• Join the best UK dedicated SEO Forum

    Provide or get advice on everything SEO, ask questions, gain confirmation or just become apart of a friendly, like minded community who love SEO and Online Marketing.


    Join 50,000 members!

Robots.txt

N

Nodnyl

New Member
Hi, I started my website at the beginning of January, so it's been live for 3, almost 4 months now.

I only started tweaking and building the SEO, probably around February, and recently this month, i've been trying my best to build backlinks to similar sites. I noticed my DR wasn't going up much and is currently on 0.7.

In February I paid a company on Fiver to help with my HTML and robots.txt , as I have no idea what to do with it, but upon looking at my metrics on ahrefs, I can see that all they did with robots.txt , is block 121 pages so that they won't show up when being crawled.

I'm currently not getting any organic traffic at the moment, and i'm very new to this, so I was curious to know whether this could partly be down to the fact that a lot of my pages have been Disallowed by robots.txt. The other strange thing is, when I go onto my robots.txt and there's nothing in it, but when I search for my website follow by robots.txt , I have loads of disallows.

Can anybody give me some advise?

Thanks

 
John_Collinson

John_Collinson

Member
Established Memeber
You have to look - maybe they've blocked "junk" pages that shouldn't be included in search and ranking. Or it could be that they have blocked important pages. You need to look at what exactly has been done.
 
K

kenworth

New Member
Established Memeber
You can use google search console to test a crawl to any page, it will tell you if a page is blocked by robots.txt or can be indexed. Are all your pages indexed?
 
Business SEO Services Business SEO services UK

Latest Products

Join the UK's SEO community

Ask about a ranking drop, share a test result, get a second opinion on a link. Membership is free and takes a minute.

Create a free account
Top