By using seoforum’s services you agree to our Cookies Use and Data Transfer outside the EU.
We and our partners operate globally and use cookies, including for analytics, personalisation, ads and Newsletters.

  • Join the best UK dedicated SEO Forum

    Provide or get advice on everything SEO, ask questions, gain confirmation or just become apart of a friendly, like minded community who love SEO and Online Marketing.


    Join 50,000 members!

Robots.txt

N

Nodnyl

New Member
Hi, I started my website at the beginning of January, so it's been live for 3, almost 4 months now.

I only started tweaking and building the SEO, probably around February, and recently this month, i've been trying my best to build backlinks to similar sites. I noticed my DR wasn't going up much and is currently on 0.7.

In February I paid a company on Fiver to help with my HTML and robots.txt , as I have no idea what to do with it, but upon looking at my metrics on ahrefs, I can see that all they did with robots.txt , is block 121 pages so that they won't show up when being crawled.

I'm currently not getting any organic traffic at the moment, and i'm very new to this, so I was curious to know whether this could partly be down to the fact that a lot of my pages have been Disallowed by robots.txt. The other strange thing is, when I go onto my robots.txt and there's nothing in it, but when I search for my website follow by robots.txt , I have loads of disallows.

Can anybody give me some advise?

Thanks

 
John_Collinson

John_Collinson

Member
Established Memeber
You have to look - maybe they've blocked "junk" pages that shouldn't be included in search and ranking. Or it could be that they have blocked important pages. You need to look at what exactly has been done.
 
K

kenworth

New Member
Established Memeber
You can use google search console to test a crawl to any page, it will tell you if a page is blocked by robots.txt or can be indexed. Are all your pages indexed?
 
Business SEO Services Business SEO Services

Latest Products

  • [Rivmedia] Lazy Loader XF2
    [Rivmedia] Lazy Loader XF2
    Load images asynchronously on your forum, allowing images to be loaded only when they are in view
    • Rivmedia
    • Updated:
  • [Rivmedia] Guest Redirect & Profile unlink
    [Rivmedia] Guest Redirect & Profile unlink
    Forums which prevent member profile access for guests, redirction and unlinking for profiles
    • Rivmedia
    • Updated:
  • [Rivmedia] Simple Redirects
    [Rivmedia] Simple Redirects
    Simple redirects allows forum admins to make simple 301 or 302 redirects via their admin panel
    • Rivmedia
    • Updated:
  • [Rivmedia] Minimum Message Length
    [Rivmedia] Minimum Message Length
    Eradicate short, pointless posts with a minimum message length and improving content worth on a thre
    • Rivmedia
    • Updated:
Top