robot.txt google error

  • Unknown's avatar

    I’ve been googling and reading forums for about 3 hours and nothing can answer my issue. I paid $100 for wordpress SEO, with no real luck, how do I utilise this SEO through wordpress? ALSO when i search my website in goggle, it says no description is available because of the robot.txt file. WHere is this file? how do I edit or remove it?

    The blog I need help with is: (visible only to logged in users)

  • Unknown's avatar

    That file hosted on wp.com and as I know we can’t edit that file.

  • Unknown's avatar

    @hdsusanto – this is the second answer you have given that is completely wrong

    @wood – is my blog working shows your robots.txt file set correctly to let in search engines –

    Not sure who you paid the $ 100 to for SEO – but they obviously did not give you any good advice

    You have a small blog with a few pages and only one Post – that will never search well –

    Your single Post is the right idea – make more posts on different projects – with 15 years experience you should have a big pile of pictures of different projects, start Posting about the projects you have done, what was special about each project, challenges etc. That will make your blog look like it is alive and give your customers a better idea of what you can do for them

  • Unknown's avatar

    Thanks for your reply. How do I remove it then?

  • Unknown's avatar

    HI AUx class, can you please explain what you mean by “is my blog working shows your robot.txt file set correctly”? is this through the reading settings section where it says to allow search engines to index this site?

  • Unknown's avatar

    Just one of the tools we use to help see how a blog is set up: http://ismyblogworking.com/woodwoodwoodwood.com

    The robot.txt file is controlled from Dashboard >> Settings >> Reading >> you have set your blog to allow search engines in – that setting goes to the robots.txt file for you – you can’t directly edit the file – but your settings at Reading are reflected in the file

  • Unknown's avatar

    is this through the reading settings section where it says to allow search engines to index this site?

    Yes

  • Unknown's avatar

    Yes, there’s an options for clawer, but how I edit that, something like disallow: /terms-of-use/ ? I even not created this http://hdsusanto.wordpress.com/robots.txt

  • Unknown's avatar

    If the settings are reflected through that reading setting.. Then why wont a description show up in google because it is blocked by the robot.txt file? I’ve allowed for search engines in the reading setting

  • Unknown's avatar

    It takes Google a while to update it’s cache of your site – and since you don’t have much content on your site – Google will be slow to update your site settings –

    like I said above – make more Posts – each time you make a new Post – your site calls up search engines and says “new stuff – stop by and see what we have”

  • The topic ‘robot.txt google error’ is closed to new replies.