Robots.Txt Issues
-
I had my site set to hidden when I first started it and now I get the “No information is available for this page.” message in place of a site description on Google even though it’s now a public site.
I’ve spent a few hours researching and attempting the suggestions made across various platforms but they all seem to come down to needing to add plugins, which (as far as I can tell) I can’t do with my non-business WordPress.com account.
This was an earlier thread I found helpful and thought would solve my problem, but I can’t even figure out how to ask Google to recrawl my URLs without installing a plugin to add meta tags… https://en.forums.wordpress.com/topic/site-made-public-but-google-still-isnt-indexing-it-robotstxt-issue/
Is it possible for me to exert any control over this issue with a non-business account? Thanks!
The blog I need help with is: (visible only to logged in users)
-
Hi there,
This is normal, and there is nothing wrong with your site’s Robots.txt file. You can view that file at https://angelacalonder.com/robots.txt and will see that it’s not blocking search engines from crawling your site.
But your site will not appear in Google results instantly. Before your site will start appearing in search results, search engines first need to index it. This process typically takes around six to eight weeks and would only have started 16 hours ago when you set your site to public, so it will still be a while.
For now the best thing you can do is to regularly publish new content so there is something for search engines to index, and otherwise be patient and wait for this process to complete.
You can read a bit more about how search engines work in this regard here:
- The topic ‘Robots.Txt Issues’ is closed to new replies.