A touble with robot.txt and plugins

  • Unknown's avatar
    knjigoljupci · Member ·

    I have a blog since 2011.
    Until recently, everything looked ok. (Or I’m not occurred on that something was wrong.) A few months ago, it was enough to enroll in the portion of the blog’s name. For example, only “knjigoljupci” or a title of subject on which I wrote, and my site appeared in the browser (knjigoljupci.wordpress.com and knjigoljupci.com). Now, it is visible only to the Google Chrome. Below the name of the site writes:
    A description for this result is not available because of this site’s robots.txt – learn more.

    My robot.txt file looks like this:

    # This file was generated on Tue, 10 Feb 2015 16:25:29 +0000
    # If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.
    # Please see http://en.wordpress.com/firehose/ for more details.

    Sitemap: http://knjigoljupci.com/sitemap.xml
    Sitemap: http://knjigoljupci.com/news-sitemap.xml

    User-agent: IRLbot
    Crawl-delay: 3600

    User-agent: *
    Disallow: /next/

    User-agent: *
    Disallow: /mshots/v1/

    # har har
    User-agent: *
    Disallow: /activate/

    User-agent: *
    Disallow: /wp-login.php

    User-agent: *
    Disallow: /related-tags.php

    User-agent: *
    Disallow: /public.api/

    # MT refugees
    User-agent: *
    Disallow: /cgi-bin/

    User-agent: *
    Disallow: /wp-admin/

    How do I fix this?

    I also noticed that do not have the plugin icon on the control panel. Why? I am ownoer of the domain knjigoljupci .com. since March 2014. Do I have the right to use plugins?

    The blog I need help with is: (visible only to logged in users)

  • Unknown's avatar
    raincoaster · Member ·

    Please do a search of this forum for “Plugins” and you’ll find the answer to the last question.

  • Unknown's avatar
    justjennifer · Member ·

    Essentially your robots.txt allows crawling of your site by all user-agents, with the exception of the above folders — none of which would affect how your site will appear in search results.

    A few months ago, it was enough to enroll in the portion of the blog’s name

    So you fairly recently bought a custom domain name? That would affect search engine results.

  • Unknown's avatar
    knjigoljupci · Member ·

    Ok, maybe a new custom domain name with .com instead of .wordpres.com, affected search engine results for a while. But it is normal, I suppose, for this problem, to be fixed, as time goes on, not to become worse.

    (I apologize because of my English, I know that i am not so good…)

    For example, if I enroll in “knjigoljupci” at Opera browser, on the top of the page I see another site which has linked one page of knigoljupci.com, (for purpose of recommendation…), but not my blog.

    I am completely confused…
    At any case, thank you for answer.

  • The topic ‘A touble with robot.txt and plugins’ is closed to new replies.