Google doesn't crawl all of my website pages

  • Unknown's avatar
    worksecurityeu · Member ·

    I have a question about how I can say Google to crawl all of my website pages. Right know Google just crawls the home page and the robot.txt. Is there a way that I can tell Google to also crawl more pages.

    http://worksecurity.eu/robots.txt

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php

  • Unknown's avatar
    a18s · Member ·

    Hello there,

    Thanks for providing your site URL. It looks like your site is not hosted with WordPress.com. It is a site using the open-source WordPress software (from WordPress.org) but hosted with SiteGround.

    Because WordPress.com and WordPress.org are two entirely separate entities, we cannot access files or data for sites that are hosted elsewhere, so WordPress.com staff can only assist with sites that are hosted on our servers.

    You can find more information here about the differences between WordPress.org software and WordPress.com: https://wordpress.com/support/com-vs-org/

    Since SiteGround is hosting your site’s files, they also have access to those files and are the best ones to help you with this problem. You can reach out to their support team here:

    https://www.siteground.com/support

    I hope that helps :)

  • The topic ‘Google doesn't crawl all of my website pages’ is closed to new replies.