Bull Finance Forum

News:

  • Welcome to Bull Finance Forum! Help us grow our community with quality content.
  • Do you have one project and need a community space? Contact us for more info.
  • Track all news about crypto on our news portal.

News

Welcome to Bull Finance Forum! Help us grow our community with quality content.

is my robots.txt file blocking my website to be index?

admin · 65

0 Members and 1 Guest are viewing this topic.

Offline admin

  • Bull Finance
  • Administrator
  • Full Member
  • *****
    • Posts: 203
    • Karma: +501/-235
  • Community Forum
    • View Profile
    • Bull Finance
That´s a great question. Your robots.txt file allow you to setup what directories should be indexed. By example if you don´t want the directory "test" to be indexed your robots.txt file should look like these:

User-agent: *
Disallow: /test

If you don´t have any restrictions about the index your file should be like these:

User-agent: *
Disallow:

If your file robots.txt have " Disallow: / " your are telling to google to don´t index the root directory. Your website root directory
If you need one example file, check the attachment above.
« Last Edit: April 05, 2022, 09:49:03 PM by admin »

Bull Finance | Team