Robots.txt - Requesting confirmation

SpaceshipSpaceship
Watch

JGK

Established Member
Impact
18
Hi all,

I have some sites which are being built off of a template I've customized. The problem is that means several of the "documents" will be very similar, only changing in the places where the name is referenced (dynamic).

Please let me know whether you think there will be any problems using the following to block robot access to those certain pages, which are in the main directory, while not restricting access to all other pages.

User-Agent: *
Disallow: /privacy.php
Disallow: /contact.php
Disallow: /terms.php
Allow: /

Thank you for the help.

Regards,
Josh
 
0
•••
The views expressed on this page by users and staff are their own, not those of NamePros.
Unstoppable Domains — AI StorefrontUnstoppable Domains — AI Storefront
Appraise.net

We're social

Escrow.com
Spaceship
Rexus Domain
CryptoExchange.com
Domain Recover
CatchDoms
NameMaxi - Your Domain Has Buyers
DomDB
  • The sidebar remains visible by scrolling at a speed relative to the page’s height.
Back