Robots.txt - Requesting confirmation

SpaceshipSpaceship
Namecheap AuctionsNamecheap Auctions
Spacemail by SpaceshipSpacemail by Spaceship
Watch

JGK

Established Member
Impact
18
Hi all,

I have some sites which are being built off of a template I've customized. The problem is that means several of the "documents" will be very similar, only changing in the places where the name is referenced (dynamic).

Please let me know whether you think there will be any problems using the following to block robot access to those certain pages, which are in the main directory, while not restricting access to all other pages.

User-Agent: *
Disallow: /privacy.php
Disallow: /contact.php
Disallow: /terms.php
Allow: /

Thank you for the help.

Regards,
Josh
 
0
Close
The views expressed on this page by users and staff are their own, not those of NamePros.
GoDaddyGoDaddy
Appraise.net

We're social

Escrow.com
Spaceship
Domain Recover
CryptoExchange.com

NamePros updates

Filters for activity feeds
Your news feed, Latest activity, and the activity tab on profiles now have filter buttons: All, Posts, Quick replies, and Other. Your...
AIVikings
Catchy
  • The sidebar remains visible by scrolling at a speed relative to the page’s height.
Back