NameSilo

Robots.txt - Requesting confirmation

Namecheap AuctionsNamecheap Auctions
Namecheap AuctionsNamecheap Auctions
SpaceshipSpaceship
Watch

JGK

Established Member
Impact
18
Hi all,

I have some sites which are being built off of a template I've customized. The problem is that means several of the "documents" will be very similar, only changing in the places where the name is referenced (dynamic).

Please let me know whether you think there will be any problems using the following to block robot access to those certain pages, which are in the main directory, while not restricting access to all other pages.

User-Agent: *
Disallow: /privacy.php
Disallow: /contact.php
Disallow: /terms.php
Allow: /

Thank you for the help.

Regards,
Josh
 
0
•••
The views expressed on this page by users and staff are their own, not those of NamePros.
AfternicAfternic
CatchedCatched

We're social

Escrow.com
Spaceship
Domain Recover
CryptoExchange.com
Catchy
DomDB
NameFit
  • The sidebar remains visible by scrolling at a speed relative to the page’s height.
Back