Crawling other sites for data

[scott2506]

I'm wondering if there would be any issues with crawling sites like directories and indexing the links in your own directory. For example, I own a tutorial web site and want to build up the index, so to speed it up (as opposed to submitting manually), I made a PHP script which reads other tutorial sites and indexes the links to those tutorials. Is there any issues with doing this?

 

[weblord]

i think not, because these search engines and directories are producing tools that will make web sites republished their content on other web sites, such as .xml (rss feeds), and others.

 

[user-7256]

Nah, I don't think so. Directories are supposed to be public so people and spiders can access them, and web addresses don't fall under copyright laws.

Go wild!