Script to generate sql databases.

[inspiration100]

Hey, I'm in a real deep need of a script that crawls sites and inserts stuff from the site into a mysql database. Does this exist? Basically lets say I see a site that has a million poems and I want that inserted into a database, but I don't want to copy them all by hand. Does a script exist that will crawl and add them?
Much Appric,
-Joseph

 

[RageD]

This is possible, but you would need access to the site's DB with the poems to retrieve the info and copy them to your DB..

-RageD

 

[inspiration100]

Well what i'm looking for is a script that creates databases from simple html files. A crawler. All my NP$ to someone who finds something for this that exists.

 

[The Engineer]

What about this, bit expensive but does the job.Easygen

 

[adam_uk]

are you sure you have permission to steal content, i think id be a bit annoyed if you came and crawled and copied every page of one of my websites

 

[inspiration100]

yes you have permission if its something of public domain