web bot or something like it.

slipondajimmy · 02-23-2007, 06:22 AM

Hey everyone.

Is there a place that I can get a bot (like google) that will crawl websites and such? I want to find sites with specific keywords and in a certain industry.

Or is there a application out there somewhere that will do this?

Barrucadu · 02-23-2007, 09:19 AM

Google has, I think, a custom search engine feature, it should be on the site somewhere.

slipondajimmy · 02-23-2007, 10:34 AM

Originally Posted by Mikor

Google has, I think, a custom search engine feature, it should be on the site somewhere.

I didnt even think of that. Im note sure that its really what I want but I will take a look.

02-23-2007, 06:22 AM	THREAD STARTER #1 (permalink)
slipondajimmy Senior Member Join Date: Nov 2003 Location: Florida Posts: 2,026	web bot or something like it. Hey everyone. Is there a place that I can get a bot (like google) that will crawl websites and such? I want to find sites with specific keywords and in a certain industry. Or is there a application out there somewhere that will do this?

02-23-2007, 09:19 AM	#2 (permalink)
Barrucadu Senior Member Join Date: Aug 2005 Location: East Yorkshire, England Posts: 2,689 Follow @barrucadu	Google has, I think, a custom search engine feature, it should be on the site somewhere. __________________ Website \| Blog Arch Hurd developer; GNU Webmaster; FSF member #8385

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)