Sitemap generators.

[unknowngiver]

Hey
I know some PHP and mysql and other languages...and i wanted to know if anyone can find me a tutorial on how sitemaps are generated..so i can try to make a sitemap generator script...i know there are already sites out there that make sitemaps for u..even free...but my purpose is to learn too make my own...
thanks

 

[Xyzer]

Here is a free site that may help you on your travels, rep would be appreciated.

http://www.xml-sitemaps.com/

 

[unknowngiver]

grr did u read my post
i know that website already..i dont want a free generator..i want to know how to MAKE one..how do they work

 

[Peter]

It is fairly simple to do.

With the address you are given you would need to get the pages html and parse it ie taking all of the links out of it (only the internal links).

With the links gained check and ensure that you do not have any duplicates and add them to the sitemap. Then go into each link and do the same again (again ensuring the same links do not exist twice, nor a page is linking too itself). You may also want to log how deep into the site you have gone 9you may for example only want to go 5 deep) and how many links you have gained (sitemaps are usually limited on how many links can go in them and how big the files can be).

 

[cef]

As Peter said, what you want is to write what's known as a spider to crawl the pages on your site. The results of the crawl will be used as the basis for generating the sitemap.

If you'd rather focus your efforts on the sitemap generator functionality and not get bogged down in writing the spider itself, you can find many free php spider scripts at hotscripts which you can use as the foundation for your system: http://www.hotscripts.com/search/15117683.html

 

[unknowngiver]

As Peter said, what you want is to write what's known as a spider to crawl the pages on your site. The results of the crawl will be used as the basis for generating the sitemap.

If you'd rather focus your efforts on the sitemap generator functionality and not get bogged down in writing the spider itself, you can find many free php spider scripts at hotscripts which you can use as the foundation for your system: http://www.hotscripts.com/search/15117683.html

no i dont want to make a searchengine..i just want to make a script like
http://www.xml-sitemaps.com/ to generate my own sitemaps
anyway..peter..thanks..that helped..now is there a script that does it out there? wherei can actually see the code? or partial code..so i know where to start from

and what is the format in XML that i have to save?

 

[cef]

no i dont want to make a searchengine..i just want to make a script like
http://www.xml-sitemaps.com/ to generate my own sitemaps

I know that. But sitemap generators work the same way. Internally, they are very similar.

I've actually written a site search engine AND a sitemap generator, and they share a lot of code, starting with the page parser and site crawler.

Anyway, good luck.

//unsubscribes