spider : Java Glossary

spider

Search engines wander over the Internet discovering new or changed html pages. They index the words of declared keywords in them. This sniffing process is called spidering.

The Altavista people used to distribute a free personal spider, Discover 1.1 that would index your local hard disk or arbitary websites. Then you could find stuff in them with the Discover search engine. I use a similar too called called Copernic for searching the complete JDK (Java Development Kit) documentation and Javadoc.

Keywords

The trick to attracting visitors to your website is to help the search engines find what you have to offer so they will have it on tap in their indexes when people ask for it. This means you have to consider two things:

What do I have to offer? How can I describe it in ways that summarises it, expecially highighting its uniqueness?
What questions are people going to ask for which I have a ready made answer? Make sure the important, and especially unusual words in those queries appear both in text body of your web pages and in the keywords header.

Don’t cheat. Don’t lie. Don’t mislead. Above all, don’t litter your pages with spider food. 100% honesty helps and impresses the search engine companies and they reward you with higher preferential ranking. All those companies who offer to use deception to artifically boost your search enginge rankings may work for a short while, but they could well ruin your reputation and, consequently, your long term hit rate.

Copernic
Lucene
search engine
sitemap

	You can get the freshest copy of this page from:	or possibly from your local J: drive (Java virtual drive/mindprod.com website mirror)
	http://mindprod.com/jgloss/spider.html	J:\mindprod\jgloss\spider.html
	Please email your feedback for publication, letters to the editor, errors, omissions, typos, formatting errors, ambiguities, unclear wording, broken/redirected link reports, suggestions to improve this page or comments to Roedy Green : . If you want your message, your name or email kept confidential, not considered for public posting, please explicitly specify that. Unless you state otherwise, I will treat your message as a letter to the editor that I may or may not publish in the feedback section. After that, it will be too late to retract it. If you disagree with something I said, please quote it and cite the web page where you found it, tell me why you think it is wrong, and, if possible, provide some supporting evidence. Threatening to kill me or spouting obscenities has yet to persuade me to change my mind.
	Canadian Mind Products
	mindprod.com IP:[65.110.21.43]
view Blog	Your face IP:[38.107.179.211]
Feedback	You are visitor number 10,232.