Bots and crawlers

snt@premier1.net ((snt@premier1.net))
Thu, 5 Oct 1995 14:02:15 -0700

Hi gang,
Listen, from a marketing stand point I am trying to understand how search
bots (worms, crawlers, spiders etc.) search webpages.
I have discovered many people are like myself and don't know these answers.
For now lets just call this type of marketing "cloaking". Named after those
sneaky old Klingons 'cause you never knew if they were there.
I thought search bots only scan for links and keywords in the descriptions I
submit to places like yahoo or infoseek. What I am realizing is that
searches may also scan for links and keywords in the html, possibly just in
the title or header. Heck I don't really know or understand bots anyhow.
But from a marketing stand point if you understand where the little buggers
search for their information you can plant your "signs" accordingly and
better manipulate your chances for exposure.
So how 'bout it, anyone out there able to explain, educate or point me in
the right direction?
I will post a FYI on the results of this query as it all comes together.
Thanks in advance.

btw It is great sharing information with you as opposed to someone thinking
if they give up tips they lose something. This idea of mailing lists and
newsgroups and communication will sustain the Internet thru all its coming
battles.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
i D E A S -=)&gt; i D E A S --==)&gt; i D E A S ---===)&gt; I nternet
Roy Harvey D evelopment &amp;
<a href="<a href="http://">http://</a>">http://</a>"under construction" /~_0 _0 E lectronic
snt@premier1.net _o\&lt;-\-&lt;--_ A dvertising
voice:800 545-7407 (*)-/---/-(*) S ervices
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

----
This week's sponsor:
Marketing to Women Online Conference &lt;<a href="<a href="http://kelseygroup.com/kelsey">http://kelseygroup.com/kelsey</a>">http://kelseygroup.com/kelsey</a>&gt;

Sponsor the Internet Marketing Discussion List! See the URL
&lt;<a href="<a href="http://www.popco.com/hyper/internet-marketing/sponsor.html">http://www.popco.com/hyper/internet-marketing/sponsor.html</a>">http://www.popco.com/hyper/internet-marketing/sponsor.html</a>&gt; for details

Messages sorted by: [ date ][ thread ][ subject ][ author ]
Next message: mcrosson@ix.netcom.com: "Internet Marketing Digest #0445"
Previous message: steve@webmedia.com: "Netscape vs. standards"

Return to top-level of current discussion

Return to Internet Marketing Home Page

Post a message to this group by filling in the form below.