W3C home > Mailing lists > Public > www-talk@w3.org > November to December 1995

I, robot

From: Steve <steve@mordred.gatech.edu>
Date: Mon, 11 Dec 1995 15:16:30 -0500 (EST)
Message-Id: <199512112016.AA13888@mordred.gatech.edu >
To: www-talk@w3.org

Hey all,

I may have missed it in the archives, but I didn't see any topics on which
sections of a document a robot or spider or other Web traveller might examine
to determine content information.

I suppose that this sort of information could be contained in the <META> tag,

<META HTTP-EQUIV="Keywords" CONTENT="Audio/Video Equipment">
<META HTTP-EQUIV="Keywords" CONTENT="Laserdiscs sold here!">

but is this indeed what robots look for besides (I guess) the first few lines
of the document itself?

If there isn't a specific indexing method that is standard for all search
engines/robots/crawlers, shouldn't there be one?



Can't think of anything right now, other than the traditional e-mail address:
Received on Monday, 11 December 1995 15:18:26 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 21:32:58 UTC