W3C home > Mailing lists > Public > www-lib@w3.org > July to September 1999

RE: fast robot

From: Franšois-Louis Mommens <mommens@echo.fr>
Date: Sat, 10 Jul 1999 15:22:50 +0200
To: "Vladimir Kozlov" <Vladimir.Kozlov@idm.ru>, <www-lib@w3.org>
Message-ID: <003601becad7$4f1e0760$7e01a8c0@orion.echo-net.net>
Thanks for your response but it's not exactly what I'm looking for.

In fact, I'm working on a search engine project and I only need the begining
of web pages cause I can't keep the totality.

This method of ranges work only with a few amount of web servers. What I
realy need is to stop the transfer of data anyway.

> -----Message d'origine-----
> De: Vladimir Kozlov [mailto:Vladimir.Kozlov@idm.ru]
> Date: vendredi 9 juillet 1999 12:30
> └: Franšois-Louis Mommens; www-lib@w3.org
> Objet: Re: fast robot
>
>
> Hi,
>
> Make a look at http://www.w3.org/Library/Examples/range.c linked
> from http://www.w3.org/library/Examples/ - I think this is
> exactly what you need (but how can you use robot without parsing
> the whole document - the link could be at the bottom of it).
>
> Kind regards,
>
> Vladimir.
>
> -------------------------
> Vladimir Kozlov, IDM Ltd.
>
> e-mail     : mailto:Vladimir.Kozlov@idm.ru
> PGP Key ID : 0x5360FA9B
> Phone      : +7 (095) 534-4221
> Fax        : +7 (095) 530-2275
> www        : http://www.idm.ru
>
> ----- Original Message -----
> From: Franšois-Louis Mommens <mommens@echo.fr>
> To: <www-lib@w3.org>
> Sent: Saturday, July 10, 1999 2:03 PM
> Subject: fast robot
>
>
> > Hi,
> >
> > I would like my robot to stop reading a document after a
> certain size for I
> > only need the begining of documents. Which is the most
> straightforward way
> > to do that ?
> > Thanks for any help.
> >
>
Received on Friday, 9 July 1999 09:29:51 UTC

This archive was generated by hypermail 2.3.1 : Wednesday, 5 February 2014 07:15:16 UTC