W3C home > Mailing lists > Public > www-talk@w3.org > September to October 1996

Re: HELP! auto Web data download

From: Ka-Ping Yee <s-ping@orange.cv.tottori-u.ac.jp>
Date: Fri, 20 Sep 1996 10:06:14 +0900
Message-Id: <3241EE06.269A7D28@sse.tottori-u.ac.jp>
To: Jin B Yong <jy29+@andrew.cmu.edu>
Cc: www-talk@www0.cern.ch
Jin B Yong wrote:
> 
> - i mean have netscape automatically open up at night
> - have it read off a file list of URL's to goto
> - goto each URL
> - download/copy and paste the data to the local machine by creating or
> appending the text on the URL webpage to a data/textfile on the
> harddrive.
> 
> Is this possible at all???? Is it possible to do ANY PART of this?
> need java to do this or some software that does something similar???

Yes, this is possible, and no, you don't need to do it with Java,
and no, Netscape cannot accomplish this for you.

Get Lynx.

    lynx -source http://server.site.dom/dir/file > myfile

will dump the contents of the URL "http://server.site.com/dir/file"
into a local file named "myfile".

To get this to happen at scheduled times like "at night", you can
use "cron" on a Unix system (try "man crontab").


Ping
       3B Computer Engineering, Waterloo (on exchange in Tottori, Japan)
http://www.lfw.org/math/ brings math to the Web as easy as <se>?pi?</se>
Received on Thursday, 19 September 1996 21:10:45 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Wednesday, 27 October 2010 18:14:19 GMT