very few connections

Hi,

I have written small client that reads very large file with URLs (ca. 10
000 lines) and downloads they using method HTLoadAbsolute. First of all
this client launches 20 requests and then goes into the event loop. Each
time a request is terminated it reads new line from input file and
launches new request. After the start all goes very good - appr. 20
requests are running simultaneous, but after short time the number of
active requests decreases very quickly. By enabling the CORE-messages
(HTSetTraceMessageMask("o")) I see the following strings

.....
Net Manager     Decreasing active sockets to 4, 2 persistent sockets
Net Manager    4 active sockets, decreasing persistent sockets to 1
Host info            removed host 0x... as persistent
Host Event         host 0x... 'host1' has closed connection
Net Manager     Decreasing active sockets to 3, 1 persistent sockets
Net Manager    3 active sockets, decreasing persistent sockets to 0
Host info            removed host 0x... as persistent
Host Event         host 0x... 'host2' has closed connection
Host Event         host 0x... 'host3' has closed connection
Host Event         host 0x... 'host4' has closed connection
Host Event         host 0x... 'host5' has closed connection
.....

At this point program stops. After ~10-11  minuts the program runs
forward but stops after 1 minute. And so on.

I periodicaly run 'netstat -t' and see that the number of active sockets
permanently falls and after program's stop is even 3 and all are in the
SYN_SENT state.

It seems that the request's termination handler is not called. Why this
happens ?

Bets regards,
Alex.

P.S. I have Linux 2.2.15 (RedHat 6.0) and libwww 5.2.8.

Received on Sunday, 1 August 1999 08:33:59 UTC