recursive url retriever

hi,

I am searching for a chunk of code that do a recursive url search (with
depth control).
I know there is the libwww robot example, but could you please point me
at least what file to check for this?

thanks,

bye