[H-GEN] Multi-thread downloads

Brendan bmccarthy at iinet.net.au
Thu May 27 00:15:44 EDT 2004


I believe prozilla ( http://prozilla.genesys.ro/ ) is what you are
looking for.

-Brendan McCarthy

On Thu, 2004-05-27 at 12:45, Harry Phillips wrote:
> [ Humbug *General* list - semi-serious discussions about Humbug and     ]
> [ Unix-related topics. Posts from non-subscribed addresses will vanish. ]
> I have looked and not found anything, what I want to do is to be able to 
> download single files using multiple threads. If anyone has seen it then 
> Download Accelerator Plus (DAP) for windows does exactly what I want to do.
> It will detect if the server allows resume, (very few don't these days) 
> it then splits the download into several threads. If the files is 4M 
> then thread one will download from 0 to the 1M mark, thread two from 1M 
> to the 2M mark, etc etc. Once all four pieces complete it then puts the 
> file back together.
> If you know of anything for Linux like this please let me know, if there 
> is nothing then I think I have found my first project once my 
> programming skills have developed enough :)
> One of the reasons behind this is the throttling they now do at the 
> humbug meetings. Each thread is limited to 8k/s, if you use DAP and set 
> it to have 8 threads per file then the file comes in at 8*8k, giving you 
> 64k/s.
> Download the same file using a Linux box and it takes 8 times longer, 
> 1*8k/s = 8k/s.

More information about the General mailing list