[H-GEN] Multi-thread downloads

Harry Phillips harry at tux.com.au
Wed May 26 22:45:08 EDT 2004


I have looked and not found anything, what I want to do is to be able to 
download single files using multiple threads. If anyone has seen it then 
Download Accelerator Plus (DAP) for windows does exactly what I want to do.

It will detect if the server allows resume, (very few don't these days) 
it then splits the download into several threads. If the files is 4M 
then thread one will download from 0 to the 1M mark, thread two from 1M 
to the 2M mark, etc etc. Once all four pieces complete it then puts the 
file back together.

If you know of anything for Linux like this please let me know, if there 
is nothing then I think I have found my first project once my 
programming skills have developed enough :)

One of the reasons behind this is the throttling they now do at the 
humbug meetings. Each thread is limited to 8k/s, if you use DAP and set 
it to have 8 threads per file then the file comes in at 8*8k, giving you 
64k/s.

Download the same file using a Linux box and it takes 8 times longer, 
1*8k/s = 8k/s.

-- 
Regards,
Harry Phillips

All expressed opinions are mine I tell you, all mine,
mine, mine, mine, mine, mine.




More information about the General mailing list