Re: Slower download with wget2 compared to original wget?

[Tim Rühsen]

Hi,

On 04.03.23 23:40, Ant wrote:
> Hello,
>
> I noticed wget2 is slower than original wget:
> $ wget2 -v 
> https://github.com/yt-dlp/yt-dlp/releases/latest/download/yt-dlp_macos_legacy[0]
>  Downloading 
> 'https://github.com/yt-dlp/yt-dlp/releases/latest/download/yt-dlp_macos_legacy' 
> ...
> HTTP response 302  
> [https://github.com/yt-dlp/yt-dlp/releases/latest/download/yt-dlp_macos_legacy]
> Adding URL: 
> https://github.com/yt-dlp/yt-dlp/releases/download/2023.03.04/yt-dlp_macos_legacy
> [0] Downloading 
> 'https://github.com/yt-dlp/yt-dlp/releases/download/2023.03.04/yt-dlp_macos_legacy'
>  ...
> HTTP response 302  
> [https://github.com/yt-dlp/yt-dlp/releases/download/2023.03.04/yt-dlp_macos_legacy]
> Adding URL: 
> https://objects.githubusercontent.com/github-production-release-asset-2e65be/307260205/57df3005-d985-41df-8d7f-6ae50b1ea75b?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20230304%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230304T223522Z&X-Amz-Expires=300&X-Amz-Signature=762c721d09cc5641a3a00d42fa56c7fbb0fc90c58df909695844ee47d6f36c2e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=307260205&response-content-disposition=attachment%3B%20filename%3Dyt-dlp_macos_legacy&response-content-type=application%2Foctet-stream
> [0] Downloading 
> 'https://objects.githubusercontent.com/github-production-release-asset-2e65be/307260205/57df3005-d985-41df-8d7f-6ae50b1ea75b?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20230304%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230304T223522Z&X-Amz-Expires=300&X-Amz-Signature=762c721d09cc5641a3a00d42fa56c7fbb0fc90c58df909695844ee47d6f36c2e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=307260205&response-content-disposition=attachment%3B%20filename%3Dyt-dlp_macos_legacy&response-content-type=application%2Foctet-stream'
>  ...
> Saving 'yt-dlp_macos_legacy'
> HTTP response 200  
> [https://objects.githubusercontent.com/github-production-release-asset-2e65be/307260205/57df3005-d985-41df-8d7f-6ae50b1ea75b?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20230304%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230304T223522Z&X-Amz-Expires=300&X-Amz-Signature=762c721d09cc5641a3a00d42fa56c7fbb0fc90c58df909695844ee47d6f36c2e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=307260205&response-content-disposition=attachment%3B%20filename%3Dyt-dlp_macos_legacy&response-content-type=application%2Foctet-stream]
>
> $ wget2 --version
> GNU Wget2 1.99.1 - multithreaded metalink/file/website downloader
> I'm using updated 64-bit Debian bulleye/stable with its kernel
> v5.10.0-21-amd64 #1 SMP Debian 5.10.162-1 (2023-01-21) x86_64 GNU/Linux
> in my custom built 14 yrs. old PC.
>
>
> Any ideas why? Thank you for reading and hopefully answering soon. :)

The reason is a many years old wget2 version in Debian.
Please report a bug and ask for a version upgrade. The more people do 
this, the higher is the likeliness that it happens.

Wget2 1.99.1 (Debian):
real    0m3,790s
user    0m0,059s
sys     0m0,063s

Wget2 2.0.1 (latest version)
real    0m0,867s
user    0m0,029s
sys     0m0,110s

Wget 1.21.3 (Debian)
real    0m0,931s
user    0m0,044s
sys     0m0,079s

This is not a real benchmark, just a quick shot.
But you see, that Debian's wget2 has an issue.
Version 1.99.1 is from Mon Apr 30 21:10:15 2018 =)

Regards, Tim

OpenPGP_signature
Description: OpenPGP digital signature