Download performance

[rossengeorgiev]

Looks like the single threaded nature of the depot download implementation can limit the download speed. Need to look into multi-thread or multi-process solution in order to saturate fat pipes.

[rossengeorgiev]

download_to needs to implement a global chunk download task pool to ensure io is saturated

[nutterthanos]

um speaking of which my download performance is very slow

i would think its because single thread
or would it be because of this #44
@rossengeorgiev

[nutterthanos]

um steam is also now being slow using download_depot don't know why tho

[rossengeorgiev]

Downloading is IO intensive task, which is fine on single thread for downloading. The single thread bottleneck mentioned here is due to the decryption of the chunks, which a CPU heavy task. To improve performance, the decryption needs to be parallelized across the available cores.

Regardless, the speed will never be that low. There isn't enough information to determine why you are experiencing slow download. Could be slow storage, network connectivity, bad cache servers, etc

[nutterthanos]

nope its not slow storage, or my network, maybe lancache is being slower lately when getting chunks upstream
but then again it isn't this slow if i just install a game normally in steam client.
it only seems to do it if i use steamctl or download_depot
i mean if the chunks are already in my lancache it works fine using download_depot or steamctl but using those without the chunks already in lancache its slow i mean i don't know if its slow without lancache at all

[nutterthanos]

also if i download the chunks or whatever using aria2 is seems to work fine like installing a game normally

[GazziFX]

Is it not ready yet? I have only half or less of my normal speed

[nutterthanos]

it seems the dev has gone missing or something