Progress report when downloading from storage provider

[ntessore]

Is your feature request related to a problem? Please describe.
When downloading very large data sets from remote storage() in a simple CLI run, there is no indication that everything is going well, and no information about how long the process might take.

Describe the solution you'd like
It would be great if there was an optional progress indicator (e.g., progress bar). It could be toggled with, e.g., storage(..., progress=True).

Describe alternatives you've considered
It's possible to write a custom download script, wrapper for wget, etc., to provide feedback, but that ultimately means replicating the storage interface.

Additional context

[cademirch]

I've recently started using storage() and also found myself wanting a progress bar.

I'm currently working on a big logging refactor, I'll see if I can come up with a way to incorporate a progress bar for the downloads.

[cmeesters]

I think this request is a little too unspecific, as there are plugins for different storage providers. Not all of them can offer a progress bar — some cannot give a reliable estimate of the remote file size for technical reasons.

That being said: While I would like to see this feature, too, I will hardly find the time to work on it any time soon. PRs are welcome, of course. ;-)

[ntessore]

Hi @cmeesters, thanks for your consideration. Even when the total file size is not known, there could still be a "download indicator" showing that something is happening (when on a terminal). As an example, this is how rich shows progress with/without a known total:

But even just a downloaded XYZ/unknown indication on the command line would help me quite a bit. I have a HTTP storage provider that sometimes unexpectedly drops the connection, and I need to check via ls -l if the download is still progressing.