Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

File transfer between clusters not working for files, only for directories #184

Open
atemate opened this issue Jan 13, 2021 · 0 comments
Open

Comments

@atemate
Copy link
Contributor

atemate commented Jan 13, 2021

Failing:

root@hello:~# neuro-extras data transfer storage://neuro-compute/yevheniisemendiak/startup_package_test/mlruns/0/bd26789fb5c6441f8a31f4a8da596853/artifacts/model/data/model.h5 storage://onprem-poc/artemyushkovskiy/startup_package_test/mlruns/0/bd26789fb5c6441f8a31f4a8da596853/artifacts/model/data/model.h5
INFO: Already on cluster: onprem-poc
Running 'neuro run -s cpu-small --pass-config -v storage://onprem-poc/artemyushkovskiy/startup_package_test/mlruns/0/bd26789fb5c6441f8a31f4a8da596853/artifacts/model/data/model.h5:/storage:rw -e NEURO_CLUSTER=neuro-compute neuromation/neuro-extras:20.12.16 neuro cp --progress -r -u -T storage://neuro-compute/yevheniisemendiak/startup_package_test/mlruns/0/bd26789fb5c6441f8a31f4a8da596853/artifacts/model/data/model.h5 /storage'
Temporary config file created on storage: storage://onprem-poc/artemyushkovskiy/.neuro/99821d56-819b-4660-9d49-7a3d1ac42f60-cfg.
Inside container it will be available at: /var/storage/.neuro/99821d56-819b-4660-9d49-7a3d1ac42f60-cfg.
√ Job ID: job-bde18bc3-9df2-4c8c-beed-780f075aa8d1
- Status: pending Creating
- Status: pending Scheduling
√ Http URL: https://job-bde18bc3-9df2-4c8c-beed-780f075aa8d1.jobs.onprem-poc.org.neu.ro
√ The job will die in a day. See --life-span option documentation for details.
√ Status: running                        
√ =========== Job is running in terminal mode ===========
√ (If you don't see a command prompt, try pressing enter)
√ (Use Ctrl-P Ctrl-Q key sequence to detach from the job)
[09:14:49] Copying storage://neuro-compute/yevheniisemendiak/startup_package_test/mlruns/0/bd26789fb5c6441f8a31f4a8da596853/artifacts/model/data/model.h5 => /storage                                              
[09:14:50] Copying: storage://neuro-compute/yevheniisemendiak/startup_package_test/mlruns/0/bd26789fb5c6441f8a31f4a8da596853/artifacts/model/data/model.h5                                                         
model.h5 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━   0% 0.0/77.1 MB ?
ERROR: cannot copy storage://neuro-compute/yevheniisemendiak/startup_package_test/mlruns/0/bd26789fb5c6441f8a31f4a8da596853/artifacts/model/data/model.h5 to file:///storage: [Errno 21] Is a directory: '/storage'

Working:

neuro-extras data transfer storage://neuro-compute/yevheniisemendiak/startup_package_test/mlruns/0/bd26789fb5c6441f8a31f4a8da596853/artifacts/model storage://onprem-poc/artemyushkovskiy/startup_package_test/mlruns/0/bd26789fb5c6441f8a31f4a8da596853/artifacts/model
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant