Connected to Redis broker. /sbin/docker-prepare.sh: line 71: /usr/src/paperless/data/migration_lock: Permission denied

[olli0815]

Description

deploy stack within Portainer

Steps to reproduce

deploy stack with external share:

Connected to Redis broker.
/sbin/docker-prepare.sh: line 71: /usr/src/paperless/data/migration_lock: Permission denied

external mount (CIFS) and mounted volume has all rights...incl. guest user access...

root@docker:~# ls -la /var/snap/docker/common/var-lib-docker/volumes/PAPERLESS_DATA/_data 
total 40
drwxrwxrwx 5 ole  users  4096 Dez 11 14:36 .
drwxrwxrwx 3 root root   4096 Dez 11 13:34 ..
-rwxrwxrwx 1 ole  users 16384 Dez 11 14:34 celerybeat-schedule.db
drwxrwxrwx 2 ole  users  4096 Dez 11 13:34 index
-rwxrwxrwx 1 ole  users     2 Dez 11 13:34 .index_version
drwxrwxrwx 2 ole  users  4096 Dez 11 13:34 log
-rwxrwxrwx 1 ole  users     0 Dez 11 14:36 migration_lock
drwxrwxrwx 5 ole  users  4096 Dez 11 13:34 nltk

Webserver logs

Waiting for PostgreSQL to start...
Waiting for Redis...
Connected to Redis broker.
/sbin/docker-prepare.sh: line 71: /usr/src/paperless/data/migration_lock: Permission denied
Paperless-ngx docker container starting...
Creating directory /tmp/paperless
[nltk_data] Downloading package snowball_data to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package snowball_data is already up-to-date!
[nltk_data] Downloading package stopwords to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package stopwords is already up-to-date!
[nltk_data] Downloading package punkt to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package punkt is already up-to-date!
Adjusting permissions of paperless files. This may take a while.
Waiting for PostgreSQL to start...
Waiting for Redis...
Connected to Redis broker.
/sbin/docker-prepare.sh: line 71: /usr/src/paperless/data/migration_lock: Permission denied
Paperless-ngx docker container starting...
Creating directory /tmp/paperless
[nltk_data] Downloading package snowball_data to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package snowball_data is already up-to-date!
[nltk_data] Downloading package stopwords to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package stopwords is already up-to-date!
[nltk_data] Downloading package punkt to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package punkt is already up-to-date!
Adjusting permissions of paperless files. This may take a while.
Waiting for PostgreSQL to start...
Waiting for Redis...
Connected to Redis broker.
/sbin/docker-prepare.sh: line 71: /usr/src/paperless/data/migration_lock: Permission denied
Paperless-ngx docker container starting...
Creating directory /tmp/paperless
[nltk_data] Downloading package snowball_data to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package snowball_data is already up-to-date!
[nltk_data] Downloading package stopwords to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package stopwords is already up-to-date!
[nltk_data] Downloading package punkt to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package punkt is already up-to-date!
Adjusting permissions of paperless files. This may take a while.
Waiting for PostgreSQL to start...
Waiting for Redis...
Connected to Redis broker.
/sbin/docker-prepare.sh: line 71: /usr/src/paperless/data/migration_lock: Permission denied
Paperless-ngx docker container starting...
Creating directory /tmp/paperless
[nltk_data] Downloading package snowball_data to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package snowball_data is already up-to-date!
[nltk_data] Downloading package stopwords to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package stopwords is already up-to-date!
[nltk_data] Downloading package punkt to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package punkt is already up-to-date!
Adjusting permissions of paperless files. This may take a while.
Waiting for PostgreSQL to start...
Waiting for Redis...
Connected to Redis broker.
/sbin/docker-prepare.sh: line 71: /usr/src/paperless/data/migration_lock: Permission denied
Paperless-ngx docker container starting...
Creating directory /tmp/paperless
[nltk_data] Downloading package snowball_data to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package snowball_data is already up-to-date!
[nltk_data] Downloading package stopwords to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package stopwords is already up-to-date!
[nltk_data] Downloading package punkt to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package punkt is already up-to-date!
Adjusting permissions of paperless files. This may take a while.
Waiting for PostgreSQL to start...
Waiting for Redis...
Connected to Redis broker.
/sbin/docker-prepare.sh: line 71: /usr/src/paperless/data/migration_lock: Permission denied
Paperless-ngx docker container starting...
Creating directory /tmp/paperless
[nltk_data] Downloading package snowball_data to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package snowball_data is already up-to-date!
[nltk_data] Downloading package stopwords to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package stopwords is already up-to-date!
[nltk_data] Downloading package punkt to
[nltk_data]     /usr/src/paperless/data/nltk...
[nltk_data]   Package punkt is already up-to-date!
Adjusting permissions of paperless files. This may take a while.
Waiting for PostgreSQL to start...
Waiting for Redis...
Connected to Redis broker.
/sbin/docker-prepare.sh: line 71: /usr/src/paperless/data/migration_lock: Permission denied

Browser logs

No response

Paperless-ngx version

latest

Host OS

ubuntu 20.4

Installation method

Docker - official image

Browser

No response

Configuration changes

No response

Other

No response

[stumpylog]

• If you run flock as the user ole does it work?
• Is there CIFS options required for file locking?
• Based on the CIFS details of the flock manual, this is an EACCES error.
• Have you tried stopping the container, manually removing the file and starting the container?

[olli0815]

Don't know flock.

What works sometimes is: deploying the containers locally than stop - migrate (copy over the _data-files) and than redeploy the stack.
Bus only with the data folder - not for the media server.
Are there known issues with smb? what would be the share-protocol of choice?

[stumpylog]

NFS might work better. But CIFS does tend to have oddities about certain normal operations, like flock it seems.

[olli0815]

deploying the stack w/o a proper external folder mapping / mounts is a very rar use case (IMHO)

[olli0815]

question? where to create the consume and export folder?

[olli0815]

outside the docker manged _data-folder of course?

[olli0815]

IMHO it's still a Bug -> Installer should be able to deploy / mkdir on external file system with 777.

[olli0815]

IMHO it's still a Bug -> Installer should be able to deploy / mkdir on external file system with 777.
wondering be the first trying to mount SMB_Share...
this should be cause a problem from the incident, and be solved
at least user running more than one container / stack on there system won't expose host-folders outside the docker managed volumes

[westd05]

I have the same issue running it on a Synology. When I deploy the container with external mount/mapping.

[philipcristiano]

Running into this as well when using Nomad/NFS/Synology mounts.

[olli0815]

check UID and GID mapping...in docker compose

[philipcristiano]

Just following up in case other people continue running into this.

It's not a filemode or u/guid issue in my case. file locking just isn't supported in my setup.

As a workaround I use a Nomad template to replace the docker_prepare.sh file with one that does not use flock.

[github-actions[bot]]

This discussion has been automatically locked since there has not been any recent activity after it was closed. Please open a new discussion for related concerns.