Navidrome is constantly writing to disk #2271

lowgos · 2023-03-21T14:27:09Z

lowgos
Mar 21, 2023

Hi guys,

Quick context

I'm hosting Navidrome on a Synology NAS via Docker and I did a quick diagnostic to understand why the disk never spin down.
I isolated the problem to Navidrome, when the docker container is down the disk spin down after some time, when the container is up the disk receive writes which cause the drive to never spin down due to the activity.

I use iotop to show who is doing such activity and it's always dockerd when Navidrome is up.

More context

I use Navidrome on multiple phones with Symfonium, via the web player and sometimes through Linux desktop apps.
This is the only docker container that causes problems, I even isolated it by downing everything else.
I'm trying to make the disks spin for energy concerns. I know that it is not recommended to spin down disks regularly but I would like to do it anyway.

Questions

Is it plausible that Navidrome constantly writes to the disk? Or am I misinterpreting something? I didn't get through the Navidrome source code to find what is writing to disk but I'm 90% sure that I pinpointed to Navidrome accurately.
If it is indeed Navidrome, can I mitigate my issue and prevent megabytes from getting written to the disk when there is no activity?

Answered by lowgos

Mar 26, 2023

@deluan I found the source of my problem.
Your Docker image contains a healthcheck which generates disk usage periodically, which in turns prevents the disks of a NAS from spinning down.

I disabled the healthcheck in my docker-compose.yml which solves my problem completely and it doesn't seem to cause any problems down the line.

healthcheck:
  disable: true

View full answer

deluan · 2023-03-21T14:38:24Z

deluan
Mar 21, 2023
Maintainer

If not disabled, the Scan can cause Navidrome to read the music library file structure every minute, but not write. It should not write that amount of data in any situation, unless it is a first time scan or a forced scan. Can you share debug logs from the Navidrome container?

0 replies

lowgos · 2023-03-21T14:39:57Z

lowgos
Mar 21, 2023
Author

Oh sorry I forgot to mention some details:

I configured Navidrome with the env variable ND_SCANSCHEDULE to ND_SCANSCHEDULE=0 12 * * * to prevent scanning too much.
I turned the log level to error to prevent too much logs.
I looked through the verbose logs to try to find why Navidrome writes so much data without anyone connected but didn't find something :/
The Spotify integration is enabled.

Let me get back to you with the debug logs. ND_LOGLEVEL=debug right ?

PS: Thank you so much for such a quick answer!

0 replies

lowgos · 2023-03-21T14:49:22Z

lowgos
Mar 21, 2023
Author

Here is the docker-compose.yml I'm using to start Navidrome:

version: "3.8"
services:
  navidrome:
    image: deluan/navidrome:latest
    container_name: navidrome
    environment:
      - PUID=1029
      - PGID=100
      - TZ=Europe/Paris
      - ND_LOGLEVEL=debug
      - ND_ENABLEUSEREDITING=true # Allow users to edit their password
      - ND_ENABLESTARRATING=false
      - ND_SCANSCHEDULE=0 12 * * *
      - ND_SPOTIFY_ID=REDACTED
      - ND_SPOTIFY_SECRET=REDACTED
    volumes:
      - /volume1/docker/navidrome:/data
      - /volume1/data/media/music:/music
    ports:
      - 4533:4533
    network_mode: synobridge
    restart: unless-stopped

And here is the complete logs of the navidrome docker container, I double checked and iotop still reports batches of 600~700kB written to disk every 20 secondes or so. Only when this docker container is up.

 _   _             _     _
| \ | |           (_)   | |
|  \| | __ ___   ___  __| |_ __ ___  _ __ ___   ___
| . ` |/ _` \ \ / / |/ _` | '__/ _ \| '_ ` _ \ / _ \
| |\  | (_| |\ V /| | (_| | | | (_) | | | | | |  __/
\_| \_/\__,_| \_/ |_|\__,_|_|  \___/|_| |_| |_|\___|
                          Version: 0.49.3 (8b93962f)

Loaded configuration from '': &conf.configOptions{
    ConfigFile:                       "",
    Address:                          "0.0.0.0",
    Port:                             4533,
    MusicFolder:                      "/music",
    DataFolder:                       "/data",
    DbPath:                           "/data/navidrome.db?cache=shared&_busy_timeout=15000&_journal_mode=WAL&_foreign_keys=on",
    LogLevel:                         "debug",
    ScanInterval:                     -1,
    ScanSchedule:                     "0 12 * * *",
    SessionTimeout:                   86400000000000,
    BaseURL:                          "",
    UILoginBackgroundURL:             "/backgrounds",
    UIWelcomeMessage:                 "",
    MaxSidebarPlaylists:              100,
    EnableTranscodingConfig:          false,
    EnableDownloads:                  true,
    EnableExternalServices:           true,
    EnableMediaFileCoverArt:          true,
    TranscodingCacheSize:             "100MB",
    ImageCacheSize:                   "100MB",
    EnableArtworkPrecache:            true,
    AutoImportPlaylists:              true,
    PlaylistsPath:                    ".:**/**",
    AutoTranscodeDownload:            false,
    DefaultDownsamplingFormat:        "opus",
    SearchFullString:                 false,
    RecentlyAddedByModTime:           false,
    IgnoredArticles:                  "The El La Los Las Le Les Os As O A",
    IndexGroups:                      "A B C D E F G H I J K L M N O P Q R S T U V W X-Z(XYZ) [Unknown]([)",
    SubsonicArtistParticipations:     false,
    FFmpegPath:                       "",
    CoverArtPriority:                 "cover.*, folder.*, front.*, embedded, external",
    CoverJpegQuality:                 75,
    EnableGravatar:                   false,
    EnableFavourites:                 true,
    EnableStarRating:                 false,
    EnableUserEditing:                true,
    EnableSharing:                    false,
    DefaultTheme:                     "Dark",
    DefaultLanguage:                  "",
    DefaultUIVolume:                  100,
    EnableReplayGain:                 true,
    EnableCoverAnimation:             true,
    GATrackingID:                     "",
    EnableLogRedacting:               true,
    AuthRequestLimit:                 5,
    AuthWindowLength:                 20000000000,
    PasswordEncryptionKey:            "[REDACTED]",
    ReverseProxyUserHeader:           "Remote-User",
    ReverseProxyWhitelist:            "",
    Prometheus:                       conf.prometheusOptions{Enabled:false, MetricsPath:"/metrics"},
    Scanner:                          conf.scannerOptions{Extractor:"taglib", GenreSeparators:";/,"},
    Agents:                           "lastfm,spotify",
    LastFM:                           conf.lastfmOptions{Enabled:true, ApiKey:"[REDACTED]", Secret:"[REDACTED]", Language:"en"},
    Spotify:                          conf.spotifyOptions{ID:"[REDACTED]", Secret:"[REDACTED]"},
    ListenBrainz:                     conf.listenBrainzOptions{Enabled:true, BaseURL:"https://api.listenbrainz.org/1/"},
    DevLogSourceLine:                 false,
    DevLogLevels:                     {},
    DevAutoCreateAdminPassword:       "",
    DevAutoLoginUsername:             "",
    DevActivityPanel:                 true,
    DevSidebarPlaylists:              true,
    DevEnableBufferedScrobble:        true,
    DevShowArtistPage:                true,
    DevArtworkMaxRequests:            2,
    DevArtworkThrottleBacklogLimit:   100,
    DevArtworkThrottleBacklogTimeout: 60000000000,
    DevArtistInfoTimeToLive:          86400000000000,
    DevAlbumInfoTimeToLive:           604800000000000,
}
time="2023-03-21T14:44:56Z" level=debug msg="Opening DataBase" dbPath="/data/navidrome.db?cache=shared&_busy_timeout=15000&_journal_mode=WAL&_foreign_keys=on" driver=sqlite3
time="2023-03-21T14:44:56Z" level=info msg="goose: no migrations to run. current version: 20230209181414\n"
time="2023-03-21T14:44:56Z" level=info msg="Starting signaler"
time="2023-03-21T14:44:56Z" level=info msg="Configuring Media Folder" name="Music Library" path=/music
time="2023-03-21T14:44:56Z" level=info msg="Starting scheduler"
time="2023-03-21T14:44:56Z" level=info msg="Scheduling periodic scan" schedule="0 12 * * *"
time="2023-03-21T14:44:56Z" level=info msg="Setting Session Timeout" value=24h
time="2023-03-21T14:44:56Z" level=info msg="Creating Image cache" maxSize="100 MB" path=/data/cache/images
time="2023-03-21T14:44:56Z" level=info msg="Login rate limit set" requestLimit=5 windowLength=20s
time="2023-03-21T14:44:56Z" level=info msg="Found ffmpeg" path=/usr/bin/ffmpeg
time="2023-03-21T14:44:56Z" level=debug msg="Last.fm integration is ENABLED"
time="2023-03-21T14:44:56Z" level=debug msg="ListenBrainz integration is ENABLED" ListenBrainz.BaseURL="https://api.listenbrainz.org/1/"
time="2023-03-21T14:44:56Z" level=debug msg="Spotify integration is ENABLED"
time="2023-03-21T14:44:56Z" level=info msg="Mounting Native API routes" path=/api
time="2023-03-21T14:44:56Z" level=debug msg="Throttling Subsonic getCoverArt endpoint" backlogLimit=100 backlogTimeout=1m maxRequests=2
time="2023-03-21T14:44:56Z" level=info msg="Mounting Subsonic API routes" path=/rest
time="2023-03-21T14:44:56Z" level=debug msg="Throttling public images endpoint" backlogLimit=100 backlogTimeout=1m maxRequests=2
time="2023-03-21T14:44:56Z" level=info msg="Mounting Public Endpoints routes" path=/share
time="2023-03-21T14:44:56Z" level=info msg="Mounting LastFM Auth routes" path=/api/lastfm
time="2023-03-21T14:44:56Z" level=info msg="Mounting ListenBrainz Auth routes" path=/api/listenbrainz
time="2023-03-21T14:44:56Z" level=debug msg="Scheduler: start"
time="2023-03-21T14:44:56Z" level=info msg="Mounting Background images routes" path=/backgrounds
time="2023-03-21T14:44:56Z" level=debug msg="Scheduler: schedule" entry=1 next="2023-03-22 12:00:00 +0000 UTC" now="2023-03-21 14:44:56.13412551 +0000 UTC"
time="2023-03-21T14:44:56Z" level=info msg="Mounting WebUI routes" path=/app
time="2023-03-21T14:44:56Z" level=info msg="Navidrome server is ready!" address="0.0.0.0:4533" startupTime=18.9ms
time="2023-03-21T14:44:56Z" level=info msg="Creating Transcoding cache" maxSize="100 MB" path=/data/cache/transcoding
time="2023-03-21T14:44:56Z" level=debug msg="Loaded cache" dir=/data/cache/transcoding numItems=0
time="2023-03-21T14:44:56Z" level=info msg="Finished initializing cache" cache=Transcoding elapsedTime=2.3ms maxSize=100MB
time="2023-03-21T14:44:56Z" level=debug msg="Loaded background images from image service" elapsed=71.1ms total=102
time="2023-03-21T14:44:56Z" level=debug msg="Loaded cache" dir=/data/cache/images numItems=634
time="2023-03-21T14:44:56Z" level=info msg="Finished initializing cache" cache=Image elapsedTime=202.8ms maxSize=100MB
time="2023-03-21T14:44:58Z" level=debug msg="Executing initial scan"
time="2023-03-21T14:44:58Z" level=debug msg="Scanning folder" folder=/music lastModifiedSince="2023-03-21 14:44:09.065 +0000 UTC"
time="2023-03-21T14:44:58Z" level=debug msg="Directory tree loaded from DB" elapsed=18.4ms total=33
time="2023-03-21T14:44:58Z" level=debug msg="Finished deleted folders check" elapsed="9.034µs" total=0
time="2023-03-21T14:44:58Z" level=debug msg="No changes found in Music Folder" elapsed=38.9ms folder=/music
time="2023-03-21T14:44:58Z" level=debug msg="Finished reading directories from filesystem" elapsed=19ms
time="2023-03-21T14:44:58Z" level=debug msg="Finished initial scan"

1 reply

lowgos Mar 21, 2023
Author

I just noticed that the docker image I'm using belongs to deluan/navidrome, this seems fitting that you're answering <3

lowgos · 2023-03-21T15:02:08Z

lowgos
Mar 21, 2023
Author

Just found out about docker stats which lets me look onto the navidrome stats directly. With that said the BLOCK I/O isn't moving and is always 0B/0B so I might have a misreport here.

1 reply

lowgos Mar 21, 2023
Author

After trying this guide to test the BLOCK I/O column it seems my system doesn't report block I/O correctly which means that I cannot count on this to understand whether or not it is Docker writing to the disk or Navidrome through Docker.

Sorry for the spam, I'm trying to spare your time <3

lowgos · 2023-03-22T09:00:12Z

lowgos
Mar 22, 2023
Author

Does anyone reading this reproduce?
In an environnement where only Navidrome is up via Docker, iotop reports lots of writes from dockerd.

0 replies

lowgos · 2023-03-26T15:15:56Z

lowgos
Mar 26, 2023
Author

@deluan I found the source of my problem.
Your Docker image contains a healthcheck which generates disk usage periodically, which in turns prevents the disks of a NAS from spinning down.

I disabled the healthcheck in my docker-compose.yml which solves my problem completely and it doesn't seem to cause any problems down the line.

healthcheck:
  disable: true

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Navidrome is constantly writing to disk #2271

{{title}}

Replies: 6 comments 2 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

Navidrome is constantly writing to disk #2271

lowgos Mar 21, 2023

Quick context

More context

Questions

Replies: 6 comments · 2 replies

deluan Mar 21, 2023 Maintainer

lowgos Mar 21, 2023 Author

lowgos Mar 21, 2023 Author

lowgos Mar 21, 2023 Author

lowgos Mar 21, 2023 Author

lowgos Mar 21, 2023 Author

lowgos Mar 22, 2023 Author

lowgos Mar 26, 2023 Author

lowgos
Mar 21, 2023

Replies: 6 comments 2 replies

deluan
Mar 21, 2023
Maintainer

lowgos
Mar 21, 2023
Author

lowgos
Mar 21, 2023
Author

lowgos Mar 21, 2023
Author

lowgos
Mar 21, 2023
Author

lowgos Mar 21, 2023
Author

lowgos
Mar 22, 2023
Author

lowgos
Mar 26, 2023
Author