[BUG] Config files are saved in wrong location

[g3rmanaviator]

In my Docker setup, I have the /app/config, /app/logs, etc directories mapped to persistent volumes.
It appears as though the tuner and user configuration is saved in the /app directory, thus every time I restart the container my config is lost.
Can you verify that config settings, such as tuners.db are saved in the /app/config directory?

ls -al
total 239
drwxr-xr-x 1 root root 506 Jan 9 09:27 .
drwxr-xr-x 1 root root 158 Jan 8 18:56 ..
drwxr-xr-x 1 root root 164 Jan 3 22:07 .git
drwxr-xr-x 1 root root 18 Jan 3 22:07 .github
-rw-r--r-- 1 root root 225 Jan 3 22:07 .gitignore
-rw-r--r-- 1 root root 16902 Jan 3 22:07 CHANGELOG.md
-rw-r--r-- 1 root root 1776 Jan 3 22:07 Dockerfile
-rw-r--r-- 1 root root 3864 Jan 3 22:07 INSTALL.md
-rw-r--r-- 1 root root 127 Jan 3 22:07 LICENSE
-rw-r--r-- 1 root root 5568 Jan 3 22:07 README.md
-rw-r--r-- 1 root root 4784 Jan 3 22:07 ROADMAP.md
-rw-r--r-- 1 root root 70244 Jan 3 22:07 app.py
-rw-r--r-- 1 root root 8945 Jan 3 22:07 bump_version.py
drwxr-xr-x 1 99 users 2 Jan 3 17:02 config
drwxr-xr-x 1 99 users 2 Jan 3 17:02 data
drwxr-xr-x 1 root root 120 Jan 3 22:07 docker
drwxr-xr-x 1 root root 22 Jan 3 22:07 docs
drwxr-xr-x 1 99 users 2 Jan 3 17:02 logs
-rw-r--r-- 1 root root 27 Jan 3 22:07 requirements.txt
-rw-r--r-- 1 root root 12053 Jan 3 22:07 retroiptv_linux.sh
-rw-r--r-- 1 root root 13636 Jan 3 22:07 retroiptv_rpi.sh
-rw-r--r-- 1 root root 6747 Jan 3 22:07 retroiptv_windows.bat
-rw-r--r-- 1 root root 20040 Jan 3 22:07 retroiptv_windows.ps1
drwxr-xr-x 1 root root 38 Jan 3 22:07 static
drwxr-xr-x 1 root root 228 Jan 3 22:07 templates
drwxr-xr-x 1 root root 38 Jan 3 22:07 tests
-rw-r--r-- 1 root root 20480 Jan 9 09:27 tuners.db
-rw-r--r-- 1 root root 16384 Jan 8 18:56 users.db

[thehack904]

That is odd. Can you run the following commands and post the results?

This should find where the DBs actually live:
docker exec -it <container_name> sh -lc 'ls -la /config /data /app 2>/dev/null; echo; find / -maxdepth 4 -type f ( -name "tuners.db" -o -name "users.db" -o -name "*.db" ) 2>/dev/null'

also useful: show the newest DB-ish files anywhere under /app, /config, /data:
docker exec -it <container_name> sh -lc 'for d in /app /config /data; do echo "== $d =="; ls -lt "$d" 2>/dev/null | head -n 50; echo; done'

[g3rmanaviator]

ls -la /config /data /app 2>/dev/null; echo;
find / -maxdepth 4 -type f ( -name "tuners.db" -o -name "users.db" -o -name "*.db" ) 2>/dev/null
/app:
total 239
drwxr-xr-x 1 root root 506 Jan 9 09:27 .
drwxr-xr-x 1 root root 158 Jan 8 18:56 ..
drwxr-xr-x 1 root root 164 Jan 3 22:07 .git
drwxr-xr-x 1 root root 18 Jan 3 22:07 .github
-rw-r--r-- 1 root root 225 Jan 3 22:07 .gitignore
-rw-r--r-- 1 root root 16902 Jan 3 22:07 CHANGELOG.md
-rw-r--r-- 1 root root 1776 Jan 3 22:07 Dockerfile
-rw-r--r-- 1 root root 3864 Jan 3 22:07 INSTALL.md
-rw-r--r-- 1 root root 127 Jan 3 22:07 LICENSE
-rw-r--r-- 1 root root 5568 Jan 3 22:07 README.md
-rw-r--r-- 1 root root 4784 Jan 3 22:07 ROADMAP.md
-rw-r--r-- 1 root root 70244 Jan 3 22:07 app.py
-rw-r--r-- 1 root root 8945 Jan 3 22:07 bump_version.py
drwxr-xr-x 1 99 users 2 Jan 3 17:02 config
drwxr-xr-x 1 99 users 2 Jan 3 17:02 data
drwxr-xr-x 1 root root 120 Jan 3 22:07 docker
drwxr-xr-x 1 root root 22 Jan 3 22:07 docs
drwxr-xr-x 1 99 users 2 Jan 3 17:02 logs
-rw-r--r-- 1 root root 27 Jan 3 22:07 requirements.txt
-rw-r--r-- 1 root root 12053 Jan 3 22:07 retroiptv_linux.sh
-rw-r--r-- 1 root root 13636 Jan 3 22:07 retroiptv_rpi.sh
-rw-r--r-- 1 root root 6747 Jan 3 22:07 retroiptv_windows.bat
-rw-r--r-- 1 root root 20040 Jan 3 22:07 retroiptv_windows.ps1
drwxr-xr-x 1 root root 38 Jan 3 22:07 static
drwxr-xr-x 1 root root 228 Jan 3 22:07 templates
drwxr-xr-x 1 root root 38 Jan 3 22:07 tests
-rw-r--r-- 1 root root 20480 Jan 9 09:27 tuners.db
-rw-r--r-- 1 root root 16384 Jan 8 18:56 users.db

[g3rmanaviator]

sh -lc 'for d in /app /config /data; do echo "== $d =="; ls -lt "$d" 2>/dev/null | head -n 50; echo; done'
== /app ==
total 231
-rw-r--r-- 1 root root 20480 Jan 9 09:27 tuners.db
-rw-r--r-- 1 root root 16384 Jan 8 18:56 users.db
-rw-r--r-- 1 root root 16902 Jan 3 22:07 CHANGELOG.md
-rw-r--r-- 1 root root 1776 Jan 3 22:07 Dockerfile
-rw-r--r-- 1 root root 3864 Jan 3 22:07 INSTALL.md
-rw-r--r-- 1 root root 127 Jan 3 22:07 LICENSE
-rw-r--r-- 1 root root 5568 Jan 3 22:07 README.md
-rw-r--r-- 1 root root 4784 Jan 3 22:07 ROADMAP.md
-rw-r--r-- 1 root root 70244 Jan 3 22:07 app.py
-rw-r--r-- 1 root root 8945 Jan 3 22:07 bump_version.py
drwxr-xr-x 1 root root 120 Jan 3 22:07 docker
drwxr-xr-x 1 root root 22 Jan 3 22:07 docs
-rw-r--r-- 1 root root 27 Jan 3 22:07 requirements.txt
-rw-r--r-- 1 root root 12053 Jan 3 22:07 retroiptv_linux.sh
-rw-r--r-- 1 root root 13636 Jan 3 22:07 retroiptv_rpi.sh
-rw-r--r-- 1 root root 6747 Jan 3 22:07 retroiptv_windows.bat
-rw-r--r-- 1 root root 20040 Jan 3 22:07 retroiptv_windows.ps1
drwxr-xr-x 1 root root 38 Jan 3 22:07 static
drwxr-xr-x 1 root root 228 Jan 3 22:07 templates
drwxr-xr-x 1 root root 38 Jan 3 22:07 tests
drwxr-xr-x 1 99 users 2 Jan 3 17:02 data
drwxr-xr-x 1 99 users 2 Jan 3 17:02 logs
drwxr-xr-x 1 99 users 2 Jan 3 17:02 config

== /config ==

== /data ==

[g3rmanaviator]

And the Unraid config

<?xml version="1.0"?> <Container version="2"> <Name>retroiptvguide</Name> <Repository>ghcr.io/thehack904/retroiptvguide:latest</Repository> <Registry>https://ghcr.io</Registry> <Network>network</Network> <MyIP/> <Shell>bash</Shell> <Privileged>false</Privileged> <Support>https://github.com/thehack904/retroiptvguide</Support> <Project>https://github.com/thehack904/retroiptvguide</Project> <ReadMe/> <Overview>RetroIPTVGuide is an IPTV guide management system that provides a web interface for managing and viewing TV guides.</Overview> <Category>MediaApp:Video MediaServer:Video</Category> <WebUI>http://[IP]:[PORT:5000]/</WebUI> <TemplateURL/> <Icon>https://raw.githubusercontent.com/g3rmanaviator/images/main/tvguide.png</Icon> <ExtraParams/> <PostArgs/> <CPUset/> <DateInstalled>1767483603</DateInstalled> <DonateText/> <DonateLink/> <Requires/> <Config Name="Web UI Port" Target="5000" Default="5000" Mode="tcp" Description="Port for RetroIPTVGuide web interface" Type="Port" Display="always" Required="true" Mask="false">5000</Config> <Config Name="Config Path" Target="/app/config" Default="/mnt/user/appdata/retroiptvguide/config" Mode="rw" Description="" Type="Path" Display="always" Required="true" Mask="false">/mnt/user/appdata/retroiptvguide/config</Config> <Config Name="Logs Path" Target="/app/logs" Default="/mnt/user/appdata/retroiptvguide/logs" Mode="rw" Description="" Type="Path" Display="always" Required="true" Mask="false">/mnt/user/appdata/retroiptvguide/logs</Config> <Config Name="Data Path" Target="/app/data" Default="/mnt/user/appdata/retroiptvguide/data" Mode="rw" Description="" Type="Path" Display="always" Required="true" Mask="false">/mnt/user/appdata/retroiptvguide/data</Config> <Config Name="Timezone" Target="TZ" Default="America/Chicago" Mode="" Description="Set your timezone (e.g., America/Chicago, America/New_York, Europe/London)" Type="Variable" Display="always" Required="false" Mask="false">America/Chicago</Config> <Config Name="Secret Key" Target="SECRET_KEY" Default="" Mode="" Description="IMPORTANT: Change this to a secure random string for security" Type="Variable" Display="always" Required="true" Mask="true">tainer?xmlTemplate=********</Config> <Config Name="Flask Environment" Target="FLASK_ENV" Default="production" Mode="" Description="Flask environment mode" Type="Variable" Display="advanced" Required="false" Mask="false">production</Config> <Config Name="Python Unbuffered" Target="PYTHONUNBUFFERED" Default="1" Mode="" Description="Force Python to run unbuffered" Type="Variable" Display="advanced" Required="false" Mask="false">1</Config> <Config Name="Database File" Target="DATABASE_FILE" Default="retroiptv.db" Mode="" Description="Database filename" Type="Variable" Display="advanced" Required="false" Mask="false">retroiptv.db</Config> <Config Name="Log File" Target="LOG_FILE" Default="retroiptv.log" Mode="" Description="Log filename" Type="Variable" Display="advanced" Required="false" Mask="false">retroiptv.log</Config> <Config Name="Flask Port" Target="FLASK_PORT" Default="5000" Mode="" Description="Internal Flask port (should match the container port)" Type="Variable" Display="advanced" Required="false" Mask="false">5000</Config> <TailscaleStateDir/> </Container>

[thehack904]

Updated and added entrypoint_fixdb.sh that creates persistent
/app/users.db → symlink to /app/config/users.db
/app/tuners.db → symlink to /app/config/tuners.db

to hold changes upon restart

[g3rmanaviator]

Updated to v4.5.0 and the users and tuners db is still stored in the main /app directory, rather than in the config directory.
This means every time I update the container the config is lost.

root@457b08e9bec9:/app# ls -al config/
total 5
drwxr-xr-x 1 99 users 2 Jan 3 17:02 .
drwxr-xr-x 1 root root 554 Feb 17 13:41 ..
root@457b08e9bec9:/app# ls -al data
total 5
drwxr-xr-x 1 99 users 2 Jan 3 17:02 .
drwxr-xr-x 1 root root 554 Feb 17 13:41 ..
root@457b08e9bec9:/app# ls -al logs/
total 10
drwxr-xr-x 1 99 users 3 Feb 17 13:36 .
drwxr-xr-x 1 root root 554 Feb 17 13:41 ..
-rw-r--r-- 1 root root 1028 Feb 17 13:41 activity.log

[thehack904]

@g3rmanaviator - Would you like to do some beta testing to make sure we get this bug knocked out? I can test on my systems if you want to test on yours. Do you know how to pull from a development branch? Pull it from copilot/fix-config-files-location branch. That content is separated from the main and dev branch. Once we verify the fix I can merge it into dev for our 4.6.0 release

[g3rmanaviator]

Pulled the copilot/fix-config-files-location branch and config files are still saved in the main app directory.

[thehack904]

@g3rmanaviator Not sure what OS your running. But if you are on Mac or Linux can you do a ls -la on your app directory. As those files should be stored there, but you should now see them actually linked back to:
lrwxrwxrwx 1 root root 21 Feb 18 19:25 tuners.db -> /app/config/tuners.db
lrwxrwxrwx 1 root root 20 Feb 18 19:25 users.db -> /app/config/users.db

Which should hold the settings. I just did a verification on my side. I pulled down from that branch, did a brand new build, started the container and added a user. Then restarted the docker container and the user was still there.

What OS are you running Docker on?

[thehack904]

@g3rmanaviator - Where you able to verify with an ls -la on your updated pull to see if they were linked back to /app/config/ ?