I have a problem with the backup as well:
- As of feb also domoticz.db-shm and domoticz.db-wal are backuped up. In essence not a big problem, however In the hourly dir The domoticz.db-wal file has a size of 825M, which causes the growth of the directory tree. In the monthly tree the file is stil bigger (biggest i also bigger, but not 64m. In the monthly tree is has a normal size. The size of this file is weird, since in size of the file being backup up is only 11M.
- But the worst thing is: domoticz.db itself is not backupped anymore as of feb 8th. (in any directory). I am on the beta channel and do updates every now and then, so i probably did an upgrade to latest version that day.
For just disabled the auto backup (it doesn't work now), but i would really like this to work, so
- Does anyone have similar experience (or let me know if it works in your case)
- Does anyone know how to fix?
Here are all the details of my analysis:
1st. These are my file sizes of the production db
Code: Select all
-rwxr-xr-x 1 domoticz domoticz 7,3M apr 19 07:47 domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 32K apr 19 07:49 domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 11M apr 19 07:49 domoticz.db-wal*
My hourly backups (last backup of .db at feb 9. shm files are enormous)
Code: Select all
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 00:00 backup-hour-00-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 19 00:00 backup-hour-00-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 818M apr 19 00:00 backup-hour-00-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 01:00 backup-hour-01-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 19 01:00 backup-hour-01-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 818M apr 19 01:00 backup-hour-01-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 02:00 backup-hour-02-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 19 02:00 backup-hour-02-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 811M apr 19 02:00 backup-hour-02-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 03:00 backup-hour-03-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 19 03:00 backup-hour-03-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 818M apr 19 03:00 backup-hour-03-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 04:00 backup-hour-04-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 19 04:00 backup-hour-04-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 818M apr 19 04:00 backup-hour-04-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 05:00 backup-hour-05-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 19 05:00 backup-hour-05-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 818M apr 19 05:00 backup-hour-05-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 06:00 backup-hour-06-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 19 06:00 backup-hour-06-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 818M apr 19 06:00 backup-hour-06-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 07:00 backup-hour-07-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 19 07:00 backup-hour-07-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 819M apr 19 07:00 backup-hour-07-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 08:00 backup-hour-08-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 19 08:00 backup-hour-08-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 782M apr 19 08:00 backup-hour-08-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 09:00 backup-hour-09-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,5M apr 18 09:00 backup-hour-09-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 760M apr 18 09:00 backup-hour-09-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 10:00 backup-hour-10-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 10:00 backup-hour-10-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 779M apr 18 10:00 backup-hour-10-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 11:00 backup-hour-11-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 11:00 backup-hour-11-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 791M apr 18 11:00 backup-hour-11-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 12:00 backup-hour-12-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 12:00 backup-hour-12-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 791M apr 18 12:00 backup-hour-12-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 13:00 backup-hour-13-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 13:00 backup-hour-13-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 785M apr 18 13:00 backup-hour-13-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 14:00 backup-hour-14-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,5M apr 18 14:00 backup-hour-14-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 767M apr 18 14:00 backup-hour-14-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 15:00 backup-hour-15-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 15:00 backup-hour-15-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 793M apr 18 15:00 backup-hour-15-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 16:00 backup-hour-16-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 16:00 backup-hour-16-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 798M apr 18 16:00 backup-hour-16-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 17:00 backup-hour-17-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 17:02 backup-hour-17-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 798M apr 18 17:02 backup-hour-17-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 18:00 backup-hour-18-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 18:00 backup-hour-18-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 806M apr 18 18:00 backup-hour-18-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 19:00 backup-hour-19-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 19:00 backup-hour-19-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 818M apr 18 19:00 backup-hour-19-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 20:00 backup-hour-20-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 20:00 backup-hour-20-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 806M apr 18 20:00 backup-hour-20-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 21:00 backup-hour-21-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 21:00 backup-hour-21-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 805M apr 18 21:00 backup-hour-21-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 22:00 backup-hour-22-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,6M apr 18 22:00 backup-hour-22-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 814M apr 18 22:00 backup-hour-22-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 23:00 backup-hour-23-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 1,7M apr 18 23:00 backup-hour-23-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 825M apr 18 23:00 backup-hour-23-Domoticz.db-wal*
My daily backups: (still big .wal files, but not as big in hourly dir. last backup of domoticz.db feb 9th)
Code: Select all
-rwxr-xr-x 1 domoticz domoticz 11M jan 1 00:00 backup-day-01-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 1 00:00 backup-day-01-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 32M apr 1 00:00 backup-day-01-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 2 00:00 backup-day-02-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 2 00:00 backup-day-02-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 32M apr 2 00:00 backup-day-02-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 3 00:00 backup-day-03-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 3 00:00 backup-day-03-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 31M apr 3 00:00 backup-day-03-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 4 00:00 backup-day-04-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 4 00:00 backup-day-04-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 31M apr 4 00:00 backup-day-04-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 5 00:00 backup-day-05-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 5 00:00 backup-day-05-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 31M apr 5 00:00 backup-day-05-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 6 00:00 backup-day-06-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 6 00:00 backup-day-06-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 26M apr 6 00:00 backup-day-06-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 7 00:00 backup-day-07-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 7 00:00 backup-day-07-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 26M apr 7 00:00 backup-day-07-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 8 00:00 backup-day-08-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 32K apr 8 00:00 backup-day-08-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 14M apr 8 00:00 backup-day-08-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M feb 9 00:00 backup-day-09-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 32K apr 9 00:00 backup-day-09-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 15M apr 9 00:00 backup-day-09-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 10 00:00 backup-day-10-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 10 00:00 backup-day-10-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 26M apr 10 00:00 backup-day-10-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 11 00:00 backup-day-11-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 11 00:00 backup-day-11-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 26M apr 11 00:00 backup-day-11-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 12 00:00 backup-day-12-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 32K apr 12 00:00 backup-day-12-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 15M apr 12 00:00 backup-day-12-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 13 00:00 backup-day-13-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 32K apr 13 00:00 backup-day-13-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 15M apr 13 00:00 backup-day-13-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 14 00:00 backup-day-14-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 32K apr 14 00:00 backup-day-14-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 15M apr 14 00:00 backup-day-14-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M jan 15 00:00 backup-day-15-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 15 00:00 backup-day-15-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 26M apr 15 00:00 backup-day-15-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M jan 16 00:00 backup-day-16-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K apr 16 00:00 backup-day-16-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 26M apr 16 00:00 backup-day-16-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 17 00:00 backup-day-17-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 96K apr 17 00:00 backup-day-17-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 38M apr 17 00:00 backup-day-17-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 18 00:00 backup-day-18-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 96K apr 18 00:00 backup-day-18-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 37M apr 18 00:00 backup-day-18-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 19 00:00 backup-day-19-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 96K apr 19 00:00 backup-day-19-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 37M apr 19 00:00 backup-day-19-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 20 00:00 backup-day-20-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 20 00:00 backup-day-20-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 30M mrt 20 00:00 backup-day-20-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 21 00:00 backup-day-21-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 21 00:00 backup-day-21-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 30M mrt 21 00:00 backup-day-21-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 13M dec 22 00:00 backup-day-22-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 22 00:00 backup-day-22-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 30M mrt 22 00:00 backup-day-22-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 23 00:00 backup-day-23-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 23 00:00 backup-day-23-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 31M mrt 23 00:00 backup-day-23-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 24 00:00 backup-day-24-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 24 00:00 backup-day-24-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 31M mrt 24 00:00 backup-day-24-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 25 00:00 backup-day-25-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 25 00:00 backup-day-25-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 31M mrt 25 00:00 backup-day-25-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 26 00:00 backup-day-26-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 26 00:00 backup-day-26-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 31M mrt 26 00:00 backup-day-26-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 27 00:00 backup-day-27-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 27 00:00 backup-day-27-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 31M mrt 27 00:00 backup-day-27-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 28 00:00 backup-day-28-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 28 00:00 backup-day-28-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 32M mrt 28 00:00 backup-day-28-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 12M dec 29 00:00 backup-day-29-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 29 00:00 backup-day-29-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 32M mrt 29 00:00 backup-day-29-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M dec 30 00:00 backup-day-30-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 30 00:00 backup-day-30-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 18M mrt 30 00:00 backup-day-30-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 11M dec 31 00:00 backup-day-31-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 64K mrt 31 00:00 backup-day-31-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 18M mrt 31 00:00 backup-day-31-Domoticz.db-wal*
And my monthly backups: (normal size wal files, last succeed backup of .db in januari)
Code: Select all
-rwxr-xr-x 1 domoticz domoticz 11M jan 1 00:00 backup-month-01-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 6,1M feb 1 2019 backup-month-02-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 32K feb 1 00:00 backup-month-02-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 12M feb 1 00:00 backup-month-02-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 6,5M mrt 1 2019 backup-month-03-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 32K mrt 1 00:00 backup-month-03-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 14M mrt 1 00:00 backup-month-03-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 6,7M apr 1 2019 backup-month-04-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 32K apr 1 00:00 backup-month-04-Domoticz.db-shm*
-rwxr-xr-x 1 domoticz domoticz 6,9M apr 1 00:00 backup-month-04-Domoticz.db-wal*
-rwxr-xr-x 1 domoticz domoticz 6,9M mei 1 2019 backup-month-05-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 7,6M jun 1 2019 backup-month-06-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 8,3M jul 1 2019 backup-month-07-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 7,9M aug 1 2019 backup-month-08-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 10M sep 1 2019 backup-month-09-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 7,5M okt 1 2019 backup-month-10-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 6,9M nov 1 00:00 backup-month-11-Domoticz.db*
-rwxr-xr-x 1 domoticz domoticz 7,4M dec 1 00:00 backup-month-12-Domoticz.db*
in the logging at every backup there are no errors: I only get these 2 loglines
Code: Select all
2020-04-19 08:00:00.880 Status: Starting automatic database backup procedure...
2020-04-19 08:00:28.452 Status: Ending automatic database backup procedure...