Build 2021.1 Domoticz From Source - Crash

[meal]

Hello,
I currently run a Domoticz 2020.2 version on RPI3+ (Buster) perfectly. It was built from the sources.
I intended to upgrade to version 2021.1 recently by compiling again from the sources.
I ran successfully the upgrade process until the end, cleared the web browser cache and noticed that Domoticz crashes.

Here is the sequence of operations I went through successfully:
1 - sudo apt-get install make gcc g++ libssl-dev git libcurl4-gnutls-dev libusb-dev libsqlite3-dev python3-dev zlib1g-dev libcereal-dev liblua5.3-dev uthash-dev
2 - sudo apt remove --purge --auto-remove cmake
3 - wget https://github.com/Kitware/CMake/releas ... 9.3.tar.gz
tar -xzvf cmake-3.19.3.tar.gz
rm cmake-3.19.3.tar.gz
cd cmake-3.19.3
./bootstrap
make
sudo make install
cd ..
rm -Rf cmake-3.19.3"
4 cmake --version
5 sudo apt remove --purge --auto-remove libboost-dev libboost-thread-dev libboost-system-dev libboost-atomic-dev libboost-regex-dev libboost-chrono-dev
6 sudo service domoticz stop
7 mkdir boost
cd boost
wget https://boostorg.jfrog.io/artifactory/m ... 6_0.tar.gz
tar xfz boost_1_76_0.tar.gz
cd boost_1_76_0/
./bootstrap.sh
./b2 stage threading=multi link=static --with-thread --with-system
sudo ./b2 install threading=multi link=static --with-thread --with-system
cd ../../
sudo rm -Rf boost/"
8 cd DEV20200309
9 cd open-zwave-read-only
10 git pull
11 make
12 sudo make install
13 cd ..
14 git clone https://github.com/domoticz/domoticz.git dev-domoticz
15 cd dev-domoticz
16 git pull
17 cmake -DCMAKE_BUILD_TYPE=Release CMakeLists.txt
18 free -htl
19 make -j1 1>make.log 2>make.error
20 sudo rsync -I /home/pi/DEV20200309/dev-domoticz/domoticz /home/pi/domoticz/"
sudo rsync -rI /home/pi/DEV20200309/dev-domoticz/www/ /home/pi/domoticz/www
sudo rsync -rI /home/pi/DEV20200309/dev-domoticz/dzVents/ /home/pi/domoticz/dzVents
sudo rsync -rI /home/pi/DEV20200309/dev-domoticz/Config/ /home/pi/domoticz/Config
sudo rsync -rI /home/pi/DEV20200309/dev-domoticz/scripts/ /home/pi/domoticz/scripts
sudo rsync -rI /home/pi/DEV20200309/dev-domoticz/plugins/ /home/pi/domoticz/plugins
sudo rsync -I /home/pi/DEV20200309/dev-domoticz/History.txt /home/pi/domoticz/
sudo rsync -I /home/pi/DEV20200309/dev-domoticz/License.txt /home/pi/domoticz/"

Some findings I made:
In step 17 - cmake -DCMAKE_BUILD_TYPE=Release CMakeLists.txt I noticed the following point in the log :
"Could not find a package configuration file provided by "cJSON" with any of the following names:

cJSONConfig.cmake
cjson-config.cmake

Add the installation prefix of "cJSON" to CMAKE_PREFIX_PATH or set
"cJSON_DIR" to a directory containing one of the above files. If "cJSON"
provides a separate development package or SDK, be sure it has been
installed."

I did not add the installation prefix of "cJSON" but no error occured in the generation of domoticz.

At run time the Developer View in the Google Web Browser shows errors when displaying the domoticz Dashboard:

in the file angular-websocket.js line 127 : me.$$ws = new WebSocket(cfg.url, cfg.protocols);

angular-websocket.js:127 WebSocket connection to 'ws://192.168.0.24:8080/json' failed:
me.$$init @ angular-websocket.js:127
me.$open @ angular-websocket.js:255
(anonymous) @ angular-websocket.js:170
custom.js:1903

I have also attached the domoticz_crash file.

I would be grateful to know if someone managed to build domoticz 2021.1 version from the sources and share the process with me.

Many thanks in advance
BR
Meal

[meal]

Hello,

I have completed the investigation on my 2021.1 testing environment.
I removed the 2020.2 domoticz.db Database from home/pi/domoticz directory, renamed in the home/pi/domoticz directory the scripts and plugins subdirectories in _scripts and _plugins and restarted the domoticz 2021.1 version to create a blank application.
It created a new database in the 2021.1 format and this time I have been able to access to the domoticz application via the chrome browser.

I checked in the Hardware view the configuration of the RFXCOM, ZWAVE hardware and noticed that the Serial Port is empty.
When comparing the structure of the Hardware Table I noticed that the newly created 2021 database has a extra field recording the log levels which is not in the previous 2020.2 database.

It seems that my 2020.2 database (Version: 2020.2 build 12501) has not been converted to the 2021.1 structure (Version: 2021.1 build 13329) in the upgrade process.

My question is : do I have something to do to upgrade the database ? if not which criteria is used by Domoticz application to proceed to the upgrade of the database ?

Many thanks in advance for the contributors willing to support me and sort the issue out.

BR
Meal

[waltervl]

To my knowledge at every start of Domoticz the database is checked on version and if the database is of a lower version the database is automatically upgraded.

[meal]

Hello,

I thank you for the answer and I understand the point.

Do you know where the version is stored in the database ?

BR

[meal]

Hello,

I checked again the domoticz database structure and I confirm that it has been converted from a 145 to a 148 version.

I was misled by the fact the Column "LOG LEVEL" is appended at the end during the database upgrade process.

To keep on assessing the issue I have started a brand new 2021.1 Domoticz application (empty one) and created only one Hardware named "System-Disk Usage Root".

It is based on the plugin "Disc usage" with the following settings :
Enabled : checked
Dispositif : /
Minutes between check : 60
Debug : False

The devices have been created accordingly and are refreshed properly.

If I disable the "System-Disk Usage Root" hardware Domoticz application is still alive.

When I re enable the "System-Disk Usage Root" hardware the Domoticz application crashes.

A look at the domoticz_crash.log file shows that the process 19 "System-Disk Usa" crashed and raised a signal 11: raise (sig=11) at ../sysdeps/unix/sysv/linux/raise.c:50

I have attached the domoticz_crash.log file.

I thanks in advance the contributors who might have a clue to address the point to support me.

BR
Meal

domoticz_crash.log

(18.66 KiB) Downloaded 41 times

[waltervl]

Are you building on development sources or on stable sources?
Is your plugin a native C++ plugin or a Python plugin?

Python plugins framework is getting worked on in development causing issues at the moment. See GitHub issues.

[meal]

Hello,

I have built Domoticz 2021.1 version from sources (Build 13329) as shown below.

Disc_usage is a PY plugin from https://github.com/Xorfor/Domoticz-Disc-usage-Plugin. See https://www.domoticz.com/wiki/Plugins

Here is the domoticz log which shows the crash of "System-Disk Usa" process (signal 11).

2021-06-17 13:18:29.433 Status: Domoticz V2021.1 (build 13329) (c)2012-2021 GizMoCuz
2021-06-17 13:18:29.433 Status: Build Hash: 24521c255-modified, Date: 2021-06-16 08:55:35
2021-06-17 13:18:29.434 Status: Startup Path: /home/pi/domoticz/
2021-06-17 13:18:29.658 Status: Compare Database Version: dbversion from DB: 148, Domoticz DBVERSION: 148
2021-06-17 13:18:30.354 Active notification Subsystems: fcm, http (2/13)
2021-06-17 13:18:30.402 Starting shared server on: :::6144
2021-06-17 13:18:30.339 Status: PluginSystem: Started, Python version '3.7.3'.
2021-06-17 13:18:30.376 Status: WebServer(HTTP) started on address: :: with port 8080
2021-06-17 13:18:30.397 Status: WebServer(SSL) started on address: :: with port 443
2021-06-17 13:18:30.403 Status: TCPServer: shared server started...
2021-06-17 13:18:30.404 Status: RxQueue: queue worker started...
2021-06-17 13:18:31.918 Status: Incoming connection from: 192.168.0.23
2021-06-17 13:18:32.405 System-Disk Usage Root hardware started.
2021-06-17 13:18:32.404 Status: System-Disk Usage Root: (System-Disk Usage Root) Entering work loop.
2021-06-17 13:18:32.405 Status: System-Disk Usage Root: (System-Disk Usage Root) Started.
2021-06-17 13:18:32.405 Status: NotificationSystem: thread started...
2021-06-17 13:18:32.406 Status: EventSystem: reset all events...
2021-06-17 13:18:32.413 Status: EventSystem: reset all device statuses...
2021-06-17 13:18:32.576 Status: Python EventSystem: Initializing event module.
2021-06-17 13:18:32.577 Status: EventSystem: Started
2021-06-17 13:18:32.577 Status: EventSystem: Queue thread started...
2021-06-17 13:18:32.754 Status: PluginSystem: 1 plugins started.
2021-06-17 13:18:32.770 Status: System-Disk Usage Root: (System-Disk Usage Root) Initialized version 1.2.0, author 'Xorfor'
2021-06-17 13:18:32.782 Error: Domoticz(pid:823, tid:846('System-Disk Usa')) received fatal signal 11 (Segmentation fault)
2021-06-17 13:18:32.782 Error: siginfo address=0x337, address=(nil)

Many thanks for your help to sort that out.
BR

[HFman]

I have a sumilair issue with buld 13329, when i "remove" the plugin folder, everything works. As soon i put it back, and there is a python plugin it fails :

2021-06-17 00:22:15.442 Error: Domoticz(pid:2782, tid:2809('Zigbee2MQTT')) received fatal signal 11 (Segmentation fault)
2021-06-17 00:22:15.443 Error: siginfo address=0xade, address=(nil)

First time it failed the at an other python plugin, when i removed that one, if failed at the zigbee to mqqt one, same error.

The log showes this :

2021-06-17 00:22:19.782 Error: #5 raise (sig=11) at ../sysdeps/unix/sysv/linux/raise.c:50
2021-06-17 00:22:19.782 Error: #6 <signal handler called>
2021-06-17 00:22:19.782 Error: #7 0x00000000 in ?? ()
2021-06-17 00:22:19.782 Error: #8 0x006494a0 in Plugins::CPlugin::Start() ()
2021-06-17 00:22:19.782 Error: #9 0x00652220 in Plugins::onStartCallback::ProcessLocked() ()
2021-06-17 00:22:19.782 Error: #10 0x0020d6a4 in Plugins::CPluginMessageBase::Process() ()
2021-06-17 00:22:19.782 Error: #11 0x0064ff68 in Plugins::CPlugin::Do_Work() ()
2021-06-17 00:22:19.782 Error: #12 0x008d01f4 in execute_native_thread_routine ()
2021-06-17 00:22:19.782 Error: #13 0x76ab8494 in start_thread (arg=0x69dfa220) at pthread_create.c:486
2021-06-17 00:22:19.782 Error: #14 0x7696b578 in ?? () at ../sysdeps/unix/sysv/linux/arm/clone.S:73 from /lib/arm-linux-gnueabihf/libc.so.6

Everything is updated :

ldd (Debian GLIBC 2.28-10+rpi1) 2.28
python 3.7.3
Somebody any clue / have it working ?

Seems possible routcause found
edit : https://github.com/domoticz/domoticz/issues/4861

[meal]

Hello,

At the end of the day, the issue was linked to a plugins framework issue with caused a segmentation default (see Crash after latest update 17/06/2021).

I uploaded the 13330 version and built domoticz from the sources.

The upgrade process was successfull and my application is now up and ready in version 2021.1.

Many thanks for all the contributors to that version.

BR

[HFman]

Yes, confirm, also mine is running fine again !