deConz not ready

[Plantje]

I have migrated to a new server and imported the created backup.

Now I get:
2020-10-29 18:59:56.276 Error: (deConz) deCONZ not ready
2020-10-29 18:59:56.339 Error: (deConz) deCONZ not ready
2020-10-29 18:59:56.339 Error: (deConz) Your pyton version miss requests library
2020-10-29 18:59:56.339 Error: (deConz) To install it, type : sudo -H pip3 install requests | sudo -H pip install requests

I also see on the server in the deCONZ application that only very few nodes are connected (directly) to the configuration node

[Plantje]

deCONZ.jpg (153.6 KiB) Viewed 1143 times

This is what my deCONZ currently looks like.
I have Python 3.8.6 installed

And this is the logging after restarting the Domoticz service:
2020-10-29 19:47:38.729 Status: Domoticz V2020.2 (c)2012-2020 GizMoCuz
2020-10-29 19:47:38.729 Status: Build Hash: b63341bc0, Date: 2020-04-26 13:47:55
2020-10-29 19:47:38.729 Status: Startup Path: C:\Program Files\Domoticz\
2020-10-29 19:47:38.982 Status: PluginSystem: Started, Python version '3.8.6'.
2020-10-29 19:47:39.029 Status: WebServer(HTTP) started on address: :: with port 8080
2020-10-29 19:47:39.091 Status: WebServer(SSL) started on address: :: with port 443
2020-10-29 19:47:39.091 Status: TCPServer: shared server started...
2020-10-29 19:47:39.091 Status: RxQueue: queue worker started...
2020-10-29 19:47:41.171 Status: P1 Smart Meter: Using serial port: COM7
2020-10-29 19:47:41.186 Status: RFXCOM: Worker started...
2020-10-29 19:47:41.358 Status: (deConz) Started.
2020-10-29 19:47:41.358 Status: P1 Smart Meter: Worker started...
2020-10-29 19:47:41.360 Status: Tesla: Worker started...
2020-10-29 19:47:41.360 Status: EventSystem: reset all events...
2020-10-29 19:47:41.360 Status: NotificationSystem: thread started...
2020-10-29 19:47:41.372 Status: EventSystem: reset all device statuses...
2020-10-29 19:47:42.127 Status: (deConz) Initialized version 1.0.15, author 'Smanar'
2020-10-29 19:47:42.134 Status: (deConz) Entering work loop.
2020-10-29 19:47:42.238 Status: OpenZWave: Starting...
2020-10-29 19:47:42.238 Status: OpenZWave: Version: 1.6.1080.g5db357e3
2020-10-29 19:47:42.254 Status: RFXCOM: Using serial port: COM6
2020-10-29 19:47:43.122 Status: Python EventSystem: Initalizing event module.
2020-10-29 19:47:43.123 Status: EventSystem: Started
2020-10-29 19:47:43.123 Status: EventSystem: Queue thread started...
2020-10-29 19:47:43.185 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-29 19:47:43.232 Status: LUA: Nieuwe logica Groep - Tuin aan
2020-10-29 19:47:45.104 Status: Tesla: Executing command: Get Awake state
2020-10-29 19:47:46.940 Status: Tesla: Executing command: Get Awake state
2020-10-29 19:47:47.668 Status: Tesla: Executing command: Get All states
2020-10-29 19:47:49.072 Status: P1 Smart Meter: Meter reports as DSMR 4.2

[Thorgal789]

You have a lib error on your python, but more worrying you have a problem on your zigbee installation, you need to have 2 circle on the right of the node (ATM you have only one)

It's the same gateway ? only the host machine have changed ? Can you show the configuration panel in deconz ?

You have used the backup/restore feature from Phoscon ? Perhaps this tool can help you https://github.com/dresden-elektronik/d ... ost-issues

[Plantje]

It's the same gateway. I just unplugged it and plugged it into the new machine.
It does have a different COM port, but that should not be an issue.

What do you mean with 2 circles? Hmmm... I have clicked the left radio button on the configuration tool 3 and was able to tick some boxes. Now everything (except for the water sensor) is either connected directly or indirectly to the configuration tool.
Strangest thing is: the water sensor is directly beneath the controller

And yes, I did install a newer deConz version. I tried the older one as well, but no difference.
And I did recover the backup like I did before.

Ok, I can controll most of my devices through the Phoscon app again.

[Plantje]

deCONZ new.jpg (289.49 KiB) Viewed 1140 times

This is what it looks like now.

O yeah... I am running this on a Windows machine.
I did run pip install requests and pip3 install requests.

[Thorgal789]

So the second backup have worked better than the first one ?

And it s working now ?

[Plantje]

No, I didn't restore another backup. I mean: I have done this before and then it worked.
Currently what is working: controlling Zigbee devices through the Phoscon app.
What is not working: controlling Zigbee devices through Domoticz using the deConz plugin. That still results in the firest errors.

[Thorgal789]

Ok so the problem is to install the requests lib ?

Do you have an error message ?
Do you have succcesfuly installed pip3 ?

On my side on windows I m using python 3.5.2

[Plantje]

Yeah, it seems that that is the problem.

I think I successfully installed pip3. I will look up the results of that tomorrow.
There was no error message.

[Plantje]

This is the result:
C:\Program Files\Domoticz\plugins\deCONZ>pip install requests
Requirement already satisfied: requests in c:\users\hendr\appdata\roaming\python\python38\site-packages (2.24.0)
Requirement already satisfied: chardet<4,>=3.0.2 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (1.25.11)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (2020.6.20)
Requirement already satisfied: idna<3,>=2.5 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (2.10)

C:\Program Files\Domoticz\plugins\deCONZ>pip3 install requests
Requirement already satisfied: requests in c:\users\hendr\appdata\roaming\python\python38\site-packages (2.24.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (2020.6.20)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (1.25.11)
Requirement already satisfied: idna<3,>=2.5 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (2.10)
Requirement already satisfied: chardet<4,>=3.0.2 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (3.0.4)

That gives me the idea that Python has not really been installed for all users as I would expect it to find the library in c:\Program Files\Python38-32. And although I do have that folder as well, I think the messages above should point to that folder.

I will now first uninstall Python and reinstall this version as administrator.

[Thorgal789]

Take a look at domoticz startup, to check wich one python version it s using.
On my side I had problem directly with python version, it s for that I m using the 3.5 and not the 3.8

[Plantje]

In my documentation I have several versions of Python that I used before and that worked: 3.8.5, 3.7.4 and 3.5.2
I always like to go for the most recent version, but perhaps it is not always the best option.
I uninstalled version 3.8.6, installed 3.8.6 as administrator --> ran both pip install requests and pip3 install requests --> didn't work (got the "Requirement already satisfied" notification)
I uninstalled version 3.8.6, installed 3.8.5 as administrator --> ran both pip install requests and pip3 install requests --> didn't work (got the "Requirement already satisfied" notification)
I uninstalled version 3.8.5, installed 3.7.4 as administrator --> ran both pip install requests and pip3 install requests, this time resulting in actually installing these libraries --> didn't work....well, wait... after doing an "update" of the deConz plugin I noticed no difference in the logging, but after a while all of a sudden I saw:
2020-10-30 11:48:10.246 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.261 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.277 Status: (deConz) ### deCONZ ready
2020-10-30 11:48:10.277 Status: (deConz) ### Found 14 Operators, 3 Sensors, 4 Groups, 0 Scenes and 0 others, with 0 Ignored
2020-10-30 11:48:10.277 Status: (deConz) ### Device GROUP_All(deConz - All) Not in deCONZ ATM, the device is deleted or not ready.
2020-10-30 11:48:10.277 Status: (deConz) ### Device 14:b4:57:ff:fe:68:5a:0a(deConz - TRADFRI motion sensor ) Not in deCONZ ATM, the device is deleted or not ready.
2020-10-30 11:48:10.333 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.355 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.417 Status: (deConz) Launching websocket on port 8088
2020-10-30 11:48:10.433 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.448 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.542 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.558 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.620 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.636 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.714 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.730 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.792 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.808 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.886 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.901 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.964 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.980 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.277 Error: (deConz) Process request take too much time : 1.469069004058838 s
2020-10-30 11:48:10.277 Error: (deConz) Process request take too much time : 1.5628163814544678 s
2020-10-30 11:48:11.058 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.073 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.089 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.167 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.167 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.183 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.339 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.371 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.448 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.464 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.042 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:11.058 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:11.136 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:11.136 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:11.245 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:11.276 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:11.402 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:11.417 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:14.511 Status: (deConz) onDisconnect called for deCONZ_WebSocket
2020-10-30 11:48:15.526 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:15.370 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:15.495 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:16.558 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:16.558 Error: (deConz) Connexion problem (3) with Gateway, check your API key, or Use Request lib > V2.4.2
2020-10-30 11:48:17.573 Error: (deConz) Connexion problem (3) with Gateway, check your API key, or Use Request lib > V2.4.2

Now things do seem to be working! However, I cannot stand the thought that I don't know what changed this

So, as a next step, I will be uninstalling version 3.7.4 and reinstalling 3.8.6 as administrator. But before installing, I will manually remove the Python folders in "c:\users\hendr\appdata\roaming\"

I'll keep you posted

[Plantje]

Well after doing that test and installing 3.8.6 again these messages started popping up again:
2020-10-30 17:46:31.527 Error: (deConz) deCONZ not ready
2020-10-30 17:46:31.589 Error: OpenZWave: Type_Notification, NodeID not found internally!. HomeID: 0, NodeID: 255 (0xff)
2020-10-30 17:46:34.715 (deConz) ### Request config
2020-10-30 17:46:34.715 Error: (deConz) Your pyton version miss requests library
2020-10-30 17:46:34.715 Error: (deConz) To install it, type : sudo -H pip3 install requests | sudo -H pip install requests
2020-10-30 17:46:37.808 Status: OpenZWave: Received timeout notification from HomeID: 3833672857, NodeID: 56 (0x38)

Now let's see what happens if I run pip install requests

[Plantje]

And after doing that the result was:
C:\Windows\system32>pip install requests
Collecting requests
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.11-py2.py3-none-any.whl (127 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Installing collected packages: urllib3, certifi, chardet, idna, requests
Successfully installed certifi-2020.6.20 chardet-3.0.4 idna-2.10 requests-2.24.0 urllib3-1.25.11
WARNING: You are using pip version 20.2.1; however, version 20.2.4 is available.
You should consider upgrading via the 'c:\program files\python38-32\python.exe -m pip install --upgrade pip' command.

And everything was up and running again. Issue fixed!

In the deCONZ application everything is connected to the host. In order to achieve that I did have to use an USB extension cable, which I didn't really want to. But I think it is too close to the Z-Wave USB stick otherwise.

Thanks again for thinking along!

[Thorgal789]

So you have installed python 3.7 to make it working, then return to 3.8 and it is still working ?

[Plantje]

Exactly! And now in the user folder no python folders have been created. So I guess the first installation was not as administrator.

Was a little bit sleepy yesterday.... so to add to this: most likely at some point I installed Python not as administrator thus some of the Python folders ending up in my user\programdata folder. If I then run "pip install requests" it of course mentions that has already been done, but it is not available for the user running the Domoticz website and thus the plugin

[Thorgal789]

IDK, I had so much problems too, forced to install manually pip with a python file, packages problem, path problem, why it s so difficult to install python on a windows machine ...