Domoticz

I have migrated to a new server and imported the created backup.

Now I get:
2020-10-29 18:59:56.276 Error: (deConz) deCONZ not ready
2020-10-29 18:59:56.339 Error: (deConz) deCONZ not ready
2020-10-29 18:59:56.339 Error: (deConz) Your pyton version miss requests library
2020-10-29 18:59:56.339 Error: (deConz) To install it, type : sudo -H pip3 install requests | sudo -H pip install requests

I also see on the server in the deCONZ application that only very few nodes are connected (directly) to the configuration node

This is what my deCONZ currently looks like.
I have Python 3.8.6 installed

And this is the logging after restarting the Domoticz service:
2020-10-29 19:47:38.729 Status: Domoticz V2020.2 (c)2012-2020 GizMoCuz
2020-10-29 19:47:38.729 Status: Build Hash: b63341bc0, Date: 2020-04-26 13:47:55
2020-10-29 19:47:38.729 Status: Startup Path: C:\Program Files\Domoticz\
2020-10-29 19:47:38.982 Status: PluginSystem: Started, Python version '3.8.6'.
2020-10-29 19:47:39.029 Status: WebServer(HTTP) started on address: :: with port 8080
2020-10-29 19:47:39.091 Status: WebServer(SSL) started on address: :: with port 443
2020-10-29 19:47:39.091 Status: TCPServer: shared server started...
2020-10-29 19:47:39.091 Status: RxQueue: queue worker started...
2020-10-29 19:47:41.171 Status: P1 Smart Meter: Using serial port: COM7
2020-10-29 19:47:41.186 Status: RFXCOM: Worker started...
2020-10-29 19:47:41.358 Status: (deConz) Started.
2020-10-29 19:47:41.358 Status: P1 Smart Meter: Worker started...
2020-10-29 19:47:41.360 Status: Tesla: Worker started...
2020-10-29 19:47:41.360 Status: EventSystem: reset all events...
2020-10-29 19:47:41.360 Status: NotificationSystem: thread started...
2020-10-29 19:47:41.372 Status: EventSystem: reset all device statuses...
2020-10-29 19:47:42.127 Status: (deConz) Initialized version 1.0.15, author 'Smanar'
2020-10-29 19:47:42.134 Status: (deConz) Entering work loop.
2020-10-29 19:47:42.238 Status: OpenZWave: Starting...
2020-10-29 19:47:42.238 Status: OpenZWave: Version: 1.6.1080.g5db357e3
2020-10-29 19:47:42.254 Status: RFXCOM: Using serial port: COM6
2020-10-29 19:47:43.122 Status: Python EventSystem: Initalizing event module.
2020-10-29 19:47:43.123 Status: EventSystem: Started
2020-10-29 19:47:43.123 Status: EventSystem: Queue thread started...
2020-10-29 19:47:43.185 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-29 19:47:43.232 Status: LUA: Nieuwe logica Groep - Tuin aan
2020-10-29 19:47:45.104 Status: Tesla: Executing command: Get Awake state
2020-10-29 19:47:46.940 Status: Tesla: Executing command: Get Awake state
2020-10-29 19:47:47.668 Status: Tesla: Executing command: Get All states
2020-10-29 19:47:49.072 Status: P1 Smart Meter: Meter reports as DSMR 4.2

You have a lib error on your python, but more worrying you have a problem on your zigbee installation, you need to have 2 circle on the right of the node (ATM you have only one)

It's the same gateway ? only the host machine have changed ? Can you show the configuration panel in deconz ?

You have used the backup/restore feature from Phoscon ? Perhaps this tool can help you https://github.com/dresden-elektronik/d ... ost-issues

It's the same gateway. I just unplugged it and plugged it into the new machine.
It does have a different COM port, but that should not be an issue.

What do you mean with 2 circles? Hmmm... I have clicked the left radio button on the configuration tool 3 and was able to tick some boxes. Now everything (except for the water sensor) is either connected directly or indirectly to the configuration tool.
Strangest thing is: the water sensor is directly beneath the controller

And yes, I did install a newer deConz version. I tried the older one as well, but no difference.
And I did recover the backup like I did before.

Ok, I can controll most of my devices through the Phoscon app again.

This is what it looks like now.

O yeah... I am running this on a Windows machine.
I did run pip install requests and pip3 install requests.

So the second backup have worked better than the first one ?

And it s working now ?

No, I didn't restore another backup. I mean: I have done this before and then it worked.
Currently what is working: controlling Zigbee devices through the Phoscon app.
What is not working: controlling Zigbee devices through Domoticz using the deConz plugin. That still results in the firest errors.

Ok so the problem is to install the requests lib ?

Do you have an error message ?
Do you have succcesfuly installed pip3 ?

On my side on windows I m using python 3.5.2

Yeah, it seems that that is the problem.

I think I successfully installed pip3. I will look up the results of that tomorrow.
There was no error message.

This is the result:
C:\Program Files\Domoticz\plugins\deCONZ>pip install requests
Requirement already satisfied: requests in c:\users\hendr\appdata\roaming\python\python38\site-packages (2.24.0)
Requirement already satisfied: chardet<4,>=3.0.2 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (1.25.11)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (2020.6.20)
Requirement already satisfied: idna<3,>=2.5 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (2.10)

C:\Program Files\Domoticz\plugins\deCONZ>pip3 install requests
Requirement already satisfied: requests in c:\users\hendr\appdata\roaming\python\python38\site-packages (2.24.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (2020.6.20)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (1.25.11)
Requirement already satisfied: idna<3,>=2.5 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (2.10)
Requirement already satisfied: chardet<4,>=3.0.2 in c:\users\hendr\appdata\roaming\python\python38\site-packages (from requests) (3.0.4)

That gives me the idea that Python has not really been installed for all users as I would expect it to find the library in c:\Program Files\Python38-32. And although I do have that folder as well, I think the messages above should point to that folder.

I will now first uninstall Python and reinstall this version as administrator.

Take a look at domoticz startup, to check wich one python version it s using.
On my side I had problem directly with python version, it s for that I m using the 3.5 and not the 3.8

In my documentation I have several versions of Python that I used before and that worked: 3.8.5, 3.7.4 and 3.5.2
I always like to go for the most recent version, but perhaps it is not always the best option.
I uninstalled version 3.8.6, installed 3.8.6 as administrator --> ran both pip install requests and pip3 install requests --> didn't work (got the "Requirement already satisfied" notification)
I uninstalled version 3.8.6, installed 3.8.5 as administrator --> ran both pip install requests and pip3 install requests --> didn't work (got the "Requirement already satisfied" notification)
I uninstalled version 3.8.5, installed 3.7.4 as administrator --> ran both pip install requests and pip3 install requests, this time resulting in actually installing these libraries --> didn't work....well, wait... after doing an "update" of the deConz plugin I noticed no difference in the logging, but after a while all of a sudden I saw:
2020-10-30 11:48:10.246 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.261 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.277 Status: (deConz) ### deCONZ ready
2020-10-30 11:48:10.277 Status: (deConz) ### Found 14 Operators, 3 Sensors, 4 Groups, 0 Scenes and 0 others, with 0 Ignored
2020-10-30 11:48:10.277 Status: (deConz) ### Device GROUP_All(deConz - All) Not in deCONZ ATM, the device is deleted or not ready.
2020-10-30 11:48:10.277 Status: (deConz) ### Device 14:b4:57:ff:fe:68:5a:0a(deConz - TRADFRI motion sensor ) Not in deCONZ ATM, the device is deleted or not ready.
2020-10-30 11:48:10.333 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.355 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.417 Status: (deConz) Launching websocket on port 8088
2020-10-30 11:48:10.433 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.448 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.542 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.558 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.620 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.636 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.714 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.730 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.792 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.808 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.886 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.901 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.964 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:10.980 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:10.277 Error: (deConz) Process request take too much time : 1.469069004058838 s
2020-10-30 11:48:10.277 Error: (deConz) Process request take too much time : 1.5628163814544678 s
2020-10-30 11:48:11.058 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.073 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.089 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.167 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.167 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.183 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.339 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.371 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.448 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.464 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:11.042 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:11.058 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:11.136 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:11.136 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:11.245 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:11.276 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:11.402 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:11.417 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:14.511 Status: (deConz) onDisconnect called for deCONZ_WebSocket
2020-10-30 11:48:15.526 (deConz) onCommand called for Unit 5: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:15.370 Status: LUA: Nieuwe logica Lamp Hal uit
2020-10-30 11:48:15.495 Status: LUA: Nieuwe logica Lamp Overloop uit
2020-10-30 11:48:16.558 (deConz) onCommand called for Unit 1: Parameter 'Off', Level: 0, Hue:
2020-10-30 11:48:16.558 Error: (deConz) Connexion problem (3) with Gateway, check your API key, or Use Request lib > V2.4.2
2020-10-30 11:48:17.573 Error: (deConz) Connexion problem (3) with Gateway, check your API key, or Use Request lib > V2.4.2

Now things do seem to be working! However, I cannot stand the thought that I don't know what changed this

So, as a next step, I will be uninstalling version 3.7.4 and reinstalling 3.8.6 as administrator. But before installing, I will manually remove the Python folders in "c:\users\hendr\appdata\roaming\"

I'll keep you posted

Well after doing that test and installing 3.8.6 again these messages started popping up again:
2020-10-30 17:46:31.527 Error: (deConz) deCONZ not ready
2020-10-30 17:46:31.589 Error: OpenZWave: Type_Notification, NodeID not found internally!. HomeID: 0, NodeID: 255 (0xff)
2020-10-30 17:46:34.715 (deConz) ### Request config
2020-10-30 17:46:34.715 Error: (deConz) Your pyton version miss requests library
2020-10-30 17:46:34.715 Error: (deConz) To install it, type : sudo -H pip3 install requests | sudo -H pip install requests
2020-10-30 17:46:37.808 Status: OpenZWave: Received timeout notification from HomeID: 3833672857, NodeID: 56 (0x38)

Now let's see what happens if I run pip install requests

And after doing that the result was:
C:\Windows\system32>pip install requests
Collecting requests
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.11-py2.py3-none-any.whl (127 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Installing collected packages: urllib3, certifi, chardet, idna, requests
Successfully installed certifi-2020.6.20 chardet-3.0.4 idna-2.10 requests-2.24.0 urllib3-1.25.11
WARNING: You are using pip version 20.2.1; however, version 20.2.4 is available.
You should consider upgrading via the 'c:\program files\python38-32\python.exe -m pip install --upgrade pip' command.

And everything was up and running again. Issue fixed!

In the deCONZ application everything is connected to the host. In order to achieve that I did have to use an USB extension cable, which I didn't really want to. But I think it is too close to the Z-Wave USB stick otherwise.

Thanks again for thinking along!

So you have installed python 3.7 to make it working, then return to 3.8 and it is still working ?

Exactly! And now in the user folder no python folders have been created. So I guess the first installation was not as administrator.

Was a little bit sleepy yesterday.... so to add to this: most likely at some point I installed Python not as administrator thus some of the Python folders ending up in my user\programdata folder. If I then run "pip install requests" it of course mentions that has already been done, but it is not available for the user running the Domoticz website and thus the plugin

IDK, I had so much problems too, forced to install manually pip with a python file, packages problem, path problem, why it s so difficult to install python on a windows machine ...