migrate Z2M to Z4D

[eddieb]

Hi,
I am running Zigbee2MQTT for a long time and would like to migrate to Zigbee4Domoticz.
Is there any guide for this ?
Any help would be appreciated.

Eddie

[waltervl]

I suppose it is the same method from Zigbee2MQTT plugin to MQTT Autodiscover. Should be something like:
1. Disable (not delete!) Zigbee2MQTT (plugin?) from Domoticz. Reboot system or restart Domoticz
2. Add Domoticz ZigbeeforDomoticz plugin and see if new devices are created. Not sure how this will happen. The pairing info is in the stick so ZfD should read it and new devices will be created in Domoticz.
3. Rename new devices to old names if used in scripts or modify scripts to use new names. If Zigbee2MQTT was disabled in Domoticz, devices with the same name will give errors in dzVents so delete the old device from Plugin after renaming the new device. Is function replace device (wiki https://www.domoticz.com/wiki/Managing_ ... ace_device ) a good alternative method as it will also keep the device history logging if present.
4. Delete Zigbee2MQTT hardware entry in Domoticz

[pipiche]

unfortunately you will have to redo the pairing of all of your devices as the plugin needs to go through a discovery.

I know that in Domoticz there is a way to keep the history of previous Widget/Device ( I don't know how it works and if it is possible between different plugin instances) that could be a path to at least keep the history of the Temp, Humi, Baro sensors as well as Meters, Power and P1

[pipiche]

@eddieb did you succeed ?

[eddieb]

@pipiche I am trying Z4D on a spare system right now.
I encouterd some issues with installing thru the python plugin manager.
Needed to fix some stuff manually before the sonoff stick was detected and working.
The plugin directory is called "Zigate" if installed thru ppmanager for example.. not all needed python modules where installed.
The "integration" page in domoticz is not working. just a blank page.. need to go to the 9440 page manually
I tried to pair a divice and that seems to work but not all is working as expected thru the 9440 interface

Screenshot 2022-12-04 at 09.47.20.png (363.53 KiB) Viewed 1095 times

like I expect a checkbox in from of this device ...
Also the device map only shows the coordinator, not this device ...
It could be that I am missing something, still trying to find and read documentation on how to setup things

[pipiche]

I’m afraid that installation via plugin manager is not working. There are a set of wiki attached to the plugin which document step by step the instructions.

Plugin managers do not support post installation scripts and I’m afraid that your setup is not correct.

Providing plugin logs and DomoticZ would also help

[eddieb]

Ok, I removed the PPmanager install and followed the wiki
integration page stil not working
startup log :

Code: Select all

~/domoticz/plugins/Domoticz-Zigbee/Logs $ sudo cat PluginZigbee_17.log 
2022-12-04 13:27:06,749 INFO    : [     MainThread 0] Zigbee for Domoticz (z4d) plugin stable6-6.3.007 started
2022-12-04 13:27:06,786 INFO    : [     MainThread 0] Plugin Database: DeviceList-17.txt
2022-12-04 13:27:06,795 INFO    : [     MainThread 0] DeviceConf loaded - 22 confs loaded
2022-12-04 13:27:07,089 INFO    : [     MainThread 0] DeviceConf loaded - 369 confs loaded
2022-12-04 13:27:07,092 INFO    : [     MainThread 0] load ListOfDevice
2022-12-04 13:27:07,093 ERROR   : [       MainThread] checkListOfDevice2Devices - Zigbee4Domoticz - ED-10014_Voltage-b4e3f9fffeefa9f1-04 - b4e3f9fffeefa9f1 not found in Plugin Database
2022-12-04 13:27:07,096 ERROR   : [       MainThread] checkListOfDevice2Devices - Zigbee4Domoticz - ED-10014_Voltage-b4e3f9fffeefa9f1-01 - b4e3f9fffeefa9f1 not found in Plugin Database
2022-12-04 13:27:07,099 ERROR   : [       MainThread] checkListOfDevice2Devices - ED-10014-5 - b4e3f9fffeefa9f1 not found in Plugin Database
2022-12-04 13:27:07,111 ERROR   : [       MainThread] checkListOfDevice2Devices - Zigbee4Domoticz - ED-10014_Voltage-b4e3f9fffeefa9f1-04 - b4e3f9fffeefa9f1 not found in Plugin Database
2022-12-04 13:27:07,114 ERROR   : [       MainThread] checkListOfDevice2Devices - ED-10014-7 - b4e3f9fffeefa9f1 not found in Plugin Database
2022-12-04 13:27:07,150 ERROR   : [       MainThread] checkListOfDevice2Devices - Zigbee4Domoticz - ED-10014_Voltage-b4e3f9fffeefa9f1-04 - b4e3f9fffeefa9f1 not found in Plugin Database
2022-12-04 13:27:07,156 ERROR   : [       MainThread] checkListOfDevice2Devices - ED-10014-9 - b4e3f9fffeefa9f1 not found in Plugin Database
2022-12-04 13:27:07,165 INFO    : [     MainThread 0] Transport mode: ZigpyZNP
2022-12-04 13:27:09,828 DEBUG   :Using selector: EpollSelector
2022-12-04 13:27:09,829 INFO    : [     MainThread 0] Start Zigpy Transport on ZNP
2022-12-04 13:27:09,830 INFO    : [     MainThread 0] ZigpyTransport __init__
2022-12-04 13:27:09,835 INFO    : [    ZigpyCom_17 0] Starting radio znp port: /dev/serial/by-id/usb-Silicon_Labs_Sonoff_Zigbee_3.0_USB_Dongle_Plus_0001-if00-port0
2022-12-04 13:27:09,845 INFO    : [ZigpyForwarder_17 0] ZigpyTransport: thread_processing_and_sending Thread start.
2022-12-04 13:27:09,848 INFO    : [     MainThread 0] Start Web Server connection
2022-12-04 13:27:09,872 INFO    : [     MainThread 0] Web backend for Web User Interface started on port: 9440
2022-12-04 13:27:09,872 INFO    : [     MainThread 0] Domoticz Widgets usage is at 3.9 % (245 units free)
2022-12-04 13:27:10,576 INFO    : [    ZigpyCom_17 0] Started radio znp port: /dev/serial/by-id/usb-Silicon_Labs_Sonoff_Zigbee_3.0_USB_Dongle_Plus_0001-if00-port0
2022-12-04 13:27:18,542 INFO    : [    ZigpyCom_17 0] ZNP Radio register default Ep
2022-12-04 13:27:18,560 INFO    : [    ZigpyCom_17 0] ZNP Radio register any additional/specific Ep
2022-12-04 13:27:18,703 INFO    : [    ZigpyCom_17 0] device_initialized (0x0000 00:12:4b:00:26:b6:98:a9)
2022-12-04 13:27:18,704 INFO    : [    ZigpyCom_17 0] ZNP Configuration {'device': {'path': '/dev/serial/by-id/usb-Silicon_Labs_Sonoff_Zigbee_3.0_USB_Dongle_Plus_0001-if00-port0', 'flow_control': None, 'baudrate': 115200}, 'network': {'channels': <Channels.CHANNEL_25|CHANNEL_20|CHANNEL_15: 34635776>, 'key': None, 'pan_id': None, 'tc_address': None, 'update_id': 0, 'tc_link_key': 5a:69:67:42:65:65:41:6c:6c:69:61:6e:63:65:30:39, 'extended_pan_id': None, 'channel': 15, 'key_sequence_number': 0}, 'znp_config': {'tx_power': 0, 'skip_bootloader': True, 'led_mode': <LEDMode.OFF: 0>, 'connect_rts_pin_states': [False, True, False], 'connect_dtr_pin_states': [False, False, False], 'sync_request_timeout': 15, 'async_response_timeout': 30, 'auto_reconnect_retry_delay': 5, 'prefer_endpoint_1': True, 'max_concurrent_requests': None}, 'topology_scan_enabled': False, 'source_routing': False, 'backup_enabled': True, 'backup_period': 1, 'database_path': None, 'topology_scan_skip_coordinator': False, 'additional_endpoints': [], 'ota': {'salus_provider': False, 'sonoff_provider': False, 'inovelli_provider': False, 'ikea_provider': False, 'otau_directory': None, 'ledvance_provider': False}, 'validate_network_settings': False, 'max_concurrent_requests': 8, 'topology_scan_period': 240}
2022-12-04 13:27:29,164 INFO    : [    ZigpyCom_17 0] ZNP Radio manufacturer: Texas Instruments
2022-12-04 13:27:29,171 INFO    : [    ZigpyCom_17 0] ZNP Radio board model: CC1352/CC2652, Z-Stack 3.30+ (build 20210708)
2022-12-04 13:27:29,182 INFO    : [    ZigpyCom_17 0] ZNP Radio version: 3.3
2022-12-04 13:27:29,188 INFO    : [    ZigpyCom_17 0] Network settings
2022-12-04 13:27:29,189 INFO    : [    ZigpyCom_17 0]   Channel: 15
2022-12-04 13:27:29,191 INFO    : [    ZigpyCom_17 0]   PAN ID: 0x5BC2
2022-12-04 13:27:29,191 INFO    : [    ZigpyCom_17 0]   Extended PAN ID: 28:d3:d1:e8:96:6b:20:79
2022-12-04 13:27:29,192 INFO    : [    ZigpyCom_17 0]   Device IEEE: 00:12:4b:00:26:b6:98:a9
2022-12-04 13:27:29,193 INFO    : [    ZigpyCom_17 0]   Device NWK: 0x0000
2022-12-04 13:27:29,194 INFO    : [ZigpyForwarder_17 0] Number of devices recently active in Zigate = 2
2022-12-04 13:27:29,197 INFO    : [ZigpyForwarder_17 0] [00] DevID: 00 Network addr: 3e29 IEEE: b4e3f9fffeefa9f1 LQI: 000 power: ff not found in plugin database!
2022-12-04 13:27:29,199 INFO    : [ZigpyForwarder_17 0] [01] DevID: 00 Network addr: b4e3 IEEE: f9fffeefa9f13e29 LQI: 000 power: ff not found in plugin database!
2022-12-04 13:27:29,204 INFO    : [ZigpyForwarder_17 0] CC1352/CC2652, Z-Stack 3.30+ (znp)
2022-12-04 13:27:29,215 INFO    : [ZigpyForwarder_17 0] Installer Version Number: 0708
2022-12-04 13:27:29,222 INFO    : [ZigpyForwarder_17 0] Branch Version: ==> CC1352/CC2652, Z-Stack 3.30+ (znp) <==
2022-12-04 13:27:29,228 INFO    : [ZigpyForwarder_17 0] Updating Channel in Plugin Configuration from: 0 to: 15
2022-12-04 13:27:29,229 INFO    : [ZigpyForwarder_17 0] Zigbee Coordinator ieee: 00124b0026b698a9 , short addr: 0000
2022-12-04 13:27:29,229 INFO    : [ZigpyForwarder_17 0] Network state UP, PANID: 5bc2 extPANID: 0x28d3d1e8966b2079 Channel: 15
2022-12-04 13:27:30,814 ERROR   :Received an exception while passing frame to API: TransportFrame(payload=GeneralFrame(header=CommandHeader(id=0xC0, subsystem=Subsystem.ZDO, type=CommandType.AREQ), data=b'\x00\x00\x82'))
Traceback (most recent call last):
  File "/home/pi/domoticz/plugins/Domoticz-Zigbee/zigpy_znp/uart.py", line 72, in data_received
    self._api.frame_received(frame.payload)
  File "/home/pi/domoticz/plugins/Domoticz-Zigbee/zigpy_znp/api.py", line 810, in frame_received
    command = command_cls.from_frame(frame, align=self.nvram.align_structs)
  File "/home/pi/domoticz/plugins/Domoticz-Zigbee/zigpy_znp/types/commands.py", line 434, in from_frame
    f"Frame {frame} contains trailing data after parsing: {data}"
ValueError: Frame GeneralFrame(header=CommandHeader(id=0xC0, subsystem=Subsystem.ZDO, type=CommandType.AREQ), data=b'\x00\x00\x82') contains trailing data after parsing: b'\x00\x82'
2022-12-04 13:27:38,055 INFO    : [     MainThread 0] Request Disabling Accepting new Hardware
2022-12-04 13:27:38,106 INFO    : [    ZigpyCom_17 0] PERMIT-TO-JOIN: {'cmd': 'PERMIT-TO-JOIN', 'datas': {'Duration': 0, 'targetRouter': 'FFFC'}, 'NwkId': None, 'TimeStamp': 1670156858.0530267, 'ACKIsDisable': False, 'Sqn': None}
2022-12-04 13:27:38,108 INFO    : [    ZigpyCom_17 0] PERMIT-TO-JOIN: duration: 0 for Radio: znp for node: None
2022-12-04 13:27:38,108 INFO    : [    ZigpyCom_17 0] Calling self.app.permit(time_s=0, node=None )
2022-12-04 13:27:38,136 INFO    : [ZigpyForwarder_17 0] Accepting new Hardware: Disable (Off)
2022-12-04 13:27:38,173 INFO    : [    ZigpyCom_17 0] returning from the self.app.permit(time_s=0, node=None )
2022-12-04 13:27:43,077 INFO    : [     MainThread 0] Switch Blue Led On
2022-12-04 13:27:43,080 INFO    : [     MainThread 0] coordinator set to Certification : 1/CE -> CE
2022-12-04 13:27:43,782 INFO    : [     MainThread 0] ota_scan_folder Following Firmware have been loaded 
2022-12-04 13:27:43,784 INFO    : [     MainThread 0] Plugin with Zigpy, Coordinator CC1352/CC2652, Z-Stack 3.30+ (znp) firmware Znp - (....0708) correctly initialized

[azonneveld]

Just out of curiosity: why do you want to move from Z2M to Z4D?

[eddieb]

I am on the point that I should replace my coordinator stick.
That seemed a good moment to reconsider the choice between Z2M and Z4D
I was reading some good stuff on Z4D here on the forums.
For now it is not doing what I want, even on my clean installed RP3b+
At the same time I was trying to get a new zigbee network up and running at a friends house

[pipiche]

Don't you have a firewall in between which could prevent the access on the port 9440 ?

[eddieb]

the RPI3B+ is a fresh raspian os install with on top a fresh domoticz and a fresh Z4D install
it is in the same network as my laptop so no firewall.
I can reach domoticz on tcp/443 and tcp/8080 and z4m on 9440
when I go to the custom page on domoticz the z4m page is created but it stays empty
tried on FireFox latest and on Safari, both same results
Looked in the source of https://192.168.2.200/#/Custom/Z4D page and there is not a sign of the Z4D content

[pipiche]

Sorry, I didn't understood what you were looking for.
So if I understood your issue, you cannot access the plugin WebUI from the Domoticz Custom menu, is that correct ?

[eddieb]

That is correct
in the domiticz dropdown "Custom" is an entry created "Z4M".
clicking on that entry gives a blank screen.
accessing port 9440 directly works.

[pipiche]

Any error messages in the Domoticz Logs ?

what are the access rights of domoticz/www and domoticz/www/templates ?

Code: Select all

ls -l www
ls -l www/templates

is domoticz running as root or as a normal user ?

I beleive something is preventing the plugin to write into the domoticz/www/templates folder and put the Zigbee.html file

[eddieb]

~/domoticz/www/templates $ ls -l
total 16
-rw-r----- 1 root root 179 Dec 4 18:51 Z4D.html
-rw-r--r-- 1 pi pi 6964 Nov 9 2020 custom.example
-rw-r--r-- 1 pi pi 176 Nov 9 2020 readme.txt

domoticz runs as the default installed user
$ ps aux | grep domoticz
root 9800 18.2 6.9 1439888 65160 ? Ssl 18:51 0:11 /home/pi/domoticz/domoticz -daemon -www 8080 -sslwww 443

[pipiche]

Is Z4D the name of the Plugin hardware ?

what do you have in the file

Code: Select all

domoticz/www/templates/Z4D.html

?

[edit]
I believed you tried to clear the firefox cache ?

[eddieb]

~/domoticz/www/templates $ sudo cat Z4D.html
<iframe id="Z4D"style="width:100%;height:800px;overflow:scroll;">
</iframe>

<script>
document.getElementById('Z4D').src = "http://" + location.hostname + ":9440/z4d/";
</script>

[pipiche]

and cleaning the firefox cache , didn't help ?

So from what I see all seems ok, it is just that Domoticz doesn't load correctly the page

[eddieb]

It also does not work in Safari ...
cleared cache ...
tried private windows
no luck

[pipiche]

honestly I have no clue, maybe someone from Domoticz size, as the custom menu seems to be correctly created