Docker: zigbee2mqtt plugin - not working after Z2M upgrade

[AlanGpio]

I have search for similar posting and the net but not found anything, so help would be much appreciated.

I decided to upgrade my Docker zigbee2mqtt container as I had a new device that was not recognised despite the zigbee2mqtt website saying it was supported. I also for good measure updated the plugin via the Docker / Domoticz console.

Domoticz V2020.2 (build 12705)
Zigbee2MQTT version 1.20.0 (commit #41b67fd)
zigbee-herdsman (0.13.117)
plugin ## v3.0 from # Changelog file

I then found that in Domoticz / Custom / Zigbee2Mqtt that it never displays the devices or the network map - just says "Loading..."
Neither do Switches work, either from Dashboard -> Switch or Switch -> Dashboard

Zigbee2MQTT seems to be OK. The new web interface works and devices are listed and the network mapped and no error messages.

I did disable and enable the Zigbee2MQTT Dongle (Idx 6) in Hardware tab (this is of course the one from way back). I did notice in my Devices page that this device is unused:
Zigbee2MQTT Dongle api_transport
but it's Idx 50 is not recent as new devices are > 70

There are no error messages on the Domoticz log (other than this new device, a SonOff SNZB-04 Door/Window sensor is still no identified):

Code: Select all

 2021-07-12 22:08:04.866 Status: PluginSystem: Entering work loop.
2021-07-12 22:08:05.272 (Zigbee2MQTT Dongle) Installing plugin custom page...
2021-07-12 22:08:05.300 (Zigbee2MQTT Dongle) Installing plugin custom page completed.
2021-07-12 22:08:05.351 (Zigbee2MQTT Dongle) Connected to MQTT Server: xxx.xxx.x.xx:xxxx
2021-07-12 22:08:05.452 (Zigbee2MQTT Dongle) Zigbee2mqtt bridge is online
2021-07-12 22:08:05.454 (Zigbee2MQTT Dongle) Received available devices list from bridge
2021-07-12 22:08:05.455 (Zigbee2MQTT Dongle) 0x00124b002235dd6e: device definiton not found, skipping...
2021-07-12 22:08:05.455 (Zigbee2MQTT Dongle) Joining new devices is disabled on the zigbee bridge
2021-07-12 22:08:05.271 Status: (Zigbee2MQTT Dongle) Entering work loop.
2021-07-12 22:08:05.271 Status: (Zigbee2MQTT Dongle) Initialized version 3.0.1
2021-07-12 22:08:05.491 Status: MQTT: Connecting to xxx.xxx.x.xx:xxxx
2021-07-12 22:08:05.692 Status: MQTT: connected to: xxx.xxx.x.xx:xxxx
2021-07-12 22:08:05.892 Status: MQTT: Subscribed
2021-07-12 22:08:15.473 Status: Incoming connection from: xxx.xxx.x.xx:xxxx
2021-07-12 22:17:19.524 Status: User: Admin (IP: xxx.xxx.x.xx) initiated a switch command (73/Immersion Switch/On) 

I also read and amended my zigbee2mqtt configuration.yaml with:

Code: Select all

experimental:
  new_api: true
frontend:  
   port: xxxx

I note that some people have had problems and reverted to a previous version of the plugin. I don't know how to do that. If someone can tell me, then I can try that.

Thanks for reading.
Alan, UK

[HansOtten]

(May 11 2021) I had to restore the plugin to an older version before the commits to humidity/temperature/pressure which broke the WSDCGQ11LM sensors.

cd domoticz/plugins/zigbee2mqtt
git reset --hard b708fc4
and restart the system.

[AlanGpio]

Hi Hans. Thank you for helping. I tried your suggestion but the problem remains. When I ran you suggestion I got:

Code: Select all

root@e8e0c1e0f2ae:/# cd /src/domoticz/plugins/zigbee2mqtt
root@e8e0c1e0f2ae:/src/domoticz/plugins/zigbee2mqtt# git reset --hard b708fc4
HEAD is now at b708fc4 fix renaming of devices
root@e8e0c1e0f2ae:/src/domoticz/plugins/zigbee2mqtt# 

Is this as expected?

There are no errors on the Domoticz log, much the same as before:

Code: Select all

021-07-13 11:53:26.364 Sunrise: 05:05:00 SunSet: 21:21:00
2021-07-13 11:53:26.365 Day length: 16:15:00 Sun at south: 13:13:00
2021-07-13 11:53:26.365 Civil twilight start: 04:20:00 Civil twilight end: 22:06:00
2021-07-13 11:53:26.365 Nautical twilight start: 03:14:00 Nautical twilight end: 23:12:00
2021-07-13 11:53:26.365 There is no astronomical twilight in the space of 24 hours
2021-07-13 11:53:26.458 Active notification Subsystems: email, fcm, telegram (3/13)
2021-07-13 11:53:26.462 Starting shared server on: 0.0.0.0:6144
2021-07-13 11:53:26.351 Status: Domoticz V2020.2 (build 12705) (c)2012-2020 GizMoCuz
2021-07-13 11:53:26.351 Status: Build Hash: d05c1201b-modified, Date: 2020-11-25 08:40:24
2021-07-13 11:53:26.351 Status: Startup Path: /src/domoticz/
2021-07-13 11:53:26.454 Status: PluginSystem: Started, Python version '3.7.3'.
2021-07-13 11:53:26.460 Status: WebServer(HTTP) started on address: 0.0.0.0 with port 8080
2021-07-13 11:53:26.463 Status: TCPServer: shared server started...
2021-07-13 11:53:26.463 Status: RxQueue: queue worker started...
2021-07-13 11:53:28.513 Status: Sysfs GPIO: Startup - polling:no interrupts:yes debounce:50msec inputs:11 outputs:6
2021-07-13 11:53:28.514 Status: (Zigbee2MQTT Dongle) Started.
2021-07-13 11:53:28.514 Status: EventSystem: reset all events...
2021-07-13 11:53:28.514 Status: NotificationSystem: thread started...
2021-07-13 11:53:28.514 Status: Sysfs GPIO: Edge detection started
2021-07-13 11:53:28.515 Status: EventSystem: reset all device statuses...
2021-07-13 11:53:28.622 Status: Python EventSystem: Initalizing event module.
2021-07-13 11:53:28.623 Status: EventSystem: Started
2021-07-13 11:53:28.623 Status: EventSystem: Queue thread started...
2021-07-13 11:53:28.871 Status: PluginSystem: Entering work loop.
2021-07-13 11:53:29.132 (Zigbee2MQTT Dongle) Installing plugin custom page...
2021-07-13 11:53:29.160 (Zigbee2MQTT Dongle) Installing plugin custom page completed.
2021-07-13 11:53:29.210 (Zigbee2MQTT Dongle) Connected to MQTT Server: 192.168.1.42:1883
2021-07-13 11:53:29.311 (Zigbee2MQTT Dongle) Zigbee2mqtt bridge is online
2021-07-13 11:53:29.315 (Zigbee2MQTT Dongle) Received available devices list from bridge
2021-07-13 11:53:29.315 (Zigbee2MQTT Dongle) 0x00124b002235dd6e: device definiton not found, skipping...
2021-07-13 11:53:29.315 (Zigbee2MQTT Dongle) Joining new devices is disabled on the zigbee bridge
2021-07-13 11:53:29.130 Status: (Zigbee2MQTT Dongle) Entering work loop.
2021-07-13 11:53:29.131 Status: (Zigbee2MQTT Dongle) Initialized version 3.0.0
2021-07-13 11:53:29.514 Status: MQTT: Connecting to 192.168.1.42:1883
2021-07-13 11:53:29.716 Status: MQTT: connected to: 192.168.1.42:1883
2021-07-13 11:53:29.917 Status: MQTT: Subscribed 

The Domoticz log in Docker has a few more lines:

Code: Select all

2021-07-13 11:53:29.315  (Zigbee2MQTT Dongle) Joining new devices is disabled on the zigbee bridge
2021-07-13 11:53:29.514  Status: MQTT: Connecting to 192.168.1.42:1883
2021-07-13 11:53:29.716  Status: MQTT: connected to: 192.168.1.42:1883
2021-07-13 11:53:29.917  Status: MQTT: Subscribed
2021-07-13 11:53:36.165  Status: Incoming connection from: 192.168.1.15

Strange that it says "Joining new devices is disabled on the zigbee bridge" as the bridge (using the new web interface to Z2M) / settings "Permit to Join" is ticked

Alan

[HansOtten]

The number was just a suggestion, it refers to a version before my problem was introduced, not that old (2021 also)

I do not know if there is an older version of the plugin that may help with your problem.

[HansOtten]

Two places to check:

Zigbee2mqtt config
- make sure that permit_join: true is set in your configuration.yaml. Otherwise new devices cannot join the network!

Domoticz

- settings : allow new hardware devices to join (for 5 minutes! )
- custom -zigee2mqtt allow new zigbee devices to join

[AlanGpio]

Zigbee2mqtt config
- make sure that permit_join: true is set in your configuration.yaml.

It is

Domoticz
- settings : allow new hardware devices to join (for 5 minutes! )

It is - I clicked the Allow button

- custom -zigee2mqtt allow new zigbee devices to join[/quote]
I don't have that option!

Domotixcz custom zigbee2mqtt.jpg (34.69 KiB) Viewed 1497 times

I presume the new plugin is rendering this page.

I checked the files in the /src/domoticz/plugins/zigbee2mqtt directory

The CHANGELOG.md is still showing V3.0 - should updating to the older version have gone back to a pre V3.
It's a pity there seems to be nothing to confirm build version or date.

I looked at frontend/zigbee2mqtt.html and the code for the button is there:

Code: Select all

<div class="align-right" ng-if="$ctrl.controllerInfo">
                <div>{{ $ctrl.getVersionString() }}</div>
                <label>
                    <input type="checkbox"
                           class="noscheck"
                           ng-model="$ctrl.controllerInfo.permit_join"
                           ng-change="$ctrl.togglePermitJoin()">
                    Allow new zigbee devices to join
                </label>

I normally use Firefox but it's the same in Chrome and Opera. I cleared the FF cache and reloaded - still the same.

Inspecting the page source I cannot find any mention of "Allow new zigbee devices to join".

So I change the html header from zigbee2mqtt to zigbee2mqtt2 and restarted Domoticz, cleared the browser cache and reloaded the custom zigbee2mqtt page. It now shows the amended header. So the plugin is being used. Still no "Allow new zigbee devices to join" button.

I'm stuck for ideas!

Alan

[HansOtten]

Mine says in the top right corner

v.1.18.3 (zStack3x0 20210120)
[ ] Allow new zigbee devices to join

My plugin version is the version 30 days ago, last time I rebooted.

With this check the plugin tells zigbee2mqtt to allow or disallow joins. Unchecked: disallowed, overrides the yaml setting.

When I vioew the page source: no 'join'
But with the Chrome console it is there, must be some scripting.

[AlanGpio]

I have raised an Issue on github https://github.com/stas-demydiuk/domoti ... issues/671