Python plugin: Presence detection from wireless router

[EscApe]

You did not install parallel-ssh

Code: Select all

pip install parallel-ssh

[Fredom]

You did not install parallel-ssh

Code: Select all

pip install parallel-ssh

Hi EscApe,

I'll do that on Saturday, I'm away for a few days now.

[Fredom]

You did not install parallel-ssh

Code: Select all

pip install parallel-ssh

Hi EscApe,
I think I've done everything you suggested.
Unfortunately it still doesn't work.
Below is what I did.

Code: Select all

redom@raspberrypi:~/domoticz/plugins/iDetect $ pip install parallel-ssh
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Requirement already satisfied: parallel-ssh in /home/fredom/.local/lib/python3.9/site-packages (2.12.0)
Requirement already satisfied: gevent>=1.3.0 in /home/fredom/.local/lib/python3.9/site-packages (from parallel-ssh) (23.9.1)
Requirement already satisfied: ssh2-python in /home/fredom/.local/lib/python3.9/site-packages (from parallel-ssh) (1.0.0)
Requirement already satisfied: ssh-python in /home/fredom/.local/lib/python3.9/site-packages (from parallel-ssh) (1.0.0)
Requirement already satisfied: zope.event in /home/fredom/.local/lib/python3.9/site-packages (from gevent>=1.3.0->parallel-ssh) (5.0)
Requirement already satisfied: zope.interface in /home/fredom/.local/lib/python3.9/site-packages (from gevent>=1.3.0->parallel-ssh) (6.1)
Requirement already satisfied: greenlet>=2.0.0 in /home/fredom/.local/lib/python3.9/site-packages (from gevent>=1.3.0->parallel-ssh) (3.0.0)
Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (from zope.event->gevent>=1.3.0->parallel-ssh) (52.0.0)
fredom@raspberrypi:~/domoticz/plugins/iDetect $ 

Code: Select all

redom@raspberrypi:~ $ sudo pip install parallel-ssh
Traceback (most recent call last):
  File "/usr/bin/pip", line 33, in <module>
    sys.exit(load_entry_point('pip==20.3.4', 'console_scripts', 'pip')())
  File "/usr/bin/pip", line 25, in importlib_load_entry_point
    return next(matches).load()
  File "/usr/lib/python3.9/importlib/metadata.py", line 77, in load
    module = import_module(match.group('module'))
  File "/usr/lib/python3.9/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 790, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/usr/lib/python3/dist-packages/pip/_internal/cli/main.py", line 10, in <module>
    from pip._internal.cli.autocompletion import autocomplete
  File "/usr/lib/python3/dist-packages/pip/_internal/cli/autocompletion.py", line 9, in <module>
    from pip._internal.cli.main_parser import create_main_parser
  File "/usr/lib/python3/dist-packages/pip/_internal/cli/main_parser.py", line 7, in <module>
    from pip._internal.cli import cmdoptions
  File "/usr/lib/python3/dist-packages/pip/_internal/cli/cmdoptions.py", line 23, in <module>
    from pip._vendor.packaging.utils import canonicalize_name
  File "/usr/lib/python3/dist-packages/pip/_vendor/__init__.py", line 94, in <module>
    vendored("requests.packages.urllib3.contrib.pyopenssl")
  File "/usr/lib/python3/dist-packages/pip/_vendor/__init__.py", line 36, in vendored
    __import__(modulename, globals(), locals(), level=0)
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
  File "<frozen zipimport>", line 259, in load_module
  File "/usr/share/python-wheels/urllib3-1.26.5-py2.py3-none-any.whl/urllib3/contrib/pyopenssl.py", line 50, in <module>
  File "/usr/lib/python3/dist-packages/OpenSSL/__init__.py", line 8, in <module>
    from OpenSSL import crypto, SSL
  File "/usr/lib/python3/dist-packages/OpenSSL/crypto.py", line 1556, in <module>
    class X509StoreFlags(object):
  File "/usr/lib/python3/dist-packages/OpenSSL/crypto.py", line 1577, in X509StoreFlags
    CB_ISSUER_CHECK = _lib.X509_V_FLAG_CB_ISSUER_CHECK
AttributeError: module 'lib' has no attribute 'X509_V_FLAG_CB_ISSUER_CHECK'
fredom@raspberrypi:~ $ 

Code: Select all

2023-10-28 10:47:03.214 Error: iDetect: Required modules for default tracker are not installed:No module named 'pssh'
2023-10-28 10:48:28.927 Error: iDetect: Required modules for default tracker are not installed:No module named 'pssh'
2023-10-28 10:50:08.061 Error: iDetect: Required modules for default tracker are not installed:No module named 'pssh'
2023-10-28 10:52:27.763 Error: iDetect: Required modules for default tracker are not installed:No module named 'pssh'

[EscApe]

Code: Select all

sudo pip install parallel-ssh

Should have done the trick. I think your Python setup might be corrupted. You could try reinstalling pip or running pip3, but it might be better to start with a fresh system if troubleshooting is not your thing.

There is still no guarantee the beta plugin will solve your original problem. It was already very strange that the plugin would succeed in doing the auto detection but would fail using the same ssh connection to actually poll the router-data. If Paramiko was the culprit then I would expect it to fail at both actions. So .... that still might take more on-site troubleshooting.

[Fredom]

Code: Select all

sudo pip install parallel-ssh

Should have done the trick. I think your Python setup might be corrupted. You could try reinstalling pip or running pip3, but it might be better to start with a fresh system if troubleshooting is not your thing.

There is still no guarantee the beta plugin will solve your original problem. It was already very strange that the plugin would succeed in doing the auto detection but would fail using the same ssh connection to actually poll the router-data. If Paramiko was the culprit then I would expect it to fail at both actions. So .... that still might take more on-site troubleshooting.

Hi EscApe,
I have tried with and without sudo, but without success. I'll just start with a clean installation. It will take some time before that is finished. I'll come back to it when that's done. Thanks so far

[Fredom]

Code: Select all

sudo pip install parallel-ssh

Should have done the trick. I think your Python setup might be corrupted. You could try reinstalling pip or running pip3, but it might be better to start with a fresh system if troubleshooting is not your thing.

There is still no guarantee the beta plugin will solve your original problem. It was already very strange that the plugin would succeed in doing the auto detection but would fail using the same ssh connection to actually poll the router-data. If Paramiko was the culprit then I would expect it to fail at both actions. So .... that still might take more on-site troubleshooting.

Hi EscApe,

Unfortunately it doesn't work on a clean installation either.
Below are the log files of Domoticz

Code: Select all

2023-11-01 15:29:39.003 Sunrise: 07:36:00 SunSet: 17:14:00
2023-11-01 15:29:39.003 Day length: 09:39:00 Sun at south: 12:25:00
2023-11-01 15:29:39.003 Civil twilight start: 07:00:00 Civil twilight end: 17:50:00
2023-11-01 15:29:39.003 Nautical twilight start: 06:21:00 Nautical twilight end: 18:30:00
2023-11-01 15:29:39.003 Astronomical twilight start: 05:42:00 Astronomical twilight end: 19:09:00
2023-11-01 15:29:38.765 Status: Domoticz V2023.2 (c)2012-2023 GizMoCuz
2023-11-01 15:29:38.765 Status: Build Hash: 19efd039c, Date: 2023-07-21 17:23:44
2023-11-01 15:29:38.765 Status: Startup Path: /home/fredom/domoticz/
2023-11-01 15:29:40.004 Active notification Subsystems: telegram (1/13)
2023-11-01 15:29:39.973 Status: PluginSystem: Started, Python version '3.9.2', 4 plugin definitions loaded.
2023-11-01 15:29:40.132 Starting shared server on: :::6144
2023-11-01 15:29:40.061 Status: WebServer(HTTP) started on address: :: with port XXXX
2023-11-01 15:29:40.117 Status: WebServer(SSL) started on address: :: with port 443
2023-11-01 15:29:40.133 Status: TCPServer: shared server started...
2023-11-01 15:29:40.134 Status: RxQueue: queue worker started...
2023-11-01 15:29:42.136 iDetect: Worker thread started.
2023-11-01 15:29:42.501 iDetect: Debug logging mask set to: PYTHON PLUGIN IMAGE DEVICE CONNECTION
2023-11-01 15:29:42.501 iDetect: Operation system is: linux
2023-11-01 15:29:42.569 iDetect: The OS user profile running domoticz is: root
2023-11-01 15:29:42.569 iDetect: Parsing user and optional keyfile from:admin
2023-11-01 15:29:42.572 iDetect: Device unit exists for:Mobiel Fred
2023-11-01 15:29:42.572 iDetect: start get or create wireless device
2023-11-01 15:29:42.572 iDetect: Mobiel Fred monitor tag_id:9E:3F:87:C7:6A:B3, domoticz unit:Mobiel Fred
2023-11-01 15:29:42.572 iDetect: Monitoring {'9E:3F:87:C7:6A:B3': <plugin.tag_device object at 0x6ecc7310>} for presence.
2023-11-01 15:29:42.572 iDetect: Tracker configuration:192.168.1.1
2023-11-01 15:29:42.572 iDetect: Configuring tracker:192.168.1.1
2023-11-01 15:29:42.572 iDetect: options:
2023-11-01 15:29:42.572 iDetect: Debug logging mask set to: PYTHON PLUGIN IMAGE DEVICE CONNECTION
2023-11-01 15:29:42.572 iDetect: All arguments (except password) for tracker init:{'debug': True, 'tracker_ip': '192.168.1.1', 'tracker_port': None, 'tracker_user': 'admin', 'tracker_keyfile': '', 'poll_interval': 15}
2023-11-01 15:29:42.572 iDetect: Type requested:default
2023-11-01 15:29:42.406 Status: iDetect: Initialized version 2.5, author 'ESCape'
2023-11-01 15:29:42.596 Status: PluginSystem: 1 plugins started.
2023-11-01 15:29:42.754 Status: Python EventSystem: Initializing event module.
2023-11-01 15:29:42.755 Status: EventSystem: Started
2023-11-01 15:29:42.755 Status: EventSystem: Queue thread started...
2023-11-01 15:29:43.592 iDetect: Trackertype 'default' got router module: unavailable_tracker
2023-11-01 15:29:43.593 iDetect: Arguments passed to tracker (except password):{'debug': True, 'tracker_ip': '192.168.1.1', 'tracker_port': None, 'tracker_user': 'admin', 'tracker_keyfile': '', 'poll_interval': 15}
2023-11-01 15:29:43.594 iDetect: Variables passed to the tracker class:{'debug': True, 'tracker_ip': '192.168.1.1', 'tracker_port': None, 'tracker_user': 'admin', 'tracker_password': '********', 'tracker_keyfile': '', 'poll_interval': 15}
2023-11-01 15:29:43.594 iDetect: 192.168.1.1 This is a substitude for the actual tracker module that could not be loaded because required python modules are missing
2023-11-01 15:29:43.594 iDetect: 192.168.1.1 Data will be received and interpreted by <bound method BasePlugin.onDataReceive of <plugin.BasePlugin object at 0x718e41c0>>
2023-11-01 15:29:43.594 iDetect: Tracker config:192.168.1.1, custom host:192.168.1.1, port:None, user:admin, type:default and options:{}
2023-11-01 15:29:43.594 iDetect: Trackers initialized as:{'192.168.1.1': <trackers.unavailable_tracker.unavailable_tracker object at 0x6ece1688>}
2023-11-01 15:29:43.594 iDetect: Heartbeat interval set to: 10.

Code: Select all

2023-11-01 15:29:43.587 Error: iDetect: Error while trying to import tracker module:/usr/local/lib/python3.9/dist-packages/ssh2/channel.cpython-39-arm-linux-gnueabihf.so: undefined symbol: libssh2_channel_request_auth_agent

[EscApe]

Sorry, I don't know why it still fails te import the module on your clean system. I just created a fresh Debian bullseye docker container to test and the beta plugin starts just fine on both the stable and latest beta release.

I am using the standard Docker file provided bij Domoticz on

Code: Select all

https://hub.docker.com/r/domoticz/domoticz

, so no extra's. Only added parallel-ssh and it works. The image includes Debian Bullseye and python 3.9.2

[Fredom]

Sorry, I don't know why it still fails te import the module on your clean system. I just created a fresh Debian bullseye docker container to test and the beta plugin starts just fine on both the stable and latest beta release.

I am using the standard Docker file provided bij Domoticz on

Code: Select all

https://hub.docker.com/r/domoticz/domoticz

, so no extra's. Only added parallel-ssh and it works. The image includes Debian Bullseye and python 3.9.2

Hi EscApe,

I don't use Docker, but the rest has approximately the same config. I'll try again with a clean install. If it doesn't work again, I will unfortunately have to switch to a ping script.

[Fredom]

Sorry, I don't know why it still fails te import the module on your clean system. I just created a fresh Debian bullseye docker container to test and the beta plugin starts just fine on both the stable and latest beta release.

I am using the standard Docker file provided bij Domoticz on

Code: Select all

https://hub.docker.com/r/domoticz/domoticz

, so no extra's. Only added parallel-ssh and it works. The image includes Debian Bullseye and python 3.9.2

Hi EscApe,

I did it again on a clean install.
1st Bulsseye for raspberrypi 3B installed
2nd Domoticz installed
3rd iDetect installed according to below.
sudo pip install parallel-ssh
sudo git clone -b DomoticzEx-based-beta https://github.com/d-EScape/Domoticz_iDetect.git iDetect (/home/fredom/domoticz/plugins)
4th iDetect plugin (instellingen/hardware)

I hope I did a good job even though it doesn't work yet.
Without the iDetect plugin I couldn't enter the mobile phones anywhere

Code: Select all

2023-11-02 12:23:53.810 Status: Domoticz V2023.2 (c)2012-2023 GizMoCuz
2023-11-02 12:23:53.810 Status: Build Hash: 19efd039c, Date: 2023-07-21 17:23:44
2023-11-02 12:23:53.810 Status: Startup Path: /home/fredom/domoticz/
2023-11-02 12:23:54.412 Sunrise: 07:38:00 SunSet: 17:13:00
2023-11-02 12:23:54.412 Day length: 09:35:00 Sun at south: 12:25:00
2023-11-02 12:23:54.412 Civil twilight start: 07:02:00 Civil twilight end: 17:48:00
2023-11-02 12:23:54.412 Nautical twilight start: 06:22:00 Nautical twilight end: 18:28:00
2023-11-02 12:23:54.412 Astronomical twilight start: 05:43:00 Astronomical twilight end: 19:07:00
2023-11-02 12:23:54.324 Error: Default admin password has NOT been changed! Change it asap!
2023-11-02 12:23:58.058 Active notification Subsystems: (0/13)
2023-11-02 12:23:58.210 Starting shared server on: :::6144
2023-11-02 12:23:58.023 Status: PluginSystem: Started, Python version '3.9.2', 2 plugin definitions loaded.
2023-11-02 12:23:58.151 Status: WebServer(HTTP) started on address: :: with port XXXX
2023-11-02 12:23:58.203 Status: WebServer(SSL) started on address: :: with port 443
2023-11-02 12:23:58.210 Status: TCPServer: shared server started...
2023-11-02 12:23:58.211 Status: RxQueue: queue worker started...
2023-11-02 12:24:00.212 iDetect: Worker thread started.
2023-11-02 12:24:00.894 iDetect: Debug logging mask set to: PYTHON PLUGIN IMAGE DEVICE CONNECTION
2023-11-02 12:24:00.894 iDetect: Operation system is: linux
2023-11-02 12:24:00.941 iDetect: The OS user profile running domoticz is: root
2023-11-02 12:24:00.942 iDetect: Parsing user and optional keyfile from:admin
2023-11-02 12:24:00.953 iDetect: Device unit exists for:Mobiel Fred
2023-11-02 12:24:00.953 iDetect: start get or create wireless device
2023-11-02 12:24:00.953 iDetect: Mobiel Fred monitor tag_id:9E:3F:87:C7:6A:B3, domoticz unit:Mobiel Fred
2023-11-02 12:24:00.954 iDetect: Monitoring {'9E:3F:87:C7:6A:B3': <plugin.tag_device object at 0x72ad80d0>} for presence.
2023-11-02 12:24:00.954 iDetect: Tracker configuration:192.168.1.1
2023-11-02 12:24:00.954 iDetect: Configuring tracker:192.168.1.1
2023-11-02 12:24:00.954 iDetect: options:
2023-11-02 12:24:00.954 iDetect: Debug logging mask set to: PYTHON PLUGIN IMAGE DEVICE CONNECTION
2023-11-02 12:24:00.954 iDetect: All arguments (except password) for tracker init:{'debug': True, 'tracker_ip': '192.168.1.1', 'tracker_port': None, 'tracker_user': 'admin', 'tracker_keyfile': '', 'poll_interval': 15}
2023-11-02 12:24:00.954 iDetect: Type requested:default
2023-11-02 12:24:00.212 Status: iDetect: Started.
2023-11-02 12:24:00.213 Status: NotificationSystem: thread started...
2023-11-02 12:24:00.214 Status: iDetect: Entering work loop.
2023-11-02 12:24:00.257 Status: EventSystem: reset all events...
2023-11-02 12:24:00.277 Status: EventSystem: reset all device statuses...
2023-11-02 12:24:00.409 Status: PluginSystem: 1 plugins started.
2023-11-02 12:24:00.754 Status: Python EventSystem: Initializing event module.
2023-11-02 12:24:00.755 Status: EventSystem: Started
2023-11-02 12:24:00.755 Status: EventSystem: Queue thread started...
2023-11-02 12:24:00.802 Status: iDetect: Initialized version 2.5, author 'ESCape'
2023-11-02 12:24:03.353 iDetect: Trackertype 'default' got router module: unavailable_tracker
2023-11-02 12:24:03.353 iDetect: Arguments passed to tracker (except password):{'debug': True, 'tracker_ip': '192.168.1.1', 'tracker_port': None, 'tracker_user': 'admin', 'tracker_keyfile': '', 'poll_interval': 15}
2023-11-02 12:24:03.371 iDetect: Variables passed to the tracker class:{'debug': True, 'tracker_ip': '192.168.1.1', 'tracker_port': None, 'tracker_user': 'admin', 'tracker_password': '********', 'tracker_keyfile': '', 'poll_interval': 15}
2023-11-02 12:24:03.371 iDetect: 192.168.1.1 This is a substitude for the actual tracker module that could not be loaded because required python modules are missing
2023-11-02 12:24:03.371 iDetect: 192.168.1.1 Data will be received and interpreted by <bound method BasePlugin.onDataReceive of <plugin.BasePlugin object at 0x706d8190>>
2023-11-02 12:24:03.372 iDetect: Tracker config:192.168.1.1, custom host:192.168.1.1, port:None, user:admin, type:default and options:{}
2023-11-02 12:24:03.372 iDetect: Trackers initialized as:{'192.168.1.1': <trackers.unavailable_tracker.unavailable_tracker object at 0x6f4e6d60>}
2023-11-02 12:24:03.372 iDetect: Heartbeat interval set to: 10.
2023-11-02 12:24:03.371 Status: iDetect: Starting address:192.168.1.1, port:None, user:admin, keyfile:, class:unavailable_tracker and poll interval:15
2023-11-02 12:24:03.338 Error: iDetect: Error while trying to import tracker module:/usr/local/lib/python3.9/dist-packages/ssh2/channel.cpython-39-arm-linux-gnueabihf.so: undefined symbol: libssh2_channel_request_auth_agent
2023-11-02 12:24:10.091 iDetect: onHeartbeat called
2023-11-02 12:24:10.097 iDetect: 0 devices are present (excluding ignored devices)
2023-11-02 12:24:18.382 iDetect: 192.168.1.1 Not (yet) ready for polling
2023-11-02 12:24:18.388 iDetect: Using address:192.168.1.1, port:None, user:admin, keyfile:, class:unavailable_tracker and poll interval:15
2023-11-02 12:24:20.073 iDetect: onHeartbeat called
2023-11-02 12:24:20.081 iDetect: 0 devices are present (excluding ignored devices)
2023-11-02 12:24:30.128 iDetect: onHeartbeat called
2023-11-02 12:24:30.133 iDetect: 0 devices are present (excluding ignored devices)
2023-11-02 12:24:33.396 iDetect: 192.168.1.1 Not (yet) ready for polling
2023-11-02 12:24:33.396 iDetect: Using address:192.168.1.1, port:None, user:admin, keyfile:, class:unavailable_tracker and poll interval:15
2023-11-02 12:24:40.108 iDetect: onHeartbeat called
2023-11-02 12:24:40.108 iDetect: 0 devices are present (excluding ignored devices)

Code: Select all

2023-11-02 12:23:53.810 Status: Domoticz V2023.2 (c)2012-2023 GizMoCuz
2023-11-02 12:23:53.810 Status: Build Hash: 19efd039c, Date: 2023-07-21 17:23:44
2023-11-02 12:23:53.810 Status: Startup Path: /home/fredom/domoticz/
2023-11-02 12:23:58.023 Status: PluginSystem: Started, Python version '3.9.2', 2 plugin definitions loaded.
2023-11-02 12:23:58.151 Status: WebServer(HTTP) started on address: :: with port 7575
2023-11-02 12:23:58.203 Status: WebServer(SSL) started on address: :: with port 443
2023-11-02 12:23:58.210 Status: TCPServer: shared server started...
2023-11-02 12:23:58.211 Status: RxQueue: queue worker started...
2023-11-02 12:24:00.212 Status: iDetect: Started.
2023-11-02 12:24:00.213 Status: NotificationSystem: thread started...
2023-11-02 12:24:00.214 Status: iDetect: Entering work loop.
2023-11-02 12:24:00.257 Status: EventSystem: reset all events...
2023-11-02 12:24:00.277 Status: EventSystem: reset all device statuses...
2023-11-02 12:24:00.409 Status: PluginSystem: 1 plugins started.
2023-11-02 12:24:00.754 Status: Python EventSystem: Initializing event module.
2023-11-02 12:24:00.755 Status: EventSystem: Started
2023-11-02 12:24:00.755 Status: EventSystem: Queue thread started...
2023-11-02 12:24:00.802 Status: iDetect: Initialized version 2.5, author 'ESCape'
2023-11-02 12:24:03.371 Status: iDetect: Starting address:192.168.1.1, port:None, user:admin, keyfile:, class:unavailable_tracker and poll interval:15

Code: Select all

2023-11-02 12:24:03.338 Error: iDetect: Error while trying to import tracker module:/usr/local/lib/python3.9/dist-packages/ssh2/channel.cpython-39-arm-linux-gnueabihf.so: undefined symbol: libssh2_channel_request_auth_agent

[Fredom]

Sorry, I don't know why it still fails te import the module on your clean system. I just created a fresh Debian bullseye docker container to test and the beta plugin starts just fine on both the stable and latest beta release.

I am using the standard Docker file provided bij Domoticz on

Code: Select all

https://hub.docker.com/r/domoticz/domoticz

, so no extra's. Only added parallel-ssh and it works. The image includes Debian Bullseye and python 3.9.2

Hi EscApe,
After trying quite a bit, I got it working.
I did the following, I added a db from a few months ago with a working iDetect on it. Now it no longer works with MAC addresses but with IP addresses. I think it no longer retrieves the information from my router but just pings all IP addresses. I still have an error in the Domoticz log file, even though it works.

Code: Select all

023-11-04 09:50:55.751 Error: iDitect: Error while trying to import tracker module:/usr/local/lib/python3.9/dist-packages/ssh2/channel.cpython-39-arm-linux-gnueabihf.so: undefined symbol: libssh2_channel_request_auth_agent
2023-11-04 15:36:32.089 Error: iDitect: Error while trying to import tracker module:catching classes that do not inherit from BaseException is not allowed

[EscApe]

Looking at the log I suspect that you restarted the plug-in and not Domoticz. There is a known issue with restarting plugins that can not be solved in the plugins themselves. Hopefully it will be solved in the Domoticz plug-in framework. Until then you should always restart Domoticz when changing the plug-in configuration. This is the same for most other plugins that use python modules.

Two things to consider:
1. I designed the plug-in so it will still start if a module fails to load. In that case a non functional dummy tracker is used instead. This way you can still use it for other trackers.
2. If you track ip adressen it will use a special ping tracker, so in your current configuration (ip’s) the failing module does not even matter.

The configuration change will probably have the same effect regardless of the database used. I suspect you will still see the same errors in the log if you restart Domoticz.

[EscApe]

Hi EscApe,

I did it again on a clean install.
1st Bulsseye for raspberrypi 3B installed
2nd Domoticz installed
3rd iDetect installed according to below.
sudo pip install parallel-ssh
sudo git clone -b DomoticzEx-based-beta https://github.com/d-EScape/Domoticz_iDetect.git iDetect (/home/fredom/domoticz/plugins)
4th iDetect plugin (instellingen/hardware)

I hope I did a good job even though it doesn't work yet.

I dug up an unused rpi4 and did a fresh install to try and reproduce the problem, following the same steps you took.
On the raspbian legacy 64bit image there was no problem.
Using the raspbian legacy 32bit image resulted in the same error message you are seeing.

There is no 64 bit version of raspbian for your rpi3b, but I hope this is at least a useful clue for your troubleshooting. Your setup was not the problem, there seems to be something going on with the 32bit libraries.

[Fredom]

Looking at the log I suspect that you restarted the plug-in and not Domoticz. There is a known issue with restarting plugins that can not be solved in the plugins themselves. Hopefully it will be solved in the Domoticz plug-in framework. Until then you should always restart Domoticz when changing the plug-in configuration. This is the same for most other plugins that use python modules.

Two things to consider:
1. I designed the plug-in so it will still start if a module fails to load. In that case a non functional dummy tracker is used instead. This way you can still use it for other trackers.
2. If you track ip adressen it will use a special ping tracker, so in your current configuration (ip’s) the failing module does not even matter.

The configuration change will probably have the same effect regardless of the database used. I suspect you will still see the same errors in the log if you restart Domoticz.

Hi EscApe,

I usually do a reboot of the entire system after installing a plugin or a modification.
For minor adjustments, I only reboot Domoticz.
It is true that after a reboot of the Raspberry or only of Domoticz the error is the same, but idetect now only works with IP addresses. iDetect does create the switches for MAC and IP addresses, but the switches with MAC addresses do not switch, the switches with IP addresses work perfectly.

[EscApe]

Hi Fred,

Did you see my other message (previous message about 64 bit vs 32 bit raspian)?

Responding to your last message:
What you are describing about ip and Mac tracking is expected. The Mac tracking is not working because of the failing module import. The ping tracker is still working.

[Fredom]

Hi Fred,

Did you see my other message (previous message about 64 bit vs 32 bit raspian)?

Responding to your last message:
What you are describing about ip and Mac tracking is expected. The Mac tracking is not working because of the failing module import. The ping tracker is still working.

Hi EscApe,
I hadn't seen your previous post about 64 and 32 bit. Then this is what it is and I'll have to deal with it. If it continues to work like this then I'll be happy. Thank you for your help and explanation.

[EscApe]

Hi Fred,

Did you see my other message (previous message about 64 bit vs 32 bit raspian)?

Responding to your last message:
What you are describing about ip and Mac tracking is expected. The Mac tracking is not working because of the failing module import. The ping tracker is still working.

Hi EscApe,
I hadn't seen your previous post about 64 and 32 bit. Then this is what it is and I'll have to deal with it. If it continues to work like this then I'll be happy. Thank you for your help and explanation.

Maybe not ... I just found something you could try. Please try it on a test system because you could break things beyond repair (without in-depth knowledge). You could install the the most recent parallel-ssh module from source instead of installing the latest version from a repo.

Code: Select all

git clone --recurse-submodules https://github.com/ParallelSSH/parallel-ssh.git
cd parallel-ssh
export SYSTEM_LIBSSH2=1
sudo python setup.py install

It that doesn't work you could try without using system libssh2.
unset SYSTEM_LIBSSH2 and run the same commands except the export line.

Reboot just to be sure.

I hope this helps. Otherwise you will have to wait until this gets fixed in the modules used ... or go back to the iDetect master branch and try troubleshooting the paramiko approach (which still seems strange to me).

[Fredom]

Hi Fred,

Did you see my other message (previous message about 64 bit vs 32 bit raspian)?

Responding to your last message:
What you are describing about ip and Mac tracking is expected. The Mac tracking is not working because of the failing module import. The ping tracker is still working.

Hi EscApe,
I hadn't seen your previous post about 64 and 32 bit. Then this is what it is and I'll have to deal with it. If it continues to work like this then I'll be happy. Thank you for your help and explanation.

Maybe not ... I just found something you could try. Please try it on a test system because you could break things beyond repair (without in-depth knowledge). You could install the the most recent parallel-ssh module from source instead of installing the latest version from a repo.

Code: Select all

git clone --recurse-submodules https://github.com/ParallelSSH/parallel-ssh.git
cd parallel-ssh
export SYSTEM_LIBSSH2=1
sudo python setup.py install

It that doesn't work you could try without using system libssh2.
unset SYSTEM_LIBSSH2 and run the same commands except the export line.

Reboot just to be sure.

I hope this helps. Otherwise you will have to wait until this gets fixed in the modules used ... or go back to the iDetect master branch and try troubleshooting the paramiko approach (which still seems strange to me).

Hi EscApe,
I did what you suggested.
I have put 1 mobile phone in idetect with the MAC address. Unfortunately the switch is created but does not work.
If I can test more for you, let me know

Code: Select all

2023-11-07 18:43:42.103 Status: Domoticz V2023.2 (c)2012-2023 GizMoCuz
2023-11-07 18:43:42.103 Status: Build Hash: 19efd039c, Date: 2023-07-21 17:23:44
2023-11-07 18:43:42.103 Status: Startup Path: /home/fredom/domoticz/
2023-11-07 18:43:43.083 Status: PluginSystem: Started, Python version '3.9.2', 3 plugin definitions loaded.
2023-11-07 18:43:43.302 Status: WebServer(HTTP) started on address: :: with port XXXX
2023-11-07 18:43:43.391 Status: WebServer(SSL) started on address: :: with port 443
2023-11-07 18:43:43.408 Status: TCPServer: shared server started...
2023-11-07 18:43:43.408 Status: RxQueue: queue worker started...
2023-11-07 18:43:45.409 Status: iDetect: Entering work loop.
2023-11-07 18:43:45.409 Status: iDetect: Started.
2023-11-07 18:43:45.409 Status: Zonnepanelen: Worker started...
2023-11-07 18:43:45.410 Status: Buienradar: using Domoticz location settings (51.922753,4.604931)
2023-11-07 18:43:45.410 Status: Buienradar: Worker started...
2023-11-07 18:43:45.410 Status: NotificationSystem: thread started...
2023-11-07 18:43:45.468 Status: PluginSystem: 1 plugins started.
2023-11-07 18:43:47.997 Status: EventSystem: reset all events...
2023-11-07 18:43:48.176 iDetect: Tracker configuration:192.168.1.1
2023-11-07 18:43:48.176 iDetect: Configuring tracker:192.168.1.1
2023-11-07 18:43:48.176 iDetect: options:
2023-11-07 18:43:48.176 iDetect: Debug logging mask set to: PYTHON PLUGIN IMAGE DEVICE CONNECTION
2023-11-07 18:43:48.176 iDetect: All arguments (except password) for tracker init:{'debug': True, 'tracker_ip': '192.168.1.1', 'tracker_port': None, 'tracker_user': 'admin', 'tracker_keyfile': '', 'poll_interval': 15}
2023-11-07 18:43:48.176 iDetect: Type requested:default
2023-11-07 18:43:48.039 Status: EventSystem: reset all device statuses...
2023-11-07 18:43:48.052 Status: iDetect: Initialized version 2.5, author 'ESCape'
2023-11-07 18:43:48.166 Status: iDetect: Starting address:local pinger, port:None, user:None, keyfile:None, class:ping_tracker and poll interval:30
2023-11-07 18:43:48.176 Status: iDetect: Tag Mobiel Fred no longer monitored --> marked as timed-out     ( i dit not remove the switch)
2023-11-07 18:43:48.176 Status: iDetect: Tag Mobiel Hanny no longer monitored --> marked as timed-out    ( i dit not remove the switch)
2023-11-07 18:43:48.646 Status: Python EventSystem: Initializing event module.

2023-11-07 18:43:48.646 Status: EventSystem: Started
2023-11-07 18:43:48.647 Status: EventSystem: Queue thread started...

Code: Select all

2023-11-07 18:43:42.103 Status: Domoticz V2023.2 (c)2012-2023 GizMoCuz
2023-11-07 18:43:42.103 Status: Build Hash: 19efd039c, Date: 2023-07-21 17:23:44
2023-11-07 18:43:42.103 Status: Startup Path: /home/fredom/domoticz/
2023-11-07 18:43:43.083 Status: PluginSystem: Started, Python version '3.9.2', 3 plugin definitions loaded.
2023-11-07 18:43:43.302 Status: WebServer(HTTP) started on address: :: with port XXXX
2023-11-07 18:43:43.391 Status: WebServer(SSL) started on address: :: with port 443
2023-11-07 18:43:43.408 Status: TCPServer: shared server started...
2023-11-07 18:43:43.408 Status: RxQueue: queue worker started...
2023-11-07 18:43:45.409 Status: iDetect: Entering work loop.
2023-11-07 18:43:45.409 Status: iDetect: Started.
2023-11-07 18:43:45.409 Status: Zonnepanelen: Worker started...
2023-11-07 18:43:45.410 Status: Buienradar: using Domoticz location settings (51.922753,4.604931)
2023-11-07 18:43:45.410 Status: Buienradar: Worker started...
2023-11-07 18:43:45.410 Status: NotificationSystem: thread started...
2023-11-07 18:43:45.468 Status: PluginSystem: 1 plugins started.
2023-11-07 18:43:47.997 Status: EventSystem: reset all events...
2023-11-07 18:43:48.039 Status: EventSystem: reset all device statuses...
2023-11-07 18:43:48.052 Status: iDetect: Initialized version 2.5, author 'ESCape'
2023-11-07 18:43:48.166 Status: iDetect: Starting address:local pinger, port:None, user:None, keyfile:None, class:ping_tracker and poll interval:30
2023-11-07 18:43:48.176 Status: iDetect: Tag Mobiel Fred no longer monitored --> marked as timed-out    ( i dit not remove the switch)
2023-11-07 18:43:48.176 Status: iDetect: Tag Mobiel Hanny no longer monitored --> marked as timed-out   ( i dit not remove the switch)
2023-11-07 18:43:48.646 Status: Python EventSystem: Initializing event module.
2023-11-07 18:43:48.646 Status: EventSystem: Started
2023-11-07 18:43:48.647 Status: EventSystem: Queue thread started...
2023-11-07 18:43:49.140 Status: iDetect: Starting address:192.168.1.1, port:None, user:admin, keyfile:, class:unavailable_tracker and poll interval:15

Code: Select all

2023-11-07 18:43:49.128 Error: iDetect: Error while trying to import tracker module:/usr/local/lib/python3.9/dist-packages/ssh2/channel.cpython-39-arm-linux-gnueabihf.so: undefined symbol: libssh2_channel_request_auth_agent

iDetect

Code: Select all

Fred mobiel test =XE:3F:87:C7:6A:XX,Laptop Hanny =192.168.1.1XX,Laptop Fred =192.168.1.2XX,Camera achtertuin =192.168.1.XX

[EscApe]

It annoys me when things fail for no logical reason, so I did some more testing. After repurposing a rpi3b I was able to reproduce your exact problem. Wrote a little testplugin to include only the relevant pssh (parallel-ssh) part and it produces the same error. I can run the same commands from the rpi's cli without any problem, but the import of pssh fails inside the Domoticz plugin framework. There must be something different in the Domoticz environment the plugin is running in compared to a normal cli. The path does not seem te be the problem and I was using the same userprofile (root). The rest is beyond my skills.

Maybe it has to do with the way Domoticz is compiled for 32 bit linux. I don't know and I am out of ideas to try. So I'm afraid you are indeed stuck with either using ip (ping) tracking, the normal (paramo based) version of the plugin or running Domoticz on a 64bit rpi.

[Fredom]

It annoys me when things fail for no logical reason, so I did some more testing. After repurposing a rpi3b I was able to reproduce your exact problem. Wrote a little testplugin to include only the relevant pssh (parallel-ssh) part and it produces the same error. I can run the same commands from the rpi's cli without any problem, but the import of pssh fails inside the Domoticz plugin framework. There must be something different in the Domoticz environment the plugin is running in compared to a normal cli. The path does not seem te be the problem and I was using the same userprofile (root). The rest is beyond my skills.

Maybe it has to do with the way Domoticz is compiled for 32 bit linux. I don't know and I am out of ideas to try. So I'm afraid you are indeed stuck with either using ip (ping) tracking, the normal (paramo based) version of the plugin or running Domoticz on a 64bit rpi.

Hi EscApe,
I have the same feeling when something doesn't work. Unfortunately my knowledge in this area is not very extensive. I would like to try a 64 bit on my raspberry, but I don't think that is possible. Pinging is a nice alternative, but does not work nearly as well as with a MAC address. The disadvantage of pinging is that it often disappears. Unfortunately it is what it is and I will have to make do with it for the time being. Thanks again and if I need to test something, please let me know.

PS
I have seen that the 64 bit version can also run on the rpi 3b. I'm going to try this out this week. I'll keep you informed.

[Fredom]

It annoys me when things fail for no logical reason, so I did some more testing. After repurposing a rpi3b I was able to reproduce your exact problem. Wrote a little testplugin to include only the relevant pssh (parallel-ssh) part and it produces the same error. I can run the same commands from the rpi's cli without any problem, but the import of pssh fails inside the Domoticz plugin framework. There must be something different in the Domoticz environment the plugin is running in compared to a normal cli. The path does not seem te be the problem and I was using the same userprofile (root). The rest is beyond my skills.

Maybe it has to do with the way Domoticz is compiled for 32 bit linux. I don't know and I am out of ideas to try. So I'm afraid you are indeed stuck with either using ip (ping) tracking, the normal (paramo based) version of the plugin or running Domoticz on a 64bit rpi.

Hi EscApe,
I did the following
1st Raspberry pi os (64bit) Debian Bookworm installed
2nd Domoticz Raspberry Pi/Ubuntu installation: sudo bash -c "$(curl -sSfL https://install.domoticz.com)" installed
I had to install Domoticz a few times, but now it works.

3rd sudo pip install parallel-ssh
4th git clone --recurse-submodules https://github.com/ParallelSSH/parallel-ssh.git
cd parallel-ssh
export SYSTEM_LIBSSH2=1
sudo python setup.py install

5th, via 'settings', 'hardware', installed the iDetect plugin.
My mobile phone with MAC address entered in iDetect.
Of course I rebooted the entire system a few times.
The switches have been neatly reconnected, but unfortunately they don't work.
If you have any ideas, I'd love to try them
Below are the error files from Domoticz

Code: Select all

2023-11-09 22:31:05.884 Status: Domoticz V2023.2 (c)2012-2023 GizMoCuz
2023-11-09 22:31:05.885 Status: Build Hash: 19efd039c, Date: 2023-07-21 17:23:44
2023-11-09 22:31:05.885 Status: Startup Path: /home/fredom/domoticz/
2023-11-09 22:31:06.469 Status: PluginSystem: Started, Python version '3.11.2', 2 plugin definitions loaded.
2023-11-09 22:31:06.501 Status: WebServer(HTTP) started on address: :: with port 7575
2023-11-09 22:31:06.577 Status: WebServer(SSL) started on address: :: with port 443
2023-11-09 22:31:06.584 Status: TCPServer: shared server started...
2023-11-09 22:31:06.585 Status: RxQueue: queue worker started...
2023-11-09 22:31:08.586 Status: iDetect: Entering work loop.
2023-11-09 22:31:08.586 Status: iDetect: Started.
2023-11-09 22:31:08.587 Status: NotificationSystem: thread started...
2023-11-09 22:31:08.616 Status: EventSystem: reset all events...
2023-11-09 22:31:08.630 Status: EventSystem: reset all device statuses...
2023-11-09 22:31:08.877 Status: Python EventSystem: Initializing event module.
2023-11-09 22:31:08.878 Status: EventSystem: Started
2023-11-09 22:31:08.878 Status: EventSystem: Queue thread started...
2023-11-09 22:31:09.053 Status: PluginSystem: 1 plugins started.
2023-11-09 22:31:09.073 Status: iDetect: Initialized version 2.5, author 'ESCape'
2023-11-09 22:31:09.213 Status: iDetect: Starting address:192.168.1.1, port:None, user:Admin, keyfile:, class:unavailable_tracker and poll interval:15 

Code: Select all

2023-11-09 22:31:09.206 Error: iDetect: Required modules for default tracker are not installed:No module named 'pssh'

Code: Select all

fredom@raspberrypi:~ $ sudo pip install parallel-ssh
error: externally-managed-environment

This environment is externally managed

To install Python packages system-wide, try apt install
python3-xyz, where xyz is the package you are trying to
install.

If you wish to install a non-Debian-packaged Python package,
create a virtual environment using python3 -m venv path/to/venv.
Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
sure you have python3-full installed.

For more information visit http://rptl.io/venv

note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.
fredom@raspberrypi:~ $