[REQUEST] Ikea Trådfri Gateway (smart lights hub controller) plugin?

[Hedda]

Did you checkout the new aiocoap implementation option that they added to pytradfri?

Aiocoap experimentation => https://github.com/ggravlingen/pytradfri/pull/28

Also relatest to https://github.com/ggravlingen/pytradfri/issues/29 but not required?

Could you get around not using Twisted with that new aiocoap implementation option?

Cool regardless!

Yes, I've checked it out, and considered making the COAP-adaptor using the aiocoap, but decided to stick with the plain pytradfri-module for now, since there are quite a lot of hoops to jump through to get aiocoap working at the moment.

As to get rid of the need for the adaptor, Dnpwwo has clearly stated that plugins doesn't support spinning off threads or using asynchronous calls. The adaptor takes care of the asynchronous communication with the gateway, which is needed to support notifications of state-changes.

I think it's possible to create a module that controls lights without depending on a external service, but not one that allows for observing state changes (which I think will be even more important down the way, in order to support the motion sensor etc). Until (if ever) plugins support coap+dtls as a native protocol, I fail to see how to support the plugin-system's methods for communication (onConnect, onMessage etc) without some kind of external service that asynchronously observe states and then sends the message about changes to the plugin. I might be completely wrong on that account, naturally...

Regards,
M

Could you use these new Python3 event scripts for Domoticz's Python plugin system to observe state changes?

Checkout => https://github.com/domoticz/domoticz/pull/1571

Like if the plugin could 'subscribe' to specific state events which could be triggered if a state is changed? I understand dnpwwo refer to that new feature as "remote-tracking" which was just added 2-weeks ago.

[moroen]

Could you use these new Python3 event scripts for Domoticz's Python plugin system to observe state changes?

Checkout => https://github.com/domoticz/domoticz/pull/1571

Like if the plugin could 'subscribe' to specific state events which could be triggered if a state is changed? I understand dnpwwo refer to that new feature as "remote-tracking" which was just added 2-weeks ago.

It's certainly possible to use the python-event-scripts to do some kind of state change observation, but since it then needs to be run as a time-script, which only gets executes once every minute, I fell that the latency will be to long to actually be useful, especially for observing and acting on sensors. One could also use the plugin heartbeat to poll for changes, but that will then run synchronously in the main thread, and if for some reason the gateway doesn't respond, the whole plugin-system (and I'm pretty sure the rest of domoticz) will hang.

I don't think the plugin-system features any kind of remote state tracking, and again, if the plugin is to observe the IKEA-gateway directly, it need to "speak coap", which it at the moment doesn't. I plan to run the idea of implementing COAP+dtls as a protocol by Dnpwoo, but at the moment I think all effort is targeted at ironing out the last bugs after updating event-scripts to use pyhton3 and consolidating the two python subsystems...

For what it's worth, I've been toying with the idea of having the plugins itself launch the adaptor, but that will run against the "no spinning off threads"-requirement... And as always, I might seriously be barking up the wrong tree...

Regards,
M

[Borgso]

What about making it a standalone proxy/script that communicates with Domoticz over MQTT like ie EasyESP does?

Domoticz allready have MQTT support..

[moroen]

What about making it a standalone proxy/script that communicates with Domoticz over MQTT like ie EasyESP does?

Domoticz allready have MQTT support..

Might be worth loooking into, as long as an external script/service/proxy is needed, the communication protocol is more or less a matter of choice. I've just taken a quick look at this, is it possible to create a switch using a MQTT-message?

Regards,
M

[Hedda]

Did you checkout the new aiocoap implementation option that they added to pytradfri?

Aiocoap experimentation => https://github.com/ggravlingen/pytradfri/pull/28

Also relatest to https://github.com/ggravlingen/pytradfri/issues/29 but not required?

Could you get around not using Twisted with that new aiocoap implementation option?

Cool regardless!

Yes, I've checked it out, and considered making the COAP-adaptor using the aiocoap, but decided to stick with the plain pytradfri-module for now, since there are quite a lot of hoops to jump through to get aiocoap working at the moment.

FYI; sounds here by discussion in their pull request #34 as if aiocoap is no longer experimental:

https://github.com/ggravlingen/pytradfri/pull/34

Perhaps is it worth revisiting an aiocoap implementation later?

[Hedda]

What about making it a standalone proxy/script that communicates with Domoticz over MQTT like ie EasyESP does?

Domoticz allready have MQTT support..

FYI; BEN HARDILL (a.k.a. hardillb) already made a MQTT Bridge for IKEA TRÅDFRI Light Gateway as a proof-of-concept:

https://www.hardill.me.uk/wordpress/201 ... tt-bridge/

Open source code here (written in Java):

https://github.com/hardillb/TRADFRI2MQTT

I however feel that a such bridge implemnetation is off-topic here because it is not a standalone plugin for Domoticz.

[moroen]

Perhaps is it worth revisiting an aiocoap implementation later?

Sure, I plan on using aiocoap as soon as it's stable, and will take a look at the latest commit. But I fail to see how this will remove the need for using some kind of adaptor/external process, as long as plugins doesn't support async. calls...

Regards,
M

[Hedda]

FYI; https://github.com/ggravlingen/pytradfri/pull/34 have now been merged into pytradfri master

[edwin]

Hi!

I recently started looking into Tradfri and ran into Moroen's plugin. Seems to work, but a newer version of pytradfri broke it. I did a quick fix for this and this seems to be working again; the plugin recognized my lamps, added devices, and I can dim and switch them.

I just send a pull request soon to moroen/IKEA-Tradfri-plugin for anyone interested. Seems Moroen was already preparing this, but maybe this saves some time https://github.com/moroen/IKEA-Tradfri-plugin/pull/2

During the initial installation, I did run into an issue with twisted. As I am running a pretty bare Arch Linux installation, I prefer pacman (or pacaur) to install as much as possible. Installing the python-twisted package does not however result in an executable /usr/local/bin/twistd, but in /usr/bin/twistd3. This needs a change in the service file. Also, the default pid file for twisted seems to be problematic, and I wanted to not run as root. All this resulted in the following service file, which seems to do the trick for me:

Code: Select all

[Unit]
Description=IKEA Tradfri COAP-adapter

[Service]
Type=simple
Environment=IKEA_HOME=/home/domoticz/domoticz/plugins/IKEA-Tradfri
ExecStart=/usr/bin/twistd3 --nodaemon \
		--rundir=${IKEA_HOME} \
		--pidfile=${IKEA_HOME}/twistd.pid \
		--python=${IKEA_HOME}/tradfri.tac

User=domoticz
Group=domoticz

Restart=always

[Install]
WantedBy=multi-user.target

[moroen]

@Edwin,

Thanks! I'll look at the pull-request and merge the changes as soon as I'm back at my own machine...

Regards,
M

[haaxema]

Hi all,

I have started with small TRADFRI setup combined with Domiticz. My setup is working with one problem.
I cant get ikea-tradfri.service running as a Service, running the python file from bash works fine.

I ran into the problem that twistd is installed in /usr/bin/ and not in /usr/local/bin/ so I changed the service file.

Now the service starts (use root as user/group) but it does not open port 1234, so domotics cant connect.....

Any toughts?

Martin

[andi216]

Hello
I do not know how to solve this problem. I can not connect to the Ikea .
(Rasp v2, clean installation, v3.8199)

With the command
python3 -i -m pytradfri 192.168.1.207 xyxyxyxyxyxyxyxy
can control the bulbs

pi@pi:~/domoticz/plugins $ python3 tradfri.tac
python3: can't open file 'tradfri.tac': [Errno 2] No such file or directory
pi@pi:~/domoticz/plugins $

2017-08-03 19:24:37.762 (IKEA) Exiting work loop.
2017-08-03 19:24:42.712 (IKEA) Stopping threads.
2017-08-03 19:24:42.712 (IKEA) Stopped.
2017-08-03 19:24:42.714 (IKEA) Started.
2017-08-03 19:24:42.988 (IKEA) Entering work loop.
2017-08-03 19:24:42.989 (IKEA) Initialized version 1.0.0, author 'moroen'
2017-08-03 19:24:42.993 (IKEA) Debug log level set to: 'true'.
2017-08-03 19:24:42.993 (IKEA) Heartbeat interval set to: 5.
2017-08-03 19:24:42.994 (IKEA) Protocol set to: 'JSON'.
2017-08-03 19:24:42.994 (IKEA) Transport set to: 'TCP/IP', 127.0.0.1:1234.
2017-08-03 19:24:42.994 PluginSystem: Starting I/O service thread.
2017-08-03 19:24:42.994 (IKEA) Connect directive received, action initiated successfully.
2017-08-03 19:24:43.044 (IKEA) Calling message handler 'onConnect'.
2017-08-03 19:24:43.045 (IKEA) Failed to connect to IKEA tradfri COAP-adapter! Status: 111 Description: Connection refused
2017-08-03 19:24:43.095 (Brd) Calling message handler 'onHeartbeat'.
2017-08-03 19:24:52.517 (IKEA) Calling message handler 'onHeartbeat'.
2017-08-03 19:24:52.517 (IKEA) Not connected - nextConnect: 3
2017-08-03 19:24:57.528 (IKEA) Calling message handler 'onHeartbeat'.
2017-08-03 19:24:57.528 (IKEA) Not connected - nextConnect: 2
2017-08-03 19:25:02.540 (IKEA) Calling message handler 'onHeartbeat'.
2017-08-03 19:25:02.540 (IKEA) Not connected - nextConnect: 1
2017-08-03 19:25:02.540 (IKEA) Transport set to: 'TCP/IP', 127.0.0.1:1234.
2017-08-03 19:25:02.541 PluginSystem: Starting I/O service thread.
2017-08-03 19:25:02.541 (IKEA) Connect directive received, action initiated successfully.

Thanks for the tips.

[moroen]

Hi all,

I have started with small TRADFRI setup combined with Domiticz. My setup is working with one problem.
I cant get ikea-tradfri.service running as a Service, running the python file from bash works fine.

I ran into the problem that twistd is installed in /usr/bin/ and not in /usr/local/bin/ so I changed the service file.

Now the service starts (use root as user/group) but it does not open port 1234, so domotics cant connect.....

Any toughts?

From the top of my head, have you tried running the service as a non-root user?

Regards,
M

[moroen]

Hello
I do not know how to solve this problem. I can not connect to the Ikea .
(Rasp v2, clean installation, v3.8199)

With the command
python3 -i -m pytradfri 192.168.1.207 xyxyxyxyxyxyxyxy
can control the bulbs

pi@pi:~/domoticz/plugins $ python3 tradfri.tac
python3: can't open file 'tradfri.tac': [Errno 2] No such file or directory
pi@pi:~/domoticz/plugins $

2017-08-03 19:24:37.762 (IKEA) Exiting work loop.
2017-08-03 19:24:42.712 (IKEA) Stopping threads.
2017-08-03 19:24:42.712 (IKEA) Stopped.
2017-08-03 19:24:42.714 (IKEA) Started.
2017-08-03 19:24:42.988 (IKEA) Entering work loop.
2017-08-03 19:24:42.989 (IKEA) Initialized version 1.0.0, author 'moroen'
2017-08-03 19:24:42.993 (IKEA) Debug log level set to: 'true'.
2017-08-03 19:24:42.993 (IKEA) Heartbeat interval set to: 5.
2017-08-03 19:24:42.994 (IKEA) Protocol set to: 'JSON'.
2017-08-03 19:24:42.994 (IKEA) Transport set to: 'TCP/IP', 127.0.0.1:1234.
2017-08-03 19:24:42.994 PluginSystem: Starting I/O service thread.
2017-08-03 19:24:42.994 (IKEA) Connect directive received, action initiated successfully.
2017-08-03 19:24:43.044 (IKEA) Calling message handler 'onConnect'.
2017-08-03 19:24:43.045 (IKEA) Failed to connect to IKEA tradfri COAP-adapter! Status: 111 Description: Connection refused
2017-08-03 19:24:43.095 (Brd) Calling message handler 'onHeartbeat'.
2017-08-03 19:24:52.517 (IKEA) Calling message handler 'onHeartbeat'.
2017-08-03 19:24:52.517 (IKEA) Not connected - nextConnect: 3
2017-08-03 19:24:57.528 (IKEA) Calling message handler 'onHeartbeat'.
2017-08-03 19:24:57.528 (IKEA) Not connected - nextConnect: 2
2017-08-03 19:25:02.540 (IKEA) Calling message handler 'onHeartbeat'.
2017-08-03 19:25:02.540 (IKEA) Not connected - nextConnect: 1
2017-08-03 19:25:02.540 (IKEA) Transport set to: 'TCP/IP', 127.0.0.1:1234.
2017-08-03 19:25:02.541 PluginSystem: Starting I/O service thread.
2017-08-03 19:25:02.541 (IKEA) Connect directive received, action initiated successfully.

Thanks for the tips.

Could you try:
$ twistd -ny tradfri.tac

and see what happens?

Regards,
M

[andi216]

Could you try:
$ twistd -ny tradfri.tac

and see what happens?
M

~/domoticz/plugins/IKEA-Tradfri $ twistd -ny tradfri.tac
Unhandled Error
Traceback (most recent call last):
File "/usr/local/lib/python3.4/dist-packages/twisted/application/app.py", line 662, in run
runApp(config)
File "/usr/local/lib/python3.4/dist-packages/twisted/scripts/twistd.py", line 25, in runApp
_SomeApplicationRunner(config).run()
File "/usr/local/lib/python3.4/dist-packages/twisted/application/app.py", line 380, in run
self.application = self.createOrGetApplication()
File "/usr/local/lib/python3.4/dist-packages/twisted/application/app.py", line 445, in createOrGetApplication
application = getApplication(self.config, passphrase)
--- <exception caught here> ---
File "/usr/local/lib/python3.4/dist-packages/twisted/application/app.py", line 456, in getApplication
application = service.loadApplication(filename, style, passphrase)
File "/usr/local/lib/python3.4/dist-packages/twisted/application/service.py", line 412, in loadApplication
application = sob.loadValueFromFile(filename, 'application')
File "/usr/local/lib/python3.4/dist-packages/twisted/persisted/sob.py", line 177, in loadValueFromFile
eval(codeObj, d, d)
File "tradfri.tac", line 2, in <module>
from twisted.internet import protocol, task, reactor, endpoints
File "/usr/local/lib/python3.4/dist-packages/twisted/internet/reactor.py", line 38, in <module>
from twisted.internet import default
File "/usr/local/lib/python3.4/dist-packages/twisted/internet/default.py", line 56, in <module>
install = _getInstallFunction(platform)
File "/usr/local/lib/python3.4/dist-packages/twisted/internet/default.py", line 44, in _getInstallFunction
from twisted.internet.epollreactor import install
File "/usr/local/lib/python3.4/dist-packages/twisted/internet/epollreactor.py", line 24, in <module>
from twisted.internet import posixbase
File "/usr/local/lib/python3.4/dist-packages/twisted/internet/posixbase.py", line 18, in <module>
from twisted.internet import error, udp, tcp
File "/usr/local/lib/python3.4/dist-packages/twisted/internet/tcp.py", line 28, in <module>
from twisted.internet._newtls import (
File "/usr/local/lib/python3.4/dist-packages/twisted/internet/_newtls.py", line 21, in <module>
from twisted.protocols.tls import TLSMemoryBIOFactory, TLSMemoryBIOProtocol
File "/usr/local/lib/python3.4/dist-packages/twisted/protocols/tls.py", line 63, in <module>
from twisted.internet._sslverify import _setAcceptableProtocols
File "/usr/local/lib/python3.4/dist-packages/twisted/internet/_sslverify.py", line 38, in <module>
TLSVersion.TLSv1_1: SSL.OP_NO_TLSv1_1,
builtins.AttributeError: 'module' object has no attribute 'OP_NO_TLSv1_1'


Failed to load application: 'module' object has no attribute 'OP_NO_TLSv1_1'


I do not know what to do.

[moroen]

Could you try:
$ twistd -ny tradfri.tac

and see what happens?
M

~/domoticz/plugins/IKEA-Tradfri $ twistd -ny tradfri.tac

Failed to load application: 'module' object has no attribute 'OP_NO_TLSv1_1'


I do not know what to do.

Hm, it looks like the error might in twisted itself, the error is triggered when tradfri.tac tries to import from twisted...

You might try to import twisted manually from interactive python, and see what happens:

$ python3
>>> from twisted.internet import protocol, task, reactor, endpoints

Or just try to install twisted again?


Regards,
M

[andi216]

Not working


pi@pi:~/domoticz/plugins/IKEA-Tradfri $ python3
Python 3.4.0 (default, Aug 2 2017, 16:53:40)
[GCC 4.9.2] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from twisted.internet import protocol, task, reactor, endpoints
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
ImportError: No module named 'twisted'
>>> ^Z
[2]+ Stopped python3


pi@pi:~/domoticz/plugins/IKEA-Tradfri $ pip3 install twisted
Requirement already satisfied (use --upgrade to upgrade): twisted in /usr/local/lib/python3.4/dist-packages
Requirement already satisfied (use --upgrade to upgrade): zope.interface>=4.0.2 in /usr/local/lib/python3.4/dist-packages (from twisted)
Requirement already satisfied (use --upgrade to upgrade): constantly>=15.1 in /usr/local/lib/python3.4/dist-packages (from twisted)
Requirement already satisfied (use --upgrade to upgrade): incremental>=16.10.1 in /usr/local/lib/python3.4/dist-packages (from twisted)
Requirement already satisfied (use --upgrade to upgrade): Automat>=0.3.0 in /usr/local/lib/python3.4/dist-packages (from twisted)
Requirement already satisfied (use --upgrade to upgrade): hyperlink>=17.1.1 in /usr/local/lib/python3.4/dist-packages (from twisted)
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python3/dist-packages (from zope.interface>=4.0.2->twisted)
Cleaning up...


pi@pi:~/domoticz/plugins/IKEA-Tradfri $ python3
Python 3.4.0 (default, Aug 2 2017, 16:53:40)
[GCC 4.9.2] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from twisted.internet import protocol, task, reactor, endpoints
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
ImportError: No module named 'twisted'
>>>

[moroen]

Not working
pi@pi:~/domoticz/plugins/IKEA-Tradfri $ python3
Python 3.4.0 (default, Aug 2 2017, 16:53:40)
[GCC 4.9.2] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from twisted.internet import protocol, task, reactor, endpoints
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
ImportError: No module named 'twisted'
>>>

There's definitely something wrong with your twisted install, you should be able to import twisted from interactive python... Try forcing an update?

$ pip3 install --upgrade twisted

Regards,
M

[andi216]

There's definitely something wrong with your twisted install, you should be able to import twisted from interactive python... Try forcing an update?

$ pip3 install --upgrade twisted

Regards,
M

pi@pi:~/domoticz/plugins/IKEA-Tradfri $ sudo pip3 install --upgrade twisted
Requirement already up-to-date: twisted in /usr/local/lib/python3.4/dist-packages
Requirement already up-to-date: zope.interface>=4.0.2 in /usr/local/lib/python3.4/dist-packages (from twisted)
Requirement already up-to-date: constantly>=15.1 in /usr/local/lib/python3.4/dist-packages (from twisted)
Requirement already up-to-date: incremental>=16.10.1 in /usr/local/lib/python3.4/dist-packages (from twisted)
Requirement already up-to-date: Automat>=0.3.0 in /usr/local/lib/python3.4/dist-packages (from twisted)
Requirement already up-to-date: hyperlink>=17.1.1 in /usr/local/lib/python3.4/dist-packages (from twisted)
Downloading/unpacking setuptools from https://pypi.python.org/packages/f6/d0/ ... 627bbe57da (from zope.interface>=4.0.2->twisted)
Downloading setuptools-36.2.7-py2.py3-none-any.whl (477kB): 477kB downloaded
Installing collected packages: setuptools
Found existing installation: setuptools 5.5.1
Not uninstalling setuptools at /usr/lib/python3/dist-packages, owned by OS
Successfully installed setuptools
Cleaning up...

pi@pi:~/domoticz/plugins/IKEA-Tradfri $ python3 tradfri.tac
Traceback (most recent call last):
File "tradfri.tac", line 1, in <module>
from twisted.conch.telnet import TelnetTransport, TelnetProtocol
ImportError: No module named 'twisted'

[Hedda]

FYI, Ikea will be releasing color/colour (RGB) lamps in the Ikea Trådfri series this upcoming October.