Page 1 of 1
Host not found (authoritative) - Help
Posted: Friday 22 December 2017 23:10
by Xorfor
I want to create a Winddelen plugin, because the standard Winddelen from Domoticz not using all possibilities from the give API. I like to use links like:
https://zep-api.windcentrale.nl/production/1
or
https://zep-api.windcentrale.nl/production/1/live
But when I define a connection with:
Code: Select all
self.httpConn = Domoticz.Connection(Name="HTTP Test", Transport="TCP/IP", Protocol="HTTP", Address="zep-api.windcentrale.nl")
I get:
Host not found (authoritative)
As you can see the links above gives you data, but I can not use Domoticz.Connection, because I have to specify a domain. And
https://zep-api.windcentrale.nl gives a Login page
How can I solve this?
Re: Host not found (authoritative) - Help
Posted: Wednesday 27 December 2017 22:59
by Xorfor
I tried already (I think almost) everything, but nothing works.
Finally I tried to get a workaround to use urllib.request.
But a soon as I place 'import urllib.request' in the Python plugin, Domoticz stops working after a restart!
Or if I enter 'import urllib', i get:
2017-12-27 23:39:58.988 Error: (motion) failed to load 'plugin.py', Python Path used was '/home/pi/domoticz/plugins/motion/:/usr/lib/python35.zip:/usr/lib/python3.5:/usr/lib/python3.5/plat-arm-linux-gnueabihf:/usr/lib/python3.5/lib-dynload'.
2017-12-27 23:39:58.988 Error: (Motion detected) Module Import failed, exception: 'NameError'
2017-12-27 23:39:58.988 Error: (Motion detected) Error Line details not available.
Re: Host not found (authoritative) - Help
Posted: Friday 29 December 2017 2:27
by Dnpwwo
@Xorfor,
Can you post a bit more of you plugin? That would help.
Also if you execute:
from the command line on the machine you are using what do you see?
Re: Host not found (authoritative) - Help
Posted: Friday 29 December 2017 17:57
by Xorfor
@Dnpwwo
The code can be found on:
https://github.com/Xorfor/Domoticz/tree ... ndcentrale
Nslookup gives:
Code: Select all
nslookup zep-api.windcentrale.nl
Server: 8.8.8.8
Address: 8.8.8.8#53
Non-authoritative answer:
zep-api.windcentrale.nl canonical name = zep-prod-lb-https-167027908.eu-central-1.elb.amazonaws.com.
Name: zep-prod-lb-https-167027908.eu-central-1.elb.amazonaws.com
Address: 54.93.73.206
Name: zep-prod-lb-https-167027908.eu-central-1.elb.amazonaws.com
Address: 52.29.46.1
Name: zep-prod-lb-https-167027908.eu-central-1.elb.amazonaws.com
Address: 52.59.60.130
Name: zep-prod-lb-https-167027908.eu-central-1.elb.amazonaws.com
Address: 52.29.184.187
Curl gives me exactly the result I want:
Code: Select all
curl https://zep-api.windcentrale.nl/production/1/live
{"powerProducerId":"f588ce00-92ee-45ee-b480-f7d6df204034","windSpeed":5.0,"windDirection":"ZO","powerAbsTot":764.0,"powerAbsWd":78.0,"powerRel":33.0,"diameter":41.0,"rpm":17.5,"pulsating":false,"kwh":4434603.0,"kwhForecast":4955000.0,"hoursRunThisYear":8264.0833333333,"runPercentage":94.4425778631072,"windSpeedForecast":5.0,"windDirectionForecast":"ZW","timestamp":"2017-12-29T17:53:37"}
At this moment I get timeouts:
Code: Select all
2017-12-29 17:56:07.407 (De Grote Geert) onHeartbeat called, run again in 17 heartbeats.
2017-12-29 17:56:08.259 (De Grote Geert) Calling message handler 'onConnect'.
2017-12-29 17:56:08.260 (De Grote Geert) onConnect called (110): Connection timed out
2017-12-29 17:56:08.260 Error: (De Grote Geert) Failed to connect (110) to: zep-api.windcentrale.nl with error: Connection timed out
2017-12-29 17:56:17.381 (De Grote Geert) Calling message handler 'onHeartbeat'.
2017-12-29 17:56:17.381 (De Grote Geert) onHeartbeat called
Please let me know if you need more information.
Re: Host not found (authoritative) - Help
Posted: Sunday 31 December 2017 1:44
by Dnpwwo
@Xorfor,
Looks like you have solved your initial problem.
From looking at your plugin I see you have realised that you need to use HTTPS not HTTP and you have (somehow) discovered that Domoticz has undocumented support for client side HTTPS. This is alpha quality only so please don't use it on your production instance. This can crash Domoticz during disconnection.
I'm interested though, did it work for you
Re: Host not found (authoritative) - Help
Posted: Sunday 31 December 2017 17:18
by Xorfor
@Dnpwwo,
No I gave up
.
In a 'normal' simple python script, I can write something like this:
Code: Select all
import urllib.request, json
with urllib.request.urlopen("https://zep-api.windcentrale.nl/production/1/live") as url:
data = json.loads(url.read().decode())
print(data)
That works. But in a plugin, whatever I try, such a 'simple' request doesn't work.
1. With the code as it is now on
https://github.com/Xorfor/Domoticz/blob ... /plugin.py, I get 'Connection timed out'
2. To avoid Domoticz.Connect problems, I tried to add 'import urllib.request'. But then Domoticz even doesn't startup!!! A conflict between Domoticz and urllib?
Re: Host not found (authoritative) - Help
Posted: Monday 01 January 2018 4:01
by Dnpwwo
@Xorfor,
I had another look at your code and found your main problem is that you haven't told the 'Connect' what port to use. I've added an error check to Domoticz to report that in future.
Once I added 'Port="443"' it started working. The 'Data' parameter to onMessage is a dictionary for HTTP which you can iterate and I got this in the log:
- Spoiler: show
- 2018-01-01 13:56:01.552 (HTTPS Test) Started.
2018-01-01 13:56:01.647 (HTTPS Test) Entering work loop.
2018-01-01 13:56:01.647 (HTTPS Test) Initialized version 1.0.0, author 'Xorfor'
2018-01-01 13:56:02.830 Plugin: TLS Certificate found: '/C=SE/O=AddTrust AB/OU=AddTrust External TTP Network/CN=AddTrust External CA Root'
2018-01-01 13:56:02.830 Plugin: TLS Certificate found: '/C=SE/O=AddTrust AB/OU=AddTrust External TTP Network/CN=AddTrust External CA Root'
2018-01-01 13:56:02.831 Plugin: TLS Certificate found: '/C=GB/ST=Greater Manchester/L=Salford/O=COMODO CA Limited/CN=COMODO RSA Certification Authority'
2018-01-01 13:56:02.832 Plugin: TLS Certificate found: '/C=GB/ST=Greater Manchester/L=Salford/O=COMODO CA Limited/CN=COMODO RSA Domain Validation Secure Server CA'
2018-01-01 13:56:02.832 Plugin: TLS Certificate found: '/OU=Domain Control Validated/OU=PositiveSSL Wildcard/CN=*.windcentrale.nl'
2018-01-01 13:56:03.561 (HTTPS Test) HTTP Details (3):
2018-01-01 13:56:03.562 (HTTPS Test) --->'Headers (10):
2018-01-01 13:56:03.563 (HTTPS Test) ------->'Connection':'keep-alive'
2018-01-01 13:56:03.564 (HTTPS Test) ------->'Access-Control-Allow-Origin':'*'
2018-01-01 13:56:03.565 (HTTPS Test) ------->'Access-Control-Allow-Headers':'X-Requested-With, Accept, Content-Type, Authorization'
2018-01-01 13:56:03.566 (HTTPS Test) ------->'X-Application-Context':'application:prod:8200'
2018-01-01 13:56:03.567 (HTTPS Test) ------->'Date':'Mon, 01 Jan 2018 02:56:02 GMT'
2018-01-01 13:56:03.568 (HTTPS Test) ------->'Server':'Apache-Coyote/1.1'
2018-01-01 13:56:03.569 (HTTPS Test) ------->'Content-Type':'application/json;charset=UTF-8'
2018-01-01 13:56:03.569 (HTTPS Test) ------->'Access-Control-Allow-Methods':'POST, GET, PUT, PATCH, DELETE, OPTIONS'
2018-01-01 13:56:03.570 (HTTPS Test) ------->'Access-Control-Max-Age':'3600'
2018-01-01 13:56:03.571 (HTTPS Test) ------->'transfer-encoding':'chunked'
2018-01-01 13:56:03.572 (HTTPS Test) --->'Status':'200'
2018-01-01 13:56:03.573 (HTTPS Test) --->'Data':'b'{"powerProducerId":"f588ce00-92ee-45ee-b480-f7d6df204034","windSpeed":6.0,"windDirection":"Z","powerAbsTot":2386.0,"powerAbsWd":241.0,"powerRel":101.0,"diameter":100.0,"rpm":22.1,"pulsating":false,"kwh":7266.0,"kwhForecast":4955000.0,"hoursRunThisYear":3.4833333333372,"runPercentage":94.4517083485457,"windSpeedForecast":4.0,"windDirectionForecast":"ZW","timestamp":"2018-01-01T03:55:30"}''
I needed to tweak the headers in your HTTP request because the site was rejecting the request with a 406 error, I just hit it from Firefox (which worked) then inspected the headers it was sending and copied some of them.
Have a look at the updated source here.
Re: Host not found (authoritative) - Help
Posted: Monday 01 January 2018 18:56
by Xorfor
@Dnpwwo,
Thanks a lot for your help. I also tried 'Port="443"', but I didn't look any further
.
I am working now on this plugin. I expect to finish this at the end of the week.
Re: Host not found (authoritative) - Help
Posted: Tuesday 09 January 2018 22:08
by Xorfor
@Dnpwwo,
FYI:
HTTPS works. But what I see, is a memory leakage? As soon as I start the Windcentrale plugin, the memory usage on the RPi is increasing (approx. 10% per day) and finally the Domoticz url does not respond. When I remove the Windcentrale in Hardware, the increasing memory usage stops.