Page 1 of 2
BuienRadar invalid data
Posted: Monday 08 June 2020 12:20
by forkboy
This morning around 10.30 CET my BuienRadar hardware started reporting the following error every 10 minutes:
Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
After disable/enable it now tells me: 2020-06-08 12:05:32.273 Error: BuienRadar: No (nearby) station found!
I am suspecting that the BuienRadar API has changed. Can somone give a clue how to further investigate (and possibly resolve) this?
I am running stable version 2020.2.
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 12:48
by waaren
forkboy wrote: ↑Monday 08 June 2020 12:20
This morning around 10.30 CET my BuienRadar hardware started reporting the following error every 10 minutes:
Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
I am suspecting that the BuienRadar API has changed. Can someone give a clue how to further investigate (and possibly resolve) this?
The API has not changed but Buienradar does return 0,0 for lat,lon. We have seen this before and after notifying buienradar they solved it within a day.
You can chek this by entering
https://data.buienradar.nl/2.0/feed/json in your browser address-bar
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 14:02
by McMelloW
In my Hardware setup for BuiennRadar I use the SationID. Never the less, I got the following errors
Code: Select all
2020-06-08 13:32:50.739 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 13:42:51.752 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 13:52:52.639 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
I did send in a message at the BuienRader contact page about it.
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 14:59
by waaren
McMelloW wrote: ↑Monday 08 June 2020 14:02
In my Hardware setup for BuiennRadar I use the SationID. Never the less, I got the following errors
Code: Select all
2020-06-08 13:32:50.739 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 13:42:51.752 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 13:52:52.639 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
I did send in a message at the BuienRader contact page about it.
Is indeed confusing.
If you enter a stationID in the setup the buienradar data wil be collected if the station is alive. For rainforecast data another URL is called and that URL need a lat/lon. If you set a a stationID in the setup, the lat/lon are to be received from the reply of your chosen station but in this case they are both 0, 0 in that reply.
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 15:03
by forkboy
So there seems to be room for improvement: with a stationid in the hardware we could at least get the basic weather information, without the rain forecast.
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 16:23
by akamming
forkboy wrote: ↑Monday 08 June 2020 15:03
So there seems to be room for improvement: with a stationid in the hardware we could at least get the basic weather information, without the rain forecast.
it's a serverside issue.
- in this url
https://data.buienradar.nl/2.0/feed/json long/lat is 0,0 for every station. So domoticz cannot determine the locations of the id's and can therefor not find the nearest station
- in this url
https://observations.buienradar.nl/1.0/ ... stationid> the stationid tag is changed. domoticz is expecting stationid, but is getting stationId (notice the capital I).
so providing the stationid in the config will not fix it.
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 16:28
by FireWizard
Hi,
Same here.
Strange that,
https://data.buienradar.nl/2.0/feed/json indicate for every station ID a lat/lon of 0/0,
while
https://data.buienradar.nl/1.0/feed/xml shows the correct lat/lon co-ordinates.
Wouldn't it be an idea to use this as a kind of back-up URL? In case the first one fails.
Regards
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 16:39
by McMelloW
The first is a json feed, while the second is an XML feed.
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 16:55
by McMelloW
At 16:43 I saw a new update of the data. The coordinates for the stations are filled in again.
Perhaps it is a coincident, but it was 5 minutes after a posting on the Facebook page of BuienRadar
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 17:00
by waaren
akamming wrote: ↑Monday 08 June 2020 16:23
it's a serverside issue.
I agree that is for the bigger part a serverside issue but I just checked this and at least for station 6344 (have only tested a few), buienradar returns stationid for both URL's (so for both all chars lowercase)
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 17:03
by akamming
waaren wrote: ↑Monday 08 June 2020 17:00
I agree that is for the bigger part a serverside issue but I just checked this and at least for station 6344 (have only tested a few), buienradar returns stationid for both URL's (so for both all chars lowercase)
that 's probably because it just started working again (i see no more errors as of around 1650). long/lat is now also present again…
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 17:07
by waaren
akamming wrote: ↑Monday 08 June 2020 17:03
that 's probably because it just started working again (i see no more errors as of around 1650). long/lat is now also present again…
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 17:11
by FireWizard
Hi,
Is it working again? I doubt.
2020-06-08 16:32:30.448 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 16:32:35.482 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:37:40.374 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:42:45.864 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:47:50.746 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:52:56.276 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:58:01.206 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 17:03:06.818 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 17:08:11.891 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
The last "Invalid data received......." was at 16:32, but since then every 5 minutes "Problem Connecting to Buienradar! (Check your Internet Connection!)"
Regards
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 17:14
by akamming
There might be an opportunity to make the code more robust. Does someone know why these checks are in the code at GetMeterDetails() ?
Code: Select all
if (root["timestamp"].empty() == true || root["stationid"].empty() == true)
{
Log(LOG_ERROR, "Invalid data received (timestamp or staionid missing) or no data returned!");
return;
}
if (root["temperature"].empty() == true)
{
Log(LOG_ERROR, "Invalid data received (temperature missing) or no data returned!");
return;
}
int stationID = root["stationid"].asInt();
if (stationID != m_iStationID)
{
Log(LOG_ERROR, "Invalid data received (invalid stationid %d / %d ) or no data returned!", stationID, m_iStationID);
return;
}
to me it looks like they have no added value. Apparently these values are not always there in the json, and then the sensors will not be updated...
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 17:16
by waaren
FireWizard wrote: ↑Monday 08 June 2020 17:11
Is it working again? I doubt.
Works for me without any messages (station 6344). Also URL replies are normal again.
Could your issue be related to 1 particular station?
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 17:20
by akamming
FireWizard wrote: ↑Monday 08 June 2020 17:11
Hi,
Is it working again? I doubt.
2020-06-08 16:32:30.448 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 16:32:35.482 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:37:40.374 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:42:45.864 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:47:50.746 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:52:56.276 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:58:01.206 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 17:03:06.818 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 17:08:11.891 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
The last "Invalid data received......." was at 16:32, but since then every 5 minutes "Problem Connecting to Buienradar! (Check your Internet Connection!)"
Regards
on my side it is. although a bit unstable. At 1655 i got a new error
Code: Select all
2020-06-08 16:55:38.581 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
but after that the calls succeeded again...
Code: Select all
2020-06-08 17:00:32.624 (Buienradar) Temp + Humidity (Buienradar TempHum)
2020-06-08 17:00:32.637 (Buienradar) Temp (Buienradar Grond Temperatuur (10 cm))
2020-06-08 17:00:32.647 (Buienradar) Temp (Buienradar Feel Temperature)
2020-06-08 17:00:32.657 (Buienradar) Wind (Buienradar Wind)
2020-06-08 17:00:32.667 (Buienradar) General/Custom Sensor (Buienradar Sun Power)
2020-06-08 17:00:32.691 (Buienradar) Rain (Buienradar Regen)
2020-06-08 17:00:33.020 (Buienradar) General/Custom Sensor (Tijd tot volgende bui)
2020-06-08 17:00:33.040 (Buienradar) General/Custom Sensor (Duur volgende bui)
2020-06-08 17:00:33.052 (Buienradar) General/Custom Sensor (Volgende bui intensiteit)
2020-06-08 17:00:33.063 (Buienradar) General/Custom Sensor (Next Rainshower Max Rainrate)
2020-06-08 17:00:33.073 (Buienradar) General/Percentage (Buienradar Rain Intensity)
2020-06-08 17:00:33.095 (Buienradar) General/Custom Sensor (Buienradar Rainfall next Hour)
2020-06-08 17:05:33.409 (Buienradar) General/Custom Sensor (Tijd tot volgende bui)
2020-06-08 17:05:33.418 (Buienradar) General/Custom Sensor (Duur volgende bui)
2020-06-08 17:05:33.426 (Buienradar) General/Custom Sensor (Volgende bui intensiteit)
2020-06-08 17:05:33.435 (Buienradar) General/Custom Sensor (Next Rainshower Max Rainrate)
2020-06-08 17:05:33.450 (Buienradar) General/Percentage (Buienradar Rain Intensity)
2020-06-08 17:05:33.465 (Buienradar) General/Custom Sensor (Buienradar Rainfall next Hour)
2020-06-08 17:10:33.834 (Buienradar) Temp + Humidity (Buienradar TempHum)
2020-06-08 17:10:33.845 (Buienradar) Temp (Buienradar Grond Temperatuur (10 cm))
2020-06-08 17:10:33.856 (Buienradar) Temp (Buienradar Feel Temperature)
2020-06-08 17:10:33.867 (Buienradar) Wind (Buienradar Wind)
2020-06-08 17:10:33.877 (Buienradar) General/Custom Sensor (Buienradar Sun Power)
2020-06-08 17:10:33.891 (Buienradar) Rain (Buienradar Regen)
2020-06-08 17:10:34.171 (Buienradar) General/Custom Sensor (Tijd tot volgende bui)
2020-06-08 17:10:34.184 (Buienradar) General/Custom Sensor (Duur volgende bui)
2020-06-08 17:10:34.193 (Buienradar) General/Custom Sensor (Volgende bui intensiteit)
2020-06-08 17:10:34.202 (Buienradar) General/Custom Sensor (Next Rainshower Max Rainrate)
2020-06-08 17:10:34.211 (Buienradar) General/Percentage (Buienradar Rain Intensity)
2020-06-08 17:10:34.220 (Buienradar) General/Custom Sensor (Buienradar Rainfall next Hour)
2020-06-08 17:15:34.547 (Buienradar) General/Custom Sensor (Tijd tot volgende bui)
2020-06-08 17:15:34.559 (Buienradar) General/Custom Sensor (Duur volgende bui)
2020-06-08 17:15:34.568 (Buienradar) General/Custom Sensor (Volgende bui intensiteit)
2020-06-08 17:15:34.577 (Buienradar) General/Custom Sensor (Next Rainshower Max Rainrate)
2020-06-08 17:15:34.586 (Buienradar) General/Percentage (Buienradar Rain Intensity)
2020-06-08 17:15:34.597 (Buienradar) General/Custom Sensor (Buienradar Rainfall next Hour)
if i look at the logs i see a lot of errors today, but also a lot of succeeded updates. Apparently it is unstable now at serverside...
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 17:26
by forkboy
waaren wrote: ↑Monday 08 June 2020 17:16
FireWizard wrote: ↑Monday 08 June 2020 17:11
Is it working again? I doubt.
Works for me without any messages (station 6344). Also URL replies are normal again.
Could your issue be related to 1 particular station?
I am seeing similar Problem Connecting to BuienRadar messages. I must also say that my sensors have been updated. The last change is 5 seconds before an error in the log. The sensors seem to be updated every 10 minutes while the error is there every 5 minutes.
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 17:34
by McMelloW
FireWizard wrote: ↑Monday 08 June 2020 17:11
Is it working again? I doubt.
No errors at this side, getting updates every 10 mins.
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 18:05
by FireWizard
@waaren
You wrote:
Could your issue be related to 1 particular station?
I changed my station for your station 6344, wherever that may be
So let us wait for at least another hour.
Regards
Re: BuienRadar invalid data
Posted: Monday 08 June 2020 18:47
by waaren
FireWizard wrote: ↑Monday 08 June 2020 18:05
... 6344, wherever that may be
Code: Select all
$id": "36",
"stationid": 6344,
"stationname": "Meetstation Rotterdam",
"lat": 51.95,
"lon": 4.45,
"regio": "Rotterdam",
"timestamp": "2020-06-08T18:30:00",
"weatherdescription": "Zwaar bewolkt",
"iconurl": "https://www.buienradar.nl/resources/images/icons/weather/30x30/c.png",
"graphUrl": "https://www.buienradar.nl/nederland/weerbericht/weergrafieken/c",
"winddirection": "NNW",
"airpressure": 1016.4,
"temperature": 14,
"groundtemperature": 14.6,
"feeltemperature": 12.4,
"visibility": 28800,
"windgusts": 7.9,
"windspeed": 5.6,
"windspeedBft": 4,
"humidity": 81,
"precipitation": 0,
"sunpower": 160,
"rainFallLast24Hour": 2.9,
"rainFallLastHour": 0,
"winddirectiondegrees": 336
