BuienRadar invalid data

[forkboy]

This morning around 10.30 CET my BuienRadar hardware started reporting the following error every 10 minutes:
Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!

After disable/enable it now tells me: 2020-06-08 12:05:32.273 Error: BuienRadar: No (nearby) station found!

I am suspecting that the BuienRadar API has changed. Can somone give a clue how to further investigate (and possibly resolve) this?

I am running stable version 2020.2.

[waaren]

This morning around 10.30 CET my BuienRadar hardware started reporting the following error every 10 minutes:
Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
I am suspecting that the BuienRadar API has changed. Can someone give a clue how to further investigate (and possibly resolve) this?

The API has not changed but Buienradar does return 0,0 for lat,lon. We have seen this before and after notifying buienradar they solved it within a day.

You can chek this by entering https://data.buienradar.nl/2.0/feed/json in your browser address-bar

[McMelloW]

In my Hardware setup for BuiennRadar I use the SationID. Never the less, I got the following errors

Code: Select all

2020-06-08 13:32:50.739 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 13:42:51.752 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 13:52:52.639 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!

I did send in a message at the BuienRader contact page about it.

[waaren]

In my Hardware setup for BuiennRadar I use the SationID. Never the less, I got the following errors

Code: Select all

2020-06-08 13:32:50.739 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 13:42:51.752 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 13:52:52.639 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!

I did send in a message at the BuienRader contact page about it.

Is indeed confusing.

If you enter a stationID in the setup the buienradar data wil be collected if the station is alive. For rainforecast data another URL is called and that URL need a lat/lon. If you set a a stationID in the setup, the lat/lon are to be received from the reply of your chosen station but in this case they are both 0, 0 in that reply.

[forkboy]

So there seems to be room for improvement: with a stationid in the hardware we could at least get the basic weather information, without the rain forecast.

[akamming]

So there seems to be room for improvement: with a stationid in the hardware we could at least get the basic weather information, without the rain forecast.

it's a serverside issue.
- in this url https://data.buienradar.nl/2.0/feed/json long/lat is 0,0 for every station. So domoticz cannot determine the locations of the id's and can therefor not find the nearest station
- in this url https://observations.buienradar.nl/1.0/ ... stationid> the stationid tag is changed. domoticz is expecting stationid, but is getting stationId (notice the capital I).

so providing the stationid in the config will not fix it.

[FireWizard]

Hi,

Same here.
Strange that, https://data.buienradar.nl/2.0/feed/json indicate for every station ID a lat/lon of 0/0,
while https://data.buienradar.nl/1.0/feed/xml shows the correct lat/lon co-ordinates.

Wouldn't it be an idea to use this as a kind of back-up URL? In case the first one fails.

Regards

[McMelloW]

Hi,

Same here.
Strange that, https://data.buienradar.nl/2.0/feed/json indicate for every station ID a lat/lon of 0/0,
while https://data.buienradar.nl/1.0/feed/xml shows the correct lat/lon co-ordinates.

Wouldn't it be an idea to use this as a kind of back-up URL? In case the first one fails.

Regards

The first is a json feed, while the second is an XML feed.

[McMelloW]

At 16:43 I saw a new update of the data. The coordinates for the stations are filled in again.

Perhaps it is a coincident, but it was 5 minutes after a posting on the Facebook page of BuienRadar

[waaren]

it's a serverside issue.

I agree that is for the bigger part a serverside issue but I just checked this and at least for station 6344 (have only tested a few), buienradar returns stationid for both URL's (so for both all chars lowercase)

[akamming]

I agree that is for the bigger part a serverside issue but I just checked this and at least for station 6344 (have only tested a few), buienradar returns stationid for both URL's (so for both all chars lowercase)

that 's probably because it just started working again (i see no more errors as of around 1650). long/lat is now also present again…

[waaren]

that 's probably because it just started working again (i see no more errors as of around 1650). long/lat is now also present again…

[FireWizard]

Hi,

Is it working again? I doubt.

2020-06-08 16:32:30.448 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 16:32:35.482 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:37:40.374 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:42:45.864 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:47:50.746 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:52:56.276 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:58:01.206 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 17:03:06.818 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 17:08:11.891 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)

The last "Invalid data received......." was at 16:32, but since then every 5 minutes "Problem Connecting to Buienradar! (Check your Internet Connection!)"

Regards

[akamming]

There might be an opportunity to make the code more robust. Does someone know why these checks are in the code at GetMeterDetails() ?

Code: Select all

	if (root["timestamp"].empty() == true || root["stationid"].empty() == true)
        {
                Log(LOG_ERROR, "Invalid data received (timestamp or staionid missing) or no data returned!");
                return;
        }
        if (root["temperature"].empty() == true)
        {
                Log(LOG_ERROR, "Invalid data received (temperature missing) or no data returned!");
                return;
        }

        int stationID = root["stationid"].asInt();
        if (stationID != m_iStationID)
        {
                Log(LOG_ERROR, "Invalid data received (invalid stationid %d / %d ) or no data returned!", stationID, m_iStationID);
                return;
        }

to me it looks like they have no added value. Apparently these values are not always there in the json, and then the sensors will not be updated...

[waaren]

Is it working again? I doubt.

Works for me without any messages (station 6344). Also URL replies are normal again.
Could your issue be related to 1 particular station?

[akamming]

Hi,

Is it working again? I doubt.

2020-06-08 16:32:30.448 Error: BuienRadar: Invalid data received (timestamp or staionid missing) or no data returned!
2020-06-08 16:32:35.482 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:37:40.374 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:42:45.864 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:47:50.746 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:52:56.276 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 16:58:01.206 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 17:03:06.818 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)
2020-06-08 17:08:11.891 Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)

The last "Invalid data received......." was at 16:32, but since then every 5 minutes "Problem Connecting to Buienradar! (Check your Internet Connection!)"

Regards

on my side it is. although a bit unstable. At 1655 i got a new error

Code: Select all

2020-06-08 16:55:38.581  Error: BuienRadar: Problem Connecting to Buienradar! (Check your Internet Connection!)

but after that the calls succeeded again...

Code: Select all

2020-06-08 17:00:32.624  (Buienradar) Temp + Humidity (Buienradar TempHum)
2020-06-08 17:00:32.637  (Buienradar) Temp (Buienradar Grond Temperatuur (10 cm))
2020-06-08 17:00:32.647  (Buienradar) Temp (Buienradar Feel Temperature)
2020-06-08 17:00:32.657  (Buienradar) Wind (Buienradar Wind)
2020-06-08 17:00:32.667  (Buienradar) General/Custom Sensor (Buienradar Sun Power)
2020-06-08 17:00:32.691  (Buienradar) Rain (Buienradar Regen)
2020-06-08 17:00:33.020  (Buienradar) General/Custom Sensor (Tijd tot volgende bui)
2020-06-08 17:00:33.040  (Buienradar) General/Custom Sensor (Duur volgende bui)
2020-06-08 17:00:33.052  (Buienradar) General/Custom Sensor (Volgende bui intensiteit)
2020-06-08 17:00:33.063  (Buienradar) General/Custom Sensor (Next Rainshower Max Rainrate)
2020-06-08 17:00:33.073  (Buienradar) General/Percentage (Buienradar Rain Intensity)
2020-06-08 17:00:33.095  (Buienradar) General/Custom Sensor (Buienradar Rainfall next Hour)
2020-06-08 17:05:33.409  (Buienradar) General/Custom Sensor (Tijd tot volgende bui)
2020-06-08 17:05:33.418  (Buienradar) General/Custom Sensor (Duur volgende bui)
2020-06-08 17:05:33.426  (Buienradar) General/Custom Sensor (Volgende bui intensiteit)
2020-06-08 17:05:33.435  (Buienradar) General/Custom Sensor (Next Rainshower Max Rainrate)
2020-06-08 17:05:33.450  (Buienradar) General/Percentage (Buienradar Rain Intensity)
2020-06-08 17:05:33.465  (Buienradar) General/Custom Sensor (Buienradar Rainfall next Hour)
2020-06-08 17:10:33.834  (Buienradar) Temp + Humidity (Buienradar TempHum)
2020-06-08 17:10:33.845  (Buienradar) Temp (Buienradar Grond Temperatuur (10 cm))
2020-06-08 17:10:33.856  (Buienradar) Temp (Buienradar Feel Temperature)
2020-06-08 17:10:33.867  (Buienradar) Wind (Buienradar Wind)
2020-06-08 17:10:33.877  (Buienradar) General/Custom Sensor (Buienradar Sun Power)
2020-06-08 17:10:33.891  (Buienradar) Rain (Buienradar Regen)
2020-06-08 17:10:34.171  (Buienradar) General/Custom Sensor (Tijd tot volgende bui)
2020-06-08 17:10:34.184  (Buienradar) General/Custom Sensor (Duur volgende bui)
2020-06-08 17:10:34.193  (Buienradar) General/Custom Sensor (Volgende bui intensiteit)
2020-06-08 17:10:34.202  (Buienradar) General/Custom Sensor (Next Rainshower Max Rainrate)
2020-06-08 17:10:34.211  (Buienradar) General/Percentage (Buienradar Rain Intensity)
2020-06-08 17:10:34.220  (Buienradar) General/Custom Sensor (Buienradar Rainfall next Hour)
2020-06-08 17:15:34.547  (Buienradar) General/Custom Sensor (Tijd tot volgende bui)
2020-06-08 17:15:34.559  (Buienradar) General/Custom Sensor (Duur volgende bui)
2020-06-08 17:15:34.568  (Buienradar) General/Custom Sensor (Volgende bui intensiteit)
2020-06-08 17:15:34.577  (Buienradar) General/Custom Sensor (Next Rainshower Max Rainrate)
2020-06-08 17:15:34.586  (Buienradar) General/Percentage (Buienradar Rain Intensity)
2020-06-08 17:15:34.597  (Buienradar) General/Custom Sensor (Buienradar Rainfall next Hour)

if i look at the logs i see a lot of errors today, but also a lot of succeeded updates. Apparently it is unstable now at serverside...

[forkboy]

Is it working again? I doubt.

Works for me without any messages (station 6344). Also URL replies are normal again.
Could your issue be related to 1 particular station?

I am seeing similar Problem Connecting to BuienRadar messages. I must also say that my sensors have been updated. The last change is 5 seconds before an error in the log. The sensors seem to be updated every 10 minutes while the error is there every 5 minutes.

[McMelloW]

Is it working again? I doubt.

No errors at this side, getting updates every 10 mins.

[FireWizard]

@waaren

You wrote:

Could your issue be related to 1 particular station?

I changed my station for your station 6344, wherever that may be
So let us wait for at least another hour.

Regards

[waaren]

... 6344, wherever that may be

Code: Select all

$id": "36",
"stationid": 6344,
"stationname": "Meetstation Rotterdam",
"lat": 51.95,
"lon": 4.45,
"regio": "Rotterdam",
"timestamp": "2020-06-08T18:30:00",
"weatherdescription": "Zwaar bewolkt",
"iconurl": "https://www.buienradar.nl/resources/images/icons/weather/30x30/c.png",
"graphUrl": "https://www.buienradar.nl/nederland/weerbericht/weergrafieken/c",
"winddirection": "NNW",
"airpressure": 1016.4,
"temperature": 14,
"groundtemperature": 14.6,
"feeltemperature": 12.4,
"visibility": 28800,
"windgusts": 7.9,
"windspeed": 5.6,
"windspeedBft": 4,
"humidity": 81,
"precipitation": 0,
"sunpower": 160,
"rainFallLast24Hour": 2.9,
"rainFallLastHour": 0,
"winddirectiondegrees": 336