Domoticz

gordonb3 wrote:

roblom wrote:Can someone help me using this script but then whti the HVC company?

Iknow it has something to do with

Code: Select all

http://inzamelkalender.hvcgroep.nl/push/calendar?callback=jQuery20204883549400154621_1493985891393&postcode=1671jv&huisnummer=22&huisletter=&toevoeging=&adresid=999999999&tijdstip_push=0&_=1493985891404

Which i know from this topic.
viewtopic.php?f=67&t=17432

Quite easy by the looks of it. You can reference the Avalex version for extracting the data. The HVC return is in fact much simpler because it has all the data you need in a single call. For next pickup you would want varname[0]['name'] to get the type and varname[0]['dataTime'][0]['date'] for the when.

Goldwing1973 wrote: ↑Thursday 21 September 2017 9:13 Looks like afvalwijzer.nl is down, it only has a DEMO option.
Script doesn't work anymore either.

The site of the city where i live has a "afvalkalender" online, but i'm not experienced enough on implementing it in the script.
Is there anyone that is willing to give it a go?

The URL is http://afvalkalender.alphenaandenrijn.nl/
and a working postalcode and housenumber is 2403SN/122

zicht wrote: ↑Thursday 21 September 2017 21:15

Goldwing1973 wrote: ↑Thursday 21 September 2017 9:13 Looks like afvalwijzer.nl is down, it only has a DEMO option.
Script doesn't work anymore either.

The site of the city where i live has a "afvalkalender" online, but i'm not experienced enough on implementing it in the script.
Is there anyone that is willing to give it a go?

The URL is http://afvalkalender.alphenaandenrijn.nl/
and a working postalcode and housenumber is 2403SN/122

just tested --> works over here :
Groente-, fruit- en tuinafval 25 sept
Plastic, Metaal en Drinkpakken 2 okt
Papier en karton 11 okt

zicht wrote: ↑Thursday 21 September 2017 22:04 Was it working before ?
Do you have curl installed on windows ? (curl.exe in the domoticz directory ?)

The textfield are a bit different on the site, so you have to search on a different string. But the site works fine.
With small adjustment i got the script working also.

try to change

Code: Select all

	result = os.capture(commando) 

to

Code: Select all

	result = os.capture(commando)
		print (result )
	

so you can see the input you read from the site source ?

-----------------------------------------------------------------------------------

you have a couple of unique strings to search for

<a href="/wat/87" title="Papier en karton"><img src="/media/svg/papier_karton.svg" alt="Papier en karton"/>
<i class="date">

<a href="/wat/113" title="Plastic, Metaal en Drinkpakken"><img src="/media/svg/plastic_blik_drank_logo.svg" alt="Plastic, Metaal en Drinkpakken"/>
<i class="date">

<a href="/wat/112" title="Groente-, fruit- en tuinafval"><img src="/media/svg/gft_appel.svg" alt="Groente-, fruit- en tuinafval"/>
<i class="date">

so you can absolute get the values.

gordonb3 wrote: ↑Friday 22 September 2017 10:43 Not a very good site, afvalkalender.nl. It mentions something about participating municipalities, but there's no listing of them anywhere. It appears this site is owned by a large waste processing company that operates under various names in different parts of the country and world. That makes it kind of a gamble whether the site will work for you or go to `demo` mode rather than telling you they don't service your area.

As it stands, it looks like Alphen a/d Rijn drew a new contract with a different company.

zicht wrote: ↑Saturday 23 September 2017 19:33

gordonb3 wrote: ↑Friday 22 September 2017 10:43 Not a very good site, afvalkalender.nl. It mentions something about participating municipalities, but there's no listing of them anywhere. It appears this site is owned by a large waste processing company that operates under various names in different parts of the country and world. That makes it kind of a gamble whether the site will work for you or go to `demo` mode rather than telling you they don't service your area.

As it stands, it looks like Alphen a/d Rijn drew a new contract with a different company.

Agreed about the site only if you local waiste company is under their holding it works,
but for goldwing it should work, (done a test myself.) So something strange is happening over there.

@goldwing i will try to send you a PM with working code for your city, but need to find the time for doing so

Thanks, take your time, i’m in no rush

	commando='curl -s http://afvalkalender.alphenaandenrijn.nl/login/<UNIQUENUMERIC_CODE>'
	result=os.capture(commando)
	if string.find(result,"rror") then 
		result="" 
		WriteToFile("Error >>> function 640"..commando,"url")
	end
	print(string.len(result))

	
	-- Beperk string tot infoblock van de site
	local start=string.find(result,'<ul id="ophaaldata">')
	print("start"..tostring(start))
	local eind=string.find(result,'<i>Papier en karton</i></a>',start)
	print("eind"..tostring(eind))
	local nData=string.sub(result, start, eind)
	print(nData)

zicht wrote: ↑Saturday 23 September 2017 20:27

Thanks, take your time, i’m in no rush

Basically it is the part where you have to enter your postalcode stops the party.
I need to find out how to get past that landingsite in a smart way.

If they have thought about security it might not be possible at all this way without entering your details manual
If i juste have visited the site and the cooky or session is placed with you details the script works fine.
But after it expires we have a problem

note : for privacy reasons i stripped the details from goldwing in the below links and script.

Edit1 :
the url i got by using another site of your city :
http://afvalkalender.alphenaandenrijn.n ... ERIC_CODE>

i just refest and deleted history and that links seems to be correct !
That could be the clue we needed.

Edit2:

Code: Select all

	commando='curl -s http://afvalkalender.alphenaandenrijn.nl/login/<UNIQUENUMERIC_CODE>'
	result=os.capture(commando)
	if string.find(result,"rror") then 
		result="" 
		WriteToFile("Error >>> function 640"..commando,"url")
	end
	print(string.len(result))

	
	-- Beperk string tot infoblock van de site
	local start=string.find(result,'<ul id="ophaaldata">')
	print("start"..tostring(start))
	local eind=string.find(result,'<i>Papier en karton</i></a>',start)
	print("eind"..tostring(eind))
	local nData=string.sub(result, start, eind)
	print(nData)

nData contains the date for 3 different types of waiste.
It is unkown for me how you want to implement... you can split them in any way you want and update 3 diff text devices or make a nice string in one text device.

the print(nDate) above prints the plain HTML code, so it looks a bit odd this way, I put it there to have something to show/debug
Are you able to work with this to make it working in your system ?

Note for others of the same city :
There is a second government site for waiste for you where you can fill in you postal code
If you do it on that site it will redirect you to the site goldwing was using but this time with a unique numeric code in the url for you postal code,
so it lands directly on the waiste page

zicht wrote: ↑Sunday 24 September 2017 0:50

Code: Select all

function os.capture(cmd, raw)				-- os.command uitvoeren en resultaat daarvan lezen in string
  local f=assert(io.popen(cmd, 'r'))
  local s=assert(f:read('*a'))
  f:close()
  if raw then return s end
  s=string.gsub(s, '^%s+', '')
  s=string.gsub(s, '%s+$', '')
  s=string.gsub(s, '[\n\r]+', ' ')
  
	
    end
  return s
end

Code: Select all

	
	commando='curl -s http://afvalkalender.alphenaandenrijn.nl/login/<youruniquecode>'
	result=os.capture(commando)
	if string.find(result,"rror") then 
		result="" 
		WriteToFile("Error >>> function 640"..commando,"url")
	end
	-- Beperk string tot infoblock van de site
	local start=string.find(result,'<ul id="ophaaldata">')
	local eind=string.find(result,'<i>Papier en karton</i></a>',start)
	local nData=string.sub(result, start, eind)
	nData=nData:gsub('%W',' ') nData=nData:match("^%s*(.-)%s*$") nData=nData:gsub("%s+", " ")
	w,x=string.find(nData,"Groente fruit en tuinafval i class date")
	y,z=string.find(nData," i i ",x)
	Groente=string.sub(nData,x+1,y)
	print("Groente,fruit & tuin"..Groente)
	w,x=string.find(nData,"Metaal en Drinkpakken i class date")
	y,z=string.find(nData," i i ",x)
	Metaal=string.sub(nData,x+1,y)
	print("Metaal & Drinkpakken "..Metaal)
	w,x=string.find(nData,"Papier en karton i class date")
	y,z=string.find(nData," i",x)
	Papier=string.sub(nData,x+1,y)
	print("Papier & karton "..Papier)
	

The above create 3 strings and prints them for the 3 types of waiste collection.
The function needs to be available and can be in the same time script as your waiste script.

You only have to put the strings in a text device any way you would like. All are small text so it would fit normally.
So you can add Something like at the end :

Code: Select all

commandArray[#commandArray + 1]={['UpdateDevice']='<YOUR_TEXT_IDX'..'|0|'..Groente.." "..Metaal.." "..Papier}

I think it is not nice to purge the page every minute so i would do it once a day as that would fit the task .
Hint : time = os.date("*t") if (time.hour==7 or time.hour==19) and time.min==0 then .... etc

For today i am done and going to hit my pillow

p.s. I am not a coder at all, so if someone can optimize or has a better solution feel free to teach me "how to"

zicht wrote: ↑Saturday 30 September 2017 23:49 Er zit n end te veel in in het begin, daardoor loopt het vast...
Als die er uit is loopt ie prima hier

Code: Select all

commandArray = {}

function os.capture(cmd, raw)				-- os.command uitvoeren en resultaat daarvan lezen in string
  local f=assert(io.popen(cmd, 'r'))
  local s=assert(f:read('*a'))
  f:close()
  if raw then return s end
  s=string.gsub(s, '^%s+', '')
  s=string.gsub(s, '%s+$', '')
  s=string.gsub(s, '[\n\r]+', ' ')
  return s
end


function Afval() 
    -- haal data op van site
	commando='curl -s http://afvalkalender.alphenaandenrijn.nl/login/0484200000000000'
	result=os.capture(commando)
	if string.find(result,"rror") then 
		result="" 
		WriteToFile("Error >>> function 640"..commando,"url")
	end
	-- Beperk string tot infoblock van de site
	local start=string.find(result,'<ul id="ophaaldata">')
	local eind=string.find(result,'<i>Papier en karton</i></a>',start)
	local nData=string.sub(result, start, eind)
	nData=nData:gsub('%W',' ') nData=nData:match("^%s*(.-)%s*$") nData=nData:gsub("%s+", " ")
	w,x=string.find(nData,"Groente fruit en tuinafval i class date")
	y,z=string.find(nData," i i ",x)
	Groente=string.sub(nData,x+1,y)
	print("Groente,fruit & tuin"..Groente)
	w,x=string.find(nData,"Metaal en Drinkpakken i class date")
	y,z=string.find(nData," i i ",x)
	Metaal=string.sub(nData,x+1,y)
	print("Metaal & Drinkpakken "..Metaal)
	w,x=string.find(nData,"Papier en karton i class date")
	y,z=string.find(nData," i",x)
	Papier=string.sub(nData,x+1,y)
	print("Papier & karton "..Papier)

    -- Haal uit het blok de data die nodig is
   local test = " " i=0
   while i<20 and string.find(nData,'>') and string.find(nData,'<',e)  do
      s= string.find(nData,'>') +1  e= string.find(nData,'<',s) -1  l= string.len(nData)
      test = test .. string.sub(nData, s, e)
      nData = string.sub(nData, e, l) 
      i = i+1
   end
   nData = test
   -- strip onnodige troep (die er al het goed is niet is , just to be sure)
   nData = nData:gsub('%W',' ') nData = nData:match("^%s*(.-)%s*$") nData=nData:gsub("%s+", " ")
   return nData
end

time = os.date("*t")
-- Only want to be notified on the evenning the garbage can needs to be put outside.
if time.hour==18 and time.min<=1 then 
   print('Afval module')
   local IDX = '525'         --your IDX
   local tmp = Afval()
   if otherdevices['Afval Kalender'] ~= tmp then
      commandArray['UpdateDevice'] = IDX..'|0|'..tmp
   end
   --Added to sent notification, on Tuesday (sunday=1)
   if os.date("*t").wday==3 then
      commandArray['SendNotification']='Garbage can#'..tmp
   end
end
return commandArray

Thanks, i copy'd/pasted your code and the errors are gone, now i have to wait until tomorrow night for the "Hello World" to be replaced with the garbage being collected next monday.