Page 2 of 4

Re: Vocal command for Domoticz

Posted: Sunday 23 December 2018 18:31
by zak45
renerene wrote: Sunday 23 December 2018 10:02 Fresh install, newbie:

1) it only recognises first words, not sentences.
Like if the recognition is only done for 0.2 secs.
2) can it be used in conjunction with Google Assistent?
3) can it be used on a Alexa or Home device (dedicated)? Or only tablets and phones
do you have read this doc : http://jarvishome.fr/doc.html
The first thing to do for testing is to import pre-defined configuration that can be found on the website.

And the main features of this application is that :

It's full CloudLess, data privacy preserved, nothing go outside your LAN: your WAN is down.. no matter you still continue to say domoticz what to do.
Endless customizable and more...

And when finished, the plugin should bypass all complexity due to the configuration...

Re: Vocal command for Domoticz

Posted: Friday 28 December 2018 11:05
by renerene
o you have read this doc : http://jarvishome.fr/doc.html
The first thing to do for testing is to import pre-defined configuration that can be found on the website.
No, started with HowToStart and got stuck on item 4, after installing the app on my OnePlus6:
You should be able to say "Hello", "What time is it", or "Could you repeat" to Jarvis@Home. He should reply, if not refer to the page Troubleshoots

Remaining questions, before diving into configuration and your technical documentation:
1) it only recognises first words, not sentences. The voice recognition is only for first 0.5 secs.
2) Can Jarvis be used in conjunction with Google Assistent on my phone? Will there be two app's listening, one responing to 'hey google' and the other to 'Nestor'?
3) can it be used on a Alexa or Home device (dedicated)? Or only tablets and phones?
4a) do I need to install anything on the Rpi in my meter cupboard? (where domoticz is running?)
4b) should i install the configuration on the Rpi and use that URL on the app?

Update got it kind of working. The configuration runs on the phone, not on the Rpi. Problem 1) remains

Re: Vocal command for Domoticz

Posted: Friday 28 December 2018 13:40
by zak45
renerene wrote: Friday 28 December 2018 11:05
No, started with HowToStart and got stuck on item 4, after installing the app on my OnePlus6:
You should be able to say "Hello", "What time is it", or "Could you repeat" to Jarvis@Home. He should reply, if not refer to the page Troubleshoots

Remaining questions, before diving into configuration and your technical documentation:
1) it only recognises first words, not sentences. The voice recognition is only for first 0.5 secs.
2) Can Jarvis be used in conjunction with Google Assistent on my phone? Will there be two app's listening, one responing to 'hey google' and the other to 'Nestor'?
3) can it be used on a Alexa or Home device (dedicated)? Or only tablets and phones?
4a) do I need to install anything on the Rpi in my meter cupboard? (where domoticz is running?)
4b) should i install the configuration on the Rpi and use that URL on the app?

Update got it kind of working. The configuration runs on the phone, not on the Rpi. Problem 1) remains
you need to upload initial configuration or create one. go here http://jarvishome.fr/download.html
This app run on Android, nothing to set/install on Rpi.
When you have installed it,and pushed the start button, you can see ip address, port used. Access on it via web browser.

Re: Vocal command for Domoticz

Posted: Friday 28 December 2018 16:09
by renerene
Yes, installation was succesfull. I can open my screens with voice. Will continue with more commands and devices, to replace Alexa and HABridge.

To answer my own questions:
1) it only recognises first words, not sentences. The voice recognition is only for first 0.5 secs.
ignore the flashing written words on the bottom of the screen; it understands full sentences.
2) Can Jarvis be used in conjunction with Google Assistent on my phone? Will there be two app's listening, one responing to 'hey google' and the other to 'Nestor'?
Yes, it seems that both apps work simultaniously
3) can it be used on a Alexa or Home device (dedicated)? Or only tablets and phones?
Guess not. I will use my android wall tablet to replace the Alexa device
4a) do I need to install anything on the Rpi in my meter cupboard? (where domoticz is running?)
4b) should i install the configuration on the Rpi and use that URL on the app?

No, the configuration is local. However, when using more devices it is wise to put the configuration central. The Rpi would be the best place. You have to buy the payed-version to link to another URL

New questions:
5) how do you stop the conversation? The microphone icon stays red, after opening the screen
6) can it be used for push notifications? It would really be great to let Domoticz speak. ("washing machine ready")

Re: Vocal command for Domoticz

Posted: Friday 28 December 2018 19:00
by zak45
renerene wrote: Friday 28 December 2018 16:09 Yes, installation was succesfull. I can open my screens with voice. Will continue with more commands and devices, to replace Alexa and HABridge.

6) can it be used for push notifications? It would really be great to let Domoticz speak. ("washing machine ready")
you can have it to speak for you. Just create HTTP notification (under seetings in Domoticz), something like this:
Capture.JPG
Capture.JPG (60.61 KiB) Viewed 2195 times

Re: Vocal command for Domoticz

Posted: Friday 28 December 2018 20:00
by renerene
Another option to let it speak, using dzVents:

Code: Select all

tekst='your text here''
domoticz.openURL ('http://192.168.0.98:8181/jarvis?jKey=xxxFILL_INxxx&action=execute&type=TTS&data={"text":"'..domoticz.utils.urlEncode(tekst,'%20')..'","volume":"100"}')
question about closing a conversation remains. At the moment the microphone icon stays red, after an action "Nestor, open screens". After that it respons to "close screens" instead of "Nestor, close screens". Is this normal behaviour?

Re: Vocal command for Domoticz

Posted: Friday 28 December 2018 21:51
by zak45
renerene wrote: Friday 28 December 2018 20:00 question about closing a conversation remains. At the moment the microphone icon stays red, after an action "Nestor, open screens". After that it respons to "close screens" instead of "Nestor, close screens". Is this normal behaviour?
This is normal, you need to decide when stop the discussion based on your logic. here an example:
Capture.JPG
Capture.JPG (134.49 KiB) Viewed 2183 times

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 8:08
by kniazio
When you can expect a plugin for domoticz?

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 11:58
by renerene
Is this a bug?

Original command

Code: Select all

http://192.168.0.107:8080/json.htm?type=command&param=switchscene&idx=4&switchcmd=On
Result
Image

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 12:04
by renerene
when using the browser on my laptop to modify the configuration on my tablet, I am having problems with saving. Most of the time there is no 'save' or 'apply' button visible. The changes are not noticeable on the tablet. After refresh changes are gone. Do I need to stop the server on the tablet side? Shutdown the app? But when the server is down on the tablet, the configuration cannot be accessed through URL?

Example: these lines are gone after refresh:
Image

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 12:20
by zak45
kniazio wrote: Saturday 29 December 2018 8:08 When you can expect a plugin for domoticz?
Very soon, it's on testing phase

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 12:23
by zak45
renerene wrote: Saturday 29 December 2018 11:58 Is this a bug?

Original command

Code: Select all

http://192.168.0.107:8080/json.htm?type=command&param=switchscene&idx=4&switchcmd=On
Had same at home, looks like only display cause URL is working.

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 12:32
by zak45
renerene wrote: Saturday 29 December 2018 12:04 when using the browser on my laptop to modify the configuration on my tablet, I am having problems with saving. Most of the time there is no 'save' or 'apply' button visible. The changes are not noticeable on the tablet. After refresh changes are gone. Do I need to stop the server on the tablet side? Shutdown the app? But when the server is down on the tablet, the configuration cannot be accessed through URL?
you should see the icon in red, just click on it:
Capture.JPG
Capture.JPG (12.26 KiB) Viewed 2155 times

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 18:21
by renerene
zak45 wrote: Saturday 29 December 2018 12:32 you should see the icon in red, just click on it:

Capture.JPG
Thank you.
I have noticed, there are some small icons with lots of functionality. My knowledge of the GUI is growing

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 18:22
by renerene
Which offline voice recognition to use?

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 22:38
by zak45
I'd tested the one from samsung, not so bad. google looks ok.

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 23:03
by renerene
zak45 wrote: Saturday 29 December 2018 22:38 I'd tested the one from samsung, not so bad. google looks ok.
Please explain.
1)I am using Google Assistent with downloaded language packs. I guess that means that it can work offline.
However, Jarvis@home2 gives error:
Error: Error Server, did you install the offline speech recognition? Else uncheck the offline voice recognitions in the advanced settings.

2)There are multiple voice apps in the play store. How does Jarvis know which one to use?

Re: Vocal command for Domoticz

Posted: Saturday 29 December 2018 23:33
by zak45
renerene wrote: Saturday 29 December 2018 23:03 Please explain.
1)I am using Google Assistent with downloaded language packs. I guess that means that it can work offline.
However, Jarvis@home2 gives error:
Error: Error Server, did you install the offline speech recognition? Else uncheck the offline voice recognitions in the advanced settings.

2)There are multiple voice apps in the play store. How does Jarvis know which one to use?
take a look here:
http://jarvishome.fr/troubleshoots.html

Jarvis use the one you have set on your Android device. this is what I have on one of my samsung phone:

COMMAND_MESSAGE
Name: fr-FR-language
Locale: fr_FR
Features: [networkTimeoutMs, legacySetLanguageVoice, networkRetriesCount]
Default Voice: Voice[Name: fr-FR-language, locale: fr_FR, quality: 400, latency: 200, requiresNetwork: false, features: [networkTimeoutMs, legacySetLanguageVoice, networkRetriesCount]]
Available Languages: [ko_KR, ru_RU, zh_TW, hu_HU, th_TH, nb_NO, da_DK, tr_TR, et_EE, bs, sw, vi_VN, en_US, sv_SE, su_ID, bn_BD, sk, el_GR, hi_IN, fi_FI, km_KH, bn_IN, fr_FR, uk_UA, en_AU, nl_NL, fr_CA, sr, pt_BR, si_LK, de_DE, ku, cs_CZ, pl_PL, sk_SK, fil_PH, it_IT, ne_NP, hr, zh_CN, es_ES, cy, ja_JP, sq, yue_HK, en_IN, es_US, jv_ID, la, in_ID, ro_RO, ca, ta, en_GB]
Default Engine: com.google.android.tts
Engines: [EngineInfo{name=com.samsung.SMT}, EngineInfo{name=com.google.android.tts}]
Current Locale: fr_FR

you can check your settings on jarvis web page:
Capture.JPG
Capture.JPG (24.29 KiB) Viewed 2119 times

Re: Vocal command for Domoticz

Posted: Friday 04 January 2019 3:57
by welby
Very cool idea and i've got it running pretty well on my system turning stuff on and off. My next idea was to have it read the temperature out from a xiaomi temp sensor. i can get it to read the full json output no worries but that's where i get stuck. How do i make it just read the data from the sensor and not everything that it receives?

Re: Vocal command for Domoticz

Posted: Friday 04 January 2019 16:48
by zak45
welby wrote: Friday 04 January 2019 3:57 How do i make it just read the data from the sensor and not everything that it receives?
this should do the trick for Domoticz:
[url]http://192.168.1.xx:xxxx/json.htm?type=devices&rid=<YOUR IDX>[/url]
<YOUR IDX> = Domoticz device IDX

and this for jarvis

SetVariable: Data to value: system.jsonParse(system.httpGetResult().at("/result/0/Data").asText()