Vocal command for Domoticz

[zak45]

Fresh install, newbie:

1) it only recognises first words, not sentences.
Like if the recognition is only done for 0.2 secs.
2) can it be used in conjunction with Google Assistent?
3) can it be used on a Alexa or Home device (dedicated)? Or only tablets and phones

do you have read this doc : http://jarvishome.fr/doc.html
The first thing to do for testing is to import pre-defined configuration that can be found on the website.

And the main features of this application is that :

It's full CloudLess, data privacy preserved, nothing go outside your LAN: your WAN is down.. no matter you still continue to say domoticz what to do.
Endless customizable and more...

And when finished, the plugin should bypass all complexity due to the configuration...

[renerene]

o you have read this doc : http://jarvishome.fr/doc.html
The first thing to do for testing is to import pre-defined configuration that can be found on the website.

No, started with HowToStart and got stuck on item 4, after installing the app on my OnePlus6:
You should be able to say "Hello", "What time is it", or "Could you repeat" to Jarvis@Home. He should reply, if not refer to the page Troubleshoots

Remaining questions, before diving into configuration and your technical documentation:
1) it only recognises first words, not sentences. The voice recognition is only for first 0.5 secs.
2) Can Jarvis be used in conjunction with Google Assistent on my phone? Will there be two app's listening, one responing to 'hey google' and the other to 'Nestor'?
3) can it be used on a Alexa or Home device (dedicated)? Or only tablets and phones?
4a) do I need to install anything on the Rpi in my meter cupboard? (where domoticz is running?)
4b) should i install the configuration on the Rpi and use that URL on the app?

Update got it kind of working. The configuration runs on the phone, not on the Rpi. Problem 1) remains

[zak45]

No, started with HowToStart and got stuck on item 4, after installing the app on my OnePlus6:
You should be able to say "Hello", "What time is it", or "Could you repeat" to Jarvis@Home. He should reply, if not refer to the page Troubleshoots

Remaining questions, before diving into configuration and your technical documentation:
1) it only recognises first words, not sentences. The voice recognition is only for first 0.5 secs.
2) Can Jarvis be used in conjunction with Google Assistent on my phone? Will there be two app's listening, one responing to 'hey google' and the other to 'Nestor'?
3) can it be used on a Alexa or Home device (dedicated)? Or only tablets and phones?
4a) do I need to install anything on the Rpi in my meter cupboard? (where domoticz is running?)
4b) should i install the configuration on the Rpi and use that URL on the app?

Update got it kind of working. The configuration runs on the phone, not on the Rpi. Problem 1) remains

you need to upload initial configuration or create one. go here http://jarvishome.fr/download.html
This app run on Android, nothing to set/install on Rpi.
When you have installed it,and pushed the start button, you can see ip address, port used. Access on it via web browser.

[renerene]

Yes, installation was succesfull. I can open my screens with voice. Will continue with more commands and devices, to replace Alexa and HABridge.

To answer my own questions:
1) it only recognises first words, not sentences. The voice recognition is only for first 0.5 secs.
ignore the flashing written words on the bottom of the screen; it understands full sentences.
2) Can Jarvis be used in conjunction with Google Assistent on my phone? Will there be two app's listening, one responing to 'hey google' and the other to 'Nestor'?
Yes, it seems that both apps work simultaniously
3) can it be used on a Alexa or Home device (dedicated)? Or only tablets and phones?
Guess not. I will use my android wall tablet to replace the Alexa device
4a) do I need to install anything on the Rpi in my meter cupboard? (where domoticz is running?)
4b) should i install the configuration on the Rpi and use that URL on the app?
No, the configuration is local. However, when using more devices it is wise to put the configuration central. The Rpi would be the best place. You have to buy the payed-version to link to another URL

New questions:
5) how do you stop the conversation? The microphone icon stays red, after opening the screen
6) can it be used for push notifications? It would really be great to let Domoticz speak. ("washing machine ready")

[zak45]

Yes, installation was succesfull. I can open my screens with voice. Will continue with more commands and devices, to replace Alexa and HABridge.

6) can it be used for push notifications? It would really be great to let Domoticz speak. ("washing machine ready")

you can have it to speak for you. Just create HTTP notification (under seetings in Domoticz), something like this:

Capture.JPG (60.61 KiB) Viewed 2082 times

[renerene]

Another option to let it speak, using dzVents:

Code: Select all

tekst='your text here''
domoticz.openURL ('http://192.168.0.98:8181/jarvis?jKey=xxxFILL_INxxx&action=execute&type=TTS&data={"text":"'..domoticz.utils.urlEncode(tekst,'%20')..'","volume":"100"}')

question about closing a conversation remains. At the moment the microphone icon stays red, after an action "Nestor, open screens". After that it respons to "close screens" instead of "Nestor, close screens". Is this normal behaviour?

[zak45]

question about closing a conversation remains. At the moment the microphone icon stays red, after an action "Nestor, open screens". After that it respons to "close screens" instead of "Nestor, close screens". Is this normal behaviour?

This is normal, you need to decide when stop the discussion based on your logic. here an example:

Capture.JPG (134.49 KiB) Viewed 2070 times

[kniazio]

When you can expect a plugin for domoticz?

[renerene]

Is this a bug?

Original command

Code: Select all

http://192.168.0.107:8080/json.htm?type=command&param=switchscene&idx=4&switchcmd=On

Result

[renerene]

when using the browser on my laptop to modify the configuration on my tablet, I am having problems with saving. Most of the time there is no 'save' or 'apply' button visible. The changes are not noticeable on the tablet. After refresh changes are gone. Do I need to stop the server on the tablet side? Shutdown the app? But when the server is down on the tablet, the configuration cannot be accessed through URL?

Example: these lines are gone after refresh:

[zak45]

When you can expect a plugin for domoticz?

Very soon, it's on testing phase

[zak45]

Is this a bug?

Original command

Code: Select all

http://192.168.0.107:8080/json.htm?type=command&param=switchscene&idx=4&switchcmd=On

Had same at home, looks like only display cause URL is working.

[zak45]

when using the browser on my laptop to modify the configuration on my tablet, I am having problems with saving. Most of the time there is no 'save' or 'apply' button visible. The changes are not noticeable on the tablet. After refresh changes are gone. Do I need to stop the server on the tablet side? Shutdown the app? But when the server is down on the tablet, the configuration cannot be accessed through URL?

you should see the icon in red, just click on it:

Capture.JPG (12.26 KiB) Viewed 2042 times

[renerene]

you should see the icon in red, just click on it:

Capture.JPG

Thank you.
I have noticed, there are some small icons with lots of functionality. My knowledge of the GUI is growing

[renerene]

Which offline voice recognition to use?

[zak45]

I'd tested the one from samsung, not so bad. google looks ok.

[renerene]

I'd tested the one from samsung, not so bad. google looks ok.

Please explain.
1)I am using Google Assistent with downloaded language packs. I guess that means that it can work offline.
However, Jarvis@home2 gives error:
Error: Error Server, did you install the offline speech recognition? Else uncheck the offline voice recognitions in the advanced settings.

2)There are multiple voice apps in the play store. How does Jarvis know which one to use?

[zak45]

Please explain.
1)I am using Google Assistent with downloaded language packs. I guess that means that it can work offline.
However, Jarvis@home2 gives error:
Error: Error Server, did you install the offline speech recognition? Else uncheck the offline voice recognitions in the advanced settings.

2)There are multiple voice apps in the play store. How does Jarvis know which one to use?

take a look here:
http://jarvishome.fr/troubleshoots.html

Jarvis use the one you have set on your Android device. this is what I have on one of my samsung phone:

COMMAND_MESSAGE
Name: fr-FR-language
Locale: fr_FR
Features: [networkTimeoutMs, legacySetLanguageVoice, networkRetriesCount]
Default Voice: Voice[Name: fr-FR-language, locale: fr_FR, quality: 400, latency: 200, requiresNetwork: false, features: [networkTimeoutMs, legacySetLanguageVoice, networkRetriesCount]]
Available Languages: [ko_KR, ru_RU, zh_TW, hu_HU, th_TH, nb_NO, da_DK, tr_TR, et_EE, bs, sw, vi_VN, en_US, sv_SE, su_ID, bn_BD, sk, el_GR, hi_IN, fi_FI, km_KH, bn_IN, fr_FR, uk_UA, en_AU, nl_NL, fr_CA, sr, pt_BR, si_LK, de_DE, ku, cs_CZ, pl_PL, sk_SK, fil_PH, it_IT, ne_NP, hr, zh_CN, es_ES, cy, ja_JP, sq, yue_HK, en_IN, es_US, jv_ID, la, in_ID, ro_RO, ca, ta, en_GB]
Default Engine: com.google.android.tts
Engines: [EngineInfo{name=com.samsung.SMT}, EngineInfo{name=com.google.android.tts}]
Current Locale: fr_FR

you can check your settings on jarvis web page:

Capture.JPG (24.29 KiB) Viewed 2006 times

[welby]

Very cool idea and i've got it running pretty well on my system turning stuff on and off. My next idea was to have it read the temperature out from a xiaomi temp sensor. i can get it to read the full json output no worries but that's where i get stuck. How do i make it just read the data from the sensor and not everything that it receives?

[zak45]

How do i make it just read the data from the sensor and not everything that it receives?

this should do the trick for Domoticz:
[url]http://192.168.1.xx:xxxx/json.htm?type=devices&rid=<YOUR IDX>[/url]
<YOUR IDX> = Domoticz device IDX

and this for jarvis

SetVariable: Data to value: system.jsonParse(system.httpGetResult().at("/result/0/Data").asText()