[REQUEST] Google Assistant (AI voice agent) speech recognition plugin in Domoticz

[Hedda]

Google have released this preview of a Python-based Google Assistant SDK that is designed for prototyping its voice agent technology:

http://linuxgizmos.com/google-assistant ... pberry-pi/
https://arstechnica.com/gadgets/2017/04 ... nches-sdk/
http://www.cnx-software.com/2017/05/03/ ... ogle-home/

If someone have the interest and Python coding skills then perhaps this SDK could be made into a Domoticz plugin for voice control?

https://developers.googleblog.com/2017/ ... t-sdk.html



Google Assistant SDK developer preview is available for download, initially optimized for the Raspberry Pi, but looks to be portable:

https://developers.google.com/assistant/sdk/
https://developers.google.com/assistant ... run-sample
https://developers.google.com/assistant ... op_of_page


PS: Guess to get wife acceptance users would either need a microphone to buy one or several microphone array(s), like ex:

http://www.jabra.com/business/speakerph ... -speak-510
https://creator.matrix.one/#!/index
https://www.seeedstudio.com/ReSpeaker-M ... -2719.html

[Hedda]

Developer preview 0.2.0 of the Google Assistant SDK released on May 17th 2017

FYI, Google have now released developer preview 0.2.0 which now includes a Google Assistant library for Python and hot-word voice activation

https://developers.google.com/assistant ... ease-notes

New features in the developer preview 0.2.0 version are:
* Initial release of the library for Python.
* Ok Google and Hey Google hotword support for voice activation
* Ability to set alarms and timers.

Previous developer preview 0.1.0 release version already had:
* An RPC API is available to communicate with the Assistant.
* Python sample code is available.

[mastair]

Could you provide some use cases how exactly you want to use this and how it fits into the Python plugin framework?

[tontze]

"Domoticz, im home" --> turns lights on, turns coffee maker on etc. ?

"Domoticz, im going to sleep" --> lights off, blinds closed etc. ?

Some use cases there if you meant that ?

[Hedda]

Could you provide some use cases how exactly you want to use this and how it fits into the Python plugin framework?

Sure, but I hope it OK that I assume that you are ar least already a little familiar with the basic use cases of Google Home (or Amazon Echo) speakers with voice controlled AI-Assistent in combination with home automation?

If you are not then I highly recommend that you should also do some research on your own about their compability regardless (as voice control really looks to be the future of home automation) and perhaps you could even build this DIY project if you own a Raspberry Pi:

https://www.raspberrypi.org/blog/free-a ... -magpi-57/
https://developers.googleblog.com/2017/ ... e-kit.html
http://www.cnx-software.com/2017/05/05/ ... -magazine/

With this Voice Kit from AIY Projects or a other similar solutions with the basic components of a good microphone and speaker you can build your own "Google Home" speaker from a Raspberry Pi or similar single-board computers using the Python library fromn the Google Assistant SDK listed in above posts. And yes you can of course run this on the same Raspberry Pi where you also run Domticz, so you are converging both the functions of Domoticz and the functions of Google Home on one single Raspberry Pi.

If you have now done some basic then you know that Google Home (and Amazon Echo) speakers are activated with a 'hot-word' (meaning a specific key-command) instead at the press of a button, so when you say the 'hot-word' out-laud the AI voice agent starts listening/recording for a few seconds then compress that data and sends it up to Google Assistant AI cloud (super-computers on the internet) which translate what you said into commands as made available with "Google Actions" (see "Actions on Google" https://developers.google.com/actions/ ) for which developers can make almost anything. In this example use-case I guess that we would want to make "Domoticz" into a 'hot-word' which it will listen for to activate.

To the examples for Domoticz using the 'hot-word' set to "Domoticz".

"Domoticz, turn on all the living room lights" => turns on all lights tagged /grouped with 'living room'
"Domoticz, turn off all the window lights" => turns off all lights tagged /grouped with 'window'
"Domoticz, good morning" => turns lights on, turns coffee maker on, play morning music, etc. ?
"Domoticz, good night" --> lights off, blinds closed, etc.

For better examples watch some of these videos how Google Home can already be used in combination with Samsung SmartThings Hub (Samsungs home automation gateway) which is officially supported by Google Home

https://www.youtube.com/results?search_ ... oogle+Home

[bueno79]

The developer preview (0.0.3) of the Google Assistant library for Python is now available.

Google Assistant Library

FEATURE Support for x86_64 Linux.
FEATURE Support for Python v2.7.
FIXED Various bug fixes and improvements in error messaging.
Google Assistant gRPC API

No updates.