Working Google assistent on raspberry pi, for controlling domoticz.

[hoeby]

I have read a few threads here about voice controlling.
Now controlicz is a paid feature, some people stopped using it.
I didn't have controlicz in the past, but would like to get an idea if google home works good or not, before paying for an external service.
Therefor i toke a raspberry pi and start some googling.

First started with 'open jarvis' or 'jasper'.
Jasper is not easy to install, after install i wass not that happy whit it.
Then tried Open Jarvis. This one is easier to install. But the same problem with jasper.
Both programs don't have a good voice control. Need to say, that i tried to run them offline (without internet). The idea was, when it works, they can change to www, but my voice control stays working. Unfortunally the voice control needs to be exact. When calling a keyword, it needs to be exact. For example turning on lights, i needed to ask it 5 times before it worked (or is my voice the problem?)

Therefor looking further with something like google home or Alexa.
Then i found GassistPi and just tried it. I worked suprisly wel. That i want to share it whit you all.
But first need to be said, if you don't have anything whit a raspberry pi and don't want to invest time in it, stay whit controlicz.
You don't need to be a programmer, everything can be found with google, but you need to invest time.
Also it is not cheaper than buying a google home
I didn't designed this, all grads to Shiva on github.

What hardware is needed, this is the minimum.
- Raspberry pi whit sd-card (advice, do not use an raspberry pi zero, it has an other arm verion)
- microphone
- speakers

For a Pi i used the 3+ version
Speakers are just a cheap set, bought i a 1 euro shop. Works just fine. Mine are working tru the jack-plug
For the microphone, this could be a problem. It need to be a good microphone, otherwise google home can't work.
After some googling i tried to microphones. The respeak 4 mic array and the ps3 eye (yes playstation3 eye).
What is my experiance. The respeak works best when you device is in the middle of the room. Because it can pick up sound from every direction. But it cost a little more. The ps3 eye was a big suprise. For a few euro's it worked very good. I tried both microphones next to each other (when not in the middle of the room). And both worked the same. Not 1 better or worse.

Because the project is not cheaper than a google home, i chose to go for the PS3 eye.
Maybe there are more people who like to try this project, and cheaper can be prefered.

Setting up the pi.
I don't go in putting the image on you pi and change your password of it.
First you microphone has to be setup. You need to setup the audio drives.
Do in putty

Code: Select all

sudo nano .asoundrc

And place this code in it (don't forget to save).

Code: Select all

pcm.dsnooper {
    type dsnoop
    ipc_key 816357492
    ipc_key_add_uid 0
    ipc_perm 0666
    slave {
        pcm "hw:1,0"
        channels 1
    }
}

pcm.!default {
        type asym
        playback.pcm {
                type plug
                slave.pcm "hw:0,0"
        }
        capture.pcm {
                type plug
                slave.pcm "dsnooper"
        }
}

After that, just follow the manual from GassistPi.
This also has the staps what you need to do at Google.
This is the link: https://github.com/shivasiddharth/GassistPi

I had one problem after install. That i got a gtoken.py error.
Search the gtoken.py (command line is in the error, where it can be found).
Copy it, give it a different name (just to have a backup).
And modify the Original gtoken.py to this https://github.com/BoseCorp/py-googletr ... /gtoken.py

Now i had a google home which can answer normal questions.
But we are on domoticz forum, so asking "OK google, sing me a song" is not where we are looking for.
But shiva has domoticz in it. Just need to enable it, how to do that, follow the instructing on his page.
All i can say, it works perfect.
The default controls for domoticz are, ON, OFF, TOGGLE, CHANGE COLOUR, CHANGE BRIGHTNES
I added OPEN, CLOSE, HALT (stop is already used for stopping mucic).
But unfortunally i added thos in a other version and after installing the last version (yesterday), i saw that to domoticz program is changed. So i can't copy/paste it from a backup. But i am working on it. This is why i said: if you don't want to invest time, stay/go with controlicz.

But now need to make it nicer, my wife doens't want this in the room


This is how far i got by now.
I orded a differend speaker, with the idea to put the pi in it whit the microphone.
But also add the lights when google home is lissening or speaking.

I ordered this speaker. I should have the space inside, but therefor i need to remove the battery. I don't find this a problem, because i don't want to walk tru the house with google home on my back. Also running the pi on the battery is not a good idea. When battery is empty it can crash the sd-card and you need to start over (Always make an image backup)


What to do with this project:
- Adding open, close, halt controls for domoticz
- Streaming audio is now over the small speaker, i want it to stream over sonos. Only streaming, not google home voice
- Making the GassistPi nice in a speaker housing
- Adding Neopixel
- Optional, adding some elekctronic power supply. When power is disconnected, the pi not just goes out, but has +/- 30seconds to do a shutdown.

GassistPi Features:
1. Headless auto start on boot.
2. Voice control of GPIOs without IFTTT, api.ai, Actions SDK.
3. Voice control of NodeMCU without IFTTT and MQTT.
4. Radio streaming.
5. Voice control of servo connected to RPi GPIO.
6. Safe shutdown RPi using voice command.
7. Stream Music from YouTube.
8. Indicator lights for assistant listening and speaking events.
9. Startup audio and audio feedback for wakeword detection.
10. Pushbutton service to stop Music or Radio playback.
11. Parcel tracking using Aftership API.
12. RSS Feed streaming.
13. Control of Kodi or Kodi Integration.
14. Streaming music from Google Play Music.
15. Casting of YouTube Videos to Chromecast and Chromecast media control by voice.
16. Voice control of Radio/YouTube/Google Music volume levels.
17. Control Sonoff Tasmota Devices/Emulated Wemo.
18. Track Kickstarter campaigns.
19. Emulated Philips Hue HUB service and control of Emulated Hue Lights.
20. Search recipes and get push message of ingredients and link to recipe.
21. Remote control of Magic Mirror.
22. Sending voice messages from the phone to the raspberry.
23. Play your Spotify playlist.
24. Custom wakeword activation for all Pi boards.
25. Mute microphones to prevent listening to Ok-Google hotword.
26. Create custom conversations.
27. Control of lights added to Domoticz.
28. Stream music from Gaana.com.
29. Stream your playlist from Deezer.
30. Custom actions in French, Italian, German, Dutch and Spanish.

[renerene]

Nice article, bad title - lot of users will miss it

[hoeby]

Thanks for your reply.
Didn't thoughed that much about the titel. Will try to change it

Already got some extra functions to work.
I added:
- Open, close and halt (stop) controls for domoticz.
- controlling Sonos speakers by voice, for streaming radio. This doesn't go tru domoticz. But domoticz can speak tru the sonos speakers. Need to change the code. I made it quick but it is a dirty code. Need to clean of up befor storing it. Node-http-sonos-api is needed for doing this function
- Adding custom dutch answers when on/off/open/close/halt functions is done by domoticz

Some changes are not shared whit GassistPi. It could be that they need to be changed when these is a new update released. They are also not added in the GassistPi on github. You need to copy/ paste them by yourself in the scripts. I will post the scripts and where to add them in your GassistPi

[hoeby]

got my havit speaker.
a lot of modifications needed to get the pi inside.
i switched from jack plug audio to bluetooth audio. jack plug audio is analog . when build in i had a lot of unpleasant noice. on bluetooth that is gone. but on bluetooth the connection gets in sleep mode. when i call the hot-word, sometimes i get no audio response. when i ask a question to it, then it answers Nice. the neopixel will add a Nice feature that you can are that gassist is responding. will try to swap from internal bluetooth to bluetooth dongle. Lets see if it change something.
when googling i find problems with the pi 3 when you use wifi and Bluetooth on the same device. will get back on it. also with pictures about the modifications

[DewGew]

I installed GassistPi also before I saw your post. Gtoken issue is taken care of in latest. Control Domoticz with voice works only from this device thou. But if you want voice commandos from all devices it Works great with controlicz also. Only thing IM missing is cast to my diy GassistPi.

[hoeby]

@Dewgew,
Could you explain a bit more about the function you are saying "But if you want voice commandos from all devices it Works great with controlicz also", What do i need to think about, which devices are you meaning?

I know the Gtoken.py has given troubles.
For me it is the second them. When i first started i had the problems that the gtoken.py was incorrect. Last days something changed and problem was back. It is fixed again by the designer of Gassistpi. That was also the reason why i wrote that you need to invest time. If you don't want to invest time, stay with controlicz.

An other option is to remove the "say" commands for the part you are using.
The gtoken.py is used to translate text to speech. When google home adds don't have to say anything, the problems doesn't pop-up. Google assistent itselfs works when doing this. I had done this for a few days untill the fix was made. I needed to keep my wife happy.

But i also went futher on my project.
The havit speaker is gone. Why? the bluetooth audio on the py had its problems. I couldn't get it working right.
I bought the ggmm d6 speaker. Added a dac module for the audio.
Last week i printed some 3d parts and not the speaker is tested on the table. Everything is nicely build in.
Waiting for an arduino and rgb lights to build in, that's the last i need to do. These ligths are for a visual status if google assist is speaking or lissening.
When people here are interested i will post the finished part with the info how i made it.

[domogijs]

Interested!

[DewGew]

@Dewgew,
Could you explain a bit more about the function you are saying "But if you want voice commandos from all devices it Works great with controlicz also", What do i need to think about, which devices are you meaning?

I know the Gtoken.py has given troubles.
For me it is the second them. When i first started i had the problems that the gtoken.py was incorrect. Last days something changed and problem was back. It is fixed again by the designer of Gassistpi. That was also the reason why i wrote that you need to invest time. If you don't want to invest time, stay with controlicz.

An other option is to remove the "say" commands for the part you are using.
The gtoken.py is used to translate text to speech. When google home adds don't have to say anything, the problems doesn't pop-up. Google assistent itselfs works when doing this. I had done this for a few days untill the fix was made. I needed to keep my wife happy.

But i also went futher on my project.
The havit speaker is gone. Why? the bluetooth audio on the py had its problems. I couldn't get it working right.
I bought the ggmm d6 speaker. Added a dac module for the audio.
Last week i printed some 3d parts and not the speaker is tested on the table. Everything is nicely build in.
Waiting for an arduino and rgb lights to build in, that's the last i need to do. These ligths are for a visual status if google assist is speaking or lissening.
When people here are interested i will post the finished part with the info how i made it.

You can not call domoticz from your google assistant from your mobile phone with GassitPi. That what I mean. Becouse its a local function on GassistPi. If you need talking response from local functions you still need the say commands and google translate. It also translate the words you are saying to the Assistant( I speak swedish). I just added custom language file for trigger words (e.g keywords_sv.yaml) and change added some lines in actions.py.

[hoeby]

Sorry everybody, it took some time, before i posted how i made my speaker.
This was because i had to wait untill my new led ring was delivered. So i could build it in the speaker and shoot some pictures.

I started this thread, that i wanted to use the long speaker i posted.
This speaker has a battery inside. When disconnecting the battery, this gives very bad audio on the jackplug. When switching to bluetooth, the connection with the pi stopped after a few hours, which was not working like i wanted.
Therefor i ordered the GGMM D6 speaker. Original a speaker designed for the Alexa DOT.

After ordering, this is what came out of the box. The hole on the top is where the Alexa DOT should be mounted, but i didn't use the Alexa DOT.


First we need to take the speaker apart, remove the rubber foot. Be cautios, you need it later.
When removed you see 4 screws, remove them.


When the screws are removed, you can take off the bottom. Be carefull, there are cables connected


Looking inside the bottom, you see the speaker. I damaged the tweeter speaker. It still works, but doesn't look nice.
Not a big problem for me. But when you want GassistPi to play the radio out of this speaker, be carefull.
Also you see 4 screws (again) which need to be taken out on a later step


Hold the outside of the housing. And push against the speaker. The internal parts will come out of the top
The bottom is connected with connectors, you could take it apart, for easier working.


Everything is taken apart. You already see the build in raspberry pi.


Normally here is where the battery is mounted. I removed it. I don't want a speaker always connected to the power and a battery inside that always be charged. I don't know how good the charging circuit is. Better safe and take it out.
I also removed the plastic pocket where battery is mounted in, to make space for the raspberry pi


This is how it looks inside.


On the top, where to alexa DOT should be placed, i made a hole where the raspberry pi sticks out. This is because the raspberry pi couldn't be mounted lower, because it push againtst the speaker. Also this is the easy way to get to the usb connectors.
Unfortunally the raspberry pi A+ only has 1 USB port, but i needed 2. Also don't know if the A+ will work on GassistPi without issues.
The left black connector is standard. The red/brown/orange cables are connected to gpio pins on the raspberry pi. Which are used for neopixel and mic on/off. I don't go into this, sorry. This is already discripted in the GassistPi readme.


I ordered this 16cmm long micro-SD extender.
The SD-card is on the bottom, which is inside the speakerhousing. To prevent that i need to take the speakerhousing apart to get to the SD-card, i use this extender.


I mounted a plastic home-made part to it. To prevent short circuit with the raspberry pi, and to mount it in the housing


The 5Vdc power for the raspbery pi. I didn't used the micro-usb on the black connector on top. The reason for this is that you can change to audio input by pushing on the button on front of the speakerhousing. When doing this, the 5Vdc of the black connector is switched off. When accidentally pushed, your pi switches off, which can damage the data on the SD-card.
Therefor i toke the 5Vdc of the pcb which is mounted in the bottom. Take out the bottom pcb and flip it over.
You see a USB 5V and the GND is taken from the usb micro case


Screw everything back together and stick the rubber bottom back


This is how the tops look. On the left the sd-card extender.


These parts are needed for the audio input and output, neoxpixel control and neopixel ring.
The blackparts are made on a 3D printer. The lexan ring is made on my CNC machine and take the clear off by sanding it.
All parts are screwed together.


Starting with the top.
I designed it with a microphone off image, where the button will be mounted in


Mounted the lexan ring on it


This is how it is mounted on the inside


Next soldered an arduino nano to the neopixel ring (24 LED ring)
also the little pcb which switch for on/off mic is shown on this picture


Mounted the pcb for mic on/off


Mounted the arduino nano


Mounted the PS3 eye. i toke this out of his case. And toke the camera off. Only the 4 microphones are used.
The cable is shortend, otherwise to many cable inside the housing, where it already is small


Sorry, forgot to make a picture where i mounted the neopixel ring. But that needed to be mounted after the PS3 eye is mounted

This is the bottom. I made something for the audio DAC. So the original black connector could be used.
I toke the USB connector of the DAC and soldered some cables to it.


Here is everything together. A nice compact housing.
Some cables are loose, will explane later.


Placed the part on top of the speaker.
The loose cables are connected to the connector of the GPIO-pins.
The USB connectors are place in the raspberry pi usb connectors.


And placed the cap on top of the speaker.


When everything is programmed right, this is how the light looks like when you say "OK Google"


And when the speaker speaks , this is how the leds look like


I don't go into programming. For this look on the gassistpi github.
Better to keep al the information about programmering in 1 place

[DewGew]

Looks really nice ...

[DewGew]

GassistPi now supports mqtt. Now i can send mqtt messages to gassistpi.
I made a tts function. I can send a custom message from my domoticz to my gassistpi and it speaks my message.

[hoeby]

I saw it on the GassistPi github.
Still need to do an upgrade to the latest version.

I use the sonos api, to speak text, but then off course tru sonos speakers.

[rkarolek]

hi
I installed gassist on my RBpi, looks like works OK, but....
I try set up it to control domoticz and... it doesnt work,
its domoticz's part of my config yaml

Code: Select all

# Domoticz declarations
Domoticz:
  # Set this to 'Enabled' 'Disabled' to control devices registered to Domoticz server.
  Domoticz_Control: 'Enabled'
  Server_IP:
    # If you are running the server on the Pi itself, then change the ip to 'localhost'
    - '10.0.0.150'
  Server_port:
    - '443'
  Devices:
    #The number of names and number of ids should be equal
    #List the device names that you want to control
    Name:
      - 'test'
      #- 'Lamp2'
      #- 'Lamp3'
    #Assign the device ids in the same order as the devices listed above
    Id:
      - '1'
      #- '2'
      #- '3'

idk where is the problem
any idea?

[hoeby]

how is the security on your domoticz?
is it possible to control without user/password?

could you manually start GassistPi . then try the command again and post what you see on the console of GassistPi.

what is the command you are speaking to GassistPi to control domoticz?

you have a domoticz device named 'test' with idx '1'?
what kind of device is this idx 1: switch on/off?

[hoeby]

My GassistPi was working without problems for over a year. But there where some things i would like to change. Therefor i made a new one.

What was the problem whit the first version.
Audio output was with usb to jack. This gives a continu noise on the speaker. It was not loud, but when close to the speaker you could hear it. Second i was missing a shutdown button, that it could be safe shutdown without damaging the image. And last challenge, try to make it smaller.

This is what i come up with.
It now has 2 mics and 1 speaker. Using adafruit i2s components, these give digital signals, the noise is gone.
The mic-off button is gone, never used it. But the hardware is used to give a safe shutdown of the pi.
Changed the pi 3b+ to pi 3a+. This one is smaller.

See the difference. Left the new one, right the old one


The led ring is moved from top to bottom. Loved it on top, but there was no place on the new version. Here you also are the small shutdown button. The sd-slot is not used. The housing is from a Bluetooth speaker with sd-slot.


Forgot to make pictures from the inside. This was just before closing. It just fits all inside.
For a few days i monitored the temperature. It is the same as my domiticz pi. That will be no problem.

[JuanUil]

interesting