Domoticz voice recognition with Jasper

nlooije · Post by **nlooije** » Wednesday 10 February 2016 14:23

Ever wanted to control your Domoticz projects like Tony Stark and Jarvis? Well now it is possible...
I spend some time writing a Jasper module which communicates with a Domoticz server through the JSON API.
The module can be found here. I'd appreciate if anyone using Domoticz and Jasper can test the module and suggest improvements if necessary.
I have not tested the module exhaustively (unittest are a to-do) so without a doubt there will be some bugs needing fixing.
I welcome any contributions, so send in a PR if you have any.

If there are questions concerning the Domoticz part of the Jasper module I welcome them here; this can be discussion on functionality for the module or bugs specific to the module, configuration of the module, etc.
If there are questions concerning Jasper installation and configuration then please post them to the Jasper support forums. This keeps the discussion here relevant to Domoticz.

m0rph13 · Post by **m0rph13** » Saturday 13 February 2016 19:19

Interesting! How does Jasper compare to Siri ?
I'm currently happy with Siri and Homebridge (using the eDomoticz plugin), but could be fun to try something new

pazzje · Post by **pazzje** » Saturday 13 February 2016 19:27

I will take a look

nlooije · Post by **nlooije** » Saturday 13 February 2016 22:17

m0rph13 wrote:Interesting! How does Jasper compare to Siri ?
I'm currently happy with Siri and Homebridge (using the eDomoticz plugin), but could be fun to try something new

Well Jasper in essence is a backend for transcribing speech using a STT engine, evaulating the spoken text to perform a command and then respond using a TTS engine. The STT and TTS engines are free to choose, i use the Google engines for example. I have no idea how it compares to Siri, perhaps you can make this evaluation and post your results here?

Derik · Post by **Derik** » Sunday 14 February 2016 11:39

Where can i find the google voice api?

nlooije · Post by **nlooije** » Sunday 14 February 2016 11:55

Derik wrote:Where can i find the google voice api?

Are you following these configuration steps? Make sure to install all dependencies for Google STT and Google TTS. Google STT requires an API key:

To obtain an API key, join the Chromium Dev group and create a project through the Google Developers console.

Then select your project. In the sidebar, navigate to “APIs & Auth.” and activate the Speech API. Under “APIs & Auth,” navigate to “Credentials.” Create a new key for public API access.

Add the appropriate settings in ~/.jasper/profile.yml

Derik · Post by **Derik** » Sunday 14 February 2016 12:06

i did join the group...
only no key..
just a lot of mail from the forum.. [ can i turn that off? ]

What do i need to create?
or is this just to get the api key?

nlooije · Post by **nlooije** » Sunday 14 February 2016 12:12

Derik wrote:i did join the group...
only no key..
just a lot of mail from the forum.. [ can i turn that off? ]

What do i need to create?
or is this just to get the api key?

This is just to get the api key. If you joined the Devgroup you shoud be able to find the Speech API, enable it and then under credentials create an API key.

Derik · Post by **Derik** » Sunday 14 February 2016 13:06

almost i think..
Hard to get, for a dombo...

: ScreenShot035.jpg (52.05 KiB) Viewed 4822 times

I can choose a lot..:

: ScreenShot036.jpg (96.31 KiB) Viewed 4822 times

only not the one you says...

Found one only what sould i do now:

: ScreenShot037.jpg (84.54 KiB) Viewed 4822 times

so what is my next step....

nlooije · Post by **nlooije** » Sunday 14 February 2016 13:10

Are you absolutely sure you are part of the devgroup? follow this just to be sure...
make sure also that the account you used to sign up for the devgroup is the same account for the dev console.
if all works you should be able to enable the speech api and create the api key.
If it still doesn't work, consider installing another STT engine

Derik · Post by **Derik** » Sunday 14 February 2016 13:23

I think i got something:

: ScreenShot039.jpg (44.66 KiB) Viewed 4819 times

And this is it gues?

: ScreenShot040.jpg (43.89 KiB) Viewed 4819 times

nlooije · Post by **nlooije** » Sunday 14 February 2016 13:31

Yeah so Server key 1 is the Speech API key, enter that into profile.yml

Derik · Post by **Derik** » Sunday 14 February 2016 13:39

nlooije wrote:Yeah so Server key 1 is the Speech API key, enter that into profile.yml

Pff
Thanks....

Go now to visit friends of my boss....

when i have time [ not match ] i give it a try

Thomasdc · Post by **Thomasdc** » Saturday 20 February 2016 18:28

Hi nlooije !

I will give this a try as soon as possible! and i am happy to help where possible (testing/looking for bugs)

What hardware do you use? (microphone)

and how is your experience so far?
not to much 'false positives' while watching a movie or something?

I will also give my experience on this, but I will only be able to test it out in a few weeks.

Thanks anyway!!

nlooije · Post by **nlooije** » Saturday 20 February 2016 20:15

Hi Thomasdc,

I look forward to your account of your experience with the module.
I use a 20 euro Akiro mini usb from amazon; i like that it is small and easily concealed, its accurate within a meter or so but i can't use it from across the room (yet). On the Jasper forum we started a 'supported hardware list' thread you may want to check (although it's not very extensive yet).

In general i think the module work quite well, with little false positives within my use cases but it is best to provide as much detail as possible when giving commands. With this i mean that specifying the 'command', 'device' and 'room' works better than just 'command' and 'device'. This may be improved if Jasper moves to a better way of predicting user 'intent'.

good luck

Derik · Post by **Derik** » Sunday 21 February 2016 19:34

Holiday so i give it a try..

1 problem in the wiki from Jasper:
How can i stop the test, and the player..

Code: Select all

Next, test that recording works (you may need to restart your Pi) by recording some audio with the following command:

arecord temp.wav
Make sure you have speakers or headphones connected to the audio jack of your Pi. You can play back the recorded file:

aplay -D hw:1,0 temp.wav

Derik · Post by **Derik** » Sunday 21 February 2016 20:54

I do have more other problems...

Code: Select all

aspberrypi 4.1.13+ #826 PREEMPT Fri Nov 13 20:13:22 GMT 2015 armv6l

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Sun Feb 21 19:40:24 2016 from 192.168.5.5
pi@raspberrypi ~ $ /home/pi/jasper/jasper.py
*******************************************************
*             JASPER - THE TALKING COMPUTER           *
* (c) 2015 Shubhro Saha, Charlie Marsh & Jan Holthuis *
*******************************************************
WARNING:root:tts_engine not specified in profile, defaulting to 'espeak-tts'
ALSA lib pcm_dmix.c:1018:(snd_pcm_dmix_open) unable to open slave
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.rear
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.center_lfe
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.side
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm_dmix.c:1018:(snd_pcm_dmix_open) unable to open slave
ALSA lib pcm_dmix.c:957:(snd_pcm_dmix_open) The dmix plugin supports only playback stream
ALSA lib pcm_dmix.c:1018:(snd_pcm_dmix_open) unable to open slave
No disturbance detected
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:48:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:49:06 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:49:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:50:06 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:50:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:51:06 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:51:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:52:06 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
INFO:client.stt:Transcribed: (u'JUST BUFFALO', u'JUST BELOW', u'JUST HELLO', u'DUST BUFFALO', u'JUST BLUFF HOLLOW')
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
INFO:client.stt:Transcribed: (u'WHAT IS THE WEATHER', u'WHAT IS THE MATTER', u'WHAT IS THE MOTHER', u'WHAT IS TOMORROW', u'WHAT IS THE WEATHER OF')
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:52:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
INFO:client.stt:Transcribed: (u"WHAT'S THE WEATHER TODAY", u"WHAT'S THE WEATHER TOMORROW")
WARNING:client.stt:Empty response: Nothing has been transcribed.

Look Jasper is running.
Looks the mic is working
The headphone is working one time, by the boot..
Where do i go wrong...

Is there a way that i can monitor my putty without a extra start of Jasper.

Edit:
Other problem.... A gmail block.

: ScreenShot043.jpg (74.75 KiB) Viewed 4652 times

Edit:
Fixed the Mail error..:

: ScreenShot044.jpg (100.12 KiB) Viewed 4647 times

nlooije · Post by **nlooije** » Sunday 21 February 2016 23:21

Derik wrote:Holiday so i give it a try..

1 problem in the wiki from Jasper:
How can i stop the test, and the player..
Code: Select all
Next, test that recording works (you may need to restart your Pi) by recording some audio with the following command:

arecord temp.wav
Make sure you have speakers or headphones connected to the audio jack of your Pi. You can play back the recorded file:

aplay -D hw:1,0 temp.wav

You can stop arecord by using: CTRL+c
You can also specify a duration: arecord -d 10 temp.wav
for a 10 second recording. The player also is stopped by CTRL+c
Basically anything in a unix system can be stopped using CTRL+c.

nlooije · Post by **nlooije** » Sunday 21 February 2016 23:22

Derik wrote:I do have more other problems...

Code: Select all

aspberrypi 4.1.13+ #826 PREEMPT Fri Nov 13 20:13:22 GMT 2015 armv6l

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Sun Feb 21 19:40:24 2016 from 192.168.5.5
pi@raspberrypi ~ $ /home/pi/jasper/jasper.py
*******************************************************
*             JASPER - THE TALKING COMPUTER           *
* (c) 2015 Shubhro Saha, Charlie Marsh & Jan Holthuis *
*******************************************************
WARNING:root:tts_engine not specified in profile, defaulting to 'espeak-tts'
ALSA lib pcm_dmix.c:1018:(snd_pcm_dmix_open) unable to open slave
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.rear
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.center_lfe
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.side
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm_dmix.c:1018:(snd_pcm_dmix_open) unable to open slave
ALSA lib pcm_dmix.c:957:(snd_pcm_dmix_open) The dmix plugin supports only playback stream
ALSA lib pcm_dmix.c:1018:(snd_pcm_dmix_open) unable to open slave
No disturbance detected
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:48:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:49:06 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:49:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:50:06 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:50:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:51:06 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:51:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:52:06 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
INFO:client.stt:Transcribed: (u'JUST BUFFALO', u'JUST BELOW', u'JUST HELLO', u'DUST BUFFALO', u'JUST BLUFF HOLLOW')
WARNING:client.stt:Empty response: Nothing has been transcribed.
WARNING:client.stt:Empty response: Nothing has been transcribed.
INFO:client.stt:Transcribed: (u'WHAT IS THE WEATHER', u'WHAT IS THE MATTER', u'WHAT IS THE MOTHER', u'WHAT IS TOMORROW', u'WHAT IS THE WEATHER OF')
WARNING:client.stt:Empty response: Nothing has been transcribed.
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-02-21 19:52:36 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 507, in login
    raise self.error(dat[-1])
error: [ALERT] Please log in via your web browser: https://support.google.com/mail/accounts/answer/78754 (Failure)
INFO:client.stt:Transcribed: (u"WHAT'S THE WEATHER TODAY", u"WHAT'S THE WEATHER TOMORROW")
WARNING:client.stt:Empty response: Nothing has been transcribed.

Look Jasper is running.
Looks the mic is working
The headphone is working one time, by the boot..
Where do i go wrong...

Is there a way that i can monitor my putty without a extra start of Jasper.

Edit:
Other problem.... A gmail block.

ScreenShot043.jpg

Edit:
Fixed the Mail error..:

ScreenShot044.jpg

What do you mean 'where do i go wrong'? what problem are you experiencing?

Derik · Post by **Derik** » Sunday 21 February 2016 23:25

What do you mean 'where do i go wrong'? what problem are you experiencing?

Jasper is not talking back...

You can also specify a duration: arecord -d 10 temp.wav
And how can i play this simple ..

Domoticz voice recognition with Jasper

Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Re: Domoticz voice recognition with Jasper

Who is online