Read-out of Power production of individual solar panels with Enphase microinverters

[AllesVanZelf]

@Firewizard
I'm very happy I found this thread. Last week they installed solarpanels with inverters and Envoy Metered on my house. It was easy installing and configuring using your guide! Thanks a lot!

[Bestek]

I have an envoy system with envoy s metered 3 phase, CT terminals for production and consumption.
I would like to read out the measurements from each phase, has anyone done that already?

[wkossen]

hi. i love this thread and have tried to implement it, but run into problems.

first, de time constraint thing, how do i actually get that available? i used the npm command in the linked resource and did a node-red-restart, but the node-types don't show up in node-red, which also means importing your flow throws error messages about things missing.

second, and more importantly, i get gibberish from the function. a whole lot of 'undefined' entries in the debug log. i have no idea what i'm doing wrong as i'm very new to node-red. my envoy api works, i get expected information from the split, and i copy/pasted the function and adapted the idxes and serialnrs. seems to just not work. any pointers? like this:

13/11/2020, 10:04:09node: 1b145bfa.4dcc44
msg.payload : undefined
undefined

thanks for all your input!

[FireWizard]

Hello @Bestek

You wrote:

I have an envoy system with envoy s metered 3 phase, CT terminals for production and consumption.
I would like to read out the measurements from each phase, has anyone done that already?

As I do not own an Envoy S metered and so not able to test, I never implemented the consumption part, but I think it will be possible.

There exist a number or URL's on your Envoy S.

1. http://<IP address of your Envoy>/production.json.
This is the URL used by Domoticz. It doesn't use a username/password.

It will give you:

Screenshot_Envoy_Production_json.png (11 KiB) Viewed 3779 times

You can see the production figures of (in this case 8 inverters) added together, for both WhNow and WhLifetime.
If you have a so called AC Battery (for local storage), you will also find data for the consumption from the battery.

For external use, they have made available another URL http://<IP address of your Envoy>/api/v1/production.
Also this one you can access without a username/password.

It will give you:

Screenshot_Envoy Production.png (5.14 KiB) Viewed 3779 times

To access the individual inverters you have to use: http://<IP address of your Envoy>/api/v1/production/inverters.
This one will request a username and password (username = envoy and the password = the last six digits of the serial number)

It is not necessary to look into the box. Do a simple http request to http://<IP address of your Envoy>/info.xml and you get it on the 4th line after <sn>.

For a Envoy-S metered, you may expect something like:

{
"production":[
{
"type":"inverters",
"wNow":74,
"whLifetime":6815.014722222222,
"readingTime":1470250044,
"activeCount":14
},
{
"type":"eim",
"activeCount":1,
"whLifetime":6704.458,
"whLastSevenDays":6676.458,
"whToday":6676.458,
"wNow":66.236,
"rmsCurrent":1.179,
"rmsVoltage":246.433,
"reactPwr":276.774,
"apprntPwr":290.494,
"pwrFactor":0.23,
"readingTime":1470250044
}
],
"consumption":[
{
"type":"eim",
"activeCount":1,
"whLifetime":8025.821,
"whLastSevenDays":7899.821,
"whToday":7899.821,
"wNow":2641.386,
"varhLeadToday":2822.701,
"varhLagToday":1810.03,
"vahToday":9018.68,
"varhLeadLifetime":2951.701,
"varhLagLifetime":1922.03,
"vahLifetime":9473.68,
"rmsCurrent":11.924,
"rmsVoltage":246.458,
"reactPwr":-284.009,
"apprntPwr":2938.817,
"pwrFactor":0.9,
"readingTime":1470250044
}
]
}

So this is a lot more. Can you confirm what you see, if you enter in your browser: http://<IP address of your Envoy>/production.json.
You may also want to try other URL's, that you find at: https://thecomputerperson.wordpress.com ... -scraping/
Some of them will require the secret installer password.

Can you also tell me, what dat you want to have included?

Regards

[FireWizard]

Hello @wkossen

You wrote:

first, de time constraint thing, how do i actually get that available? i used the npm command in the linked resource and did a node-red-restart, but the node-types don't show up in node-red, which also means importing your flow throws error messages about things missing.

Go to the "Hamburger" menu (Right at the top beside "Deploy") and look for "Manage palette". Click!
Click on the "Install" tab and look for node-red-contrib-time-switch. Install this node.

I believe most of the others are default nodes.

second, and more importantly, i get gibberish from the function. a whole lot of 'undefined' entries in the debug log. i have no idea what i'm doing wrong as i'm very new to node-red. my envoy api works, i get expected information from the split, and i copy/pasted the function and adapted the idxes and serialnrs. seems to just not work. any pointers? like this:

This could be caused by the missing node, but if after installation of the missing node it is still te case, I suggest that you publish your flow here (or send me a PM), so that I can have a look.

Regards

[Bestek]

@firewizard thnak you for your answer, i have looked into the urls but aint getting the readings im looking for.

This is my /production.json

{"production":[{
"type":"inverters"
,"activeCount":7
,"readingTime":0
,"wNow":0
,"whLifetime":15049},

{"type":"eim"
,"activeCount":1
,"measurementType":"production"
,"readingTime":1605288940
,"wNow":17.408
,"whLifetime":20639.961
,"varhLeadLifetime":214.295
,"varhLagLifetime":20760.954
,"vahLifetime":45875.766
,"rmsCurrent":0.549
,"rmsVoltage":685.842
,"reactPwr":101.313
,"apprntPwr":125.694
,"pwrFactor":0.09
,"whToday":1713.961
,"whLastSevenDays":15254.961
,"vahToday":3732.766
,"varhLeadToday":1.295
,"varhLagToday":1973.954}]

,"consumption":[
{"type":"eim"
,"activeCount":1,
"measurementType":"total-consumption"
,"readingTime":1605288940
,"wNow":923.133,"whLifetime":247343.218
,"varhLeadLifetime":140035.569
,"varhLagLifetime":28925.086
,"vahLifetime":361148.279
,"rmsCurrent":5.975
,"rmsVoltage":685.718
,"reactPwr":-470.325
,"apprntPwr":4097.32
,"pwrFactor":0.23
,"whToday":13103.218
,"whLastSevenDays":132864.218
,"vahToday":20071.279
,"varhLeadToday":8864.569
,"varhLagToday":2268.086}
,{"type":"eim","activeCount":1
,"measurementType":"net-consumption"
,"readingTime":1605288940
,"wNow":905.725
,"whLifetime":232445.606
,"varhLeadLifetime":139821.274
,"varhLagLifetime":8164.132
,"vahLifetime":361148.279
,"rmsCurrent":5.426
,"rmsVoltage":685.593
,"reactPwr":-369.012
,"apprntPwr":1241.072
,"pwrFactor":0.73
,"whToday":0
,"whLastSevenDays":0
,"vahToday":0
,"varhLeadToday":0
,"varhLagToday":0}]
,"storage":[{"type":"acb"
,"activeCount":0
,"readingTime":0
,"wNow":0
,"whNow":0
,"state":"idle"}]}

I dont see specific measurements from every phase, in enlighten manager i can see the load.

[FireWizard]

Hi,
@Bestek

Data for all three phase is indeed not included .

According to https://thecomputerperson.wordpress.com ... mment-5838 you can try another URL.
In my case It does not work, but I don't have an Envoy-S metered.

However you need the installer password (secret).

Regards

[Joske]

Hello guys, an question about Enphase, i think its 'ontopic' so this should be the wright place..

I am using Domoticz (and an Toon v2 thermostate as interface) and used the existing 'hardware' to add the Enphase Envoy for my solarpanels.
The only thing is that the information isn't correct.
Domoticz shows an nice sensor with the 'kwh' of the day, thats very nice (and accurate if i compare with my Enphase app).
But the TOTAL kwh information isn't correct.

If i do this:

http://192.168.1.66/api/v1/production

The result is:

Code: Select all

{
  "wattHoursToday": 0,
  "wattHoursSevenDays": 5873,
  "[b]wattHoursLifetime": 149064,[/b]
  "wattsNow": 0
}

My question is:

What can i do to get an good result?
If i use the Enphase app is says: Lifetime (levensduur): 2,2 Megawatt

Because i use an very nice Solar app on the Toon i would like to get good results, so not only the 'daily kwh' but also the 'Total kwh'.
Before i try other methods like PVOutput (and maybe getting info via the API in stead of via the Envoy)...i think the problem first has to be solved.
Or am i doing something wrong?

PS

To be complete; this it what i get after giving the command: http://192.168.1.66/production.json

Code: Select all

==============
{"production":[{"type":"inverters",
"activeCount":7,
"readingTime":1611301689,
"wNow":-6,
"whLifetime":149065},
{"type":"eim","activeCount":0,
"measurementType":"production",
"readingTime":1611301942,
"wNow":-1.14,
"whLifetime":0.0,
"varhLeadLifetime":0.0,
"varhLagLifetime":0.0,
"vahLifetime":0.0,
"rmsCurrent":0.589,
"rmsVoltage":240.796,
"reactPwr":0.686,
"apprntPwr":66.969,
"pwrFactor":0.0,
"whToday":0.0,
"whLastSevenDays":0.0,
"vahToday":0.0,
"varhLeadToday":0.0,
"varhLagToday":0.0}],
"consumption":[{"type":"eim",
"activeCount":0,
"measurementType":"totalConsumption",
"readingTime":1611301942,
"wNow":-1.531,
"whLifetime":0.0,
"varhLeadLifetime":0.0,
"varhLagLifetime":0.0,
"vahLifetime":0.0,
"rmsCurrent":0.318,
"rmsVoltage":240.675,
"reactPwr":-0.686,
"apprntPwr":76.604,
"pwrFactor":-0.02,
"whToday":0.0,
"whLastSevenDays":0.0,
"vahToday":0.0,
"varhLeadToday":0.0,
"varhLagToday":0.0},
{"type":"eim",
"activeCount":0,"measurementType":"netconsumption",
"readingTime":1611301942,
"wNow":-0.391,
"whLifetime":0.0,
"varhLeadLifetime":0.0,
"varhLagLifetime":0.0,
"vahLifetime":0.0,
"rmsCurrent":0.27,
"rmsVoltage":240.553,
"reactPwr":0.0,
"apprntPwr":1.514,
"pwrFactor":-1.0,
"whToday":0,
"whLastSevenDays":0,
"vahToday":0,
"varhLeadTod
ay":0,"varhLagToday":0}],
"storage":[{"type":"acb",
"activeCount":0,
"readingTime":0,
"wNow":0,
"whNow":0,"state":"idle"}]}
==================================

EDIT:

The outcome of the command> http://192.168.1.66/api/v1/production/inverters :

Code: Select all

=================================
[
  {
    "serialNumber": "121915095354",
    "lastReportDate": 1611303724,
    "devType": 1,
    "lastReportWatts": 4,
    "maxReportWatts": 4
  },
  {
    "serialNumber": "121915093494",
    "lastReportDate": 1611303731,
    "devType": 1,
    "lastReportWatts": 3,
    "maxReportWatts": 3
  },
  {
    "serialNumber": "121915093025",
    "lastReportDate": 1611303727,
    "devType": 1,
    "lastReportWatts": 3,
    "maxReportWatts": 3
  },
  {
    "serialNumber": "121915093523",
    "lastReportDate": 1611303732,
    "devType": 1,
    "lastReportWatts": 3,
    "maxReportWatts": 3
  },
  {
    "serialNumber": "121915066311",
    "lastReportDate": 1611303728,
    "devType": 1,
    "lastReportWatts": 3,
    "maxReportWatts": 4
  },
  {
    "serialNumber": "121915092825",
    "lastReportDate": 1611303723,
    "devType": 1,
    "lastReportWatts": 4,
    "maxReportWatts": 4
  },
  {
    "serialNumber": "121915093502",
    "lastReportDate": 1611303728,
    "devType": 1,
    "lastReportWatts": 3,
    "maxReportWatts": 3
  }
]

========================================

Hopefully somebody can advise me.

Thanks!

[FireWizard]

Hello @Joske,

You wrote:

Hello guys, an question about Enphase, i think its 'ontopic' so this should be the wright place..

Yes, could be, at least you can try .

You said:

I am using Domoticz (and an Toon v2 thermostate as interface) and used the existing 'hardware' to add the Enphase Envoy for my solarpanels.

The Domoticz hardware uses the URL: http://<IP address>/production.json and it will give (among others) wNow: -6 and whLifetime: 149065

I also see that this data has been read at Friday, January 22, 2021 8:48:09. At this time of the year your solar panels are not active.
I have seen as well that sometimes the panels produce a negative value. It is not expected and therefore I corrected it in my solution.

The other URL you mentioned (http://192.168.1.66/api/v1/production) has been made public available and is described in a hard to find document.
See in this post: viewtopic.php?f=59&t=29516&p=225886&hil ... se#p225886

You can see that wattHoursToday is still 0 and wattsNow is also 0. Your wattsHoursLifetime is 149064, which is more or less equal as the data, you received in the first URL.

You said also:

The only thing is that the information isn't correct.
Domoticz shows an nice sensor with the 'kwh' of the day, thats very nice (and accurate if i compare with my Enphase app).
But the TOTAL kwh information isn't correct.

Why do you think that? And if so, which value is incorrect?
Domoticz "hardware" just reads the URL http://<IP address>/production.json and as said, the relevant data is identical to the public available URL: http://<IP address>/api/v1/production.

You compare data, what you retrieve from 2 URL's of your Enphase Envoy S metered with data that is published in the Enlighten app.
I also think that the app is not completely accurate, but what do you think that is correct. Your Enlighten app or Domoticz?

But you can try the Enlighten API. They have a free plan to access your own data.

Let us know

Regards

[Joske]

Thanks for you answer!
I already applied for the API key, hopefully i can manage to use that key and retreive the data direct form the Enphase-server.

What i meant:

It says the Enphase produced in its liftime: 149064watts, within Domoticz it also says this (149 kwh).
I know that this Enphase produces a lot more, the Enlighten apps says 2200 kvh (2,2 megawatt).

For example:
I also have an SMA Sunnyboy, also communicating via Domoticz and an SMA-app.
The data from this SMA is exactly the same, the app says exactly the same as the Domoticz-sensor.

So ik think there's something wrong, maybe the Envoy only gives the production of only 1 inverter?

I posted the most recent outcome of that command, but i did it earlier (while the sun was shining) and its the same issue.

Hopefully the API works better, i will take a look how i can integrate that (tips are welcome
Like i said, i registred already to receive the key, i only do not have 'Installer' cedentials, only 'User' credentials.

Thanks!

[FireWizard]

@Joske,

I see you have 7 Enphase inverters. How long have these been in use?

It says the Enphase produced in its liftime: 149064watts, within Domoticz it also says this (149 kwh).
I know that this Enphase produces a lot more, the Enlighten apps says 2200 kvh (2,2 megawatt).

That is what you should expect, because Domoticz get the data from that URL.

So ik think there's something wrong, maybe the Envoy only gives the production of only 1 inverter

No, if you look to the accumulated values of your inverters, you will see, it matches with the values of the URL's

Hopefully the API works better, i will take a look how i can integrate that (tips are welcome

You can use Node Red for it, but take care that the number of calls is limited to 10,000 hits per month or 10 hits per minute.
10.000/month means about 1 per 5 minutes

Like i said, i registred already to receive the key, i only do not have 'Installer' cedentials, only 'User' credentials.

See: viewtopic.php?f=59&t=29516&p=225886&hil ... se#p225886

And look for the APK file: https://www.dropbox.com/s/xc40op8eqfryk ... 9.apk?dl=0
This will generate the installer password..

Regards

[Joske]

Thanks again.

I have this set since june 2019.

I will dive into it, thanks for the tips.
Its al little bit much work for only the "total kwh"
the rest (LIVE) is okay.
I still think its strange that it gives this info via the mentioned URL.

Thanks

[FireWizard]

@Joske,

Just as a reference.

My Enphase system consists of 8 IQ7+ inverters connected to Solar panels of 300Ẁp.

The first registration at Enlighten was May 23, 2019, so more or less in the same period as yours.
In the Enphase app it indicates 3,0 MWh as lifetime production.

http://<IP address>/production.json indicate: whLifetime: 3264653 and http://<IP address>/api/v1/production exactly the same
This is also indicated by the Domoticz sensor: "Enphase Production Total".
So actually Domoticz indicate a little bit more than the Enphase app 3.2 MWh against 3.0 MWh.

This is possible, as I installed the panels in two sets and registered the system at the day everything was finished.

My conclusion so far:

Your lifetime energy production, indicated in the app of 2.2 MWh seems to be correct, related to the number (7) of panels and the time of operation.
Even somewhat low, but okay.
Domoticz functions correctly, as it uses the values that it got from the URL The values are correctly indicated.

However your Enphase Envoy Metered is not correct. (far to low). Any reason/thoughts why that could be.

It would be interesting, what the Enphase cloud API shows.

Regards

[Joske]

Thank you for the reference!

Its very interesting what the API will tell indeed.

edit:
I have an API key and a user_id; so i can check what the information is @Enphase servers side.

This first command (i am new in the API business) works:

https://api.enphaseenergy.com/api/v2/systems?key=<MY API KEY>&user_id=<MY USER_ID>

The result gives information about my set, like addres etc, but no watts-info.

Now i have to play with the commands;

This one didn't work (yet) unfortunatly>

https://api.enphaseenergy.com/api/v2/sy ... me&key=<MY API KEY>id=<MY USER_ID>

At this website i can get some examples > https://developer.enphase.com/docs/quickstart.html
Greetz

[MeAlbert]

@fireWizard
Very nice tutorial, thanks a lot. Have installed a system with nine panels and IQ7+ inverters.
I have now 9 meters which are calculating the generated kWh.
I also have a total house meter where every minute I add all the values.
There are minor differences between the system reports and the Domoticz devices do.

I could overcome that by extracting actual figures from http://envoy.local/api/v1/production. I will then get :
{
"wattHoursToday": 12473,
"wattHoursSevenDays": 51834,
"wattHoursLifetime": 51667,
"wattsNow": 593
}
when I add an extra function in Node Red with the line:
msg.payload = {"command":"udevice","idx":135,"nvalue":0,"svalue":((msg.payload.wattsNow).toString() + ";0")};

I think I can get the watts now from all panels total in an electric devise. But what if I also want to get the wattHoursToday directly in the device and not calculate it. (as WhToday)

Should I change it in this line?
msg.payload = {"command":"udevice","idx":135,"nvalue":0,"svalue":((msg.payload.wattsNow).toString() + (msg.payload.wattHoursToday).toString())};
Your help is highly appreciated.

[FireWizard]

Hello @MeAlbert,

You wrote:

Very nice tutorial, thanks a lot.

It was my pleasure, so no thanks.

I also have a total house meter where every minute I add all the values.
There are minor differences between the system reports and the Domoticz devices do.

I think that I understand what you want to say.

I see also differences between the value of the "Today" counter in Total Solar Production and the sum of the "Today" counter of the individual Solar Panels, that you receive from http://envoy.local/api/v1/production
These value is more or less the same as the Domoticz "hardware" of Enphase. See the screenshot.
The Domoticz hardware uses http://envoy.local/production.json

The reason might be the update frequency of the various values. I did not pay much attention to the differences.

The current value of the "Total" is equal to the sum of the individual panels, but the first one is received from the device and the value from the individual panels are calculated by Domoticz.

Personally I use a command from Node Red to Domoticz as:

Code: Select all

msg.payload = {"command":"udevice","idx":279,"nvalue":0,"svalue":(msg.payload.wattsNow.toString()) + ";" + (msg.payload.wattHoursLifetime.toString())};

Screenshot_Solar Production and Enphase.png (91.2 KiB) Viewed 3202 times

This provides the data for the left widget, while the right one is the Domoticz "hardware"

I hope this will help you.

Regards

[MeAlbert]

@FireWizard
Thanks is what I ment. Now I will try to get the monthly production out of it.
If I get stuck I will ask for your help but think I can manage it.
Thanks again.
Albert

[MeAlbert]

Post removed and started in a new lead.

[benedict]

Hi, I'm new here (and fairly new to domoticz, but not to MQTT), but I would also like to be able to grab the panel data of our enphase envoy-S.
Is this project similar to the one by the late Rens' (waaren) dzVentz script here: viewtopic.php?p=224674#p224674 or is waaren's script created later/better?
waaren did not post a tutorial, and I could really use some help here. I have domoticz running on a debian 11 server (not a pi, a bit stronger) on the same LAN as the Envoy, so that should work. It says:
"you need to install a MQTT broker, like Mosquitto, Node JS and Node Red."
Do you mean to say Node JS and Node Red are also MQTT brokers? Or do I need to install all three of them (Mosquitto, Node JS and Node Red)?

[FireWizard]

Hello @benedict,

Hi, I'm new here (and fairly new to domoticz, but not to MQTT)

Welcome on this forum

but I would also like to be able to grab the panel data of our enphase envoy-S

That's is very well possible and the method depends on what you want to see.

Is this project similar to the one by the late Rens' (waaren) dzVentz script here: viewtopic.php?p=224674#p224674 or is waaren's script created later/better?

It is not a question about what is better.

Both methods serves the same goal: Get the data from the Envoy-S or Envoy-S metered to Domoticz. Both methods can do this.
I think waaren's script was created a little bit later, but we both published our solution in September 2019.
I hardly use dzVents, while Rens is the father of it. So that's probably why he opt to use dzVents.

It is up to you to select dzVents and take waaren's script or to go for the Node RED solutions.

I have domoticz running on a debian 11 server (not a pi, a bit stronger) on the same LAN as the Envoy, so that should work

Absolute.

"you need to install a MQTT broker, like Mosquitto, Node JS and Node Red."
Do you mean to say Node JS and Node Red are also MQTT brokers? Or do I need to install all three of them (Mosquitto, Node JS and Node Red)?

No, NodeJS and Node Red are not MQTT brokers, although Node RED has a MQTT broker node, but as far as I have noticed, it is hardly used.

Node RED is a visual programming environment and I used it to convert the data from the Envoy S to the required Domoticz format.
See: https://nodered.org/ It is built on NodeJS. See: https://nodejs.org/en/

You can install Node RED and Mosquitto (MQTT Broker) on the same device under Debian 11.

For Mosquitto see: https://snapcraft.io/install/mosquitto/debian

Node RED, including NodeJS can be installed according to: https://nodered.org/docs/getting-started/raspberrypi
Although it says Raspberry PI, it is the same for any Debian release.

Install that first and then I can support you with the flow.

Regards