Figured it out on my own

Needed to change "Switch Type" to "On/Off" instead of "Push On Button" which is default for Wake-On-Lan devices

Cheers

Doing what you said does not achieve the following:

have on/wake buttons on my dashboard that at the same time show if the computer is actually on

I only get WoL button, but no on/off status of the monitored host.
Could you elaborate a bit?

Thanks