I was able to get rid of the notifications delay by disabling Doze Light only:
adb shell dumpsys deviceidle disable light
This command should be applied after a restart again, since my phone is not rooted.

Hopefully Android will make it possible to apply these settings manually in the future, but ...