I just tried to remove the access control (removed userid/pw), and ran the debug cycle again. Now the mail comes in without problems, so I can confirm that this was the root cause.
For testing sake I have reinstated the access control but now added "::1", as you suggested. I will know in five minutes...