Well, now notifications are just disappearing on their own.

The notification was in my notification timeline, I clicked on Notification again without leaving the page, this time it just disappeared without going to another page.

Notification is there:

Now it's gone after just basically refreshing the page.