This is something where I thought it would take me five minutes. And then when that didn't work, it looked like another ten minutes. And then when that didn't work, I thought it would be another ten minutes .... and so on and so on ...
When I finally got to the point where I could see how to fix it I thought about how people would experience the exact problem you are talking about.
I need to go make the appropriate change to that part next.
For now ... I haven't tried this, so this is just based on my understanding of how the innards of this forum software works ... if you go and turn it on, and then turn it off, that should turn it off.
I turned it back on as you suggested, and left it on last night. Today I had some notifications, so I deleted them, went back to my profile and turned it off, and restarted the computer, and still got some notifications.