Comments on PRs don't always trigger notifications

[loutPhilipps]

Describe the bug
After getting a comment on a PR I'm the author of, I don't receive any Slack notification, missing that I got a review. If the reviewer mentions me with a @, approves/requests changes, I do receive the notification consistently. This is with this setting on:

To Reproduce
Doesn't seem to happen consistently.

Expected behavior
If I enable Someone comments on your pull request, I always receive a Slack notification, even if I'm not directly mentioned

Additional context
This issue has been present for a while (at least 3 years for me).

[furkando]

Not getting notification if there is a comment with approve as well! (comment not included)

[hasanbal]

+1 same here

[lenzai]

What i experienced for comment on PR, comment on PR review and comment on any commit outside PR.

If I post 1 line comment, I receive notification always
if I post 2+ lines comment, I don't receive notification

[scr4bble]

I am experiencing the same behavior. It's very annoying because one definitely wants to be notified about new comments in his own PR. Currently the comments are posted into respective PR thread in Slack but no notification is generated out of it so unless you are following the specific thread in Slack.

Btw. where have you found the settings you have posted as a screenshot @loutPhilipps ?