Stop sending notifications about new replies