It looks like WhatsApp knows how annoying that can be because the company seems to be testing out a new feature. According to a report from WABetaInfo, it appears that WhatsApp is testing a feature in beta that will keep archived chats archived. This means that even if you get a new message, that chat will remain in your archive instead of appearing in the main screen.
This is a toggle that users can choose whether or not they want to enable or disable, so if you’re the type that just wants all archived chats to remain hidden and silent, this could be the feature for you. We know that there have been some users who complained about this, so it’ll be good news for them.
Unfortunately as this is a beta, there is no telling when the feature will be available to those who aren’t in the beta, but hopefully it won’t take too long.