Inbox still showing notification even though all messages are read?

Especially with replies, I can have all of the different tabs underneath my inbox empty but I will still see a notification for a certain number of messages still in my inbox. The only way that I can get it marked as empty is to click the Mark all is red button. Is there any way to have it fixed in that way?