Re the repost from @joeld above:
Our plan was to eventually switch the unread counts to being based only on what users and streams you favorite, but the rate of new content is still slow enough that we figured (incorrectly, it seems) that doing it for the whole site would be fine.
We can push up making that change in our priorities. Perhaps it will encourage people to favorite more stuff.