With regards to desktop notifications:

Add a time element to set how long between notification pushes. Rather than when each new email arrives, you could set to be notified every 10 minutes.

Add an option to consolidate notifications. So instead of a single notification banner per email, you'd see a single notification popup listing all new email, one per line, with the sender's name and maybe the first 40 characters of the subject.