All Mail can sometimes end up with mail itens in there that have no label or folder. There is currently no way to filter out emails that have no folder or label.

My proposal is to either have the items 'Unsorted' and 'Unlabelled' in the left bar OR in the search dialog have an item there we can click that will specifically bring up email that has no folder or label.