I totally agree w/mm about the lemon, it is magical in this recipe. I usually substitute barley flour for the whole wheat, which makes it even more like cake, as does topping it with Heidi's muscovado-lemon glaze: http://www.101cookbooks.com/archives/lemony-olive-oil-banana-bread-recipe.html

And then I try to not be left alone with it.