When I looked up and saw this fruit at Allan Gardens in downtown Toronto, I immediately suspected it was a Papaya. I think I didn't know how they grew. Well, they bunch up around the trunk. You learn something everyday. I asked for a confirmation that it was indeed a Papaya and a person working there confirmed it. I forgot to ask who gets to eat this fruit when it is ripe. Maybe they give it to the Toronto Mayor?
Here is what the tree looks like.