Not sure if the aphids ate all those flowers before the fruit could properly set, or if the yucca moths (which pollinate joshua trees) just didn't get to that cluster of flowers, but the aphids and flowers are gone now, and there are only a few almond-sized not-quite-started fruits on that cluster... Need to get more ladybugs! :)