Since the ratio of apples to bananas is $3: 2$, then we can let the numbers of apples and bananas equal $3n$ and $2n$, respectively, for some positive integer $n$. Therefore, the total number of apples and bananas is $3n + 2n = 5n$, which is a multiple of 5. Of the given choices, only (E) 72 is not a multiple of 5 and so cannot be the total. (Each of the other choices can be the total by picking an appropriate value of $n$.)