Your dad is quite right. I worked for J Lyons teashops in my school holidays and on occasions I was trusted to work the till at the end of the counter. Bun pennies, usually very worn (clear date) were easily found, as were widow head coins in around fine. I never once saw a Victorian halfpenny of any kind, and even Edward VII ones were rare and very worn. The best Victorian penny I ever found was a 1892 in GVF, which I still have. Otherwise, the only other notably decent coin was a 1866 one thirteenth of a shilling from Jersey in EF. The coin is absolutely jet black and has a commonwealth style bust, which is probably the reason it got spent - the owner I would guess thought he was fiddling me with a foreign coin by passing it on. Again, I still have it.
It is probably the fact that interesting coins could be found in change which set me on the path of collecting. I put together an album in the late 1960s/early 70s, and was inspired to pick up the interest again in the early 1990s, and the rest as they say is history.