I think collecting coins appeals to people who appreciate:
1) history, 2) beauty , 3) intrinsic rarity , 4) condition rarity , 5) investment potential
I know I am generalising when I say the type of coins we collect depends on which factor(s) matter to us most. A few rate history and intrinsic rarity beyond all else and are happy to collect washers. Intrinsic rarity is prized much more highly by bronze collectors and you have many people paying thousands for a "rare variety" penny in terrible condition. I would never do such a thing as I don't value intrinsic rarity so highly (and I view all hammered coins are unique). For me, I value factors 1), 2) and 4). If I ever buy a holed coin, it's for the history (and what's left of beauty) and will use my "fun" budget rather than "coin" budget.