Not flippant when you look into the history behind the differences - for example, the Mint had enormous problems with the early bronze coinage, which is why there are so many varieties for the first few years. Many of these varieties are 'significant', in that different designs can be seen (lighthouse, leaves in wreath, signature present somewhere or other or absent, beads vs teeth, die letters below lighthouse, position of bust, lettering, shield, etc) - some are very common, others very rare, added to which there are common obverses and reverses which are rare in particular combinations.
One thing which varies a great deal is the position and angle of the final punched digit in the date. These correspond to different individual dies being used, there being no other difference to note. They of course might be of interest to a (very small) number of collectors, and those same collectors might equally wish to pursue a collection of different die numbers used on silver coins, and good luck to them - as has been said, it takes all sorts...
However, the small collector base for these means that although certain dies may be rare, you'd have to search out an interested collector to get any premium over the listed price for - e.g. - a common variety of 1861 penny. Where it becomes more interesting (i.e. a greater number of potential collectors) is where you get a deliberate design difference in the spacing of date numerals, as can be seen between 1875 and 1879. A few varieties are rare, and though some collectors wouldn't be interested in the slightest, there are enough others to raise the premium on a particular variety by quite a large amount.
HTH