When you’re jiggling around in your pocket for it and there’s other coins in there too, it becomes harder to do.

Well, sure. Adding many variables usually makes anything harder to do. But that generally just means it takes a little more effort.

Are your hands horribly mangled or something? Am I bringing up something hard for you to deal with?