Use the right size drill bit when installing new pins. Be aware that closet door manufacturers will typically specify a 7/16" drill bit which is often too small, and prevents the pin shaft moving freely.
In these situations, use a 15/32” drill bit. This will yield a slightly larger hole, which will still hold the pin firmly, and allow the pin mechanism to function.
Don't use larger drill bit sizes beyond 15/32" or attempt to auger out the hole. If the hole is too large or misshapen, the pin will rock under load causing damage and increased wear