Interestingly, in long-sleeved shirts, these holes do not appear, but the collars and cuffs wear out
There's a brand of shirts called Double Two. They don't do it nowadays but got the name because they used to supply a second collar (and I think cuffs) with each shirt. I used to spend a lot of time near their factory and bought a lot from the factory shop. Mostly slight seconds but you couldn't tell. They're still going, still a family firm and have a good reputation as an employer.
doubletwo.co.uk/
Holes in short shirts are now a real nightmare even in very expensive brands
I'd guess that's because the fabric is lighter usually