I think that's a bit dramatic
Not only that but also untrue.It,s not like you address Pan/Pani everybody every time.
In fact, the majority of people, when stopping me on the street, address me as 'ty' and they are not necessarily older (though I've been called Pan by many old folks, which sounds odd)
You must be a young person.It may sound odd for someone not familiar with customs (I am saying customs because there is not any written rule regarding Pan/Pani,though as a rule you can't go wrong with pan/i).To give you an example lets say I am 23 years old,talking to another 23 y/o in some formal situation (like office,store, etc)I would address him per Pan.But talking to the same man in some informal situation I would address him per ty.Now lets say I am 40.I would address another 40 y/o (as well as 23 y/o) per Pan in both formal and informal situations.Women, I always address per Pani regardless their (and my) age.
Few days ago in Chicago I was approached by a Polish middle age women per ty and to me it sounded awkward (crude?).I immidiatelly thought she had bad manners.With that being said, as a foreigner you will be given some slack and nobody will assault you just for addressing him per ty.Though, it is possible that he may not like it. I don't feel like writing a lot,basically you would have spend some time among Poles to get a grasp on customs.