Why would a Polish uni be so strict about a few days` delay?
It's not a few days delay. It's a few days after the end of a rather generous six or seven week long delay. The students are well into the semester now, and the OP would have trouble catching up with a month and a half of work.
who can`t be blamed for their visa problems?
Blame has nothing to do with it.