As a Portuguese living in Poland...
You really shouldn't bring racist slurs into it, because that only reveals an inferiority complex within yourself. Someone looks down on the appearance of Polish men, and then you have to look down on someone's supposed race. When in reality, it was a stupid comment to begin with. There are gorgeous Polish men and ugly Polish men, gorgeous Portuguese and ugly Portuguese, gorgeous black men and mixed-races and ugly, etc. If it isn't your thing, then it isn't, but no need to be a racist infantile, whether you are ugly or not.
I am starting to take pride in my Polish side, but I really hope this forum or Polish members do not make me feel ashamed.