There is some racism, like everywhere, but it tends to lie latent unless you get close to Poles. Many want to create a good impression and thus don't openly voice it. They tend to say it more amongst themselves but only a select few are hostile with it.
Racism is about stereotypes and hatred. We have no reason to hate any race simply because until recently we have no contact with ppl of other races. As for stereotypes - you have to got a time and some experience to develop some. We have got none of them.
Let's say - some thug is rather unhappy with kebab is calling a cook "You brown B###ard"
In London - this is racism. Simply because of a long standing tensions between minorities.
In Warsaw - This is simple statement: "This brown-skinned guy is ba###rd". Brown or black are just a colours in Polish language - with no other contexts.
In Poland you can describe people by the color of their skin the same way you can do it by the colour of hair. Calling somebody a red-head is certainly not racist, is it?
Polish individualism means that we are mostly proud of being different than the others. We assume that all the people feel the same. For instance - as a Pole I would not describe somebody as a guy "wearing a blue shirt an dark trousers" in situation where this guy is the only black person in the city. The fact that he is black is what distinguish him from the others - not his shirt. (Of course - I know that in London that would be seen as an racist remark)
Of course - for most of Westerners visiting Poland this simple information is hard to grasp. They heard that Poles in conversation are describe somebody as black/brown/yellow/whatever. By their western standard this is racism. By Polish standards it is not. Some cultural-awareness shall be employed at this point, don't you think? We have any right to be judged accordingly to our culture, not yours.
I don't deny that there are some REAL racists in Poland. But most of this so-called famous Polish racism is just a misunderstanding on the border of cultures and languages.