I'm pretty sure I'll get ripped off by a dealer or a car owner.
This is a real risk, even for Polish speakers, including those who have lived there all their lives.
Yes. People from Poland often buy used cars abroad rather than within Poland for that reason.
How much tax do I pay on top of the car cost?
This explains it well.
justlanded/english/Poland/Poland-Guide/Travel-Leisure/Renting-and-importing-a-car-in-Poland