Indeed, if the total turnover of the business is less than a certain threshold (about EUR15,000 or so), there is no need to charge VAT, which should cut the price even more.
It won't cut the price, because you'll have to pay VAT on the purchase with no prospect of a refund. You wouldn't have to charge VAT on the sale - but any advantage is lost with having to pay VAT to the Polish side of things.
Plus you'll have to have the money to pay the excise taxes upfront - the latest thing I found is saying that you'll pay around 1EUR per bottle of your average Polish beer. Let's say you can get the stuff for 0.60EUR a bottle - you're upto 1.60EUR up front before you even consider transportation costs.