I want to know if I can apply for the normal residence permit without a passport.
Nothing anyone can tell you here is liable to be accurate (except by chance). You need to go to the immigration office (take your wife to interpret) since only what they say will matter. Also Polish legal regulations are at times ambiguous and sometimes offices in different cities interpret the rules differently so again, only believe what your local office tells you.