If your ancestor was a Roman Catholic, many parish records were saved and are in Warsaw in National Archives.
The most important is what was a parish of your great-grandparents. If you have any Church certificate (birth, marriage, death) - there must be a parish name on it.
If not try to google it or give the family name here and I try with google tricks.