Yes, that makes it much more difficult. Do you know if he became a naturalized UK citizen after the war?
You can also try contacting Robert Ostrycharz who has a lot of information about the Polish forces in Scotland. polishforcesinbritain.info
I also have a list of the manpower of the 24th Lancers in July 1944 but "Alojzy Adamczyk" does not appear. There is a "Zygmunt Adamiak" and "Eryk Adamski". Do you know if your grandfather received any decorations?
Above all else, never give up hope or stop searching! :)