I think you have to draw the line somewhere.
Definitely - there was a big difference between Waffen-ss combat units and so called Allgemaine ss, more or less, the political "arm" of the nazi-party.
After the war, the judges of the Nuremberg Trials declared part of the SS a criminal organization.
I tend to see some of the Waffen ss unit as "less criminal" but believe me:
drawing the line is pretty hard here.
For example some Russians are ready to recognize Vlasov army as a patriotic anti-commie organization.
I would rather admit general Vlasov was a Russian patriot but for sure not his bunch of criminals coming partially from Kaminski brigade.
It was not my only example - for sure Jewish organizations consider Waffen ss from the Baltics to be Holocaust responsible.
For many Latvians or Estonians they are freedom fighters.
But all these do not refers to Dirlewanger.
I can imagine torturing him was a pleasure.