Some poeple claimed it was a reference to the New World Order that the Nazis craved. The band claimed that it was simply because they were the same band with a new order (given that Curtis was gone and Gilbert was now involved).
The "Joy Division" was specifically tasked to rape the women of occupied areas in an attempt to spread the Ayrean genes.
The controversy continued after Ian Curtis' death when the remaining members of Joy Division (and Gillian Gilbert) continued under the name New Order. Cue more complaints of Nazi sympathies.