Your colleagues wouldn't give a fuck, your employer probably wouldn't have you back if your time was up though. The other factor here is Coke or Pepsi drinkers don't give a fuck who works there, they just want the black stuff.
Fans have an unusual expectation of loyalty from players, misguided, but still expected. If a player moves on it should be done in a way to satisfy that expectation of loyalty.