If there are Units at locations other than the Battlefield that the Combat is taking place at, but have either Attacker or Defender designations, they lose those designations now
§ 323.2.c Core Rules PDF (officieel)
§ 323 When a Cleanup occurs, the following Tasks become Outstanding in the order described:
§ 323.2 2. Assign or Remove the Attacker or Defender designation from Units as needed if there is a Combat in progress