At around 10:15pm on Wednesday, the men approached the area in the Falkenberg suburb east of the city centre where an accommodation facility is being built out of shipping containers, Tagesspiegel reported.
Two security guards on duty at the site reported that the men started hurling racist insults at them before one of the men raised his arm in the gesture, which is forbidden under German laws against symbols of banned organizations and incitement to hatred.
Once the men had left, the guards reported the incident to the police, and the four men were picked up by a patrol car soon afterwards.
Alcohol tests showed that all four were drunk. The police released them after checking their identities and are investigating them for incitement to hatred.