We analyze cooperative behavior of participants who faced a loss. In particular, we extend the Public Good Game by a fixed loss in the beginning of every period. We show that humans change their behavior compared to corresponding studies with gains only. First, in contrast to literature on gains, we observe significant order effects. When participants first play a treatment with punishment, they cooperate less and face higher punishment costs than when first playing a treatment without punishment. The changes are that drastic that punishment does not pay in the first case, while it does in the later. Second, for participants first playing without punishment the contributions in the very first period of play determine the contributions throughout both treatments of the game, yielding higher contributions in the punishment treatment than when playing with gains. Participants punishing first, show no comparable behavior.