"Against the wind" is a phrase that can be used to describe going in the opposite direction of the wind. For example, you could say "We had to row our boat against the wind to get back to shore."