To say "I went swimming yesterday" in Engpsh, you can say:

"I swam yesterday."

Alternatively, you can also say:

"I went for a swim yesterday."

Both of these sentences are correct and convey the same meaning.