"前一天" means "the day before" in Chinese. To say this in Engpsh, you can simply say "the day before" or "the previous day." For example:

I finished the project the day before.
I will see you the previous day.