A regression test is a test whose job is to stick around and make sure that, as a system evolves, it keeps working.
Most unit tests are also regression tests, since if you're writing a unit test, the property which the test verifies is generally important for some period of time.