A regression problem is a Supervised Learning category where you wish to solve for a continuous value given an initial Training Set.

Initial Data: a set of continuous values

Goal: predict a continuous value output given a set of parameters

Example: housing prices based on size of house