A regression problem is a Supervised Learning category where you wish to solve for a continuous value given an initial Training Set.
Initial Data: a set of continuous values
Goal: predict a continuous value output given a set of parameters
Example: housing prices based on size of house