small data

We define small data by the training time of a top predicitive model being on the order of minutes to an hour. Controling overfitting is very important in this regime, and domain knowledge has high value. On the other hand, the range of applicable techniques is also larger (e.g., kernel methods can be considered), and a large number of models and hyperparameter combinations can be tried.

Related problems