I found this confusing when I use the neural network toolbox in Matlab.
It divided the raw data set into three parts:
- training set
- validation set
- test set
I notice in many training or learning algorithm, the data is often divided into 2 parts, the training set and the test set.
My questions are:
- what is the difference between validation set and test set?
- Is the validation set really specific to neural network? Or it is optional.
- To go further, is there a difference between validation and testing in context of machine learning?