|Class SVRLight, performs support vector regression using SVMLight. |
Class SVRLight, performs support vector regression using SVMLight.
The SVR solution can be expressed as
where and are determined in training, i.e. using a pre-specified kernel, a given tube-epsilon for the epsilon insensitive loss, the follwoing quadratic problem is minimized (using the chunking decomposition technique)
Note that the SV regression problem is reduced to the standard SV classification problem by introducing artificial labels which leads to the epsilon insensitive loss constraints *
This implementation supports multiple kernel learning, i.e. if a CCombinedKernel is used the weights in can be determined in training (cf. Large Scale Multiple Kernel Learning Sonnenburg, Raetsch, Schaefer, Schoelkopf 2006).
linadd optimizations were implemented for kernels that support it (most string kernels and the linear kernel), which will result in significant speedups.