Ordinal Regression by Extended Binary Classification
- Creators
- Li, Ling
- Lin, Hsuan-Tien
Abstract
We present a reduction framework from ordinal regression to binary classification based on extended examples. The framework consists of three steps: extracting extended examples from the original examples, learning a binary classifier on the extended examples with any binary classification algorithm, and constructing a ranking rule from the binary classifier. A weighted 0/1 loss of the binary classifier would then bound the mislabeling cost of the ranking rule. Our framework allows not only to design good ordinal regression algorithms based on well-tuned binary classification approaches, but also to derive new generalization bounds for ordinal regression from known bounds for binary classification. In addition, our framework unifies many existing ordinal regression algorithms, such as perceptron ranking and support vector ordinal regression. When compared empirically on benchmark data sets, some of our newly designed algorithms enjoy advantages in terms of both training speed and generalization performance over existing algorithms, which demonstrates the usefulness of our framework.
Additional Information
We wish to thank Yaser S. Abu-Mostafa, Amrit Pratap, John Langford, and the anonymous reviewers for valuable discussions and comments. Ling Li was supported by the Caltech SISL Graduate Fellowship, and Hsuan-Tien Lin was supported by the Caltech EAS Division Fellowship.Attached Files
Published - 3125-ordinal-regression-by-extended-binary-classification.pdf
Files
Name | Size | Download all |
---|---|---|
md5:b7f3813a6fb8ba0a6772ab4fd35ceba5
|
172.4 kB | Preview Download |
Additional details
- Eprint ID
- 65362
- Resolver ID
- CaltechAUTHORS:20160315-111243621
- Caltech SISL Graduate Fellowship
- Caltech EAS Division Fellowship
- Caltech Social and Information Sciences Laboratory
- Created
-
2016-03-30Created from EPrint's datestamp field
- Updated
-
2019-10-03Created from EPrint's last_modified field
- Series Name
- Advances in Neural Information Processing Systems
- Series Volume or Issue Number
- 19