A metric learning perspective of SVM : on the relation of LMNN and SVM

Do, Huyen ; Kalousis, Alexandros ; Wang, Jun ; Woznica, Adam

In: Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics (AISTATS) April 21-23, 2012 La Palma, Canary Islands, 2012, vol. 22, p. 308-317

Support Vector Machines, SVMs, and the Large Margin Nearest Neighbor algorithm, LMNN, are two very popular learning algorithms with quite different learning biases. In this paper we bring them into a unified view and show that they have a much stronger relation than what is commonly thought. We analyze SVMs from a metric learning perspective and cast them as a metric learning problem, a view... Plus

Ajouter à la liste personnelle
    Summary
    Support Vector Machines, SVMs, and the Large Margin Nearest Neighbor algorithm, LMNN, are two very popular learning algorithms with quite different learning biases. In this paper we bring them into a unified view and show that they have a much stronger relation than what is commonly thought. We analyze SVMs from a metric learning perspective and cast them as a metric learning problem, a view which helps us uncover the relations of the two algorithms. We show that LMNN can be seen as learning a set of local SVM-like models in a quadratic space. Along the way and inspired by the metric-based interpretation of SVMs we derive a novel variant of SVMs,