# Metric Learning

Differential Training, Similarity Learning

Discusssion

The goal of metric learning is to ensure that, after training, the distance between vectors of the same class remains small, while distance between different classes are large.

References

http://www.cs.toronto.edu/~rsalakhu/papers/oneshot1.pdf Siamese Neural Networks for One-shot Image Recognition

http://yann.lecun.com/exdb/publis/pdf/chopra-05.pdf Learning a Similarity Metric Discriminatively, with Application to Face Verification

The learning process minimizes a discriminative loss function that drives the similarity metric to be small for pairs of faces from the same person, and large for pairs from different persons.

https://arxiv.org/abs/1412.6622 Deep metric learning using Triplet network

http://web.cse.ohio-state.edu/~kulis/pubs/ftml_metric_learning.pdf Metric Learning: A Survey

http://arxiv.org/pdf/1509.05360v1.pdf Geometry-aware Deep Transform

Deep networks are often optimized for a classification objective, where class-labeled samples are input as training ; or a metric learning objective, where training data are input as positive and negative pairs.

In this section, we first propose a novel deep learning objective that unifies the classification and metric learning criteria. We then introduce a geometry-aware deep transform, and optimize it through standard back-propagation.

We denote formulation as Geometry aware Deep Transform (GDT). The GDT objective is a weighted combination of the two formulations. We can understand it as regularizing the metric learning formulation using the classification one.
{"extraction_info": {"found_math": false, "script_math_tex": 0, "script_math_asciimath": 0, "math_annotations": 0, "math_alttext": 0, "mathml": 0, "mathjax_tag": 0, "mathjax_inline_tex": 0, "mathjax_display_tex": 0, "mathjax_asciimath": 0, "img_math": 0, "codecogs_latex": 0, "wp_latex": 0, "mimetex.cgi": 0, "/images/math/codecogs": 0, "mathtex.cgi": 0, "katex": 0, "math-container": 0, "wp-katex-eq": 0, "align": 0, "equation": 0, "x-ck12": 0, "texerror": 0, "math_score": 0.8710253238677979, "perplexity": 1764.2031443008011}, "config": {"markdown_headings": true, "markdown_code": true, "boilerplate_config": {"ratio_threshold": 0.18, "absolute_threshold": 10, "end_threshold": 15, "enable": true}, "remove_buttons": true, "remove_image_figures": true, "remove_link_clusters": true, "table_config": {"min_rows": 2, "min_cols": 3, "format": "plain"}, "remove_chinese": true, "remove_edit_buttons": true, "extract_latex": true}, "warc_path": "s3://commoncrawl/crawl-data/CC-MAIN-2021-39/segments/1631780057615.3/warc/CC-MAIN-20210925082018-20210925112018-00515.warc.gz"}