Spaces:
Sleeping
Sleeping
docs
Browse files
README.md
CHANGED
|
@@ -1,3 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# Metric Card for SignWriting Similarity
|
| 2 |
|
| 3 |
## Metric Description
|
|
@@ -10,9 +27,6 @@ The metric is used by passing two SignWriting signs (as sets of symbols) and com
|
|
| 10 |
|
| 11 |
* **hypothesis** *(List\[Symbol]):* The output sign, represented as a list of symbols with visual and spatial properties.
|
| 12 |
* **reference** *(List\[Symbol]):* The gold/reference sign, in the same format.
|
| 13 |
-
* **alpha** *(float, default=2.0):* Controls exponential scaling of symbol distance normalization.
|
| 14 |
-
* **beta** *(float, default=2.0):* Controls the penalty for sign length mismatches.
|
| 15 |
-
* **gamma** *(float, default=1.0):* Controls final exponential scaling of the overall score.
|
| 16 |
|
| 17 |
### Output Values
|
| 18 |
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: SignWriting Similarity
|
| 3 |
+
sdk: gradio
|
| 4 |
+
sdk_version: 5.29.0
|
| 5 |
+
app_file: app.py
|
| 6 |
+
pinned: false
|
| 7 |
+
tags:
|
| 8 |
+
- evaluate
|
| 9 |
+
- metric
|
| 10 |
+
description: >-
|
| 11 |
+
The Symbol Distance Metric is a novel evaluation metric specifically designed for SignWriting,
|
| 12 |
+
a visual writing system for signed languages. Unlike traditional string-based metrics (e.g., BLEU, chrF),
|
| 13 |
+
this metric directly considers the visual and spatial properties of individual symbols used in SignWriting,
|
| 14 |
+
such as base shape, orientation, rotation, and position. It is primarily used to evaluate model outputs in
|
| 15 |
+
SignWriting transcription and translation tasks, offering a similarity score between a predicted and a reference sign.
|
| 16 |
+
---
|
| 17 |
+
|
| 18 |
# Metric Card for SignWriting Similarity
|
| 19 |
|
| 20 |
## Metric Description
|
|
|
|
| 27 |
|
| 28 |
* **hypothesis** *(List\[Symbol]):* The output sign, represented as a list of symbols with visual and spatial properties.
|
| 29 |
* **reference** *(List\[Symbol]):* The gold/reference sign, in the same format.
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
### Output Values
|
| 32 |
|