Spaces:
Sleeping
Sleeping
docs
Browse files
README.md
CHANGED
@@ -1,3 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
# Metric Card for SignWriting Similarity
|
2 |
|
3 |
## Metric Description
|
@@ -10,9 +27,6 @@ The metric is used by passing two SignWriting signs (as sets of symbols) and com
|
|
10 |
|
11 |
* **hypothesis** *(List\[Symbol]):* The output sign, represented as a list of symbols with visual and spatial properties.
|
12 |
* **reference** *(List\[Symbol]):* The gold/reference sign, in the same format.
|
13 |
-
* **alpha** *(float, default=2.0):* Controls exponential scaling of symbol distance normalization.
|
14 |
-
* **beta** *(float, default=2.0):* Controls the penalty for sign length mismatches.
|
15 |
-
* **gamma** *(float, default=1.0):* Controls final exponential scaling of the overall score.
|
16 |
|
17 |
### Output Values
|
18 |
|
|
|
1 |
+
---
|
2 |
+
title: SignWriting Similarity
|
3 |
+
sdk: gradio
|
4 |
+
sdk_version: 5.29.0
|
5 |
+
app_file: app.py
|
6 |
+
pinned: false
|
7 |
+
tags:
|
8 |
+
- evaluate
|
9 |
+
- metric
|
10 |
+
description: >-
|
11 |
+
The Symbol Distance Metric is a novel evaluation metric specifically designed for SignWriting,
|
12 |
+
a visual writing system for signed languages. Unlike traditional string-based metrics (e.g., BLEU, chrF),
|
13 |
+
this metric directly considers the visual and spatial properties of individual symbols used in SignWriting,
|
14 |
+
such as base shape, orientation, rotation, and position. It is primarily used to evaluate model outputs in
|
15 |
+
SignWriting transcription and translation tasks, offering a similarity score between a predicted and a reference sign.
|
16 |
+
---
|
17 |
+
|
18 |
# Metric Card for SignWriting Similarity
|
19 |
|
20 |
## Metric Description
|
|
|
27 |
|
28 |
* **hypothesis** *(List\[Symbol]):* The output sign, represented as a list of symbols with visual and spatial properties.
|
29 |
* **reference** *(List\[Symbol]):* The gold/reference sign, in the same format.
|
|
|
|
|
|
|
30 |
|
31 |
### Output Values
|
32 |
|