Other
zouharvi commited on
Commit
2a5e7d6
·
verified ·
1 Parent(s): 2ea7987

update example in README

Browse files
Files changed (1) hide show
  1. README.md +10 -3
README.md CHANGED
@@ -38,7 +38,6 @@ wget https://huggingface.co/zouharvi/PWESuite-metric_learner/resolve/main/rnn_me
38
 
39
  Then, in Python, you can run [this example script](https://github.com/zouharvi/pwesuite/blob/master/scripts/50-use_metric_learner.py):
40
  ```python
41
-
42
  from models.metric_learning.model import RNNMetricLearner
43
  from models.metric_learning.preprocessor import preprocess_dataset_foreign
44
  from main.utils import load_multi_data
@@ -47,13 +46,21 @@ import tqdm
47
  import math
48
 
49
  data = load_multi_data(purpose_key="all")
50
- data = preprocess_dataset_foreign(data[:10], features="token_ipa")
 
 
 
 
 
 
 
 
51
 
52
  model = RNNMetricLearner(
53
  dimension=300,
54
  feature_size=data[0][0].shape[1],
55
  )
56
- model.load_state_dict(torch.load("computed/models/rnn_metric_learning_token_ipa_all.pt"))
57
 
58
  # some cheap paralelization
59
  BATCH_SIZE = 32
 
38
 
39
  Then, in Python, you can run [this example script](https://github.com/zouharvi/pwesuite/blob/master/scripts/50-use_metric_learner.py):
40
  ```python
 
41
  from models.metric_learning.model import RNNMetricLearner
42
  from models.metric_learning.preprocessor import preprocess_dataset_foreign
43
  from main.utils import load_multi_data
 
46
  import math
47
 
48
  data = load_multi_data(purpose_key="all")
49
+ data = preprocess_dataset_foreign(
50
+ [
51
+ {"token_ort": "Hello", "token_ipa": None},
52
+ {"token_ort": "what", "token_ipa": None},
53
+ {"token_ort": "is", "token_ipa": None},
54
+ {"token_ort": "pwesuite", "token_ipa": None},
55
+ ],
56
+ features="token_ort"
57
+ )
58
 
59
  model = RNNMetricLearner(
60
  dimension=300,
61
  feature_size=data[0][0].shape[1],
62
  )
63
+ model.load_state_dict(torch.load("computed/models/rnn_metric_learning_token_ort_all.pt"))
64
 
65
  # some cheap paralelization
66
  BATCH_SIZE = 32