ejschwartz commited on
Commit
2b3768e
·
1 Parent(s): 2ab342b
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -38,6 +38,15 @@ We do not get the same results for sub_40FD86. In fact, we don't create the sam
38
 
39
  It's unclear why a1, a2, and result are not listed.
40
 
 
 
 
 
 
 
 
 
 
41
  ## Todo
42
 
43
  * Add field decoding (probably needs Docker)
 
38
 
39
  It's unclear why a1, a2, and result are not listed.
40
 
41
+ ### `first_token` weirdness
42
+
43
+ The [example
44
+ inference](https://github.com/lt-asset/resym/blob/main/training_src/fielddecoder_inf.py)
45
+ scripts get the first token of the output and include it in the prompt.
46
+ Technically this is data leakage, but since the first token is usually part of
47
+ the prompt (a variable name or field expression) it's probably OK? But it's
48
+ also pretty weird.
49
+
50
  ## Todo
51
 
52
  * Add field decoding (probably needs Docker)