Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -3,6 +3,9 @@ library_name: transformers
|
|
| 3 |
tags: []
|
| 4 |
---
|
| 5 |
|
|
|
|
|
|
|
|
|
|
| 6 |
# ESM++
|
| 7 |
[ESM++](https://github.com/Synthyra/ESMplusplus) is a faithful implementation of [ESMC](https://www.evolutionaryscale.ai/blog/esm-cambrian) ([license](https://www.evolutionaryscale.ai/policies/cambrian-open-license-agreement)) that allows for batching and standard Huggingface compatibility without requiring the ESM Python package.
|
| 8 |
The small version corresponds to the 300 million parameter version of ESMC.
|
|
|
|
| 3 |
tags: []
|
| 4 |
---
|
| 5 |
|
| 6 |
+
# NOTE
|
| 7 |
+
There was previously a bug with Huggingface weight tieing that caused the logits of ESM++ to differ from ESMC. That bug is now resolved.
|
| 8 |
+
|
| 9 |
# ESM++
|
| 10 |
[ESM++](https://github.com/Synthyra/ESMplusplus) is a faithful implementation of [ESMC](https://www.evolutionaryscale.ai/blog/esm-cambrian) ([license](https://www.evolutionaryscale.ai/policies/cambrian-open-license-agreement)) that allows for batching and standard Huggingface compatibility without requiring the ESM Python package.
|
| 11 |
The small version corresponds to the 300 million parameter version of ESMC.
|