How do I run the humaneval test set using starcoder? Has anyone tried it?

#97
by LiuWhite - opened

How do I run the humaneval test set using starcoder? Has anyone tried it?

BigCode org

@LiuWhite You may check out the repo https://github.com/bigcode-project/bigcode-evaluation-harness to find more details about evaluating starcoder on humaneval.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment