How do I run the humaneval test set using starcoder? Has anyone tried it?

#97

by LiuWhite - opened Nov 13, 2023

Nov 13, 2023

How do I run the humaneval test set using starcoder? Has anyone tried it?

BigCode org Nov 13, 2023

@LiuWhite You may check out the repo https://github.com/bigcode-project/bigcode-evaluation-harness to find more details about evaluating starcoder on humaneval.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment