Search results

🤗 [REQUEST] - Kimi K2 (and Kimi-Dev)

model eval

Status: Open.

#279 In evalplus/evalplus;

· BradKML opened on Jul 16, 2025

[Improvement] HumanEval/111 canonical solution - ValueError on space-only input

Status: Open.

#278 In evalplus/evalplus;

· take0x opened on Jul 11, 2025

screenspot-v2 is still maintained?

Status: Open.

#277 In evalplus/evalplus;

· jackfsuia opened on Jul 10, 2025

🐛 [TestRemoval] - HumanEval/0 , Asseration Oracle is Wrong

bugSomething isn't workingSomething isn't working

Status: Open.

#274 In evalplus/evalplus;

· Marvinmw opened on Jun 6, 2025

🐛 [TestRemoval] - <HumanEval/8> <Incorrect input type for plus_input[446] and plus_input[595]>

bugSomething isn't workingSomething isn't working

Status: Open.

#272 In evalplus/evalplus;

· mantine226 opened on May 27, 2025

🐛 [TestRemoval] - <HumanEval/132> 题意理解有误 The meaning of the question is wrong.

bugSomething isn't workingSomething isn't working

Status: Open.

#264 In evalplus/evalplus;

· Lorien1128 opened on Mar 4, 2025

🤗 [REQUEST] - DeepSeek R1 (and their Distills)

model eval

Status: Open.

#263 In evalplus/evalplus;

· BradKML opened on Feb 5, 2025

🤗 [REQUEST] Evaluate NovaSky-AI / Sky-T1-32B-Preview

model eval

Status: Open.

#261 In evalplus/evalplus;

· BLACKGAMER1221 opened on Jan 14, 2025

Release 0.3.2

Status: Open.

#257 In evalplus/evalplus;

· Qubitium opened on Dec 20, 2024

🐛 [TestRemoval] - HumanEval/32 - Issues in HuggingFace Version

bugSomething isn't workingSomething isn't working

Status: Open.

#253 In evalplus/evalplus;

· jiangwangyi opened on Dec 4, 2024

🤗 [REQUEST] - Llama3.2 collection

model eval

Status: Open.

#251 In evalplus/evalplus;

· VoiceBeer opened on Nov 26, 2024

Evalperf giving issue for generated code

Status: Open.

#250 In evalplus/evalplus;

· Shlok-crypto opened on Nov 21, 2024