-
Notifications
You must be signed in to change notification settings - Fork 483
Insights: open-compass/opencompass
Overview
Could not load contribution data
Please try again later
1 Release published by 1 person
-
0.4.0
published
Jan 22, 2025
6 Pull requests merged by 3 people
-
[Demo] Internlm3 math500 thinking demo
#1846 merged
Jan 24, 2025 -
[Feature] Support OlympiadBench Benchmark
#1841 merged
Jan 24, 2025 -
[Feature] Support Omni-Math
#1837 merged
Jan 23, 2025 -
[Bump] Bump version to 0.4.0
#1838 merged
Jan 22, 2025 -
[Fix] Update max_out_len logic for OpenAI model
#1839 merged
Jan 21, 2025 -
[Refactor] Code refactoarization
#1831 merged
Jan 20, 2025
1 Pull request opened by 1 person
-
[Feature] Add codeeval_pro & serval models
#1848 opened
Jan 24, 2025
6 Issues closed by 3 people
-
[Feature] 数据集ppl及gen使用场景建议
#1840 closed
Jan 23, 2025 -
[Feature] 请问是否支持用megatron-deepspeed 框架预训练大模型?
#1842 closed
Jan 23, 2025 -
[Bug] Unable to load model offline
#1817 closed
Jan 20, 2025 -
[Bug] lazy module import error
#1821 closed
Jan 20, 2025 -
[Bug] OpenICLEval任务失败--ResourceWarning: unclosed file
#1835 closed
Jan 18, 2025
4 Issues opened by 4 people
-
[Feature] humaneval_postprocess历史无效的单测清理或case更新
#1847 opened
Jan 24, 2025 -
[Bug] 部分数据集中对question进行增广时使用浅拷贝会导致选项与答案错位
#1845 opened
Jan 23, 2025 -
Missing one required positional argument in tools/collect_code_preds.py#L190
#1844 opened
Jan 23, 2025 -
Miss using GPT3 in GPT4.py?
#1836 opened
Jan 20, 2025
6 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
[Bug] 无法使用多卡评测
#1828 commented on
Jan 20, 2025 • 0 new comments -
[Feature] Unsupported Model Type in vLLM/LMDeploy acceleration
#1427 commented on
Jan 20, 2025 • 0 new comments -
[Bug] llama3 8b 基座模型在ARC-C PPL数据集上的评估,accuracy只有41,不正常
#1253 commented on
Jan 20, 2025 • 0 new comments -
请问我想对cmmlu这类选择题的模板进行更改,但是system变量无法赋值
#457 commented on
Jan 22, 2025 • 0 new comments -
[Bug] 使用leval测评时报错,求助
#1825 commented on
Jan 23, 2025 • 0 new comments -
[Feature] Support downloading dataset from OpenMind
#1792 commented on
Jan 20, 2025 • 0 new comments