CMMLU vs Gemini：怎么选？
下面把两款工具的关键信息逐项放在一起对照。 两者同属「AI 聊天」分类，属于直接竞品。
📊 参数逐项对照
| 对比项 | CMMLU | Gemini |
|---|---|---|
| 价格模式 | 免费 | 免费 |
| 来源地区 | 🌍 国外 | 🌍 国外 |
| 所属分类 | AI 聊天 | AI 聊天 |
| 用户评分 | 暂无评分 | 暂无评分 |
| 热度（浏览量） | 103 | 205 |
| 付费说明 | — | — |
| 替代品 | CMMLU 的替代品 → | Gemini 的替代品 → |
📖 详细介绍
CMMLU 是什么？
关于 CMMLU
CMMLU是一个综合性的中文评估基准，专门用于评估语言模型在中文语境下的知识和推理能力。CMMLU涵盖了从基础学科到高级专业水平的67个主题。它包括：需要计算和推理的自然科学，需要知识的人文科学和社会科学,以及需要生活常识的中国驾驶规则等。此外，CMMLU中的许多任务具有中国特定的答案，可能在其他地区或语言中并不普遍适用。因此是一个完全中国化的中文测试基准。
CMMLU数据集采用Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Note：自2023-12-16日起，对于未开放公测的API模型，我们将验证 1.模型是否有基本的指令跟随能力；2.是否存在数据污染，通过验证的模型会被更新在榜单。
Gemini 是什么？
关于 Gemini
“Gemini 3.5 Flash beat Gemini 3 Flash by 19.6% on Box’s enterprise work evaluation set, which we designed to reflect the kinds of real-world, multi-step tasks our customers perform daily with the Box Agent. We’re already seeing stronger performance in workflows that matter to specific industries. Our Life Sciences customers can use Gemini 3.5 Flash to extract data and make calculations with 96.4% greater accuracy, helping them process scientific information more reliably. For Financial Services firms, where exact measurement drives trust, it can build financial reports from structured data with 46.7% greater accuracy.”
“By bringing Gemini 3 Pro to GitHub Copilot, we’re seeing promising gains in how quickly and confidently developers can move from idea to code. In our early testing in VS Code, Gemini 3 Pro demonstrated 35% higher accuracy in resolving software engineering challenges than Gemini 2.5 Pro. That's the kind of potential that translates to developers solving real-world problems with more speed and effectiveness.”
“Gemini's newest flash model advances the frontier for intelligence per dollar. It performs 42% better than Flash 3 on our long range, multi-turn cyber benchmark while achieving a 68% improvement in token efficiency. This makes it an excellent choice for defenders seeking to scale horizontally. We are excited to continue collaborating with the Gemini team to help give Armadin customers the edge.”