随着 AI 从“会聊天”向“会做事”持续演进,多模态大模型的重要性进一步凸显。当模型能够融合图像、文本、语音、视频等多源信息进行理解,并结合推理、规划与工具调用等完成复杂任务时,AI 的能力边界从信息理解不断拓展至任务执行与自主协作。作为连接感知、推理与行动的重要基础,多模态智能正加速向更高阶的能力形态演进,成为推动 AI 能力跃迁和应用落地的重要力量。
司南持续关注大模型的发展动态,基于闭源评测基准,近期针对国内外主流多模态模型进行了全面评测,现公布司南多模态模型 5 月评测榜单。
需要提示的是:由于榜单规则,为提升闭源评测集榜单的时效性与先进性,我们对部分旧模型进行了移除,并测试了他们的最新版本。
综合榜单解读
整体性能排名

本次评测中,Qwen3.7-Plus 以 72.96 分位列综合榜首,Gemini-3.1-Pro-Preview 以 72.58 分紧随其后,Qwen3.5-397B-A17B 以 72.26 分位列第三,并成为本期排名最高的开源模型。GPT-5.5(high)与 Kimi-K2.6 分别以 71.14 分和 70.60 分位列第四、第五。
头部模型竞争十分胶着。前三名均超过 72 分,榜首与第三名之间仅相差 0.70 分;前五名均突破 70 分,整体实力接近,说明头部模型之间的竞争已经从单一能力领先,转向多维度能力的综合均衡。
国产模型在本期榜单中表现亮眼。前七名中,Qwen3.7-Plus、Qwen3.5-397B-A17B、Kimi-K2.6、Doubao-Seed-2.0-Pro(high)、SenseNova-6-7-Flash-Alpha 均来自国内厂商,且覆盖闭源 API、开源 MoE、强推理与强创作等不同技术路线。

在纳入智能体维度后,Qwen3.7-Plus 以 80.51 分位列第一,GPT-5.5(high)以 79.59 分位列第二,Qwen3.5-397B-A17B 以 77.92 分位列第三,Gemini-3.1-Pro-Preview 以 77.14 分位列第四。
深层洞察
注:以下的洞察基于不含智能体维度的整体性能榜单
头部模型竞争胶着,能力均衡性成制胜关键
本期头部模型的综合得分高度接近。Qwen3.7-Plus、Gemini-3.1-Pro-Preview 与 Qwen3.5-397B-A17B 三者之间分差不足 1 分,头部竞争已难以通过单一优势能力拉开明显差距。
在这样的竞争格局中,决定模型最终排名的关键因素已从“优势能力有多强”转向“能力结构是否均衡”。通用感知、信息图形理解、多模态推理等能力维度需要同时保持高水准,才能稳定跻身第一梯队;若在基础感知或结构化理解等维度存在明显短板,即使在创作生成或智能体单项能力上表现突出,也难以取得相当的综合排名。
开源模型持续逼近闭源前沿模型
Qwen3.5-397B-A17B 以 72.26 分位列综合第三,成为本期最强开源模型。它在通用感知维度以 73.0 分位列第一,在信息图形感知维度以 80.0 分位列第二,在多模态推理维度也达到 82.5 分,展现出非常均衡的综合能力。
Kimi-K2.6 以 70.60 分位列第五,并在信息图形感知和多模态创作两个维度保持前列。Step-3.7-Flash(high)、Gemma-4-31B-it、Ovis2.6-80B-A3B、Mistral-Medium-3.5-128B 等开源模型也在部分维度上展现出竞争力。
这表明开源多模态模型已经不再只是追赶者,而是在通用感知、结构化图文理解、多模态推理等核心能力上持续逼近闭源前沿模型。
多模态推理成为拉开综合能力的关键维度
本期多模态推理维度的头部模型表现非常突出。SenseNova-6-7-Flash-Alpha 以 86.9 分位列第一,GPT-5.5(high)以 86.2 分位列第二,Qwen3.7-Plus、Gemini-3.1-Pro-Preview、Qwen3.5-397B-A17B 也都超过 82 分。
由于多模态推理能力对复杂任务尤为关键,本榜单在计算综合得分时将多模态推理维度权重设置为 2,其他维度权重为 1。因此,推理维度不仅反映模型处理数学、科学、逻辑类任务的能力,也会显著影响模型在综合榜单中的位置。
同时,推理能力与其他能力之间并不总是完全同步提升。一些模型在多模态推理中表现很强,但在感知或创作维度存在短板;另一些模型则在创作和工具调用上有优势,但推理能力不足会限制其综合排名。这种差异说明,多模态模型的发展正在从“单项突破”走向“体系化补齐短板”。
榜单规则说明
本榜单基于闭源测试数据,对不同多模态模型在 通用感知、空间感知、信息图形理解、多模态推理、多模态创作、智能体六大能力维度上的表现进行了评测,并基于加权分数计算模型的平均得分进行排序。闭源评测基准拥有较为丰富的题目类型,包含单选、多选、填空、开放性创作等,且为中英文双语,可以同时考验模型的多语言理解能力。
加权规则:多模态推理权重为 2,其他维度权重为 1

子维度能力解读
通用感知

通用感知维度中,Qwen3.5-397B-A17B 以 73.0 分位列第一,Qwen3.7-Plus、Gemini-3.1-Pro-Preview、Doubao-Seed-2.0-Pro(high)均以 71.0 分紧随其后。
通用感知测试关注模型对自然场景中实体、人物、物体、事件和复杂视觉内容的识别与理解,是多模态模型“读懂视觉世界”的基础能力。本期榜单中,前四名集中在 71-73 分区间,说明头部模型在基础感知上已经形成比较稳定的第一梯队。与此同时,开源模型在该维度取得榜首,也反映出开源模型在视觉表征与图文对齐能力上的持续提升。
需要注意的是,由于闭源模型和开源模型的安全限制,部分涉及人物识别、特殊场景的问题,API 或者模型会拒绝回答,导致部分模型出现较高的推理失败率。
空间感知

空间感知维度中,GPT-5.5(high)以 54.0 分位列第一,SenseNova-6-7-Flash-Alpha 以 53.5 分位列第二,Gemini-3.1-Pro-Preview 与 Qwen3.5-397B-A17B 以 52.5 分并列第三,Qwen3.7-Plus 以 52.0 分位列第五。
空间感知能力衡量模型对二维平面空间、三维结构、视角变化、物体位置关系和空间变换的理解。相比信息图形和推理等维度,空间感知的整体得分仍偏低,说明空间关系建模仍是多模态模型的一项难点。尤其是在折纸、积木、三维视角转换、几何结构变化等题型中,模型不仅要识别图像内容,还要在脑内完成空间变换,这对视觉编码和符号推理都提出了更高要求。
信息图形感知

信息图形感知维度中,Qwen3.7-Plus 以 82.0 分位列第一,Qwen3.5-397B-A17B 以 80.0 分位列第二,Gemini-3.1-Pro-Preview 与 Kimi-K2.6 均以 78.0 分位列第三,Doubao-Seed-2.0-Pro(high)以 75.0 分位列第五。
该维度考察模型对图表、票据、技术图示、文档页面和结构化视觉内容的理解能力,是报告分析、商业文档处理、表格问答和知识提取等场景中的核心能力。头部模型在该维度表现突出,说明它们在视觉文字识别、布局解析、跨区域信息聚合和数值理解方面具备较强能力。
需要注意的是,信息图形场景也是本期推理失败相对集中的维度之一。部分样本包含多图或大尺寸图像,容易触发模型服务的图片数量限制,或是触发开源模型的上下文长度限制;如果模型不得不压缩输入,也可能损失细节信息,进而影响回答质量。
多模态推理

多模态推理维度中,SenseNova-6-7-Flash-Alpha 以 86.9 分位列第一,GPT-5.5(high)以 86.2 分位列第二,Qwen3.7-Plus 以 84.4 分位列第三,Gemini-3.1-Pro-Preview 与 Qwen3.5-397B-A17B 分别以 83.8 分和 82.5 分位列第四、第五。
多模态推理要求模型在理解视觉内容的基础上完成数学、科学、逻辑、图形推理、规则推断等复杂任务,是最能体现模型“深度思考”能力的维度之一。本期头部模型在该维度的分数显著高于其他维度,说明强推理训练、长链路思考能力和视觉信息抽象能力正在快速提升。
但从中后段模型表现看,多模态推理仍然存在明显梯度。对于当前模型而言,难点已经不只是看懂图片,而是能否把视觉信息稳定转化为可推理的中间表示,并在多步逻辑中避免错误累积。
多模态创作

多模态创作维度中,GPT-5.5(high)以 73.4 分位列第一,Kimi-K2.6 以 69.8 分位列第二,Gemini-3.1-Pro-Preview 以 66.5 分位列第三,Claude-Opus-4.8(high)与 Qwen3.7-Plus 分别以 65.2 分和 64.0 分位列第四、第五。
该维度考察模型根据图像和复杂指令生成高质量文本的能力,包括文案撰写、材料整理、角色化表达、结构化改写、方案设计等任务。与感知和推理维度相比,创作能力更依赖语言组织、任务理解、风格控制和细节覆盖能力。本期结果显示,创作能力与综合能力之间并不完全一致,一些综合排名靠前的模型在创作维度并未取得绝对领先,而部分语言生成能力强的模型则在该维度表现突出。
智能体

智能体维度中,GPT-5.5(high)以 50.7 分位列第一,Claude-Opus-4.8(high)以 46.0 分位列第二,Qwen3.7-Plus 以 45.3 分位列第三,MiniMax-M3 与 Doubao-Seed-2.0-Pro(high)分别以 40.0 分和 39.3 分位列第四、第五。
智能体能力考察模型在工具调用、信息检索、任务规划和多步骤执行中的稳定性。与传统视觉理解任务相比,智能体任务的链路更长,任何一步检索、判断或调用失败都可能影响最终结果。因此,当前智能体得分整体低于其他维度,也说明多模态模型距离稳定完成真实复杂任务仍有提升空间。
评测题目示例
通用感知
问题:
How many ice cube slots are there?

答案:
12
空间感知
问题:
The original paper is a 4×4 grid paper. The images in the top row show the results of 2 consecutive folding operations on the grid paper. Folding operations include folding along horizontal, vertical, or 45-degree direction. The rightmost image in the top row shows the result after punching holes in the folded paper. Which image represents the appearance of the paper after unfolding the punched paper? Black solid circles represent grid cells with holes. Please answer from options A, B, C, or D.

答案:
A
信息图形感知
问题:
Based on the infographic, where each dot and star represents one song, which songwriter or songwriting partnership contributed the highest number of songs to the "Magical Mystery Tour" album?

答案:
McCartney
多模态推理
问题:
The grid is divided into multiple aquariums (regions). Your task is to determine which cells are filled with water based on the following rules:
1. Each region must be filled to a uniform water level (from bottom up).
2. Water cannot float — if a cell is filled, the cell directly below it (if any, in same region) must also be filled.
3. The numbers outside the grid indicate how many cells are filled with water in each row and column.
4. Regions are separated by thick black lines in the grid. Cells within the same region must follow the same water level rule.
Please list all the cells that are filled with water in the format:
[(x1, y1), (x2, y2), ...]

答案:
[(4, 0), (5, 0), (6, 0), (1, 1), (2, 1), (3, 1), (4, 1), (5, 1), (6, 1), (1, 2), (2, 2), (4, 2), (5, 2), (6, 2), (2, 3), (4, 3), (5, 3), (6, 3), (0, 4), (1, 4), (2, 4), (3, 4), (5, 4), (0, 5), (1, 5), (2, 5), (3, 5), (5, 5), (0, 6), (1, 6), (2, 6), (3, 6), (4, 6), (5, 6)]
多模态创作
问题: Assume you are an interior space designer, good at finding existing housing problems according to the actual situation of users, and giving relevant opinions.
This picture is the floor plan of the house you have to design. This home is about to welcome a family of three with one child. Please follow the requirements below to analyze the floor plan of the house.
1. Combine the characteristics of the occupants and your expertise to list the advantages and disadvantages of the house.
2. Provide suggestions for improving the house's shortcomings along with a preliminary renovation plan.

GPT-4o 参考回答
### Analysis of the Floor Plan
#### **Advantages:**
1. **Spacious Living Room:**
- The living room is large and centrally located, making it ideal for family gatherings and activities.
- The open layout allows for flexible furniture arrangements.
2. **Separate Bedrooms:**
- The house has two bedrooms, providing privacy for the parents and the child.
- The master bedroom is spacious and well-lit.
3. **Multiple Bathrooms:**
- Two bathrooms are available, which is convenient for a family of three, especially during busy mornings.
4. **Dedicated Dining Area:**
- The dining area is separate from the living room, creating a more organized space for meals.
5. **Balcony/Outdoor Space:**
- The balcony provides an outdoor area for relaxation or small gardening activities.
6. **Natural Light:**
- The layout allows for good natural light in most rooms, especially the living room and bedrooms.
---
#### **Disadvantages:**
1. **Narrow Kitchen:**
- The kitchen is small and lacks sufficient counter space, which may be inconvenient for a family that cooks frequently.
2. **Limited Storage:**
- There is limited built-in storage space, which may be insufficient for a growing family.
3. **Child’s Room Layout:**
- The child’s room is narrow and may not accommodate a bed, study desk, and storage comfortably.
4. **Bathroom Placement:**
- The bathrooms are located far from the living room, which may be inconvenient for guests.
5. **Unused Corners:**
- Some corners in the living room and bedrooms are underutilized, reducing the efficiency of the space.
---
### Suggestions for Improvement and Renovation Plan
#### **1. Kitchen Expansion:**
- **Solution:** Combine the kitchen with the adjacent dining area to create an open-concept kitchen-dining space.
- **Benefits:** This will provide more counter space, better flow, and a modern look.
#### **2. Optimize Storage:**
- **Solution:** Install built-in wardrobes in the bedrooms and add storage cabinets in the living room and hallway.
- **Benefits:** This will maximize storage without taking up additional floor space.
#### **3. Child’s Room Redesign:**
- **Solution:** Use multifunctional furniture, such as a loft bed with a study desk underneath, to save space.
- **Benefits:** This will make the room more functional and comfortable for the child.
#### **4. Living Room Layout:**
- **Solution:** Rearrange the furniture to create distinct zones for relaxation, entertainment, and play.
- **Benefits:** This will make the space more organized and family-friendly.
#### **5. Bathroom Accessibility:**
- **Solution:** If possible, add a small powder room near the living room for guest use.
- **Benefits:** This will improve convenience and privacy.
#### **6. Utilize Balcony:**
- **Solution:** Convert the balcony into a small play area or a cozy seating space with weatherproof furniture.
- **Benefits:** This will add functional outdoor space for the family.
#### **7. Lighting and Decor:**
- **Solution:** Add layered lighting (ambient, task, and accent) in all rooms and use light-colored decor to enhance the sense of space.
- **Benefits:** This will make the house feel brighter and more welcoming.
---
### Preliminary Renovation Plan
1. **Kitchen-Dining Area:**
- Remove the wall between the kitchen and dining area.
- Install additional cabinets and a kitchen island for more storage and workspace.
2. **Child’s Room:**
- Install a loft bed with a study desk and storage underneath.
- Use bright, cheerful colors and child-friendly decor.
3. **Living Room:**
- Add a modular sofa and a play corner for the child.
- Use rugs and partitions to define zones.
4. **Storage Solutions:**
- Install floor-to-ceiling wardrobes in bedrooms.
- Add a storage bench in the hallway.
5. **Bathrooms:**
- Upgrade fixtures for better functionality.
- Add a small powder room near the living room if space permits.
6. **Balcony:**
- Add weatherproof flooring and furniture.
- Include potted plants for a refreshing ambiance.
By implementing these changes, the house will become more functional, comfortable, and suitable for a family of three.
智能体
问题:
Identify the thesis title published from 2010 to 2020 that explores a sustainable coolant used in machining an alloy with an annealing temperature above 300ºC but below 800ºC, and a modulus of elasticity greater than 10,000 ksi yet under 18,000 ksi; the thesis was conducted at a university whose student population surged in the 1850s, and its author earned a B.Sc between 2005 and 2013.
答案:
Cryogenic machining of Ti-6Al-4V
工具:
网络搜索、网页访问
了解更多
多模态模型闭源评测榜单已同步上线至司南官网,欢迎大家访问查看更详细的评测数据!
https://rank.opencompass.org.cn/
同时,司南评测过程中所用到的工具链均在 GitHub 开源,诚挚邀请您在学术研究或产品研发过程中使用~

744

被折叠的 条评论
为什么被折叠?



