Pai 的 AI 雷达

模型与评测

今天:An updated Model,Granite Switch 4.1.1。并行还有 AOS-Bench、Agent or Human?、We're releasing the。

日期
2026/10/30
今日条目
96
当前类目
31
#01

An updated Model Spec for more capable and beneficial AI

OpenAI’s updated Model Spec outlines five core values to guide more capable AI toward sound judgment, human agency, and faithfulness to human intent.

推荐理由它通过确立五项核心价值观,用来引导能力更强的人工智能树立健全合理的判断力,维护并保障人类自主权,同时始终忠实契合人类的真实意图,促使更具能力的AI系统安全运作并更具建设性与益处。
模型与评测OpenAI News
#03

AOS-Bench: Can LLM Agents Manage Dynamic Workloads?

arXiv:2610.33178v2 Announce Type: replace Abstract: Coding agents are moving from handling one request at a time to serving as persistent assistants to which users hand a stream of work: a build, a data-processing job and a bug fix may all be pending on the same machine at once.

推荐理由它能用来评测代码智能体在作为持久助手时,能否应对同一台机器上并发交织的动态负载,检验其是否具备同时协调与推进构建、数据处理以及缺陷修复等持续流入的多项工作的综合管理能力。
模型与评测arXiv cs.AI 官方
#04

Agent or Human? Detecting Commits by AI Coding Agents in the Absence of Authorship Signatures

arXiv:2610.36229v1 Announce Type: cross Abstract: AI coding agents such as Claude Code, GitHub Copilot coding agent, and Cursor now commit directly to open-source repositories. Empirical studies of these agents identify their commits through authorship signatures, such as bot acc

推荐理由该项成果可用于在开源代码仓库缺少机器人账号等签名标识的情况下,准确检测并识别出由 Claude Code、Cursor 等 AI 编程助手提交的代码,从而帮助开发者及平台进行代码溯源并评估人工智能在软件开发中的实际渗透率。
模型与评测arXiv cs.AI 官方
#08

Agentic Algorithm Design: LLMs that Propose, Formalise, and Prove Runtime Bounds for Evolutionary Algorithms in Lean

arXiv:2610.35595v2 Announce Type: replace Abstract: LLMs now prove hard theorems in Lean. Can they also design algorithms and prove their correctness and efficiency? LLM-guided design of optimisation heuristics (such as AlphaEvolve) is purely empirical. Automated theorem provers

推荐理由Agentic Algorithm Design: LLMs that:arXiv:2610.35595v2 Announce Type: replace Abstract: LLMs now prove hard theorems in Lean。
模型与评测arXiv cs.AI 官方
#09

BUSTA: Teaching Small Language Models to Reason About Binary Execution

arXiv:2610.36288v1 Announce Type: cross Abstract: Large Language Models (LLM) are increasingly applied to Reverse Engineering (RE) workflows. RE, however, differs from common LLM coding tasks as it requires models to reason about low-level program behavior. Furthermore, the deplo

推荐理由BUSTA: Teaching Small Language Models:arXiv:2610.36288v1 Announce Type: cross Abstract: Large Language Models (LLM) are。
模型与评测arXiv cs.AI 官方
#10

Benchmarking LLM Agents for Behaviorally Adequate Test Generation from Software Requirements

arXiv:2610.36584v1 Announce Type: cross Abstract: As large language model agents increasingly compile natural-language requirements into repository-level code, requirement-to-test generation grows in importance to provide validation constraints (or harness) to guide code generati

推荐理由Benchmarking LLM Agents:arXiv:2610.36584v1 Announce Type: cross Abstract: As large language model agents。
模型与评测arXiv cs.AI 官方
#11

CIVER: Causal Intervention Verification for Reliable Code Review

arXiv:2610.36010v1 Announce Type: cross Abstract: Code review is essential for maintaining software repositories by identifying defects, improving code quality, and supporting reliable software evolution. With the growing adoption of LLM-based coding agents, an increasing number

推荐理由CIVER: Causal Intervention Verification:arXiv:2610.36010v1 Announce Type: cross Abstract: Code review is essential。
模型与评测arXiv cs.AI 官方
#12

Context Is a Pipeline, Not a Window: Information Attrition in LLM Agent Harnesses

arXiv:2610.36114v1 Announce Type: cross Abstract: LLM agents are judged by two numbers: the size of the context window, and how often the final answer is correct. Both numbers miss a third thing: how much of a tool's output is lost before the model ever sees it. We measured this

推荐理由Context Is a Pipeline, Not a Window:arXiv:2610.36114v1 Announce Type: cross Abstract: LLM agents are judged by two numbers。
模型与评测arXiv cs.AI 官方
#13

God Does Not Play Dice: Enforcing Batch Invariance in Agentic Kernel Generation

arXiv:2610.36623v1 Announce Type: new Abstract: Large language model (LLM) serving systems dynamically batch user requests for GPU execution, so the same request may be processed alongside different requests across runs. If the GPU kernels lack batch invariance (BI), this changin

推荐理由God Does Not Play Dice: Enforcing Batch:arXiv:2610.36623v1 Announce Type: new Abstract: Large language model (LLM) serving。
模型与评测arXiv cs.AI 官方
#14

Grounding LLM Agents in Business Processes: Process-Aware Knowledge Graphs for Reliable Multi-Step Service Invocation

arXiv:2610.37242v1 Announce Type: new Abstract: Large language model (LLM) agents that call enterprise APIs must select the correct endpoints, follow process order, use valid payload keys, and choose coded values from predefined lists. However, current retrieval-augmented service

推荐理由Grounding LLM Agents in Business:arXiv:2610.37242v1 Announce Type: new Abstract: Large language model (LLM) agents that。
模型与评测arXiv cs.AI 官方
#15

Log-To-Leak: Prompt Injection Attacks on Tool-Using LLM Agents via the Model Context Protocol

arXiv:2610.36108v1 Announce Type: cross Abstract: LLM agents increasingly access external tools through the Model Context Protocol (MCP), but the natural-language metadata used to describe those tools creates a prompt-injection surface. Within this established tool-poisoning surf

推荐理由Log-To-Leak: Prompt Injection Attacks:arXiv:2610.36108v1 Announce Type: cross Abstract: LLM agents increasingly access。
模型与评测arXiv cs.AI 官方
#16

MARQ: A Modular, LLM-Agnostic Requirement Quality Assessor Infused with Systems Engineering Knowledge

arXiv:2610.36234v1 Announce Type: new Abstract: Requirements engineering (RE) is foundational to systems engineering (SE), as requirement defects can propagate downstream and adversely affect development outcomes. Although large language models (LLMs) are promising for requiremen

推荐理由MARQ: A Modular, LLM-Agnostic:arXiv:2610.36234v1 Announce Type: new Abstract: Requirements engineering (RE) is。
模型与评测arXiv cs.AI 官方
#17

MedConstBench: Benchmarking How Constitutions Steer LLMs in Medical Ethics

arXiv:2610.36513v1 Announce Type: new Abstract: As large language models advance rapidly, they are increasingly used to answer medical questions, and many such models are now deployed locally. Once a model is deployed, its behavior is governed mainly by the ethical policy written

推荐理由MedConstBench: Benchmarking How:arXiv:2610.36513v1 Announce Type: new Abstract: As large language models advance。
模型与评测arXiv cs.AI 官方
#18

OA-RAG: Ontology-based Agentic RAG for Faithful LLM Reasoning

arXiv:2610.36335v1 Announce Type: new Abstract: Large language models (LLMs) perform well across many real-world tasks but remain prone to hallucination, limiting their reliability in domains such as biomedicine and healthcare, where answers must be grounded in established knowle

推荐理由OA-RAG: Ontology-based Agentic RAG:arXiv:2610.36335v1 Announce Type: new Abstract: Large language models (LLMs) perform。
模型与评测生信医疗arXiv cs.AI 官方
#19

PolicyMediator: Multi-Regional Policy Learning through Mediation Agents with Evolving Skills in OPC Ecosystems

arXiv:2610.35997v1 Announce Type: cross Abstract: One-person companies (OPCs) are emerging enterprises operated by individual entrepreneurs through digital platforms and LLM-based AI agents. These highly skilled entrepreneurs are characterized by being digital nomads, with limite

推荐理由PolicyMediator: Multi-Regional Policy:arXiv:2610.35997v1 Announce Type: cross Abstract: One-person companies (OPCs) are。
模型与评测arXiv cs.AI 官方
#20

Prospector: learning a compact graph traversal policy for scientific reasoning

arXiv:2610.37121v1 Announce Type: new Abstract: Scientific reasoning in specialized engineering fields depends on knowledge scattered across the literature, often proprietary and absent from frontier LLM training data. In such domains, frontier models tend to give generic answers

推荐理由Prospector: learning a compact graph:arXiv:2610.37121v1 Announce Type: new Abstract: Scientific reasoning in specialized。
模型与评测arXiv cs.AI 官方
#21

Skill Dreaming: Evolving Repository Skills through Pull Request Streams

arXiv:2610.36188v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly rely on reusable skills for complex software engineering tasks, making skill libraries essential for repository development and maintenance. However, repository-specific skills must evo

推荐理由Skill Dreaming: Evolving Repository:arXiv:2610.36188v1 Announce Type: new Abstract: Large language model (LLM) agents。
模型与评测arXiv cs.AI 官方
#22

UnityBench-Mini3D: Evaluating LLM Agents for 3D Game Development in Unity

arXiv:2610.35980v1 Announce Type: cross Abstract: Game development stresses coding agents in ways general software engineering does not: correctness depends on how engine APIs, serialized scene state, and runtime behavior interact, not on source code alone. Existing benchmarks ma

推荐理由UnityBench-Mini3D: Evaluating LLM:arXiv:2610.35980v1 Announce Type: cross Abstract: Game development stresses coding。
模型与评测arXiv cs.AI 官方
#23

When Rubrics Fail: Hallucinations Reveal Blind Spots in Medical AI Evaluation

arXiv:2609.12718v2 Announce Type: replace Abstract: Hallucinations can undermine clinician trust in LLMs, making it important that evaluation methods capture clinically relevant errors. Rubric-based evaluation has become the leading approach for assessing LLMs in medicine, but it

推荐理由When Rubrics Fail: Hallucinations:arXiv:2609.12718v2 Announce Type: replace Abstract: Hallucinations can undermine。
模型与评测生信医疗arXiv cs.AI 官方
#24

When the Critic Falls Behind: Co-Evolving Rubrics and Harnesses for Continual Agent Self-Improvement

arXiv:2610.36826v1 Announce Type: new Abstract: Autonomous agents increasingly depend on harnesses that govern interaction, memory, tools, and execution around large language models (LLMs). While recent work has begun to evolve these harnesses from execution experience, the super

推荐理由When the Critic Falls Behind:arXiv:2610.36826v1 Announce Type: new Abstract: Autonomous agents increasingly depend。
模型与评测arXiv cs.AI 官方