Agents' Last Exam Benchmark Targets Long-Horizon Economic Workflows
The Agents' Last Exam (ALE) is a new benchmark designed to address the disconnect between high AI benchmark scores and limited real-world economic deployment. Unlike existing metrics that evaluate short, isolated tasks, ALE focuses on long-horizon, professional-grade workflows that reflect economically valuable activities. The authors argue that current evaluation methods fail to capture the sustained performance required for many professional domains, and ALE provides a more rigorous framework for measuring an agent's ability to operate over extended periods within complex, real-world environments.
Zero-Knowledge Proofs Proposed for Verifiable Frontier AI Training
A new research paper introduces the possibility of using zero-knowledge verification for frontier AI training, a breakthrough that could transform global AI governance. Currently, AI regulations based on compute thresholds rely almost entirely on self-reporting by labs. By applying cryptographic primitives, researchers demonstrate that it is possible to verify the amount of compute used to train a model without compromising proprietary information such as the model weights, dataset contents, or specific architecture. This technical primitive could serve as a foundational tool for international agreements, allowing regulators to 'trust but verify' the scale of training runs while maintaining institutional privacy.
SAGE-PTQ Framework Optimizes Ultra-Low-Bit Quantization for LLMs
SAGE-PTQ (Saliency-Aware Graph-guided Efficient PTQ) has been introduced to address the efficiency bottlenecks in post-training quantization for large language models. While ultra-low-bit quantization is essential for deploying large models on consumer hardware, existing methods often introduce significant hidden scaling overhead due to rigid assumptions about weight saliency. SAGE-PTQ uses a novel graph-guided approach to separate salient and unsalient weights more effectively, minimizing this overhead and improving the accuracy of compressed models. This method represents a significant step forward in making frontier models more accessible through advanced inference-time optimization.
Ethics Backlash Over Covert AI Debate Experiment on Reddit
A study analyzing a discontinued field experiment on Reddit's r/ChangeMyView has highlighted significant ethical concerns regarding the use of covert LLM agents in social spaces. The experiment involved undisclosed AI-generated accounts engaging in live debates to test their persuasiveness. Following a backlash from the community and moderators, the intervention was halted, and an archive of the AI comments was released for analysis. The findings provide a rare glimpse into the persuasive tactics used by LLMs in real-world interactions and underscore the urgent need for transparency and ethical standards in the deployment of autonomous agents within digital communities.
LLM Judge Reliability Challenged by Post-Decision Manipulability
New research into 'LLM-as-judge' evaluation pipelines reveals that automated evaluators are highly susceptible to manipulation through post-decision interaction. While benchmarking pipelines typically assume that model judgments are stable properties of fixed inputs, this study shows that the outcome of an evaluation can be significantly altered through subsequent conversation with the judge. This findings suggest that current automated ranking systems may not be as robust or objective as previously thought, potentially leading to skewed results in leaderboard rankings and model comparisons.
LLM-Driven Code Mutation Found to Converge Toward Attractor Regions
A study on the dynamics of LLM-driven program evolution has discovered that repeated code mutation leads to a loss of variation. Researchers analyzed mutation chains in a domain-specific language and found that, in the absence of selection pressure, LLM-based mutations consistently converge toward specific 'attractor regions' in the program space. This convergence is particularly severe at the start of mutation chains and varies across different model families. The results imply that LLMs may have inherent biases that limit their ability to explore the full diversity of potential code solutions, which has significant implications for automated programming and genetic improvement.
LeanMarathon Facilitates Long-Horizon Formal Mathematics Verification
LeanMarathon is a new multi-agent harness designed to tackle the challenges of reliable research-level Lean autoformalization. Traditional attempts at long-horizon AI mathematics often fail as dependencies tangle and context decays over time. LeanMarathon addresses this by using an evolving 'blueprint'—a file that serves as a formal proof skeleton, a natural-language proof graph, and a shared system state for multiple agents. By maintaining this shared context, the system allows for more reliable formalization of complex mathematical proofs, moving AI closer to becoming a capable co-mathematician in research environments.
Open Code Review CLI Tool Gains Community Traction
Open Code Review, an AI-powered command-line interface tool, has recently gained significant attention for its ability to automate the code review process. By integrating directly into developer workflows, the tool provides automated feedback and suggestions, aiming to reduce the burden on human reviewers and speed up development cycles. Its popularity on platforms like Hacker News highlights a growing demand for developer tools that leverage LLMs to improve code quality and maintainability in an open-source format.
Comprehensive Audit Estimates Carbon Footprint of U.S. Hyperscale Data Centers
A facility-level audit of 403 hyperscale data centers in the United States has quantified the significant environmental impact of the ongoing AI infrastructure boom. The study, which covered facilities operating between 2024 and 2025, estimated electricity consumption and attributable CO2 emissions based on various load scenarios. The data provides a detailed look at the energy sources powering the modern AI industry and highlights the growing tension between rapid technological expansion and environmental sustainability goals, providing a critical dataset for policymakers and environmental analysts.
SentinelBench Introduces Monitoring Standard for Sustained Attention Agents
SentinelBench has been launched as a benchmark specifically for long-running monitoring agents. The research argues that the standard 'continuous action' model—where agents are constantly issuing tool calls or refreshing pages—is inappropriate for tasks that require sustained attention over hours or days. SentinelBench evaluates an agent's ability to monitor an environment and respond only when specific external events occur. This shift in focus from active execution to passive monitoring represents an important evolution in how autonomous agents are designed and evaluated for persistent, real-world utility.