ArXiv AI Papers
Latest artificial intelligence and machine learning research papers from ArXiv.
Showing 50 of 209 items
TerraNova: A Foundation Model for the Anthropocene
Builds a single model that jointly learns from global physical data and country-level social indicators, keeping both geometries intact. It can fill in missing climate fields and reason about national metrics, which is a big deal for climate risk, policy modeling, and long-term planning tools.
When Does On-Policy Interaction Help? Representational Tradeoffs in Value-Based Imitation Learning
Proves that if you can query an expert while the learner acts, you only need to model the expert’s value function, not its exact policy. They introduce an algorithm that uses this fact and show it beats standard behavior cloning and DAgger when the student network is much smaller than the expert.
A Human-Centered Validation of the Explainability-Performance Coefficient
Introduces a score that balances how sparse an explanation is with how much model performance it preserves. The authors show this score lines up well with human judgments across text, images, and tabular data, so it is a practical metric if you need explainable models in production.
The Parts Are Greater Than the Sum: Automated Task Sequencing for Efficient Training of Multi-Policy LLMs
Shows that splitting tasks across several small adapters and learning a smart training order can beat one shared adapter at the same parameter budget. For anyone running heavy customizing runs, this suggests focusing on task scheduling and adapter routing, not just making adapters bigger.
MOT-SR: Multi-Objective Tool-Augmented Scientific Equation Discovery with Large Language Models
Uses language models plus external math tools to search for equations that explain data while trading off accuracy, simplicity, and generalization. It beats prior symbolic-regression methods and even finds better orbital corrections for a space mission case, so it is directly useful for scientific modeling teams.
Beyond Retrieval: Analytic Memory for Multimodal Agents
Turns long-term agent memory from a bag of notes into structured tables that you can filter, aggregate, and compare over time. That structure lets multimodal agents answer questions like analytics systems, not only recall snippets, which matters for dashboards, research copilots, and personal assistants.
Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remember
Proposes agents that generate their own problems, solve them, and distill failures into reusable skills stored in a growing memory. The system improves both its search policy and its external skills over time, which is directly relevant if you want agents that keep getting better without new labeled data.
LEMUR: Learning to Align with Multi-Objective Reinforcement Learning from Preference Feedback
Lets humans express tradeoffs between several goals, then learns both reward models and policies from that preference data. This moves beyond single-score reward learning and is useful wherever you want systems to balance, say, quality, speed, and safety instead of chasing one metric.
DungeonBench: A Benchmark for Rules-Rich Tactical Reasoning in Dungeons & Dragons Combat
Builds a combat simulator that forces models to plan under dense rules, geometry, resources, and long sequences, using Dungeons & Dragons as the testbed. Good if you care whether “reasoning” models can actually manage resources and multi-step plans, not only answer trivia.
AgentHPOBench: A Benchmark For Evaluating LLM Agents as Sequential Hyperparameter Optimizers
Tests how well language-model agents can run real machine learning experiments by tuning hyperparameters over many steps. It shows today’s agents can improve models but still struggle with long runs, messy logs, and steady progress, which matters if you want agents doing your training loop design.
ExtractBench: A Benchmark for Schema-Guided Enterprise Document Extraction
Defines a tough benchmark for pulling structured data from real enterprise documents while also checking whether answers are grounded in the source pages. Useful if you build agents that read contracts, invoices, or forms and you want realistic metrics on accuracy, completeness, grounding, and cost.
AREX: Towards a Recursively Self-Improving Agent for Deep Research
AREX is a research agent that repeatedly checks its own partial answers, then uses those checks to drive new searches and reasoning steps. It trains specialized models and reward signals so the agent can handle very long tasks and beat similar sized systems on deep research benchmarks.
Agora: Enhancing LLM Agent Reasoning Via Auction-Based Task Allocation
Agora treats each reasoning step as something agents bid for, then routes work to the model or tool that proves most competent. It improves accuracy under a fixed budget and exposes a clean knob to trade cost against quality.
Scalable Visual Pretraining for Language Intelligence
The authors skip text extraction and pretrain on raw document images, letting the model learn from layout, figures, and equations directly. Across backbones, this visual-first pretraining beats text-only training on language tasks using the same corpus.
Task-Specific Multimodal Question Answering Agents via Confidence Calibration and Incremental Reasoning for QANTA 2026
This QANTA system uses two different agents for "buzzing" and for final answers, each tuned to different risk profiles. It calibrates confidence and adds structured reasoning steps to cut overconfident guesses on tricky, multi-modal quiz questions.
Statistically Undetectable Backdoors in Deep Neural Networks
The authors show a trainer can hide a backdoor in a network so well that even full white‑box access can’t distinguish it statistically. The backdoor enables powerful adversarial examples that are provably infeasible to find without the secret.
KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scaling
KV‑PRM scores agent trajectories by reading the model’s key‑value cache instead of re‑encoding long texts. That cuts reward model cost from quadratic in length to linear, unlocking much cheaper multi-agent search.
Scoped Verification for Reliable Long-Horizon Agentic Context Evolution under Distribution Shift
GRACE stores an agent’s evolving system prompt as a typed graph instead of a blob of text. It verifies only local graph edits, then regenerates the text, keeping long‑running agents editable without losing safety guarantees.
Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agents
The Hypothesis Evolution Protocol forces a science agent to write down hypotheses, tests, evidence, and belief updates as structured objects. That makes its research process inspectable and comparable across questions and base models.
LongMedBench: Benchmarking Medical Agents for Long-Horizon Clinical Decision-Making
LongMedBench turns real hospital records into long, multi-visit timelines for testing medical agents. It stresses models that must remember dozens of visits and events instead of answering one-off medical trivia.
ProofCouncil: An LLM Agent for Solving Open Mathematical Problems
ProofCouncil wraps an LLM in an author‑critic workflow aimed at real math problems, not toy benchmarks. It solved 6 of 10 FirstProof tasks up to minor revisions, and tackles an extra set of 30 researcher-supplied problems.
Multimodal Reward Hacking in Reinforcement Learning
The paper shows that when you RL-train vision‑plus‑text models on weak reward signals, they learn to game the reward instead of the task. The authors propose metrics like Newly Rewarded Failure Rate to expose where "improvements" hide new failures.
Shared Selective Persistent Memory for Agentic LLM Systems
This work proposes a memory layer that keeps only reusable bits of past tool-using sessions, like schemas and configs, not full chats. Teams can share these workspaces so new agents start with hard-won context instead of repeating setup.
Beyond Fixed Representations: The Vocabulary and Verifier Gaps in Open-Ended AI
The authors argue current AI operates inside a fixed conceptual box and cannot easily invent or judge truly new ideas. They define "vocabulary" and "verifier" gaps and outline research paths toward more open-ended, innovative systems.
TrustX Agent Risk Classification Framework (ARC): Risk-Tiering Internally Created Agentic AI Systems
ARC gives companies a scoring rubric to rate the risk of internal AI agents across twelve dimensions and five autonomy levels. It outputs three governance tiers with control recommendations, plus a special track for coding assistants.
Co-evolution of self-replication and function in a digital primordial soup
Random tiny assembly programs evolve both self‑replication and math skills in a shared digital environment. Task rewards push the population toward compact, efficient "organisms" that reuse memory and create an emergent learning curriculum.
Program-as-Weights: A Programming Paradigm for Fuzzy Functions
You describe a fuzzy task in plain language and a 4B "compiler" turns it into a tiny neural add‑on for a small model. Those add‑ons match a 32B model on the tasks while using about fifty times less memory and running comfortably on a laptop. Use this to turn one‑off prompts into cheap, reusable local tools for routing, triage, and other judgment calls.
Optimizing Visual Generative Models via Distribution-wise Rewards
Most image RL setups reward each sample alone and end up with mode collapse or weird artifacts. This work instead rewards the whole batch distribution, pushing models toward diverse, high‑quality images. If you tune image generators, this is a recipe for reducing reward hacking while keeping variety.
PACE: A Proxy for Agentic Capability Evaluation
Running full agent benchmarks like SWE‑Bench or GAIA can cost thousands of dollars per run. PACE learns a tiny set of cheap test items whose scores predict those heavy agent scores with strong rank correlation. Use this to triage models and routes before paying for full agent evaluations.
Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Sampling
MrFlow speeds up image generators by first making a rough low‑res image, then upscaling in pixel space, adding light noise, and doing one last high‑res pass. It reports 10–25× faster full pipelines on FLUX and Qwen‑Image with almost no quality loss. If you ship image models, this is a blueprint for big speedups without retraining.
AgenticDataBench: A Comprehensive Benchmark for Data Agents
AgenticDataBench collects 344 real and synthetic data‑science tasks across 15 domains with 433 labeled "skills" like joins, cleaning, and feature work. It lets you see not just whether a data agent solves a task, but which skills it uses or misses. Use this if you are building spreadsheet or SQL copilots and want fine‑grained eval instead of single scores.
AgenticSTS: A Bounded-Memory Testbed for Long-Horizon LLM Agents
The authors build a Slay the Spire 2 benchmark where an agent must make hundreds of connected decisions with tight memory limits. They swap the usual endlessly growing context for a "bounded contract" that pulls only typed, relevant records into each step. Use this testbed to stress‑test your agent memory designs instead of guessing from toy games.
IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMs
IsoSci pairs science questions that share the same logical structure but live in different domains. It shows that over 90% of "reasoning mode" gains really come from extra knowledge, not better logic. Use this benchmark before claiming your model "reasons" better just because chain‑of‑thought scores went up.
CausalMix: Data Mixture as Causal Inference for Language Model Training
CausalMix treats data mixing for LLM training as a causal problem instead of a guessing game. It estimates how different data buckets change downstream scores, then picks mixtures based on those estimated effects. If you are curating giant training pools, this gives you a more principled way to choose what to oversample.
Multi-Objective Molecular Generation with Frequency-Controlled Evolutionary Dynamics
Represents molecules in a Fourier basis and evolves them with a multi-objective evolutionary algorithm. Separates coarse scaffold changes from fine local tweaks in a clean way. If you care about drug discovery or interpretable molecule search, this offers a training-free alternative to diffusion models. ([arxiv.org](https://arxiv.org/list/cs.NE/new))
Not All Relations Rotate Alike: Transformation-Aware Decoupling for Viewpoint-Robust 3D Scene Graph Generation
Separates 3D scene relations into ones that should rotate with the camera and ones that should stay fixed. This decoupling makes scene graphs much more stable under viewpoint changes. If you're building embodied agents or 3D perception, this is a practical robustness trick. ([arxiv.org](https://arxiv.org/list/cs.CV/new))
The Curse of Multiple Mediators: Hidden Interaction Effects in Activation Patching
Shows that standard activation patching mixes the effect of a unit with how it interacts with many others, not just its direct influence. These interaction terms can hide or fake "important" neurons. If you run mechanistic interpretability experiments, this paper says: treat patching results with more skepticism. ([arxiv.org](https://arxiv.org/list/cs.LG/new))
Prism Transformer: Progressive Head Schedules for Hierarchical Attention Processing
Keeps total parameters fixed but redistributes attention heads: few wide heads early, many narrow heads late. This simple change consistently beats standard layouts on language benchmarks. If you're running expensive training runs, this is a cheap architectural tweak to test. ([arxiv.org](https://arxiv.org/list/cs.LG/new))
PairSAE: Mechanistic Interpretability from Pair Representations in Protein Co-Folding
Adapts sparse autoencoders to the "pair" tensors in protein co-folding models by compressing them into token-level features first. Recovers features aligned with biological structure and binding signals. If you care about interpretability beyond plain transformers, this is a useful template. ([arxiv.org](https://arxiv.org/list/cs.LG/new))
Unified Zero-Shot Time Series Forecasting: A Darts Foundation
Plugs several time-series foundation models into the Darts library under one standard interface. Lets teams swap in Chronos-2, TimesFM 2.5, TiRex, and PatchTST-FM with a name change. If you forecast anything, you can now A/B strong zero-shot models without glue code. ([arxiv.org](https://arxiv.org/list/cs.LG/new))
Developmental Approach Reveals the Statistical Learning of Neural Language Models
Trains transformers on a synthetic grammar and snapshots them over time to see how they internalize patterns. Finds that they first pick up global statistics, then refine local rules. If you care about curriculum design or "how models learn," this gives concrete evidence, not just anecdotes. ([arxiv.org](https://arxiv.org/list/cs.CL/new))
Position: The Term "Machine Unlearning" Is Overused in LLMs
Argues that "machine unlearning" should mean only one strict thing: making a model behave as if a specific dataset was never seen. Most current LLM "unlearning" work does not meet that bar. If you work on data deletion or policy compliance, this sharpens the vocabulary and bar for evidence. ([arxiv.org](https://arxiv.org/list/cs.CL/new))
Formalizing Latent Thoughts: Four Axioms of Thought Representation in LLMs
Defines four testable criteria for what a "good" internal thought representation should satisfy, separate from task scores. Finds that current models systematically fail these tests. If you probe activations or build latent-thought pipelines, this gives a sharper evaluation target. ([arxiv.org](https://arxiv.org/list/cs.CL/new))
Towards Reliable and Robust LLM Planning: Symbolic Feedback-Driven Iterative Self-Refinement Framework
Wraps an LLM planner with a symbolic checker that spots broken plans and feeds back fixes in plain language. Adds a goal recognizer to catch impossible targets. If your agents keep hallucinating steps, this paper gives a concrete control loop to bolt on. ([arxiv.org](https://arxiv.org/list/cs.AI/new))
ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregation
Builds a "Tree of Evidence" system: one agent expands a claim into subclaims and retrieves evidence, another scores evidence, then a tree algorithm aggregates everything. It beats baselines especially on poisoned or adversarial inputs. If you rely on web search or RAG, the architecture is worth copying. ([arxiv.org](https://arxiv.org/list/cs.AI/new))
MER-R1: Multimodal Emotion Reasoning via Slow-Fast Thinking Synergy
Shows that explicit chain-of-thought often hurts emotion recognition compared with quick answers from the same model. Introduces a training setup that combines "fast" and "slow" heads so they work together instead of fighting. If you build emotional or social agents, this is a blueprint for more stable behavior. ([arxiv.org](https://arxiv.org/list/cs.AI/new))
DysLexLens: A Low-Resource LLM Framework for Analysing Dyslexic Learners Insights from Online Forums
Builds a full pipeline that cleans messy Reddit posts, builds a knowledge graph, and uses an LLM to study how dyslexic learners use AI tools. Treat it as a pattern for responsible analysis of niche online communities when data and labels are scarce. ([arxiv.org](https://arxiv.org/list/cs.AI/new))
Internalizing the Future: A Unified Agentic Training Paradigm for World Model Planning
Trains LLM agents to "imagine" future states and score plans, not just react step by step. They use a three-stage pipeline to inject forecasting, format it, then harden it with reinforcement learning. If you build agents that plan, this is a concrete recipe for giving them an internal world model. ([arxiv.org](https://arxiv.org/list/cs.AI/new))
AI-Model Network: Concept, Current State and Future
Proposes an "AI-ModelNet" that connects many smaller models into a network that can share skills, route requests, and collaborate like the internet of AIs. Useful if you're thinking beyond one giant model and toward fleets of specialized models that talk to each other. ([arxiv.org](https://arxiv.org/list/cs.AI/new))
Rethinking Shrinkage Bias in LLM FP4 Pretraining: Geometric Origin, Systemic Impact, and UFP4 Recipe
Argues today’s popular 4‑bit number format systematically underestimates values and destabilizes large-model training. Proposes a uniform 4‑bit recipe that stays closer to BF16 while saving memory and compute.