Skip to content

๐Ÿฆพ LLM Agent

๐Ÿ“ท CVPR2025 ยท 12 paper notes

๐Ÿ“Œ Same area in other venues: ๐Ÿง  NeurIPS2026 (8) ยท ๐ŸŽž๏ธ ECCV2026 (36) ยท ๐Ÿ“ท CVPR2026 (44) ยท ๐Ÿ”ฌ ICLR2026 (209) ยท ๐Ÿ’ฌ ACL2026 (121) ยท ๐Ÿงช ICML2026 (83)

๐Ÿ”ฅ Top topics: Agents ร—6

GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration

Proposed the GUI-Xplore dataset (312 applications, 32K+ QA pairs, 5-level tasks) and the Xplore-Agent framework (Action-aware GUI Modeling + GUI Transition Graph Reasoning). By simulating the human strategy of "exploring before reasoning", it improves StepSR by approximately 10% on unfamiliar applications compared to state-of-the-art GUI agents.

ATA: Adaptive Transformation Agent for Text-Guided Subject-Position Variable Background Generation

Proposes the ATA (Adaptive Transformation Agent) framework to achieve precise control over subject position and pose in text-guided background generation, dynamically adjusting the subject's placement in the background via an adaptive transformation module while balancing visual consistency and semantic plausibility.

ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systems

ComfyBench proposes the first comprehensive benchmark (200 tasks, 3205 node documentations, and 20 curriculum workflows) to evaluate the capability of LLM-based agents to autonomously design collaborative AI systems in ComfyUI. It also introduces the ComfyAgent framework, which leverages code-based workflow representation and multi-agent collaboration to achieve a resolve rate comparable to o1-preview. However, it resolves only 15% of helper creative tasks, highlighting a significant gap in autonomous system design for LLM agents.

Feature4X: Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fields

This paper proposes Feature4X, a versatile framework that distills the functionalities of various 2D visual foundation models (e.g., SAM2, InternVideo2) from arbitrary monocular videos into a unified 4D Gaussian feature field via a dynamic optimization strategy. This work represents the first attempt to lift video foundation models to 4D features based on Gaussian Splatting, supporting segment anything from novel views, geometric/appearance editing, and free-form VQA.

NADER: Neural Architecture Design via Multi-Agent Collaboration

NADER models neural architecture design as a multi-LLM-agent collaborative task: a Reader extracts knowledge from papers, a Proposer generates improvement plans, a Modifier implements modifications using Directed Acyclic Graphs (DAGs), and a Reflector learns from failures. With only 10 trials, it surpasses the accuracy upper bound of the NAS-Bench-201 search space, achieving 74.51% on CIFAR-100 (compared to the best in-space search result of 73.51%).

RL-RC-DoT: A Block-level RL Agent for Task-Aware Video Compression

Proposes RL-RC-DoT, a reinforcement learning-based macroblock-level quantization parameter (QP) control agent for task-aware video compression. By modeling QP selection as a sequential decision-making problem in RL, the agent learns to allocate more bitrate to task-relevant regions under given bitrate constraints, significantly improving performance on vehicle detection and ROI saliency coding tasks. A key advantage is that it does not require running downstream task models during inference, making it suitable for edge device deployment.

SceneAssistant: A Visual Feedback Agent for Open-Vocabulary 3D Scene Generation

Proposes SceneAssistant, a closed-loop agentic framework based on visual feedback. By designing a fully functioning suite of Action APIs (13 atomic operations spanning object search, deletion, 6DoF spatial operations, and camera control) for VLMs, this approach enables iterative, open-vocabulary 3D scene generation using the ReAct paradigm. It significantly outperforms Holodeck and SceneWeaver in both indoor (preference rate of 61.25%) and open-domain (preference rate of 65.00%) scenarios.

SpiritSight Agent: Advanced GUI Agent with One Look

This paper proposes SpiritSight, a vision-based end-to-end GUI agent, which resolves grounding ambiguity under dynamic high-resolution inputs through a multi-tier dataset of 5.73 million samples named GUI-Lasagne and the Universal Block Parsing (UBP) method. On Multimodal-Mind2Web under the non-candidate element setup, SpiritSight-8B achieves a Step Success Rate (SR) of 52.7%, outperforming all vision, language, and hybrid methods.

TANGO: Training-free Embodied AI Agents for Open-world Tasks

This paper proposes TANGO, which orchestrates two minimal navigation foundation primitives (PointGoal Navigation + Memory-based Exploration) through the program generation capability of LLMs. Without any task-specific training and using only few-shot examples, TANGO achieves state-of-the-art (SOTA) results across three distinct embodied AI tasks: Open-Set ObjectGoal Navigation, Multi-Modal Lifelong Navigation, and Open Embodied QA, demonstrating the generalizability of the "minimal primitive set + LLM composition" paradigm.

Visual Agentic AI for Spatial Reasoning with a Dynamic API

This paper proposes VADAR, an agentic program synthesis approach for 3D spatial reasoning. Multiple LLM agents collaborate to generate Pythonic APIs and dynamically extend new functions to solve common subproblems during the solving process, overcoming the limitations of prior methods like VisProg/ViperGPT that rely on static, human-defined APIs. At the same time, it introduces a new benchmark involving multi-step spatial localization and reasoning, outperforming existing zero-shot methods on 3D understanding tasks.

Collaborative Tree Search for Enhancing Embodied Multi-Agent Collaboration

This paper proposes the Cooperative Tree Search (CoTS) framework, which integrates a modified Monte Carlo Tree Search with an LLM-driven reward function to guide multiple embodied agents in long-term strategic planning and highly efficient collaboration. By incorporating a plan evaluation module to prevent action confusion caused by frequent plan updates, CoTS significantly outperforms existing methods in both CWAH and TDW-MAT environments.

Sketchtopia: A Dataset and Foundational Agents for Benchmarking Asynchronous Multimodal Communication with Iconic Feedback

Proposes the Sketchtopia large-scale dataset (20K+ game sessions, 263K sketches, 916 players) and a three-component Agent framework (ActionDecider + DRAWBOT + GUESSBOT) to study asynchronous, goal-driven multimodal collaborative communication in Pictionary scenarios, introducing three new evaluation metrics: AAO, FRS, and MATS.