Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Boundary-Guided Policy Optimization for Memory-efficient RL of Diffusion Large Language Models

ManiAgent: An Agentic Framework for General Robotic Manipulation

AndesVL Technical Report: An Efficient Mobile-side Multimodal Large Language Model

ParsVoice: A Large-Scale Multi-Speaker Persian Speech Corpus for Text-to-Speech Synthesis

Optimally Deep Networks -- Adapting Model Depth to Datasets for Superior Efficiency

BrowserAgent: Building Web Agents with Human-Inspired Web Browsing Actions

AGENTIQL: An Agent-Inspired Multi-Expert Framework for Text-to-SQL Generation

Towards Safe Maneuvering of Double-Ackermann-Steering Robots with a Soft Actor-Critic Framework

The Algorithmic Regulator

HccePose(BF): Predicting Front & Back Surfaces to Construct Ultra-Dense 2D-3D Correspondences for Pose Estimation

ICL-Router: In-Context Learned Model Representations for LLM Routing

CrisiText: A dataset of warning messages for LLM training in emergency communication

GTCN-G: A Residual Graph-Temporal Fusion Network for Imbalanced Intrusion Detection (Preprint)

Scalable Policy-Based RL Algorithms for POMDPs

OptiFLIDS: Optimized Federated Learning for Energy-Efficient Intrusion Detection in IoT

Malice in Agentland: Down the Rabbit Hole of Backdoors in the AI Supply Chain

AgentBuilder: Exploring Scaffolds for Prototyping User Experiences of Interface Agents

Neon: Negative Extrapolation From Self-Training Improves Image Generation

Triplet-Structured Knowledge Integration for Multi-Turn Medical Reasoning

General Exploratory Bonus for Optimistic Exploration in RLHF

PolySim: Bridging the Sim-to-Real Gap for Humanoid Control via Multi-Simulator Dynamics Randomization

Asymmetric Proximal Policy Optimization: mini-critics boost LLM reasoning

Graph2Eval: Automatic Multimodal Task Generation for Agents via Knowledge Graphs

Understanding Language Prior of LVLMs by Contrasting Chain-of-Embedding

Large language models management of medications: three performance analyses

Responsible AI Technical Report

A Longitudinal Randomized Control Study of Companion Chatbot Use: Anthropomorphism and Its Mediating Role on Social Impacts

SPiDR: A Simple Approach for Zero-Shot Safety in Sim-to-Real Transfer

TISDiSS: A Training-Time and Inference-Time Scalable Framework for Discriminative Source Separation

Efficient and Versatile Model for Multilingual Information Retrieval of Islamic Text: Development and Deployment in Real-World Scenarios

StegOT: Trade-offs in Steganography via Optimal Transport

General Demographic Foundation Models for Enhancing Predictive Performance Across Diseases and Populations

Attention as an Adaptive Filter

Diffusion Language Models Know the Answer Before Decoding

NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows

Hard Examples Are All You Need: Maximizing GRPO Post-Training Under Annotation Budgets

AdaptJobRec: Enhancing Conversational Career Recommendation through an LLM-Powered Agentic System

An Introduction to Sliced Optimal Transport

EMSEdit: Efficient Multi-Step Meta-Learning-based Model Editing

DMSC: Dynamic Multi-Scale Coordination Framework for Time Series Forecasting

mmWave Radar-Based Non-Line-of-Sight Pedestrian Localization at T-Junctions Utilizing Road Layout Extraction via Camera

Capturing More: Learning Multi-Domain Representations for Robust Online Handwriting Verification

A Cooperative Approach for Knowledge-based Business Process Design in a Public Authority

Finding Dori: Memorization in Text-to-Image Diffusion Models Is Not Local

Feature Distillation is the Better Choice for Model-Heterogeneous Federated Learning

Knowledge Fusion via Bidirectional Information Aggregation

LearnLens: LLM-Enabled Personalised, Curriculum-Grounded Feedback with Educators in the Loop

Dual Perspectives on Non-Contrastive Self-Supervised Learning

SAFER: Probing Safety in Reward Models with Sparse Autoencoder

Inverse Design in Nanophotonics via Representation Learning

SPADE: Spatial Transcriptomics and Pathology Alignment Using a Mixture of Data Experts for an Expressive Latent Space

VIDEE: Visual and Interactive Decomposition, Execution, and Evaluation of Text Analytics with Intelligent Agents

Time-IMM: A Dataset and Benchmark for Irregular Multimodal Multivariate Time Series

BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models

Uncertainty Estimation on Graphs with Structure Informed Stochastic Partial Differential Equations

EvolveNav: Empowering LLM-Based Vision-Language Navigation via Self-Improving Embodied Reasoning

Can LLMs Reason Structurally? An Evaluation via the Lens of Data Structures

Finite Sample Analysis of Linear Temporal Difference Learning with Arbitrary Features

Leveraging Importance Sampling to Detach Alignment Modules from Large Language Models

Protein Design with Dynamic Protein Vocabulary

Your Pre-trained LLM is Secretly an Unsupervised Confidence Calibrator

Steering Large Language Models for Machine Translation Personalization

AsynFusion: Towards Asynchronous Latent Consistency Models for Decoupled Whole-Body Audio-Driven Avatars

Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learning

Fixed Point Explainability

Time Travel is Cheating: Going Live with DeepFund for Real-Time Fund Investment Benchmarking

MobileCity: An Efficient Framework for Large-Scale Urban Behavior Simulation

A Customized SAT-based Solver for Graph Coloring

Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advances

FOCUS on Contamination: A Geospatial Deep Learning Framework with a Noise-Aware Loss for Surface Water PFAS Prediction

ParetoQ: Improving Scaling Laws in Extremely Low-bit LLM Quantization

Query Brand Entity Linking in E-Commerce Search

AgentBreeder: Mitigating the AI Safety Risks of Multi-Agent Scaffolds via Self-Improvement

GraphRAG under Fire

Polynomial-Time Algorithms for Fair Orientations of Chores

CiteBART: Learning to Generate Citations for Local Citation Recommendation

Reframing Image Difference Captioning with BLIP2IDC and Synthetic Augmentation

Multi-View Majority Vote Learning Algorithms: Direct Minimization of PAC-Bayesian Bounds

COMAL: A Convergent Meta-Algorithm for Aligning LLMs with General Preferences

Generative AI for Requirements Engineering: A Systematic Literature Review

Assessing Latency in ASR Systems: A Methodological Perspective for Real-Time Use

ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training

Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directions

Offline Fictitious Self-Play for Competitive Games

When "Competency" in Reasoning Opens the Door to Vulnerability: Jailbreaking LLMs via Novel Complex Ciphers

Can ChatGPT support software verification?

Optimized Layerwise Approximation for Efficient Private Inference on Fully Homomorphic Encryption

DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems

Adaptive Dual Reasoner: Large Reasoning Models Can Think Efficiently by Hybrid Reasoning

Concise Reasoning in the Lens of Lagrangian Optimization

Humanoid Artificial Consciousness Designed with Large Language Model Based on Psychoanalysis and Personality Theory

TripScore: Benchmarking and rewarding real-world travel planning with fine-grained evaluation

Agent Learning via Early Experience

L2M-AID: Autonomous Cyber-Physical Defense by Fusing Semantic Reasoning of Large Language Models with Multi-Agent Reinforcement Learning (Preprint)

Clean First, Align Later: Benchmarking Preference Data Cleaning for Reliable LLM Alignment

Similarity Field Theory: A Mathematical Framework for Intelligence

Large Language Models in Operations Research: Methods, Applications, and Challenges

MoEs Are Stronger than You Think: Hyper-Parallel Inference Scaling with RoE

Strategic Tradeoffs Between Humans and AI in Multi-Agent Bargaining

MapAgent: A Hierarchical Agent for Geospatial Reasoning with Dynamic Map Tool Integration

Diffusion Language Models Know the Answer Before Decoding

Created by

Haebom

저자

Pengxiang Li, Yefan Zhou, Dilxat Muhtar, Lu Yin, Shilin Yan, Li Shen, Yi Liang, Soroush Vosoughi, Shiwei Liu

개요

Diffusion 언어 모델(DLM)은 병렬 시퀀스 생성 및 유연한 토큰 순서를 제공하지만, 양방향 어텐션의 비용과 고품질 출력을 위한 많은 정제 단계로 인해 추론 속도가 자가 회귀 모델보다 느리다. 본 연구에서는 DLM의 조기 응답 수렴 특성을 활용하여, 최종 디코딩 단계의 절반 단계에서 정답을 내부적으로 식별할 수 있음을 발견했다. 이를 바탕으로, Prophet을 도입하여 훈련 없이 조기 커밋 디코딩을 가능하게 한다. Prophet은 상위 2개 예측 후보 간의 신뢰도 차이를 기준으로 정제 계속 여부를 동적으로 결정한다. LLaDA-8B 및 Dream-7B에 대한 실험 결과, Prophet은 디코딩 단계를 최대 3.4배 줄이면서 높은 생성 품질을 유지했다.

시사점, 한계점

•

DLM 추론 속도를 향상시키는 새로운 접근 방식 제시: 조기 응답 수렴 특성을 활용한 Prophet.

•

추가 훈련 없이 기존 DLM 구현에 통합 가능하며, 오버헤드가 적음.

•

디코딩 단계를 대폭 줄여 추론 속도를 향상시킴.

•

DLM의 조기 수렴 현상에 대한 더 깊은 이해 제공.

•

현재 연구는 LLaDA-8B 및 Dream-7B 모델에 대한 실험 결과만 제시함.

•

다른 DLM 아키텍처 및 대규모 모델에 대한 확장성 검증 필요.

•

조기 커밋 결정 기준인 신뢰도 차이의 최적화에 대한 추가 연구 필요.

Made with Slashpage