Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Boundary-Guided Policy Optimization for Memory-efficient RL of Diffusion Large Language Models

ManiAgent: An Agentic Framework for General Robotic Manipulation

AndesVL Technical Report: An Efficient Mobile-side Multimodal Large Language Model

ParsVoice: A Large-Scale Multi-Speaker Persian Speech Corpus for Text-to-Speech Synthesis

Optimally Deep Networks -- Adapting Model Depth to Datasets for Superior Efficiency

BrowserAgent: Building Web Agents with Human-Inspired Web Browsing Actions

AGENTIQL: An Agent-Inspired Multi-Expert Framework for Text-to-SQL Generation

Towards Safe Maneuvering of Double-Ackermann-Steering Robots with a Soft Actor-Critic Framework

The Algorithmic Regulator

HccePose(BF): Predicting Front & Back Surfaces to Construct Ultra-Dense 2D-3D Correspondences for Pose Estimation

ICL-Router: In-Context Learned Model Representations for LLM Routing

CrisiText: A dataset of warning messages for LLM training in emergency communication

GTCN-G: A Residual Graph-Temporal Fusion Network for Imbalanced Intrusion Detection (Preprint)

Scalable Policy-Based RL Algorithms for POMDPs

OptiFLIDS: Optimized Federated Learning for Energy-Efficient Intrusion Detection in IoT

Malice in Agentland: Down the Rabbit Hole of Backdoors in the AI Supply Chain

AgentBuilder: Exploring Scaffolds for Prototyping User Experiences of Interface Agents

Neon: Negative Extrapolation From Self-Training Improves Image Generation

Triplet-Structured Knowledge Integration for Multi-Turn Medical Reasoning

General Exploratory Bonus for Optimistic Exploration in RLHF

PolySim: Bridging the Sim-to-Real Gap for Humanoid Control via Multi-Simulator Dynamics Randomization

Asymmetric Proximal Policy Optimization: mini-critics boost LLM reasoning

Graph2Eval: Automatic Multimodal Task Generation for Agents via Knowledge Graphs

Understanding Language Prior of LVLMs by Contrasting Chain-of-Embedding

Large language models management of medications: three performance analyses

Responsible AI Technical Report

A Longitudinal Randomized Control Study of Companion Chatbot Use: Anthropomorphism and Its Mediating Role on Social Impacts

SPiDR: A Simple Approach for Zero-Shot Safety in Sim-to-Real Transfer

TISDiSS: A Training-Time and Inference-Time Scalable Framework for Discriminative Source Separation

Efficient and Versatile Model for Multilingual Information Retrieval of Islamic Text: Development and Deployment in Real-World Scenarios

StegOT: Trade-offs in Steganography via Optimal Transport

General Demographic Foundation Models for Enhancing Predictive Performance Across Diseases and Populations

Attention as an Adaptive Filter

Diffusion Language Models Know the Answer Before Decoding

NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows

Hard Examples Are All You Need: Maximizing GRPO Post-Training Under Annotation Budgets

AdaptJobRec: Enhancing Conversational Career Recommendation through an LLM-Powered Agentic System

An Introduction to Sliced Optimal Transport

EMSEdit: Efficient Multi-Step Meta-Learning-based Model Editing

DMSC: Dynamic Multi-Scale Coordination Framework for Time Series Forecasting

mmWave Radar-Based Non-Line-of-Sight Pedestrian Localization at T-Junctions Utilizing Road Layout Extraction via Camera

Capturing More: Learning Multi-Domain Representations for Robust Online Handwriting Verification

A Cooperative Approach for Knowledge-based Business Process Design in a Public Authority

Finding Dori: Memorization in Text-to-Image Diffusion Models Is Not Local

Feature Distillation is the Better Choice for Model-Heterogeneous Federated Learning

Knowledge Fusion via Bidirectional Information Aggregation

LearnLens: LLM-Enabled Personalised, Curriculum-Grounded Feedback with Educators in the Loop

Dual Perspectives on Non-Contrastive Self-Supervised Learning

SAFER: Probing Safety in Reward Models with Sparse Autoencoder

Inverse Design in Nanophotonics via Representation Learning

SPADE: Spatial Transcriptomics and Pathology Alignment Using a Mixture of Data Experts for an Expressive Latent Space

VIDEE: Visual and Interactive Decomposition, Execution, and Evaluation of Text Analytics with Intelligent Agents

Time-IMM: A Dataset and Benchmark for Irregular Multimodal Multivariate Time Series

BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models

Uncertainty Estimation on Graphs with Structure Informed Stochastic Partial Differential Equations

EvolveNav: Empowering LLM-Based Vision-Language Navigation via Self-Improving Embodied Reasoning

Can LLMs Reason Structurally? An Evaluation via the Lens of Data Structures

Finite Sample Analysis of Linear Temporal Difference Learning with Arbitrary Features

Leveraging Importance Sampling to Detach Alignment Modules from Large Language Models

Protein Design with Dynamic Protein Vocabulary

Your Pre-trained LLM is Secretly an Unsupervised Confidence Calibrator

Steering Large Language Models for Machine Translation Personalization

AsynFusion: Towards Asynchronous Latent Consistency Models for Decoupled Whole-Body Audio-Driven Avatars

Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learning

Fixed Point Explainability

Time Travel is Cheating: Going Live with DeepFund for Real-Time Fund Investment Benchmarking

MobileCity: An Efficient Framework for Large-Scale Urban Behavior Simulation

A Customized SAT-based Solver for Graph Coloring

Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advances

FOCUS on Contamination: A Geospatial Deep Learning Framework with a Noise-Aware Loss for Surface Water PFAS Prediction

ParetoQ: Improving Scaling Laws in Extremely Low-bit LLM Quantization

Query Brand Entity Linking in E-Commerce Search

AgentBreeder: Mitigating the AI Safety Risks of Multi-Agent Scaffolds via Self-Improvement

GraphRAG under Fire

Polynomial-Time Algorithms for Fair Orientations of Chores

CiteBART: Learning to Generate Citations for Local Citation Recommendation

Reframing Image Difference Captioning with BLIP2IDC and Synthetic Augmentation

Multi-View Majority Vote Learning Algorithms: Direct Minimization of PAC-Bayesian Bounds

COMAL: A Convergent Meta-Algorithm for Aligning LLMs with General Preferences

Generative AI for Requirements Engineering: A Systematic Literature Review

Assessing Latency in ASR Systems: A Methodological Perspective for Real-Time Use

ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training

Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directions

Offline Fictitious Self-Play for Competitive Games

When "Competency" in Reasoning Opens the Door to Vulnerability: Jailbreaking LLMs via Novel Complex Ciphers

Can ChatGPT support software verification?

Optimized Layerwise Approximation for Efficient Private Inference on Fully Homomorphic Encryption

DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems

Adaptive Dual Reasoner: Large Reasoning Models Can Think Efficiently by Hybrid Reasoning

Concise Reasoning in the Lens of Lagrangian Optimization

Humanoid Artificial Consciousness Designed with Large Language Model Based on Psychoanalysis and Personality Theory

TripScore: Benchmarking and rewarding real-world travel planning with fine-grained evaluation

Agent Learning via Early Experience

L2M-AID: Autonomous Cyber-Physical Defense by Fusing Semantic Reasoning of Large Language Models with Multi-Agent Reinforcement Learning (Preprint)

Clean First, Align Later: Benchmarking Preference Data Cleaning for Reliable LLM Alignment

Similarity Field Theory: A Mathematical Framework for Intelligence

Large Language Models in Operations Research: Methods, Applications, and Challenges

MoEs Are Stronger than You Think: Hyper-Parallel Inference Scaling with RoE

Strategic Tradeoffs Between Humans and AI in Multi-Agent Bargaining

MapAgent: A Hierarchical Agent for Geospatial Reasoning with Dynamic Map Tool Integration

Dual Perspectives on Non-Contrastive Self-Supervised Learning

Created by

Haebom

저자

Jean Ponce (ENS-PSL, NYU), Basile Terver (FAIR, WILLOW), Martial Hebert (CMU), Michael Arbel (Thoth)

개요

본 논문은 자기 지도 학습의 비대조적 접근 방식에서 표현 붕괴를 방지하기 위해 사용되는 "stop gradient"와 "exponential moving average" 반복 절차를 최적화 및 동적 시스템 관점에서 분석한다. 이 절차들이 원래의 목적 함수 또는 다른 부드러운 함수를 최적화하지 않음에도 표현 붕괴를 방지한다는 것을 보인다. 선형 사례에서 동적 시스템 관점을 사용하여, "stop gradient"나 "exponential moving average" 없이 원래 목적 함수를 최소화하면 항상 붕괴로 이어진다는 것을 증명한다. 또한, 선형 설정에서 이 두 절차와 관련된 동적 시스템의 평형점을 명시적으로 특성화하고, 그들이 일반적으로 점근적으로 안정함을 보여준다.

시사점, 한계점

•

"stop gradient"와 "exponential moving average"가 실제로는 원래 목적 함수를 최적화하지 않지만 표현 붕괴를 방지하는 데 효과적임을 이론적으로 밝힘.

•

선형 환경에서 "stop gradient"와 "exponential moving average"의 효과를 수학적으로 엄밀하게 증명함.

•

"stop gradient"와 "exponential moving average"와 관련된 동적 시스템의 평형점을 분석하여 시스템의 안정성을 이해.

•

본 연구는 이론적 분석에 초점을 맞추고 있으며, 다른 종류의 자기 지도 학습 기술이나 비선형 환경으로의 일반화에 대한 추가 연구가 필요함.

•

실제 데이터와 합성 데이터를 사용한 실험을 통해 이론적 결과를 검증함.

Made with Slashpage