Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Best Practices for Biorisk Evaluations on Open-Weight Bio-Foundation Models

Dual-level Progressive Hardness-Aware Reweighting for Cross-View Geo-Localization

How Similar Are Grokipedia and Wikipedia? A Multi-Dimensional Textual and Structural Comparison

Implicit Bias of Per-sample Adam on Separable Data: Departure from the Full-batch Regime

The Narrative Continuity Test: A Conceptual Framework for Evaluating Identity Persistence in AI Systems

DMVFC: Deep Learning Based Functionally Consistent Tractography Fiber Clustering Using Multimodal Diffusion MRI and Functional MRI

Rethinking Visual Intelligence: Insights from Video Pretraining

Key and Value Weights Are Probably All You Need: On the Necessity of the Query, Key, Value weight Triplet in Decoder-Only Transformers

Flight Delay Prediction via Cross-Modality Adaptation of Large Language Models and Aircraft Trajectory Representation

GroupSHAP-Guided Integration of Financial News Keywords and Technical Indicators for Stock Price Prediction

Knowledge-guided Continual Learning for Behavioral Analytics Systems

A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generation

ADPO: Anchored Direct Preference Optimization

Bridging Symmetry and Robustness: On the Role of Equivariance in Enhancing Adversarial Robustness

Exploring the Synergy of Quantitative Factors and Newsflow Representations from Large Language Models for Stock Return Prediction

Automotive Crash Dynamics Modeling Accelerated with Machine Learning

RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning

Readers Prefer Outputs of AI Trained on Copyrighted Books over Expert Human Writers

MedREK: Retrieval-Based Editing for Medical LLMs with Key-Aware Prompts

KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems

DITTO: A Spoofing Attack Framework on Watermarked LLMs via Knowledge Distillation

Dynamic Topic Evolution with Temporal Decay and Attention in Large Language Models

Debiasing LLMs by Masking Unfairness-Driving Attention Heads

What Makes Looped Transformers Perform Better Than Non-Recursive Ones (Provably)

Uncovering Representation Bias for Investment Decisions in Open-Source Large Language Models

Inoculation Prompting: Eliciting traits from LLMs during training can suppress them at test-time

Measuring Algorithmic Partisanship via Zero-Shot Classification and Its Implications on Political Discourse

Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models

PrunedLoRA: Robust Gradient-Based structured pruning for Low-rank Adaptation in Fine-tuning

From Superficial Outputs to Superficial Learning: Risks of Large Language Models in Education

Does FLUX Already Know How to Perform Physically Plausible Image Composition?

EmbeddingGemma: Powerful and Lightweight Text Representations

A Generalized Bisimulation Metric of State Similarity between Markov Decision Processes: From Theoretical Propositions to Applications

Lattice Boltzmann Model for Learning Real-World Pixel Dynamicity

Beyond Pointwise Scores: Decomposed Criteria-Based Evaluation of LLM Responses

Adversarial Distilled Retrieval-Augmented Guarding Model for Online Malicious Intent Detection

DSpAST: Disentangled Representations for Spatial Audio Reasoning with Large Language Models

Teaching According to Talents! Instruction Tuning LLMs with Competence-Aware Curriculum Learning

RL Fine-Tuning Heals OOD Forgetting in SFT

3DViT-GAT: A Unified Atlas-Based 3D Vision Transformer and Graph Learning Framework for Major Depressive Disorder Detection Using Structural MRI Data

Beyond Autoregression: An Empirical Study of Diffusion Large Language Models for Code Generation

Language Native Lightly Structured Databases for Large Language Model Driven Composite Materials Research

EndoGMDE: Generalizable Monocular Depth Estimation with Mixture of Low-Rank Experts for Diverse Endoscopic Scenes

Multi-Focused Video Group Activities Hashing

OpinioRAG: Towards Generating User-Centric Opinion Highlights from Large-scale Online Reviews

Evaluating Federated Learning for At-Risk Student Prediction: A Comparative Analysis of Model Complexity and Data Balancing

Zero-knowledge LLM hallucination detection and mitigation through fine-grained cross-model consistency

Learning to Steer: Input-dependent Steering for Multimodal LLMs

Combinative Matching for Geometric Shape Assembly

Identity Increases Stability in Neural Cellular Automata

Why Attention Fails: A Taxonomy of Faults in Attention-Based Neural Networks

A DbC Inspired Neurosymbolic Layer for Trustworthy Agent Design

Dynamic Forgetting and Spatio-Temporal Periodic Interest Modeling for Local-Life Service Recommendation

Recognising, Anticipating, and Mitigating LLM Pollution of Online Behavioural Research

Music Arena: Live Evaluation for Text-to-Music

A Self-Evolving AI Agent System for Climate Science

H-NeiFi: Non-Invasive and Consensus-Efficient Multi-Agent Opinion Guidance

MindJourney: Test-Time Scaling with World Models for Spatial Reasoning

CoralVQA: A Large-Scale Visual Question Answering Dataset for Coral Reef Image Understanding

Chain of Retrieval: Multi-Aspect Iterative Search Expansion and Post-Order Search Aggregation for Full Paper Retrieval

Through the River: Understanding the Benefit of Schedule-Free Methods for Language Model Training

A Collectivist, Economic Perspective on AI

On the Bias of Next-Token Predictors Toward Systematically Inefficient Reasoning: A Shortest-Path Case Study

Context Tuning for In-Context Optimization

AI-Generated Video Detection via Perceptual Straightening

PPMI: Privacy-Preserving LLM Interaction with Socratic Chain-of-Thought Reasoning and Homomorphically Encrypted Vector Databases

TabArena: A Living Benchmark for Machine Learning on Tabular Data

Over-squashing in Spatiotemporal Graph Neural Networks

Flat Channels to Infinity in Neural Loss Landscapes

Balancing Caregiving and Self-Care: Exploring Mental Health Needs of Alzheimer's and Dementia Caregivers

Where and How to Perturb: On the Design of Perturbation Guidance in Diffusion and Flow Models

ConTextTab: A Semantics-Aware Tabular In-Context Learner

Non-Contact Health Monitoring During Daily Personal Care Routines

MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification

LiteVLM: A Low-Latency Vision-Language Model Inference Pipeline for Resource-Constrained Environments

Curriculum Reinforcement Learning from Easy to Hard Tasks Improves LLM Reasoning

A Tale of Two Symmetries: Exploring the Loss Landscape of Equivariant Models

A Closer Look at Bias and Chain-of-Thought Faithfulness of Large (Vision) Language Models

Elicit and Enhance: Advancing Multimodal Reasoning in Medical Scenarios

In Dialogue with Intelligence: Rethinking Large Language Models as Collective Knowledge

Spatial Knowledge Graph-Guided Multimodal Synthesis

Policy Optimized Text-to-Image Pipeline Design

Breaking the Performance Ceiling in Reinforcement Learning requires Inference Strategies

Exploring the Hidden Capacity of LLMs for One-Step Text Generation

KIT's Low-resource Speech Translation Systems for IWSLT2025: System Enhancement with Synthetic Data and Model Regularization

PromptWise: Online Learning for Cost-Aware Prompt Assignment in Generative Models

Exploring the limits of strong membership inference attacks on large language models

Autocomp: A Powerful and Portable Code Optimizer for Tensor Accelerators

Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Models

Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding

Forging Time Series with Language: A Large Language Model Approach to Synthetic Data Generation

Towards Robust Evaluation of STEM Education: Leveraging MLLMs in Project-Based Learning

Words That Unite The World: A Unified Framework for Deciphering Central Bank Communications Globally

Multi-head Temporal Latent Attention

New Encoders for German Trained from Scratch: Comparing ModernGBERT with Converted LLM2Vec Models

Learning Repetition-Invariant Representations for Polymer Informatics

Evaluating Simplification Algorithms for Interpretability of Time Series Classification

UniVLA: Learning to Act Anywhere with Task-centric Latent Actions

Memory Assisted LLM for Personalized Recommendation System

Accelerating Volumetric Medical Image Annotation via Short-Long Memory SAM 2

KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems

Created by

Haebom

저자

Hancheng Ye, Zhengqi Gao, Mingyuan Ma, Qinsi Wang, Yuzhe Fu, Ming-Yu Chung, Yueqian Lin, Zhijian Liu, Jianyi Zhang, Danyang Zhuo, Yiran Chen

개요

멀티 에이전트 대규모 언어 모델 (LLM) 시스템은 에이전트 간의 소통과 협업이 필요한 복잡한 언어 처리 작업에 점점 더 많이 사용되고 있습니다. 그러나 이러한 시스템은 에이전트 간의 중복된 컨텍스트를 반복적으로 재처리하는 데 상당한 오버헤드가 발생합니다. KV 캐싱은 단일 에이전트 설정에서 중복 계산을 피하는 효과적인 솔루션이지만, 에이전트별 컨텍스트 확장에 의해 도입된 서로 다른 접두사로 인해 멀티 에이전트 시나리오에서는 직접 재사용할 수 없습니다. 이 문제를 해결하기 위해, KVCOMM은 KV 캐시를 재사용하고 다양한 접두사 컨텍스트에서 중복 컨텍스트의 캐시 오프셋을 정렬하여 멀티 에이전트 추론에서 효율적인 사전 채우기를 가능하게 하는 학습이 필요 없는 프레임워크입니다. KVCOMM은 캐시된 예시 풀(앵커)을 참조하여 공유 콘텐츠에 대한 KV 캐시를 추정하고 조정하며, 이는 다양한 접두사에서 관찰된 캐시 편차를 저장합니다. KVCOMM은 검색 증강 생성, 수학적 추론, 협업 코딩 작업을 포함한 다양한 멀티 에이전트 워크로드에서 70% 이상의 재사용률을 달성하며, 품질 저하 없이 성능을 향상시켰습니다.

시사점, 한계점

•

시사점:

◦

KVCOMM은 멀티 에이전트 LLM 시스템의 추론 효율성을 크게 향상시킵니다.

◦

학습이 필요 없는 프레임워크로, 다양한 작업에 쉽게 적용할 수 있습니다.

◦

다양한 멀티 에이전트 워크로드에서 높은 캐시 재사용률을 달성합니다.

◦

표준 사전 채우기 파이프라인보다 최대 7.8배 속도 향상을 보입니다.

•

한계점:

◦

논문에 구체적인 한계점에 대한 언급은 없습니다.

Made with Slashpage