Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

IG Parser: A Software Package for the Encoding of Institutional Statements using the Institutional Grammar

One-Step Offline Distillation of Diffusion-based Models via Koopman Modeling

J4R: Learning to Judge with Equivalent Initial State Group Relative Policy Optimization

Evaluating the efficacy of LLM Safety Solutions : The Palit Benchmark Dataset

From Assistants to Adversaries: Exploring the Security Risks of Mobile LLM Agents

Leveraging LLM Inconsistency to Boost Pass@k Performance

Sinusoidal Initialization, Time for a New Start

Enhancing Channel-Independent Time Series Forecasting via Cross-Variate Patch Embedding

Any-to-Any Learning in Computational Pathology via Triplet Multimodal Pretraining

Predicting Turn-Taking and Backchannel in Human-Machine Conversations Using Linguistic, Acoustic, and Visual Signals

ChromFound: Towards A Universal Foundation Model for Single-Cell Chromatin Accessibility Data

IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems

RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correction

LLM-DSE: Searching Accelerator Parameters with LLM Agents

Online Iterative Self-Alignment for Radiology Report Generation

Reachability Barrier Networks: Learning Hamilton-Jacobi Solutions for Smooth and Flexible Control Barrier Functions

Improving Medium Range Severe Weather Prediction through Transformer Post-processing of AI Weather Forecasts

BioCube: A Multimodal Dataset for Biodiversity Research

One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systems

TCC-Bench: Benchmarking the Traditional Chinese Culture Understanding Capabilities of MLLMs

FALCON: False-Negative Aware Learning of Contrastive Negatives in Vision-Language Pretraining

GRoQ-Loco: Generalist and Robot-agnostic Quadruped Locomotion Control using Offline Datasets

Who You Are Matters: Bridging Topics and Social Roles via LLM-Enhanced Logical Recommendation

Artificial Intelligence Bias on English Language Learners in Automatic Scoring

Learning Long-Context Diffusion Policies via Past-Token Prediction

Fast Text-to-Audio Generation with Adversarial Post-Training

Unified Continuous Generative Models

Can LLM-based Financial Investing Strategies Outperform the Market in Long Run?

Technical Report: Quantifying and Analyzing the Generalization Power of a DNN

Prompting Large Language Models for Training-Free Non-Intrusive Load Monitoring

On-Device LLM for Context-Aware Wi-Fi Roaming

Efficient Fine-Tuning of Quantized Models via Adaptive Rank and Bitwidth

Understanding University Students' Use of Generative AI: The Roles of Demographics and Personality Traits

Adaptive Thinking via Mode Policy Optimization for Social Language Agents

LLM-hRIC: LLM-empowered Hierarchical RAN Intelligent Control for O-RAN

On the Boolean Network Theory of Datalog$^\neg$

Learning to Reason under Off-Policy Guidance

How Effective Can Dropout Be in Multiple Instance Learning ?

Learning Joint ID-Textual Representation for ID-Preserving Image Synthesis

Walk the Talk? Measuring the Faithfulness of Large Language Model Explanations

Cross-Document Cross-Lingual NLI via RST-Enhanced Graph Fusion and Interpretability Prediction

S1-Bench: A Simple Benchmark for Evaluating System 1 Thinking Capability of Large Reasoning Models

Beyond Self-Reports: Multi-Observer Agents for Personality Assessment in Large Language Models

Scaling Video-Language Models to 10K Frames via Hierarchical Differential Distillation

Scaling Test-Time Inference with Policy-Optimized, Dynamic Retrieval-Augmented Generation via KV Caching and Decoding

Breaking Language Barriers in Visual Language Models via Multilingual Textual Regularization

LogicQA: Logical Anomaly Detection with Vision Language Model Generated Questions

Conjuring Positive Pairs for Efficient Unification of Representation Learning and Image Synthesis

CRCE: Coreference-Retention Concept Erasure in Text-to-Image Diffusion Models

LED: LLM Enhanced Open-Vocabulary Object Detection without Human Curated Data Generation

MirrorShield: Towards Universal Defense Against Jailbreaks via Entropy-Guided Mirror Crafting

HICD: Hallucination-Inducing via Attention Dispersion for Contrastive Decoding to Mitigate Hallucinations in Large Language Models

RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs

Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More More

Cost-Optimal Grouped-Query Attention for Long-Context Modeling

Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representation

On the Vulnerability of Concept Erasure in Diffusion Models

Char-mander Use mBackdoor! A Study of Cross-lingual Backdoor Attacks in Multilingual LLMs

SQLong: Enhanced NL2SQL for Longer Contexts with LLMs

DiffSampling: Enhancing Diversity and Accuracy in Neural Text Generation

TreeCut: A Synthetic Unanswerable Math Word Problem Dataset for LLM Hallucination Evaluation

Attention Mechanism for LLM-based Agents Dynamic Diffusion under Information Asymmetry

Robust Adaptation of Large Multimodal Models for Retrieval Augmented Hateful Meme Detection

R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphs

DeepResonance: Enhancing Multimodal Music Understanding via Music-centric Multi-way Instruction Tuning

MomentSeeker: A Task-Oriented Benchmark For Long-Video Moment Retrieval

EquiBench: Benchmarking Large Language Models' Understanding of Program Semantics via Equivalence Checking

EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models

Uncovering Untapped Potential in Sample-Efficient World Model Agents

MMUnlearner: Reformulating Multimodal Machine Unlearning in the Era of Multimodal Large Language Models

CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation

AI-driven Personalized Privacy Assistants: a Systematic Literature Review

Early Risk Prediction of Pediatric Cardiac Arrest from Electronic Health Records via Multimodal Fused Transformer

Online Scheduling for LLM Inference with KV Cache Constraints

Uni-Retrieval: A Multi-Style Retrieval Framework for STEM's Education

Speculative Prefill: Turbocharging TTFT with Lightweight and Training-Free Token Importance Estimation

Latent Action Learning Requires Supervision in the Presence of Distractors

Redefining Machine Unlearning: A Conformal Prediction-Motivated Approach

On the Role of Transformer Feed-Forward Layers in Nonlinear In-Context Learning

People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text

NBDI: A Simple and Effective Termination Condition for Skill Extraction from Task-Agnostic Demonstrations

MMDocIR: Benchmarking Multi-Modal Retrieval for Long Documents

Building Symbiotic AI: Reviewing the AI Act for a Human-Centred, Principle-Based Framework

TiEBe: Tracking Language Model Recall of Notable Worldwide Events Through Time

xLSTM-SENet: xLSTM for Single-Channel Speech Enhancement

A Separable Self-attention Inspired by the State Space Model for Computer Vision

Cross-model Transferability among Large Language Models on the Platonic Representations of Concepts

KunServe: Efficient Parameter-centric Memory Management for LLM Serving

Hotspot-Driven Peptide Design via Multi-Fragment Autoregressive Extension

Can LLMs be Good Graph Judge for Knowledge Graph Construction?

RoCoDA: Counterfactual Data Augmentation for Data-Efficient Robot Learning from Demonstrations

Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language Models

Knowledge-Guided Prompt Learning for Request Quality Assurance in Public Code Review

Scaling Stick-Breaking Attention: An Efficient Implementation and In-depth Study

M-RewardBench: Evaluating Reward Models in Multilingual Settings

Unlearning Backdoor Attacks for LLMs with Weak-to-Strong Knowledge Distillation

RATE: Causal Explainability of Reward Models with Imperfect Counterfactuals

Bayes Adaptive Monte Carlo Tree Search for Offline Model-based Reinforcement Learning

Large Continual Instruction Assistant

TopoTune : A Framework for Generalized Combinatorial Complex Neural Networks

Large Continual Instruction Assistant

Created by

Haebom

저자

Jingyang Qiao, Zhizhong Zhang, Xin Tan, Yanyun Qu, Shouhong Ding, Yuan Xie

개요

본 논문은 지속적인 지시 조정(CIT)에서 기존의 기울기 업데이트가 이전 데이터셋의 성능을 크게 저하시키는 문제를 해결하기 위해, 지속적인 지시 조정을 위한 일반적인 프레임워크를 제안합니다. 기존의 지수 이동 평균(EMA)이 이전 매개변수를 추적하여 망각을 줄이는 데 도움이 되지만, 변화하는 데이터셋에 대한 균형을 맞추지 못하는 한계를 극복하고자, 손실 함수의 테일러 전개를 기반으로 기울기와 학습된 매개변수에 의해 최적의 균형 가중치를 자동으로 결정하는 안정성-가소성 균형 계수를 제안합니다. 또한, 지시어의 의미적 유사성을 기반으로 재훈련 또는 매개변수 확장 여부를 결정하고 테스트 인스턴스에 가장 적합한 매개변수를 할당합니다. 여러 지속적인 지시 조정 벤치마크에 대한 광범위한 실험을 통해 제안된 방법이 망각 방지 기능을 향상시키고 전반적인 지속적인 조정 성능을 크게 향상시킨다는 것을 보여줍니다. 코드는 https://github.com/JingyangQiao/CoIN 에서 확인할 수 있습니다.

GitHub - JingyangQiao/CoIN: Official Pytorch implementation for ICML 2025 paper "Large Continual Instruction Assistant"

Official Pytorch implementation for ICML 2025 paper "Large Continual Instruction Assistant" - JingyangQiao/CoIN

시사점, 한계점

•

시사점:

◦

기존 CIT의 망각 문제를 효과적으로 해결하는 새로운 프레임워크 제시

◦

안정성과 가소성 간의 최적 균형을 자동으로 찾는 알고리즘 개발

◦

지시어의 의미적 유사성을 활용한 효율적인 매개변수 관리 전략 제시

◦

다양한 벤치마크에서 성능 향상을 실험적으로 검증

•

한계점:

◦

제안된 방법의 일반화 성능에 대한 추가적인 연구 필요

◦

다양한 종류의 지시어 및 데이터셋에 대한 로버스트니스 평가 필요

◦

계산 비용 및 복잡도에 대한 분석 필요

Made with Slashpage