[공지사항]을 빙자한 안부와 근황

Show more

Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Efficient Federated Learning with Heterogeneous Data and Adaptive Dropout

Energy Efficiency in AI for 5G and Beyond: A DeepRx Case Study

A PBN-RL-XAI Framework for Discovering a "Hit-and-Run" Therapeutic Strategy in Melanoma

(Almost) Free Modality Stitching of Foundation Models

Prompt4Trust: A Reinforcement Learning Prompt Augmentation Framework for Clinically-Aligned Confidence Calibration in Multimodal Large Language Models

SEALGuard: Safeguarding the Multilingual Conversations in Southeast Asian Languages for LLM Software Systems

Dually Hierarchical Drift Adaptation for Online Configuration Performance Learning

Tree-Structured Parzen Estimator Can Solve Black-Box Combinatorial Optimization More Efficiently

EXPO: Stable Reinforcement Learning with Expressive Policies

Reinforcement Learning with Action Chunking

On the Effect of Instruction Tuning Loss on Generalization

Hallucination Stations: On Some Basic Limitations of Transformer-Based Language Models

Text to model via SysML: Automated generation of dynamical system computational models from unstructured natural language text via enhanced System Modeling Language diagrams

Feature-Based vs. GAN-Based Learning from Demonstrations: When and Why

DRAGON: Dynamic RAG Benchmark On News

Solar Flare Prediction Using Long Short-term Memory (LSTM) and Decomposition-LSTM with Sliding Window Pattern Recognition

Conversation Forests: The Key to Fine Tuning Large Language Models for Multi-Turn Medical Conversations is Branching

RAG-R1 : Incentivize the Search and Reasoning Capabilities of LLMs through Multi-query Parallelism

Following the Clues: Experiments on Person Re-ID using Cross-Modal Intelligence

Stylometry recognizes human and LLM-generated texts in short samples

QLPro: Automated Code Vulnerability Discovery via LLM and Static Code Analysis Integration

Evaluating Multimodal Large Language Models on Educational Textbook Question Answering

FeDa4Fair: Client-Level Federated Datasets for Fairness Evaluation

Alleviating User-Sensitive bias with Fair Generative Sequential Recommendation Model

MATE: LLM-Powered Multi-Agent Translation Environment for Accessibility Applications

DeInfoReg: A Decoupled Learning Framework for Better Training Throughput

FLAME: Towards Federated Fine-Tuning Large Language Models Through Adaptive SMoE

ImpliRet: Benchmarking the Implicit Fact Retrieval Challenge

The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Products

The Limits of Tractable Marginalization

A quantum semantic framework for natural language processing

ProtocolLLM: RTL Benchmark for SystemVerilog Generation of Communication Protocols

Deepfake Technology Unveiled: The Commoditization of AI and Its Impact on Digital Trust

Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning

Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedback

Matrix Is All You Need

Temporal Chunking Enhances Recognition of Implicit Sequential Patterns

Seven Security Challenges That Must be Solved in Cross-domain Multi-agent LLM Systems

PAN-Crafter: Learning Modality-Consistent Alignment for PAN-Sharpening

FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editing

Traveling Across Languages: Benchmarking Cross-Lingual Consistency in Multimodal LLMs

FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoning

Multimodal Sentiment Analysis on CMU-MOSEI Dataset using Transformer-based Models

Nexus-Gen: Unified Image Understanding, Generation, and Editing via Prefilled Autoregression in Shared Embedding Space

Leveraging Large Language Models for Multi-Class and Multi-Label Detection of Drug Use and Overdose Symptoms on Social Media

Rethinking the Foundations for Continual Reinforcement Learning

Compositional Flows for 3D Molecule and Synthesis Pathway Co-design

Rethinking RoPE: A Mathematical Blueprint for N-dimensional Positional Embedding

Speculative Automated Refactoring of Imperative Deep Learning Programs to Graph Execution

Test-time Adaptation for Foundation Medical Segmentation Model without Parametric Updates

Style over Substance: Distilled Language Models Reason Via Stylistic Replication

AnnoPage Dataset: Dataset of Non-Textual Elements in Documents with Fine-Grained Categorization

Multi-View Node Pruning for Accurate Graph Representation

Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models

Voting or Consensus? Decision-Making in Multi-Agent Debate

Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Support

A Generative Approach to LLM Harmfulness Detection with Special Red Flag Tokens

Score-of-Mixture Training: Training One-Step Generative Models Made Simple via Score Estimation of Mixture Distributions

Model Tampering Attacks Enable More Rigorous Evaluations of LLM Capabilities

Synthetic Datasets for Machine Learning on Spatio-Temporal Graphs using PDEs

Comply: Learning Sentences with Complex Weights inspired by Fruit Fly Olfaction

Inverse Reinforcement Learning with Switching Rewards and History Dependency for Characterizing Animal Behaviors

Few-Shot Radar Signal Recognition through Self-Supervised Learning and Radio Frequency Domain Adaptation

Transfer Learning Analysis of Variational Quantum Circuits

Plancraft: an evaluation dataset for planning with LLM agents

Fully Data-driven but Interpretable Human Behavioural Modelling with Differentiable Discrete Choice Model

A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation

Is Training Data Quality or Quantity More Impactful to Small Language Model Performance?

Searching Latent Program Spaces

The Pragmatic Frames of Spurious Correlations in Machine Learning: Interpreting How and Why They Matter

ComFairGNN: Community Fair Graph Neural Network

DroidSpeak: KV Cache Sharing for Cross-LLM Communication and Multi-LLM Serving

Online Intrinsic Rewards for Decision Making Agents from Large Language Model Feedback

Large Language Models Engineer Too Many Simple Features For Tabular Data

Overcoming Slow Decision Frequencies in Continuous Control: Model-Based Sequence Reinforcement Learning for Model-Free Control

IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedback

SECURE: Semantics-aware Embodied Conversation under Unawareness for Lifelong Robot Learning

Advancing Depth Anything Model for Unsupervised Monocular Depth Estimation in Endoscopy

SA-GDA: Spectral Augmentation for Graph Domain Adaptation

The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances

State-Constrained Offline Reinforcement Learning

SimAD: A Simple Dissimilarity-based Approach for Time Series Anomaly Detection

Unified ODE Analysis of Smooth Q-Learning Algorithms

FairTargetSim: An Interactive Simulator for Understanding and Explaining the Fairness Effects of Target Variable Definition

Fine-grained Stateful Knowledge Exploration: Effective and Efficient Graph Retrieval with Large Language Models

Learning Safe Numeric Planning Action Models

Augmenting End-to-End Steering Angle Prediction with CAN Bus Data

EASTER: Embedding Aggregation-based Heterogeneous Models Training in Vertical Federated Learning

GRAPES: Learning to Sample Graphs for Scalable Graph Neural Networks

Acquiring and Adapting Priors for Novel Tasks via Neural Meta-Architectures

VerifyBench: A Systematic Benchmark for Evaluating Reasoning Verifiers Across Domains

Is Human-Written Data Enough? The Challenge of Teaching Reasoning to LLMs Without RL or Distillation

Working with AI: Measuring the Occupational Implications of Generative AI

Establishing Best Practices for Building Rigorous Agentic Benchmarks

An Agentic Framework for Autonomous Metamaterial Modeling and Inverse Design

Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Models

BOOST: Bootstrapping Strategy-Driven Reasoning Programs for Program-Guided Fact-Checking

The Odyssey of the Fittest: Can Agents Survive and Still Be Good?

Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools

ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoning

Unlearning Isn't Deletion: Investigating Reversibility of Machine Unlearning in LLMs

Created by

Haebom

저자

Xiaoyu Xu, Xiang Yue, Yang Liu, Qingqing Ye, Haibo Hu, Minxin Du

개요

본 논문은 대규모 언어 모델(LLM)에서의 언러닝(unlearning) 평가에 사용되는 토큰 수준 지표(정확도, 퍼플렉서티)의 한계를 지적하고, 이러한 지표들이 모델의 실제 정보 삭제 여부를 정확히 반영하지 못할 수 있음을 보여줍니다. 저자들은 PCA 기반 유사도 및 이동, 중심 커널 정렬, 피셔 정보를 사용하는 표상 수준 평가 프레임워크를 제안하여, 여섯 가지 언러닝 방법, 세 가지 도메인(텍스트, 코드, 수학), 두 개의 오픈소스 LLM에 적용합니다. 이를 통해 가역적(reversible) 망각과 비가역적(irreversible) 망각을 구분하고, 가역적 망각의 경우 토큰 수준 붕괴가 발생하지만 잠재적 특징은 유지되는 반면, 비가역적 망각의 경우 더 깊은 표상 수준의 손상이 발생함을 밝힙니다. 또한 출력층 근처의 얕은 가중치 변화가 오해의 소지를 일으키는 언러닝 신호와 관련이 있음을 이론적으로 설명하고, 가역성이 작업 유형과 하이퍼파라미터에 의해 조절됨을 보여줍니다. 결론적으로, 현재의 언러닝 평가 관행의 근본적인 한계를 드러내고, LLM에서 신뢰할 수 있는 언러닝을 위한 새로운 진단 기반을 마련합니다. LLM 표상 변화를 분석하기 위한 통합 툴킷을 제공합니다 (https://github.com/XiaoyuXU1/Representational_Analysis_Tools.git).

GitHub - XiaoyuXU1/Representational_Analysis_Tools

Contribute to XiaoyuXU1/Representational_Analysis_Tools development by creating an account on GitHub.

시사점, 한계점

•

시사점:

◦

기존의 토큰 수준 지표(정확도, 퍼플렉서티)만으로는 LLM의 언러닝 효과를 정확하게 평가할 수 없다는 것을 밝힘.

◦

표상 수준 평가 프레임워크를 제시하여, 가역적/비가역적 망각을 구분하고 언러닝의 효과를 더 정확하게 분석할 수 있도록 함.

◦

언러닝의 가역성이 작업 유형과 하이퍼파라미터에 의해 영향받는다는 것을 규명.

◦

LLM의 신뢰할 수 있는 언러닝을 위한 새로운 진단 기반을 제공.

◦

LLM 표상 변화 분석을 위한 통합 툴킷을 공개.

•

한계점:

◦

제시된 표상 수준 평가 프레임워크의 일반성 및 확장성에 대한 추가 연구 필요.

◦

다양한 LLM 아키텍처와 언러닝 방법에 대한 광범위한 실험이 필요.

◦

가역적/비가역적 망각의 경계를 더 명확히 규정할 필요.

Made with Slashpage