Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Instella: Fully Open Language Models with Stellar Performance

STAGE: A Symbolic Tensor grAph GEnerator for distributed AI system co-design

Speech-Audio Compositional Attacks on Multimodal LLMs and Their Mitigation with SALMONN-Guard

PustakAI: Curriculum-Aligned and Interactive Textbooks Using Large Language Models

Harnessing Bounded-Support Evolution Strategies for Policy Refinement

Potent but Stealthy: Rethink Profile Pollution against Sequential Recommendation via Bi-level Constrained Reinforcement Paradigm

FAST-CAD: A Fairness-Aware Framework for Non-Contact Stroke Diagnosis

Learning Topology-Driven Multi-Subspace Fusion for Grassmannian Deep Network

LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics

Contrastive Integrated Gradients: A Feature Attribution-Based Method for Explaining Whole Slide Image Classification

SafeMIL: Learning Offline Safe Imitation Policy from Non-Preferred Trajectories

Dynamic Sparsity: Challenging Common Sparsity Assumptions for Learning World Models in Robotic Reinforcement Learning Benchmarks

Invisible Triggers, Visible Threats! Road-Style Adversarial Creation Attack for Visual 3D Detection in Autonomous Driving

Intelligence per Watt: Measuring Intelligence Efficiency of Local AI

SPUR: A Plug-and-Play Framework for Integrating Spatial Audio Understanding and Reasoning into Large Audio-Language Models

Exploiting Inter-Session Information with Frequency-enhanced Dual-Path Networks for Sequential Recommendation

EMOD: A Unified EEG Emotion Representation Framework Leveraging V-A Guided Contrastive Learning

AI Assisted AR Assembly: Object Recognition and Computer Vision for Augmented Reality Assisted Assembly

Adaptive Detection of Software Aging under Workload Shift

Pelican-VL 1.0: A Foundation Brain Model for Embodied Intelligence

A filtering scheme for confocal laser endomicroscopy (CLE)-video sequences for self-supervised learning

Reflections on the Reproducibility of Commercial LLM Performance in Empirical Software Engineering Studies

Advantage Shaping as Surrogate Reward Maximization: Unifying Pass@K Policy Gradients

ICL-Router: In-Context Learned Model Representations for LLM Routing

Causal Digital Twins for Cyber-Physical Security: A Framework for Robust Anomaly Detection in Industrial Control Systems

Synthetic Object Compositions for Scalable and Accurate Learning in Detection, Segmentation, and Grounding

An Adaptive Multi Agent Bitcoin Trading System

BanglaTalk: Towards Real-Time Speech Assistance for Bengali Regional Dialects

SecInfer: Preventing Prompt Injection via Inference-time Scaling

Re-FRAME the Meeting Summarization SCOPE: Fact-Based Summarization and Personalization via Questions

Threat Modeling for Enhancing Security of IoT Audio Classification Devices under a Secure Protocols Framework

Efficient Learning-Based Control of a Legged Robot in Lunar Gravity

Adaptive Pareto-Optimal Token Merging for Edge Transformer Models in Semantic Communication

Advanced Torrential Loss Function for Precipitation Forecasting

TTF-VLA: Temporal Token Fusion via Pixel-Attention Integration for Vision-Language-Action Models

$\mathrm{TIME}[t]\subseteq \mathrm{SPACE}[O(\sqrt{t})]$ via Tree Height Compression

Visual Document Understanding and Reasoning: A Multi-Agent Collaboration Framework with Agent-Wise Adaptive Test-Time Scaling

FastDriveVLA: Efficient End-to-End Driving via Plug-and-Play Reconstruction-based Token Pruning

First-Order Error Matters: Accurate Compensation for Quantized Large Language Models

StreamDiT: Real-Time Streaming Text-to-Video Generation

NOCTIS: Novel Object Cyclic Threshold based Instance Segmentation

On the Necessity of Output Distribution Reweighting for Effective Class Unlearning

Orthogonal Soft Pruning for Efficient Class Unlearning

Optimization-Induced Dynamics of Lipschitz Continuity in Neural Networks

Self-supervised Learning of Echocardiographic Video Representations via Online Cluster Distillation

Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Models

Zero-Shot Temporal Interaction Localization for Egocentric Videos

Latent Principle Discovery for Language Model Self-Improvement

Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuning

Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglement

$\textit{New News}$: System-2 Fine-tuning for Robust Integration of New Knowledge

Representation Meets Optimization: Training PINNs and PIKANs for Gray-Box Discovery in Systems Pharmacology

Walk Before You Dance: High-fidelity and Editable Dance Synthesis via Generative Masked Motion Prior

Mining--Gym: A Configurable RL Benchmarking Environment for Truck Dispatch Scheduling

The Empty Chair: Using LLMs to Raise Missing Perspectives in Policy Deliberations

Concept-as-Tree: A Controllable Synthetic Data Framework Makes Stronger Personalized VLMs

FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA

RAG-Enhanced Collaborative LLM Agents for Drug Discovery

Text-to-SQL Domain Adaptation via Human-LLM Collaborative Data Annotation

FQ-PETR: Fully Quantized Position Embedding Transformation for Multi-View 3D Object Detection

Enhanced Structured Lasso Pruning with Class-wise Information

Efficient Image Restoration via Latent Consistency Flow Matching

Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training

The Temporal Trap: Entanglement in Pre-Trained Visual Representations for Visuomotor Policy Learning

LDC: Learning to Generate Research Idea with Dynamic Control

MOSABench: Multi-Object Sentiment Analysis Benchmark for Evaluating Multimodal Large Language Models Understanding of Complex Image

DreamRunner: Fine-Grained Compositional Story-to-Video Generation with Retrieval-Augmented Motion Adaptation

Strada-LLM: Graph LLM for traffic prediction

Towards Formalizing Spuriousness of Biased Datasets Using Partial Information Decomposition

Are language models rational? The case of coherence norms and belief revision

Posterior Label Smoothing for Node Classification

Partial Information Decomposition for Data Interpretability and Feature Selection

Fractured Glass, Failing Cameras: Simulating Physics-Based Adversarial Samples for Autonomous Driving Systems

MoPE: Mixture of Prompt Experts for Parameter-Efficient and Scalable Multimodal Fusion

Survey in Characterization of Semantic Change

GreatSplicing: A Semantically Rich Splicing Dataset

Bi-Level Contextual Bandits for Individualized Resource Allocation under Delayed Feedback

Strategic Opponent Modeling with Graph Neural Networks, Deep Reinforcement Learning and Probabilistic Topic Modeling

Intelligence Foundation Model: A New Perspective to Approach Artificial General Intelligence

Enhancing the Medical Context-Awareness Ability of LLMs via Multifaceted Self-Refinement Learning

OIDA-QA: A Multimodal Benchmark for Analyzing the Opioid Industry Documents Archive

Proceedings of the Second International Workshop on Next-Generation Language Models for Knowledge Representation and Reasoning (NeLaMKRR 2025)

An Efficient Training Pipeline for Reasoning Graphical User Interface Agents

Thinker: Training LLMs in Hierarchical Thinking for Deep Search via Multi-Turn Interaction

Data Complexity of Querying Description Logic Knowledge Bases under Cost-Based Semantics

Spilling the Beans: Teaching LLMs to Self-Report Their Hidden Objectives

Synthetic Data-Driven Prompt Tuning for Financial QA over Tables and Documents

Large Language Model-assisted Autonomous Vehicle Recovery from Immobilization

VoiceAgentEval: A Dual-Dimensional Benchmark for Expert-Level Intelligent Voice-Agent Evaluation of Xbench's Professional-Aligned Series

Practical, Utilitarian Algorithm Configuration

Clutch Control: An Attention-based Combinatorial Bandit for Efficient Mutation in JavaScript Engine Fuzzing

The Carbon Footprint Wizard: A Knowledge-Augmented AI Interface for Streamlining Food Carbon Footprint Analysis

NetGent: Agent-Based Automation of Network Application Workflows

CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal Knowledge

Optimizing Multi-Tier Supply Chain Ordering with LNN+XGBoost: Mitigating the Bullwhip Effect

Efficient Story Point Estimation With Comparative Learning

Comprehension Without Competence: Architectural Limits of LLMs in Symbolic Computation and Reasoning

MUDAS: Mote-scale Unsupervised Domain Adaptation in Multi-label Sound Classification

Modeling the Diachronic Evolution of Legal Norms: An LRMoo-Based, Component-Level, Event-Centric Approach to Legal Knowledge Graphs

Sensory-Motor Control with Large Language Models via Iterative Policy Refinement

AROMA: Autonomous Rank-one Matrix Adaptation

Created by

Haebom

저자

Hao Nan Sheng, Zhi-yong Wang, Mingrui Yang, Hing Cheung So

개요

본 논문은 대규모 언어 모델의 매개변수 효율적인 미세 조정을 위한 새로운 프레임워크인 AROMA를 제안합니다. 기존의 저계수 적응(LoRA) 및 적응형 저계수 적응(AdaLoRA) 방법의 한계를 극복하기 위해, AROMA는 계층별 업데이트를 자동으로 구성하는 이중 루프 아키텍처를 사용합니다. 내부 루프는 각 계수-1 부분 공간에서 정보를 추출하고, 외부 루프는 최적의 계수(즉, 계수-1 부분 공간의 수)를 결정합니다. 매개변수 수를 크게 줄이면서 자연어 이해 및 상식 추론 작업에서 우수한 성능을 달성합니다.

시사점, 한계점

•

시사점:

◦

기존의 LoRA와 AdaLoRA보다 매개변수 수를 크게 줄이면서 우수한 성능을 달성하는 새로운 매개변수 효율적인 미세 조정 방법을 제시합니다.

◦

계층별 업데이트를 자동으로 구성하여 최적의 계수를 동적으로 결정하는 효율적인 메커니즘을 제공합니다.

◦

자연어 이해 및 상식 추론 작업에서 성능 향상을 보여줍니다.

◦

오픈소스 코드를 공개하여 접근성을 높였습니다.

•

한계점:

◦

AROMA의 성능이 모든 종류의 대규모 언어 모델과 작업에 대해 우수한지는 추가적인 실험을 통해 검증이 필요합니다.

◦

이중 루프 아키텍처의 복잡성으로 인해 훈련 시간이 증가할 가능성이 있습니다.

◦

다양한 하이퍼파라미터에 대한 최적화가 필요할 수 있습니다.

Made with Slashpage