Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Inductive Moment Matching

LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL

Ideas in Inference-time Scaling can Benefit Generative Pre-training Algorithms

FaceID-6M: A Large-Scale, Open-Source FaceID Customization Dataset

Interactive Medical Image Analysis with Concept-based Similarity Reasoning

Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models

LightMotion: A Light and Tuning-free Method for Simulating Camera Motion in Video Generation

A Transformer Model for Predicting Chemical Reaction Products from Generic Templates

CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarking

The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own

VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control

Multi-Task Reinforcement Learning Enables Parameter Scaling

Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models

Prediction of Frozen Region Growth in Kidney Cryoablation Intervention Using a 3D Flow-Matching Model

Call for Rigor in Reporting Quality of Instruction Tuning Data

KunlunBaize: LLM with Multi-Scale Convolution and Multi-Token Prediction Under TransformerX Framework

(How) Do Language Models Track State?

IterPref: Focal Preference Learning for Code Generation via Iterative Debugging

PaCA: Partial Connection Adaptation for Efficient Fine-Tuning

Forgotten Polygons: Multimodal Large Language Models are Shape-Blind

Q-PETR: Quant-aware Position Embedding Transformation for Multi-View 3D Object Detection

FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling

Helix-mRNA: A Hybrid Foundation Model For Full Sequence mRNA Therapeutics

IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation

Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Models

Equivariant Masked Position Prediction for Efficient Molecular Representation

IRepair: An Intent-Aware Approach to Repair Data-Driven Errors in Large Language Models

Automated Consistency Analysis of LLMs

ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templates

Rationalization Models for Text-to-SQL

Reflection-Window Decoding: Text Generation with Selective Refinement

Agentic Bug Reproduction for Effective Automated Program Repair at Google

Data Duplication: A Novel Multi-Purpose Attack Paradigm in Machine Unlearning

MambaQuant: Quantizing the Mamba Family with Variance Aligned Rotation Methods

KAA: Kolmogorov-Arnold Attention for Enhancing Attentive Graph Neural Networks

TexAVi: Generating Stereoscopic VR Video Clips from Text Descriptions

Multi-P$^2$A: A Multi-perspective Benchmark on Privacy Assessment for Large Vision-Language Models

Faster Vision Mamba is Rebuilt in Minutes via Merged Token Re-training

SweetTok: Semantic-Aware Spatial-Temporal Tokenizer for Compact Video Discretization

DMin: Scalable Training Data Influence Estimation for Diffusion Models

MAGIC: Mastering Physical Adversarial Generation in Context through Collaborative LLM Agents

LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Models

RL-MILP Solver: A Reinforcement Learning Approach for Solving Mixed-Integer Linear Programs with Graph Neural Networks

Proto Successor Measure: Representing the Behavior Space of an RL Agent

KinMo: Kinematic-aware Human Motion Understanding and Generation

Towards Million-Scale Adversarial Robustness Evaluation With Stronger Individual Attacks

OminiControl: Minimal and Universal Control for Diffusion Transformer

MTA: Multimodal Task Alignment for BEV Perception and Captioning

PyGen: A Collaborative Human-AI Approach to Python Package Creation

Fair Summarization: Bridging Quality and Diversity in Extractive Summaries

AtlasSeg: Atlas Prior Guided Dual-U-Net for Cortical Segmentation in Fetal Brain MRI

V-LoRA: An Efficient and Flexible System Boosts Vision Applications with LoRA LMM

Fourier Head: Helping Large Language Models Learn Complex Probability Distributions

Conditional diffusions for neural posterior estimation

LLM-HDR: Bridging LLM-based Perception and Self-Supervision for Unpaired LDR-to-HDR Image Reconstruction

Chemistry-Inspired Diffusion with Non-Differentiable Guidance

Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion

6DGS: Enhanced Direction-Aware Gaussian Splatting for Volumetric Rendering

CAX: Cellular Automata Accelerated in JAX

Emotion-Aware Embedding Fusion in LLMs (Flan-T5, LLAMA 2, DeepSeek-R1, and ChatGPT 4) for Intelligent Response Generation

What Information Contributes to Log-based Anomaly Detection? Insights from a Configurable Transformer-Based Approach

Meta-RTL: Reinforcement-Based Meta-Transfer Learning for Low-Resource Commonsense Reasoning

LEMMo-Plan: LLM-Enhanced Learning from Multi-Modal Demonstration for Planning Sequential Contact-Rich Manipulation Tasks

Training with Differential Privacy: A Gradient-Preserving Noise Reduction Approach with Provable Security

ASMA: An Adaptive Safety Margin Algorithm for Vision-Language Drone Navigation via Scene-Aware Control Barrier Functions

Surgical SAM 2: Real-time Segment Anything in Surgical Video by Efficient Frame Pruning

Inference-Time Selective Debiasing to Enhance Fairness in Text Classification Models

Detect, Investigate, Judge and Determine: A Knowledge-guided Framework for Few-shot Fake News Detection

How Data Inter-connectivity Shapes LLMs Unlearning: A Structural Unlearning Perspective

Value Improved Actor Critic Algorithms

Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Search

Curriculum Direct Preference Optimization for Diffusion and Consistency Models

Is the House Ready For Sleeptime? Generating and Evaluating Situational Queries for Embodied Question Answering

RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion

Adversarial Guided Diffusion Models for Adversarial Purification

M-HOF-Opt: Multi-Objective Hierarchical Output Feedback Optimization via Multiplier Induced Loss Landscape Scheduling

The VampPrior Mixture Model

Regularization by Texts for Latent Diffusion Inverse Solvers

Deep Tensor Network

Identifying the Truth of Global Model: A Generic Solution to Defend Against Byzantine and Backdoor Attacks in Federated Learning (full version)

Generalizable Imitation Learning Through Pre-Trained Representations

Hypergraph Structure Inference From Data Under Smoothness Prior

HowkGPT: Investigating the Detection of ChatGPT-generated University Student Homework through Context-Aware Perplexity Analysis

SketchOGD: Memory-Efficient Continual Learning

ChatGPT-4 in the Turing Test: A Critical Analysis

Toward an Evaluation Science for Generative AI Systems

WritingBench: A Comprehensive Benchmark for Generative Writing

ToolFuzz -- Automated Agent Tool Testing

Building Interval Type-2 Fuzzy Membership Function: A Deck of Cards based Co-constructive Approach

Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policy

Learning to Plan with Personalized Preferences

Exponential Speedups by Rerooting Levin Tree Search

A Unified Framework for Motion Reasoning and Generation in Human Interaction

Agent-Oriented Planning in Multi-Agent Systems

Dynamic Analysis and Adaptive Discriminator for Fake News Detection

A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models

AI Data Readiness Inspector (AIDRIN) for Quantitative Assessment of Data Readiness for AI

Nondeterministic Causal Models

X-SHIELD: Regularization for eXplainable Artificial Intelligence

Categorical semantics of compositional reinforcement learning

Faster Vision Mamba is Rebuilt in Minutes via Merged Token Re-training

Created by

Haebom

저자

Mingjia Shi, Yuhao Zhou, Ruiji Yu, Zekai Li, Zhiyuan Liang, Xuanlei Zhao, Xiaojiang Peng, Shanmukha Ramakrishna Vedantam, Wangbo Zhao, Kai Wang, Yang You

개요

Vision Mamba의 효율성을 높이기 위한 연구로, 토큰 감소 기법을 적용했습니다. 기존의 토큰 제거 방식은 성능 저하를 야기하는 반면, 토큰 병합 방식은 정보 손실을 줄이지만 높은 압축률에서는 성능이 저하됩니다. 본 연구는 토큰 병합 후 빠른 재훈련을 통해 다양한 압축률에서 견고한 성능을 얻는 방법을 제시합니다. ImageNet-1K에서 토큰이 제거된 Vim의 정확도 저하(최대 0.9%)를 제안된 R-MeeTo 프레임워크로 회복시켰으며, Vim-Ti의 경우 3 epoch의 재훈련으로 35.9%의 정확도 향상을 달성했습니다. Vim-Ti/S/B는 각각 5/7/17분 내에 재훈련되었고, Vim-S는 1.2배(최대 1.5배)의 추론 속도 향상과 함께 1.3%의 정확도 저하만 보였습니다.

시사점, 한계점

•

시사점:

◦

토큰 병합 후 재훈련을 통해 Vision Mamba의 효율성을 크게 향상시킬 수 있음을 보여줌.

◦

빠른 재훈련(수 분 이내)으로도 괄목할 만한 성능 향상을 달성 가능함.

◦

추론 속도 향상과 정확도 저하 최소화를 동시에 달성 가능함.

•

한계점:

◦

제안된 방법의 일반화 성능에 대한 추가적인 검증 필요.

◦

다양한 비전 모델에 대한 적용 가능성 및 효과에 대한 추가 연구 필요.

◦

재훈련에 필요한 계산 비용 및 에너지 소모에 대한 분석 필요.

Made with SlashPage