Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Inductive Moment Matching

LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL

Ideas in Inference-time Scaling can Benefit Generative Pre-training Algorithms

FaceID-6M: A Large-Scale, Open-Source FaceID Customization Dataset

Interactive Medical Image Analysis with Concept-based Similarity Reasoning

Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models

LightMotion: A Light and Tuning-free Method for Simulating Camera Motion in Video Generation

A Transformer Model for Predicting Chemical Reaction Products from Generic Templates

CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarking

The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own

VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control

Multi-Task Reinforcement Learning Enables Parameter Scaling

Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models

Prediction of Frozen Region Growth in Kidney Cryoablation Intervention Using a 3D Flow-Matching Model

Call for Rigor in Reporting Quality of Instruction Tuning Data

KunlunBaize: LLM with Multi-Scale Convolution and Multi-Token Prediction Under TransformerX Framework

(How) Do Language Models Track State?

IterPref: Focal Preference Learning for Code Generation via Iterative Debugging

PaCA: Partial Connection Adaptation for Efficient Fine-Tuning

Forgotten Polygons: Multimodal Large Language Models are Shape-Blind

Q-PETR: Quant-aware Position Embedding Transformation for Multi-View 3D Object Detection

FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling

Helix-mRNA: A Hybrid Foundation Model For Full Sequence mRNA Therapeutics

IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation

Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Models

Equivariant Masked Position Prediction for Efficient Molecular Representation

IRepair: An Intent-Aware Approach to Repair Data-Driven Errors in Large Language Models

Automated Consistency Analysis of LLMs

ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templates

Rationalization Models for Text-to-SQL

Reflection-Window Decoding: Text Generation with Selective Refinement

Agentic Bug Reproduction for Effective Automated Program Repair at Google

Data Duplication: A Novel Multi-Purpose Attack Paradigm in Machine Unlearning

MambaQuant: Quantizing the Mamba Family with Variance Aligned Rotation Methods

KAA: Kolmogorov-Arnold Attention for Enhancing Attentive Graph Neural Networks

TexAVi: Generating Stereoscopic VR Video Clips from Text Descriptions

Multi-P$^2$A: A Multi-perspective Benchmark on Privacy Assessment for Large Vision-Language Models

Faster Vision Mamba is Rebuilt in Minutes via Merged Token Re-training

SweetTok: Semantic-Aware Spatial-Temporal Tokenizer for Compact Video Discretization

DMin: Scalable Training Data Influence Estimation for Diffusion Models

MAGIC: Mastering Physical Adversarial Generation in Context through Collaborative LLM Agents

LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Models

RL-MILP Solver: A Reinforcement Learning Approach for Solving Mixed-Integer Linear Programs with Graph Neural Networks

Proto Successor Measure: Representing the Behavior Space of an RL Agent

KinMo: Kinematic-aware Human Motion Understanding and Generation

Towards Million-Scale Adversarial Robustness Evaluation With Stronger Individual Attacks

OminiControl: Minimal and Universal Control for Diffusion Transformer

MTA: Multimodal Task Alignment for BEV Perception and Captioning

PyGen: A Collaborative Human-AI Approach to Python Package Creation

Fair Summarization: Bridging Quality and Diversity in Extractive Summaries

AtlasSeg: Atlas Prior Guided Dual-U-Net for Cortical Segmentation in Fetal Brain MRI

V-LoRA: An Efficient and Flexible System Boosts Vision Applications with LoRA LMM

Fourier Head: Helping Large Language Models Learn Complex Probability Distributions

Conditional diffusions for neural posterior estimation

LLM-HDR: Bridging LLM-based Perception and Self-Supervision for Unpaired LDR-to-HDR Image Reconstruction

Chemistry-Inspired Diffusion with Non-Differentiable Guidance

Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion

6DGS: Enhanced Direction-Aware Gaussian Splatting for Volumetric Rendering

CAX: Cellular Automata Accelerated in JAX

Emotion-Aware Embedding Fusion in LLMs (Flan-T5, LLAMA 2, DeepSeek-R1, and ChatGPT 4) for Intelligent Response Generation

What Information Contributes to Log-based Anomaly Detection? Insights from a Configurable Transformer-Based Approach

Meta-RTL: Reinforcement-Based Meta-Transfer Learning for Low-Resource Commonsense Reasoning

LEMMo-Plan: LLM-Enhanced Learning from Multi-Modal Demonstration for Planning Sequential Contact-Rich Manipulation Tasks

Training with Differential Privacy: A Gradient-Preserving Noise Reduction Approach with Provable Security

ASMA: An Adaptive Safety Margin Algorithm for Vision-Language Drone Navigation via Scene-Aware Control Barrier Functions

Surgical SAM 2: Real-time Segment Anything in Surgical Video by Efficient Frame Pruning

Inference-Time Selective Debiasing to Enhance Fairness in Text Classification Models

Detect, Investigate, Judge and Determine: A Knowledge-guided Framework for Few-shot Fake News Detection

How Data Inter-connectivity Shapes LLMs Unlearning: A Structural Unlearning Perspective

Value Improved Actor Critic Algorithms

Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Search

Curriculum Direct Preference Optimization for Diffusion and Consistency Models

Is the House Ready For Sleeptime? Generating and Evaluating Situational Queries for Embodied Question Answering

RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion

Adversarial Guided Diffusion Models for Adversarial Purification

M-HOF-Opt: Multi-Objective Hierarchical Output Feedback Optimization via Multiplier Induced Loss Landscape Scheduling

The VampPrior Mixture Model

Regularization by Texts for Latent Diffusion Inverse Solvers

Deep Tensor Network

Identifying the Truth of Global Model: A Generic Solution to Defend Against Byzantine and Backdoor Attacks in Federated Learning (full version)

Generalizable Imitation Learning Through Pre-Trained Representations

Hypergraph Structure Inference From Data Under Smoothness Prior

HowkGPT: Investigating the Detection of ChatGPT-generated University Student Homework through Context-Aware Perplexity Analysis

SketchOGD: Memory-Efficient Continual Learning

ChatGPT-4 in the Turing Test: A Critical Analysis

Toward an Evaluation Science for Generative AI Systems

WritingBench: A Comprehensive Benchmark for Generative Writing

ToolFuzz -- Automated Agent Tool Testing

Building Interval Type-2 Fuzzy Membership Function: A Deck of Cards based Co-constructive Approach

Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policy

Learning to Plan with Personalized Preferences

Exponential Speedups by Rerooting Levin Tree Search

A Unified Framework for Motion Reasoning and Generation in Human Interaction

Agent-Oriented Planning in Multi-Agent Systems

Dynamic Analysis and Adaptive Discriminator for Fake News Detection

A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models

AI Data Readiness Inspector (AIDRIN) for Quantitative Assessment of Data Readiness for AI

Nondeterministic Causal Models

X-SHIELD: Regularization for eXplainable Artificial Intelligence

Categorical semantics of compositional reinforcement learning

InterFeedback: Unveiling Interactive Intelligence of Large Multimodal Models via Human Feedback

Created by

Haebom

저자

Henry Hengyuan Zhao, Wenqi Pei, Yifei Tao, Haiyang Mei, Mike Zheng Shou

개요

본 논문은 대규모 다중 모달 모델(LMM)의 인간 사용자와의 상호 작용 지능을 평가하기 위한 새로운 상호 피드백 프레임워크인 InterFeedback을 제시합니다. InterFeedback는 어떤 LMM과 데이터셋에도 적용 가능하며, MMMU-Pro와 MathVerse 데이터셋을 사용하여 10개의 오픈소스 LMM을 평가하는 InterFeedback-Bench와, OpenAI-o1 및 Claude-3.5-Sonnet과 같은 선도적 모델들을 수동으로 평가하기 위한 120개의 사례로 구성된 InterFeedback-Human 데이터셋을 함께 소개합니다. 평가 결과, 최첨단 LMM인 OpenAI-o1조차도 인간의 피드백을 기반으로 응답을 개선하는 데 어려움을 겪고 평균 50% 미만의 점수를 얻었다는 것을 보여줍니다. 이는 LMM이 피드백을 해석하고 활용하는 능력을 향상시키는 방법의 필요성을 시사합니다.

시사점, 한계점

•

시사점:

◦

LMM의 상호 작용 지능 평가를 위한 새로운 프레임워크(InterFeedback) 제시

◦

최첨단 LMM의 상호 작용 지능 수준이 아직 미흡함을 밝힘

◦

LMM의 피드백 해석 및 활용 능력 향상 연구의 필요성 제기

◦

InterFeedback-Bench 및 InterFeedback-Human 데이터셋 제공을 통한 LMM 연구의 발전에 기여

•

한계점:

◦

InterFeedback-Human 데이터셋의 규모가 상대적으로 작음 (120 cases)

◦

평가 대상 LMM의 종류 및 수 제한 (10개 오픈소스 LMM)

◦

다양한 유형의 상호 작용 및 피드백 유형에 대한 포괄적인 평가가 부족할 수 있음

Made with SlashPage