Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

MuseControlLite: Multifunctional Music Generation with Lightweight Conditioners

Benchmarking the Pedagogical Knowledge of Large Language Models

ReDit: Reward Dithering for Improved LLM Policy Optimization

Multimodal Fusion SLAM with Fourier Attention

Understanding Reasoning in Thinking Language Models via Steering Vectors

KAG-Thinker: Interactive Thinking and Deep Reasoning in LLMs via Knowledge-Augmented Generation

Research on Model Parallelism and Data Parallelism Optimization Methods in Large Language Model-Based Recommendation Systems

AI-based Multimodal Biometrics for Detecting Smartphone Distractions: Application to Online Learning

PBFT-Backed Semantic Voting for Multi-Agent Memory Pruning

Long-Context Generalization with Sparse Attention

SycnMapV2: Robust and Adaptive Unsupervised Segmentation

TrainVerify: Equivalence-Based Verification for Distributed LLM Training

Human-Centered Editable Speech-to-Sign-Language Generation via Streaming Conformer-Transformer and Resampling Hook

AntiGrounding: Lifting Robotic Actions into VLM Representation Space for Decision Making

DaMO: A Data-Efficient Multimodal Orchestrator for Temporal Reasoning with Video LLMs

Time-IMM: A Dataset and Benchmark for Irregular Multimodal Multivariate Time Series

Understanding Human-AI Trust in Education

cuVSLAM: CUDA accelerated visual odometry and mapping

TeViR: Text-to-Video Reward with Diffusion Models for Efficient Reinforcement Learning

SSPS: Self-Supervised Positive Sampling for Robust Self-Supervised Speaker Verification

Disentangling Reasoning and Knowledge in Medical Large Language Models

Process Reward Models That Think

AI-Assisted Transport of Radioactive Ion Beams

Robust Reinforcement Learning from Human Feedback for Large Language Models Fine-Tuning

Defeating Prompt Injections by Design

CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilities

AI-Facilitated Episodic Future Thinking For Adults with Obesity

AI-Enhanced Deliberative Democracy and the Future of the Collective Will

Robust Optimization with Diffusion Models for Green Security

VesselSAM: Leveraging SAM for Aortic Vessel Segmentation with AtrousLoRA

SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation

Language Model Re-rankers are Fooled by Lexical Similarities

Evaluating link prediction: New perspectives and recommendations

"I know myself better, but not really greatly": How Well Can LLMs Detect and Explain LLM-Generated Texts?

Towards Unsupervised Multi-Agent Reinforcement Learning via Task-Agnostic Exploration

Controllable Video Generation with Provable Disentanglement

Towards Robust Stability Prediction in Smart Grids: GAN-based Approach under Data Constraints and Adversarial Challenges

Exploring the Collaborative Co-Creation Process with AI: A Case Study in Novice Music Production

Leveraging Large Language Models to Democratize Access to Costly Datasets for Academic Research

Mixture of Cache-Conditional Experts for Efficient Mobile Device Inference

LAuReL: Learned Augmented Residual Layer

Do Vendi Scores Converge with Finite Samples? Truncated Vendi Score for Finite-Sample Convergence Guarantees

Multi-Continental Healthcare Modelling Using Blockchain-Enabled Federated Learning

Rational Metareasoning for Large Language Models

MOST: MR reconstruction Optimization for multiple downStream Tasks via continual learning

ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model

ASR-enhanced Multimodal Representation Learning for Cross-Domain Product Retrieval

Evaluating Transparent Reasoning in Large Language Models for Accountable Critical Tasks

Multimodal Machine Learning in Mental Health: A Survey of Data, Algorithms, and Challenges

Rich Interoperable Metadata for Cultural Heritage Projects at Jagiellonian University

Detecting Machine-Generated Texts: Not Just "AI vs Humans" and Explainability is Complicated

Exclusive Style Removal for Cross Domain Novel Class Discovery

ClimateIQA: A New Dataset and Benchmark to Advance Vision-Language Models in Meteorology Anomalies Analysis

Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding Challenges

Unified Neural Backdoor Removal with Only Few Clean Samples through Unlearning and Relearning

A Certified Proof Checker for Deep Neural Network Verification in Imandra

ECG-SMART-NET: A Deep Learning Architecture for Precise ECG Diagnosis of Occlusion Myocardial Infarction

ContactDexNet: Multi-fingered Robotic Hand Grasping in Cluttered Environments through Hand-object Contact Semantic Mapping

The Elements of Differentiable Programming

Align and Distill: Unifying and Improving Domain Adaptive Object Detection

Interrogating AI: Characterizing Emergent Playful Interactions with ChatGPT

Sum-of-Parts: Self-Attributing Neural Networks with End-to-End Learning of Feature Groups

DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editing

Impact of Visual Context on Noisy Multimodal NMT: An Empirical Study for English to Indian Languages

DF2: Distribution-Free Decision-Focused Learning

jina-embeddings-v4: Universal Embeddings for Multimodal Multilingual Retrieval

ConciseHint: Boosting Efficient Reasoning via Continuous Concise Hints during Generation

HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challenges

RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning

MCP-Zero: Active Tool Discovery for Autonomous LLM Agents

What do professional software developers need to know to succeed in an age of Artificial Intelligence?

Emergent Risk Awareness in Rational Agents under Resource Constraints

Smart Traffic Signals: Comparing MARL and Fixed-Time Strategies

TRAIL: Trace Reasoning and Agentic Issue Localization

Lemmanaid: Neuro-Symbolic Lemma Conjecturing

Perspective-Shifted Neuro-Symbolic World Models: A Framework for Socially-Aware Robot Navigation

Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Proving

Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Models

Large language models for automated scholarly paper review: A survey

ChatSR: Multimodal Large Language Models for Scientific Formula Discovery

Radial Attention: $O(n\log n)$ Sparse Attention with Energy Decay for Long Video Generation

Orthogonal Finetuning Made Scalable

Improving Progressive Generation with Decomposable Flow Matching

A standard transformer and attention with linear biases for molecular conformer generation

Persona Features Control Emergent Misalignment

Why Do Open-Source LLMs Struggle with Data Analysis? A Systematic Empirical Study

Alleviating User-Sensitive bias with Fair Generative Sequential Recommendation Model

Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation

A Survey of Multi-sensor Fusion Perception for Embodied AI: Background, Methods, Challenges and Prospects

SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning

Cross-regularization: Adaptive Model Complexity through Validation Gradients

Arabic Dialect Classification using RNNs, Transformers, and Large Language Models: A Comparative Analysis

NeRF-based CBCT Reconstruction needs Normalization and Initialization

Who Does What in Deep Learning? Multidimensional Game-Theoretic Attribution of Function of Neural Units

Geometric-Aware Variational Inference: Robust and Adaptive Regularization with Directional Weight Uncertainty

Uncovering Conceptual Blindspots in Generative Image Models Using Sparse Autoencoders

Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models

When Can We Reuse a Calibration Set for Multiple Conformal Predictions?

Semantic Scene Graph for Ultrasound Image Explanation and Scanning Guidance

Tailored Conversations beyond LLMs: A RL-Based Dialogue Manager

DaMO: A Data-Efficient Multimodal Orchestrator for Temporal Reasoning with Video LLMs

Created by

Haebom

저자

Bo-Cheng Chiu, Jen-Jee Chen, Yu-Chee Tseng, Feng-Chi Chen

개요

본 논문은 정확한 시간적 추론과 다중 모달 이해를 위해 특별히 설계된 데이터 효율적인 비디오 LLM인 DaMO를 제안합니다. DaMO는 계층적 이중 스트림 아키텍처를 사용하는 Temporal-aware Fuseformer를 중심으로, 각 모달 내의 시간적 역동성을 점진적으로 포착하고 상호 보완적인 시각 및 음향 정보를 효과적으로 융합합니다. 공간적 중복성을 줄이면서 필수적인 의미적 세부 정보를 유지하기 위해 전역 잔차를 통합하여 계산 효율성을 높입니다. 다중 모달 정렬, 의미적 근거, 시간적 추론 기능을 점진적으로 갖추도록 하는 4단계의 점진적 훈련 패러다임을 통해 DaMO를 훈련합니다. 또한, 시간적 감독이 필요한 작업을 위해 GPT가 생성한 시간적 근거 QA 쌍으로 확장된 여러 데이터셋을 제공합니다. 시간적 근거 및 비디오 QA 벤치마크에 대한 종합적인 실험을 통해 DaMO가 특히 정확한 시간적 정렬 및 추론을 요구하는 작업에서 이전 방법들을 꾸준히 능가함을 보여줍니다.

시사점, 한계점

•

시사점:

◦

데이터 효율적인 비디오 LLM인 DaMO를 제시하여, 제한된 감독 하에서도 정확한 시간적 추론과 다중 모달 이해가 가능함을 보여줌.

◦

Temporal-aware Fuseformer와 4단계 점진적 훈련 패러다임을 통해 시간적 추론 성능 향상.

◦

GPT를 활용한 데이터 증강으로 시간적 감독이 필요한 작업의 성능 향상.

◦

시간적 정렬 및 추론을 요구하는 작업에서 기존 방법들을 능가하는 성능 달성.

•

한계점:

◦

제안된 방법의 일반화 성능에 대한 추가적인 분석 필요.

◦

다양한 비디오 유형에 대한 로버스트니스 평가 필요.

◦

더욱 복잡하고 장시간의 비디오에 대한 성능 평가 필요.

◦

계산 비용 및 메모리 사용량에 대한 상세한 분석 필요.

Made with Slashpage