Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

MuseControlLite: Multifunctional Music Generation with Lightweight Conditioners

Benchmarking the Pedagogical Knowledge of Large Language Models

ReDit: Reward Dithering for Improved LLM Policy Optimization

Multimodal Fusion SLAM with Fourier Attention

Understanding Reasoning in Thinking Language Models via Steering Vectors

KAG-Thinker: Interactive Thinking and Deep Reasoning in LLMs via Knowledge-Augmented Generation

Research on Model Parallelism and Data Parallelism Optimization Methods in Large Language Model-Based Recommendation Systems

AI-based Multimodal Biometrics for Detecting Smartphone Distractions: Application to Online Learning

PBFT-Backed Semantic Voting for Multi-Agent Memory Pruning

Long-Context Generalization with Sparse Attention

SycnMapV2: Robust and Adaptive Unsupervised Segmentation

TrainVerify: Equivalence-Based Verification for Distributed LLM Training

Human-Centered Editable Speech-to-Sign-Language Generation via Streaming Conformer-Transformer and Resampling Hook

AntiGrounding: Lifting Robotic Actions into VLM Representation Space for Decision Making

DaMO: A Data-Efficient Multimodal Orchestrator for Temporal Reasoning with Video LLMs

Time-IMM: A Dataset and Benchmark for Irregular Multimodal Multivariate Time Series

Understanding Human-AI Trust in Education

cuVSLAM: CUDA accelerated visual odometry and mapping

TeViR: Text-to-Video Reward with Diffusion Models for Efficient Reinforcement Learning

SSPS: Self-Supervised Positive Sampling for Robust Self-Supervised Speaker Verification

Disentangling Reasoning and Knowledge in Medical Large Language Models

Process Reward Models That Think

AI-Assisted Transport of Radioactive Ion Beams

Robust Reinforcement Learning from Human Feedback for Large Language Models Fine-Tuning

Defeating Prompt Injections by Design

CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilities

AI-Facilitated Episodic Future Thinking For Adults with Obesity

AI-Enhanced Deliberative Democracy and the Future of the Collective Will

Robust Optimization with Diffusion Models for Green Security

VesselSAM: Leveraging SAM for Aortic Vessel Segmentation with AtrousLoRA

SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation

Language Model Re-rankers are Fooled by Lexical Similarities

Evaluating link prediction: New perspectives and recommendations

"I know myself better, but not really greatly": How Well Can LLMs Detect and Explain LLM-Generated Texts?

Towards Unsupervised Multi-Agent Reinforcement Learning via Task-Agnostic Exploration

Controllable Video Generation with Provable Disentanglement

Towards Robust Stability Prediction in Smart Grids: GAN-based Approach under Data Constraints and Adversarial Challenges

Exploring the Collaborative Co-Creation Process with AI: A Case Study in Novice Music Production

Leveraging Large Language Models to Democratize Access to Costly Datasets for Academic Research

Mixture of Cache-Conditional Experts for Efficient Mobile Device Inference

LAuReL: Learned Augmented Residual Layer

Do Vendi Scores Converge with Finite Samples? Truncated Vendi Score for Finite-Sample Convergence Guarantees

Multi-Continental Healthcare Modelling Using Blockchain-Enabled Federated Learning

Rational Metareasoning for Large Language Models

MOST: MR reconstruction Optimization for multiple downStream Tasks via continual learning

ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model

ASR-enhanced Multimodal Representation Learning for Cross-Domain Product Retrieval

Evaluating Transparent Reasoning in Large Language Models for Accountable Critical Tasks

Multimodal Machine Learning in Mental Health: A Survey of Data, Algorithms, and Challenges

Rich Interoperable Metadata for Cultural Heritage Projects at Jagiellonian University

Detecting Machine-Generated Texts: Not Just "AI vs Humans" and Explainability is Complicated

Exclusive Style Removal for Cross Domain Novel Class Discovery

ClimateIQA: A New Dataset and Benchmark to Advance Vision-Language Models in Meteorology Anomalies Analysis

Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding Challenges

Unified Neural Backdoor Removal with Only Few Clean Samples through Unlearning and Relearning

A Certified Proof Checker for Deep Neural Network Verification in Imandra

ECG-SMART-NET: A Deep Learning Architecture for Precise ECG Diagnosis of Occlusion Myocardial Infarction

ContactDexNet: Multi-fingered Robotic Hand Grasping in Cluttered Environments through Hand-object Contact Semantic Mapping

The Elements of Differentiable Programming

Align and Distill: Unifying and Improving Domain Adaptive Object Detection

Interrogating AI: Characterizing Emergent Playful Interactions with ChatGPT

Sum-of-Parts: Self-Attributing Neural Networks with End-to-End Learning of Feature Groups

DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editing

Impact of Visual Context on Noisy Multimodal NMT: An Empirical Study for English to Indian Languages

DF2: Distribution-Free Decision-Focused Learning

jina-embeddings-v4: Universal Embeddings for Multimodal Multilingual Retrieval

ConciseHint: Boosting Efficient Reasoning via Continuous Concise Hints during Generation

HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challenges

RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning

MCP-Zero: Active Tool Discovery for Autonomous LLM Agents

What do professional software developers need to know to succeed in an age of Artificial Intelligence?

Emergent Risk Awareness in Rational Agents under Resource Constraints

Smart Traffic Signals: Comparing MARL and Fixed-Time Strategies

TRAIL: Trace Reasoning and Agentic Issue Localization

Lemmanaid: Neuro-Symbolic Lemma Conjecturing

Perspective-Shifted Neuro-Symbolic World Models: A Framework for Socially-Aware Robot Navigation

Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Proving

Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Models

Large language models for automated scholarly paper review: A survey

ChatSR: Multimodal Large Language Models for Scientific Formula Discovery

Radial Attention: $O(n\log n)$ Sparse Attention with Energy Decay for Long Video Generation

Orthogonal Finetuning Made Scalable

Improving Progressive Generation with Decomposable Flow Matching

A standard transformer and attention with linear biases for molecular conformer generation

Persona Features Control Emergent Misalignment

Why Do Open-Source LLMs Struggle with Data Analysis? A Systematic Empirical Study

Alleviating User-Sensitive bias with Fair Generative Sequential Recommendation Model

Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation

A Survey of Multi-sensor Fusion Perception for Embodied AI: Background, Methods, Challenges and Prospects

SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning

Cross-regularization: Adaptive Model Complexity through Validation Gradients

Arabic Dialect Classification using RNNs, Transformers, and Large Language Models: A Comparative Analysis

NeRF-based CBCT Reconstruction needs Normalization and Initialization

Who Does What in Deep Learning? Multidimensional Game-Theoretic Attribution of Function of Neural Units

Geometric-Aware Variational Inference: Robust and Adaptive Regularization with Directional Weight Uncertainty

Uncovering Conceptual Blindspots in Generative Image Models Using Sparse Autoencoders

Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models

When Can We Reuse a Calibration Set for Multiple Conformal Predictions?

Semantic Scene Graph for Ultrasound Image Explanation and Scanning Guidance

Tailored Conversations beyond LLMs: A RL-Based Dialogue Manager

Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation

Created by

Haebom

저자

Jun Wang, Xijuan Zeng, Chunyu Qiang, Ruilong Chen, Shiyao Wang, Le Wang, Wangjing Zhou, Pengfei Cai, Jiahui Zhao, Nan Li, Zihan Li, Yuzhe Liang, Xiaopeng Wang, Haorui Zheng, Ming Wen, Kang Yin, Yiran Wang, Nan Li, Feng Deng, Liang Dong, Chen Zhang, Di Zhang, Kun Gai

개요

Kling-Foley는 고품질의 비디오 동기화 오디오를 합성하는 대규모 다중 모달 비디오-오디오 생성 모델입니다. 비디오, 오디오, 텍스트 모달 간의 상호 작용을 모델링하기 위해 다중 모달 확산 트랜스포머를 도입하고, 시각적 의미 표현 모듈과 오디오-비주얼 동기화 모듈을 결합하여 정렬 기능을 향상시킵니다. 특히, 이러한 모듈은 프레임 단위로 비디오 조건을 잠재 오디오 요소와 정렬하여 의미적 정렬과 오디오-비주얼 동기화를 개선합니다. 텍스트 조건과 함께 이 통합된 접근 방식을 통해 비디오와 일치하는 사운드 효과를 정확하게 생성할 수 있습니다. 또한, 사운드 효과, 음성, 노래, 음악과 같은 다양한 시나리오에서 고품질 모델링을 달성할 수 있는 범용 잠재 오디오 코덱을 제안합니다. 합성된 오디오에 공간적 존재감을 부여하는 입체 렌더링 방법을 사용합니다. 또한, 오픈소스 벤치마크의 불완전한 유형과 주석을 보완하기 위해 산업 수준의 벤치마크인 Kling-Audio-Eval도 오픈소스로 공개합니다. 플로우 매칭 목표로 훈련된 Kling-Foley는 분포 매칭, 의미적 정렬, 시간적 정렬 및 오디오 품질 측면에서 공개 모델 중 새로운 오디오-비주얼 최첨단 성능을 달성합니다.

시사점, 한계점

•

시사점:

◦

고품질 비디오 동기화 오디오 합성을 위한 새로운 최첨단 모델 제시.

◦

다중 모달 확산 트랜스포머와 추가 모듈을 활용한 향상된 정렬 기능.

◦

다양한 오디오 유형(사운드 효과, 음성, 노래, 음악)에 대한 범용 잠재 오디오 코덱 개발.

◦

산업 수준의 오디오-비주얼 벤치마크 Kling-Audio-Eval 공개.

•

한계점:

◦

오픈소스 벤치마크의 불완전한 유형 및 주석에 대한 의존성(Kling-Audio-Eval 공개로 일부 해결).

◦

모델의 훈련 및 추론에 필요한 컴퓨팅 자원에 대한 명시적 언급 부족.

◦

모델의 일반화 성능에 대한 추가적인 평가 필요.

Made with Slashpage