Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics

HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarios

SASG-DA: Sparse-Aware Semantic-Guided Diffusion Augmentation For Myoelectric Gesture Recognition

DiffRegCD: Integrated Registration and Change Detection with Diffusion Features

Advancing mathematics research with generative AI

TiS-TSL: Image-Label Supervised Surgical Video Stereo Matching via Time-Switchable Teacher-Student Learning

Quantifying Edits Decay in Fine-tuned LLMs

Self-adaptive weighting and sampling for physics-informed neural networks

Too Good to be Bad: On the Failure of LLMs to Role-Play Villains

MERaLiON-SER: Robust Speech Emotion Recognition Model for English and SEA Languages

Prompt-Based Safety Guidance Is Ineffective for Unlearned Text-to-Image Diffusion Models

Reasoning Up the Instruction Ladder for Controllable Language Models

Prompt Injection as an Emerging Threat: Evaluating the Resilience of Large Language Models

PISA-Bench: The PISA Index as a Multilingual and Multimodal Metric for the Evaluation of Vision-Language Models

Aligning Diffusion Language Models via Unpaired Preference Optimization

TaoSR-AGRL: Adaptive Guided Reinforcement Learning Framework for E-commerce Search Relevance

Global Convergence of Policy Gradient for Entropy Regularized Linear-Quadratic Control with multiplicative noise

SecInfer: Preventing Prompt Injection via Inference-time Scaling

Towards Adapting Federated & Quantum Machine Learning for Network Intrusion Detection: A Survey

Symphony-MoE: Harmonizing Disparate Pre-trained Models into a Coherent Mixture-of-Experts

Machine Unlearning for Responsible and Adaptive AI in Education

KoopMotion: Learning Almost Divergence Free Koopman Flow Fields for Motion Planning

Where Should I Study? Biased Language Models Decide! Evaluating Fairness in LMs for Academic Recommendations

Radio Astronomy in the Era of Vision-Language Models: Prompt Sensitivity and Adaptation

SparK: Query-Aware Unstructured Sparsity with Recoverable KV Cache Channel Pruning

Survey of Vision-Language-Action Models for Embodied Manipulation

Mitigating Hallucinations in Large Language Models via Causal Reasoning

ComoRAG: A Cognitive-Inspired Memory-Organized RAG for Stateful Long Narrative Reasoning

M3-Net: A Cost-Effective Graph-Free MLP-Based Model for Traffic Prediction

The Power of Many: Synergistic Unification of Diverse Augmentations for Efficient Adversarial Robustness

Veli: Unsupervised Method and Unified Benchmark for Low-Cost Air Quality Sensor Correction

Asking the Right Questions: Benchmarking Large Language Models in the Development of Clinical Consultation Templates

M^2VAE: Multi-Modal Multi-View Variational Autoencoder for Cold-start Item Recommendation

IndoPref: A Multi-Domain Pairwise Preference Dataset for Indonesian

Bridging Synthetic and Real-World Domains: A Human-in-the-Loop Weakly-Supervised Framework for Industrial Toxic Emission Segmentation

Bayesian preference elicitation for decision support in multiobjective optimization

Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper

Kodezi Chronos: A Debugging-First Language Model for Repository-Scale Code Understanding

Simulation as Supervision: Mechanistic Pretraining for Scientific Discovery

A Personalised Formal Verification Framework for Monitoring Activities of Daily Living of Older Adults Living Independently in Their Homes

Knowledge-Guided Brain Tumor Segmentation via Synchronized Visual-Semantic-Topological Prior Fusion

Geo-Registration of Terrestrial LiDAR Point Clouds with Satellite Images without GNSS

TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Driving

What Do Latent Action Models Actually Learn?

Capturing Polysemanticity with PRISM: A Multi-Concept Feature Description Framework

Flat Channels to Infinity in Neural Loss Landscapes

Edit Flows: Flow Matching with Edit Operations

MoE-Gyro: Self-Supervised Over-Range Reconstruction and Denoising for MEMS Gyroscopes

Joint-GCG: Unified Gradient-Based Poisoning Attacks on Retrieval-Augmented Generation Systems

An empirical study of task and feature correlations in the reuse of pre-trained models

anyECG-chat: A Generalist ECG-MLLM for Flexible ECG Input and Multi-Task Understanding

Solver-Free Decision-Focused Learning for Linear Optimization Problems

The Feasibility of Topic-Based Watermarking on Academic Peer Reviews

Military AI Needs Technically-Informed Regulation to Safeguard AI Research and its Applications

FS-DAG: Few Shot Domain Adapting Graph Networks for Visually Rich Document Understanding

Teaching Large Language Models to Maintain Contextual Faithfulness via Synthetic Tasks and Reinforcement Learning

Trajectory Bellman Residual Minimization: A Simple Value-Based Method for LLM Reasoning

Polar Sparsity: High Throughput Batched LLM Inferencing with Scalable Contextual Sparsity

RefiDiff: Progressive Refinement Diffusion for Efficient Missing Data Imputation

Rainbow Delay Compensation: A Multi-Agent Reinforcement Learning Framework for Mitigating Delayed Observation

ViSA-Flow: Accelerating Robot Skill Learning via Large-Scale Video Semantic Action Flow

Uncertainty Quantification for Language Models: A Suite of Black-Box, White-Box, LLM Judge, and Ensemble Scorers

MOSAIC: A Skill-Centric Algorithmic Framework for Long-Horizon Manipulation Planning

DataSentinel: A Game-Theoretic Detection of Prompt Injection Attacks

Repetitive Contrastive Learning Enhances Mamba's Selectivity in Time Series Prediction

Generalization Bounds in Hybrid Quantum-Classical Machine Learning Models

Beyond the Hype: Embeddings vs. Prompting for Multiclass Classification Tasks

Large Language Models Are Unreliable for Cyber Threat Intelligence

A Causal Framework to Measure and Mitigate Non-binary Treatment Discrimination

Evolutionary Policy Optimization

What's Producible May Not Be Reachable: Measuring the Steerability of Generative Models

MARS: Multi-Agent Adaptive Reasoning with Socratic Guidance for Automated Prompt Optimization

Prompt-OT: An Optimal Transport Regularization Paradigm for Knowledge Preservation in Vision-Language Model Adaptation

UDora: A Unified Red Teaming Framework against LLM Agents by Dynamically Hijacking Their Own Reasoning

A Simple and Effective Reinforcement Learning Method for Text-to-Image Diffusion Fine-tuning

Contextual Thompson Sampling via Generation of Missing Data

FedP$^2$EFT: Federated Learning to Personalize PEFT for Multilingual LLMs

Privacy-Preserving Retrieval-Augmented Generation with Differential Privacy

Certified Training with Branch-and-Bound for Lyapunov-stable Neural Control

Training and Evaluating Language Models with Template-based Data Generation

The Visual Counter Turing Test (VCT2): A Benchmark for Evaluating AI-Generated Image Detection and the Visual AI Index (VAI)

Conditional Distribution Learning for Graph Classification

Large Language Model Benchmarks in Medical Tasks

LLM4AD: Large Language Models for Autonomous Driving - Concept, Review, Benchmark, Experiments, and Future Trends

TeVAE: A Variational Autoencoder Approach for Discrete Online Anomaly Detection in Variable-state Multivariate Time-series Data

Multimodal Adversarial Defense for Vision-Language Models by Leveraging One-To-Many Relationships

An Information Theoretic Evaluation Metric For Strong Unlearning

CSAI: Conditional Self-Attention Imputation for Healthcare Time-series

Formalizing and Benchmarking Prompt Injection Attacks and Defenses

Hyperdimensional Decoding of Spiking Neural Networks

Information Capacity: Evaluating the Efficiency of Large Language Models via Text Compression

DigiData: Training and Evaluating General-Purpose Mobile Control Agents

A Theoretical Analysis of Detecting Large Model-Generated Time Series

Green AI: A systematic review and meta-analysis of its definitions, lifecycle models, hardware and measurement attempts

Do LLMs Feel? Teaching Emotion Recognition with Prompts, Retrieval, and Curriculum Learning

Are We Asking the Right Questions? On Ambiguity in Natural Language Queries for Tabular Data Analysis

Ariadne: A Controllable Framework for Probing and Extending VLM Reasoning Boundaries

e1: Learning Adaptive Control of Reasoning Effort

Emotion-Coherent Reasoning for Multimodal LLMs via Emotional Rationale Verifier

Mixed-Density Diffuser: Efficient Planning with Non-Uniform Temporal Resolution

Mitigating Modal Imbalance in Multimodal Reasoning

Created by

Haebom

저자

Chen Henry Wu, Neil Kale, Aditi Raghunathan

개요

다중 모드(modalities)를 통합하는 파운데이션 모델(FMs)이 여러 모드 간의 상호 작용과 관계를 이해하고, 충돌하는 정보를 처리하는 능력을 평가하는 연구. 실험 결과, FMs는 단일 모드 내에서는 충돌을 잘 인식하지만, 여러 모드에 정보가 분산될 경우 충돌 인식 능력이 급격히 저하됨. 이는 크로스 모달(cross-modal) 어텐션 불균형으로 인해 특정 모드에 과도하게 집중하기 때문이며, 크로스 모달 추론을 명시적으로 요구하는 훈련 데이터가 부족하기 때문임. 훈련 인스턴스 내에서 여러 모드를 명시적으로 결합하는 간단한 방법으로 어텐션 불균형을 줄이고, 다운스트림 성능을 향상시킬 수 있음을 보임.

시사점, 한계점

•

시사점:

◦

파운데이션 모델의 크로스 모달 추론 능력에 대한 중요한 통찰 제공.

◦

크로스 모달 어텐션 불균형이 성능 저하의 주요 원인임을 밝힘.

◦

명시적인 크로스 모달 추론을 위한 훈련 데이터의 중요성을 강조.

◦

간단한 방법으로 어텐션 불균형을 완화하고 성능을 향상시킬 수 있음을 제시.

•

한계점:

◦

특정 벤치마크 및 실험 환경에 국한될 수 있음.

◦

제안된 방법의 일반화 가능성에 대한 추가 연구 필요.

◦

크로스 모달 어텐션 불균형의 근본적인 원인에 대한 추가 분석 필요.

Made with Slashpage