Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Dehazing Light Microscopy Images with Guided Conditional Flow Matching: finding a sweet spot between fidelity and realism

EFRame: Deeper Reasoning via Exploration-Filter-Replay Reinforcement Learning Framework

Refine-POI: Reinforcement Fine-Tuned Large Language Models for Next Point-of-Interest Recommendation

HalluSegBench: Counterfactual Visual Reasoning for Segmentation Hallucination Evaluation

Potemkin Understanding in Large Language Models

OmniEval: A Benchmark for Evaluating Omni-modal Models with Visual, Auditory, and Textual Inputs

How to Retrieve Examples in In-context Learning to Improve Conversational Emotion Recognition using Large Language Models?

Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track

Arabic Dialect Classification using RNNs, Transformers, and Large Language Models: A Comparative Analysis

Improving Student-AI Interaction Through Pedagogical Prompting: An Example in Computer Science Education

GLIMPSE: Gradient-Layer Importance Mapping for Prompted Visual Saliency Explanation for Generative LVLMs

Automatic Depression Assessment using Machine Learning: A Comprehensive Survey

Generalizing vision-language models to novel domains: A comprehensive survey

Comparative Evaluation of ChatGPT and DeepSeek Across Key NLP Tasks: Strengths, Weaknesses, and Domain-Specific Performance

AI-Generated Song Detection via Lyrics Transcripts

KAG-Thinker: Interactive Thinking and Deep Reasoning in LLMs via Knowledge-Augmented Generation

Data Quality Issues in Multilingual Speech Datasets: The Need for Sociolinguistic Awareness and Proactive Language Planning

Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusion

Aligning Evaluation with Clinical Priorities: Calibration, Label Shift, and Error Costs

Value-Free Policy Optimization via Reward Partitioning

VFEFL: Privacy-Preserving Federated Learning against Malicious Clients via Verifiable Functional Encryption

Enabling Precise Topic Alignment in Large Language Models Via Sparse Autoencoders

Robust LLM Unlearning with MUDMAN: Meta-Unlearning with Disruption Masking And Normalization

CMI-Bench: A Comprehensive Benchmark for Evaluating Music Instruction Following

StepProof: Step-by-step verification of natural language mathematical proofs

Scalable Non-Equivariant 3D Molecule Generation via Rotational Alignment

Improved Supervised Fine-Tuning for Large Language Models to Mitigate Catastrophic Forgetting

SLED: A Speculative LLM Decoding Framework for Efficient Edge Serving

FZOO: Fast Zeroth-Order Optimizer for Fine-Tuning Large Language Models towards Adam-Scale Speed

VeriLoC: Line-of-Code Level Prediction of Hardware Design Quality from Verilog Code

Multi Layered Autonomy and AI Ecologies in Robotic Art Installations

Bridging Subjective and Objective QoE: Operator-Level Aggregation Using LLM-Based Comment Analysis and Network MOS Comparison

Quantum computing and artificial intelligence: status and perspectives

Fine-Tuning Next-Scale Visual Autoregressive Models with Group Relative Policy Optimization

A Large Language Model-Enabled Control Architecture for Dynamic Resource Capability Exploration in Multi-Agent Manufacturing Systems

Spotlight-TTS: Spotlighting the Style via Voiced-Aware Style Extraction and Style Direction Adjustment for Expressive Text-to-Speech

WeatherEdit: Controllable Weather Editing with 4D Gaussian Field

From Alignment to Advancement: Bootstrapping Audio-Language Alignment with Synthetic Data

Error Optimization: Overcoming Exponential Signal Decay in Deep Predictive Coding Networks

TinyAlign: Boosting Lightweight Vision-Language Models by Mitigating Modal Alignment Bottlenecks

Super-Resolution Generative Adversarial Networks based Video Enhancement

Object detection in adverse weather conditions for autonomous vehicles using Instruct Pix2Pix

INSIGHT: Bridging the Student-Teacher Gap in Times of Large Language Models

SConU: Selective Conformal Uncertainty in Large Language Models

MetaSynth: Meta-Prompting-Driven Agentic Scaffolds for Diverse Synthetic Data Generation

Sculpting Memory: Multi-Concept Forgetting in Diffusion Models via Dynamic Mask and Concept-Aware Optimization

Achieving binary weight and activation for LLMs using Post-Training Quantization

A Consequentialist Critique of Binary Classification Evaluation Practices

Redefining Evaluation Standards: A Unified Framework for Evaluating the Korean Capabilities of Language Models

Test-Time Reasoning Through Visual Human Preferences with VLMs and Soft Rewards

FedMM-X: A Trustworthy and Interpretable Framework for Federated Multi-Modal Learning in Dynamic Environments

Automating Adjudication of Cardiovascular Events Using Large Language Models

ATTENTION2D: Communication Efficient Distributed Self-Attention Mechanism

Visual Position Prompt for MLLM based Visual Grounding

Time-R1: Post-Training Large Vision Language Model for Temporal Video Grounding

Privacy Ethics Alignment in AI: A Stakeholder-Centric Framework for Ethical AI

Characterizing GPU Resilience and Impact on AI/HPC Systems

Explainable Sentiment Analysis with DeepSeek-R1: Performance, Efficiency, and Few-Shot Learning

Neurons: Emulating the Human Visual Cortex Improves Fidelity and Interpretability in fMRI-to-Video Reconstruction

The Problem of the Priors, or Posteriors?

Gumiho: A Hybrid Architecture to Prioritize Early Tokens in Speculative Decoding

Disrupting Model Merging: A Parameter-Level Defense Without Sacrificing Accuracy

What can large language models do for sustainable food?

Enough Coin Flips Can Make LLMs Act Bayesian

How to Move Your Dragon: Text-to-Motion Synthesis for Large-Vocabulary Objects

Time-MQA: Time Series Multi-Task Question Answering with Context Enhancement

PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization

Space-Time Graphs of Convex Sets for Multi-Robot Motion Planning

HalCECE: A Framework for Explainable Hallucination Detection through Conceptual Counterfactuals in Image Captioning

LNUCB-TA: Linear-nonlinear Hybrid Bandit Learning with Temporal Attention

No, of course I can! Refusal Mechanisms Can Be Exploited Using Harmless Fine-Tuning Data

Investigating the Impact of Quantization Methods on the Safety and Reliability of Large Language Models

Retrieval Augmented Generation Based LLM Evaluation For Protocol State Machine Inference With Chain-of-Thought Reasoning

A general language model for peptide identification

Cluster and Predict Latent Patches for Improved Masked Image Modeling

Semantic-Aware Adaptive Video Streaming Using Latent Diffusion Models for Wireless Networks

KMI: A Dataset of Korean Motivational Interviewing Dialogues for Psychotherapy

Mechanistic Interpretability of Emotion Inference in Large Language Models

Multimodal Medical Code Tokenizer

Time to Rethink AI for Combinatorial Optimization: Classical Algorithms Remain Tough to Match

Simultaneous Multi-Robot Motion Planning with Projected Diffusion Models

Environment-Driven Online LiDAR-Camera Extrinsic Calibration

Riddle Me This! Stealthy Membership Inference for Retrieval-Augmented Generation

DReSS: Data-driven Regularized Structured Streamlining for Large Language Models

Towards Automated Self-Supervised Learning for Truly Unsupervised Graph Anomaly Detection

Adaptive Rank Allocation for Federated Parameter-Efficient Fine-Tuning of Language Models

DisCoPatch: Taming Adversarially-driven Batch Statistics for Improved Out-of-Distribution Detection

An Investigation into Seasonal Variations in Energy Forecasting for Student Residences

Efficiently Serving Large Multimodal Models Using EPD Disaggregation

PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models

AlignGuard: Scalable Safety Alignment for Text-to-Image Generation

A Library for Learning Neural Operators

ZipAR: Parallel Auto-regressive Image Generation through Spatial Locality

Pretrained Reversible Generation as Unsupervised Visual Representation Learning

FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portrait

SEUF: Is Unlearning One Expert Enough for Mixture-of-Experts LLMs?

Recommender Systems for Good (RS4Good): Survey of Use Cases and a Call to Action for Research that Matters

Foundation Models for Wearable Movement Data in Mental Health Research

GenBFA: An Evolutionary Optimization Approach to Bit-Flip Attacks on LLMs

Enhancing Diffusion Posterior Sampling for Inverse Problems by Integrating Crafted Measurements

OmniEval: A Benchmark for Evaluating Omni-modal Models with Visual, Auditory, and Textual Inputs

Created by

Haebom

저자

Yiman Zhang, Ziheng Luo, Qiangyu Yan, Wei He, Borui Jiang, Xinghao Chen, Kai Han

개요

본 논문은 다중 모달리티(시각, 청각, 텍스트) 모델을 평가하기 위한 새로운 벤치마크인 OmniEval을 소개합니다. OmniEval은 기존 벤치마크와 달리, 오디오와 비디오 간의 강력한 상호작용을 평가하는 과제를 포함하여 다중 모달리티의 협력적 지각 능력을 평가합니다. 810개의 오디오-비디오 동기화 비디오(중국어 285개, 영어 525개)와 2617개의 질의응답 쌍(개방형 질문 1412개, 객관식 질문 1205개)으로 구성되어 있으며, 3가지 주요 과제 유형과 12가지 하위 과제 유형으로 세분화되어 포괄적인 평가를 수행합니다. 특히, 비디오 내 특정 부분을 찾는 보다 세분화된 과제인 Grounding을 새롭게 도입했습니다. 여러 다중 모달리티 모델을 사용한 실험 결과도 제시하며, 모든 모달리티의 맥락에서 일관성을 구축하고 이해하는 능력을 평가하는 플랫폼으로서 OmniEval의 활용을 제시합니다. 코드와 데이터는 https://omnieval-benchmark.github.io/ 에서 확인할 수 있습니다.

OmniEval: A Benchmark for Evaluating Omni-modal Models

OmniEval is a novel benchmark for evaluating omni-modal models with visual, auditory, and textual inputs, featuring full-modal collaboration and diverse tasks.

omnieval-benchmark.github.io

시사점, 한계점

•

시사점:

◦

다중 모달리티 모델의 협력적 지각 능력을 종합적으로 평가할 수 있는 새로운 벤치마크 OmniEval을 제공합니다.

◦

다양한 언어(중국어, 영어)와 과제 유형(개방형 질문, 객관식 질문, Grounding)을 포함하여 포괄적인 평가가 가능합니다.

◦

다중 모달리티 모델의 성능 비교 및 향상을 위한 표준 플랫폼을 제공합니다.

•

한계점:

◦

현재 벤치마크에 포함된 비디오의 수와 언어가 제한적일 수 있습니다. (810개 비디오, 중국어 및 영어에 한정)

◦

OmniEval이 모든 종류의 다중 모달리티 모델에 적용 가능한지에 대한 추가적인 검증이 필요합니다.

◦

벤치마크의 과제 구성 및 평가 지표의 객관성 및 공정성에 대한 추가적인 논의가 필요할 수 있습니다.

Made with Slashpage