Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

When Generative AI Meets Extended Reality: Enabling Scalable and Natural Interactions

An Explainable Market Integrity Monitoring System with Multi-Source Attention Signals and Transparent Scoring

Can We Trust LLM Detectors?

Embedding Retrofitting: Data Engineering for better RAG

Entropy-Tree: Tree-Based Decoding with Entropy-Guided Exploration

Elsewise: Authoring AI-Based Interactive Narrative with Possibility Space Visualization

Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarios

LLM-based Multimodal Feedback Produces Equivalent Learning and Better Student Perceptions than Educator Feedback

Psychometric Comparability of LLM-Based Digital Twins

Scalable Board Expansion within a General Game System

Structured Hints for Sample-Efficient Lean Theorem Proving

Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning

LLM Prompt Evaluation for Educational Applications

Multimodal Climate Disinformation Detection: Integrating Vision-Language Models with External Knowledge Sources

Controlling Long-Horizon Behavior in Language Model Agents with Explicit State Dynamics

Designing faster mixed integer linear programming algorithm via learning the optimal path

AgriPINN: A Process-Informed Neural Network for Interpretable and Scalable Crop Biomass Prediction Under Water Stress

Grounding Large Language Models in Reaction Knowledge Graphs for Synthesis Retrieval

Deja Vu in Plots: Leveraging Cross-Session Evidence with Retrieval-Augmented LLMs for Live Streaming Risk Assessment

Decoupling Return-to-Go for Efficient Decision Transformer

Natural Language-Driven Global Mapping of Martian Landforms

ICON: Invariant Counterfactual Optimization with Neuro-Symbolic Priors for Text-Based Person Search

EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience

ErrorMap and ErrorAtlas: Charting the Failure Landscape of Large Language Models

Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification

VitalDiagnosis: AI-Driven Ecosystem for 24/7 Vital Monitoring and Chronic Disease Management

Creativity in the Age of AI: Rethinking the Role of Intentional Agency

Agentic Confidence Calibration

Off-Policy Actor-Critic with Sigmoid-Bounded Entropy for Real-World Robot Learning

Tabular Incremental Inference

PhysProver: Advancing Automatic Theorem Proving for Physics

Benchmarking Text-to-Python against Text-to-SQL: The Impact of Explicit Logic and Ambiguity

Investigation of the Generalisation Ability of Genetic Programming-evolved Scheduling Rules in Dynamic Flexible Job Shop Scheduling

AgentSM: Semantic Memory for Agentic Text-to-SQL

Improving Methodologies for LLM Evaluations Across Global Languages

Agentic Uncertainty Quantification

From Passive Metric to Active Signal: The Evolving Role of Uncertainty Quantification in Large Language Models

Improving Methodologies for Agentic Evaluations Across Domains: Leakage of Sensitive Information, Fraud and Cybersecurity Threats

Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models

Agentic AI Governance and Lifecycle Management in Healthcare

CogToM: A Comprehensive Theory of Mind Benchmark inspired by Human Cognition for Large Language Models

Autonomous Business System via Neuro-symbolic AI

ALIGNAgent: Adaptive Learner Intelligence for Gap Identification and Next-step guidance

From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models

TransportAgents: a multi-agents LLM framework for traffic accident severity prediction

The Dark Side of AI Transformers: Sentiment Polarization & the Loss of Business Neutrality by NLP Transformers

Tracking the Limits of Knowledge Propagation: How LLMs Fail at Multi-Step Reasoning with Conflicting Knowledge

MiRAGE: A Multiagent Framework for Generating Multimodal Multihop Question-Answer Dataset for RAG Evaluation

Reliability by design: quantifying and eliminating fabrication risk in LLMs. From generative to consultative AI: a comparative analysis in the legal domain and lessons for high-stakes knowledge bases

A tensor network formalism for neuro-symbolic AI

Not Your Typical Sycophant: The Elusive Nature of Sycophancy in Large Language Models

Beyond Prompting: Efficient and Robust Contextual Biasing for Speech LLMs via Logit-Space Integration (LOGIC)

GeMM-GAN: A Multimodal Generative Model Conditioned on Histopathology Images and Clinical Descriptions for Gene Expression Profile Generation

Logic Programming on Knowledge Graph Networks And its Application in Medical Domain

Prometheus Mind: Retrofitting Memory to Frozen Language Models

Replayable Financial Agents: A Determinism-Faithfulness Assurance Harness for Tool-Using LLM Agents

The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection

Aeon: High-Performance Neuro-Symbolic Memory Management for Long-Horizon LLM Agents

DeepSurvey-Bench: Evaluating Academic Value of Automatically Generated Scientific Survey

Uncovering Latent Bias in LLM-Based Emergency Department Triage Through Proxy Variables

Gated Sparse Attention: Combining Computational Efficiency with Training Stability for Long-Context Language Models

AI/ML in 3GPP 5G Advanced -- Services and Architecture

CookAnything: A Framework for Flexible and Consistent Multi-Step Recipe Image Generation

Dynamic Correction of Erroneous State Estimates via Diffusion Bayesian Exploration

Concept-Guided Backdoor Attack on Vision Language Models

On the Holographic Geometry of Deterministic Computation

Decoding inner speech with an end-to-end brain-to-text neural interface

Physics-informed Neural Operator Learning for Nonlinear Grad-Shafranov Equation

MindEval: Benchmarking Language Models on Multi-turn Mental Health Support

LAET: A Layer-wise Adaptive Ensemble Tuning Framework for Pretrained Language Models

FAST-CAD: A Fairness-Aware Framework for Non-Contact Stroke Diagnosis

Designing LLM-based Multi-Agent Systems for Software Engineering Tasks: Quality Attributes, Design Patterns and Rationale

SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control

MOSS: Efficient and Accurate FP8 LLM Training with Microscaling and Automatic Scaling

Data-Augmented Deep Learning for Downhole Depth Sensing and Field Validation

Chinese Discharge Drug Recommendation in Metabolic Diseases with Large Language Models

Analysing Moral Bias in Finetuned LLMs through Mechanistic Interpretability

Orders in Chaos: Enhancing Large-Scale MoE LLM Serving with Data Movement Forecasting

Reinforce-Ada: An Adaptive Sampling Framework under Non-linear RL Objectives

TempoControl: Temporal Attention Guidance for Text-to-Video Models

AortaDiff: A Unified Multitask Diffusion Framework For Contrast-Free AAA Imaging

SoREX: Towards Self-Explainable Social Recommendation with Relevant Ego-Path Extraction

The AI Productivity Index (APEX)

Uncovering Grounding IDs: How External Cues Shape Multimodal Binding

Pushing Toward the Simplex Vertices: A Simple Remedy for Code Collapse in Smoothed Vector Quantization

V-CECE: Visual Counterfactual Explanations via Conceptual Edits

Momentum-constrained Hybrid Heuristic Trajectory Optimization Framework with Residual-enhanced DRL for Visually Impaired Scenarios

HARP: Hallucination Detection via Reasoning Subspace Projection

Rethinking Sparse Autoencoders: Select-and-Project for Fairness and Control from Encoder Features Alone

IPA: An Information-Reconstructive Input Projection Framework for Efficient Foundation Model Adaptation

Sparse but Wrong: Incorrect L0 Leads to Incorrect Features in Sparse Autoencoders

ORFuzz: Fuzzing the "Other Side" of LLM Safety -- Testing Over-Refusal

Retro-Expert: Collaborative Reasoning for Interpretable Retrosynthesis

A Survey on Diffusion Language Models

CodeNER: Code Prompting for Named Entity Recognition

ReSem3D: Refinable 3D Spatial Constraints via Fine-Grained Semantic Grounding for Generalizable Robotic Manipulation

VERIRAG: A Post-Retrieval Auditing of Scientific Study Summaries

SustainDiffusion: Optimising the Social and Environmental Sustainability of Stable Diffusion Models

LittleBit: Ultra Low-Bit Quantization via Latent Factorization

Real-Time Execution of Action Chunking Flow Policies

MM-CRITIC: A Holistic Evaluation of Large Multimodal Models as Multimodal Critique

Created by

Haebom

Category

Empty

저자

Gailun Zeng, Ziyang Luo, Hongzhan Lin, Yuchen Tian, Kaixin Li, Ziyang Gong, Jianxiong Guo, Jing Ma

개요

본 논문은 대규모 멀티모달 모델(LMM)의 비판 능력을 평가하기 위한 MM-CRITIC이라는 포괄적인 벤치마크를 소개합니다. 캡셔닝 및 시각적 추론과 같은 작업에서 LMM의 증가하는 능력에도 불구하고 멀티모달 비판에 대한 연구는 부족합니다. MM-CRITIC은 기본, 수정, 비교의 여러 차원에서 LMM의 비판 능력을 평가하며, 8가지 주요 작업 유형과 500개 이상의 작업을 포괄합니다. 4471개의 샘플로 구성된 이 벤치마크는 다양한 모델 크기를 가진 여러 LMM의 응답을 수집합니다. 신뢰할 수 있는 평가를 위해 전문가가 정보를 제공한 정답을 점수 매기기 기준에 통합하여 GPT-4o가 응답에 주석을 달고 신뢰할 수 있는 판단을 위한 기준으로 참조 비판을 생성하도록 합니다. 광범위한 실험을 통해 MM-CRITIC의 효과를 입증하고 주요 LMM의 비판 능력을 여러 차원에서 포괄적으로 평가합니다.

시사점, 한계점

•

MM-CRITIC은 LMM의 비판 능력을 평가하기 위한 새로운 벤치마크를 제공합니다.

•

벤치마크는 기본, 수정, 비교 등 다양한 차원을 포괄합니다.

•

전문가 기반의 정답을 사용하여 평가의 신뢰성을 높입니다.

•

LMM의 응답 품질과 비판 능력 간의 상관관계를 보여줍니다.

•

다양한 평가 차원에서의 비판 난이도 차이를 분석합니다.

•

코드와 데이터는 공개되어 있습니다.

•

논문의 구체적인 한계점은 제시되지 않았습니다.

Made with Slashpage