Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

VideoPDE: Unified Generative PDE Solving via Video Inpainting Diffusion Models

Prefix-Tuning+: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention

Graph-Convolutional-Beta-VAE for Synthetic Abdominal Aorta Aneurysm Generation

A Production Scheduling Framework for Reinforcement Learning Under Real-World Constraints

ROSAQ: Rotation-based Saliency-Aware Weight Quantization for Efficiently Compressing Large Language Models

Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models

SeqPE: Transformer with Sequential Position Encoding

No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!

AI-Facilitated Analysis of Abstracts and Conclusions: Flagging Unsubstantiated Claims and Ambiguous Pronouns

IKDiffuser: Fast and Diverse Inverse Kinematics Solution Generation for Multi-arm Robotic Systems

Delving into Instance-Dependent Label Noise in Graph Data: A Comprehensive Study and Benchmark

Deep Learning Model Acceleration and Optimization Strategies for Real-Time Recommendation Systems

Adaptive Composition of Machine Learning as a Service (MLaaS) for IoT Environments

Discrete Audio Tokens: More Than a Survey!

FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation

Inherently Faithful Attention Maps for Vision Transformers

Reparameterized LLM Training via Orthogonal Equivalence Transformation

MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification

SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithms

CellCLIP -- Learning Perturbation Effects in Cell Painting via Text-Guided Contrastive Learning

EuroLLM-9B: Technical Report

Incentivizing Reasoning for Advanced Instruction-Following of Large Language Models

EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEG

MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning

CSVQA: A Chinese Multimodal Benchmark for Evaluating STEM Reasoning Capabilities of VLMs

KGMark: A Diffusion Watermark for Knowledge Graphs

Representing local protein environments with atomistic foundation models

Accelerating RLHF Training with Reward Variance Increase

FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editing

PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulation

REAL-Prover: Retrieval Augmented Lean Prover for Mathematical Reasoning

MSVIT: Improving Spiking Vision Transformer Using Multi-scale Attention Fusion

Abacus: A Cost-Based Optimizer for Semantic Operator Systems

IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems

CAPTURE: Context-Aware Prompt Injection Testing and Robustness Enhancement

Chatting with Papers: A Hybrid Approach Using LLMs and Knowledge Graphs

Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

H$^3$DP: Triply-Hierarchical Diffusion Policy for Visuomotor Learning

Convert Language Model into a Value-based Strategic Planner

Graph RAG for Legal Norms: A Hierarchical, Temporal and Deterministic Approach

CAPO: Cost-Aware Prompt Optimization

Spatiotemporal Learning of Brain Dynamics from fMRI Using Frequency-Specific Multi-Band Attention for Cognitive and Psychiatric Applications

The Backfiring Effect of Weak AI Safety Regulation

Assessing Consistency and Reproducibility in the Outputs of Large Language Models: Evidence Across Diverse Finance and Accounting Tasks

Achieving Unbiased Multi-Instance Learning via Balanced Fine-Grained Positive-Unlabeled Learning

Conformal Prediction Sets for Deep Generative Models via Reduction to Conformal Regression

SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints

Effect of Selection Format on LLM Performance

Reward Shaping to Mitigate Reward Hacking in RLHF

SAE-V: Interpreting Multimodal Models for Enhanced Alignment

LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification

Target Speaker Extraction through Comparing Noisy Positive and Negative Audio Enrollments

Hardware-Friendly Static Quantization Method for Video Diffusion Transformers

PredictaBoard: Benchmarking LLM Score Predictability

Towards Geo-Culturally Grounded LLM Generations

Diverse Topology Optimization using Modulated Neural Fields

Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models

NAROCE: A Neural Algorithmic Reasoner Framework for Online Complex Event Detection

Bridging Voting and Deliberation with Algorithms: Field Insights from vTaiwan and Kultur Komitee

From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphors

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs

Language and Planning in Robotic Navigation: A Multilingual Evaluation of State-of-the-Art Models

Agent Laboratory: Using LLM Agents as Research Assistants

LLMs Help Alleviate the Cross-Subject Variability in Brain Signal and Language Alignment

Uncertainty-Aware Critic Augmentation for Hierarchical Multi-Agent EV Charging Control

Parallel Greedy Best-First Search with a Bound on Expansions Relative to Sequential Search

PunchBench: Benchmarking MLLMs in Multimodal Punchline Comprehension

BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of English

LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior

Geometric Signatures of Compositionality Across a Language Model's Lifetime

AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environment

MSDNet: Multi-Scale Decoder for Few-Shot Semantic Segmentation via Transformer-Guided Prototyping

What is the Right Notion of Distance between Predict-then-Optimize Tasks?

QuantFactor REINFORCE: Mining Steady Formulaic Alpha Factors with Variance-bounded REINFORCE

MALSIGHT: Exploring Malicious Source Code and Benign Pseudocode for Iterative Binary Malware Summarization

Bridging Social Media and Search Engines: Dredge Words and the Detection of Unreliable Domains

Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAG

Quality-aware Masked Diffusion Transformer for Enhanced Music Generation

InkSight: Offline-to-Online Handwriting Conversion by Teaching Vision-Language Models to Read and Write

Exploring news intent and its application: A theory-driven approach

Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures

AgentOrchestra: A Hierarchical Multi-Agent Framework for General-Purpose Task Solving

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities

A Conjecture on a Fundamental Trade-Off between Certainty and Scope in Symbolic and Generative AI

Comment on The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity

TIP-Search: Time-Predictable Inference Scheduling for Market Prediction under Uncertain Load

AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning

Large Language Models' Reasoning Stalls: An Investigation into the Capabilities of Frontier Models

OrgAccess: A Benchmark for Role Based Access Control in Organization Scale LLMs

SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoning

Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis

Arbitrarily Applicable Same/Opposite Relational Responding with NARS

ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoning

Behaviour Discovery and Attribution for Explainable Reinforcement Learning

Verification Learning: Make Unsupervised Neuro-Symbolic System Feasible

Chain-of-Thought Reasoning In The Wild Is Not Always Faithful

Activation Space Interventions Can Be Transferred Between Large Language Models

Planning of Heuristics: Strategic Planning on Large Language Models with Monte Carlo Tree Search for Automating Heuristic Optimization

MAGELLAN: Metacognitive predictions of learning progress guide autotelic LLM agents in large goal spaces

Do Large Language Models Exhibit Cognitive Dissonance? Studying the Difference Between Revealed Beliefs and Stated Answers

Created by

Haebom

저자

Manuel Mondal, Ljiljana Dolamic, Gerome Bovet, Philippe Cudre-Mauroux, Julien Audiffren

개요

본 논문은 대규모 언어 모델(LLM)의 능력 평가에 널리 사용되는 다지선다형 문제(MCQ) 평가 방식의 한계를 지적하고, 새로운 평가 프레임워크인 'Revealed Belief'를 제시합니다. Revealed Belief는 LLM의 텍스트 완성 확률 분포를 분석하여 불확실성 하에서의 추론 능력을 평가합니다. 기존 MCQ 평가 방식은 LLM이 정답을 제시하는지 여부에만 초점을 맞추지만, Revealed Belief는 LLM이 확률을 일관되게 할당하고, 새로운 증거에 따라 믿음을 적절하게 갱신하는지 여부까지 평가합니다.

시사점, 한계점

•

시사점: LLM의 추론 능력에 대한 기존 MCQ 기반 평가의 부족함을 지적하고, 더욱 포괄적인 평가 방식의 필요성을 강조합니다. LLM의 'Stated Answer'와 'Revealed Belief' 간의 차이를 분석하여 LLM의 내부적인 확률 분포 및 추론 과정에 대한 이해를 높일 수 있습니다. 하류 작업에 대한 LLM의 성능에 대한 새로운 시각을 제공합니다.

•

한계점: Revealed Belief 프레임워크의 일반화 가능성 및 다양한 LLM 아키텍처 및 작업에 대한 적용 가능성에 대한 추가 연구가 필요합니다. 텍스트 완성 확률 분포 분석의 해석에 대한 주관성이 존재할 수 있습니다. 새로운 평가 프레임워크의 계산 비용 및 복잡성에 대한 고려가 필요합니다.

Made with Slashpage