Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

VideoPDE: Unified Generative PDE Solving via Video Inpainting Diffusion Models

Prefix-Tuning+: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention

Graph-Convolutional-Beta-VAE for Synthetic Abdominal Aorta Aneurysm Generation

A Production Scheduling Framework for Reinforcement Learning Under Real-World Constraints

ROSAQ: Rotation-based Saliency-Aware Weight Quantization for Efficiently Compressing Large Language Models

Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models

SeqPE: Transformer with Sequential Position Encoding

No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!

AI-Facilitated Analysis of Abstracts and Conclusions: Flagging Unsubstantiated Claims and Ambiguous Pronouns

IKDiffuser: Fast and Diverse Inverse Kinematics Solution Generation for Multi-arm Robotic Systems

Delving into Instance-Dependent Label Noise in Graph Data: A Comprehensive Study and Benchmark

Deep Learning Model Acceleration and Optimization Strategies for Real-Time Recommendation Systems

Adaptive Composition of Machine Learning as a Service (MLaaS) for IoT Environments

Discrete Audio Tokens: More Than a Survey!

FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation

Inherently Faithful Attention Maps for Vision Transformers

Reparameterized LLM Training via Orthogonal Equivalence Transformation

MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification

SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithms

CellCLIP -- Learning Perturbation Effects in Cell Painting via Text-Guided Contrastive Learning

EuroLLM-9B: Technical Report

Incentivizing Reasoning for Advanced Instruction-Following of Large Language Models

EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEG

MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning

CSVQA: A Chinese Multimodal Benchmark for Evaluating STEM Reasoning Capabilities of VLMs

KGMark: A Diffusion Watermark for Knowledge Graphs

Representing local protein environments with atomistic foundation models

Accelerating RLHF Training with Reward Variance Increase

FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editing

PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulation

REAL-Prover: Retrieval Augmented Lean Prover for Mathematical Reasoning

MSVIT: Improving Spiking Vision Transformer Using Multi-scale Attention Fusion

Abacus: A Cost-Based Optimizer for Semantic Operator Systems

IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems

CAPTURE: Context-Aware Prompt Injection Testing and Robustness Enhancement

Chatting with Papers: A Hybrid Approach Using LLMs and Knowledge Graphs

Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

H$^3$DP: Triply-Hierarchical Diffusion Policy for Visuomotor Learning

Convert Language Model into a Value-based Strategic Planner

Graph RAG for Legal Norms: A Hierarchical, Temporal and Deterministic Approach

CAPO: Cost-Aware Prompt Optimization

Spatiotemporal Learning of Brain Dynamics from fMRI Using Frequency-Specific Multi-Band Attention for Cognitive and Psychiatric Applications

The Backfiring Effect of Weak AI Safety Regulation

Assessing Consistency and Reproducibility in the Outputs of Large Language Models: Evidence Across Diverse Finance and Accounting Tasks

Achieving Unbiased Multi-Instance Learning via Balanced Fine-Grained Positive-Unlabeled Learning

Conformal Prediction Sets for Deep Generative Models via Reduction to Conformal Regression

SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints

Effect of Selection Format on LLM Performance

Reward Shaping to Mitigate Reward Hacking in RLHF

SAE-V: Interpreting Multimodal Models for Enhanced Alignment

LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification

Target Speaker Extraction through Comparing Noisy Positive and Negative Audio Enrollments

Hardware-Friendly Static Quantization Method for Video Diffusion Transformers

PredictaBoard: Benchmarking LLM Score Predictability

Towards Geo-Culturally Grounded LLM Generations

Diverse Topology Optimization using Modulated Neural Fields

Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models

NAROCE: A Neural Algorithmic Reasoner Framework for Online Complex Event Detection

Bridging Voting and Deliberation with Algorithms: Field Insights from vTaiwan and Kultur Komitee

From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphors

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs

Language and Planning in Robotic Navigation: A Multilingual Evaluation of State-of-the-Art Models

Agent Laboratory: Using LLM Agents as Research Assistants

LLMs Help Alleviate the Cross-Subject Variability in Brain Signal and Language Alignment

Uncertainty-Aware Critic Augmentation for Hierarchical Multi-Agent EV Charging Control

Parallel Greedy Best-First Search with a Bound on Expansions Relative to Sequential Search

PunchBench: Benchmarking MLLMs in Multimodal Punchline Comprehension

BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of English

LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior

Geometric Signatures of Compositionality Across a Language Model's Lifetime

AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environment

MSDNet: Multi-Scale Decoder for Few-Shot Semantic Segmentation via Transformer-Guided Prototyping

What is the Right Notion of Distance between Predict-then-Optimize Tasks?

QuantFactor REINFORCE: Mining Steady Formulaic Alpha Factors with Variance-bounded REINFORCE

MALSIGHT: Exploring Malicious Source Code and Benign Pseudocode for Iterative Binary Malware Summarization

Bridging Social Media and Search Engines: Dredge Words and the Detection of Unreliable Domains

Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAG

Quality-aware Masked Diffusion Transformer for Enhanced Music Generation

InkSight: Offline-to-Online Handwriting Conversion by Teaching Vision-Language Models to Read and Write

Exploring news intent and its application: A theory-driven approach

Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures

AgentOrchestra: A Hierarchical Multi-Agent Framework for General-Purpose Task Solving

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities

A Conjecture on a Fundamental Trade-Off between Certainty and Scope in Symbolic and Generative AI

Comment on The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity

TIP-Search: Time-Predictable Inference Scheduling for Market Prediction under Uncertain Load

AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning

Large Language Models' Reasoning Stalls: An Investigation into the Capabilities of Frontier Models

OrgAccess: A Benchmark for Role Based Access Control in Organization Scale LLMs

SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoning

Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis

Arbitrarily Applicable Same/Opposite Relational Responding with NARS

ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoning

Behaviour Discovery and Attribution for Explainable Reinforcement Learning

Verification Learning: Make Unsupervised Neuro-Symbolic System Feasible

Chain-of-Thought Reasoning In The Wild Is Not Always Faithful

Activation Space Interventions Can Be Transferred Between Large Language Models

Planning of Heuristics: Strategic Planning on Large Language Models with Monte Carlo Tree Search for Automating Heuristic Optimization

MAGELLAN: Metacognitive predictions of learning progress guide autotelic LLM agents in large goal spaces

FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation

Created by

Haebom

저자

Zheqi He, Yesheng Liu, Jing-shu Zheng, Xuejing Li, Jin-Ge Yao, Bowen Qin, Richeng Xuan, Xi Yang

개요

FlagEvalMM은 시각-언어 이해 및 생성 작업(예: 시각적 질문 응답, 텍스트-이미지/비디오 생성, 이미지-텍스트 검색) 전반에 걸쳐 다양한 다중 모드 모델을 종합적으로 평가하도록 설계된 오픈 소스 평가 프레임워크입니다. 모델 추론을 독립적인 평가 서비스를 통해 분리하여 유연한 자원 할당과 새로운 작업 및 모델의 원활한 통합을 가능하게 합니다. 또한, 고급 추론 가속 도구(예: vLLM, SGLang)와 비동기 데이터 로딩을 활용하여 평가 효율성을 크게 향상시킵니다. 광범위한 실험을 통해 FlagEvalMM이 모델의 강점과 한계에 대한 정확하고 효율적인 통찰력을 제공하여 다중 모드 연구 발전에 귀중한 도구임을 보여줍니다. 해당 프레임워크는 https://github.com/flageval-baai/FlagEvalMM 에서 공개적으로 접근 가능합니다.

GitHub - flageval-baai/FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation

A Flexible Framework for Comprehensive Multimodal Model Evaluation - flageval-baai/FlagEvalMM

시사점, 한계점

•

시사점:

◦

다양한 시각-언어 작업에 대한 다중 모달 모델의 종합적인 평가를 가능하게 합니다.

◦

독립적인 평가 서비스를 통한 유연한 자원 할당 및 확장성 제공.

◦

고급 추론 가속 도구를 활용한 효율적인 평가 수행.

◦

모델의 강점과 약점에 대한 정확한 통찰력 제공.

◦

오픈 소스로 공개되어 연구 공동체에 기여.

•

한계점:

◦

현재 지원하는 작업 및 모델의 범위에 대한 명시적인 언급이 부족.

◦

평가 지표의 다양성 및 적절성에 대한 추가적인 설명 필요.

◦

프레임워크의 확장성 및 유지보수에 대한 장기적인 계획이 명확하지 않음.

Made with Slashpage