Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Aggregating Concepts of Accuracy and Fairness in Prediction Algorithms

Self-cross Feature based Spiking Neural Networks for Efficient Few-shot Learning

Graph neural networks and MSO

Generative Pre-trained Autoregressive Diffusion Transformer

SAS-Bench: A Fine-Grained Benchmark for Evaluating Short Answer Scoring with Large Language Models

Towards user-centered interactive medical image segmentation in VR with an assistive AI agent

Towards Scalable IoT Deployment for Visual Anomaly Detection via Efficient Compression

X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Real

UniVLA: Learning to Act Anywhere with Task-centric Latent Actions

Assessing Tenstorrent's RISC-V MatMul Acceleration Capabilities

Examining the Source of Defects from a Mechanical Perspective for 3D Anomaly Detection

Understanding In-context Learning of Addition via Activation Subspaces

Risk-sensitive Reinforcement Learning Based on Convex Scoring Functions

Intelligently Augmented Contrastive Tensor Factorization: Empowering Multi-dimensional Time Series Classification in Low-Data Environments

Modeling Human Behavior in a Strategic Network Game with Complex Group Dynamics

GPU Performance Portability needs Autotuning

RM-R1: Reward Modeling as Reasoning

Fast and Robust: Task Sampling with Posterior and Diversity Synergies for Adaptive Decision-Makers in Randomized Environments

Data-Driven Calibration of Prediction Sets in Large Vision-Language Models Based on Inductive Conformal Prediction

WildFireCan-MMD: A Multimodal Dataset for Classification of User-Generated Content During Wildfires in Canada

CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectives

Optimizing Power Grid Topologies with Reinforcement Learning: A Survey of Methods and Challenges

Flexible Graph Similarity Computation With A Proactive Optimization Strategy

CryoSAMU: Enhancing 3D Cryo-EM Density Maps of Protein Structures at Intermediate Resolution with Structure-Aware Multimodal U-Nets

PromptMobile: Efficient Promptus for Low Bandwidth Mobile Video Streaming

Implicit Bias-Like Patterns in Reasoning Models

EMMOE: A Comprehensive Benchmark for Embodied Mobile Manipulation in Open Environments

Temporal Triplane Transformers as Occupancy World Models

The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own

Atlas: A Framework for ML Lifecycle Provenance & Transparency

Centrally Coordinated Multi-Agent Reinforcement Learning for Power Grid Topology Control

Illegal Waste Detection in Remote Sensing Images: A Case Study

ARR: Question Answering with Large Language Models via Analyzing, Retrieving, and Reasoning

ImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinement

Lightspeed Geometric Dataset Distance via Sliced Optimal Transport

Benchmarking Generative AI for Scoring Medical Student Interviews in Objective Structured Clinical Examinations (OSCEs)

Representation Convergence: Mutual Distillation is Secretly a Form of Regularization

Goal-Conditioned Supervised Learning for Multi-Objective Recommendation

Not All Adapters Matter: Selective Adapter Freezing for Memory-Efficient Fine-Tuning of Language Models

Simple and Provable Scaling Laws for the Test-Time Compute of Large Language Models

KBAlign: Efficient Self Adaptation on Specific Knowledge Bases

Natural Language Reinforcement Learning

Translating Electrocardiograms to Cardiac Magnetic Resonance Imaging Useful for Cardiac Assessment and Disease Screening: A Multi-Center Study AI for ECG to CMR Translation Study

TSINR: Capturing Temporal Continuity via Implicit Neural Representations for Time Series Anomaly Detection

Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphs

Temporal-Difference Variational Continual Learning

FAMMA: A Benchmark for Financial Domain Multilingual Multimodal Question Answering

Time Awareness in Large Language Models: Benchmarking Fact Recall Across Time

Self-supervised Learning for Acoustic Few-Shot Classification

Double Successive Over-Relaxation Q-Learning with an Extension to Deep Reinforcement Learning

SAKR: Enhancing Retrieval-Augmented Generation via Streaming Algorithm and K-Means Clustering

Compensate Quantization Errors+: Quantized Models Are Inquisitive Learners

Beyond Next Token Prediction: Patch-Level Training for Large Language Models

PersLLM: A Personified Training Approach for Large Language Models

PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling

Demystifying AI Platform Design for Distributed Inference of Next-Generation LLM models

RoBERTa-BiLSTM: A Context-Aware Hybrid Model for Sentiment Analysis

Tokenization Matters! Degrading Large Language Models through Challenging Their Tokenization

Aligning Transformers with Continuous Feedback via Energy Rank Alignment

Large Language Models for Cyber Security: A Systematic Literature Review

Construction and Application of Materials Knowledge Graph in Multidisciplinary Materials Science via Large Language Model

CreativeSynth: Cross-Art-Attention for Artistic Image Synthesis with Multimodal Diffusion

LLM A*: Human in the Loop Large Language Models Enabled A* Search for Robotics

Neurodivergent Influenceability as a Contingent Solution to the AI Alignment Problem

AssertionForge: Enhancing Formal Verification Assertion Generation with Structured Representation of Specifications and RTL

Demonstrating specification gaming in reasoning models

SensorChat: Answering Qualitative and Quantitative Questions during Long-Term Multimodal Sensor Interactions

MapExplorer: New Content Generation from Low-Dimensional Visualizations

Addressing and Visualizing Misalignments in Human Task-Solving Trajectories

AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents

Learning Progress Driven Multi-Agent Curriculum

Neural Thermodynamic Laws for Large Language Model Training

MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning

Does Feasibility Matter? Understanding the Impact of Feasibility on Synthetic Training Data

Real-Time Out-of-Distribution Failure Prevention via Multi-Modal Reasoning

LibIQ: Toward Real-Time Spectrum Classification in O-RAN dApps

Knowledge capture, adaptation and composition (KCAC): A framework for cross-task curriculum learning in robotic manipulation

Multi-Token Prediction Needs Registers

PnPXAI: A Universal XAI Framework Providing Automatic Explanations Across Diverse Modalities and Models

UniEval: Unified Holistic Evaluation for Unified Multimodal Understanding and Generation

Fine-tuning Diffusion Policies with Backpropagation Through Diffusion Timesteps

Superposition Yields Robust Neural Scaling

SEAL: Searching Expandable Architectures for Incremental Learning

Vision language models have difficulty recognizing virtual objects

Are Large Language Models Robust in Understanding Code Against Semantics-Preserving Mutations?

IN-RIL: Interleaved Reinforcement and Imitation Learning for Policy Fine-Tuning

PIF: Anomaly detection via preference embedding

Learned Lightweight Smartphone ISP with Unpaired Data

Visual Fidelity Index for Generative Semantic Communications with Critical Information Embedding

Rethinking Repetition Problems of LLMs in Code Generation

Inconsistency Handling in DatalogMTL

Uncovering Magnetic Phases with Synthetic Data and Physics-Informed Training

Schreier-Coset Graph Propagation

Multi-Agent Path Finding For Large Agents Is Intractable

Are Sparse Autoencoders Useful for Java Function Bug Detection?

ILIF: Temporal Inhibitory Leaky Integrate-and-Fire Neuron for Overactivation in Spiking Neural Networks

FactsR: A Safer Method for Producing High Quality Healthcare Documentation

SpikeVideoFormer: An Efficient Spike-Driven Video Transformer with Hamming Attention and $\mathcal{O}(T)$ Complexity

Uniform Loss vs. Specialized Optimization: A Comparative Analysis in Multi-Task Learning

Emergence of Structure in Ensembles of Random Neural Networks

FAMMA: A Benchmark for Financial Domain Multilingual Multimodal Question Answering

Created by

Haebom

저자

Siqiao Xue, Xiaojing Li, Fan Zhou, Qingyang Dai, Zhixuan Chu, Hongyuan Mei

개요

FAMMA는 금융 분야 다국어 다모달 질의응답(QA)을 위한 오픈소스 벤치마크입니다. 대규모 언어 모델(LLM)의 고급 금융 지식을 요구하는 복잡한 추론 질문에 대한 답변 능력을 평가하기 위해 고안되었습니다. FAMMA는 대학 교재 및 시험에서 추출한 1,945개의 질문으로 구성된 FAMMA-Basic과, 금융 전문가가 생성한 103개의 새로운 질문으로 구성된 FAMMA-LivePro의 두 가지 버전으로 제공됩니다. 질문은 영어, 중국어, 프랑스어로 제공되며, 대부분의 질문은 차트, 다이어그램 또는 표와 같은 비텍스트 데이터를 포함합니다. 실험 결과, FAMMA는 GPT-o1 및 DeepSeek-R1과 같은 추론 모델을 포함한 LLM에 상당한 어려움을 제시하는 것으로 나타났습니다. 또한, DeepSeek-R1의 FAMMA-Basic 데이터에 대한 1,270개의 추론 경로를 정리하고 이 추론 데이터를 사용하여 일련의 오픈소스 Qwen 모델을 미세 조정했습니다. 이러한 추론 경로에 대한 모델 학습은 FAMMA-LivePro의 성능을 크게 향상시킬 수 있음을 발견했습니다. 리더보드, 데이터, 코드 및 학습된 모델은 https://famma-bench.github.io/famma/에서 공개되었습니다.

시사점, 한계점

•

시사점:

◦

금융 분야 다국어 다모달 질의응답을 위한 새로운 벤치마크 FAMMA를 제시.

◦

LLM의 고급 금융 지식 및 추론 능력 평가에 유용한 도구 제공.

◦

추론 경로 데이터를 활용한 모델 미세 조정을 통해 성능 향상 가능성 제시.

◦

오픈소스로 공개되어 연구 및 개발에 기여.

•

한계점:

◦

FAMMA-LivePro의 질문 수가 103개로 상대적으로 적음.

◦

특정 금융 분야에 편향될 가능성 존재.

◦

다양한 LLM에 대한 포괄적인 평가가 아직 부족.

Made with Slashpage