Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

VideoPDE: Unified Generative PDE Solving via Video Inpainting Diffusion Models

Prefix-Tuning+: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention

Graph-Convolutional-Beta-VAE for Synthetic Abdominal Aorta Aneurysm Generation

A Production Scheduling Framework for Reinforcement Learning Under Real-World Constraints

ROSAQ: Rotation-based Saliency-Aware Weight Quantization for Efficiently Compressing Large Language Models

Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models

SeqPE: Transformer with Sequential Position Encoding

No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!

AI-Facilitated Analysis of Abstracts and Conclusions: Flagging Unsubstantiated Claims and Ambiguous Pronouns

IKDiffuser: Fast and Diverse Inverse Kinematics Solution Generation for Multi-arm Robotic Systems

Delving into Instance-Dependent Label Noise in Graph Data: A Comprehensive Study and Benchmark

Deep Learning Model Acceleration and Optimization Strategies for Real-Time Recommendation Systems

Adaptive Composition of Machine Learning as a Service (MLaaS) for IoT Environments

Discrete Audio Tokens: More Than a Survey!

FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation

Inherently Faithful Attention Maps for Vision Transformers

Reparameterized LLM Training via Orthogonal Equivalence Transformation

MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification

SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithms

CellCLIP -- Learning Perturbation Effects in Cell Painting via Text-Guided Contrastive Learning

EuroLLM-9B: Technical Report

Incentivizing Reasoning for Advanced Instruction-Following of Large Language Models

EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEG

MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning

CSVQA: A Chinese Multimodal Benchmark for Evaluating STEM Reasoning Capabilities of VLMs

KGMark: A Diffusion Watermark for Knowledge Graphs

Representing local protein environments with atomistic foundation models

Accelerating RLHF Training with Reward Variance Increase

FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editing

PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulation

REAL-Prover: Retrieval Augmented Lean Prover for Mathematical Reasoning

MSVIT: Improving Spiking Vision Transformer Using Multi-scale Attention Fusion

Abacus: A Cost-Based Optimizer for Semantic Operator Systems

IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems

CAPTURE: Context-Aware Prompt Injection Testing and Robustness Enhancement

Chatting with Papers: A Hybrid Approach Using LLMs and Knowledge Graphs

Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

H$^3$DP: Triply-Hierarchical Diffusion Policy for Visuomotor Learning

Convert Language Model into a Value-based Strategic Planner

Graph RAG for Legal Norms: A Hierarchical, Temporal and Deterministic Approach

CAPO: Cost-Aware Prompt Optimization

Spatiotemporal Learning of Brain Dynamics from fMRI Using Frequency-Specific Multi-Band Attention for Cognitive and Psychiatric Applications

The Backfiring Effect of Weak AI Safety Regulation

Assessing Consistency and Reproducibility in the Outputs of Large Language Models: Evidence Across Diverse Finance and Accounting Tasks

Achieving Unbiased Multi-Instance Learning via Balanced Fine-Grained Positive-Unlabeled Learning

Conformal Prediction Sets for Deep Generative Models via Reduction to Conformal Regression

SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints

Effect of Selection Format on LLM Performance

Reward Shaping to Mitigate Reward Hacking in RLHF

SAE-V: Interpreting Multimodal Models for Enhanced Alignment

LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification

Target Speaker Extraction through Comparing Noisy Positive and Negative Audio Enrollments

Hardware-Friendly Static Quantization Method for Video Diffusion Transformers

PredictaBoard: Benchmarking LLM Score Predictability

Towards Geo-Culturally Grounded LLM Generations

Diverse Topology Optimization using Modulated Neural Fields

Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models

NAROCE: A Neural Algorithmic Reasoner Framework for Online Complex Event Detection

Bridging Voting and Deliberation with Algorithms: Field Insights from vTaiwan and Kultur Komitee

From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphors

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs

Language and Planning in Robotic Navigation: A Multilingual Evaluation of State-of-the-Art Models

Agent Laboratory: Using LLM Agents as Research Assistants

LLMs Help Alleviate the Cross-Subject Variability in Brain Signal and Language Alignment

Uncertainty-Aware Critic Augmentation for Hierarchical Multi-Agent EV Charging Control

Parallel Greedy Best-First Search with a Bound on Expansions Relative to Sequential Search

PunchBench: Benchmarking MLLMs in Multimodal Punchline Comprehension

BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of English

LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior

Geometric Signatures of Compositionality Across a Language Model's Lifetime

AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environment

MSDNet: Multi-Scale Decoder for Few-Shot Semantic Segmentation via Transformer-Guided Prototyping

What is the Right Notion of Distance between Predict-then-Optimize Tasks?

QuantFactor REINFORCE: Mining Steady Formulaic Alpha Factors with Variance-bounded REINFORCE

MALSIGHT: Exploring Malicious Source Code and Benign Pseudocode for Iterative Binary Malware Summarization

Bridging Social Media and Search Engines: Dredge Words and the Detection of Unreliable Domains

Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAG

Quality-aware Masked Diffusion Transformer for Enhanced Music Generation

InkSight: Offline-to-Online Handwriting Conversion by Teaching Vision-Language Models to Read and Write

Exploring news intent and its application: A theory-driven approach

Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures

AgentOrchestra: A Hierarchical Multi-Agent Framework for General-Purpose Task Solving

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities

A Conjecture on a Fundamental Trade-Off between Certainty and Scope in Symbolic and Generative AI

Comment on The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity

TIP-Search: Time-Predictable Inference Scheduling for Market Prediction under Uncertain Load

AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning

Large Language Models' Reasoning Stalls: An Investigation into the Capabilities of Frontier Models

OrgAccess: A Benchmark for Role Based Access Control in Organization Scale LLMs

SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoning

Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis

Arbitrarily Applicable Same/Opposite Relational Responding with NARS

ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoning

Behaviour Discovery and Attribution for Explainable Reinforcement Learning

Verification Learning: Make Unsupervised Neuro-Symbolic System Feasible

Chain-of-Thought Reasoning In The Wild Is Not Always Faithful

Activation Space Interventions Can Be Transferred Between Large Language Models

Planning of Heuristics: Strategic Planning on Large Language Models with Monte Carlo Tree Search for Automating Heuristic Optimization

MAGELLAN: Metacognitive predictions of learning progress guide autotelic LLM agents in large goal spaces

EuroLLM-9B: Technical Report

Created by

Haebom

저자

Pedro Henrique Martins, Joao Alves, Patrick Fernandes, Nuno M. Guerreiro, Ricardo Rei, Amin Farajian, Mateusz Klimaszewski, Duarte M. Alves, Jose Pombal, Nicolas Boizard, Manuel Faysse, Pierre Colombo, Fran\c{c}ois Yvon, Barry Haddow, Jose G. C. de Souza, Alexandra Birch, Andre F. T. Martins

개요

EuroLLM-9B는 유럽 연합의 24개 공식 언어와 11개 추가 언어를 지원하도록 처음부터 학습된 대규모 언어 모델입니다. 기존 오픈 대규모 언어 모델에서 유럽 언어가 과소 대표되고 서비스가 부족한 문제를 해결합니다. 토큰화 설계, 아키텍처 사양, 데이터 필터링 및 훈련 절차를 포함한 EuroLLM-9B의 개발에 대한 포괄적인 개요를 제공합니다. AI 기반 다국어 필터인 EuroFilter 생성과 유럽 언어의 언어 적용 범위를 향상시키는 새로운 합성 데이터셋인 EuroBlocks-Synthetic 설계를 포함한 사전 훈련 데이터 수집 및 필터링 파이프라인을 설명합니다. 평가 결과는 EuroLLM-9B가 다국어 벤치마크 및 기계 번역 작업에서 경쟁력 있는 성능을 보여주며, 동급의 최고의 오픈 유럽산 LLM임을 입증합니다. 오픈 연구 및 채택을 지원하기 위해 기본 및 지시어 튜닝 모델, EuroFilter 분류기 및 합성 사후 훈련 데이터셋을 포함한 이 작업의 모든 주요 구성 요소를 공개합니다.

시사점, 한계점

•

시사점:

◦

유럽 언어에 대한 대규모 언어 모델의 접근성을 크게 향상시킴.

◦

EuroFilter 및 EuroBlocks-Synthetic와 같은 혁신적인 데이터 처리 기술 개발.

◦

다국어 벤치마크 및 기계 번역에서 경쟁력 있는 성능으로 유럽 언어 처리 분야의 발전에 기여.

◦

오픈 소스로 공개되어 연구 및 활용 가능성 증대.

•

한계점:

◦

논문에서 구체적인 한계점이나 향후 연구 방향에 대한 언급이 부족함.

◦

EuroLLM-9B의 성능 평가에 사용된 벤치마크 및 데이터셋에 대한 자세한 설명이 필요함.

◦

특정 유럽 언어에 대한 성능 차이에 대한 분석이 부족함.

Made with Slashpage