Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons

MambaNeXt-YOLO: A Hybrid State Space Model for Real-time Object Detection

Confidence-Guided Human-AI Collaboration: Reinforcement Learning with Distributional Proxy Value Propagation for Autonomous Driving

FOLIAGE: Towards Physical Intelligence World Models Via Unbounded Surface Evolution

UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation

Retrieval-Augmented Generation as Noisy In-Context Learning: A Unified Theory and Risk Bounds

DGMO: Training-Free Audio Source Separation through Diffusion-Guided Mask Optimization

EvaLearn: Quantifying the Learning Capability and Efficiency of LLMs via Sequential Problem Solving

Flexiffusion: Training-Free Segment-Wise Neural Architecture Search for Efficient Diffusion Models

Psi-Sampler: Initial Particle Sampling for SMC-Based Inference-Time Reward Alignment in Score Models

NTPP: Generative Speech Language Modeling for Dual-Channel Spoken Dialogue via Next-Token-Pair Prediction

Linear Representation Transferability Hypothesis: Leveraging Small Models to Steer Large Models

Aligned but Blind: Alignment Increases Implicit Bias by Reducing Awareness of Race

Supervised Quantum Machine Learning: A Future Outlook from Qubits to Enterprise Applications

Train One Sparse Autoencoder Across Multiple Sparsity Budgets to Preserve Interpretability and Accuracy

ReCalKV: Low-Rank KV Cache Compression via Head Reordering and Offline Calibration

ADG: Ambient Diffusion-Guided Dataset Recovery for Corruption-Robust Offline Reinforcement Learning

Seven Security Challenges That Must be Solved in Cross-domain Multi-agent LLM Systems

Breaking the Cloak! Unveiling Chinese Cloaked Toxicity with Homophone Graph and Toxic Lexicon

Inclusive, Differentially Private Federated Learning for Clinical Data

Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)

Electrolyzers-HSI: Close-Range Multi-Scene Hyperspectral Imaging Benchmark Dataset

In-context Language Learning for Endangered Languages in Speech Recognition

Rethinking Text-based Protein Understanding: Retrieval or LLM?

DreamPRM: Domain-Reweighted Process Reward Model for Multimodal Reasoning

Deconstructing Obfuscation: A four-dimensional framework for evaluating Large Language Models assembly code deobfuscation capabilities

STOPA: A Database of Systematic VariaTion Of DeePfake Audio for Open-Set Source Tracing and Attribution

FlowCut: Rethinking Redundancy via Information Flow for Efficient Vision-Language Models

Deriving Strategic Market Insights with Large Language Models: A Benchmark for Forward Counterfactual Generation

The Role of Diversity in In-Context Learning for Large Language Models

MetaGen Blended RAG: Unlocking Zero-Shot Precision for Specialized Domain Question-Answering

Bottlenecked Transformers: Periodic KV Cache Abstraction for Generalised Reasoning

AceReason-Nemotron: Advancing Math and Code Reasoning through Reinforcement Learning

SUS backprop: linear backpropagation algorithm for long inputs in transformers

Optimizing Anytime Reasoning via Budget Relative Policy Optimization

Information Science Principles of Machine Learning: A Causal Chain Meta-Framework Based on Formalized Information Mapping

MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttraining

Piloting Structure-Based Drug Design via Modality-Specific Optimal Schedule

Full-Parameter Continual Pretraining of Gemma2: Insights into Fluency and Domain Knowledge

AGENTFUZZER: Generic Black-Box Fuzzing for Indirect Prompt Injection against LLM Agents

Rethinking LLM Advancement: Compute-Dependent and Independent Paths to Progress

Addressing Concept Mislabeling in Concept Bottleneck Models Through Preference Optimization

Goal-Oriented Time-Series Forecasting: Foundation Framework Design

Biased by Design: Leveraging Inherent AI Biases to Enhance Critical Thinking of News Readers

Hearing Anywhere in Any Environment

NorEval: A Norwegian Language Understanding and Generation Evaluation Benchmark

LLM Social Simulations Are a Promising Research Method

Firm or Fickle? Evaluating Large Language Models Consistency in Sequential Interactions

COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixing

On The Sample Complexity Bounds In Bilevel Reinforcement Learning

TinySQL: A Progressive Text-to-SQL Dataset for Mechanistic Interpretability Research

ChatWise: A Strategy-Guided Chatbot for Enhancing Cognitive Support in Older Adults

Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference Alignment

Knowledge Retention for Continual Model-Based Reinforcement Learning

When Claims Evolve: Evaluating and Enhancing the Robustness of Embedding Models Against Misinformation Edits

ATLaS: Agent Tuning via Learning Critical Steps

Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable

From Benign import Toxic: Jailbreaking the Language Model via Adversarial Metaphors

TurboFuzzLLM: Turbocharging Mutation-based Fuzzing for Effectively Jailbreaking Large Language Models in Practice

SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inference

Contrastive Visual Data Augmentation

SNaRe: Domain-aware Data Generation for Low-Resource Event Detection

AnyTop: Character Animation Diffusion with Any Topology

Towards Robust ESG Analysis Against Greenwashing Risks: Aspect-Action Analysis with Cross-Category Generalization

GoRA: Gradient-driven Adaptive Low Rank Adaptation

Mind the Confidence Gap: Overconfidence, Calibration, and Distractor Effects in Large Language Models

Bandit Multiclass List Classification

CurvGAD: Leveraging Curvature for Enhanced Graph Anomaly Detection

Can Large Language Models Understand Intermediate Representations in Compilers?

Contrastive Representation Distillation via Multi-Scale Feature Decoupling

Blackout DIFUSCO

Multiple Invertible and Partial-Equivariant Function for Latent Vector Transformation to Enhance Disentanglement in VAEs

Analytical Lyapunov Function Discovery: An RL-based Generative Approach

Explainability in Practice: A Survey of Explainable NLP Across Various Domains

Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictions

Spectro-Riemannian Graph Neural Networks

The Lessons of Developing Process Reward Models in Mathematical Reasoning

Efficiently Serving Large Multimodal Models Using EPD Disaggregation

Hybrid deep convolution model for lung cancer detection with transfer learning

Uncovering Memorization Effect in the Presence of Spurious Correlations

OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoning

An analytic theory of creativity in convolutional diffusion models

HashEvict: A Pre-Attention KV Cache Eviction Strategy using Locality-Sensitive Hashing

From Intention To Implementation: Automating Biomedical Research via LLMs

Proactive Model Adaptation Against Concept Drift for Online Time Series Forecasting

MuLan: Adapting Multilingual Diffusion Models for Hundreds of Languages with Negligible Cost

Functional relevance based on the continuous Shapley value

Empower Structure-Based Molecule Optimization with Gradient Guided Bayesian Flow Networks

What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective

Focus On This, Not That! Steering LLMs with Adaptive Feature Specification

A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks

David and Goliath: Small One-step Model Beats Large Diffusion with Score Post-training

Context is Key: A Benchmark for Forecasting with Essential Textual Information

Diff-Instruct++: Training One-step Text-to-image Generator Model to Align with Human Preferences

Beyond Position: the emergence of wavelet-like properties in Transformers

The Disparate Benefits of Deep Ensembles

Not All Options Are Created Equal: Textual Option Weighting for Token-Efficient LLM-Based Knowledge Tracing

Evaluating Morphological Compositional Generalization in Large Language Models

Stein Variational Evolution Strategies

Biased AI can Influence Political Decision-Making

Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountability

Created by

Haebom

저자

Genta Indra Winata, David Anugraha, Emmy Liu, Alham Fikri Aji, Shou-Yi Hung, Aditya Parashar, Patrick Amadeus Irawan, Ruochen Zhang, Zheng-Xin Yong, Jan Christian Blaise Cruz, Niklas Muennighoff, Seungone Kim, Hanyang Zhao, Sudipta Kar, Kezia Erina Suryoraharjo, M. Farid Adilazuarda, En-Shiun Annie Lee, Ayu Purwarianti, Derry Tanti Wijaya, Monojit Choudhury

개요

본 논문은 머신러닝 모델 학습 및 평가에 필수적인 고품질 데이터셋 생성의 어려움을 지적하며, 특히 정확한 수동 주석 작업의 어려움에 주목합니다. 기존 데이터셋 논문들이 독창성, 다양성, 엄격한 품질 관리 부족 등의 문제를 안고 있으며, 심사 과정에서 이러한 단점들이 간과되는 경우가 많다는 점을 강조합니다. 또한 데이터셋 구성 및 속성에 대한 필수적인 세부 정보가 자주 누락되는 점을 지적합니다. 기존의 데이터시트와 같은 도구들이 투명성을 증진시키는 것을 목표로 하지만, 대부분 기술적인 설명에 그치며 데이터 품질을 평가하는 표준화되고 측정 가능한 방법을 제공하지 못한다는 점을 비판합니다. 이러한 한계를 해결하기 위해, 본 논문은 데이터셋 심사 과정에 체계적인 루브릭 기반 평가 지표를 통합할 것을 제안하며, 특히 데이터셋 제출량이 증가하는 추세를 고려할 때 더욱 중요하다고 주장합니다. 더불어 합성 데이터 생성을 위한 확장 가능하고 비용 효율적인 방법, 전용 도구 및 LLM 기반 평가 접근 방식을 탐구합니다. 마지막으로, 수동 및 모델 생성 데이터셋의 품질을 평가하기 위한 구조화된 프레임워크인 DataRubrics를 소개하고, LLM 기반 평가의 재현성, 확장성 및 실행 가능성을 강조하며, LLM 기반 평가의 재현성을 지원하는 코드를 공개합니다 (https://github.com/datarubrics/datarubrics).

GitHub - datarubrics/datarubrics: DataRubrics, a structured framework for assessing the quality of both human- and model-generated datasets. Leveraging recent advances in LLM-based evaluation.

DataRubrics, a structured framework for assessing the quality of both human- and model-generated datasets. Leveraging recent advances in LLM-based evaluation. - datarubrics/datarubrics

시사점, 한계점

•

시사점:

◦

데이터셋 품질 평가를 위한 체계적이고 측정 가능한 방법의 필요성을 강조하고, DataRubrics라는 실질적인 해결책을 제시.

◦

LLM 기반 평가를 활용하여 데이터셋 평가의 효율성과 확장성을 높일 수 있는 가능성 제시.

◦

데이터셋 심사 과정에 루브릭 기반 평가 지표를 통합하여 데이터 중심 연구의 질적 향상 도모.

◦

합성 데이터 생성을 통한 데이터셋 생성의 효율성 증대 방안 제시.

•

한계점:

◦

DataRubrics의 실제 효과 및 적용 가능성에 대한 추가적인 실증 연구 필요.

◦

LLM 기반 평가의 편향성 및 신뢰성에 대한 검증 필요.

◦

루브릭 기반 평가 지표의 보편적인 적용 및 표준화에 대한 논의 필요.

◦

합성 데이터 생성의 품질 및 현실성에 대한 추가적인 고려 필요.

Made with Slashpage