Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Dually Hierarchical Drift Adaptation for Online Configuration Performance Learning

Token-based Audio Inpainting via Discrete Diffusion

Mechanistic Indicators of Understanding in Large Language Models

PyVision: Agentic Vision with Dynamic Tooling

Low Resource Reconstruction Attacks Through Benign Prompts

DTECT: Dynamic Topic Explorer & Context Tracker

Your Absorbing Discrete Diffusion Secretly Models the Bayesian Posterior

Bias-Aware Mislabeling Detection via Decoupled Confident Learning

Bridging the Last Mile of Prediction: Enhancing Time Series Forecasting with Conditional Guided Flow Matching

Planted in Pretraining, Swayed by Finetuning: A Case Study on the Origins of Cognitive Biases in LLMs

FlexOlmo: Open Language Models for Flexible Data Use

Democratizing High-Fidelity Co-Speech Gesture Video Generation

GR-LLMs: Recent Advances in Generative Recommendation Based on Large Language Models

LIRA: Inferring Segmentation in Large Multi-modal Models with Local Interleaved Region Assistance

BayesSDF: Surface-Based Laplacian Uncertainty Estimation for 3D Geometry with Neural Signed Distance Fields

Fast Bilateral Teleoperation and Imitation Learning Using Sensorless Force Control via Accurate Dynamics Model

DESIGN: Encrypted GNN Inference via Server-Side Input Graph Pruning

Beyond classical and contemporary models: a transformative AI framework for student dropout prediction in distance learning using RAG, Prompt engineering, and Cross-modal fusion

Hear-Your-Click: Interactive Object-Specific Video-to-Audio Generation

PRIME: Large Language Model Personalization with Cognitive Memory and Thought Processes

LearnLens: LLM-Enabled Personalised, Curriculum-Grounded Feedback with Educators in the Loop

Zero-Shot Cyclic Peptide Design via Composable Geometric Constraints

Model Collapse Is Not a Bug but a Feature in Machine Unlearning for LLMs

SymbolicThought: Integrating Language Models and Symbolic Reasoning for Consistent and Interpretable Human Relationship Understanding

From Video to EEG: Adapting Joint Embedding Predictive Architecture to Uncover Visual Concepts in Brain Signal Analysis

An Efficient Deep Learning Framework for Brain Stroke Diagnosis Using Computed Tomography (CT) Images

De-Fake: Style based Anomaly Deepfake Detection

ForgeHLS: A Large-Scale, Open-Source Dataset for High-Level Synthesis

Expert-level validation of AI-generated medical text with scalable language models

DriveMRP: Enhancing Vision-Language Models with Synthetic Motion Data for Motion Risk Prediction

FlowSpec: Continuous Pipelined Speculative Decoding for Efficient Distributed LLM Inference

DeltaSHAP: Explaining Prediction Evolutions in Online Patient Monitoring with Shapley Values

Following the Clues: Experiments on Person Re-ID using Cross-Modal Intelligence

Description of the Training Process of Neural Networks via Ergodic Theorem : Ghost nodes

Quality over Quantity: An Effective Large-Scale Data Reduction Strategy Based on Pointwise V-Information

Imagine for Me: Creative Conceptual Blending of Real Images and Text via Blended Attention

When Small Guides Large: Cross-Model Co-Learning for Test-Time Adaptation

Perspective Dial: Measuring Perspective of Text and Guiding LLM Outputs

CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentation

Positioning AI Tools to Support Online Harm Reduction Practice: Applications and Design Directions

Interpretable Time Series Autoregression for Periodicity Quantification

Teaching Models to Verbalize Reward Hacking in Chain-of-Thought Reasoning

Exploration Behavior of Untrained Policies

Ark: An Open-source Python-based Framework for Robot Learning

Hyperspherical Variational Autoencoders Using Efficient Spherical Cauchy Distribution

TReB: A Comprehensive Benchmark for Evaluating Table Reasoning Capabilities of Large Language Models

The Debugging Decay Index: Rethinking Debugging Strategies for Code LLMs

Towards Effective Complementary Security Analysis using Large Language Models

Vision-Guided Chunking Is All You Need: Enhancing RAG with Multimodal Document Understanding

Learning from M-Tuple Dominant Positive and Unlabeled Data

BreastDCEDL: A Comprehensive Breast Cancer DCE-MRI Dataset and Transformer Implementation for Treatment Response Prediction

Pisces: An Auto-regressive Foundation Model for Image Understanding and Generation

SLED: A Speculative LLM Decoding Framework for Efficient Edge Serving

BIS Reasoning 1.0: The First Large-Scale Japanese Benchmark for Belief-Inconsistent Syllogistic Reasoning

FuseUNet: A Multi-Scale Feature Fusion Method for U-like Networks

Subgroups Matter for Robust Bias Mitigation

Robust Stability Analysis of Positive Lure System with Neural Network Feedback

Next-token pretraining implies in-context learning

A modular framework for automated evaluation of procedural content generation in serious games with deep reinforcement learning agents

Learning Flexible Forward Trajectories for Masked Molecular Diffusion

LEXam: Benchmarking Legal Reasoning on 340 Law Exams

Large Language Model Psychometrics: A Systematic Review of Evaluation, Validation, and Enhancement

Quantum Observers: A NISQ Hardware Demonstration of Chaotic State Prediction Using Quantum Echo-state Networks

Visual Test-time Scaling for GUI Agent Grounding

Consistency in Language Models: Current Landscape, Challenges, and Future Directions

Avoiding Leakage Poisoning: Concept Interventions Under Distribution Shifts

Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction

Adaptive Non-local Observable on Quantum Neural Networks

Leveraging Large Language Models for Multi-Class and Multi-Label Detection of Drug Use and Overdose Symptoms on Social Media

Bypassing LLM Guardrails: An Empirical Analysis of Evasion Attacks against Prompt Injection and Jailbreak Detection Systems

Divergence of Empirical Neural Tangent Kernel in Classification Problems

Rethinking the Foundations for Continual Reinforcement Learning

Predictive Modeling: BIM Command Recommendation Based on Large-scale Usage Logs

Unfair Learning: GenAI Exceptionalism and Copyright Law

OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agents

LLMs' Leaning in European Elections

COVID-19 Pneumonia Diagnosis Using Medical Images: Deep Learning-Based Transfer Learning Approach

Can A Society of Generative Agents Simulate Human Behavior and Inform Public Health Policy? A Case Study on Vaccine Hesitancy

Learning-Order Autoregressive Models with Application to Molecular Graph Generation

KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Coding

Class-Aware PillarMix: Can Mixed Sample Data Augmentation Enhance 3D Object Detection with Radar Point Clouds?

No, of Course I Can! Deeper Fine-Tuning Attacks That Bypass Token-Level Safety Mechanisms

Disambiguate First, Parse Later: Generating Interpretations for Ambiguity Resolution in Semantic Parsing

IPAD: Inverse Prompt for AI Detection -- A Robust and Explainable LLM-Generated Text Detector

B-cos LM: Efficiently Transforming Pre-trained Language Models for Improved Explainability

Brain Latent Progression: Individual-based Spatiotemporal Disease Progression on 3D Brain MRIs via Latent Diffusion

Integrating Generative Artificial Intelligence in ADRD: A Roadmap for Streamlining Diagnosis and Care in Neurodegenerative Diseases

Logits are All We Need to Adapt Closed Models

Oracular Programming: A Modular Foundation for Building LLM-Enabled Software

Learning Traffic Anomalies from Generative Models on Real-Time Observations

BiDepth: A Bidirectional-Depth Neural Network for Spatio-Temporal Prediction

Not all tokens are created equal: Perplexity Attention Weighted Networks for AI generated text detection

Prune 'n Predict: Optimizing LLM Decision-making with Conformal Prediction

Relation-aware Hierarchical Prompt for Open-vocabulary Scene Graph Generation

An Interoperable Machine Learning Pipeline for Pediatric Obesity Risk Estimation

BEExformer: A Fast Inferencing Binarized Transformer with Early Exits

VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editing

Tiny-Align: Bridging Automatic Speech Recognition and Large Language Model on the Edge

DuSEGO: Dual Second-order Equivariant Graph Ordinary Differential Equation

Knowledge-Augmented Multimodal Clinical Rationale Generation for Disease Diagnosis with Small Language Models

FlexOlmo: Open Language Models for Flexible Data Use

Created by

Haebom

저자

Weijia Shi, Akshita Bhagia, Kevin Farhat, Niklas Muennighoff, Pete Walsh, Jacob Morrison, Dustin Schwenk, Shayne Longpre, Jake Poznanski, Allyson Ettinger, Daogao Liu, Margaret Li, Dirk Groeneveld, Mike Lewis, Wen-tau Yih, Luca Soldaini, Kyle Lo, Noah A. Smith, Luke Zettlemoyer, Pang Wei Koh, Hannaneh Hajishirzi, Ali Farhadi, Sewon Min

개요

FlexOlmo는 분산 학습과 데이터 유연 추론을 지원하는 새로운 종류의 언어 모델입니다. 서로 다른 모델 파라미터들이 개별적으로 폐쇄된 데이터셋에서 학습되며(데이터 공유 없이), 추론 시에는 이러한 파라미터와 관련 데이터를 추가적인 학습 없이 유연하게 포함하거나 제외할 수 있습니다. 각 전문가(expert)는 독립적으로 폐쇄된 데이터셋에서 학습되고, 새로운 도메인 정보 라우팅을 통해 통합됩니다(결합 학습 없음). 공개 데이터셋과 7개의 도메인별 데이터셋으로 구성된 FlexMix 코퍼스를 사용하여 학습되었으며, 최대 370억 개의 파라미터(200억 개 활성)를 가진 모델을 31개의 다양한 하위 작업에서 평가했습니다. 공개 데이터로 학습된 일반 전문가를 다른 데이터 소유자의 독립적으로 학습된 전문가와 효과적으로 결합하여 평균 41%의 상대적 성능 향상을 달성했으며, 데이터 라이선스 또는 허가 요구사항에 따라 특정 데이터를 선택적으로 제외할 수 있습니다. 기존 모델 병합 방법보다 평균 10.1%의 성능 향상을 보였으며, 동일한 학습 FLOPs을 사용하는 표준 MoE보다도 성능이 우수했습니다. 민감하거나 보호된 데이터를 가진 규제 산업의 데이터 소유자와 연구자 모두에게 해결책을 제공합니다. 데이터를 로컬로 유지하고 추론 중 데이터 접근에 대한 세분화된 제어를 지원하여 폐쇄된 데이터의 이점을 누리면서 데이터 소유자의 기본 설정을 존중합니다.

시사점, 한계점

•

시사점:

◦

분산 학습을 통해 데이터 공유 없이 여러 데이터 소유자의 데이터를 활용한 언어 모델 학습 가능

◦

추론 시 데이터 유연성 제공: 데이터 라이선스 또는 허가 요구사항에 따라 데이터 선택적 포함/제외 가능

◦

기존 모델 병합 방법 및 데이터 제약 없이 학습된 표준 MoE보다 우수한 성능

◦

규제 산업에서 민감한 데이터의 활용 및 데이터 프라이버시 보호에 대한 실질적인 해결책 제시

•

한계점:

◦

FlexMix 코퍼스의 구성 및 폐쇄 데이터셋의 대표성에 대한 추가적인 검증 필요

◦

다양한 데이터셋 통합 시 발생할 수 있는 편향 및 데이터 간의 상호작용에 대한 추가 연구 필요

◦

실제 산업 환경 적용 시 발생할 수 있는 문제점 및 확장성에 대한 추가적인 실험 및 분석 필요

Made with Slashpage