Daily Arxiv

世界中で発行される人工知能関連の論文をまとめるページです。
このページはGoogle Geminiを活用して要約し、非営利で運営しています。
論文の著作権は著者および関連機関にあり、共有する際は出典を明記してください。

CEHR-XGPT: A Scalable Multi-Task Foundation Model for Electronic Health Records

Unveiling the Response of Large Vision-Language Models to Visually Absent Tokens

Adaptive Learning Strategies for Mitotic Figure Classification in MIDOG2025 Challenge

MitoDetect++: A Domain-Robust Pipeline for Mitosis Detection and Atypical Subtyping

Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidance

Fantastic Pretraining Optimizers and Where to Find Them

Towards Interpretable Geo-localization: a Concept-Aware Global Image-GPS Alignment Framework

TECP: Token-Entropy Conformal Prediction for LLMs

The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Management

Train-Once Plan-Anywhere Kinodynamic Motion Planning via Diffusion Trees

Skill-Aligned Fairness in Multi-Agent Learning for Collaboration in Healthcare

Mitigating Hallucinations in LM-Based TTS Models via Distribution Alignment Using GFlowNets

AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injection

HuggingGraph: Understanding the Supply Chain of LLM Ecosystem

Food safety trends across Europe: insights from the 392-million-entry CompreHensive European Food Safety (CHEFS) database

Simple Yet Effective: An Information-Theoretic Approach to Multi-LLM Uncertainty Quantification

BayesSDF: Surface-Based Laplacian Uncertainty Estimation for 3D Geometry with Neural Signed Distance Fields

Empowering Bridge Digital Twins by Bridging the Data Gap with a Unified Synthesis Framework

The Features at Convergence Theorem: a first-principles alternative to the Neural Feature Ansatz for how networks learn representations

AI-Assisted Rapid Crystal Structure Generation Towards a Target Local Environment

First Steps Towards Overhearing LLM Agents: A Case Study With Dungeons & Dragons Gameplay

TokUR: Token-Level Uncertainty Estimation for Large Language Model Reasoning

Cutting Through Privacy: A Hyperplane-Based Data Reconstruction Attack in Federated Learning

AutoPDL: Automatic Prompt Optimization for LLM Agents

RailGoerl24: G\"orlitz Rail Test Center CV Dataset 2024

Revealing higher-order neural representations of uncertainty with the Noise Estimation through Reinforcement-based Diffusion (NERD) model

PromptGuard: Soft Prompt-Guided Unsafe Content Moderation for Text-to-Image Models

Spoof Trace Discovery for Deep Learning Based Explainable Face Anti-Spoofing

The Information Security Awareness of Large Language Models

Automatically Detecting Online Deceptive Patterns

HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scale

Automated detection of underdiagnosed medical conditions via opportunistic imaging

Selective Preference Optimization via Token-Level Reward Function Estimation

ATHAR: A High-Quality and Diverse Dataset for Classical Arabic to English Translation

PersonaGym: Evaluating Persona Agents and LLMs

CFaults: Model-Based Diagnosis for Fault Localization in C Programs with Multiple Test Cases

From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks

AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling

Demystifying Chains, Trees, and Graphs of Thoughts

Survival Analysis with Adversarial Regularization

Net2Brain: A Toolbox to compare artificial vision models with human brain responses

The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMs

PersonaTeaming: Exploring How Introducing Personas Can Improve Automated AI Red-Teaming

UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning

Dynamic Speculative Agent Planning

AI-SearchPlanner: Modular Agentic Search via Pareto-Optimal Multi-Objective Reinforcement Learning

Graph RAG as Human Choice Model: Building a Data-Driven Mobility Agent with Preference Chain

MHSNet:An MoE-based Hierarchical Semantic Representation Network for Accurate Duplicate Resume Detection with Large Language Model

FutureX: An Advanced Live Benchmark for LLM Agents in Future Prediction

MeLA: A Metacognitive LLM-Driven Architecture for Automatic Heuristic Design

Conversational Education at Scale: A Multi-LLM Agent Workflow for Procedural Learning and Pedagogic Quality Assessment

DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoning

Don't Make It Up: Preserving Ignorance Awareness in LLM Fine-Tuning

Translating Federated Learning Algorithms in Python into CSP Processes Using ChatGPT

ArtRAG: Retrieval-Augmented Generation with Structured Context for Visual Art Understanding

Epistemic Skills: Reasoning about Knowledge and Oblivion

Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment

GUIエージェント：A Survey

Neural Network Verification with PyRAT

Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-tuning

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation

MMoE: Robust Spoiler Detection with Multi-modal Information and Domain-aware Mixture-of-Experts

WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool

Crosscoding Through Time: Tracking Emergence & Consolidation Of Linguistic Representations Throughout LLM Pretraining

SpikingBrain Technical Report: Spiking Brain-inspired Large Models

Scaling Performance of Large Language Model Pretraining

Recomposer: Event-roll-guided generative audio editing

COGITAO: A Visual Reasoning Framework To Study Compositionality & Generalization

Uncertain but Useful: Leveraging CNN Variability into Data Augmentation

CURE: Controlled Unlearning for Robust Embeddings - Mitigating Conceptual Shortcuts in Pre-Trained Language Models

HoPE: Hyperbolic Rotary Positional Encoding for Stable Long-Range Dependency Modeling in Large Language Models

RapidGNN: Energy and Communication-Efficient Distributed Training on Large-Scale Graph Neural Networks

Enhancing 3D Point Cloud Classification with ModelNet-R and Point-SkipNet

AI Agents for Web Testing: A Case Study in the Wild

Accuracy-Constrained CNN Pruning for Efficient and Reliable EEG-Based Seizure Detection

Exploring Situated Stabilities of a Rhythm Generation System through Variational Cross-Examination

GenAI-based test case generation and execution in SDV platform

ICR: Iterative Clarification and Rewriting for Conversational Search

ToM-SSI: Evaluating Theory of Mind in Situated Social Interactions

Towards Efficient Pixel Labeling for Industrial Anomaly Detection and Localization

Pointing-Guided Target Estimation via Transformer-Based Attention

Adversarial Augmentation and Active Sampling for Robust Cyber Anomaly Detection

LLM Enabled Multi-Agent System for 6G Networks: Framework and Method of Dual-Loop Edge-Terminal Collaboration

High-Resolution Global Land Surface Temperature Retrieval via a Coupled Mechanism-Machine Learning Framework

Exploring an implementation of quantum learning pipeline for support vector machines

DeGuV: Depth-Guided Visual Reinforcement Learning for Generalization and Interpretability in Manipulation

Artificial intelligence for representing and characterizing quantum systems

PLaMo 2 Technical Report

SpiderNets: Estimating Fear Ratings of Spider-Related Images with Vision Models

The Paradox of Doom: Acknowledging Extinction Risk Reduces the Incentive to Prevent It

A Knowledge-Driven Diffusion Policy for End-to-End Autonomous Driving Based on Expert Routing

REMOTE: A Unified Multimodal Relation Extraction Framework with Multilevel Optimal Transport and Mixture-of-Experts

PropVG: End-to-End Proposal-Driven Visual Grounding with Multi-Granularity Discrimination

Exploring Non-Local Spatial-Angular Correlations with a Hybrid Mamba-Transformer Framework for Light Field Super-Resolution

AI-Driven Fronthaul Link Compression in Wireless Communication Systems: Review and Method Design

Toward Accessible Dermatology: Skin Lesion Classification Using Deep Learning Models on Mobile-Acquired Images

Graph Unlearning: Efficient Node Removal in Graph Neural Networks

Enhancing Diversity in Large Language Models via Determinantal Point Processes

VARMA-Enhanced Transformer for Time Series Forecasting

The LLM Has Left The Chat: Evidence of Bail Preferences in Large Language Models

Scaling Performance of Large Language Model Pretraining

Created by

Haebom

作者

Alexander Interrante-Grant, Carla Varela-Rosa, Suhaas Narayan, Chris Connelly, Albert Reuther

概要

この論文は、大規模言語モデル（LLM）の事前トレーニングパイプライン、特に分散トレーニング、数百のノードにわたる大規模データセット管理、および利用可能なGPU計算能力を完全に活用するデータ並列処理拡張の理解を高めることを目的としています。最先端のAI研究企業は、大規模なデータセットで大規模なモデルを訓練するために数十億ドルをスーパーコンピューティングインフラストラクチャに投資していますが、これらの大規模なトレーニングパイプラインのパフォーマンスの拡張とトレーニングの考慮事項に関する情報は公開資料に欠けています。したがって、この論文では、大規模な言語モデルを拡張する際にトレーニングのパフォーマンスを調整するための実用的な推奨事項を提供します。

Takeaways、Limitations

•

Takeaways：大規模言語モデルの分散トレーニング、大規模データセット管理、およびデータ並列処理の拡張に関する実用的な推奨事項を提供し、効率的なトレーニングを可能にします。 LLMトレーニングの効率向上に貢献できます。

•

Limitations：この論文で提示されている推奨事項は、特定の環境またはモデルに限定される可能性があり、一般化に制限がある可能性があります。開示された資料の不足により、あらゆる側面を包括的に扱うことができない場合があります。具体的なトレーニングパラメータや技術的な詳細が不足する可能性があります。

Made with Slashpage