[공지사항]을 빙자한 안부와 근황
Show more
/
/
Daily Arxiv
Daily Arxiv
世界中で発行される人工知能関連の論文をまとめるページです。
このページはGoogle Geminiを活用して要約し、非営利で運営しています。
論文の著作権は著者および関連機関にあり、共有する際は出典を明記してください。
SystolicAttention: Fusing FlashAttention within a Single Systolic Array
Automated Novelty Evaluation of Academic Paper: A Collaborative Approach Integrating Human and Large Language Model Knowledge
"Is it always watching? Is it always listening?" Exploring Contextual Privacy and Security Concerns Toward Domestic Social Robots
A Group Theoretic Analysis of the Symmetries Underlying Base Addition and Their Learnability by Neural Networks
GHPO: Adaptive Guidance for Stable and Efficient LLM Reinforcement Learning
Extension OL-MDISF: Online Learning from Mix-Typed, Drifted, and Incomplete Streaming Features
When and Where do Data Poisons Attack Textual Inversion?
Truth Sleuth and Trend Bender: AI Agents to fact-check YouTube videos and influence opinions
NLP Meets the World: Toward Improving Conversations With the Public About Natural Language Processing Research
Accurate generation of chemical reaction transition states by conditional flow matching
Benchmarking and Evaluation of AI Models in Biology: Outcomes and Recommendations from the CZI Virtual Cells Workshop
A PBN-RL-XAI Framework for Discovering a "Hit-and-Run" Therapeutic Strategy in Melanoma
NeuTSFlow: Modeling Continuous Functions Behind Time Series Forecasting
THOR: Transformer Heuristics for On-Demand Retrieval
Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs
ブリッジング Literature and the Universe Via A Multi-Agent Large Language Model System
Magneto-radiative modelling and artificial neural network optimization of biofluid flow in a stenosed arterial domain
Symbiosis: Multi-Adapter Inference and Fine-Tuning
Rethinking Data Protection in the (Generative) Artificial Intelligence Era
SoK: Semantic Privacy in Large Language Models
FedRef: Communication-Efficient Bayesian Fine Tuning with Reference Model
Predictable Scale: Part II, Farseer: A Refined Scaling Law in Large Language Models
Position Prediction Self-Supervised Learning for Multimodal Satellite Imagery Semantic Segmentation
ScaleRTL: Scaling LLMs with Reasoning Data and Test-Time Compute for Accurate RTL Code Generation
HueManity: Probing Fine-Grained Visual Perception in MLLMs
AKReF: An argumentative knowledge representation framework for structured argumentation
Large Language Models Often Know When They Are Being Evaluated
Dynamic Risk Assessments for Offensive Cybersecurity Agents
How Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inference
Diffused Responsibility: Analyzing the Energy Consumption of Generative Text-to-Audio Diffusion Models
Flow-GRPO: Training Flow Matching Models via Online RL
On the Need for a Statistical Foundation in Scenario-Based Testing of Autonomous Vehicles
What's Pulling the Strings? Evaluating Integrity and Attribution in AI Training and Inference through Concept Shift
TD-EVAL: Revisiting Task-Oriented Dialogue Evaluation by Combining Turn-Level Precision with Dialogue-Level Comparisons
MobileCity: An Efficient Framework for Large-Scale Urban Behavior Simulation
Semantic Adapter for Universal Text Embeddings: Diagnosing and Mitigating Negation Blindness to Enhance Universality
Leveraging LLMs for User Stories in AI Systems: UStAI Dataset
Large Language Models are Unreliable for Cyber Threat Intelligence
AnnoPage Dataset: Dataset of Non-Textual Elements in Documents with Fine-Grained Categorization
A Thorough Assessment of the Non-IID Data Impact in Federated Learning
Visual Position Prompt for MLLM ベースの Visual Grounding
Neurons: Emulating the Human Visual Cortex Improves Fidelity and Interpretability in fMRI-to-Video Reconstruction
FADE: Why Bad Descriptions Happen to Good Features
FlipConcept: Tuning-Free Multi-Concept Personalization for Text-to-Image Generation
LUMINA-Net: Low-light Upgrade through Multi-stage Illumination and Noise Adaptation Network for Image Enhancement
Towards Geo-Culturally Grounded LLM Generations
Learning to Reason at the Frontier of Learnability
Flexible and Efficient Grammar-Constrained Decoding
PATCH: a deep learning method to assess heterogeneity of artistic practice in historical paintings
The Impact of Modern AI in Metadata Management
Learning an Effective Premise Retrieval Model for Efficient Mathematical Formalization
ChipAlign: Instruction Alignment in Large Language Models for Chip Design via Geodesic Interpolation
Many Objective Problems Where Crossover is Provably Essential
Patherea: Cell Detection and Classification for the 2020s
ViTally Consistent: Scaling Biological Representation Learning for Cell Microscopy
TextDestroyer: A Training- and Annotation-Free Diffusion Method for Destroying Anomal Text from Images
Quantifying calibration error in modern neural networks through evidence based theory
Multi-view biomedical foundation models for molecule-target and property prediction
Reinforced Imitative Trajectory Planning for Urban Automated Driving
Distilling Invariant Representations with Dual Augmentation
Tackling the Abstraction and Reasoning Corpus with Vision Transformers: the Importance of 2D Representation, Positions, and Objects
Linearly-Interpretable Concept Embedding Models for Text Analysis
Towards Understanding Link Predictor Generalizability Under Distribution Shifts
StreakNet-Arch: An Anti-scattering Network-based Architecture for Underwater Carrier LiDAR-Radar Imaging
Enhancing Trust in Autonomous Agents: An Architecture for Accountability and Explainability through Blockchain and Large Language Models
On the Statistical Properties of Generative Adversarial Models for Low Intrinsic Data Dimension
Programming Distributed Collective Processes in the eXchange Calculus
Holistic analysis on the sustainability of Federated Learning across AI product lifecycle
Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory
Epic-Sounds: A Large-scale Dataset of Actions That Sound
From Semantic Web and MAS to Agentic AI: A Unified Narrative of the Web of Agents
On Gradual Semantics for Assumption-Based Argumentation
The Challenge of Teaching Reasoning to LLMs Without RL or Distillation
Continuous Classification Aggregation
Can Prompt Difficulty be Online Predicted for Accelerating RL Finetuning of Reasoning Models?
MacOSWorld: A Multilingual Interactive Benchmark for GUI Agents
GeoChain: Multimodal Chain-of-Thought for Geographic Reasoning
Lost in Transmission: When and Why LLMs Fail to Reason Globally
A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems
System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systems
Practical Principles for AI Cost and Compute Accounting
Generative Emergent Communication: Large Language Model is a Collective World Model
Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertainty
Learning Lifted STRIPS Models from Action Traces Alone: A Simple, General, and Scalable Solution
Hallucination Detox: Sensitivity Dropout (SenD) for Large Language Model Training
Life, uh, Finds a Way: Hyperadaptability by Behavioral Search
Governance of Generative Artificial Intelligence for Companies
RACER: Rational Artificial Intelligence Car-following-model Enhanced by Reality
Artificial Intelligence Governance for Businesses
Interpreting Radiologist's Intention from Eye Movements in Chest X-ray Diagnosis
S2WTM: Spherical Sliced-Wasserstein Autoencoder for Topic Modeling
LLM-Based Config Synthesis requires Disambiguation
Characterizing State Space Model (SSM) and SSM-Transformer Hybrid Language Model Performance with Long Context Length
EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos
Can We Predict Alignment Before Models Finish Thinking? Towards Monitoring Misaligned Reasoning Models
Unit-Based Histopathology Tissue Segmentation via Multi-Level Feature Representation
Advancing Retrieval-Augmented Generation for Structured Enterprise and Internal Data
Mixture of Raytraced Experts
QuRe: Query-Relevant Retrieval through Hard Negative Sampling in Composed Image Retrieval
AutoVDC: Automated Vision Data Cleaning Using Vision-Language Models
Load more
A Thorough Assessment of the Non-IID Data Impact in Federated Learning
Created by
Haebom
作者
Daniel M. Jimenez-Gutierrez, Mehrdad Hassanzadeh, Aris Anagnostopoulos, Ioannis Chatzigiannakis, Andrea Vitaletti
概要
本論文は、分散クライアントの情報を活用してコラボレーション機械学習モデルの訓練を可能にする連合学習（FL）におけるデータの不均一性（non-IID）問題を詳細に分析します。特に、従来の研究で体系的に扱われていなかった様々なタイプのデータの不均一性（ラベル、特徴、データ量、時空間的非対称）をヘリンガー距離（HD）を使用して測定し、最新の4つのnon-IIDデータ処理戦略の性能を実験的に比較分析します。特に、時空間的非対称性の影響は、ＦＬ性能について初めて包括的に分析される。実験は、ラベルと時空間非対称性がFLモデルのパフォーマンスに大きな影響を与え、特定のHDしきい値を超えるとパフォーマンスの低下が大幅に発生することを示しています。極端な非IID状況でFL性能が大幅に低下することを確認し、データの不均一性を効果的に解決するためのFL研究方向を提示します。
Takeaways、Limitations
•
Takeaways：
◦
連合学習におけるラベルおよび時空間的非対称性のような様々なタイプのデータの不均一性の影響を定量的に分析し、その重大性を明確に示した。
◦
特定のヘリンガー距離（HD）しきい値に基づいてnon-IIDデータの影響を分析し、効果的なnon-IIDデータ処理戦略の開発に関する重要なガイドラインを提供しました。
◦
時空間的非対称性の影響をFL性能について最初に包括的に分析し,今後の研究の基盤を確立した。
◦
極端な非IID状況でFL性能の低下が大幅に発生することを確認し、これを解決するための研究方向を提示しました。
•
Limitations:
◦
この研究は、特定のデータセットと設定に限定された実験結果に基づいているため、他のデータセットや設定では一般化されない可能性があります。
◦
より多様な非IIDデータ処理戦略の比較分析が必要となる場合がある。
◦
ヘリンガー距離以外の他のデータ分布差測定法を用いたさらなる分析が必要となる場合がある。
PDFを見る
Made with Slashpage
