Daily Arxiv

世界中で発行される人工知能関連の論文をまとめるページです。
このページはGoogle Geminiを活用して要約し、非営利で運営しています。
論文の著作権は著者および関連機関にあり、共有する際は出典を明記してください。

Watermarking and Anomaly Detection in Machine Learning Models for LORA RF Fingerprinting

Vulnerable Agent Identification in Large-Scale Multi-Agent Reinforcement Learning

Sea-ing Through Scattered Rays: Revisiting the Image Formation Model for Realistic Underwater Image Generation

DPANet: Dual Pyramid Attention Network for Multivariate Time Series Forecasting

MeanFlowSE: one-step generative speech enhancement via conditional mean flow

Empathy-R1: A Chain-of-Empathy and Reinforcement Learning Framework for Long-Form Mental Health Support

Threat Modeling for Enhancing Security of IoT Audio Classification Devices under a Secure Protocols Framework

AToken: A Unified Tokenizer for Vision

TGPO: Tree-Guided Preference Optimization for Robust Web Agent Reinforcement Learning

Comprehensive Evaluation of CNN-Based Audio Tagging Models on Resource-Constrained Devices

MapAnything: Universal Feed-Forward Metric 3D Reconstruction

Improving Anomalous Sound Detection with Attribute-aware Representation from Domain-adaptive Pre-training

Hardness, Structural Knowledge, and Opportunity: An Analytical Framework for Modular Performance Modeling

Benchmark of stylistic variation in LLM-generated texts

SWE-Effi: Re-Evaluating Software AI Agent System Effectiveness Under Resource Constraints

Structure Matters: Brain Graph Augmentation via Learnable Edge Masking for Data-efficient Psychiatric Diagnosis

DischargeSim: A Simulation Benchmark for Educational Doctor-Patient Communication at Discharge

Riemannian Batch Normalization: A Gyro Approach

On the Security of Tool-Invocation Prompts for LLM-Based Agentic Systems: An Empirical Risk Assessment

MIDOG 2025: Mitotic Figure Detection with Attention-Guided False Positive Correction

Do Retrieval Augmented Language Models Know When They Don't Know?

LongCat-Flash Technical Report

MedCOD: Enhancing English-to-Spanish Medical Translation of Large Language Models Using Enriched Chain-of-Dictionary Framework

Middo: Model-Informed Dynamic Data Optimization for Enhanced LLM Fine-Tuning via Closed-Loop Learning

PVPO: Pre-Estimated Value-Based Policy Optimization for Agentic Reasoning

CORE-RAG: Lossless Compression for Retrieval-Augmented LLMs via Reinforcement Learning

OpenWHO: A Document-Level Parallel Corpus for Health Translation in Low-Resource Languages

Subjective Behaviors and Preferences in LLM: Language of Browsing

Using Natural Language for Human-Robot Collaboration in the Real World

RegionMed-CLIP: A Region-Aware Multimodal Contrastive Learning Pre-trained Model for Medical Image Understanding

Causal2Vec: Improving Decoder-only LLMs as Versatile Embedding Models

VLA-Mark: A cross modal watermark for large vision-language alignment model

Deformable Dynamic Convolution for Accurate yet Efficient Spatio-Temporal Traffic Prediction

Deep Reinforcement Learning with Gradient Eligibility Traces

Generating Moving 3D Soundscapes with Latent Diffusion Models

Capturing Polysemanticity with PRISM: A Multi-Concept Feature Description Framework

Discrete Diffusion in Large Language and Multimodal Models: A Survey

DualEdit: Dual Editing for Knowledge Updating in Vision-Language Models

Algorithmic Fairness: Not a Purely Technical but Socio-Technical Property

OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization

Perception-R1: Advancing Multimodal Reasoning Capabilities of MLLMs via Visual Perception Reward

AS-ASR: A Lightweight Framework for Aphasia-Specific Automatic Speech Recognition

LLMs Can Compensate for Deficiencies in Visual Representations

Spatial Understanding from Videos: Structured Prompts Meet Simulation Data

Emergent Abilities of Large Language Models under Continued Pretraining for Language Adaptation

Cross-Attention Speculative Decoding

Beyond Linear Steering: Unified Multi-Attribute Control for Language Models

Noise-Robustness Through Noise: Asymmetric LoRA Adaption with Poisoning Expert

SEMMA: A Semantic Aware Knowledge Graph Foundation Model

AmpleHate: Amplifying the Attention for Versatile Implicit Hate Detection

Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systems

GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chains

A Survey of Large Language Models for Data Challenges in Graphs

CLEAR: A Clinically-Grounded Tabular Framework for Radiology Report Evaluation

Creative Preference Optimization

MUG-Eval: A Proxy Evaluation Framework for Multilingual Generation Capabilities in Any Language

Search and Refine During Think: Facilitating Knowledge Refinement for Improved Retrieval-Augmented Reasoning

Space Group Equivariant Crystal Diffusion

Schreier-Coset Graph Propagation

Examining Deployment and Refinement of the VIOLA-AI Intracranial Hemorrhage Model Using an Interactive NeoMedSys Platform

StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistant

ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning

AttentionDrop: A Novel Regularization Method for Transformer Models

MigGPT: Harnessing Large Language Models for Automated Migration of Out-of-Tree Linux Kernel Patches Across Versions

Hybrid Temporal Differential Consistency Autoencoder for Efficient and Sustainable Anomaly Detection in Cyber-Physical Systems

Who is Responsible When AI Fails? Mapping Causes, Entities, and Consequences of AI Privacy and Ethical Incidents

No Black Box Anymore: Demystifying Clinical Predictive Modeling with Temporal-Feature Cross Attention Mechanism

Negotiative Alignment: Embracing Disagreement to Achieve Fairer Outcomes - Insights from Urban Studies

MT-RewardTree: A Comprehensive Framework for Advancing LLM-Based Machine Translation via Reward Modeling

Pruning the Paradox: How CLIP's Most Informative Heads Enhance Performance While Amplifying Bias

KatFishNet: Detecting LLM-Generated Korean Text through Linguistic Feature Analysis

SuPreME: A Supervised Pre-training Framework for Multimodal ECG Representation Learning

Sparsity May Be All You Need: Sparse Random Parameter Adaptation

Neural Networks for Learnable and Scalable Influence Estimation of Instruction Fine-Tuning Data

"It Felt Like I Was Left in the Dark": Exploring Information Needs and Design Opportunities for Family Caregivers of Older Adult Patients in Critical Care Settings

Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspective

Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models

A Layered Multi-Expert Framework for Long-Context Mental Health Assessments

Efficient Real-time Refinement of Language Model Text Generation

FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portrait

Dynamic Neural Curiosity Enhances Learning Flexibility for Autonomous Goal Discovery

Bayesian Concept Bottleneck Models with LLM Priors

G2D2: Gradient-Guided Discrete Diffusion for Inverse Problem Solving

SeCodePLT: A Unified Platform for Evaluating the Security of Code GenAI

DiRW: Path-Aware Digraph Learning for Heterophily

Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework

DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition

CrackSCF: Lightweight Cascaded Fusion Network for Robust and Efficient Structural Crack Segmentation

ConfReady: A RAG based Assistant and Dataset for Conference Checklist Responses

FOVAL: Calibration-Free and Subject-Invariant Fixation Depth Estimation Across Diverse Eye-Tracking Datasets

Assessing invariance to affine transformations in image quality metrics

The Great AI Witch Hunt: Reviewers Perception and (Mis)Conception of Generative AI in Research Writing

Database-Augmented Query Representation for Information Retrieval

Two Is Better Than One: Aligned Representation Pairs for Anomaly Detection

BBScoreV2: Learning Time-Evolution and Latent Alignment from Stochastic Representation

Beyond Pixels: Enhancing LIME with Hierarchical Features and Segmentation Foundation Models

Spatio-Temporal Anomaly Detection with Graph Networks for Data Quality Monitoring of the Hadron Calorimeter

Understanding AI Evaluation Patterns: How Different GPT Models Assess Vision-Language Descriptions

Online Robust Planning under Model Uncertainty: A Sample-Based Approach

HiPhO: How Far Are (M)LLMs from Humans in the Latest High School Physics Olympiad Benchmark?

Cross-Attention Speculative Decoding

Created by

Haebom

作者

Wei Zhong, Manasa Bharadwaj, Yixiao Wang, Nikhil Verma, Yipeng Ji, Chul Lee

概要

本論文は、大規模言語モデル（LLM）の推論速度を上げるために広く使用されている推測的復号（SD）法の限界を克服するために、クロスアテンションベースの新しい推測的復号モデルであるBudget EAGLE（Beagle）を提案します。 Beagleは、従来の磁気アテンションベースのSDモデルとは異なり、プーリングや補助コンポーネントなしで同等のパフォーマンスを実現し、アーキテクチャを簡素化し、トレーニング効率を向上させ、トレーニング時間中に安定したメモリ使用量を維持します。効果的な訓練のために,論文は新しい二段階ブロック‐アテンショントレーニング法を提示する。さまざまなLLMとデータセットの実験の結果、Beagleは従来のモデルよりも競争力のある推論速度の向上と高いトレーニング効率を達成することを示しています。

Takeaways、Limitations

•

Takeaways：

◦

クロスアテンションベースの推測的復号モデルは,既存の自己アテンションベースモデルの複雑さを低減し,一般化性能を改善できることを示した。

◦

プーリングや補助部品なしで既存の最先端モデルと同等の性能を達成し、アーキテクチャの簡素化とトレーニング効率の向上の可能性を提示

◦

Two-Stage Block-Attention Training法により,ブロックレベルアテンションシナリオにおける訓練安定性と収束効率を改善できることを証明した。

◦

推測的復号アーキテクチャのための強力な代替案を提示します。

•

Limitations：

◦

この論文で提示されているBeagleモデルのパフォーマンスがすべてのLLMとデータセットで一貫して優れているかどうかをさらに検討する必要があります。

◦

Two-Stage Block-Attention Training法の一般化の可能性と他のモデルアーキテクチャへの適用可能性に関するさらなる研究の必要性

◦

実際の導入環境におけるBeagleモデルの性能と効率の評価が必要

Made with Slashpage