Daily Arxiv

世界中で発行される人工知能関連の論文をまとめるページです。
このページはGoogle Geminiを活用して要約し、非営利で運営しています。
論文の著作権は著者および関連機関にあり、共有する際は出典を明記してください。

Training-Free Text-Guided Color Editing with Multi-Modal Diffusion Transformer

SPARC: Soft Probabilistic Adaptive multi-interest Retrieval Model via Codebooks for recommender system

When Deepfakes Look Real: Detecting AI-Generated Faces with Unlabeled Data due to Annotation Challenges

TempOpt - Unsupervised Alarm Relation Learning for Telecommunication Networks

A Survey on Parallel Text Generation: From Parallel Decoding to Diffusion Language Models

Transferable Model-agnostic Vision-Language Model Adaptation for Efficient Weak-to-Strong Generalization

Yan: Foundational Interactive Video Generation

MLLM-CBench:A Comprehensive Benchmark for Continual Instruction Tuning of Multimodal LLMs with Chain-of-Thought Reasoning Analysis

VGGSounder: Audio-Visual Evaluations for Foundation Models

Capabilities of GPT-5 on Multimodal Medical Reasoning

C-MAG: Cascade Multimodal Attributed Graphs for Supply Chain Link Prediction

Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RL

MIND: A Noise-Adaptive Denoising Framework for Medical Images Integrating Multi-Scale Transformer

FlexCTC: GPU-powered CTC Beam Decoding With Advanced Contextual Abilities

Fairness of Automatic Speech Recognition: Looking Through a Philosophical Lens

Generalizing Scaling Laws for Dense and Sparse Large Language Models

Memp: Exploring Agent Procedural Memory

InfoCausalQA:Can Models Perform Non-explicit Causal Reasoning Based on Infographic?

Benchmarking Pretrained Molecular Embedding Models For Molecular Representation Learning

Request-Only Optimization for Recommendation Systems

Chemist Eye: A Visual Language Model-Powered System for Safety Monitoring and Robot Decision-Making in Self-Driving Laboratories

GTPO and GRPO-S: Token and Sequence-Level Reward Shaping with Policy Entropy

FairPOT: Balancing AUC Performance and Fairness with Proportional Optimal Transport

GTPO: Trajectory-Based Policy Optimization in Large Language Models

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

Estimating Worst-Case Frontier Risks of Open-Weight LLMs

LiteFat: Lightweight Spatio-Temporal Graph Learning for Real-Time Driver Fatigue Detection

DRWKV: Focusing on Object Edges for Low-Light Image Enhancement

A multi-strategy improved snake optimizer for 3-dimensional UAV path planning and engineering problems

Fragment size density estimator for shrinkage-induced fracture based on a physics-informed neural network

GLM-4.1V-Thinking and GLM-4.5V: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning

WebArXiv: Evaluating Multimodal Agents on Time-Invariant arXiv Tasks

Audio-3DVG：Unified Audio - Point Cloud Fusion for 3D Visual Grounding

Beyond Autocomplete: Designing CopilotLens Towards Transparent and Explainable AI Coding Agents

OC-SOP: Enhancing Vision-Based 3D Semantic Occupancy Prediction by Object-Centric Awareness

SWA-SOP: Spatially-aware Window Attention for Semantic Occupancy Prediction in Autonomous Driving

The Importance of Being Lazy: Scaling Limits of Continual Learning

Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models

HVL: Semi-Supervised Segmentation leveraging Hierarchical Vision-Language Synergy with Dynamic Text-Spatial Query Alignment

Open-Set LiDAR Panoptic Segmentation Guided by Uncertainty-Aware Learning

Poison Once, Control Anywhere: Clean-Text Visual Backdoors in VLM-based Mobile Agents

MGDFIS: Multi-scale Global-detail Feature Integration Strategy for Small Object Detection

Deep Learning Model Acceleration and Optimization Strategies for Real-Time Recommendation Systems

ChineseHarm-Bench: A Chinese Harmful Content Detection Benchmark

Gradual Transition from Bellman Optimality Operator to Bellman Operator in Online Reinforcement Learning

Sarc7: Evaluating Sarcasm Detection and Generation with Seven Types and Emotion-Informed Techniques

Exploring Scaling Laws for EHR Foundation Models

MapStory: Prototyping Editable Map Animations with LLM Agents

Teaching Large Language Models to Maintain Contextual Faithfulness via Synthetic Tasks and Reinforcement Learning

Can Large Multimodal Models Understand Agricultural Scenes? Benchmarking with AgroMind

Halting Recurrent GNNs and the Graded $\mu$-Calculus

Deep Learning Warm Starts for Trajectory Optimization on the International Space Station

EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting

FedRecon: Missing Modality Reconstruction in Heterogeneous Distributed Environments

AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computation

GraspClutter6D: A Large-scale Real-world Dataset for Robust Perception and Grasping in Cluttered Scenes

Mosaic: Composite Projection Pruning for Resource-efficient LLMs

CO-Bench: Benchmarking Language Model Agents in Algorithm Search for Combinatorial Optimization

FT-Transformer: Resilient and Reliable Transformer with End-to-End Fault Tolerant Attention

The Illusory Normativity of Rights-Based AI Regulation

Shifting Perspectives: Steering Vectors for Robust Bias Mitigation in LLMs

Simulating the Real World: A Unified Survey of Multimodal Generative Models

RIZE: Regularized Imitation Learning via Distributional Reinforcement Learning

One-shot Optimized Steering Vectors Mediate Safety-relevant Behaviors in LLMs

EvoP: Robust LLM Inference via Evolutionary Pruning

Conformal Prediction of Classifiers with Many Classes based on Noisy Labels

Benchmarking LLMs' Mathematical Reasoning with Unseen Random Variables Questions

GenAI Confessions: Black-box Membership Inference for Generative Image Models

Beyond Memorization: Assessing Semantic Generalization in Large Language Models Using Phrasal Constructions

Evaluation of Bio-Inspired Models under Different Learning Settings For Energy Efficiency in Network Traffic Prediction

SLTNet: Efficient Event-based Semantic Segmentation with Spike-driven Lightweight Transformer-based Networks

Leveraging Audio and Text Modalities in Mental Health: A Study of LLMs Performance

Learning Characteristics of Reverse Quaternion Neural Network

Depth-Guided Self-Supervised Human Keypoint Detection via Cross-Modal Distillation

Retrieval-Augmented Decision Transformer: External Memory for In-context RL

Downscaling Extreme Precipitation with Wasserstein Regularized Diffusion

Episodic Memory Verbalization using Hierarchical Representations of Life-Long Robot Experience

Return Prediction for Mean-Variance Portfolio Selection: How Decision-Focused Learning Shapes Forecasting Models

Pediatric brain tumor classification using digital histopathology and deep learning: evaluation of SOTA methods on a multi-center Swedish cohort

CTRQNets & LQNets: Continuous Time Recurrent and Liquid Quantum Neural Networks

Explaining Caption-Image Interactions in CLIP Models with Second-Order Attributions

SpectralEarth: Training Hyperspectral Foundation Models at Scale

Towards flexible perception with visual memory

Integrating Clinical Knowledge Graphs and Gradient-Based Neural Systems for Enhanced Melanoma Diagnosis via the 7-Point Checklist

LUMA: A Benchmark Dataset for Learning from Uncertain and Multimodal Data

Towards Black-Box Membership Inference Attack for Diffusion Models

Robo-Instruct: Simulator-Augmented Instruction Alignment For Finetuning Code LLMs

From Model Performance to Claim: How a Change of Focus in Machine Learning Replicability Can Help Bridge the Responsibility Gap

Learning to Defer in Congested Systems: The AI-Human Interplay

LEAVES: Learning Views for Time-Series Biobehavioral Data in Contrastive Learning

Game-Theoretic Multiagent Reinforcement Learning

SMA：Who Said That？ Auditing Membership Leakage in Semi-Black-box RAG Controlling

Aryabhata: An exam-focused language model for JEE Math

Rethinking Domain-Specific LLM Benchmark Construction: A Comprehensiveness-Compactness Approach

Large Language Models Do Not Simulate Human Psychology

LLM Robustness Leaderboard v1 --Technical report

One Subgoal at a Time: Zero-Shot Generalization to Arbitrary Linear Temporal Logic Requirements in Multi-Task Reinforcement Learning

Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens

StepFun-Prover Preview: Let's Think and Verify Step by Step

MoSE: Skill-by-Skill Mixture-of-Experts Learning for Embodied Autonomous Machines

Mosaic: Composite Projection Pruning for Resource-efficient LLMs

Created by

Haebom

作者

Bailey J. Eccles, Leon Wong, Blesson Varghese

概要

この論文では、大規模言語モデル（LLM）の配布を制限する高い演算およびメモリ要件を解決するための新しい微調整剪定方法であるプロジェクションプルーニングを紹介します。従来の粗雑な剪定方法の限界を克服するために、精度を維持する非定型剪定とモデルサイズを減らす整形剪定を組み合わせたコンポジットプロジェクションプルーニングを提案します。これに基づいて、剪定されたLLMを作成および展開する新しいシステムであるMosaicを開発し、さまざまなハードウェアプラットフォーム、LLM、データセットのパフォーマンスと品質指標を評価しました。 Mosaicは従来の方法よりも最大7.19倍速いモデルを生成し、最大84.2％低いパープレクティブと31.4％高い精度を達成します。さらに、Mosaicモデルは最大67％の高速推論速度と68％の低いGPUメモリ使用量を示しました。 Mosaicはhttps://github.com/blessonvar/Mosaicで公に利用可能です。

GitHub - blessonvar/Mosaic: Source code for composite projection pruning for resource efficient LLMs

Source code for composite projection pruning for resource efficient LLMs - blessonvar/Mosaic

Takeaways、Limitations

•

Takeaways：

◦

従来の粗雑な剪定方法よりもはるかに高速で効率的なLLM剪定方法を提案する。

◦

生成されたモデルの精度とパフォーマンスの向上（Perplexityの低減、精度の向上、推論速度の向上、メモリ使用量の削減）。

◦

開発されたシステムMosaicによるLLMの実際の展開可能性の向上

◦

開発されたシステムをオープンソースで公開し、アクセシビリティ向上。

•

Limitations：

◦

本論文で提示された結果は、特定のハードウェアプラットフォーム、LLM、データセットの評価結果であり、他の環境での一般化の可能性に関するさらなる研究が必要です。

◦

プロジェクションプルーニングとコンポジットプロジェクションプルーニングの最適パラメータ設定に関するさらなる研究が必要

◦

さまざまな種類のLLMの適用性と性能比較分析がさらに必要です。

Made with Slashpage