Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Maximizing Confidence Alone Improves Reasoning

Pre-training for Recommendation Unlearning

FastTD3: Simple, Fast, and Capable Reinforcement Learning for Humanoid Control

On the performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics models

Agent-UniRAG: A Trainable Open-Source LLM Agent Framework for Unified Retrieval-Augmented Generation Systems

Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systems

Train with Perturbation, Infer after Merging: A Two-Stage Framework for Continual Learning

SplitLoRA: Balancing Stability and Plasticity in Continual Learning Through Gradient Space Splitting

Skywork Open Reasoner 1 Technical Report

Speculative Decoding Meets Quantization: Compatibility Evaluation and Hierarchical Framework Design

DORAEMON: Decentralized Ontology-aware Reliable Agent with Enhanced Memory Oriented Navigation

Cross-modal RAG: Sub-dimensional Retrieval-Augmented Text-to-Image Generation

CAST: Contrastive Adaptation and Distillation for Semi-Supervised Instance Segmentation

Scaling Up Liquid-Resistance Liquid-Capacitance Networks for Efficient Sequence Modeling

Is Attention Required for Transformer Inference? Explore Function-preserving Attention Replacement

VietASR: Achieving Industry-level Vietnamese ASR with 50-hour labeled data and Large-Scale Speech Pretraining

Hume: Introducing System-2 Thinking in Visual-Language-Action Model

DeSocial: Blockchain-based Decentralized Social Networks

Subgroups Matter for Robust Bias Mitigation

Hybrid Disagreement-Diversity Active Learning for Bioacoustic Sound Event Detection

Automatic Transmission for LLM Tiers: Optimizing Cost and Accuracy in Large Language Models

The challenge of hidden gifts in multi-agent reinforcement learning

Retrieval Visual Contrastive Decoding to Mitigate Object Hallucinations in Large Vision-Language Models

Risk-aware Direct Preference Optimization under Nested Risk Measure

Surrogate-Assisted Evolutionary Reinforcement Learning Based on Autoencoder and Hyperbolic Neural Network

A Novel Zero-Trust Identity Framework for Agentic AI: Decentralized Authentication and Fine-Grained Access Control

BroadGen: A Framework for Generating Effective and Efficient Advertiser Broad Match Keyphrase Recommendations

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

How We Won the ISLES'24 Challenge by Preprocessing

SP2RINT: Spatially-Decoupled Physics-Inspired Progressive Inverse Optimization for Scalable, PDE-Constrained Meta-Optical Neural Network Training

Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeek

Rethinking the Sampling Criteria in Reinforcement Learning for LLM Reasoning: A Competence-Difficulty Alignment Perspective

OrionBench: A Benchmark for Chart and Human-Recognizable Object Detection in Infographics

EarthSE: A Benchmark Evaluating Earth Scientific Exploration Capability for Large Language Models

CASS: Nvidia to AMD Transpilation with Data, Models, and Benchmark

Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection

Edge-First Language Model Inference: Models, Metrics, and Tradeoffs

Smaller, Smarter, Closer: The Edge of Collaborative Generative AI

YESciEval: Robust LLM-as-a-Judge for Scientific Question Answering

DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models

Articulatory Feature Prediction from Surface EMG during Speech Production

Exploring Spatiotemporal Emotional Synchrony in Dyadic Interactions: The Role of Speech Conditions in Facial and Vocal Affective Alignment

LEXam: Benchmarking Legal Reasoning on 340 Law Exams

Neural Networks as Universal Finite-State Machines: A Constructive Deterministic Finite Automaton Theory

The Geometry of ReLU Networks through the ReLU Transition Graph

RepCali: High Efficient Fine-tuning Via Representation Calibration in Latent Space for Pre-trained Language Models

Fusing Bidirectional Chains of Thought and Reward Mechanisms A Method for Enhancing Question-Answering Capabilities of Large Language Models for Chinese Intangible Cultural Heritage

Multimodal Survival Modeling in the Age of Foundation Models

Burger: Robust Graph Denoising-augmentation Fusion and Multi-semantic Modeling in Social Recommendation

The Aloe Family Recipe for Open and Specialized Healthcare LLMs

To Judge or not to Judge: Using LLM Judgements for Advertiser Keyphrase Relevance at eBay

LENSLLM: Unveiling Fine-Tuning Dynamics for LLM Selection

CoordField: Coordination Field for Agentic UAV Task Allocation In Low-altitude Urban Scenarios

Learning to Reason under Off-Policy Guidance

A Combinatorial Theory of Dropout: Subnetworks, Graph Geometry, and Generalization

Error Broadcast and Decorrelation as a Potential Artificial and Natural Learning Mechanism

Carbon-Efficient 3D DNN Acceleration: Optimizing Performance and Sustainability

Agentic Knowledgeable Self-awareness

Are Domain Generalization Benchmarks with Accuracy on the Line Misspecified?

MiZero: The Shadowy Defender Against Text Style Infringements

Firm or Fickle? Evaluating Large Language Models Consistency in Sequential Interactions

LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty

Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approach

LEAVS: An LLM-based Labeler for Abdominal CT Supervision

From Head to Tail: Towards Balanced Representation in Large Vision-Language Models through Adaptive Data Calibration

Enhancing Retrieval for ESGLLM via ESG-CID -- A Disclosure Content Index Finetuning Dataset for Mapping GRI and ESRS

DynaCode: A Dynamic Complexity-Aware Code Benchmark for Evaluating Large Language Models in Code Generation

Aligning Text to Image in Diffusion Models is Easier Than You Think

Can LLMs Reason About Program Semantics? A Comprehensive Evaluation of LLMs on Formal Specification Inference

BatteryLife: A Comprehensive Dataset and Benchmark for Battery Life Prediction

Bridging Critical Gaps in Convergent Learning: How Representational Alignment Evolves Across Layers, Training, and Distribution Shifts

ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance

Audio Visual Segmentation Through Text Embeddings

Privacy-Aware Joint DNN Model Deployment and Partitioning Optimization for Collaborative Edge Inference Services

Learning to Reason from Feedback at Test-Time

ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generation

STeCa: Step-level Trajectory Calibration for LLM Agent Learning

GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning

Enhancing Semi-supervised Learning with Zero-shot Pseudolabels

DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing

Multilingual Encoder Knows more than You Realize: Shared Weights Pretraining for Extremely Low-Resource Languages

Jailbreaking to Jailbreak

Behavior-Regularized Diffusion Policy Optimization for Offline Reinforcement Learning

Position: Scaling LLM Agents Requires Asymptotic Analysis with LLM Primitives

CodeSteer: Symbolic-Augmented Language Models via Code/Text Guidance

Toward universal steering and monitoring of AI models

SPRI: Aligning Large Language Models with Context-Situated Principles

MedRAX: Medical Reasoning Agent for Chest X-ray

Adaptive Exploration for Multi-Reward Multi-Policy Evaluation

Wake-Informed 3D Path Planning for Autonomous Underwater Vehicles Using A* and Neural Network Approximations

Fast Large Language Model Collaborative Decoding via Speculation

A Statistical Learning Perspective on Semi-dual Adversarial Neural Optimal Transport Solvers

Joint Localization and Activation Editing for Low-Resource Fine-Tuning

KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search

Towards Unified Attribution in Explainable AI, Data-Centric AI, and Mechanistic Interpretability

Chain of Grounded Objectives: Bridging Process and Goal-oriented Prompting for Code Generation

Re-ranking Using Large Language Models for Mitigating Exposure to Harmful Content on Social Media Platforms

Beyond Reward Hacking: Causal Rewards for Large Language Model Alignment

Tensor Product Attention Is All You Need

VideoRAG: Retrieval-Augmented Generation over Video Corpus

A Combinatorial Theory of Dropout: Subnetworks, Graph Geometry, and Generalization

Created by

Haebom

저자

Sahil Rajesh Dhayalkar

개요

본 논문은 드롭아웃을 고차원 이진 하위 네트워크 그래프 상의 랜덤 워크로 모델링하는 조합론적 및 그래프 이론적 이론을 제시합니다. 각 노드는 네트워크의 마스크된 버전을 나타내며, 드롭아웃은 이 공간을 통한 확률적 탐색을 유도합니다. 일반화를 정량화하는 하위 네트워크 기여 점수를 정의하고, 이 점수가 그래프에서 부드럽게 변화함을 보여줍니다. 스펙트럴 그래프 이론, PAC-Bayes 분석 및 조합론의 도구를 사용하여 일반화하는 하위 네트워크는 크고, 연결되고, 저저항 클러스터를 형성하며, 그 수는 네트워크 너비에 따라 기하급수적으로 증가함을 증명합니다. 이는 드롭아웃을 내장된 중복성을 가진 잘 일반화되는 하위 네트워크의 강력하고 구조화된 앙상블에서 샘플링하는 메커니즘으로 밝힙니다. 광범위한 실험을 통해 다양한 아키텍처에서 모든 이론적 주장을 검증합니다. 결과적으로, 본 연구는 드롭아웃을 이해하기 위한 통합된 기반을 제공하고 마스크 기반 정규화 및 하위 네트워크 최적화에 대한 새로운 방향을 제시합니다.

시사점, 한계점

•

시사점:

◦

드롭아웃의 작동 원리를 그래프 이론적 관점에서 통합적으로 설명하는 새로운 이론 제시.

◦

일반화 성능과 하위 네트워크의 연결성, 저항 간의 관계 규명.

◦

네트워크 너비와 잘 일반화되는 하위 네트워크 수의 기하급수적 관계 증명.

◦

마스크 기반 정규화 및 하위 네트워크 최적화에 대한 새로운 연구 방향 제시.

◦

다양한 아키텍처에서 이론적 주장을 실험적으로 검증.

•

한계점:

◦

이론적 분석의 복잡성으로 인해 실제 응용에 대한 직접적인 가이드라인 제시 부족 가능성.

◦

특정한 종류의 네트워크 구조나 드롭아웃 방식에 대한 제한적인 적용 가능성.

◦

더욱 복잡한 정규화 기법이나 앙상블 학습 방법과의 비교 분석 부족.

Made with Slashpage