Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Maximizing Confidence Alone Improves Reasoning

Pre-training for Recommendation Unlearning

FastTD3: Simple, Fast, and Capable Reinforcement Learning for Humanoid Control

On the performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics models

Agent-UniRAG: A Trainable Open-Source LLM Agent Framework for Unified Retrieval-Augmented Generation Systems

Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systems

Train with Perturbation, Infer after Merging: A Two-Stage Framework for Continual Learning

SplitLoRA: Balancing Stability and Plasticity in Continual Learning Through Gradient Space Splitting

Skywork Open Reasoner 1 Technical Report

Speculative Decoding Meets Quantization: Compatibility Evaluation and Hierarchical Framework Design

DORAEMON: Decentralized Ontology-aware Reliable Agent with Enhanced Memory Oriented Navigation

Cross-modal RAG: Sub-dimensional Retrieval-Augmented Text-to-Image Generation

CAST: Contrastive Adaptation and Distillation for Semi-Supervised Instance Segmentation

Scaling Up Liquid-Resistance Liquid-Capacitance Networks for Efficient Sequence Modeling

Is Attention Required for Transformer Inference? Explore Function-preserving Attention Replacement

VietASR: Achieving Industry-level Vietnamese ASR with 50-hour labeled data and Large-Scale Speech Pretraining

Hume: Introducing System-2 Thinking in Visual-Language-Action Model

DeSocial: Blockchain-based Decentralized Social Networks

Subgroups Matter for Robust Bias Mitigation

Hybrid Disagreement-Diversity Active Learning for Bioacoustic Sound Event Detection

Automatic Transmission for LLM Tiers: Optimizing Cost and Accuracy in Large Language Models

The challenge of hidden gifts in multi-agent reinforcement learning

Retrieval Visual Contrastive Decoding to Mitigate Object Hallucinations in Large Vision-Language Models

Risk-aware Direct Preference Optimization under Nested Risk Measure

Surrogate-Assisted Evolutionary Reinforcement Learning Based on Autoencoder and Hyperbolic Neural Network

A Novel Zero-Trust Identity Framework for Agentic AI: Decentralized Authentication and Fine-Grained Access Control

BroadGen: A Framework for Generating Effective and Efficient Advertiser Broad Match Keyphrase Recommendations

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

How We Won the ISLES'24 Challenge by Preprocessing

SP2RINT: Spatially-Decoupled Physics-Inspired Progressive Inverse Optimization for Scalable, PDE-Constrained Meta-Optical Neural Network Training

Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeek

Rethinking the Sampling Criteria in Reinforcement Learning for LLM Reasoning: A Competence-Difficulty Alignment Perspective

OrionBench: A Benchmark for Chart and Human-Recognizable Object Detection in Infographics

EarthSE: A Benchmark Evaluating Earth Scientific Exploration Capability for Large Language Models

CASS: Nvidia to AMD Transpilation with Data, Models, and Benchmark

Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection

Edge-First Language Model Inference: Models, Metrics, and Tradeoffs

Smaller, Smarter, Closer: The Edge of Collaborative Generative AI

YESciEval: Robust LLM-as-a-Judge for Scientific Question Answering

DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models

Articulatory Feature Prediction from Surface EMG during Speech Production

Exploring Spatiotemporal Emotional Synchrony in Dyadic Interactions: The Role of Speech Conditions in Facial and Vocal Affective Alignment

LEXam: Benchmarking Legal Reasoning on 340 Law Exams

Neural Networks as Universal Finite-State Machines: A Constructive Deterministic Finite Automaton Theory

The Geometry of ReLU Networks through the ReLU Transition Graph

RepCali: High Efficient Fine-tuning Via Representation Calibration in Latent Space for Pre-trained Language Models

Fusing Bidirectional Chains of Thought and Reward Mechanisms A Method for Enhancing Question-Answering Capabilities of Large Language Models for Chinese Intangible Cultural Heritage

Multimodal Survival Modeling in the Age of Foundation Models

Burger: Robust Graph Denoising-augmentation Fusion and Multi-semantic Modeling in Social Recommendation

The Aloe Family Recipe for Open and Specialized Healthcare LLMs

To Judge or not to Judge: Using LLM Judgements for Advertiser Keyphrase Relevance at eBay

LENSLLM: Unveiling Fine-Tuning Dynamics for LLM Selection

CoordField: Coordination Field for Agentic UAV Task Allocation In Low-altitude Urban Scenarios

Learning to Reason under Off-Policy Guidance

A Combinatorial Theory of Dropout: Subnetworks, Graph Geometry, and Generalization

Error Broadcast and Decorrelation as a Potential Artificial and Natural Learning Mechanism

Carbon-Efficient 3D DNN Acceleration: Optimizing Performance and Sustainability

Agentic Knowledgeable Self-awareness

Are Domain Generalization Benchmarks with Accuracy on the Line Misspecified?

MiZero: The Shadowy Defender Against Text Style Infringements

Firm or Fickle? Evaluating Large Language Models Consistency in Sequential Interactions

LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty

Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approach

LEAVS: An LLM-based Labeler for Abdominal CT Supervision

From Head to Tail: Towards Balanced Representation in Large Vision-Language Models through Adaptive Data Calibration

Enhancing Retrieval for ESGLLM via ESG-CID -- A Disclosure Content Index Finetuning Dataset for Mapping GRI and ESRS

DynaCode: A Dynamic Complexity-Aware Code Benchmark for Evaluating Large Language Models in Code Generation

Aligning Text to Image in Diffusion Models is Easier Than You Think

Can LLMs Reason About Program Semantics? A Comprehensive Evaluation of LLMs on Formal Specification Inference

BatteryLife: A Comprehensive Dataset and Benchmark for Battery Life Prediction

Bridging Critical Gaps in Convergent Learning: How Representational Alignment Evolves Across Layers, Training, and Distribution Shifts

ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance

Audio Visual Segmentation Through Text Embeddings

Privacy-Aware Joint DNN Model Deployment and Partitioning Optimization for Collaborative Edge Inference Services

Learning to Reason from Feedback at Test-Time

ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generation

STeCa: Step-level Trajectory Calibration for LLM Agent Learning

GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning

Enhancing Semi-supervised Learning with Zero-shot Pseudolabels

DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing

Multilingual Encoder Knows more than You Realize: Shared Weights Pretraining for Extremely Low-Resource Languages

Jailbreaking to Jailbreak

Behavior-Regularized Diffusion Policy Optimization for Offline Reinforcement Learning

Position: Scaling LLM Agents Requires Asymptotic Analysis with LLM Primitives

CodeSteer: Symbolic-Augmented Language Models via Code/Text Guidance

Toward universal steering and monitoring of AI models

SPRI: Aligning Large Language Models with Context-Situated Principles

MedRAX: Medical Reasoning Agent for Chest X-ray

Adaptive Exploration for Multi-Reward Multi-Policy Evaluation

Wake-Informed 3D Path Planning for Autonomous Underwater Vehicles Using A* and Neural Network Approximations

Fast Large Language Model Collaborative Decoding via Speculation

A Statistical Learning Perspective on Semi-dual Adversarial Neural Optimal Transport Solvers

Joint Localization and Activation Editing for Low-Resource Fine-Tuning

KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search

Towards Unified Attribution in Explainable AI, Data-Centric AI, and Mechanistic Interpretability

Chain of Grounded Objectives: Bridging Process and Goal-oriented Prompting for Code Generation

Re-ranking Using Large Language Models for Mitigating Exposure to Harmful Content on Social Media Platforms

Beyond Reward Hacking: Causal Rewards for Large Language Model Alignment

Tensor Product Attention Is All You Need

VideoRAG: Retrieval-Augmented Generation over Video Corpus

ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance

Created by

Haebom

저자

Sijia Yao, Pengcheng Huang, Zhenghao Liu, Yu Gu, Yukun Yan, Shi Yu, Ge Yu

개요

본 논문은 LLM을 활용한 밀집 검색 개선을 위해, LLM과 검색기를 분리된 모듈로 다루는 기존 방식과 달리, 생성 및 순위 지정 목표를 공동으로 최적화하는 통합 프레임워크인 ExpandR을 제안합니다. ExpandR은 LLM을 사용하여 의미 풍부한 쿼리 확장을 생성하고, 이를 검색기의 학습에 활용합니다. 동시에, 검색 효과와 생성 일관성을 균형 있게 고려한 보상 함수를 사용하여 DPO(Direct Preference Optimization)를 통해 LLM을 학습합니다. 이러한 공동 최적화 패러다임을 통해 LLM과 검색기 간 상호 적응을 가능하게 하여 정보가 풍부하고 검색에 적합한 쿼리 확장을 생성합니다. 다양한 벤치마크에서의 실험 결과, ExpandR은 기존 최고 성능 모델보다 5% 이상의 검색 성능 향상을 달성했습니다. 소스 코드는 https://github.com/NEUIR/ExpandR 에서 확인 가능합니다.

GitHub - NEUIR/ExpandR: Source code for paper "LLM-QE: Improving Query Expansion by Aligning Large Language Models with Ranking Preferences"

Source code for paper "LLM-QE: Improving Query Expansion by Aligning Large Language Models with Ranking Preferences" - NEUIR/ExpandR

시사점, 한계점

•

시사점:

◦

LLM과 검색기를 통합적으로 최적화하여 밀집 검색 성능을 향상시킬 수 있는 새로운 방법 제시

◦

DPO를 활용한 LLM 학습을 통해 검색 효과와 생성 일관성을 동시에 고려

◦

다양한 벤치마크에서 기존 방법 대비 5% 이상의 성능 향상을 입증

◦

공개된 소스 코드를 통해 재현성 및 확장성 확보

•

한계점:

◦

제시된 보상 함수의 설계 및 최적화에 대한 자세한 설명 부족

◦

특정 벤치마크에 국한된 실험 결과, 일반화 가능성에 대한 추가 검증 필요

◦

LLM의 계산 비용 및 학습 시간에 대한 고려 부족

Made with Slashpage