Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

DNN-Based Precoding in RIS-Aided mmWave MIMO Systems With Practical Phase Shift

Holistic Tokenizer for Autoregressive Image Generation

MAGIC: Mask-Guided Diffusion Inpainting with Multi-Level Perturbations and Context-Aware Alignment for Few-Shot Anomaly Generation

Order Acquisition Under Competitive Pressure: A Rapidly Adaptive Reinforcement Learning Approach for Ride-Hailing Subsidy Strategies

Towards a Playground to Democratize Experimentation and Benchmarking of AI Agents for Network Troubleshooting

AC-DiT: Adaptive Coordination Diffusion Transformer for Mobile Manipulation

GPU-based complete search for nonlinear minimization subject to bounds

Text Detoxification: Data Efficiency, Semantic Preservation and Model Generalization

On-Policy Optimization of ANFIS Policies Using Proximal Policy Optimization

Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrations

LD-RPS: Zero-Shot Unified Image Restoration via Latent Diffusion Recurrent Posterior Sampling

Horus: A Protocol for Trustless Delegation Under Uncertainty

Visual Anagrams Reveal Hidden Differences in Holistic Shape Processing Across Vision Models

Diversity Conscious Refined Random Forest

GLU Attention Improve Transformer

Implicit Reward as the Bridge: A Unified View of SFT and DPO Connections

CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentation

Treatment, evidence, imitation, and chat

EFRame: Deeper Reasoning via Exploration-Filter-Replay Reinforcement Learning Framework

Towards Understanding the Cognitive Habits of Large Reasoning Models

SEAL: Vision-Language Model-Based Safe End-to-End Cooperative Autonomous Driving with Adaptive Long-Tail Modeling

Inside you are many wolves: Using cognitive models to interpret value trade-offs in LLMs

AI and Agile Software Development: From Frustration to Success -- XP2025 Workshop Summary

Position: Machine Learning Conferences Should Establish a “Refutations and Critiques” Track

Why Do Open-Source LLMs Struggle with Data Analysis? A Systematic Empirical Study

NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments

Comparative Evaluation of ChatGPT and DeepSeek Across Key NLP Tasks: Strengths, Weaknesses, and Domain-Specific Performance

RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Models

Human2LocoMan: Learning Versatile Quadrupedal Manipulation with Human Pretraining

Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models

Discrete Diffusion in Large Language and Multimodal Models: A Survey

Robust Molecular Property Prediction via Densifying Scarce Labeled Data

LearnAlign: Reasoning Data Selection for Reinforcement Learning in Large Language Models Based on Improved Gradient Alignment

AutoMind: Adaptive Knowledgeable Agent for Automated Data Science

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

Towards Practical Alzheimer's Disease Diagnosis: A Lightweight and Interpretable Spiking Neural Model

The Geometries of Truth Are Orthogonal Across Tasks

TrajFlow: Multi-modal Motion Prediction via Flow Matching

Graph-Assisted Stitching for Offline Hierarchical Reinforcement Learning

Making a Pipeline Production-Ready: Challenges and Lessons Learned in the Healthcare Domain

FinBERT2: A Specialized Bidirectional Encoder for Bridging the Gap in Finance-Specific Deployment of Large Language Models

Recommender systems, stigmergy, and the tyranny of popularity

HAVIR: Hierarchical Vision to Image Reconstruction using CLIP-Guided Versatile Diffusion

SLAC: Simulation-Pretrained Latent Action Space for Whole-Body Real-World RL

RewardAnything: Generalizable Principle-Following Reward Models

BiMa: Towards Biases Mitigation for Text-Video Retrieval via Scene Element Guidance

A Quantum Information Theoretic Approach to Tractable Probabilistic Models

Playing with Transformer at 30+ FPS via Next-Frame Diffusion

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA

Deep Retrieval at CheckThat! 2025: Identifying Scientific Papers from Implicit Social Media Mentions via Hybrid Retrieval and Re-Ranking

Extended Inductive Reasoning for Personalized Preference Inference from Behavioral Signals

Better Safe Than Sorry? Overreaction Problem of Vision Language Models in Visual Emergency Recognition

Adaptive Inference-Time Scaling via Cyclic Diffusion Search

Domain Adaptation of VLM for Soccer Video Understanding

Towards Universal Semantics With Large Language Models

ReviewInstruct: A Review-Driven Multi-Turn Conversations Generation Method for Large Language Models

An Exploration of Default Images in Text-to-Image Generation

Aggregating Concepts of Fairness and Accuracy in Prediction Algorithms

PRUNE: A Patching Based Repair Framework for Certifiable Unlearning of Neural Networks

Enhancing Satellite Object Localization with Dilated Convolutions and Attention-aided Spatial Pooling

Explainable Coarse-to-Fine Ancient Manuscript Duplicates Discovery

Rewriting Pre-Training Data Boosts LLM Performance in Math and Code

The Role of Open-Source LLMs in Shaping the Future of GeoAI

EasyEdit2: An Easy-to-use Steering Framework for Editing Large Language Models

AI for the Open-World: the Learning Principles

Towards Explainable Fusion and Balanced Learning in Multimodal Sentiment Analysis

TerraMind: Large-Scale Generative Multimodality for Earth Observation

NativQA Framework: Enabling LLMs with Native, Local, and Everyday Knowledge

Breach in the Shield: Unveiling the Vulnerabilities of Large Language Models

Quantifying Robustness: A Benchmarking Framework for Deep Learning Forecasting in Cyber-Physical Systems

Enhancing Personalized Multi-Turn Dialogue with Curiosity Reward

EAP4EMSIG -- Enhancing Event-Driven Microscopy for Microfluidic Single-Cell Analysis

UNITYAI-GUARD: Pioneering Toxicity Detection Across Low-Resource Indian Languages

CMD-HAR: Cross-Modal Disentanglement for Wearable Human Activity Recognition

Construction Identification and Disambiguation Using BERT: A Case Study of NPN

PVChat: Personalized Video Chat with One-Shot Learning

Neural Discrete Token Representation Learning for Extreme Token Reduction in Video Large Language Models

MASS: Mathematical Data Selection via Skill Graphs for Pretraining Large Language Models

Long Context Modeling with Ranked Memory-Augmented Retrieval

Probing Latent Subspaces in LLM for AI Security: Identifying and Manipulating Adversarial States

Language Models can Self-Improve at State-Value Estimation for Better Search

Offline RLAIF: Piloting VLM Feedback for RL via SFO

Integrating Biological and Machine Intelligence: Attention Mechanisms in Brain-Computer Interfaces

Graded Neural Networks

Do LLMs Understand the Safety of Their Inputs? Training-Free Moderation via Latent Prototypes

FairFare: A Tool for Crowdsourcing Rideshare Data to Empower Labor Organizers

Federated Continual Learning: Concepts, Challenges, and Solutions

UniForm: A Unified Multi-Task Diffusion Transformer for Audio-Video Generation

Code Simulation as a Proxy for High-order Tasks in Large Language Models

An Efficient Local Search Approach for Polarized Community Discovery in Signed Networks

Learning Traffic Anomalies from Generative Models on Real-Time Observations

Explainable AI for Mental Health Emergency Returns: Integrating LLMs with Predictive Modeling

In-Context Meta LoRA Generation

Rethinking Table Instruction Tuning

Autonomous Microscopy Experiments through Large Language Model Agents

Static Segmentation by Tracking: A Label-Efficient Approach for Fine-Grained Specimen Image Segmentation

Random weights of DNNs and emergence of fixed points

On the Expressiveness and Length Generalization of Selective State-Space Models on Regular Languages

Mask Approximation Net: A Novel Diffusion Model Approach for Remote Sensing Change Captioning

Enhancing Long Video Generation Consistency without Tuning

Enhancing Personalized Multi-Turn Dialogue with Curiosity Reward

Created by

Haebom

Author

Yanming Wan, Jiaxing Wu, Marwa Abdulhai, Lior Shani, Natasha Jaques

Outline

In this paper, we present a novel method for improving personalized interactions of conversational agents based on large-scale language models (LLMs). Existing reinforcement learning-based methods (RLHFs) focus on usability and safety, but they fall short in generating empathic, adaptive, and personalized conversations. In this paper, we propose a method that integrates curiosity-based intrinsic rewards into multi-round RLHF based on user models. This allows the LLM agent to actively infer user characteristics and optimize conversations to improve the accuracy of the user model, thereby providing more personalized interactions. Through experiments in conversational recommendation and training environments, we demonstrate improved personalization and generalization performance compared to existing RLHFs while maintaining conversation quality.

Takeaways, Limitations

•

Takeaways:

◦

We present a novel method to improve the level of personalization of LLM-based conversational agents by leveraging user models and curiosity-based rewards.

◦

Overcoming the limitations of existing RLHF and achieving effective personalization even with limited user information.

◦

Experimentally verifying improved personalization and generalization performance in conversational recommendation and training.

◦

Suggests the potential for developing more empathetic, adaptive, and immersive conversational agents.

•

Limitations:

◦

The effectiveness of the proposed method has been verified only in specific domains (conversational recommendation, education), and further research is needed on its generalizability to other domains.

◦

Because of the high dependence on the accuracy of the user model, errors in the user model can affect the agent's performance.

◦

Further research may be needed on the design and tuning of curiosity-based rewards.

◦

Extensive experimentation and evaluation across a variety of user types and characteristics is required.

View PDF

Made with Slashpage