Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

OmniEVA: Embodied Versatile Planner via Task-Adaptive 3D-Grounded and Embodiment-aware Reasoning

Open-sci-ref-0.01: open and reproducible reference baselines for language model and dataset comparison

MachineLearningLM: Scaling Many-shot In-context Learning via Continued Pretraining

Musculoskeletal simulation of limb movement biomechanics in Drosophila melanogaster

Between a Rock and a Hard Place: Exploiting Ethical Reasoning to Jailbreak LLMs

Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees

The Architecture of AI Transformation: Four Strategic Patterns and an Emerging Frontier

IS${}^3$ : Generic Impulsive--Stationary Sound Separation in Acoustic Scenes using Deep Filtering

Beyond Ensembles: Simulating All-Atom Protein Dynamics in a Learned Latent Space

HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detection

Input-Time Scaling

Counterfactual Probabilistic Diffusion with Expert Models

Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments

Bridging the Gap: A Framework for Real-World Video Deepfake Detection via Social Network Compression Emulation

Imposing AI: Deceptive design patterns against sustainability

LMAR: Language Model Augmented Retriever for Domain-specific Knowledge Indexing

Data-Driven Discovery of Mobility Periodicity for Understanding Urban Systems

Privacy Risks of LLM-Empowered Recommender Systems: An Inversion Attack Perspective

Web3 x AI Agents: Landscape, Integrations, and Foundational Challenges

Atherosclerosis through Hierarchical Explainable Neural Network Analysis

Survivability of Backdoor Attacks on Unconstrained Face Recognition Systems

Geological Everything Model 3D: A Promptable Foundation Model for Unified and Zero-Shot Subsurface Understanding

HiLight: A Hierarchical Reinforcement Learning Framework with Global Adversarial Guidance for Large-Scale Traffic Signal Control

AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoning

OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval

The Precautionary Principle and the Innovation Principle: Incompatible Guides for AI Innovation Governance?

A Framework for Testing and Adapting REST APIs as LLM Tools

D\'ej\`a Vu: Multilingual LLM Evaluation through the Lens of Machine Translation Evaluation

JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse

Prompt Programming: A Platform for Dialogue-based Computational Problem Solving with Generative AI Models

Auxiliary Discrminator Sequence Generative Adversarial Networks (ADSeqGAN) for Few Sample Molecule Generation

Neural Force Field: Few-shot Learning of Generalized Physical Reasoning

Towards Developing Socially Compliant Automated Vehicles: Advances, Expert Insights, and A Conceptual Framework

A Novel Approach to Balance Convenience and Nutrition in Meals With Long-Term Group Recommendations and Reasoning on Multimodal Recipes and its Implementation in BEACON

Can LLM Prompting Serve as a Proxy for Static Analysis in Vulnerability Detection

Tokens, the oft-overlooked appetizer: Large language models, the distributional hypothesis, and meaning

Polish-English medical knowledge transfer: A new benchmark and results

InterFormer: Effective Heterogeneous Interaction Learning for Click-Through Rate Prediction

AdvI2I: Adversarial Image Attack on Image-to-Image Diffusion models

A Survey on Group Fairness in Federated Learning: Challenges, Taxonomy of Solutions and Directions for Future Research

A Conflicts-free, Speed-lossless KAN-based Reinforcement Learning Decision System for Interactive Driving in Roundabouts

The Overcooked Generalization Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Design

Modeling the 5G Energy Consumption using Real-world Data: Energy Fingerprint is All You Need

Slaves to the Law of Large Numbers: An Asymptotic Equipartition Property for Perplexity in Generative Language Models

Interpretable Data-driven Anomaly Detection in Industrial Processes with ExIFFI

Analyzing the Impact of Adversarial Examples on Explainable Machine Learning

TSGCNeXt: Dynamic-Static Multi-Graph Convolution for Efficient Skeleton-Based Action Recognition with Long-term Learning Potential

Sufficient Invariant Learning for Distribution Shift

TORSO: Template-Oriented Reasoning Towards General Tasks

ForTIFAI: Fending Off Recursive Training Induced Failure for AI Models

Oyster-I: Beyond Refusal -- Constructive Safety Alignment for Responsible Language Models

Building Self-Evolving Agents via Experience-Driven Lifelong Learning: A Framework and Benchmark

QuantX: A Framework for Hardware-Aware Quantization of Generative AI Workloads

Learning to Plan with Personalized Preferences

Multi-Turn Human-LLM Interaction Through the Lens of a Two-Way Intelligence Protocol

Spatio-Temporal Graphical Counterfactuals: An Overview

Standards in the Preparation of Biomedical Research Metadata: A Bridge2AI Perspective

Is In-Context Learning Learning?

Multimodal SAM-adapter for Semantic Segmentation

Diversified recommendations of cultural activities with personalized determinantal point processes

Improving Audio Event Recognition with Consistency Regularization

Data distribution impacts the performance and generalisability of contrastive learning-based foundation models of electrocardiograms

Towards Understanding Visual Grounding in Visual Language Models

GLAM: Geometry-Guided Local Alignment for Multi-View VLP in Mammography

I-Segmenter: Integer-Only Vision Transformer for Efficient Semantic Segmentation

Generalizing Beyond Suboptimality: Offline Reinforcement Learning Learns Effective Scheduling through Random Data

We Need a New Ethics for a World of AI Agents

SignClip: Leveraging Mouthing Cues for Sign Language Translation by Multimodal Contrastive Fusion

Openness in AI and downstream governance: A global value chain approach

SI-FACT: Mitigating Knowledge Conflict via Self-Improving Faithfulness-Aware Contrastive Tuning

Benchmark of stylistic variation in LLM-generated texts

BenchECG and xECG: a benchmark and baseline for ECG foundation models

Efficient Learning-Based Control of a Legged Robot in Lunar Gravity

Population-Aligned Persona Generation for LLM-based Social Simulation

Realism Control One-step Diffusion for Real-World Image Super-Resolution

Generating Energy-Efficient Code via Large-Language Models -- Where are we now?

Established Psychometric vs. Ecologically Valid Questionnaires: Rethinking Psychological Assessments in Large Language Models

Predictive Spike Timing Enables Distributed Shortest Path Computation in Spiking Neural Networks

TwinTac: A Wide-Range, Highly Sensitive Tactile Sensor with Real-to-Sim Digital Twin Sensor Model

Multimodal Mathematical Reasoning Embedded in Aerial Vehicle Imagery: Benchmarking, Analysis, and Exploration

Reinforcement learning for spin torque oscillator tasks

Exploring Expert Specialization through Unsupervised Training in Sparse Mixture of Experts

Intrinsic Dimension Estimating Autoencoder (IDEA) Using CancelOut Layer and a Projected Loss

Unsupervised Hallucination Detection by Inspecting Reasoning Processes

Drone-Based Multispectral Imaging and Deep Learning for Timely Detection of Branched Broomrape in Tomato Farms

Securing LLM-Generated Embedded Firmware through AI Agent-Driven Validation and Patching

Large Language Models Meet Legal Artificial Intelligence: A Survey

Limited Reference, Reliable Generation: A Two-Component Framework for Tabular Data Generation in Low-Data Regimes

Zero-Shot Referring Expression Comprehension via Visual-Language True/False Verification

Adaptive Token Merging for Efficient Transformer Semantic Communication at the Edge

SmartCoder-R1: Towards Secure and Explainable Smart Contract Generation with Security-Aware Group Relative Policy Optimization

WALL: A Web Application for Automated Quality Assurance using Large Language Models

An Autoencoder and Vision Transformer-based Interpretability Analysis of the Differences in Automated Staging of Second and Third Molars

Tackling One Health Risks: How Large Language Models are leveraged for Risk Negotiation and Consensus-building

Self-Augmented Robot Trajectory: Efficient Imitation Learning via Safe Self-augmentation with Demonstrator-annotated Precision

Automated Tuning for Diffusion Inverse Problem Solvers without Generative Prior Retraining

From Hugging Face to GitHub: Tracing License Drift in the Open-Source AI Ecosystem

Emulating Public Opinion: A Proof-of-Concept of AI-Generated Synthetic Survey Responses for the Chilean Case

Vibe Check: Understanding the Effects of LLM-Based Conversational Agents' Personality and Alignment on User Perceptions in Goal-Oriented Tasks

Established Psychometric vs. Ecologically Valid Questionnaires: Rethinking Psychological Assessments in Large Language Models

Created by

Haebom

Author

Dongmin Choi, Woojung Song, Jongwook Han, Eun-Ju Lee, Yohan Jo

Outline

This paper presents a critical analysis of existing studies that applied existing psychological scales (e.g., the Behavioral Factor Index (BFI) and the Prescriptive Questionnaire (PVQ)) to measure personality traits and values in large-scale language models (LLMs). We address the lack of ecological validity of existing scales and compare and analyze the differences in results between existing and ecologically valid questionnaires. Our analysis reveals that existing scales (1) generate LLM profiles that are inconsistent with the psychological traits expressed in the context of user queries, (2) lack sufficient items for reliable measurement, (3) create the misconception that LLMs are a stable construct, and (4) generate inflated profiles in LLMs using persona prompts. Therefore, we urge caution in applying existing psychological scales to LLMs.

Takeaways, Limitations

•

Takeaways: This paper clearly identifies the limitations of applying existing psychological scales to the LLM exam and emphasizes the need for the development of ecologically valid scales. It also identifies the limitations of existing methodologies for measuring personality traits and values in the LLM exam and suggests directions for developing more appropriate assessment methods.

•

Limitations: The specific details of the ecologically valid questionnaire presented in this study and the validation process are insufficient. Further research is needed to determine its generalizability to various types of LLMs. Furthermore, clear criteria for defining and measuring "ecologically valid questionnaires" are needed.

View PDF

Made with Slashpage