Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

OmniEVA: Embodied Versatile Planner via Task-Adaptive 3D-Grounded and Embodiment-aware Reasoning

Open-sci-ref-0.01: open and reproducible reference baselines for language model and dataset comparison

Similarity-based Outlier Detection for Noisy Object Re-Identification Using Beta Mixtures

MachineLearningLM: Scaling Many-shot In-context Learning via Continued Pretraining

Musculoskeletal simulation of limb movement biomechanics in Drosophila melanogaster

Between a Rock and a Hard Place: Exploiting Ethical Reasoning to Jailbreak LLMs

Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees

The Architecture of AI Transformation: Four Strategic Patterns and an Emerging Frontier

IS${}^3$ : Generic Impulsive--Stationary Sound Separation in Acoustic Scenes using Deep Filtering

Beyond Ensembles: Simulating All-Atom Protein Dynamics in a Learned Latent Space

HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detection

Input-Time Scaling

Counterfactual Probabilistic Diffusion with Expert Models

Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments

Bridging the Gap: A Framework for Real-World Video Deepfake Detection via Social Network Compression Emulation

Imposing AI: Deceptive design patterns against sustainability

LMAR: Language Model Augmented Retriever for Domain-specific Knowledge Indexing

Data-Driven Discovery of Mobility Periodicity for Understanding Urban Systems

Privacy Risks of LLM-Empowered Recommender Systems: An Inversion Attack Perspective

Web3 x AI Agents: Landscape, Integrations, and Foundational Challenges

Atherosclerosis through Hierarchical Explainable Neural Network Analysis

Survivability of Backdoor Attacks on Unconstrained Face Recognition Systems

Geological Everything Model 3D: A Promptable Foundation Model for Unified and Zero-Shot Subsurface Understanding

HiLight: A Hierarchical Reinforcement Learning Framework with Global Adversarial Guidance for Large-Scale Traffic Signal Control

AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoning

OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval

The Precautionary Principle and the Innovation Principle: Incompatible Guides for AI Innovation Governance?

A Framework for Testing and Adapting REST APIs as LLM Tools

D\'ej\`a Vu: Multilingual LLM Evaluation through the Lens of Machine Translation Evaluation

JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse

Prompt Programming: A Platform for Dialogue-based Computational Problem Solving with Generative AI Models

Auxiliary Discrminator Sequence Generative Adversarial Networks (ADSeqGAN) for Few Sample Molecule Generation

Neural Force Field: Few-shot Learning of Generalized Physical Reasoning

Towards Developing Socially Compliant Automated Vehicles: Advances, Expert Insights, and A Conceptual Framework

A Novel Approach to Balance Convenience and Nutrition in Meals With Long-Term Group Recommendations and Reasoning on Multimodal Recipes and its Implementation in BEACON

Can LLM Prompting Serve as a Proxy for Static Analysis in Vulnerability Detection

Tokens, the oft-overlooked appetizer: Large language models, the distributional hypothesis, and meaning

Polish-English medical knowledge transfer: A new benchmark and results

InterFormer: Effective Heterogeneous Interaction Learning for Click-Through Rate Prediction

AdvI2I: Adversarial Image Attack on Image-to-Image Diffusion models

A Survey on Group Fairness in Federated Learning: Challenges, Taxonomy of Solutions and Directions for Future Research

A Conflicts-free, Speed-lossless KAN-based Reinforcement Learning Decision System for Interactive Driving in Roundabouts

The Overcooked Generalization Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Design

Modeling the 5G Energy Consumption using Real-world Data: Energy Fingerprint is All You Need

Slaves to the Law of Large Numbers: An Asymptotic Equipartition Property for Perplexity in Generative Language Models

Interpretable Data-driven Anomaly Detection in Industrial Processes with ExIFFI

Analyzing the Impact of Adversarial Examples on Explainable Machine Learning

TSGCNeXt: Dynamic-Static Multi-Graph Convolution for Efficient Skeleton-Based Action Recognition with Long-term Learning Potential

Sufficient Invariant Learning for Distribution Shift

TORSO: Template-Oriented Reasoning Towards General Tasks

ForTIFAI: Fending Off Recursive Training Induced Failure for AI Models

Oyster-I: Beyond Refusal -- Constructive Safety Alignment for Responsible Language Models

Building Self-Evolving Agents via Experience-Driven Lifelong Learning: A Framework and Benchmark

QuantX: A Framework for Hardware-Aware Quantization of Generative AI Workloads

Learning to Plan with Personalized Preferences

Multi-Turn Human-LLM Interaction Through the Lens of a Two-Way Intelligence Protocol

Spatio-Temporal Graphical Counterfactuals: An Overview

Standards in the Preparation of Biomedical Research Metadata: A Bridge2AI Perspective

Is In-Context Learning Learning?

Multimodal SAM-adapter for Semantic Segmentation

Diversified recommendations of cultural activities with personalized determinantal point processes

Improving Audio Event Recognition with Consistency Regularization

Data distribution impacts the performance and generalisability of contrastive learning-based foundation models of electrocardiograms

Towards Understanding Visual Grounding in Visual Language Models

GLAM: Geometry-Guided Local Alignment for Multi-View VLP in Mammography

I-Segmenter: Integer-Only Vision Transformer for Efficient Semantic Segmentation

Generalizing Beyond Suboptimality: Offline Reinforcement Learning Learns Effective Scheduling through Random Data

We Need a New Ethics for a World of AI Agents

SignClip: Leveraging Mouthing Cues for Sign Language Translation by Multimodal Contrastive Fusion

Openness in AI and downstream governance: A global value chain approach

SI-FACT: Mitigating Knowledge Conflict via Self-Improving Faithfulness-Aware Contrastive Tuning

Benchmark of stylistic variation in LLM-generated texts

BenchECG and xECG: a benchmark and baseline for ECG foundation models

Efficient Learning-Based Control of a Legged Robot in Lunar Gravity

Population-Aligned Persona Generation for LLM-based Social Simulation

Realism Control One-step Diffusion for Real-World Image Super-Resolution

Generating Energy-Efficient Code via Large-Language Models -- Where are we now?

Established Psychometric vs. Ecologically Valid Questionnaires: Rethinking Psychological Assessments in Large Language Models

Predictive Spike Timing Enables Distributed Shortest Path Computation in Spiking Neural Networks

TwinTac: A Wide-Range, Highly Sensitive Tactile Sensor with Real-to-Sim Digital Twin Sensor Model

Multimodal Mathematical Reasoning Embedded in Aerial Vehicle Imagery: Benchmarking, Analysis, and Exploration

Reinforcement learning for spin torque oscillator tasks

Exploring Expert Specialization through Unsupervised Training in Sparse Mixture of Experts

Intrinsic Dimension Estimating Autoencoder (IDEA) Using CancelOut Layer and a Projected Loss

Unsupervised Hallucination Detection by Inspecting Reasoning Processes

Drone-Based Multispectral Imaging and Deep Learning for Timely Detection of Branched Broomrape in Tomato Farms

Securing LLM-Generated Embedded Firmware through AI Agent-Driven Validation and Patching

Large Language Models Meet Legal Artificial Intelligence: A Survey

Limited Reference, Reliable Generation: A Two-Component Framework for Tabular Data Generation in Low-Data Regimes

Zero-Shot Referring Expression Comprehension via Visual-Language True/False Verification

Adaptive Token Merging for Efficient Transformer Semantic Communication at the Edge

SmartCoder-R1: Towards Secure and Explainable Smart Contract Generation with Security-Aware Group Relative Policy Optimization

WALL: A Web Application for Automated Quality Assurance using Large Language Models

An Autoencoder and Vision Transformer-based Interpretability Analysis of the Differences in Automated Staging of Second and Third Molars

Tackling One Health Risks: How Large Language Models are leveraged for Risk Negotiation and Consensus-building

Self-Augmented Robot Trajectory: Efficient Imitation Learning via Safe Self-augmentation with Demonstrator-annotated Precision

Automated Tuning for Diffusion Inverse Problem Solvers without Generative Prior Retraining

From Hugging Face to GitHub: Tracing License Drift in the Open-Source AI Ecosystem

Emulating Public Opinion: A Proof-of-Concept of AI-Generated Synthetic Survey Responses for the Chilean Case

Vibe Check: Understanding the Effects of LLM-Based Conversational Agents' Personality and Alignment on User Perceptions in Goal-Oriented Tasks

SignClip: Leveraging Mouthing Cues for Sign Language Translation by Multimodal Contrastive Fusion

Created by

Haebom

Author

Wenfang Wu, Tingting Yuan, Yupeng Li, Daling Wang, Xiaoming Fu

Outline

This paper proposes SignClip, a novel framework for improving the accuracy of sign language translation (SLT). Unlike previous studies that primarily focus on passive cues (hand gestures) in sign language, SignClip leverages both passive and non-passive cues (lip shapes). Specifically, it fuses spatial gesture and lip movement features and introduces a hierarchical contrastive learning framework with a multi-level alignment objective to ensure semantic consistency between sign-to-lip and vision-to-text modes. Experimental results using the PHOENIX14T and How2Sign datasets demonstrate that SignClip outperforms SpaMo, the previous state-of-the-art model. For example, in the PHOENIX14T gloss-free setting, BLEU-4 scores improved from 24.32 to 24.71, and ROUGE scores improved from 46.57 to 48.38.

Takeaways, Limitations

•

Takeaways:

◦

An effective method for integrating passive and non-passive signals (lip shapes) to improve the accuracy of sign language translation is presented.

◦

Improving semantic consistency between sign-to-oral and visual-to-text modes through a hierarchical contrastive learning framework.

◦

Achieve better performance than existing top-performing models

•

Limitations:

◦

Performance improvement is not significant (0.39 improvement based on BLEU-4, 1.81 improvement based on ROUGE)

◦

Generalization performance verification is required using limited datasets (PHOENIX14T, How2Sign).

◦

The need to consider other non-passive signals (such as facial expressions)

Made with Slashpage