Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

HoPE: Hyperbolic Rotary Positional Encoding for Stable Long-Range Dependency Modeling in Large Language Models

Comparative Analysis of Transformer Models in Disaster Tweet Classification for Public Safety

Emergent Social Dynamics of LLM Agents in the El Farol Bar Problem

The Good, the Bad and the Constructive: Automatically Measuring Peer Review's Utility for Authors

Energy Landscapes Enable Reliable Abstention in Retrieval-Augmented Large Language Models for Healthcare

DEXOP: A Device for Robotic Transfer of Dexterous Human Manipulation

Reinforcement Learning for Robust Ageing-Aware Control of Li-ion Battery Systems with Data-Driven Formal Verification

RepoDebug: Repository-Level Multi-Task and Multi-Language Debugging Evaluation of Large Language Models

Gravity Well Echo Chamber Modeling With An LLM-Based Confirmation Bias Model

Insights from Gradient Dynamics: Gradient Autoscaled Normalization

Efficient Virtuoso: A Latent Diffusion Transformer Model for Goal-Conditioned Trajectory Planning

MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholds

DCPO: Dynamic Clipping Policy Optimization

DSDE: Dynamic Speculative Decoding with KLD Stability for Real-World Serving

Can AI be Auditable?

Robotic Fire Risk Detection based on Dynamic Knowledge Graph Reasoning: An LLM-Driven Approach with Graph Chain-of-Thought

Navigating the EU AI Act: Foreseeable Challenges in Qualifying Deep Learning-Based Automated Inspections of Class III Medical Devices

Complementary Learning System Empowers Online Continual Learning of Vehicle Motion Forecasting in Smart Cities

MultiPL-MoE: Multi-Programming-Lingual Extension of Large Language Models through Hybrid Mixture-of-Experts

QuadKAN: KAN-Enhanced Quadruped Motion Control via End-to-End Reinforcement Learning

MovieCORE: COgnitive REasoning in Movies

Automatic Prompt Optimization with Prompt Distillation

Membership Inference Attacks on LLM-based Recommender Systems

Leveraging Large Language Models for Accurate Sign Language Translation in Low-Resource Scenarios

Group Expectation Policy Optimization for Heterogeneous Reinforcement Learning

Convergence and Generalization of Anti-Regularization for Parametric Models

Jet-Nemotron: Efficient Language Model with Post Neural Architecture Search

CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuning

Bridging Generalization and Personalization in Human Activity Recognition via On-Device Few-Shot Learning

FinAgentBench: A Benchmark Dataset for Agentic Retrieval in Financial Question Answering

Using Artificial Intuition in Distinct, Minimalist Classification of Scientific Abstracts for Management of Technology Portfolios

Semantic Discrepancy-aware Detector for Image Forgery Identification

Quantum-Efficient Reinforcement Learning Solutions for Last-Mile On-Demand Delivery

BadPromptFL: A Novel Backdoor Threat to Prompt-based Federated Learning in Multimodal Models

Uncertainty-Driven Reliability: Selective Prediction and Trustworthy Deployment in Modern Machine Learning

Real-Time Analysis of Unstructured Data with Machine Learning on Heterogeneous Architectures

VSI: Visual Subtitle Integration for Keyframe Selection to enhance Long Video Understanding

SGDFuse: SAM-Guided Diffusion for High-Fidelity Infrared and Visible Image Fusion

An Efficient Continuous-Time MILP for Integrated Aircraft Hangar Scheduling and Layout

DIRF: A Framework for Digital Identity Protection and Clone Governance in Agentic AI Systems

COLLAGE: Adaptive Fusion-based Retrieval for Augmented Policy Learning

Dynamically Adaptive Reasoning via LLM-Guided MCTS for Efficient and Context-Aware KGQA

Nested Graph Pseudo-Label Refinement for Noisy Label Domain Adaptation Learning

LanternNet: A Hub-and-Spoke System to Seek and Suppress Spotted Lanternfly Populations

RecPS: Privacy Risk Scoring for Recommender Systems

Supervised Fine Tuning on Curated Data is Reinforcement Learning (and can be improved)

Role-Playing LLM-Based Multi-Agent Support Framework for Detecting and Addressing Family Communication Bias

PLAME: Lightweight MSA Design Advances Protein Folding From Evolutionary Embeddings

Driver-Net: Multi-Camera Fusion for Assessing Driver Take-Over Readiness in Automated Vehicles

Leveraging Out-of-Distribution Unlabeled Images: Semi-Supervised Semantic Segmentation with an Open-Vocabulary Model

Visual Structures Helps Visual Reasoning: Addressing the Binding Problem in VLMs

Precise Bayesian Neural Networks

Transit for All: Mapping Equitable Bike2Subway Connection using Region Representation Learning

Scaling Intelligence: Designing Data Centers for Next-Gen Language Models

Image Segmentation with Large Language Models: A Survey with Perspectives for Intelligent Transportation Systems

SAIL: Faster-than-Demonstration Execution of Imitation Learning Policies

Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models

Bipedal Balance Control with Whole-body Musculoskeletal Standing and Falling Simulations

Scaling Laws of Motion Forecasting and Planning - Technical Report

Efficient $Q$-Learning and Actor-Critic Methods for Robust Average Reward Reinforcement Learning

Who Gets Credit or Blame? Attributing Accountability in Modern AI Systems

Unsupervised Evolutionary Cell Type Matching via Entropy-Minimized Optimal Transport

Multi-output Classification using a Cross-talk Architecture for Compound Fault Diagnosis of Motors in Partially Labeled Condition

SoloSpeech: Enhancing Intelligibility and Quality in Target Speech Extraction through a Cascaded Generative Pipeline

Steering LLM Reasoning Through Bias-Only Adaptation

MetaSTH-Sleep: Towards Effective Few-Shot Sleep Stage Classification for Health Management with Spatial-Temporal Hypergraph Enhanced Meta-Learning

InterFeat: A Pipeline for Finding Interesting Scientific Features

HumaniBench: A Human-Centric Framework for Large Multimodal Models Evaluation

Advancing Scientific Text Classification: Fine-Tuned Models with Dataset Expansion and Hard-Voting

Test It Before You Trust It: Applying Software Testing for Trustworthy In-context Learning

Action Flow Matching for Continual Robot Learning

Addressing Concept Mislabeling in Concept Bottleneck Models Through Preference Optimization

Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models

Byzantine-Robust Federated Learning Using Generative Adversarial Networks

Beyond SHAP and Anchors: A large-scale experiment on how developers struggle to design meaningful end-user explanations

VIPER: Visual Perception and Explainable Reasoning for Sequential Decision-Making

DistJoin: A Decoupled Join Cardinality Estimator based on Adaptive Neural Predicate Modulation

Low-Confidence Gold: Refining Low-Confidence Samples for Efficient Instruction Tuning

Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Support

Soft Token Attacks Cannot Reliably Audit Unlearning in Large Language Models

CHIRLA: Comprehensive High-resolution Identification and Re-identification for Large-scale Analysis

Kolmogorov-Arnold Fourier Networks

Position: LLMs Can be Good Tutors in English Education

Predicting Steady-State Behavior in Complex Networks with Graph Neural Networks

Separate Motion from Appearance: Customizing Motion via Customizing Text-to-Video Diffusion Models

Motion-enhanced Cardiac Anatomy Segmentation via an Insertable Temporal Attention Module

Bias in Decision-Making for AI's Ethical Dilemmas: A Comparative Study of ChatGPT and Claude

OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking

DispFormer: A Pretrained Transformer Incorporating Physical Constraints for Dispersion Curve Inversion

Integrating Evidence into the Design of XAI and AI-based Decision Support Systems: A Means-End Framework for End-users in Construction

Revealing the impact of synthetic native samples and multi-tasking strategies in Hindi-English code-mixed humour and sarcasm detection

Neural Port-Hamiltonian Differential Algebraic Equations for Compositional Learning of Electrical Networks

Sequential Controlled Langevin Diffusions

Privacy-Preserving Federated Learning via Homomorphic Adversarial Networks

CAREL: Instruction-guided reinforcement learning with cross-modal auxiliary objectives

Lessons from Studying Two-Hop Latent Reasoning

HierTOD: A Task-Oriented Dialogue System Driven by Hierarchical Goals

Flexible Coded Distributed Convolution Computing for Enhanced Straggler Resilience and Numerical Stability in Distributed CNNs

FACEGroup: Feasible and Actionable Counterfactual Explanations for Group Fairness

ETF: An Entity Tracing Framework for Hallucination Detection in Code Summaries

Unveiling the Response of Large Vision-Language Models to Visually Absent Tokens

Created by

Haebom

저자

Sohee Kim, Soohyun Ryu, Joonhyung Park, Eunho Yang

개요

본 논문은 대규모 비전-언어 모델(LVLMs)이 시각적 증거가 없는 텍스트 입력을 이미지의 일부로 잘못 인식하여 오류를 발생시키는 현상을 밝힙니다. 연구진은 LVLMs 내부에서 텍스트 개념이 이미지에 근거하는지 판단하는 능력을 조사하여, 시각적 부재를 독특한 활성 패턴으로 신호하는 피드포워드 네트워크(FFN) 뉴런의 특정 하위 집합인 시각적 부재 인식(VA) 뉴런을 발견했습니다. 이 패턴을 활용하여 입력 토큰이 시각적으로 근거하는지 분류하는 탐지 모듈을 개발하고, 이 예측에 따라 질문 프롬프트를 재해석하거나 생성 중에 감지된 부재 토큰을 대체하여 출력을 개선하는 방법을 제안합니다. 광범위한 실험을 통해 제안된 방법이 모델의 시각적 존재에 대한 잘못된 가정 경향을 효과적으로 완화하고 다양한 LVLMs에서 일반성을 갖는다는 것을 보여줍니다.

시사점, 한계점

•

시사점:

◦

LVLMs의 시각적 정보 처리 과정에 대한 새로운 이해를 제공합니다.

◦

시각적 근거가 없는 텍스트 입력을 감지하고 출력을 개선하는 새로운 방법을 제시합니다.

◦

다양한 LVLMs에 적용 가능한 일반적인 방법론을 제시합니다.

•

한계점:

◦

VA 뉴런의 활성 패턴이 모든 LVLMs에서 동일하게 나타나는지에 대한 추가 연구가 필요합니다.

◦

제안된 방법의 성능이 다양한 유형의 이미지와 텍스트 입력에 대해 얼마나 일반화되는지에 대한 추가 검증이 필요합니다.

◦

복잡한 시각적 추론이 필요한 경우의 성능에 대한 추가 연구가 필요합니다.

Made with Slashpage