Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

SACL: Understanding and Combating Textual Bias in Code Retrieval with Semantic-Augmented Reranking and Localization

Towards Provable (In)Secure Model Weight Release Schemes

Semantic Scene Graph for Ultrasound Image Explanation and Scanning Guidance

IndieFake Dataset: A Benchmark Dataset for Audio Deepfake Detection

These Are Not All the Features You Are Looking For: A Fundamental Bottleneck in Supervised Pretraining

In-Context Learning Strategies Emerge Rationally

Fake it till You Make it: Reward Modeling as Discriminative Prediction

Semantic Preprocessing for LLM-based Malware Analysis

PCDVQ: Enhancing Vector Quantization for Large Language Models via Polar Coordinate Decoupling

TracLLM: A Generic Framework for Attributing Long Context LLMs

TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation

Composite Flow Matching for Reinforcement Learning with Shifted-Dynamics Data

Explainability of Large Language Models using SMILE: Statistical Model-agnostic Interpretability with Local Explanations

Thinkless: LLM Learns When to Think

A3 : an Analytical Low-Rank Approximation Framework for Attention

Search and Refine During Think: Autonomous Retrieval-Augmented Reasoning of LLMs

JointDiT: Enhancing RGB-Depth Joint Modeling with Diffusion Transformers

Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling

AI-Driven Sentiment Analytics: Unlocking Business Value in the E-Commerce Landscape

Towards Adaptive Memory-Based Optimization for Enhanced Retrieval-Augmented Generation

AirCache: Activating Inter-modal Relevancy KV Cache Compression for Efficient Large Vision-Language Model Inference

Will LLMs be Professional at Fund Investment? DeepFund: A Live Arena Perspective

Revealing higher-order neural representations of uncertainty with the Noise Estimation through Reinforcement-based Diffusion (NERD) model

Zero-TIG: Temporal Consistency-Aware Zero-Shot Illumination-Guided Low-light Video Enhancement

PP-DocBee: Improving Multimodal Document Understanding Through a Bag of Tricks

CREStE: Scalable Mapless Navigation with Internet Scale Priors and Counterfactual Guidance

Markets with Heterogeneous Agents: Dynamics and Survival of Bayesian vs. No-Regret Learners

Reward-Guided Speculative Decoding for Efficient LLM Reasoning

UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent

DisCoPatch: Taming Adversarially-driven Batch Statistics for Improved Out-of-Distribution Detection

Materialist: Physically Based Editing Using Single-Image Inverse Rendering

Representation Learning of Lab Values via Masked AutoEncoders

Lagrangian Index Policy for Restless Bandits with Average Reward

SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model

InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Models

Pretrained Reversible Generation as Unsupervised Visual Representation Learning

MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancement

GASP: Efficient Black-Box Generation of Adversarial Suffixes for Jailbreaking LLMs

ToolScan: A Benchmark for Characterizing Errors in Tool-Use LLMs

Recall and Refine: A Simple but Effective Source-free Open-set Domain Adaptation Framework

InterFormer: Effective Heterogeneous Interaction Learning for Click-Through Rate Prediction

Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languages

Advanced computer vision for extracting georeferenced vehicle trajectories from drone imagery

Rapid Gyroscope Calibration: A Deep Learning Approach

HERMES: temporal-coHERent long-forM understanding with Episodes and Semantics

A GREAT Architecture for Edge-Based Graph Problems Like TSP

ClimateIQA: A New Dataset and Benchmark to Advance Vision-Language Models in Meteorology Anomalies Analysis

MockLLM: A Multi-Agent Behavior Collaboration Framework for Online Job Seeking and Recruiting

Is my Data in your AI Model? Membership Inference Test with Application to Face Images

PuriDefense: Randomized Local Implicit Adversarial Purification for Defending Black-box Query-based Attacks

Continual Learning as Computationally Constrained Reinforcement Learning

Efficient Image Generation with Variadic Attention Heads

Smart Ride and Delivery Services with Electric Vehicles: Leveraging Bidirectional Charging for Profit Optimisation

From Memories to Maps: Mechanisms of In-Context Reinforcement Learning in Transformers

Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunities

Taming the Untamed: Graph-Based Knowledge Retrieval and Reasoning for MLLMs to Conquer the Unknown

Exploring Big Five Personality and AI Capability Effects in LLM-Simulated Negotiation Dialogues

Doppelganger Method: Breaking Role Consistency in LLM Agent via Prompt-based Transferable Adversarial Attack

Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning

Fast Monte Carlo Tree Diffusion: 100x Speedup via Parallel Sparse Planning

NFISiS: New Perspectives on Fuzzy Inference Systems for Renewable Energy Forecasting

The State of Large Language Models for African Languages: Progress and Challenges

Structuring the Unstructured: A Multi-Agent System for Extracting and Querying Financial KPIs and Guidance

Super Co-alignment for Sustainable Symbiotic Society

Improving Human-AI Coordination through Online Adversarial Training and Generative Models

WiS Platform: Enhancing Evaluation of LLM-Based Multi-Agent Systems Through Game-Based Analysis

Review learning: Real world validation of privacy preserving continual learning across medical institutions

Whole-Body Conditioned Egocentric Video Prediction

mTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scale

HalluSegBench: Counterfactual Visual Reasoning for Segmentation Hallucination Evaluation

WorldVLA: Towards Autoregressive Action World Model

"What's Up, Doc?": Analyzing How Users Seek Health Information in Large-Scale Conversational AI Datasets

Potemkin Understanding in Large Language Models

skLEP: A Slovak General Language Understanding Benchmark

Process mining-driven modeling and simulation to enhance fault diagnosis in cyber-physical systems

TITAN: Query-Token based Domain Adaptive Adversarial Learning

SmoothSinger: A Conditional Diffusion Model for Singing Voice Synthesis with Multi-Resolution Architecture

Optimising 4th-Order Runge-Kutta Methods: A Dynamic Heuristic Approach for Efficiency and Low Storage

Domain Knowledge-Enhanced LLMs for Fraud and Concept Drift Detection

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference

Leveraging LLM-Assisted Query Understanding for Live Retrieval-Augmented Generation

Temporal-Aware Graph Attention Network for Cryptocurrency Transaction Fraud Detection

Pay Attention to Small Weights

Real-time and personalized product recommendations for large e-commerce platforms

rQdia: Regularizing Q-Value Distributions With Image Augmentation

CA-I2P: Channel-Adaptive Registration Network with Global Optimal Selection

A Systematic Review of Human-AI Co-Creativity

Holistic Surgical Phase Recognition with Hierarchical Input Dependent State Space Models

On Uniform Weighted Deep Polynomial approximation

Exploring Adapter Design Tradeoffs for Low Resource Music Generation

Detecting Referring Expressions in Visually Grounded Dialogue with Autoregressive Language Models

Small Encoders Can Rival Large Decoders in Detecting Groundedness

Hyperspherical Variational Autoencoders Using Efficient Spherical Cauchy Distribution

Integrating Vehicle Acoustic Data for Enhanced Urban Traffic Management: A Study on Speed Classification in Suzhou

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster

Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents

From On-chain to Macro: Assessing the Importance of Data Source Diversity in Cryptocurrency Market Forecasting

$T^3$: Multi-level Tree-based Automatic Program Repair with Large Language Models

BitMark for Infinity: Watermarking Bitwise Autoregressive Image Generative Models

Task-Aware KV Compression For Cost-Effective Long Video Understanding

Doppelganger Method: Breaking Role Consistency in LLM Agent via Prompt-based Transferable Adversarial Attack

Created by

Haebom

저자

Daewon Kang, YeongHwan Shin, Doyeon Kim, Kyu-Hwan Jung, Meong Hi Son

개요

본 논문은 대규모 언어 모델 기반 자율 에이전트의 프롬프트 엔지니어링 편의성과 그로 인한 안전성, 견고성, 행동 일관성 문제를 제기한다. 특히, 프롬프트가 사용자의 악의적인 시도에 노출될 위험성에 초점을 맞춰, 에이전트를 해킹하여 시스템 명령어와 내부 정보를 노출시키는 "Doppelganger method"를 제안한다. 해당 공격에 대한 취약성을 평가하기 위한 "Prompt Alignment Collapse under Adversarial Transfer (PACAT)" 수준을 정의하고, Doppelganger method에 대응하는 "Caution for Adversarial Transfer (CAT)" 프롬프트를 제시한다. 실험 결과, Doppelganger method가 에이전트의 일관성을 저해하고 내부 정보를 노출시킬 수 있음을 보여주며, CAT 프롬프트가 이러한 적대적 공격에 효과적으로 방어할 수 있음을 입증한다.

시사점, 한계점

•

시사점:

◦

대규모 언어 모델 기반 에이전트의 프롬프트 안전성 및 견고성에 대한 심각한 위협을 제시한다.

◦

Doppelganger method를 통해 적대적 공격의 실제 위험성을 보여준다.

◦

CAT 프롬프트와 같은 방어 메커니즘 개발의 중요성을 강조한다.

◦

PACAT 수준을 통해 프롬프트의 취약성을 정량적으로 평가할 수 있는 기준을 제공한다.

•

한계점:

◦

CAT 프롬프트의 효과는 특정 공격 유형 및 에이전트 구현에 따라 달라질 수 있다.

◦

다양한 유형의 적대적 공격에 대한 일반화된 방어 전략이 아직 부족하다.

◦

실험 환경의 제한으로 인해 실제 환경에서의 일반화 가능성에 대한 추가 연구가 필요하다.

Made with Slashpage