Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Principles

Saturation Self-Organizing Map

PiPViT: Patch-based Visual Interpretable Prototypes for Retinal Image Analysis

Specification and Evaluation of Multi-Agent LLM Systems -- Prototype and Cybersecurity Applications

Intra-Trajectory Consistency for Reward Modeling

Foundation Models in Medical Imaging -- A Review and Outlook

Merging Smarter, Generalizing Better: Enhancing Model Merging on OOD Data

Diffuse Everything: Multimodal Diffusion Models on Arbitrary State Spaces

Improving Large Language Models with Concept-Aware Fine-Tuning

Consistent Video Editing as Flow-Driven Image-to-Video Generation

Evidential Spectrum-Aware Contrastive Learning for OOD Detection in Dynamic Graphs

Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning

DURA-CPS: A Multi-Role Orchestrator for Dependability Assurance in LLM-Enabled Cyber-Physical Systems

Cartridges: Lightweight and general-purpose long context representations via self-study

Fast-DataShapley: Neural Modeling for Training Data Valuation

NOBLE -- Neural Operator with Biologically-informed Latent Embeddings to Capture Experimental Variability in Biological Neuron Models

LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation

Can AI Master Econometrics? Evidence from Econometrics AI Agent on Expert-Level Tasks

Improving the Calibration of Confidence Scores in Text Generation Using the Output Distribution's Characteristics

Training RL Agents for Multi-Objective Network Defense Tasks

Explainability of Large Language Models using SMILE: Statistical Model-agnostic Interpretability with Local Explanations

RSCF: Relation-Semantics Consistent Filter for Entity Embedding of Knowledge Graph

MoESD: Unveil Speculative Decoding's Potential for Accelerating Sparse MoE

Impact of Frame Rates on Speech Tokenizer: A Case Study on Mandarin and English

Can reasoning models comprehend mathematical problems in Chinese ancient texts? An empirical study based on data from Suanjing Shishu

Table-R1: Region-based Reinforcement Learning for Table Understanding

Spatiotemporal Field Generation Based on Hybrid Mamba-Transformer with Physics-informed Fine-tuning

Graph-Based Floor Separation Using Node Embeddings and Clustering of WiFi Trajectories

Enhancing Cooperative Multi-Agent Reinforcement Learning with State Modelling and Adversarial Exploration

Quantitative Analysis of Performance Drop in DeepSeek Model Quantization

PhysNav-DG: A Novel Adaptive Framework for Robust VLM-Sensor Fusion in Navigation Applications

FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents

ColorBench: Can VLMs See and Understand the Colorful World? A Comprehensive Benchmark for Color Perception, Reasoning, and Robustness

"It's not a representation of me": Examining Accent Bias and Digital Exclusion in Synthetic AI Voice Services

Towards Personalized Conversational Sales Agents: Contextual User Profiling for Strategic Action

PIPO: Pipelined Offloading for Efficient Inference on Consumer Devices

Beyond the Visible: Multispectral Vision-Language Learning for Earth Observation

Ensemble Knowledge Distillation for Machine Learning Interatomic Potentials

Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to Artifacts

V-Max: A Reinforcement Learning Framework for Autonomous Driving

PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts

Naturalistic Computational Cognitive Science: Towards generalizable models and theories that capture the full range of natural behavior

MEDDxAgent: A Unified Modular Agent Framework for Explainable Automatic Differential Diagnosis

The Sharpness Disparity Principle in Transformers for Accelerating Language Model Pre-Training

Understanding the Emergence of Multimodal Representation Alignment

Conformal Inference under High-Dimensional Covariate Shifts via Likelihood-Ratio Regularization

Towards Understanding Fine-Tuning Mechanisms of LLMs via Circuit Analysis

TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages

BalanceBenchmark: A Survey for Multimodal Imbalance Learning

AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformers

Vision-Language Models for Edge Networks: A Comprehensive Survey

Foundation Models for Anomaly Detection: Vision and Challenges

Unsafe LLM-Based Search: Quantitative Analysis and Mitigation of Safety Risks in AI Web Search

Capturing Temporal Dynamics in Large-Scale Canopy Tree Height Estimation

Graph of Attacks with Pruning: Optimizing Stealthy Jailbreak Prompt Generation for Enhanced LLM Content Moderation

Evaluating Sample Utility for Efficient Data Selection by Mimicking Model Weights

Discovering Hidden Visual Concepts Beyond Linguistic Input in Infant Learning

Bi-directional Mapping of Morphology Metrics and 3D City Blocks for Enhanced Characterization and Generation of Urban Form

One Diffusion to Generate Them All

Entropy Controllable Direct Preference Optimization

TrajAgent: An LLM-based Agent Framework for Automated Trajectory Modeling via Collaboration of Large and Small Models

Control Industrial Automation System with Large Language Model Agents

How Well Do Large Language Models Serve as End-to-End Secure Code Agents for Python?

Self-interpreting Adversarial Images

Evaluating Implicit Bias in Large Language Models by Attacking From a Psychometric Perspective

Ad Auctions for LLMs via Retrieval Augmented Generation

Dynamic and Adaptive Feature Generation with LLM

MiniMaxAD: A Lightweight Autoencoder for Feature-Rich Anomaly Detection

PLeak: Prompt Leaking Attacks against Large Language Model Applications

HandS3C: 3D Hand Mesh Reconstruction with State Space Spatial Channel Attention from RGB images

DiffTORI: Differentiable Trajectory Optimization for Deep Reinforcement and Imitation Learning

Evolution Guided Generative Flow Networks

Manipulating Feature Visualizations with Gradient Slingshots

Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoning

Agent Semantics, Semantic Spacetime, and Graphical Reasoning

Decomposability-Guaranteed Cooperative Coevolution for Large-Scale Itinerary Planning

DeePoly: A High-Order Accuracy Scientific Machine Learning Framework for Function Approximation and Solving PDEs

Does Thinking More always Help? Understanding Test-Time Scaling in Reasoning Models

The Automated but Risky Game: Modeling Agent-to-Agent Negotiations and Transactions in Consumer Markets

ChemRxivQuest: A Curated Chemistry Question-Answer Database Extracted from ChemRxiv Preprints

Epistemic Artificial Intelligence is Essential for Machine Learning Models to Truly `Know When They Do Not Know'

Enhancing multimodal analogical reasoning with Logic Augmented Generation

Beating Transformers using Synthetic Cognition

HypRL: Reinforcement Learning of Control Policies for Hyperproperties

From Idea to Implementation: Evaluating the Influence of Large Language Models in Software Development -- An Opinion Paper

Bel Esprit: Multi-Agent Framework for Building AI Model Pipelines

Dynamic Policy Fusion for User Alignment Without Re-Interaction

Tell Me What You Don't Know: Enhancing Refusal Capabilities of Role-Playing Agents via Representation Space Analysis and Editing

An overview of domain-specific foundation model: key technologies, applications and challenges

Learning from Litigation: Graphs and LLMs for Retrieval and Reasoning in eDiscovery

Combining Deep Reinforcement Learning and Search with Generative Models for Game-Theoretic Opponent Modeling

EMLoC: Emulator-based Memory-efficient Fine-tuning with LoRA Correction

code_transformed: The Influence of Large Language Models on Code

Reimagining Dance: Real-time Music Co-creation between Dancers and AI

Upgrade or Switch: Do We Need a New Registry Architecture for the Internet of AI Agents?

VGR: Visual Grounded Reasoning

Technical Evaluation of a Disruptive Approach in Homomorphic AI

SAIL: Faster-than-Demonstration Execution of Imitation Learning Policies

Subjective Experience in AI Systems: What Do AI Researchers and the Public Believe?

Today's Cat Is Tomorrow's Dog: Accounting for Time-Based Changes in the Labels of ML Vulnerability Detection Approaches

Self-interpreting Adversarial Images

Created by

Haebom

저자

Tingwei Zhang, Collin Zhang, John X. Morris, Eugene Bagdasarian, Vitaly Shmatikov

개요

본 논문은 시각 언어 모델에 대한 새로운 유형의 간접적이고 교차 모달 주입 공격인 자기 해석 이미지 생성 방법을 제시합니다. 자기 해석 이미지는 모델이 이미지에 대한 사용자 질문에 답하는 방식을 제어하고, 공격자가 선택한 스타일, 감정 또는 관점을 표현하도록 모델의 출력을 조종하는 숨겨진 "메타 지시"를 포함합니다. 이러한 이미지는 소프트 프롬프트 역할을 하며, 시각적 콘텐츠를 기반으로 답변을 생성하면서 동시에 공격자의 (메타) 목표를 충족하도록 모델을 조절합니다. 메타 지시는 따라서 프롬프트 주입의 더 강력한 형태입니다. 공격적인 이미지는 자연스러워 보이고 모델의 답변은 일관되고 그럴듯하지만, 공격자가 선택한 해석(예: 정치적 왜곡) 또는 명시적 텍스트 지시로는 달성할 수 없는 목표를 따릅니다. 다양한 모델, 해석 및 사용자 프롬프트에 대한 자기 해석 이미지의 효과를 평가하고, 스팸, 허위 정보 또는 왜곡을 전달하는 자기 해석 콘텐츠 생성을 통해 어떻게 피해를 입힐 수 있는지 설명하며, 마지막으로 방어에 대해 논의합니다.

시사점, 한계점

•

시사점:

◦

시각 언어 모델에 대한 새로운 유형의 교차 모달 공격 방식을 제시하여 기존 프롬프트 주입 공격보다 강력한 공격 가능성을 보여줌.

◦

자연스러운 이미지와 일관된 응답을 통해 사용자를 속이고 원하는 정보를 전달할 수 있는 위험성을 제기함.

◦

스팸, 허위 정보, 정치적 왜곡 등 악의적인 목적으로 활용될 가능성을 보여줌.

•

한계점:

◦

제시된 방어 기법의 효과 및 실현 가능성에 대한 추가적인 연구가 필요함.

◦

다양한 시각 언어 모델 및 사용 사례에 대한 광범위한 실험적 검증이 필요함.

◦

실제 세계의 다양한 상황에서 공격의 효과를 평가하기 위한 추가 연구가 필요함.

Made with Slashpage