Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Sekai: A Video Dataset towards World Exploration

Federated Learning for MRI-based BrainAGE: a multicenter study on post-stroke functional outcome prediction

One-Step Diffusion for Detail-Rich and Temporally Consistent Video Super-Resolution

Capturing Polysemanticity with PRISM: A Multi-Concept Feature Description Framework

Efficient Retail Video Annotation: A Robust Key Frame Generation Approach for Product and Customer Interaction Analysis

WebXAII: an open-source web framework to study human-XAI interaction

Refining music sample identification with a self-supervised graph neural network

Decoupled Classifier-Free Guidance for Counterfactual Diffusion Models

Essential-Web v1.0: 24T tokens of organized web data

Adaptive Guidance Accelerates Reinforcement Learning of Reasoning Models

LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction

Screen Hijack: Visual Poisoning of VLM Agents in Mobile Environments

SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Acceleration

Serving Large Language Models on Huawei CloudMatrix384

Machine Learning Methods for Small Data and Upstream Bioprocessing Applications: A Comprehensive Review

Med-U1: Incentivizing Unified Medical Reasoning in LLMs via Large-scale Reinforcement Learning

Two Heads Are Better than One: Simulating Large Transformers with Small Ones

BreastDCEDL: Curating a Comprehensive DCE-MRI Dataset and developing a Transformer Implementation for Breast Cancer Treatment Response Prediction

Semantic Preprocessing for LLM-based Malware Analysis

A Minimalist Method for Fine-tuning Text-to-Image Diffusion Models

Human-like Forgetting Curves in Deep Neural Networks

Convergent Linear Representations of Emergent Misalignment

LearnAlign: Reasoning Data Selection for Reinforcement Learning in Large Language Models Based on Improved Gradient Alignment

TARDIS STRIDE: A Spatio-Temporal Road Image Dataset and World Model for Autonomy

Autonomous Computer Vision Development with Agentic AI

The Memory Paradox: Why Our Brains Need Knowledge in an Age of AI

SWE-Factory: Your Automated Factory for Issue Resolution Training Data and Evaluation Benchmarks

Using Language and Road Manuals to Inform Map Reconstruction for Autonomous Driving

Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing

PlantBert: An Open Source Language Model for Plant Science

Info-Coevolution: An Efficient Framework for Data Model Coevolution

SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes

SafeGenBench: A Benchmark Framework for Security Vulnerability Detection in LLM-Generated Code

UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation

KVCache Cache in the Wild: Characterizing and Optimizing KVCache Cache at a Large Cloud Provider

GraphRAG-Bench: Challenging Domain-Specific Reasoning for Evaluating Graph Retrieval-Augmented Generation

Towards Efficient Few-shot Graph Neural Architecture Search via Partitioning Gradient Contribution

Optimizing Sensory Neurons: Nonlinear Attention Mechanisms for Accelerated Convergence in Permutation-Invariant Neural Networks for Reinforcement Learning

CryoCCD: Conditional Cycle-consistent Diffusion with Biophysical Modeling for Cryo-EM Synthesis

More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Models

Calibrating Pre-trained Language Classifiers on LLM-generated Noisy Labels via Iterative Refinement

Dynamic Risk Assessments for Offensive Cybersecurity Agents

SSR-Zero: Simple Self-Rewarding Reinforcement Learning for Machine Translation

Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets

Breaking the Compression Ceiling: Data-Free Pipeline for Ultra-Efficient Delta Compression

Representation Learning with Mutual Influence of Modalities for Node Classification in Multi-Modal Heterogeneous Networks

Learning Dynamics in Continual Pre-Training for Large Language Models

Mask-PINNs: Regulating Feature Distributions in Physics-Informed Neural Networks

Assessing Tenstorrent's RISC-V MatMul Acceleration Capabilities

SPIN-ODE: Stiff Physics-Informed Neural ODE for Chemical Reaction Rate Estimation

PerceptionLM: Open-Access Data and Models for Detailed Visual Understanding

DeepSelective: Interpretable Prognosis Prediction via Feature Selection and Compression in EHR Data

Boosting multi-demographic federated learning for chest radiograph analysis using general-purpose self-supervised representations

AerialVG: A Challenging Benchmark for Aerial Visual Grounding by Exploring Positional Relations

PR-Attack: Coordinated Prompt-RAG Attacks on Retrieval-Augmented Generation in Large Language Models via Bilevel Optimization

TALE: A Tool-Augmented Framework for Reference-Free Evaluation of Large Language Models

Decentralized Collective World Model for Emergent Communication and Coordination

RL2Grid: Benchmarking Reinforcement Learning in Power Grid Operations

Efficient but Vulnerable: Benchmarking and Defending LLM Batch Prompting Attack

LLMs in Disease Diagnosis: A Comparative Study of DeepSeek-R1 and O3 Mini Across Chronic Health Conditions

Can We Detect Failures Without Failure Data? Uncertainty-Aware Runtime Failure Detection for Imitation Learning Policies

QG-SMS: Enhancing Test Item Analysis via Student Modeling and Simulation

Dynamic Knowledge Integration for Evidence-Driven Counter-Argument Generation with Large Language Models

AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation

Eau De $Q$-Network: Adaptive Distillation of Neural Networks in Deep Reinforcement Learning

Hierarchical and Modular Network on Non-prehensile Manipulation in General Environments

Selective Use of Yannakakis' Algorithm to Improve Query Performance: Machine Learning to the Rescue

FRIDA to the Rescue! Analyzing Synthetic Data Effectiveness in Object-Based Common Sense Reasoning for Disaster Response

Batayan: A Filipino NLP benchmark for evaluating Large Language Models

From RAG to Memory: Non-Parametric Continual Learning for Large Language Models

Conformal Inference under High-Dimensional Covariate Shifts via Likelihood-Ratio Regularization

ShapeLib: Designing a library of programmatic 3D shape abstractions with Large Language Models

Rethinking Fine-Tuning when Scaling Test-Time Compute: Limiting Confidence Improves Mathematical Reasoning

Guaranteed prediction sets for functional surrogate models

FDLLM: A Dedicated Detector for Black-Box LLMs Fingerprinting

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning

MonoSOWA: Scalable monocular 3D Object detector Without human Annotations

Representation Learning of Point Cloud Upsampling in Global and Local Inputs

Multi-Preference Optimization: Generalizing DPO via Set-Level Contrasts

Incivility and Rigidity: The Risks of Fine-Tuning LLMs for Political Argumentation

Song Form-aware Full-Song Text-to-Lyrics Generation with Multi-Level Granularity Syllable Count Control

Learning Multi-Branch Cooperation for Enhanced Click-Through Rate Prediction at Taobao

On the Limits of Language Generation: Trade-Offs Between Hallucination and Mode Collapse

Web Archives Metadata Generation with GPT-4o: Challenges and Insights

Cyclic Vision-Language Manipulator: Towards Reliable and Fine-Grained Image Interpretation for Automated Report Generation

A Implies B: Circuit Analysis in LLMs for Propositional Logical Reasoning

Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation

FALCON: Feedback-driven Adaptive Long/short-term memory reinforced Coding Optimization system

Efficient Mixture-of-Expert for Video-based Driver State and Physiological Multi-task Estimation in Conditional Autonomous Driving

ALTA: Compiler-Based Analysis of Transformers

Learning to Route LLMs with Confidence Tokens

Core Knowledge Deficits in Multi-Modal Language Models

AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environment

MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension

Can Large Language Models Replace Human Subjects? A Large-Scale Replication of Scenario-Based Experiments in Psychology and Management

LogProber: Disentangling confidence from contamination in LLM responses

V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Models

xGen-MM (BLIP-3): A Family of Open Large Multimodal Models

Understanding and Reducing the Class-Dependent Effects of Data Augmentation with A Two-Player Game Approach

PromptDSI: Prompt-based Rehearsal-free Instance-wise Incremental Learning for Document Retrieval

Efficient but Vulnerable: Benchmarking and Defending LLM Batch Prompting Attack

Created by

Haebom

저자

Murong Yue, Ziyu Yao

개요

본 논문은 배치 프롬프팅의 보안 취약성을 다룹니다. 배치 프롬프팅은 여러 쿼리를 하나의 추론으로 처리하여 비용을 절감하는 기법이지만, 악의적인 사용자가 배치에 공격 명령을 주입하여 모든 쿼리에 영향을 미칠 수 있다는 취약성을 지적합니다. 이를 체계적으로 연구하기 위해 150개의 공격 명령어와 8,000개의 배치 인스턴스로 구성된 BATCHSAFEBENCH 벤치마크를 제시하고, 다양한 LLM에서의 취약성을 실험적으로 검증합니다. 또한 프롬프트 기반 방어 및 탐지 기반 방어 기법을 제시하고, 메커니즘 분석을 통해 공격의 원인과 관련된 어텐션 헤드를 확인합니다.

시사점, 한계점

•

시사점:

◦

배치 프롬프팅의 보안 취약성을 밝히고, 그 심각성을 실험적으로 증명했습니다.

◦

BATCHSAFEBENCH 벤치마크를 통해 배치 프롬프팅 공격 연구를 위한 표준을 제시했습니다.

◦

프롬프트 기반 방어와 탐지 기반 방어의 효과를 비교 분석했습니다. 탐지 기반 방어가 더 높은 정확도를 보였습니다.

◦

메커니즘 분석을 통해 공격의 원인을 분석하고, 취약한 어텐션 헤드를 확인했습니다.

•

한계점:

◦

제시된 방어 기법(탐지 기반)의 일반화 성능에 대한 추가 연구가 필요합니다.

◦

더욱 다양하고 정교한 공격 기법에 대한 추가적인 연구가 필요합니다.

◦

특정 LLM 아키텍처에 국한된 분석 결과일 수 있습니다.

◦

프롬프트 기반 방어의 효과가 작은 LLM에서 제한적이라는 점이 한계로 지적됩니다.

Made with Slashpage