Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Distillation Robustifies Unlearning

Cartridges: Lightweight and general-purpose long context representations via self-study

Text-to-LoRA: Instant Transformer Adaption

Information Bargaining: Bilateral Commitment in Bayesian Persuasion

Cross-lingual Collapse: How Language-Centric Foundation Models Shape Reasoning in Large Language Models

Heartcare Suite: Multi-dimensional Understanding of ECG with Raw Multi-lead Signal Modeling

Peer-Ranked Precision: Creating a Foundational Dataset for Fine-Tuning Vision Models from DataSeeds' Annotated Imagery

TissUnet: Improved Extracranial Tissue and Cranium Segmentation for Children through Adulthood

A Red Teaming Roadmap Towards System-Level Safety

Reason-to-Recommend: Using Interaction-of-Thought Reasoning to Enhance LLM Recommendation

Context Is Not Comprehension

Feature-Based Lie Group Transformer for Real-World Applications

Horizon Reduction Makes RL Scalable

SLAC: Simulation-Pretrained Latent Action Space for Whole-Body Real-World RL

A Diffusion-Driven Temporal Super-Resolution and Spatial Consistency Enhancement Framework for 4D MRI imaging

BiMa: Towards Biases Mitigation for Text-Video Retrieval via Scene Element Guidance

Retrieval-Augmented Generation as Noisy In-Context Learning: A Unified Theory and Risk Bounds

Deep Learning for Retinal Degeneration Assessment: A Comprehensive Analysis of the MARIO AMD Progression Challenge

CoT is Not True Reasoning, It Is Just a Tight Constraint to Imitate: A Theory Perspective

Rethinking the effects of data contamination in Code Intelligence

MINT: Multimodal Instruction Tuning with Multimodal Interaction Grouping

Protap: A Benchmark for Protein Modeling on Realistic Downstream Applications

NTPP: Generative Speech Language Modeling for Dual-Channel Spoken Dialogue via Next-Token-Pair Prediction

SATA-BENCH: Select All That Apply Benchmark for Multiple Choice Questions

Learning from Double Positive and Unlabeled Data for Potential-Customer Identification

Aligned but Blind: Alignment Increases Implicit Bias by Reducing Awareness of Race

Diversity of Transformer Layers: One Aspect of Parameter Scaling Laws

Noise-Robustness Through Noise: Asymmetric LoRA Adaption with Poisoning Expert

Large Language Models Often Know When They Are Being Evaluated

WorkForceAgent-R1: Incentivizing Reasoning Capability in LLM-based Web Agents via Reinforcement Learning

CAST: Contrastive Adaptation and Distillation for Semi-Supervised Instance Segmentation

PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulation

RainFusion: Adaptive Video Generation Acceleration via Multi-Dimensional Visual Redundancy

VeriThoughts: Enabling Automated Verilog Code Generation using Reasoning and Formal Verification

Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzles

APE: Selective Fine-tuning with Acceptance Criteria for Language Model Adaptation

When Two LLMs Debate, Both Think They'll Win

Turb-L1: Achieving Long-term Turbulence Tracing By Tackling Spectral Bias

GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chains

Can MLLMs Guide Me Home? A Benchmark Study on Fine-Grained Visual Reasoning from Transit Maps

Sample Complexity of Diffusion Model Training Without Empirical Risk Minimizer Access

EVADE: Multimodal Benchmark for Evasive Content Detection in E-Commerce Applications

Simulating Macroeconomic Expectations using LLM Agents

Mixture of Decoding: An Attention-Inspired Adaptive Decoding Strategy to Mitigate Hallucinations in Large Vision-Language Models

Mechanistic evaluation of Transformers and state space models

Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Models

Pel, A Programming Language for Orchestrating AI Agents

MARVEL: Multi-Agent RTL Vulnerability Extraction using Large Language Models

Learning Pareto-Optimal Rewards from Noisy Preferences: A Framework for Multi-Objective Inverse Reinforcement Learning

Q-Policy: Quantum-Enhanced Policy Evaluation for Scalable Reinforcement Learning

BLEUBERI: BLEU is a surprisingly effective reward for instruction following

Position: We Need Responsible, Application-Driven (RAD) AI Research

Restoring Calibration for Aligned Large Language Models: A Calibration-Aware Fine-Tuning Approach

LookAlike: Consistent Distractor Generation in Math MCQs

Tree-Sliced Wasserstein Distance with Nonlinear Projection

Test-time Correlation Alignment

Pushing the Limits of Low-Bit Optimizers: A Focus on EMA Dynamics

OpenTCM: A GraphRAG-Empowered LLM-based System for Traditional Chinese Medicine Knowledge Retrieval and Diagnosis

A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment

MIB: A Mechanistic Interpretability Benchmark

Bipartite Ranking From Multiple Labels: On Loss Versus Label Aggregation

LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Models

Toward Total Recall: Enhancing FAIRness through AI-Driven Metadata Standardization

Finding Interest Needle in Popularity Haystack: Improving Retrieval by Modeling Item Exposure

Geometrical Properties of Text Token Embeddings for Strong Semantic Binding in Text-to-Image Generation

sudo rm -rf agentic_security

Imagine to Hear: Auditory Knowledge Generation can be an Effective Assistant for Language Models

Towards Achieving Perfect Multimodal Alignment

nvBench 2.0: Resolving Ambiguity in Text-to-Visualization through Stepwise Reasoning

FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA

RONA: Pragmatically Diverse Image Captioning with Coherence Relations

Unifying 2D and 3D Vision-Language Understanding

Revisiting semi-supervised learning in the era of foundation models

AI-based Framework for Robust Model-Based Connector Mating in Robotic Wire Harness Installation

Generalized Interpolating Discrete Diffusion

Towards Autonomous Reinforcement Learning for Real-World Robotic Manipulation with Large Language Models

Straight-Line Diffusion Model for Efficient 3D Molecular Generation

Examining the Mental Health Impact of Misinformation on Social Media Using a Hybrid Transformer-Based Approach

Dynamic spillovers and investment strategies across artificial intelligence ETFs, artificial intelligence tokens, and green markets

Dialogue Without Limits: Constant-Sized KV Caches for Extended Responses in LLMs

LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement

from Benign import Toxic: Jailbreaking the Language Model via Adversarial Metaphors

EgoNormia: Benchmarking Physical Social Norm Understanding

PhantomWiki: On-Demand Datasets for Reasoning and Retrieval Evaluation

NeoBERT: A Next-Generation BERT

From Offline to Online Memory-Free and Task-Free Continual Learning via Fine-Grained Hypergradients

AMPO: Active Multi-Preference Optimization for Self-play Preference Selection

SYNTHIA: Novel Concept Design with Affordance Composition

DBudgetKV: Dynamic Budget in KV Cache Compression for Ensuring Optimal Performance

AlphaAgent: LLM-Driven Alpha Mining with Regularized Exploration to Counteract Alpha Decay

DISC: DISC: Dynamic Decomposition Improves LLM Inference Scaling

Predicting Bad Goods Risk Scores with ARIMA Time Series: A Novel Risk Assessment Approach

Space-O-RAN: Enabling Intelligent, Open, and Interoperable Non Terrestrial Networks in 6G

MindLLM: A Subject-Agnostic and Versatile Model for fMRI-to-Text Decoding

Improving the Diffusability of Autoencoders

Tree-of-Debate: Multi-Persona Debate Trees Elicit Critical Thinking for Scientific Comparative Analysis

MMTEB: Massive Multilingual Text Embedding Benchmark

From Sub-Ability Diagnosis to Human-Aligned Generation: Bridging the Gap for Text Length Control via MARKERGEN

How Expressive are Knowledge Graph Foundation Models?

Machine Learning Should Maximize Welfare, but Not by (Only) Maximizing Accuracy

A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment

Created by

Haebom

저자

Kun Wang, Guibin Zhang, Zhenhong Zhou, Jiahao Wu, Miao Yu, Shiqian Zhao, Chenlong Yin, Jinhu Fu, Yibo Yan, Hanjun Luo, Liang Lin, Zhihao Xu, Haolang Lu, Xinye Cao, Xinyun Zhou, Weifei Jin, Fanci Meng, Shicheng Xu, Junyuan Mao, Yu Wang, Hao Wu, Minghe Wang, Fan Zhang, Junfeng Fang, Wenjie Qu, Yue Liu, Chengwei Liu, Yifan Zhang, Qiankun Li, Chongye Guo, Yalan Qin, Zhaoxin Fan, Kai Wang, Yi Ding, Donghai Hong, Jiaming Ji, Yingxin Lai, Zitong Yu, Xinfeng Li, Yifan Jiang, Yanhui Li, Xinyu Deng, Junlin Wu, Dongxia Wang, Yihao Huang, Yufei Guo, Jen-tse Huang, Qiufeng Wang, Xiaolong Jin, Wenxuan Wang, Dongrui Liu, Yanwei Yue, Wenke Huang, Guancheng Wan, Heng Chang, Tianlin Li, Yi Yu, Chenghao Li, Jiawei Li, Lei Bai, Jie Zhang, Qing Guo, Jingyi Wang, Tianlong Chen, Joey Tianyi Zhou, Xiaojun Jia, Weisong Sun, Cong Wu, Jing Chen, Xuming Hu, Yiming Li, Xiao Wang, Ningyu Zhang, Luu Anh Tuan, Guowen Xu, Jiaheng Zhang, Tianwei Zhang, Xingjun Ma, Jindong Gu, Liang Pang, Xiang Wang, Bo An, Jun Sun, Mohit Bansal, Shirui Pan, Lingjuan Lyu, Yuval Elovici, Bhavya Kailkhura, Yaodong Yang, Hongwei Li, Wenyuan Xu, Yizhou Sun, Wei Wang, Qing Li, Ke Tang, Yu-Gang Jiang, Felix Juefei-Xu, Hui Xiong, Xiaofeng Wang, Dacheng Tao, Philip S. Yu, Qingsong Wen, Yang Liu

개요

본 논문은 대규모 언어 모델(LLM)의 안전성 및 보안 문제에 대한 포괄적인 분석을 제공합니다. 기존 연구들이 LLM 수명 주기의 특정 단계(배포 또는 미세 조정 단계 등)에만 초점을 맞춘 것과 달리, 본 논문은 데이터 준비, 사전 훈련, 사후 훈련, 배포 및 최종 상용화를 포함하는 LLM의 전체 수명 주기를 고려하는 "풀스택" 안전성 개념을 처음으로 제시합니다. 800편 이상의 논문을 분석하여 LLM 안전성에 대한 포괄적인 이해를 제공하며, 데이터 생성, 정렬 기술, 모델 편집 및 LLM 기반 에이전트 시스템 등 유망한 연구 방향을 제시합니다.

시사점, 한계점

•

시사점:

◦

LLM의 전체 수명 주기에 걸친 포괄적인 안전성 평가 프레임워크 제시

◦

800편 이상의 논문 분석을 통한 방대한 문헌 검토 및 체계적인 안전 문제 정리

◦

데이터 생성, 정렬 기술, 모델 편집, LLM 기반 에이전트 시스템 등의 유망한 연구 방향 제시

◦

LLM 안전성 연구에 대한 로드맵 및 관점 제공

•

한계점:

◦

본 논문에서 제시된 "풀스택" 안전성 개념의 실제 적용 및 효과에 대한 추가적인 연구 필요

◦

급속도로 발전하는 LLM 기술의 특성상, 본 논문의 분석 결과가 장기간 유효할지는 추가적인 검증 필요

◦

다양한 LLM 아키텍처 및 응용 분야에 대한 안전성 분석의 일반화 가능성에 대한 추가 연구 필요

Made with Slashpage