Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Distillation Robustifies Unlearning

Cartridges: Lightweight and general-purpose long context representations via self-study

Text-to-LoRA: Instant Transformer Adaption

Information Bargaining: Bilateral Commitment in Bayesian Persuasion

Cross-lingual Collapse: How Language-Centric Foundation Models Shape Reasoning in Large Language Models

Heartcare Suite: Multi-dimensional Understanding of ECG with Raw Multi-lead Signal Modeling

Peer-Ranked Precision: Creating a Foundational Dataset for Fine-Tuning Vision Models from DataSeeds' Annotated Imagery

TissUnet: Improved Extracranial Tissue and Cranium Segmentation for Children through Adulthood

A Red Teaming Roadmap Towards System-Level Safety

Reason-to-Recommend: Using Interaction-of-Thought Reasoning to Enhance LLM Recommendation

Context Is Not Comprehension

Feature-Based Lie Group Transformer for Real-World Applications

Horizon Reduction Makes RL Scalable

SLAC: Simulation-Pretrained Latent Action Space for Whole-Body Real-World RL

A Diffusion-Driven Temporal Super-Resolution and Spatial Consistency Enhancement Framework for 4D MRI imaging

BiMa: Towards Biases Mitigation for Text-Video Retrieval via Scene Element Guidance

Retrieval-Augmented Generation as Noisy In-Context Learning: A Unified Theory and Risk Bounds

Deep Learning for Retinal Degeneration Assessment: A Comprehensive Analysis of the MARIO AMD Progression Challenge

CoT is Not True Reasoning, It Is Just a Tight Constraint to Imitate: A Theory Perspective

Rethinking the effects of data contamination in Code Intelligence

MINT: Multimodal Instruction Tuning with Multimodal Interaction Grouping

Protap: A Benchmark for Protein Modeling on Realistic Downstream Applications

NTPP: Generative Speech Language Modeling for Dual-Channel Spoken Dialogue via Next-Token-Pair Prediction

SATA-BENCH: Select All That Apply Benchmark for Multiple Choice Questions

Learning from Double Positive and Unlabeled Data for Potential-Customer Identification

Aligned but Blind: Alignment Increases Implicit Bias by Reducing Awareness of Race

Diversity of Transformer Layers: One Aspect of Parameter Scaling Laws

Noise-Robustness Through Noise: Asymmetric LoRA Adaption with Poisoning Expert

Large Language Models Often Know When They Are Being Evaluated

WorkForceAgent-R1: Incentivizing Reasoning Capability in LLM-based Web Agents via Reinforcement Learning

CAST: Contrastive Adaptation and Distillation for Semi-Supervised Instance Segmentation

PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulation

RainFusion: Adaptive Video Generation Acceleration via Multi-Dimensional Visual Redundancy

VeriThoughts: Enabling Automated Verilog Code Generation using Reasoning and Formal Verification

Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzles

APE: Selective Fine-tuning with Acceptance Criteria for Language Model Adaptation

When Two LLMs Debate, Both Think They'll Win

Turb-L1: Achieving Long-term Turbulence Tracing By Tackling Spectral Bias

GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chains

Can MLLMs Guide Me Home? A Benchmark Study on Fine-Grained Visual Reasoning from Transit Maps

Sample Complexity of Diffusion Model Training Without Empirical Risk Minimizer Access

EVADE: Multimodal Benchmark for Evasive Content Detection in E-Commerce Applications

Simulating Macroeconomic Expectations using LLM Agents

Mixture of Decoding: An Attention-Inspired Adaptive Decoding Strategy to Mitigate Hallucinations in Large Vision-Language Models

Mechanistic evaluation of Transformers and state space models

Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Models

Pel, A Programming Language for Orchestrating AI Agents

MARVEL: Multi-Agent RTL Vulnerability Extraction using Large Language Models

Learning Pareto-Optimal Rewards from Noisy Preferences: A Framework for Multi-Objective Inverse Reinforcement Learning

Q-Policy: Quantum-Enhanced Policy Evaluation for Scalable Reinforcement Learning

BLEUBERI: BLEU is a surprisingly effective reward for instruction following

Position: We Need Responsible, Application-Driven (RAD) AI Research

Restoring Calibration for Aligned Large Language Models: A Calibration-Aware Fine-Tuning Approach

LookAlike: Consistent Distractor Generation in Math MCQs

Tree-Sliced Wasserstein Distance with Nonlinear Projection

Test-time Correlation Alignment

Pushing the Limits of Low-Bit Optimizers: A Focus on EMA Dynamics

OpenTCM: A GraphRAG-Empowered LLM-based System for Traditional Chinese Medicine Knowledge Retrieval and Diagnosis

A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment

MIB: A Mechanistic Interpretability Benchmark

Bipartite Ranking From Multiple Labels: On Loss Versus Label Aggregation

LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Models

Toward Total Recall: Enhancing FAIRness through AI-Driven Metadata Standardization

Finding Interest Needle in Popularity Haystack: Improving Retrieval by Modeling Item Exposure

Geometrical Properties of Text Token Embeddings for Strong Semantic Binding in Text-to-Image Generation

sudo rm -rf agentic_security

Imagine to Hear: Auditory Knowledge Generation can be an Effective Assistant for Language Models

Towards Achieving Perfect Multimodal Alignment

nvBench 2.0: Resolving Ambiguity in Text-to-Visualization through Stepwise Reasoning

FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA

RONA: Pragmatically Diverse Image Captioning with Coherence Relations

Unifying 2D and 3D Vision-Language Understanding

Revisiting semi-supervised learning in the era of foundation models

AI-based Framework for Robust Model-Based Connector Mating in Robotic Wire Harness Installation

Generalized Interpolating Discrete Diffusion

Towards Autonomous Reinforcement Learning for Real-World Robotic Manipulation with Large Language Models

Straight-Line Diffusion Model for Efficient 3D Molecular Generation

Examining the Mental Health Impact of Misinformation on Social Media Using a Hybrid Transformer-Based Approach

Dynamic spillovers and investment strategies across artificial intelligence ETFs, artificial intelligence tokens, and green markets

Dialogue Without Limits: Constant-Sized KV Caches for Extended Responses in LLMs

LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement

from Benign import Toxic: Jailbreaking the Language Model via Adversarial Metaphors

EgoNormia: Benchmarking Physical Social Norm Understanding

PhantomWiki: On-Demand Datasets for Reasoning and Retrieval Evaluation

NeoBERT: A Next-Generation BERT

From Offline to Online Memory-Free and Task-Free Continual Learning via Fine-Grained Hypergradients

AMPO: Active Multi-Preference Optimization for Self-play Preference Selection

SYNTHIA: Novel Concept Design with Affordance Composition

DBudgetKV: Dynamic Budget in KV Cache Compression for Ensuring Optimal Performance

AlphaAgent: LLM-Driven Alpha Mining with Regularized Exploration to Counteract Alpha Decay

DISC: DISC: Dynamic Decomposition Improves LLM Inference Scaling

Predicting Bad Goods Risk Scores with ARIMA Time Series: A Novel Risk Assessment Approach

Space-O-RAN: Enabling Intelligent, Open, and Interoperable Non Terrestrial Networks in 6G

MindLLM: A Subject-Agnostic and Versatile Model for fMRI-to-Text Decoding

Improving the Diffusability of Autoencoders

Tree-of-Debate: Multi-Persona Debate Trees Elicit Critical Thinking for Scientific Comparative Analysis

MMTEB: Massive Multilingual Text Embedding Benchmark

From Sub-Ability Diagnosis to Human-Aligned Generation: Bridging the Gap for Text Length Control via MARKERGEN

How Expressive are Knowledge Graph Foundation Models?

Machine Learning Should Maximize Welfare, but Not by (Only) Maximizing Accuracy

Mixture of Decoding: An Attention-Inspired Adaptive Decoding Strategy to Mitigate Hallucinations in Large Vision-Language Models

Created by

Haebom

저자

Xinlong Chen, Yuanxing Zhang, Qiang Liu, Junfei Wu, Fuzheng Zhang, Tieniu Tan

개요

본 논문은 대규모 비전-언어 모델(LVLMs)의 환각 문제를 해결하기 위해 새로운 디코딩 방법인 혼합 디코딩(MoD)을 제안합니다. MoD는 모델의 이미지 토큰에 대한 어텐션의 정확성을 평가하여 디코딩 전략을 동적으로 조절합니다. 원본 이미지 토큰과 모델이 주목한 이미지 토큰으로부터 생성된 출력의 일관성을 측정하여 어텐션의 정확성을 판단합니다. 출력이 일관성이 있으면 중요 정보를 증폭하고, 일관성이 없으면 잘못된 정보를 억제하는 전략을 사용합니다. 다양한 벤치마크에서 기존 디코딩 방법보다 성능이 우수함을 실험적으로 입증하였으며, 코드는 공개되어 있습니다.

시사점, 한계점

•

시사점:

◦

LVLMs의 환각 문제 완화에 효과적인 새로운 디코딩 방법(MoD) 제시

◦

이미지 토큰에 대한 어텐션의 정확성 평가를 통한 동적 디코딩 전략 조절

◦

다양한 벤치마크에서 기존 방법 대비 성능 향상 확인

◦

코드 공개를 통한 재현성 및 확장성 확보

•

한계점:

◦

제안된 방법의 일반화 성능에 대한 추가적인 검증 필요

◦

다양한 LVLMs 및 task에 대한 적용성 평가 필요

◦

환각의 정의 및 측정 방법에 대한 세밀한 논의 부족 (추가 연구 필요)

Made with Slashpage