[공지사항]을 빙자한 안부와 근황

Show more

Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos

Compositional Discrete Latent Code for High Fidelity, Productive Diffusion Models

MERA Code: A Unified Framework for Evaluating Code Generation Across Tasks

Site-Level Fine-Tuning with Progressive Layer Freezing: Towards Robust Prediction of Bronchopulmonary Dysplasia from Day-1 Chest Radiographs in Extremely Preterm Infants

A Roadmap for Climate-Relevant Robotics Research

Fairness Is Not Enough: Auditing Competence and Intersectional Bias in AI-powered Resume Screening

MMOne: Representing Multiple Modalities in One Scene

SWE-MERA: A Dynamic Benchmark for Agenticly Evaluating Large Language Models on Software Engineering Tasks

CodeAssistBench (CAB): Dataset & Benchmarking for Multi-turn Chat-Based Code Assistance

(Almost) Free Modality Stitching of Foundation Models

A Brain Tumor Segmentation Method Based on CLIP and 3D U-Net with Cross-Modal Semantic Guidance and Multi-Level Feature Fusion

KEN: Knowledge Augmentation and Emotion Guidance Network for Multimodal Fake News Detection

THOR: Transformer Heuristics for On-Demand Retrieval

SEALGuard: Safeguarding the Multilingual Conversations in Southeast Asian Languages for LLM Software Systems

KeyRe-ID: Keypoint-Guided Person Re-Identification using Part-Aware Representation in Videos

Prompt Perturbations Reveal Human-Like Biases in LLM Survey Responses

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

Fast Bilateral Teleoperation and Imitation Learning Using Sensorless Force Control via Accurate Dynamics Model

Task-Specific Generative Dataset Distillation with Difficulty-Guided Sampling

VIDEE: Visual and Interactive Decomposition, Execution, and Evaluation of Text Analytics with Intelligent Agents

ReCode: Updating Code API Knowledge with Reinforcement Learning

Cross-Layer Discrete Concept Discovery for Interpreting Language Models

Semantic Structure-Aware Generative Attacks for Enhanced Adversarial Transferability

MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents

Multiple-Frequencies Population-Based Training

Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedback

Fine-Tune an SLM or Prompt an LLM? The Case of Generating Low-Code Workflows

ContextQFormer: A New Context Modeling Method for Multi-Turn Multi-Modal Conversations

GPU Performance Portability needs Autotuning

Generating Synthetic Data via Augmentations for Improved Facial Resemblance in DreamBooth and InstantID

Coral Protocol: Open Infrastructure Connecting The Internet of Agents

MAC-Tuning: LLM Multi-Compositional Problem Reasoning with Enhanced Knowledge Boundary Awareness

Federated Learning: A Survey on Privacy-Preserving Collaborative Intelligence

ConTextual: Improving Clinical Text Summarization in LLMs with Context-preserving Token Filtering and Knowledge Graphs

Task-Circuit Quantization: Leveraging Knowledge Localization and Interpretability for Compression

JailDAM: Jailbreak Detection with Adaptive Memory for Vision-Language Model

K-P Quantum Neural Networks

VectorFit : Adaptive Singular & Bias Vector Fine-Tuning of Pre-trained Foundation Models

Data-Efficient Deep Operator Network for Unsteady Flow: A Multi-Fidelity Approach with Physics-Guided Subsampling

Learning Universal Human Mobility Patterns with a Foundation Model for Cross-domain Data Fusion

GeoFlow-SLAM: A Robust Tightly-Coupled RGBD-Inertial and Legged Odometry Fusion SLAM for Dynamic Legged Robotics

A Multi-Stage Framework with Taxonomy-Guided Reasoning for Occupation Classification Using Large Language Models

Multi-View Node Pruning for Accurate Graph Representation

V-Max: A Reinforcement Learning Framework for Autonomous Driving

Interpretable Transformation and Analysis of Timelines through Learning via Surprisability

AI Governance InternationaL Evaluation Index (AGILE Index) 2024

UPCORE: Utility-Preserving Coreset Selection for Balanced Unlearning

Improving Transformer World Models for Data-Efficient RL

LLM-RecG: A Semantic Bias-Aware Framework for Zero-Shot Sequential Recommendation

SIDDA: SInkhorn Dynamic Domain Adaptation for Image Classification with Equivariant Neural Networks

Determination of galaxy photometric redshifts using Conditional Generative Adversarial Networks (CGANs)

Speech-Forensics: Towards Comprehensive Synthetic Speech Dataset Establishment and Analysis

MRGen: Segmentation Data Engine for Underrepresented MRI Modalities

IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization

Out-of-Distribution Recovery with Object-Centric Keypoint Inverse Policy for Visuomotor Imitation Learning

Dataset resulting from the user study on comprehensibility of explainable AI algorithms

Unified Triplet-Level Hallucination Evaluation for Large Vision-Language Models

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization

Identifying Task Groupings for Multi-Task Learning Using Pointwise V-Usable Information

DeFine: Decision-Making with Analogical Reasoning over Factor Profiles

Benchmarking Sub-Genre Classification For Mainstage Dance Music

Risks of ignoring uncertainty propagation in AI-augmented security pipelines

MedPix 2.0: A Comprehensive Multimodal Biomedical Data set for Advanced AI Applications with Retrieval Augmented Generation and Knowledge Graphs

Leveraging Quantum Superposition to Infer the Dynamic Behavior of a Spatial-Temporal Neural Network Signaling Model

Bounding the Worst-class Error: A Boosting Approach

TBDetector:Transformer-Based Detector for Advanced Persistent Threats with Provenance Graph

Machine Learning Systems: A Survey from a Data-Oriented Perspective

Aime: Towards Fully-Autonomous Multi-Agent Framework

SmartThinker: Learning to Compress and Preserve Reasoning by Step-Level Length Control

Ready Jurist One: Benchmarking Language Agents for Legal Intelligence in Dynamic Environments

NTRL: Encounter Generation via Reinforcement Learning for Dynamic Difficulty Adjustment in Dungeons and Dragons

Judging with Many Minds: Do More Perspectives Mean Less Prejudice? On Bias Amplifications and Resistance in Multi-Agent Based LLM-as-Judge

ActionStudio: A Lightweight Framework for Data and Training of Large Action Models

BEARCUBS: A benchmark for computer-using web agents

Demystifying MuZero Planning: Interpreting the Learned Model

LLM-Enhanced User-Item Interactions: Leveraging Edge Information for Optimized Recommendations

VideoITG: Multimodal Video Understanding with Instructed Temporal Grounding

VisionThink: Smart and Efficient Vision Language Model via Reinforcement Learning

Imbalance in Balance: Online Concept Balancing in Generation Models

Latent Policy Steering with Embodiment-Agnostic Pretrained World Models

Vision-and-Language Training Helps Deploy Taxonomic Knowledge but Does Not Fundamentally Alter It

Revisiting Reliability in the Reasoning-based Pose Estimation Benchmark

AbGen: Evaluating Large Language Models in Ablation Study Design and Evaluation for Scientific Research

Towards Formal Verification of LLM-Generated Code from Natural Language Prompts

Evaluating Reinforcement Learning Algorithms for Navigation in Simulated Robotic Quadrupeds: A Comparative Study Inspired by Guide Dog Behaviour

Overview of the TalentCLEF 2025: Skill and Job Title Intelligence for Human Capital Management

QuestA: Expanding Reasoning Capacity in LLMs via Question Augmentation

Merge Kernel for Bayesian Optimization on Permutation Space

Efficient Adaptation of Pre-trained Vision Transformer underpinned by Approximately Orthogonal Fine-Tuning Strategy

Automating Steering for Safe Multimodal Large Language Models

HATS: Hindi Analogy Test Set for Evaluating Reasoning in Large Language Models

VITA: Vision-to-Action Flow Matching Policy

$S^2M^2$: Scalable Stereo Matching Model for Reliable Depth Estimation

Synthesizing Reality: Leveraging the Generative AI-Powered Platform Midjourney for Construction Worker Detection

Aligning Humans and Robots via Reinforcement Learning from Implicit Human Feedback

SHIELD: A Secure and Highly Enhanced Integrated Learning for Robust Deepfake Detection against Adversarial Attacks

Prompt Injection 2.0: Hybrid AI Threats

Orbis: Overcoming Challenges of Long-Horizon Prediction in Driving World Models

Inverse Reinforcement Learning Meets Large Language Model Post-Training: Basics, Advances, and Opportunities

The Geometry of Self-Verification in a Task-Specific Reasoning Model

Created by

Haebom

저자

Andrew Lee, Lihao Sun, Chris Wendler, Fernanda Viegas, Martin Wattenberg

개요

본 논문은 DeepSeek R1을 이용하여 CountDown 과제에 대한 모델을 훈련시켜 추론 모델이 자신의 답을 어떻게 검증하는지 연구합니다. 선호도 조정으로 인한 모드 붕괴를 활용하여 항상 고도로 구조화된 사고 과정(chain-of-thought) 시퀀스를 생성하는 모델을 만듭니다. 상향식 및 하향식 분석을 통해 모델의 출력 검증 방식을 역설계합니다. 하향식 분석에서는 "success" 또는 "incorrect"와 같은 검증 관련 토큰을 인코딩하는 GLU 가중치를 발견하고, 상향식 분석에서는 "이전 토큰 헤드"가 자체 검증에 주로 책임이 있음을 발견합니다. 계층 간 통신 채널에서 영감을 얻어 식별된 GLU 가중치를 사용하여 자체 검증을 비활성화할 수 있는 3개의 어텐션 헤드를 찾아 잠재적으로 더 큰 검증 회로의 필수 구성 요소를 지적합니다. 마지막으로, 기본 모델과 일반적인 추론 DeepSeek-R1 모델에서도 유사한 검증 구성 요소가 존재함을 확인합니다.

시사점, 한계점

•

시사점: 추론 모델의 자체 검증 메커니즘에 대한 통찰력을 제공하며, GLU 가중치와 어텐션 헤드를 분석하여 자체 검증에 중요한 구성 요소를 특정합니다. 이는 향후 더 안전하고 신뢰할 수 있는 추론 모델 개발에 기여할 수 있습니다. 특정 어텐션 헤드의 역할을 규명함으로써 자체 검증 기능을 제어하거나 향상시키는 방법을 제시합니다.

•

한계점: CountDown 과제라는 특정 작업에 국한된 연구 결과이며, 다른 작업이나 모델에 대한 일반화 가능성은 제한적입니다. 분석에 사용된 방법론이 특정 모델 구조에 의존적일 수 있으며, 더 포괄적인 검증 메커니즘의 일부만을 밝혀냈을 가능성이 있습니다. 모드 붕괴 현상을 이용한 분석 방식의 일반성에 대한 추가적인 검토가 필요합니다.

Made with Slashpage