Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Geo-Registration of Terrestrial LiDAR Point Clouds with Satellite Images without GNSS

Empowering Bridge Digital Twins by Bridging the Data Gap with a Unified Synthesis Framework

AI Agent Smart Contract Exploit Generation

ModelCitizens: Representing Community Voices in Online Safety

Sequential Attention-based Sampling for Histopathological Analysis

Classification of autoimmune diseases from Peripheral blood TCR repertoires by multimodal multi-instance learning

From Video to EEG: Adapting Joint Embedding Predictive Architecture to Uncover Visual Concepts in Brain Signal Analysis

Reinforcement Learning-based Feature Generation Algorithm for Scientific Data

RefineX: Learning to Refine Pre-training Data at Scale from Expert-Guided Programs

On Jailbreaking Quantized Language Models Through Fault Injection Attacks

PBa-LLM: Privacy- and Bias-aware NLP using Named-Entity Recognition (NER)

DriveMRP: Enhancing Vision-Language Models with Synthetic Motion Data for Motion Risk Prediction

Probing and Steering Evaluation Awareness of Language Models

Generating Heterogeneous Multi-dimensional Data : A Comparative Study

Autonomy by Design: Preserving Human Autonomy in AI Decision-Support

PBCAT: Patch-based composite adversarial training against physically realizable attacks on object detection

Federated Breast Cancer Detection Enhanced by Synthetic Ultrasound Image Augmentation

XY-Tokenizer: Mitigating the Semantic-Acoustic Conflict in Low-Bitrate Speech Codecs

DeepTalk: Towards Seamless and Smart Speech Interaction with Adaptive Modality-Specific MoE

SWE-SQL: Illuminating LLM Pathways to Solve User SQL Issues in Real-World Applications

LLM Agent for Hyper-Parameter Optimization

MedSyn: Enhancing Diagnostics with Human-AI Collaboration

Evaluating and Improving Robustness in Large Language Models: A Survey and Future Directions

ConTextTab: A Semantics-Aware Tabular In-Context Learner

QUITE: A Query Rewrite System Beyond Rules with LLM Agents

Saffron-1: Safety Inference Scaling

hdl2v: A Code Translation Dataset for Enhanced LLM Verilog Generation

Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons

Humanoid World Models: Open World Foundation Models for Humanoid Robotics

EMORL: Ensemble Multi-Objective Reinforcement Learning for Efficient and Flexible LLM Fine-Tuning

Adaptive Elicitation of Latent Information Using Natural Language

Substance over Style: Evaluating Proactive Conversational Coaching Agents

Real AI Agents with Fake Memories: Fatal Context Manipulation Attacks on Web3 Agents

Sparse Autoencoder as a Zero-Shot Classifier for Concept Erasing in Text-to-Image Diffusion Models

Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to Artifacts

UniF$^2$ace: Fine-grained Face Understanding and Generation with Unified Multimodal Models

DynamicID: Zero-Shot Multi-ID Image Personalization with Flexible Facial Editability

GMLM: Bridging Graph Neural Networks and Language Models for Heterophilic Node Classification

Towards Enterprise-Ready Computer Using Generalist Agent

Oscillation-Reduced MXFP4 Training for Vision Transformers

Understanding Fixed Predictions via Confined Regions

Multi-Attribute Steering of Language Models via Targeted Intervention

Teaching LLMs According to Their Aptitude: Adaptive Reasoning for Mathematical Problem Solving

Theme-Explanation Structure for Table Summarization using Large Language Models: A Case Study on Korean Tabular Data

Scaling 4D Representations

AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework

CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedback

Vital Insight: Assisting Experts' Context-Driven Sensemaking of Multi-modal Personal Tracking Data Using Visualization and Human-In-The-Loop LLM

Hespi: A pipeline for automatically detecting information from hebarium specimen sheets

Diversifying Robot Locomotion Behaviors with Extrinsic Behavioral Curiosity

Pullback Flow Matching on Data Manifolds

The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilot

Breaking PEFT Limitations: Leveraging Weak-to-Strong Knowledge Transfer for Backdoor Attacks in LLMs

Tokenization for Molecular Foundation Models

DilateQuant: Accurate and Efficient Diffusion Quantization via Weight Dilation

PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideation

Disentangling Uncertainty for Safe Social Navigation using Deep Reinforcement Learning

CodeMirage: Hallucinations in Code Generated by Large Language Models

A Policy-Gradient Approach to Solving Imperfect-Information Games with Best-Iterate Convergence

Diffusion-Driven Semantic Communication for Generative Models with Bandwidth Constraints

Semantic Augmentation in Images using Language

Geometric Constraints in Deep Learning Frameworks: A Survey

Enhancing Plasticity for First Session Adaptation Continual Learning

Efficient Transfer Learning via Causal Bounds

FEVO: Financial Knowledge Expansion and Reasoning Evolution for Large Language Models

A Wireless Foundation Model for Multi-Task Prediction

GTA1: GUI Test-time Scaling Agent

Modeling (Deontic) Modal Operators With the s(CASP) Goal-directed Predicate Answer Set Programming System

Fuzzy Classification Aggregation for a Continuum of Agents

MedGellan: LLM-Generated Medical Guidance to Support Physicians

Animation Needs Attention: A Holistic Approach to Slides Animation Comprehension with Visual-Language Models

Establishing Best Practices for Building Rigorous Agentic Benchmarks

SHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agents

TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systems

The end of radical concept nativism

AI-Driven Scholarly Peer Review via Persistent Workflow Prompting, Meta-Prompting, and Meta-Reasoning

Do Larger Language Models Imply Better Generalization? A Pretraining Scaling Law for Implicit Reasoning

SagaLLM: Context Management, Validation, and Transaction Guarantees for Multi-Agent LLM Planning

Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models

ROCKET-2: Steering Visuomotor Policy via Cross-View Goal Alignment

Hybrid Quantum-Classical Multi-Agent Pathfinding

FinSphere, a Real-Time Stock Analysis Agent Powered by Instruction-Tuned LLMs and Domain Tools

Multi-Agent Pathfinding Under Team-Connected Communication Constraint via Adaptive Path Expansion and Dynamic Leading

Can adversarial attacks by large language models be attributed?

Planning Anything with Rigor: General-Purpose Zero-Shot Planning with LLM-based Formalized Programming

OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework

Stepwise functional refoundation of relational concept analysis

A Survey on Event Prediction Methods from a Systems Perspective: Bringing Together Disparate Research Areas

An AI Approach for Learning the Spectrum of the Laplace-Beltrami Operator

Latent Acoustic Mapping for Direction of Arrival Estimation: A Self-Supervised Approach

DeepRetro: Retrosynthetic Pathway Discovery using Iterative LLM Reasoning

Comparative Analysis of CNN and Transformer Architectures with Heart Cycle Normalization for Automated Phonocardiogram Classification

A Novel Hybrid Deep Learning Technique for Speech Emotion Detection using Feature Engineering

Advances in Intelligent Hearing Aids: Deep Learning Approaches to Selective Noise Cancellation

Modeling Heterogeneity across Varying Spatial Extents: Discovering Linkages between Sea Ice Retreat and Ice Shelve Melt in the Antarctic

Surrogate Model for Heat Transfer Prediction in Impinging Jet Arrays using Dynamic Inlet/Outlet and Flow Rate Control

PLAME: Leveraging Pretrained Language Models to Generate Enhanced Protein Multiple Sequence Alignments

Design and Implementation of an OCR-Powered Pipeline for Table Extraction from Invoices

FlexOlmo: Open Language Models for Flexible Data Use

Generating Multi-Table Time Series EHR from Latent Space with Minimal Preprocessing

Scaling 4D Representations

Created by

Haebom

저자

Joao Carreira, Dilara Gokay, Michael King, Chuhan Zhang, Ignacio Rocco, Aravindh Mahendran, Thomas Albert Keck, Joseph Heyward, Skanda Koppula, Etienne Pot, Goker Erdogan, Yana Hasson, Yi Yang, Klaus Greff, Guillaume Le Moing, Sjoerd van Steenkiste, Daniel Zoran, Drew A. Hudson, Pedro Velez, Luisa Polania, Luke Friedman, Chris Duvarney, Ross Goroshin, Kelsey Allen, Jacob Walker, Rishabh Kabra, Eric Aboussouan, Jennifer Sun, Thomas Kipf, Carl Doersch, Viorica P\u{a}tr\u{a}ucean, Dima Damen, Pauline Luc, Mehdi S. M. Sajjadi, Andrew Zisserman

개요

본 논문은 비디오 데이터를 활용한 순수 자기 지도 학습의 확장성을 비디오 기반의 공간적(3D) 및 시간적(+1D=4D) 비지도 학습 과제(카메라 자세 추정, 점 및 객체 추적, 깊이 추정 등)에 초점을 맞춰 평가합니다. 기존 연구들이 주로 의미론적 과제(액션 분류, ImageNet 분류 등)에 집중한 것과 달리, 본 연구는 대규모 비디오 데이터셋으로부터 학습된 Transformer 기반의 마스크 자동 인코딩(MAE) 모델을 사용하여, 모델 크기가 20M에서 22B 파라미터까지 증가함에 따라 4D 비전 과제의 성능이 지속적으로 향상됨을 보여줍니다. 다양한 최신 이미지 및 비디오 모델과의 비교 분석을 통해 4D 표현의 확장성 이점을 제시하며, 사전 학습된 모델은 공개 저장소에서 제공합니다.

시사점, 한계점

•

시사점:

◦

대규모 비디오 데이터셋을 활용한 자기 지도 학습의 확장성을 공간-시간적(4D) 비전 과제에서 성공적으로 입증.

◦

Transformer 기반 MAE 모델의 4D 표현 학습의 효과를 실험적으로 증명.

◦

22B 파라미터에 달하는 대규모 자기 지도 학습 비디오 모델을 제시하고 공개.

◦

다양한 비디오 기반 과제에서 성능 향상을 보임.

•

한계점:

◦

아직 의미론적 과제에 대한 자기 지도 학습 확장성은 충분히 검증되지 않음.

◦

제시된 모델의 계산 비용이 높을 수 있음.

◦

특정 유형의 비디오 데이터에 대한 성능 평가에 치중되어 일반화 성능에 대한 추가 연구 필요.

Made with Slashpage