Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

JWB-DH-V1: Benchmark for Joint Whole-Body Talking Avatar and Speech Generation Version 1

T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation

The Xeno Sutra: Can Meaning and Value be Ascribed to an AI-Generated "Sacred" Text?

Humanoid Occupancy: Enabling A Generalized Multimodal Occupancy Perception System on Humanoid Robots

Sem-DPO: Mitigating Semantic Inconsistency in Preference Optimization for Prompt Engineering

The Carbon Cost of Conversation, Sustainability in the Age of Language Models

Machine Learning Risk Intelligence for Green Hydrogen Investment: Insights for Duqm R3 Auction

Differential-UMamba: Rethinking Tumor Segmentation Under Limited Data Scenarios

Decoding Instructional Dialogue: Human-AI Collaborative Analysis of Teacher Use of AI Tool at Scale

Towards Facilitated Fairness Assessment of AI-based Skin Lesion Classifiers Through GenAI-based Image Synthesis

Reinforcement Learning Fine-Tunes a Sparse Subnetwork in Large Language Models

Machine learning-based multimodal prognostic models integrating pathology images and high-throughput omic data for overall survival prediction in cancer: a systematic review

Diffusion Beats Autoregressive in Data-Constrained Settings

SegQuant: A Semantics-Aware and Generalizable Quantization Framework for Diffusion Models

Linguistic and Embedding-Based Profiling of Texts generated by Humans and Large Language Models

AI-ming backwards: Vanishing archaeological landscapes in Mesopotamia and automatic detection of sites on CORONA imagery

Kodezi Chronos: A Debugging-First Language Model for Repository-Scale Code Understanding

TolerantECG: A Foundation Model for Imperfect Electrocardiogram

AMix-1: A Pathway to Test-Time Scalable Protein Foundation Model

Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models

HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation

ZERO: Industry-ready Vision Foundation Model with Multi-modal Prompts

End-to-End Large Portfolio Optimization for Variance Minimization with Neural Networks through Covariance Cleaning

iPanda: An LLM-based Agent for Automated Conformance Testing of Communication Protocols

SurgiSR4K: A High-Resolution Endoscopic Video Dataset for Robotic-Assisted Minimally Invasive Procedures

Generating Heterogeneous Multi-dimensional Data : A Comparative Study

Automated Generation of Diverse Courses of Actions for Multi-Agent Operations using Binary Optimization and Graph Learning

GLIMPSE: Holistic Cross-Modal Explainability for Large Vision-Language Models

Fine-Grained Perturbation Guidance via Attention Head Selection

FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation

SmoothRot: Combining Channel-Wise Scaling and Rotation for Quantization-Friendly LLMs

LinkTo-Anime: A 2D Animation Optical Flow Dataset from 3D Model Rendering

Incentivizing Reasoning for Advanced Instruction-Following of Large Language Models

Adversarial bandit optimization for approximately linear functions

FB-RAG: Improving RAG with Forward and Backward Lookup

Mining Intrinsic Rewards from LLM Hidden States for Efficient Best-of-N Sampling

Learning Pareto-Optimal Rewards from Noisy Preferences: A Framework for Multi-Objective Inverse Reinforcement Learning

Context-Aware Probabilistic Modeling with LLM for Multimodal Time Series Forecasting

Multi-Modal Hypergraph Enhanced LLM Learning for Recommendation

OPAL: Encoding Causal Understanding of Physical Systems for Robot Learning

Not someone, but something: Rethinking trust in the age of medical AI

My Life in Artificial Intelligence: People, anecdotes, and some lessons learnt

SQuat: Subspace-orthogonal KV Cache Quantization

Levels of Analysis for Large Language Models

Narrative Context Protocol: An Open-Source Storytelling Framework for Generative AI

Conceptualizing Uncertainty: A Concept-based Approach to Explaining Uncertainty

Low-Confidence Gold: Refining Low-Confidence Samples for Efficient Instruction Tuning

A calibration test for evaluating set-based epistemic uncertainty representations

Multi-branch of Attention Yields Accurate Results for Tabular Data

PAR-AdvGAN: Improving Adversarial Attack Capability with Progressive Auto-Regression AdvGAN

Latent Swap Joint Diffusion for 2D Long-Form Latent Generation

LIMO: Less is More for Reasoning

Implementing Large Quantum Boltzmann Machines as Generative AI Models for Dataset Balancing

A Survey on Memory-Efficient Transformer-Based Model Training in AI for Science

Breaking Memory Limits: Gradient Wavelet Transform Enhances LLMs Training

Back Home: A Computer Vision Solution to Seashell Identification for Ecological Restoration

DIVE: Taming DINO for Subject-Driven Video Editing

AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning

Puzzle Similarity: A Perceptually-guided Cross-Reference Metric for Artifact Detection in 3D Scene Reconstructions

Receding Hamiltonian-Informed Optimal Neural Control and State Estimation for Closed-Loop Dynamical Systems

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation

Recovering Manifold Structure Using Ollivier-Ricci Curvature

Simulated patient systems are intelligent when powered by large language model-based AI agents

GSON: A Group-based Social Navigation Framework with Large Multimodal Model

Task Arithmetic for Language Expansion in Speech Translation

Geometric Algebra Meets Large Language Models: Instruction-Based Transformations of Separate Meshes in 3D, Interactive and Controllable Scenes

Latent Adversarial Training Improves Robustness to Persistent Harmful Behaviors in LLMs

IRASim: A Fine-Grained World Model for Robot Manipulation

MALLM-GAN: Multi-Agent Large Language Model as Generative Adversarial Network for Synthesizing Tabular Data

Long-Term Fairness Inquiries and Pursuits in Machine Learning: A Survey of Notions, Methods, and Challenges

Online Concurrent Multi-Robot Coverage Path Planning

The pitfalls of next-token prediction

Adversarial attacks and defenses in explainable artificial intelligence: A survey

Demystifying Misconceptions in Social Bots Research

A Multi-Agent System Enables Versatile Information Extraction from the Chemical Literature

What Does 'Human-Centred AI' Mean?

Illuminating the Three Dogmas of Reinforcement Learning under Evolutionary Light

Enhancing Student Learning with LLM-Generated Retrieval Practice Questions: An Empirical Study in Data Science Courses

SLR: Automated Synthesis for Scalable Logical Reasoning

Towards Reliable Proof Generation with LLMs: A Neuro-Symbolic Approach

2D-Curri-DPO: Two-Dimensional Curriculum Learning for Direct Preference Optimization

An Algebraic Approach to Moralisation and Triangulation of Probabilistic Graphical Models

SAKE: Steering Activations for Knowledge Editing

Intrinsic Barriers and Practical Pathways for Human-AI Alignment: An Agreement-Based Complexity Analysis

A Scalable Approach to Probabilistic Neuro-Symbolic Robustness Verification

Ensuring Medical AI Safety: Interpretability-Driven Detection and Mitigation of Spurious Model Behavior and Associated Data

Strategist: Self-improvement of LLM Decision Making via Bi-Level Tree Search

A finite time analysis of distributed Q-learning

Foundation Models for Demand Forecasting via Dual-Strategy Ensembling

Supervised Quantum Image Processing

Secure Tug-of-War (SecTOW): Iterative Defense-Attack Training with Reinforcement Learning for Multimodal Model Security

ReXGroundingCT: A 3D Chest CT Dataset for Segmentation of Findings from Free-Text Reports

XAI for Point Cloud Data using Perturbations based on Meaningful Segmentation

Exploring the Stratified Space Structure of an RL Game with the Volume Growth Transform

Bridging Synthetic and Real-World Domains: A Human-in-the-Loop Weakly-Supervised Framework for Industrial Toxic Emission Segmentation

Staining and locking computer vision models without retraining

Teach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation

ChemDFM-R: An Chemical Reasoner LLM Enhanced with Atomized Chemical Knowledge

Fine-Tuning Code Language Models to Detect Cross-Language Bugs

MapAgent: Trajectory-Constructed Memory-Augmented Planning for Mobile Task Automation

Response Wide Shut? Surprising Observations in Basic Vision Language Model Capabilities

Created by

Haebom

저자

Shivam Chandhok, Wan-Cyuan Fan, Vered Shwartz, Vineeth N Balasubramanian, Leonid Sigal

개요

본 논문은 최첨단 비전-언어 모델(VLMs)의 기본적인 시각적 이해 능력 부족 문제를 다룹니다. 기존 성능 벤치마크를 넘어, 시각 인코더, 중간 비전-언어 투영, 그리고 LLM 디코더 출력에서 얻은 특징들을 직접 훈련한 프로브와 VLMs의 성능을 비교 분석하여 VLMs의 한계를 밝히고, 시각 정보 처리 방식, 강건성 및 능력에 대한 중요한 관찰 결과를 제시합니다. 이는 VLMs의 향상을 위한 발전 방향을 제시하는 것을 목표로 합니다.

시사점, 한계점

•

시사점: VLMs의 시각 정보 처리 과정에 대한 심층적인 이해를 제공하여, 모델 개선을 위한 구체적인 방향을 제시합니다. 기존 벤치마크를 뛰어넘는 분석 방식을 통해 VLMs의 강점과 약점을 명확하게 드러냅니다.

•

한계점: 본 논문에서 제시된 테스트는 특정한 기본 시각 과제에 국한될 수 있으며, 모든 VLMs의 한계를 일반화하기에는 추가적인 연구가 필요합니다. 또한, 프로브 훈련 방식의 특성이 결과에 영향을 미칠 수 있습니다.

Made with Slashpage