Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

End-to-End Text-to-SQL with Dataset Selection: Leveraging LLMs for Adaptive Query Generation

Fourier-VLM: Compressing Vision Tokens in the Frequency Domain for Large Vision-Language Models

LAG: Logic-Augmented Generation from a Cartesian Perspective

Echo: Decoupling Inference and Training for Large-Scale RL Alignment on Heterogeneous Swarms

FDC-Net: Rethinking the association between EEG artifact removal and multi-dimensional affective computing

Fairness in Dysarthric Speech Synthesis: Understanding Intrinsic Bias in Dysarthric Speech Cloning using F5-TTS

RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory

DS$^2$Net: Detail-Semantic Deep Supervision Network for Medical Image Segmentation

LLMDistill4Ads: Using Cross-Encoders to Distill from LLM Signals for Advertiser Keyphrase Recommendations at eBay

When Cars Have Stereotypes: Auditing Demographic Bias in Objects from Text-to-Image Models

HiTeC: Hierarchical Contrastive Learning on Text-Attributed Hypergraph with Semantic-Aware Augmentation

SpectrumFM: Redefining Spectrum Cognition via Foundation Modeling

Dynamic Robot-Assisted Surgery with Hierarchical Class-Incremental Semantic Segmentation

A novel language model for predicting serious adverse event results in clinical trials from their prospective registrations

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model

aLLoyM: A large language model for alloy phase diagram prediction

Learning Phonetic Context-Dependent Viseme for Enhancing Speech-Driven 3D Facial Animation

Are Vision Foundation Models Ready for Out-of-the-Box Medical Image Registration?

SystolicAttention: Fusing FlashAttention within a Single Systolic Array

RAPNet: A Receptive-Field Adaptive Convolutional Neural Network for Pansharpening

AMix-1: A Pathway to Test-Time Scalable Protein Foundation Model

Bridging the Last Mile of Prediction: Enhancing Time Series Forecasting with Conditional Guided Flow Matching

Speckle2Self: Self-Supervised Ultrasound Speckle Reduction Without Clean Data

LIRA: Inferring Segmentation in Large Multi-modal Models with Local Interleaved Region Assistance

Addressing The Devastating Effects Of Single-Task Data Poisoning In Exemplar-Free Continual Learning

Foundation versus Domain-specific Models: Performance Comparison, Fusion, and Explainability in Face Recognition

Probabilistic Optimality for Inference-time Scaling

ARAG: Agentic Retrieval Augmented Generation for Personalized Recommendation

Exploring Adapter Design Tradeoffs for Low Resource Music Generation

CycleDistill: Bootstrapping Machine Translation using LLMs with Cyclical Distillation

Robust Anomaly Detection in Network Traffic: Evaluating Machine Learning Models on CICIDS2017

Robust Behavior Cloning Via Global Lipschitz Regularization

Granular-Ball-Induced Multiple Kernel K-Means

DRAMA-X: A Fine-grained Intent Prediction and Risk Reasoning Benchmark For Driving

MMET: A Multi-Input and Multi-Scale Transformer for Efficient PDEs Solving

A Two-stage Optimization Method for Wide-range Single-electron Quantum Magnetic Sensing

Physics-Informed Teleconnection-Aware Transformer for Global Subseasonal-to-Seasonal Forecasting

AI-Generated Compromises for Coalition Formation

MLOps with Microservices: A Case Study on the Maritime Domain

Winner-takes-all for Multivariate Probabilistic Time Series Forecasting

Leaps Beyond the Seen: Reinforced Reasoning Augmented Generation for Clinical Notes

Learning to Diagnose Privately: DP-Powered LLMs for Radiology Report Classification

HERGC: Heterogeneous Experts Representation and Generative Completion for Multimodal Knowledge Graphs

Verbal Werewolf: Engage Users with Verbalized Agentic Werewolf Game Framework

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection

CADRE: Customizable Assurance of Data Readiness in Privacy-Preserving Federated Learning

FP4 All the Way: Fully Quantized Training of LLMs

Improving LLM Outputs Against Jailbreak Attacks with Expert Model Integration

Extracting Probabilistic Knowledge from Large Language Models for Bayesian Network Parameterization

RIDGECUT: Learning Graph Partitioning with Rings and Wedges

Uniform Loss vs. Specialized Optimization: A Comparative Analysis in Multi-Task Learning

Can LLM-based Financial Investing Strategies Outperform the Market in Long Run?

A Multimodal Deep Learning Approach for White Matter Shape Prediction in Diffusion MRI Tractography

Sparsity Outperforms Low-Rank Projections in Few-Shot Adaptation

Bidirectional Hierarchical Protein Multi-Modal Representation Learning

How Post-Training Reshapes LLMs: A Mechanistic View on Knowledge, Truthfulness, Refusal, and Confidence

$\mu$KE: Matryoshka Unstructured Knowledge Editing of Large Language Models

Learning 3D-Gaussian Simulators from RGB Videos

Learning Adaptive Dexterous Grasping from Single Demonstrations

A Theory of Learning with Autoregressive Chain of Thought

FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interaction

From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers

ElementaryNet: A Non-Strategic Neural Network for Predicting Human Behavior in Normal-Form Games

Collective Reasoning Among LLMs: A Framework for Answer Validation Without Ground Truth

Advancing AI-Powered Medical Image Synthesis: Insights from MedVQA-GI Challenge Using CLIP, Fine-Tuned Stable Diffusion, and Dream-Booth + LoRA

Predicting Depression in Screening Interviews from Interactive Multi-Theme Collaboration

Schema-Guided Scene-Graph Reasoning based on Multi-Agent Large Language Model System

MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization

Mitigating Traffic Oscillations in Mixed Traffic Flow with Scalable Deep Koopman Predictive Control

Improving Your Model Ranking on Chatbot Arena by Vote Rigging

FIT-Print: Towards False-claim-resistant Model Ownership Verification via Targeted Fingerprint

Softplus Attention with Re-weighting Boosts Length Extrapolation in Large Language Models

Ehrenfeucht-Haussler Rank and Chain of Thought

WebWalker: Benchmarking LLMs in Web Traversal

Generative AI for Cel-Animation: A Survey

Toward Intelligent and Secure Cloud: Large Language Model Empowered Proactive Defense

MomentMix Augmentation with Length-Aware DETR for Temporally Robust Moment Retrieval

POEX: Towards Policy Executable Jailbreak Attacks Against the LLM-based Robots

B-VLLM: A Vision Large Language Model with Balanced Spatio-Temporal Tokens

LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation

Understanding and Mitigating Memorization in Generative Models via Sharpness of Probability Landscapes

Steering AI-Driven Personalization of Scientific Text for General Audiences

Zero-Shot Voice Conversion via Content-Aware Timbre Ensemble and Conditional Flow Matching

EfficientEQA: An Efficient Approach to Open-Vocabulary Embodied Question Answering

UoMo: A Universal Model of Mobile Traffic Forecasting for Wireless Network Optimization

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection

Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation

A Closer Look at Machine Unlearning for Large Language Models

In-Situ Fine-Tuning of Wildlife Models in IoT-Enabled Camera Traps for Efficient Adaptation

EEG-Language Pretraining for Highly Label-Efficient Clinical Phenotyping

A Practice of Post-Training on Llama-3 70B with Optimal Selection of Additional Language Mixture Ratio

Reward-Directed Score-Based Diffusion Models via q-Learning

Chain of Thought Still Thinks Fast: APriCoT Helps with Thinking Slow

A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning

AI-AI Bias: large language models favor communications generated by large language models

LVBench: An Extreme Long Video Understanding Benchmark

From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks

Fractured Glass, Failing Cameras: Simulating Physics-Based Adversarial Samples for Autonomous Driving Systems

Runtime Monitoring and Enforcement of Conditional Fairness in Generative AIs

On the Sample Efficiency of Abstractions and Potential-Based Reward Shaping in Reinforcement Learning

B-VLLM: A Vision Large Language Model with Balanced Spatio-Temporal Tokens

Created by

Haebom

저자

Zhuqiang Lu, Zhenfei Yin, Mengwei He, Zhihui Wang, Zicheng Liu, Zhiyong Wang, Kun Hu

개요

본 논문은 비전 대규모 언어 모델(VLLM)을 이용한 장시간 영상 이해의 어려움을 해결하기 위해, 텍스트 조건부 적응적 프레임 선택 모듈과 시간적 프레임 토큰 병합 기법, 공간적 토큰 샘플링 모듈 및 병합 전략을 활용한 Balanced-VLLM (B-VLLM) 프레임워크를 제시합니다. 기존 VLLM들이 영상 다운샘플링 또는 각 프레임의 시각 토큰 수 감소로 인해 시간적 또는 공간적 정보 손실이 발생하는 문제점을 해결하고자, 과제 관련 시공간적 단서를 효과적으로 활용하면서 VLLM의 컨텍스트 창 길이 내에서 시각 토큰 수를 제한하는 방법을 제안합니다. 실험 결과, B-VLLM이 다양한 영상 이해 벤치마크에서 우수한 성능을 보임을 확인했습니다.

시사점, 한계점

•

시사점:

◦

VLLM 기반 장시간 영상 이해의 효율성을 크게 향상시켰습니다.

◦

텍스트 조건부 적응적 프레임 선택 및 토큰 병합 전략을 통해 과제 관련 정보 손실을 최소화했습니다.

◦

다양한 영상 이해 벤치마크에서 기존 방법보다 우수한 성능을 달성했습니다.

◦

공개된 코드를 통해 재현성을 높였습니다.

•

한계점:

◦

제안된 방법의 계산 복잡도에 대한 자세한 분석이 부족합니다.

◦

특정 유형의 영상 데이터에 대한 성능 편향 가능성이 존재합니다.

◦

더욱 다양하고 복잡한 영상 이해 과제에 대한 추가적인 실험이 필요합니다.

Made with Slashpage