Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Long-Term Visual Object Tracking with Event Cameras: An Associative Memory Augmented Tracker and A Benchmark Dataset

Created by
  • Haebom

Author

Xiao Wang, Xufeng Lou, Shiao Wang, Ju Huang, Lan Chen, Bo Jiang

Outline

This paper addresses the limitations of evaluating existing event stream-based trackers on short-term tracking datasets and presents FELT, a novel, large-scale long-term tracking dataset that considers long-term tracking in real-world scenarios. FELT comprises 1,044 long-term videos, 1.9 million RGB frame and event stream pairs, 60 different target objects, and 14 challenging attributes. Furthermore, we retrain and evaluate 21 baseline trackers on the FELT dataset to establish a benchmark. Furthermore, we propose AMTTrack, an RGB-event long-term visual tracker based on the Associative Memory Transformer (AMT). AMTTrack follows a single-stream tracking framework, efficiently aggregates multi-scale RGB/event templates and search tokens via a Hopfield search layer, and maintains dynamic template representations via an associative memory update method to address the problem of appearance changes in long-term tracking. We validate the effectiveness of the proposed tracker through extensive experiments on the FELT, FE108, VisEvent, and COESOT datasets. The datasets and source code will be made publicly available.

Takeaways, Limitations

Takeaways:
We contribute to the advancement of long-term tracking research by presenting FELT, a large-scale long-term visual object tracking dataset that considers real-world scenarios.
We propose a new long-term tracking algorithm, AMTTrack, that effectively utilizes RGB-event information.
Validating the superiority of AMTTrack on various datasets.
Providing a new benchmark in long-term tracking.
Limitations:
Further review of the diversity and representativeness of the FELT dataset is needed.
Further analysis of AMTTrack's computational cost and real-time performance is needed.
More comprehensive comparative studies with other state-of-the-art long-term tracking algorithms are needed.
👍