Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

TransLLM: A Unified Multi-Task Foundation Framework for Urban Transportation via Learnable Prompting

Created by
  • Haebom

Author

Jiaming Leng, Yunying Bi, Chuan Qin, Bing Yin, Yanyong Zhang, Chao Wang

Outline

This paper proposes TransLLM, an integrated framework that combines spatiotemporal modeling and a large-scale language model (LLM) to address diverse challenges in urban transportation systems, including traffic prediction, electric vehicle charging demand forecasting, and taxi dispatching. TransLLM captures complex dependencies through a lightweight spatiotemporal encoder and seamlessly interacts with the LLM through learnable prompt construction. An instance-level prompt routing mechanism trained via reinforcement learning dynamically personalizes prompts based on input characteristics. It encodes spatiotemporal patterns as contextual representations, constructs personalized prompts to guide LLM inference, and generates task-specific predictions through a specialized output layer. Experimental results on seven datasets and three tasks demonstrate that TransLLM performs competitively in both supervised and zero-shot settings, demonstrating excellent generalization and cross-task adaptability.

Takeaways, Limitations

Takeaways:
It overcomes the limitations of existing task-specific models and presents an integrated solution to various urban transportation problems.
By effectively combining spatiotemporal data with LLM, we leverage the strengths of LLM to address urban transportation issues.
Improve model performance and generalization ability through learnable prompt configuration and reinforcement learning-based prompt routing mechanism.
It shows excellent performance even in zero-shot settings, alleviating data shortage issues.
Limitations:
There may be a lack of analysis of the interactions between factors that contribute to the performance improvement of the proposed model.
Further in-depth evaluation of generalization performance across diverse urban environments and transportation systems is needed.
Further research is needed on scalability and real-time processing performance for application to real systems.
A more detailed analysis may be required to determine how the characteristics of the dataset used affect the model's performance.
👍