TrajViViT: A Trajectory Video Vision Transformer Network for Trajectory Forecasting
(2024) 13th International Conference on Pattern Recognition Applications and Methods ICPRAM - Volume 1 — Location: Rome, Italy (24.February.2024)
Files
123720.pdf
Open Access - Adobe PDF
- 334.75 KB
Details
- Authors
- Abstract
- Forecasting trajectory is a complex task relying on the accuracy of past positions, a correct model of the agent’s motion and an understanding of the social context, which are often challenging to acquire. Deep Neural Networks (DNNs), especially Transformer networks (TFs), have recently evolved as state-of-the-art tools in tackling these challenges. This paper presents TrajViViT (Trajectory Video Vision Transformer), a novel multimodal Transformer Network combining images of the scene and positional information. We show that such approach enhances the accuracy of trajectory forecasting and improves the network’s robustness against inconsistencies and noise in positional data. Our contributions are the design and comprehensive implementation of TrajViViT. A public Github repository will be provided.
- Affiliations
Citations
Rotsart de Hertaing, G., Manjah, D., & Macq, B. (2024). TrajViViT: A Trajectory Video Vision Transformer Network for Trajectory Forecasting. Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods ICPRAM - Volume 1. Published. 13th International Conference on Pattern Recognition Applications and Methods ICPRAM - Volume 1, Rome, Italy. https://doi.org/10.5220/0012372000003654