In this presentation, I will discuss the challenge of forecasting pedestrian trajectories in shared urban traffic environments using non-invasive sensor modalities in both autonomous vehicles and smart infrastructure domains. I will also show how proposed innovative AI based framework could help in overcoming some of those challenges.