Data-Driven Crowd Simulation with Generative Adversarial Networks

ABSTRACT

This paper presents a novel data-driven crowd simulation method that can mimic the observed traffic of pedestrians in a given environment. Given a set of observed trajectories, we use a recent form of neural networks, Generative Adversarial Networks (GANs), to learn the properties of this set and generate new trajectories with similar properties. We define a way for simulated pedestrians (agents) to follow such a trajectory while handling local collision avoidance. As such, the system can generate a crowd that behaves similarly to observations, while still enabling real-time interactions between agents. Via experiments with real-world data, we show that our simulated trajectories preserve the statistical properties of their input. Our method simulates crowds in real time that resemble existing crowds, while also allowing insertion of extra agents, combination with other simulation methods, and user interaction.

References

1. Amirian, J., Hayet, J.-B., and Pettré, J. Social ways: Learning multi-modal distributions of pedestrian trajectories with GANs. In CVPR Workshops (2019).
2. van den Berg, J., Guy, S., Lin, M., and Manocha, D. Reciprocal n-body collision avoidance. In Proc. Int. Symp. Robotics Research (2011), pp. 3--19.
3. Di, X., and Patel, V. Face synthesis from visual attributes via sketch using conditional VAEs and GANs. CoRR abs/1801.00077 (2018).
4. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. Generative adversarial nets. In Proc. Int. Conf. Neural Information Processing Systems (2014), vol. 2, pp. 2672--2680.
5. Helbing, D., and Molnár, P. Social force model for pedestrian dynamics. Physical Review E 51, 5 (1995), 4282--4286.
6. Jaklin, N., Cook IV, A., and Geraerts, R. Real-time path planning in heterogeneous environments. Computer Animation and Virtual Worlds 24, 3 (2013), 285--295.
7. Lee, K., Choi, M., Hong, Q., and Lee, J. Group behavior from video: A data-driven approach to crowd simulation. In Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (2007), pp. 109--118.
8. Lerner, A., Chrysanthou, Y., and Lischinski, D. Crowds by example. Computer Graphics Forum 26, 3 (2007), 655--664.
9. Metz, L., Poole, B., Pfau, D., and Sohl-Dickstein, J. Unrolled generative adversarial networks. CoRR abs/1611.02163 (2017).
10. Pellegrini, S., Ess, A., Schindler, K., and van Gool, L. You'll never walk alone: Modeling social behavior for multi-target tracking. In Proc. IEEE Int. Conf. Computer Vision (2009), pp. 261--268.
11. Pellegrini, S., Gall, J., Sigal, L., and van Gool, L. Destination flow for crowd simulation. In Proc. European Conf. Computer Vision (2012), pp. 162--171.
12. van Toll, W., Jaklin, N., and Geraerts, R. Towards believable crowds: A generic multi-level framework for agent navigation. In ASCI.OPEN/ICT.OPEN (ASCI track) (2015).
13. Wang, H., Ondřej, J., and O'Sullivan, C. Path patterns: Analyzing and comparing real and simulated crowds. In Proc. 20th ACM SIGGRAPH Symp. Interactive 3D Graphics and Games (2016), pp. 49--57.
14. Wolinski, D., Guy, S., Olivier, A.-H., Lin, M., Manocha, D., and Pettré, J. Parameter estimation and comparative evaluation of crowd simulations. Computer Graphics Forum 33, 2 (2014), 303--312.
15. Yersin, B., Maïm, J., Pettré, J., and Thalmann, D. Crowd patches: Populating large-scale virtual environments for real-time applications. In Proc. Symp. Interactive 3D Graphics and Games (2009), pp. 207--214.
16. Zhong, J., Cai, W., Luo, L., and Zhao, M. Learning behavior patterns from video for agent-based crowd modeling and simulation. Autonomous Agents and Multi-Agent Systems 30, 5 (2016), 990--1019.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Control methods

      • Motion path planning

    • Distributed artificial intelligence

      • Intelligent agents

  • Machine learning

    • Machine learning approaches

      • Neural networks

  • Modeling and simulation

    • Simulation types and techniques

      • Real-time simulation