Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published March 20, 2018 | Published
Conference Paper Open

Generating Multi-Agent Trajectories using Programmatic Weak Supervision

Abstract

We study the problem of training sequential generative models for capturing coordinated multi-agent trajectory behavior, such as offensive basketball gameplay. When modeling such settings, it is often beneficial to design hierarchical models that can capture long-term coordination using intermediate variables. Furthermore, these intermediate variables should capture interesting high-level behavioral semantics in an interpretable and manipulable way. We present a hierarchical framework that can effectively learn such sequential generative models. Our approach is inspired by recent work on leveraging programmatically produced weak labels, which we extend to the spatiotemporal regime. In addition to synthetic settings, we show how to instantiate our framework to effectively model complex interactions between basketball players and generate realistic multi-agent trajectories of basketball gameplay over long time periods. We validate our approach using both quantitative and qualitative evaluations, including a user study comparison conducted with professional sports analysts.

Additional Information

This research is supported in part by NSF #1564330, NSF #1637598, and gifts from Bloomberg, Activision/Blizzard and Northrop Grumman. Dataset was provided by STATS: https://www.stats.com/data-science/. Code is available at https://github.com/ezhan94/multiagent-programmatic-supervision

Attached Files

Published - 1803.07612.pdf

Files

1803.07612.pdf
Files (3.0 MB)
Name Size Download all
md5:d55fc7121725154db20ac8cf978abe33
3.0 MB Preview Download

Additional details

Created:
August 19, 2023
Modified:
October 20, 2023