Reasoning

Manling Li, Sha Li, Zhenhailong Wang, Lifu Huang, Kyunghyun Cho, Heng Ji, Jiawei Han
- Can input partially instantiated graphs to ``grow’’ the graph either forward or backward in time to predict missing events, arguments or relations, both from the past and in the future
- A different perspective, Models as Schemas, to output probabilistic schema models that can be probed on demand for event prediction
- A complicated graph including temporal dynamics and multiple paths involving entities that play important roles in a cohesive narrative - The first to capture event temporal dynamics probabilistically and perform global inference for event prediction

Manling Li, Qi Zeng, Ying Lin, Kyunghyun Cho, Heng Ji, Jonathan May, Nathanael Chambers, Clare Voss
- An auto-regressive language model trained on event-event paths, select paths showing how one event walks to another through entities
- Launchs a new step towards deep understanding

Zhenhailong Wang*, Manling Li*, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji (* denotes equal contribution)
- Starts a new paradigm of leveraging langauge models to understand videos