Talking Papers Podcast

Cristian Rodriguez-Opazo - DORi

January 05, 2022 Itzik Ben-Shabat Season 1 Episode 1
Talking Papers Podcast
Cristian Rodriguez-Opazo - DORi
Show Notes Chapter Markers

Paper title:
"DORi: Discovering Object Relationships for Moment Localization of a Natural Language Query in a Video"

Authors:  Cristian Rodriguez-Opazo, Edison Marrese-Taylor, Basura Fernando, Hongdong Li, Stephen Gould

This paper studies the task of temporal moment localization in a long untrimmed video using natural language query. Given a query sentence, the goal is to determine the start and end of the relevant segment within the video. Our key innovation is to learn a video feature embedding through a language-conditioned message-passing algorithm suitable for temporal moment localization which captures the relationships between humans, objects and activities in the video. These relationships are obtained by a spatial subgraph that contextualized the scene representation using detected objects and human features. Moreover, a temporal sub-graph captures the activities within the video through time. Our method is evaluated on three standard benchmark datasets, and we also introduce YouCook II as a new benchmark for this task. Experiments show our method outperforms state-of-the-art methods on these datasets, confirming the effectiveness of our approach

Cristian's page:


Related papers:
"Proposal free temporal moment localization" :
"Action Genome: Actions As Compositions of Spatio-Temporal Scene Graphs" :

Subscribe to the podcast:
Subscribe to our mailing list:
Follow us on Twitter:
YouTube Channel:

If you would like to be a guest, sponsor or just share your thoughts, feel free to reach out via email:

Recorded on March, 26th 2021.

🎧Subscribe on your favourite podcast app:

📧Subscribe to our mailing list:

🐦Follow us on Twitter:

🎥YouTube Channel:

Related Work
Conclusions and future work
What did reviewer 2 say?