Fred Hohman

A Viz of Ice and Fire: Exploring Entertainment Video Using Color and Dialogue

2nd Workshop on Visualization for the Digital Humanities at IEEE VIS (VIS4DH), 2017

Abstract

Films and television shows provide a rich source of cultural data and form an integral part of modern life. However, the video medium remains difficult to analyze at scale effectively and its study has generally attracted limited research attention. We propose a method of summarizing the audio and visual aspects of entertainment videos, through the automatic extraction of dominant colors from video frames and textual categories from dialogue. The colors and dialogue are displayed in a visualization that allows the user to explore the video, highlighting both high-level and low-level patterns from the data. Focusing on the hit television series Game of Thrones, we show how our visualization supports the detection of scene changes and plot points, providing a new perspective for both scholars and casual viewers.

Materials

Project
Demo
PDF
Slides
Code
Data

BibTeX

			
@article{hohman2017got,
    title={A Viz of Ice and Fire: Exploring Entertainment Video Using Color and Dialogue},
    author={Hohman, Fred and Soni, Sandeep and Stewart, Ian and Stasko, John}
    journal={Proceedings of the 2nd Workshop on Visualization for the Digital Humanities (VIS4DH) at IEEE VIS},
    year={2017},
    publisher={IEEE},
    url={https://fredhohman.com/a-viz-of-ice-and-fire/}
}