Fred Hohman
/ CSE Ph.D. Student at GT

Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers

Fred Hohman, Minsuk Kahng, Robert Pienta, Duen Horng Chau

A visual overview and illustration of our interrogative survey, and how each of the six questions, "Why, Who, What, How, When, and Where," relate to one another. Each question corresponds to one section of the paper, indicated by the labelled tag, near each question title. Each section lists the major subsections identified and discussed from the survey.

Abstract

Deep learning has recently seen rapid development and significant attention due to its state-of-the-art performance on previously-thought hard problems. However, because of the innate complexity and nonlinear structure of deep neural networks, the underlying decision making processes for why these models are achieving such high performance are challenging and sometimes mystifying to interpret. As deep learning spreads across domains, it is of paramount importance that we equip users of deep learning with tools for understanding when a model works correctly, when it fails, and ultimately how to improve its performance. Standardized toolkits for building neural networks have helped democratize deep learning; visual analytics systems have now been developed to support model explanation, interpretation, debugging, and improvement. We present a survey of the role of visual analytics in deep learning research, noting its short yet impactful history and summarize the state-of-the-art using a human-centered interrogative framework, focusing on the Five W’s and How (Why, Who, What, How, When, and Where), to thoroughly summarize deep learning visual analytics research. We conclude by highlighting research directions and open research problems. This survey helps new researchers and practitioners in both visual analytics and deep learning to quickly learn key aspects of this young and rapidly growing body of research, whose impact spans a diverse range of domains.

Materials

PDF | BibTeX

Citation

Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers
Fred Hohman, Minsuk Kahng, Robert Pienta, Duen Horng Chau
arXiv:1801.06889. Jan 21, 2018.
PDF | BibTeX

BibTeX

@article{hohman2017visual,
  title={Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers},
  author={Hohman, Fred and Kahng, Minsuk and Pienta, Robert and Chau, Duen Horng},
  journal={arXiv preprint arXiv:1801.06889},
  year={2018}
}