Toddler-Inspired Visual Object Learning

S Bambach, D J Crandall, L B Smith, C Yu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)
8 Downloads (Pure)

Abstract

Real-world learning systems have practical limitations on the quality and quantity of the training datasets that they can collect and consider. How should a system go about choosing a subset of the possible training examples that still allows for learning accurate, generalizable models? To help address this question, we draw inspiration from a highly efficient practical learning system: the human child. Using head-mounted cameras, eye gaze trackers, and a model of foveated vision, we collected first-person (egocentric) images that represents a highly accurate approximation of the "training data" that toddlers' visual systems collect in everyday, naturalistic learning contexts. We used state-of-the-art computer vision learning models (convolutional neural networks) to help characterize the structure of these data, and found that child data produce significantly better object models than egocentric data experienced by adults in exactly the same environment. By using the CNNs as a modeling tool to investigate the properties of the child data that may enable this rapid learning, we found that child data exhibit a unique combination of quality and diversity, with not only many similar large, high-quality object views but also a greater number and diversity of rare views. This novel methodology of analyzing the visual "training data" used by children may not only reveal insights to improve machine learning, but also may suggest new experimental tools to better understand infant learning in developmental psychology.
Original languageEnglish
Title of host publicationAdvances in Neural Information Processing Systems
PublisherNeural Information Processing Systems Foundation
Volume31
Publication statusE-pub ahead of print - 2018
EventNeural Information Processing Systems Conference - Palais des Congrès de Montréal, Montréal, Canada
Duration: 2 Dec 20188 Dec 2018
https://nips.cc/

Conference

ConferenceNeural Information Processing Systems Conference
Abbreviated titleNIPS 2018
CountryCanada
CityMontréal
Period2/12/188/12/18
Internet address

Cite this