How we draw and recognize things that don't exist

Abstract

How do we make sense of something weve never seen before? Classifying objects into superordinate classes like animal is a key step in interpreting novel experiences, but is challenging because radically different items (e.g., octopus, rabbit) must somehow be grouped together. In general, no single feature is shared by all members. We reasoned that to classify or imagine novel items from outside the distribution of previous experiences, observers parse objects into meaningful component features that they can mentally recombine ( compositionality). To test this, we asked participants to draw familiar and novel members of nine superordinate object classes. We then asked other participants to classify the drawings, and mark and label their defining parts. We find that human classification performance is well predicted by a Bayesian classifier that optimally combines the part labels, suggesting humans can create and classify out-of-distribution experiences through a compositional generative representation of object features.