Searching across working memory and perception

Abstract

Searching for objects of interest is an essential and pervasive activity in adaptive cognition. In everyday situations, we often search for relevant content in our surroundings and in mind at the same time, yet most experimental tasks consider search behavior in perception or in working memory separately. To address the gap, we designed tasks to investigate perceptual and working-memory search proceeding in tandem. Participants viewed successive arrays of two real-world objects, separated by a delay, and then were prompted to search for a specific object, while the second array remained visible. The probed target was equally likely to be in the previously encoded array, available only in working memory, or in the visible array. Behavioral performance across four experiments with different response demands and delays yielded a consistent pattern of findings. Accuracy was better for detecting perceptual targets than working-memory targets. However, search speed was equivalent for targets in both domains in all cases, suggesting parallel search functions co-existing across the two domains. The final experiment combined continuous color reproduction with eye tracking and neural recordings. Neural measures of posterior alpha lateralization, tracking the neural selection of working-memory and perceptual targets, suggested parallel search functions developing with similar time courses. Intriguingly, oculomotor gaze shifts showed a divergent pattern, with earlier gaze shifts associated with perceptual targets and later shifts with working-memory targets. Overall, the present studies establish a means for investigating search across working-memory and perceptual domains, suggest the co-existence of parallel search mechanisms, and invite new lines of enquiry.