Looking into working memory to verify potential targets during search

Abstract

Finding what you are looking for is a ubiquitous task in everyday life that relies on a two-way comparison between what is currently viewed and internal search goals held in memory. Yet, despite a wealth of studies tracking visual verification behavior among the external contents of perception, complementary processes associated with visual verification among internal contents of memory remain elusive. Building on a recently established gaze marker of internal visual focusing in working memory, we tracked the internal-inspection process associated with confirming or dismissing potential targets during search. We show how we look back into memory when faced with external stimuli that are perceived as potential targets and link such internal inspection to the time required for visual verification. A direct comparison between visual verification among the contents of working memory or perception further revealed how verification in both domains engages frontal theta activity in scalp EEG, but also how mnemonic verification is slower to deploy than perceptual verification. This establishes internal verification behavior as an integral component of visual search, and provides new ways to look into this underexplored component of human search behavior.