Macknik Lab

Our eyes move continually, even while we fixate our gaze on an object. If fixational eye movements are counteracted, our perception of stationary objects fades completely, due to neural adaptation.Some studies have suggested that fixational microsaccades refresh retinal images, thereby preventing adaptation and fading. However, other studies disagree, and so the role of microsaccades remains unclear. Here, we correlate visibility during fixation to the occurrence of microsaccades. We asked subjects to indicate when Troxler fading of a peripheral target occurs, while simultaneously recording their eye movements with high precision. We found that before a fading period, the probability, rate, and magnitude of microsaccades decreased. Before transitions toward visibility, the probability, rate, and magnitude of microsaccades increased. These results reveal a direct link between suppression of microsaccades and fading and suggest a causal relationship between microsaccade production and target visibility during fixation.

In visual masking, visible targets are rendered invisible by modifying the context in which they are presented, but not by modifying the targets themselves. Here, we localize the neuronal correlates of visual awareness in the human brain by using visual masking illusions. We compare monoptic visual masking activation, which we find within all retinotopic visual areas, with dichoptic masking activation, which we find only in those retinotopic areas downstream of V2. Because monoptic and dichoptic masking are equivalent in magnitude perceptually, the present results establish a lower bound for maintenance of visual awareness of simple unattended targets. Moreover, we find that awareness correlated circuits for simple targets are restricted to the occipital lobe. This finding provides evidence of an upper boundary in the visual hierarchy for visual awareness of simple unattended targets, thus constraining the location of circuits that maintain the visibility of simple targets to occipital areas beyond V1/V2

Vasarely's 'nested-squares' illusion shows that 90° corners can be more salient perceptually than straight edges. On the basis of this illusion we have developed a novel visual illusion, the 'Alternating Brightness Star', which shows that sharp corners are more salient than shallow corners (an effect we call 'corner angle salience variation') and that the same corner can be perceived as either bright or dark depending on the polarity of the angle (ie whether concave or convex: 'corner angle brightness reversal'). Here we quantify the perception of corner angle salience variation and corner angle brightness reversal effects in twelve naive human subjects, in a two-alternative forced-choice brightness discrimination task. The results show that sharp corners generate stronger percepts than shallow corners, and that corner gradients appear bright or dark depending on whether the corner is concave or convex. Basic computational models of center surround receptive fields predict the results to some degree, but not fully.

Brain mapping techniques have come a long way since the first explorations with surface electrodes. This study examines some of the new electrophysiological and imaging techniques that have been developed in response to the demands of brain mapping. Our laboratory combines several of these techniques, including single-unit recording, fMRI, optical imaging, and in vivo two-photon microscopy, to map cortical circuits with high-resolution and in three dimensions. Long-term goals of this research include the development of novel microscopic imaging methods to help diagnose and treat diseases of the human cerebral cortex.

Visual masking effects are illusions in which a target is rendered invisible by a mask, which can either overlap or not overlap the target spatially and/or temporally. These illusions provide a powerful tool to study visibility and consciousness, object grouping, brightness perception, and much more. As such, the physiological mechanisms underlying the perception of masking are critically important to our understanding of visibility. Several models that require cortical circuits have been proposed previously to explain the mysterious spatial and timing effects associated with visual masking. Here we describe single-unit physiological experiments from the awake monkey that show that visual masking occurs in at least two separate and independent circuits, one that is binocular and one that is monocular (possibly even subcortical), without feedback from higher-level visual brain areas. These and other results together fail to support models of masking that require circuits found only in the cortex, but support our proposed model that suggests that simple ubiquitous lateral inhibition may itself be the fundamental mechanism that explains visual masking across multiple levels in the brain. We also show that area V1 neurons are dichoptic in terms of excitation, but monoptic in terms of inhibition. That is, responses within area V1 binocular neurons reveal that excitation to monocular targets is inhibited strongly only by masks presented to the same eye, and not by masks presented to the opposite eye. These results lead us to redefine the model for the first stage of binocular processing in the visual system, and may be crucial to interpreting the effects of other similar binocular and dichoptic stimulation paradigms, such as the binocular rivalry family of illusions.

The response dynamics of neurons in the visual pathway are driven, in part, by the dynamics of lateral inhibitory networks. Illusions of invisibility, such as the visual masking illusions, in addition to the dynamics of visibility itself, can be explained by the actions of such networks. Here we provide a descriptive model of a lateral inhibitory network in space and time. We provide physiological evidence that neurons in the early visual system of primates respond in a fashion predicted by these temporal dynamics. Furthermore, we discuss how the network predicts the existence of novel visual illusions and their physiological correlates.

Our eyes continually move even while we fix our gaze on an object. Although these fixational eye movements have a magnitude that should make them visible to us, we are unaware of them. If fixational eye movements are counteracted, our visual perception fades completely as a result of neural adaptation. So, our visual system has a built-in paradox — we must fix our gaze to inspect the minute details of our world, but if we were to fixate perfectly, the entire world would fade from view. Owing to their role in counteracting adaptation, fixational eye movements have been studied to elucidate how the brain makes our environment visible. Moreover, because we are not aware of these eye movements, they have been studied to understand the underpinnings of visual awareness. Recent studies of fixational eye movements have focused on determining how visible perception is encoded by neurons in various visual areas of the brain.

When images are stabilized on the retina, visual perception fades. During voluntary visual fixation, however, constantly occurring small eye movements, including microsaccades, prevent this fading. We previously showed that microsaccades generated bursty firing in the primary visual cortex (area V-1) in the presence of stationary stimuli. Here we examine the neural activity generated by microsaccades in the lateral geniculate nucleus (LGN), and in the area V-1 of the awake monkey, for various functionally relevant stimulus parameters. During visual fixation, microsaccades drove LGN neurons by moving their receptive fields across a stationary stimulus, offering a likely explanation of how microsaccades block fading during normal fixation. Bursts of spikes in the LGN and area V-1 were associated more closely than lone spikes with preceding microsaccades, suggesting that bursts are more reliable than are lone spikes as neural signals for visibility. In area V-1, microsaccadegenerated activity, and the number of spikes per burst, was maximal when the bar stimulus centered over a receptive field matched the cell’s optimal orientation. This suggested burst size as a neural code for stimuli optimality (and not solely stimuli visibility). As expected, burst size did not vary with stimulus orientation in the LGN. To address the effectiveness of microsaccades in generating neural activity, we compared activity correlated with microsaccades to activity correlated with flashing bars. Onset responses to flashes were about 7 times larger than the responses to the same stimulus moved across the cells’ receptive fields by microsaccades, perhaps because of the relative abruptness of flashes.

What parts of a visual stimulus produce the greatest neural signal? Previous studies have explored this question and found that the onset of a stimulus’s edge is what excites early visual neurons most strongly. The role of inhibition at the edges of stimuli has remained less clear, however, and the importance of neural responses associated with the termination of stimuli has only recently been examined. Understanding all of these spatiotemporal parameters (the excitation and inhibition evoked by the stimulus’s onset and termination, as well as its spatial edges) is crucial if we are to develop a general principle concerning the relationship between neural signals and the parts of the stimulus that generate them. Here, we use visual masking illusions to explore this issue, in combination with human psychophysics, awake behaving primate neurophysiology in the lateral geniculate nucleus of the thalamus, and optical recording in the primary visual cortex of anesthetized monkeys. The edges of the stimulus, rather than its interior, generate the strongest excitatory and inhibitory responses both perceptually and physiologically. These edges can be imaged directly by using optical recording techniques. Excitation and inhibition are moreover most powerful when the stimulus turns both on and off (what might be thought of as the stimulus’s temporal edges). We thus conclude that there is a general principle that relates the generation of neural signals (excitatory and inhibitory) to the spatiotemporal edges of stimuli in the early visual system.

When viewing a stationary object, we unconsciously make small, involuntary eye movements or ‘microsaccades’. If displacements of the retinal image are prevented, the image quickly fades from perception. To understand how microsaccades sustain perception, we studied their relationship to the firing of cells in primary visual cortex (V1). We tracked eye movements and recorded from V1 cells as macaque monkeys fixated. When an optimally oriented line was centered over a cell’s receptive field, activity increased after microsaccades. Moreover, microsaccades were better correlated with bursts of spikes than with either single spikes or instantaneous firing rate. These findings may help explain maintenance of perception during normal visual fixation.

We optically imaged a visual masking illusion in primary visual cortex (area V-1) of rhesus monkeys to ask whether activity in the early visual system more closely reflects the physical stimulus or the generated percept. Visual illusions can be a powerful way to address this question because they have the benefit of dissociating the stimulus from perception. We used an illusion in which a flickering target (a bar oriented in visual space) is rendered invisible by two counter-phase flickering bars, called masks, which flank and abut the target. The target and masks, when shown separately, each generated correlated activity on the surface of the cortex. During the illusory condition, however, optical signals generated in the cortex by the target disappeared although the image of the masks persisted. The optical image thus was correlated with perception but not with the physical stimulus.

A brief visual target stimulus may be rendered invisible if it is immediately preceded or followed by another stimulus. This class of illusions, known as visual masking, may allow insights into the neural mechanisms that underlie visual perception. We have therefore explored the temporal characteristics of masking illusions in humans, and compared them with corresponding neuronal responses in the primary visual cortex of awake and anesthetized monkeys. Stimulus parameters that in humans produce forward masking (in which the mask precedes the target) suppress the transient on-response to the target in monkey visual cortex. Those that produce backward masking (in which the mask comes after the target) inhibit the transient after-discharge, the excitatory response that occurs just after the disappearance of the target. These results suggest that, for targets that can be masked (those of short duration), the transient neuronal responses associated with onset and turning off of the target may be important in its visibility.