Neuropsychologia 41 (2003) 1717–1727
Neuronal mechanisms for detection of motion in the field of view Claudio Galletti∗ , Patrizia Fattori Dipartimento di Fisiologia Umana e Generale, Università di Bologna, I-40127 Bologna, Italy Received 6 March 2003; accepted 20 June 2003
Abstract The visual system cannot rely only upon information from the retina to perceive object motion because identical retinal stimulations can be evoked by the movement of objects in the field of view as well as by the movements of retinal images self-evoked by eye movements. We clearly distinguish the two situations, perceiving object motion in the first case and stationarity in the second. The present work deals with the neuronal mechanisms that are likely involved in the detection of real motion. In monkeys, cells that are able to distinguish real from self-induced motion (real-motion cells) are distributed in several cortical areas of the dorsal visual stream. We suggest that the activity of these cells is responsible for motion perception, and hypothesize that these cells are the elements of a cortical network representing an internal map of a stable visual world. Supporting this view are the facts that: (i) the same cortical regions in humans are activated in brain imaging studies during perception of object motion; and (ii) lesions of these same regions produce selective impairments in motion detection, so that patients interpret any retinal image motion as object motion, even when they result from her/his eye movements. Among the areas of the dorsal visual stream rich in real-motion cells, V3A and V6, likely involved in the fast form and motion analyses needed for visual guidance of action, could use real-motion signals to orient the animal’s attention towards moving objects, and/or to help grasping them. Areas MT/V5, MST and 7a, known to be involved in the control of pursuit eye movements and in the analysis of visual signals evoked by slow ocular movements, could use real-motion signals to give a proper evaluation of motion during pursuits. © 2003 Elsevier Ltd. All rights reserved. Keywords: Visual cortex; Dorsal visual stream; Saccadic suppression; Visual stability; Movement perception; Real movement
1. Introduction Visual perception of motion is clearly related to the movement of retinal images of objects present in our field of view. However, similar movements of retinal images can be evoked by eye movements, while the objects are still in the visual scene. How do we distinguish actual movements from the image movements self-induced by the movement of the eyes? The purpose of the present work is to try to answer this question taking into account the neuronal mechanisms that are likely involved in the detection of motion. Experimental data obtained in paralyzed animals showed that many neurones of the visual system are sensitive to the movement of visual stimuli, and several cells of the visual cortex are able to encode the speed of motion over large ranges of velocities (Orban, 1984; Riva Sanseverino, Galletti, Maioli, & Squatrito, 1979). One could believe that all these neurones, being sensitive to various speeds of motion, are able to encode the movement occurring in the visual ∗
Corresponding author. Tel.: +39-051-2091741; fax: +39-051-251731. E-mail address:
[email protected] (C. Galletti).
0028-3932/$ – see front matter © 2003 Elsevier Ltd. All rights reserved. doi:10.1016/S0028-3932(03)00174-X
field, but this is clearly not the case. In physiological conditions, contrary to what happens in paralyzed animals, the animal moves the eyes, so the images of motionless objects move on the retina, exactly as the images of moving objects do. How can motion-sensitive neurones recognize the real movement of objects in the visual field? In physiological conditions, the images of objects motionless in the visual field move on the retina even when the animal maintains a steady fixation, owing to eye micromovements (drifts and flicks). As the velocity of these micromovements is such as to activate many cells in paralyzed animals (drifts: 100◦ s−1 ), and cells sensitive to slow speeds of motion by pursuit eye movement (1–50◦ s−1 ), as well as by flicks and drifts during steady fixation. If this were the case, we would perceive a shift of the visual world each time we make a saccade, and we would perceive as in motion the motionless objects the image of which is moving on the retina owing to pursuit eye movements. As this is not the case, it means that the movement of the retinal image per se is not sufficient to evoke a sensation of movement of the object in the visual field. This sensation is evoked when the movement on the retina is due to a real motion of the object, and is not evoked when the retinal image movement is self-induced by the movement of the eyes.
2. Perception of real motion In order to give a proper evaluation of motion, the visual system takes into account the movement of the eyes besides that of retinal images. For instance, long-lasting afterimages, as well as phosphenes evoked by cortical stimulation, appear as motionless when they are viewed in complete darkness and the eyes are moved passively, but these afterimages appear to be moving when the eyes move actively, either for saccadic or slow pursuit movements (Brindley & Lewin, 1968; Grusser & Grusser-Cornehls, 1973; Mack & Bachant, 1969). It has also been reported that if the eyes are mechanically, pharmacologically or pathologically immobilized, the attempt to move them gives a sensation of movement of the objects present in the visual field (Brindley & Merton, 1960; Hammond, Merton, & Sutton, 1956; Hughlings Jackson, 1932; Kornmuller, 1931; Mach, 1886; Von Helmholtz, 1909). In all these cases, there is a retinotopically “stable” neural stimulation associated with a perception of movement in the visual field that depends on performing an active ocular movement, or even on the intention to make it. As we can perceive a movement of an object when its image is motionless on the retina, we also can perceive the absence of motion (stationarity) when the image of an object sweeps across the retina if the retinal-image sweeping is due to the movement of the eyes. It is a common experience that during the execution of saccadic eye movements, the stationary visual world is perceived as stable (motionless) in spite of the shift of its retinal images due to the eye movement. It has been suggested that this visual stability is due to a reduced sensitivity of the visual system during saccades (saccadic suppression; Bridgeman, Hendry, & Stark, 1975; Burr, Holt, Johnstone, & Ross, 1982; Volkmann, 1962, 1976). We know that this reduced sensitivity lasts some hundreds of milliseconds around the time of occurrence of the saccade, but which type of eye-motion signal is responsible for this loss of visual sensitivity is a matter of debate. Information about eye movements could result from retinal as well as extraretinal signals. A suitable retinal signal indicating the eye motion is the shift on the retina of images of the
1719
whole visual field occurring when the eyes move (Brooks & Impelman, 1981; Gibson, 1966; MacKay, 1970; Wallace, 1985). Suitable extraretinal signals are both the sensory one coming from eye muscle proprioreceptors (“inflow theory”, Sherrington, 1918; Skavenski, 1972) and a copy of the motor one sent to the eye muscles by the oculomotor centers (“outflow theory”, Sperry, 1950; Von Helmholtz, 1909; Von Holst, 1954). Which of these signals is used to allow the stability of visual perception is still an unsolved question, and is beyond the scope of this paper. As the saccadic suppression is not a complete suppression of vision but a decrease of visual sensitivity, during the saccades at least weak and blurred visual images of the world ought to be perceived. This is not the case. In an elegant experiment, Judge, Wurtz and Richmond (1980) demonstrated that the blurring of visual perception during saccades is overcome by the masking effect of visual stimulation occurring soon before the saccade itself. Burr, Morrone and Ross (1994) have more recently suggested a second, not an alternative mechanism, that could explain the absence of motion perception during saccades. They found that saccadic suppression mainly affects the magnocellular section of the visual system, leaving the parvocellular one unaffected. As the cells of magnocellular system are sensitive to fast-moving stimuli (like the cell shown on the right in Fig. 1E), and would therefore be activated by the retinal shift of images of the visual world during saccades, the selective inhibition of these cells during saccades would prevent them from discharging, avoiding the sensation of visual world motion during the eye movement. Cells sensitive to fast speeds of motion, but insensitive to high velocities of retinal images when motion is self-induced by saccadic eye movements, have been described in subcortical structures as PL and PI subdivisions of the monkey pulvinar (Robinson & Petersen, 1985) and superior colliculus in both monkey (Robinson & Wurtz, 1976) and cat (Straschill & Hoffmann, 1970). Cells with similar behaviour were also found in cortical areas V1 and V2 (Fig. 2; Battaglini, Galletti, Aicardi, Squatrito, & Maioli, 1986), in area V4 (Fischer, Boch, & Bach, 1981), and in visual areas known to receive a strong magnocellular input as MT/V5 and MST (Thiele, Henning, Kubischik, & Hoffmann, 2002). Cells of the parvocellular system, supposed not to be inhibited during saccades, are insensitive to fast-moving stimuli (see the tuning curve of the cell shown on the left in Fig. 1E), and therefore are not activated by visual stimulations evoked by saccades. This type of cell would be activated by stationary or slow-moving images during saccades, but both events are virtually absent in physiological conditions. According to this view, if we stimulate the retina with a stable image during a saccade, we would perceive the object represented by that image thanks to the activity evoked in the non-inhibited cells. This prediction can be easily verified. When looking out from a window of a train in motion, the sleepers of the track line at our side are clearly seen each time we make a saccade in the direction opposite
1720
C. Galletti, P. Fattori / Neuropsychologia 41 (2003) 1717–1727
3. Correct evaluation of motion during tracking eye movement
Fig. 2. Real-motion cells of areas V1 and V2, sensitive to fast-moving stimuli (modified from Battaglini et al., 1986). For each area, a comparison of neural activity evoked by stimulus movement during steady fixation and by eye movement against a stationary stimulus is reported. Spike activity is shown as peri-stimulus time histograms (PSTHs); arrow heads below PSTHs mark the beginning and end of stimulus or target motion. Horizontal (H) and vertical (V) components of a typical record of eye movement are reported below spike activity. Scales: neural activity, four spikes/division (area V1) and two spikes/division (area V2); eye position, 4◦ per division.
to that of the train. The perception of sleepers is vivid and, oddly, they are perceived as absolutely still. The stillness of sleepers contrasts with the instability of their retinal images during the saccade. In fact, sleeper images move on the retina during saccade as the speed of saccade cannot always exactly match that of the train. Retinal images move at speeds that are likely in the range of activation of cells of the parvocellular system (from less than 1◦ s−1 to some tens of degrees per second), and this evokes a sensation of stillness of sleepers. If this view is correct, it means that the sensation of motion or stationarity of an object in the visual field depends on the type of cells activated by visual stimuli rather than the type of retinal stimulation. According to this view, we would perceive the motion of an object when the image of the object activates a particular set of cells (likely, the cells receiving a magnocellular input), whereas perception of stationarity would depend on the activation of another set of cells (likely, the cells receiving a parvocellular input). Both types of cells would be active during steady fixations and not active during saccades, the first because inhibited and the second because not activated by fast visual stimulations. The activities of both types of cells during steady fixation would mask the absence of specific activation of these same cells during the few tens of milliseconds of the saccade duration, resulting in a stability of the visual perception.
During steady fixation, as an object moves in the visual field its image moves on the retina and we soon perceive the object as in motion. During visual tracking of a moving object, conversely, the image of the followed object is quite still on the retina while the images of motionless visual world around the moving object are in motion. Despite this, everyone clearly perceives the object as in motion and the visual world as motionless. The stability of perception of the visual world during pursuit cannot be explained with a selective inhibition of motion-sensitive cells during eye movements, as suggested for the saccadic eye movements, because pursuit lasts for seconds, and during this time we correctly perceive any movement occurring in the visual field. But if motion-sensitive elements are not inhibited, they should be activated by the motion of retinal images self-induced by pursuit, and this fact contrasts with the stability of visual perception we have during pursuit. Which are the neural mechanisms that support the visual stability and proper evaluation of motion during tracking eye movement? Many laboratories in the last two decades addressed this question, looking for cells (real-motion cells) able to recognize whether a movement of a retinal image is the consequence of an actual movement that occurs in the visual field, or is self-induced by an ocular movement while the object is motionless in the visual field. Typically, the experimental paradigm used to look for these cells uses one of two conditions. In the first, the animal is required to fixate a stationary target while an optimal visual stimulus sweeps across the receptive field of the cell evoking a neural response. In the second, the animal is asked to pursue the target moving in the opposite direction with respect to the stimulus in the previous condition, while the visual stimulus is maintained still. The visual stimulation is the same in the two conditions (same relative movement between retinal image and receptive field). Consequently, the neural responses ought to be the same. Real-motion cells show good responses when the visual stimulus really moves in the visual field, and weak responses or no response at all when the eye moves the image of the stationary stimulus on the retina (Fig. 3). Such cells were found in the cortical areas V1 (Bridgeman, 1973; Galletti, Squatrito, Battaglini, & Maioli, 1984), V2 (Galletti, Battaglini, & Aicardi, 1988), V3A (Galletti, Battaglini, & Fattori, 1990), MT/V5 (see Figs. 2C and 4A of Erickson & Thier, 1991), MST (Erickson & Thier, 1991) and 7a (Sakata, Shibutan, Kawano, & Harrington, 1985). In areas V1, V2, V3A and MT/V5, the eye movement weakened the visual response to less than half of its value during steady fixation, but the visual response seldom disappeared during eye movement. In areas MST and 7a in most cases eye movements completely suppressed the visual response. Some real-motion cells of the occipital
C. Galletti, P. Fattori / Neuropsychologia 41 (2003) 1717–1727
1721
Fig. 3. Real-motion cells of areas V1, V2 and V3A, sensitive to slow-moving stimuli (modified from Battaglini et al., 1993; Galletti et al., 1988, 1990). For each area, the responses of a real-motion cell to receptive-field stimulation during steady fixation (stimulus movement), visual tracking (eye movement) and tracking eye movement without visual stimulation (control) are reported. Other details are same as in Figs. 1 and 2. Scales: neural activity, three spikes/division; eye position, 2◦ per division.
1722
C. Galletti, P. Fattori / Neuropsychologia 41 (2003) 1717–1727
visual areas were able to discriminate between real and self-induced motion also in darkness, but the presence of a visual background further decreased their visual response during an eye movement, and in some cases the response completely disappeared when pursuit was performed against a textured background (Galletti et al., 1990). Thus, it seems that several types of inputs modulate the visual response of real-motion cells: (i) an extraretinal eye-motion input, responsible for the real-motion effect observed in darkness, that likely acts directly on the visual input as the activity of real-motion cells was not affected in control trials (see Fig. 3); (ii) a retinal eye-motion input, evoked by the retinal slip of the visual world; and possibly (iii) a vestibular input, which would be well suited to account for head movement. Each of these inputs might weaken the visual response during eye/head movement with a mutual, synergic action, up to a complete inhibition of the response of real-motion cells in circumstances (lighted environment, structured visual background) that are frequently present in everyday life.
(A)
FP
Stimulus movement
S RF
H V
(B)
FP
Eye movement
S RF
4. Cortical stream for real motion detection An increasing percentage of cells in areas V1, V2 and V3A responds better to externally-induced retinal image slip than to image slip self-induced by the eye movement (10, 15 and 41%, respectively; Battaglini et al., 1986; Galletti et al., 1984, 1988, 1990). Many cells in area MT/V5 (Erickson & Thier, 1991; Thiele et al., 2002), and the great majority in areas MST and 7a (Erickson & Thier, 1991; Sakata et al., 1985; Thiele et al., 2002), show the real-motion behaviour. The higher percentage of real-motion cells in high-order cortical visual areas is likely due to the fact that these areas receive stronger retinal as well as extraretinal eye-motion inputs. In fact, though it has been recently found that even cells in V1 can be modulated by large stimuli outside the classical receptive field (Cavanaugh, Bair, & Movshon, 2002), it is well known that this interaction is stronger in high-order visual areas (Allman, Miezin, & Mac, 1995), as it is well known that the high-order visual areas receive strong extraretinal eye-motion inputs through the extrageniculostriate system (via superior colliculus and pulvinar). Other cortical areas, not previously tested with the realmotion paradigm, could contain real-motion cells. In order to look for them, we have applied the real-motion paradigm to visual cells recorded in the medial parietooccipital cortex of the awake macaque. This region of the brain contains two visual areas, V6 and V6A, recently defined on functional basis (Galletti, Fattori, Gamberini, & Kutz, 1999; Galletti, Fattori, Kutz, & Gamberini, 1999). V6 is a retinotopically-organized visual area that receives directly from V1 (Galletti et al., 2001); V6A, a non-retinotopically organized visuomotor area receiving visual input from V6 (Galletti et al., 2001; Shipp, Blanton, & Zeki, 1998). The results obtained with the real-motion paradigm show that area V6 contains many real-motion
H V
0
1000
2000
3000
Fig. 4. Real-motion cell recorded from area V6. (A) Neural responses evoked by sweeping an optimal visual stimulus (S) across the receptive field (RF) while the animal looked at a stationary fixation point (FP). (B) Neural activity evoked by sweeping the receptive field across the stationary visual stimulus. Receptive-field sweeping was the consequence of pursuit eye movements made to follow the moving fixation point. Other details as in Figs. 1 and 2. Scales: neural activity, 150 spikes/s; eye position, 30◦ per division.
cells, whereas none of the cells tested in V6A showed the real-motion behaviour. Fig. 4 shows the behaviour of a real-motion cell recorded in area V6. The cell was strongly activated when the visual stimulus moved from right to left, whereas similar retinal stimulations obtained by rightwards pursuit movements, with the stimulus stationary on the screen facing the animal, did not affect the cell’s discharge. The presence of real-motion cells in area V6 is not surprising, as V6 is target of the magnocellular input. It has been recently demonstrated that V6 receives a strong magnocellular input from the layer IVB cells of area V1 (Galletti et al., 2001), which in turn are known to receive directly from the cells of the magnocellular layers of the lateral geniculate nucleus. Fig. 5 shows the cortical areas containing real-motion cells, and their interconnectivity according to data from
5
PEc PGm
V 6 A V1
V2
POs
V6
Cin
Cal POM IOs
V3
OTs
V3
Dorso-medial visual stream
V4
V6
PEc V2
MIP
V6
V1
5
V6A
V3 V6
LIP
PEip VIP
V3 V2
DP V 4 MT T V4
7b MST
MST 7a
Dorso-lateral visual stream
PMv
POs
Inferior temporal cortex
IPs Ls
FST
Premotor cortex
V3A MT
PMd
AIP
7a
V3A
V1 V2
V6A
STs
C. Galletti, P. Fattori / Neuropsychologia 41 (2003) 1717–1727
V2
Fig. 5. Cortical network involved in real-motion detection. Left. Medial and dorsal views of macaque brain showing the functional parcellation of the posterior part of the macaque brain. Parieto-occipital (POs), medial parieto-occipital (POM), inferior occipital (IOs), occipito-temporal (OTs), intraparietal (IPs), lunate (Ls) and superior temporal (STs) sulci are open to show the occipital and posterior parietal areas hidden in the depth of these sulci (modified from Colby, Gattass, Olson, & Gross, 1988). Sulci opened are shown in light grey, and as thickened lines on the brain silhouettes in the middle part of the figure. Dashed lines are the borders between different cortical areas according to (Desimone & Ungerleider, 1986; Galletti et al., 1999; Gattass & Gross, 1981; Gattass, Gross & Sandell, 1981; Gattass, Sousa, & Gross, 1988; Matelli et al., 1998; Pandya & Seltzer, 1982). Right. Occipito-parietal network processing real-motion. Connections are according to (Boussaoud et al., 1990; Galletti et al., 2001; Luppino, Calzavara, Rozzi, & Matelli, 2001; Matelli et al., 1998; Shipp et al., 1998; Tanne-Gariepy, Rouiller, & Boussaoud, 2002).
1723
1724
C. Galletti, P. Fattori / Neuropsychologia 41 (2003) 1717–1727
literature. Note that apart from V1 and V2, that are known to distribute visual information to both dorsal and ventral visual streams, all other cortical areas belong to the dorsal visual stream. It is known that the dorsal visual stream projects visual information to the premotor areas of the frontal cortex, to be used to visually guide actions (Caminiti, Ferraina, & Johnson, 1996; Galletti et al., 2001; Galletti, Kutz, Gamberini, Breveglieri, & Fattori, 2003; Matelli, Govoni, Galletti, Kutz, & Luppino, 1998; Rizzolatti, Fogassi, & Gallese, 1997; Shipp et al., 1998). Visual information follows two main routes to reach the frontal cortex, one through the visual areas of the superior parietal lobule (dorso-medial visual stream) and one through the inferior parietal lobule (dorso-lateral visual stream). According to the schema presented in Fig. 5, information on real movement reaches the frontal cortex only through the dorso-lateral visual stream, as area V6A, which receives from V6 and is strongly connected to premotor cortex, is devoid of real-motion cells. It might be that other cortical visual areas of the dorso-medial stream not yet tested with the real-motion paradigm (as areas MIP and VIP) do contain real-motion cells. Area VIP in particular seems to be a good candidate, as it contains many cells sensitive to the direction of movement (Colby, Duhamel, & Goldberg, 1993), like areas MT/V5, MST and V6 (Desimone & Ungerleider, 1986; Galletti, Fattori, Battaglini, Shipp, & Zeki, 1996; Maunsell & Van Essen, 1983; Zeki, 1974), and is strongly connected with them (Boussaoud, Ungerleider, & Desimone, 1990; Galletti et al., 2001). However, recent experiments have demonstrated that a large majority of VIP neurones show significant differences in directional tuning for passive and active visual motion, but the response amplitudes to passive and active visual motion are not significantly different (Gabel, Misslisch, Gielen, & Duysens, 2002). The fact that several cells show opposite preferred directions for passive and active motion leaves open the possibility that VIP cells are able to discriminate between these two situations.
5. An internal map of visual world for motion detection The real-motion cells are able to distinguish whether a movement of a retinal image is due to a real movement in the visual field or is self-induced by a movement of the eyes. These cells allow one to recognize the actual movement of an object across a structured or non-patterned visual background, as well as in complete darkness. They could act as ‘sensors’ of real movement in a neural network that subserve an internal, objective map of the visual field. Such an internal representation of the field of view could allow one to properly interpret real motion as well as the plethora of sensory changes resulting from exploratory eye movements in a stable visual world. The existence of an internal representation of the visual world, stable despite eye/head movements, was suggested
by many authors in the past. MacKay (1973) advanced the hypothesis that a neural representation of this world would continuously ‘evaluate’ whether something changes its location (i.e. moves) in the visual environment. We suggest that the real-motion cells are responsible for this evaluation process. According to this view, the internal map of the visual world would change whenever the activity of real-motion cells changes above a certain amount, otherwise the map would remain unchanged, and the subject would perceive a stable visual environment. The hypothesis that the internal map of the visual world would not change until the eye-motion input and/or the visual input changes above a threshold value agrees with data obtained by several authors in psychophysical experiments. Yarbus (1967), for instance, demonstrated that when the amplitude of retinal image displacement was altered by the experimenter so that it was greater than that of eye movement, a sensation of object movement was perceived by the subject. As Yarbus pointed out, if the difference in retinal displacement was within 5–15 , the object was perceived as still; note that 5–15 is just the normal range for the micromovements of the eyes during steady fixation. Along the same line of evidence, other authors reported that when their subjects were watching a luminous target against a darkened background, and the output of eye-movement recording system caused the target to move when the eyes moved, the subjects perceived target motion only when the shift of the target was 10–20% larger than that of gaze (Mack, 1970; Whipple & Wallach, 1978). The right part of Fig. 5 shows the cortical areas and pathways that could be part of the network subserving the internal map of the visual world involved in detection of motion. According to this view, it has been demonstrated that cortical regions that could include the human homologues of areas containing real-motion cells in monkey: (i) evoke the perception of object motion when electrically stimulated (Lee, Hong, Seo, Tae, & Hong, 2000; Richer, Martinez, Cohen, & Sthilaire, 1991); (ii) are activated in normal subjects during vision of moving stimuli (Dupont, Orban, De Bruyn, Verbruggen, & Mortelmans, 1994; Kleinschmidt et al., 2002; Sunaert, Van Hecke, Marchal, & Orban, 1999; Watson et al., 1993); and (iii) are damaged in patients severely impaired in detection of movement in the visual field (Zihl et al., 1983). These patients describe the perceptual experience of looking at a moving object as if the object remains stationary but appears at different successive positions. In other words, they realize that objects moving in the visual world change in position but are unable to detect the occurrence of this movement. Recently, a very selective impairment in motion detection has been described after bilateral lesions of the extrastriate cortex in human (Haarmeier, Their, & Repnow, 1997). The patient suffered from false perception of motion, due to his inability to take into account eye movements when judging whether a retinal slip was self-induced or due to an actual movement. He interpreted any retinal image motion
C. Galletti, P. Fattori / Neuropsychologia 41 (2003) 1717–1727
as object motion, even when it resulted from his pursuit eye movements. No other visual functions, even in the motion domain, revealed any relevant disturbance. In particular, his perception of visual motion during steady fixation did not reveal any deficiency. The same was true for his perception of ego-motion. Magnetic resonance imaging revealed that the lesion involved the parieto-occipital cortex, affecting parts of dorsal areas 18, 19 and the cortex in and around the intraparietal sulcus. We suggest that this lesion included areas with high percentage of real-motion cells, e.g. the human homologues of monkey areas V3A, V6, MT/V5, MST and 7a (see Fig. 5). Strong support for this view comes from the fact that V3A, V6, MT/V5, MST, are located within the limits of Brodmann’s areas 18 and 19, and area 7a is the monkey homologous of human area 39 that surrounds the intraparietal sulcus, that is they are the same areas damaged in the patients suffering from false perception of motion. A particular perceptual problem is raised by the retinal stimulations evoked by tracking eye movement carried out to follow an object moving across a stationary background. During the pursuit, we actually perceive the motion of images of the motionless visual world around the moving object, but we interpret them as due to the eye motion, and not due to the motion of the visual world. The visual world far from the moving object we are pursuing, on the contrary, is clearly perceived as motionless despite the fact that images of that world are moving on the retina as those around the moving object. In other words, the same retinal slip evokes two different percepts depending on the retinal location of the slip. In terms of neural correlates, this means that: (i) the visual system is able to distinguish between actual and self-induced retinal slip wherever it happens on the retina; and (ii) the neural mechanisms involved in this process are likely different for central and peripheral representations of the visual field. Supporting this view is the fact that patients who are unable to detect movement in the visual field are still able to perceive movements at slow speeds in the central part of the visual field (Zihl et al., 1983). Further support comes from neurophysiological data from monkeys. Area MT/V5 represents mainly the central part of the visual field (Gattass & Gross, 1981) while area V6 mainly represents the peripheral part of it (Galletti et al., 1999). We advance the hypothesis that MT/V5, together with the neighboring areas MST and 7a, is particularly involved in interpreting signals evoked from the central retina during pursuits of moving objects, while V6 would be involved in detection of actual movement in the whole visual field. This view is in line with data from the literature as, in addition to real-motion cells, areas MT/V5, MST and 7a contain retinal eye-motion signals (cells responding to retinal slip, Allman et al., 1995; Komatsu & Wurtz, 1988; Sakata et al., 1985), and areas MST and 7a also contain extraretinal eye-motion signals (cells responding to pursuit eye movement, also in darkness, Newsome, Wurtz, & Komatsu, 1988; Sakata et al., 1985). Area V6, on the contrary, does not contain cells activated
1725
by pursuit eye movements in darkness (Galletti, Battaglini, & Fattori, 1991), but contains real-motion cells as well as cells activated by the movement of large visual stimuli and cells modulated by pursuit movements in light (Galletti, unpublished observations).
6. Conclusions Cells able to distinguish real from self-induced motion (real-motion cells) are distributed in several cortical areas in the brain. This cortical network, that seems to exist also in the human brain, could be responsible for the proper evaluation of motion and the stability of visual perception despite eye movements. Real-motion cells are distributed in areas of the dorsal visual stream that are strongly influenced by the magnocellular input. Among these areas, V3A and V6 are likely involved in the fast form and motion analyses needed for visual guidance of action (see Galletti et al., 2001, 2003). The real-motion cells of these areas could signal actual movements in the field of view, and these signals could be used to orient the animal’s attention towards moving objects, to parry a blow, to grasp the moving objects or simply to update their spatial location. The other visual areas of the dorsal visual stream, MT/V5, MST and 7a, are known to be involved in the control of pursuit eye movements as well as in the analysis of visual signals evoked by tracking eye movements (Allman et al., 1995; Komatsu & Wurtz, 1988; Newsome et al., 1988; Sakata et al., 1985). The real-motion cells of these areas could interpret retinal and extraretinal signals evoked by eye-tracking of moving objects, in order to give a proper evaluation of motion during pursuit.
Acknowledgements This work was supported by Grants from Ministero dell’Istruzione, dell’Universita’ e della Ricerca, Italy. References Allman, J., Miezin, F., & Mac, G. E. (1995). Stimulus specific responses from beyond the classical receptive field: Neurophysiological mechanism for local-global comparisons in visual neurons. Annual Review of Neuroscience, 8, 407–430. Battaglini, P. P., Galletti, C., & Fattori, P. (1993). Functional properties of neurons in area V1 of awake macaque monkeys: Peripheral versus central visual field representation. Archives Italiennes de Biologie, 131, 303–315. Battaglini, P. P., Galletti, C., Aicardi, G., Squatrito, S., & Maioli, M. G. (1986). Effect of fast moving stimuli and saccadic eye movements on cell activity in visual areas V1 and V2 of behaving monkeys. Archives Italiennes de Biologie, 124, 111–119. Boussaoud, D., Ungerleider, L. G., & Desimone, R. (1990). Pathways for motion analysis: Cortical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque. The Journal of Comparative Neurology, 296, 462–495.
1726
C. Galletti, P. Fattori / Neuropsychologia 41 (2003) 1717–1727
Bridgeman, B. (1973). Receptive fields in single cells of monkey visual cortex during visual tracking. The International Journal of Neuroscience, 6, 141–152. Bridgeman, B., Hendry, D., & Stark, L. (1975). Failure to detect displacement of the visual world during saccadic eye movements. Vision Research, 15, 719–722. Brindley, G. S., & Lewin, W. S. (1968). The sensations produced by electrical stimulation of the visual cortex. The Journal of Physiology, 196, 479–493. Brindley, G. S., & Merton, P. A. (1960). The absence of position sense in the human eye. The Journal of Physiology, 153, 127–130. Brooks, B. A., & Impelman, D. M. (1981). Suppressive effects of a peripheral grating displacement during saccadic eye movement and during fixation. Experimental Brain Research, 42, 489–492. Burr, D. C., Holt, J., Johnstone, J. R., & Ross, J. (1982). Selective depression of motion sensitivity during saccades. The Journal of Physiology, 333, 1–15. Burr, D. C., Morrone, M. C., & Ross, J. (1994). Selective suppression of the magnocellular visual pathway during saccadic eye movements. Nature, 371, 511–513. Caminiti, R., Ferraina, S., & Johnson, P. B. (1996). The sources of visual information to the primate frontal lobe: A novel role for the superior parietal lobule (review). Cerebral Cortex, 6, 319–328. Carpenter, R. H. S. (1988). Movements of the eyes. London: Pion Limited, 1988. Cavanaugh, J. R., Bair, W., & Movshon, J. A. (2002). Nature and interaction of signals from the receptive field center and surround in macaque v1 neurons. Journal of Neurophysiology, 88, 2530–2546. Colby, C. L., Duhamel, J. R., & Goldberg, M. E. (1993). Ventral intraparietal area of the macaque: Anatomic location and visual response properties. Journal of Neurophysiology, 69, 902–914. Colby, C. L., Gattass, R., Olson, C. R., & Gross, C. G. (1988). Topographical organization of cortical afferents to extrastriate visual area PO in the macaque: A dual tracer study. The Journal of Comparative Neurology, 269, 392–413. Desimone, R., & Ungerleider, L. G. (1986). Multiple visual areas in the caudal superior temporal sulcus of the macaque. The Journal of Comparative Neurology, 248, 164. Dupont, P., Orban, G. A., De Bruyn, B., Verbruggen, A., & Mortelmans, L. (1994). Many areas in the human brain respond to visual motion. Journal of Neurophysiology, 72, 1420–1424. Erickson, R. G., & Thier, P. (1991). A neuronal correlate of spatial stability during periods of self-induced visual motion. Experimental Brain Research, 86, 608–616. Fischer, B., Boch, R., & Bach, M. (1981). Stimulus versus eye movements: Comparison of neural activity in the striate and prelunate visual cortex (A17 and A19) of trained rhesus monkey. Experimental Brain Research, 43, 69–77. Gabel, S. F., Misslisch, H., Gielen, C. C., & Duysens, J. (2002). Responses of neurons in area VIP to self-induced and external visual motion. Experimental Brain Research, 147, 520–528. Galletti, C., Battaglini, P. P., & Aicardi, G. (1988). ‘Real-motion’ cells in visual area V2 of behaving macaque monkeys. Experimental Brain Research, 69, 279–288. Galletti, C., Battaglini, P. P., & Fattori, P. (1990). ‘Real-motion’ cells in area V3A of macaque visual cortex. Experimental Brain Research, 82, 67–76. Galletti, C., Battaglini, P. P., & Fattori, P. (1991). Functional properties of neurons in the anterior bank of the parieto-occipital sulcus of the macaque monkey. The European Journal of Neuroscience, 3, 452–461. Galletti, C., Fattori, P., Battaglini, P. P., Shipp, S., & Zeki, S. (1996). Functional demarcation of a border between areas V6 and V6A in the superior parietal gyrus of the macaque monkey. The European Journal of Neuroscience, 8, 30–52. Galletti, C., Fattori, P., Gamberini, M., & Kutz, D. F. (1999). The cortical visual area V6: Brain location and visual topography. The European Journal of Neuroscience, 11, 3922–3936.
Galletti, C., Fattori, P., Kutz, D. F., & Gamberini, M. (1999). Brain location and visual topography of cortical area V6A in the macaque monkey. The European Journal of Neuroscience, 11, 575–582. Galletti, C., Gamberini, M., Kutz, D. F., Fattori, P., Luppino, G., & Matelli, M. (2001). The cortical connections of area V6: An occipito-parietal network processing visual information. The European Journal of Neuroscience, 13, 1572–1588. Galletti, C., Kutz, D. F., Gamberini, M., Breveglieri, R., Fattori, P. (2003). Role of the medial parieto-occipital cortex in the control of reaching and grasping movements. Experimental Brain Research, in press. Galletti, C., Squatrito, S., Battaglini, P. P., & Maioli, M. G. (1984). ‘Real-motion’ cells in the primary visual cortex of the macaque monkeys. Brain Research, 301, 95–110. Gattass, R., & Gross, C. G. (1981). Visual topography of striate projection zone (MT) in posterior superior temporal sulcus of the macaque. Journal of Neurophysiology, 46, 621–638. Gattass, R., Gross, C. G., & Sandell, J. H. (1981). Visual topography of V2 in the macaque. The Journal of Comparative Neurology, 201, 519–539. Gattass, R., Sousa, A. P. B., & Gross, C. G. (1988). Visuotopic organization and extent of V3 and V4 of the macaque. The Journal of Neuroscience, 8, 1831–1845. Gibson, J. J. (1966). The senses considered as perceptual systems. Boston: Houghton Mifflin; 1966. Grusser, O. J., & Grusser-Cornehls, U. (1973). Neuronal mechanisms of visual movement perception and some psychophysical and behavioral correlations. In Central processing of visual information. Part A. Integrative functions and comparative data. Handbook of sensory physiology (vol. VII/3, pp. 333–429). Berlin: Spinger-Verlag; 1973. Haarmeier, T., Thier, P., & Repnow M, D. P. (1997). False perception of motion in a patient who cannot compensate for eye movements. Nature, 389, 849–852. Hammond, P., Merton, P. A., & Sutton, G. G. (1956). Nervous gradation of muscolar contraction. British Medical Bulletin, 12, 214–218. Hughlings Jackson, J. (1932). Selected writings. London: Hodder and Stoughton; 1932. Judge, S. J., Wurtz, R. W., & Richmond, B. J. (1980). Vision during saccadic eye movements. I. Visual interaction in striate cortex. Journal of Neurophysiology, 43, 1133–1155. Kleinschmidt, A., Thilo, K. V., Buchel, C., Gresty, M. A., Bronstein, A. M., & Frackowiak, R. S. (2002). Neural correlates of visual-motion perception as object- or self-motion. Neuroimage, 16, 873–882. Komatsu, H., & Wurtz, R. H. (1988). Relation of cortical areas MT and MST to pursuit eye movements. III. Interaction with full-field visual stimulation. Journal of Neurophysiology, 60, 621–644. Kornmuller, A. E. (1931). Eine experimentelle Anasthesie der aeusseren Augenmuskeln von Menschen und ihre Auswirkungen. Journal Fur Psychologie und Neurologie, 41, 354–366. Lee, H. W., Hong, S. B., Seo, D. W., Tae, W. S., & Hong, S. C. (2000). Mapping of functional organization in human visual cortex: Electrical cortical stimulation. Neurology, 54, 849–854. Luppino, G., Calzavara, R., Rozzi, S., & Matelli, M. (2001). Projections from the superior temporal sulcus to the agranular frontal cortex in the macaque. The European Journal of Neuroscience, 14, 1035–1040. Mach, E. (1886). Beitrage zur Analyse der Empfindungen [The analysis of sensations, Trans., 1959]. Dover, New York: Jena; 1886. Mack, A. (1970). An investigation of the relationship between eye and retinal image movement in the perception of movement. Perception and Psychophysics, 8, 291–297. Mack, A., & Bachant, J. (1969). Perceived movement of the after image during eye movements. Perception and Psychophysics, 6, 379–384. MacKay, D. M. (1970). Elevation of visual threshold by displacement of retinal image. Nature, 225, 90–92. MacKay, D. M. (1973). Visual stability and voluntary eye movements. In Central processing of visual information. part a. integrative functions and comparative data. handbook of sensory physiology (vol. VII/3, p. 307–332). Berlin: Springer-Verlag; 1973.
C. Galletti, P. Fattori / Neuropsychologia 41 (2003) 1717–1727 Matelli, M., Govoni, P., Galletti, C., Kutz, D. F., & Luppino, G. (1998). Superior area six afferents from the superior parietal lobule in the macaque monkey. The Journal of Comparative Neurology, 402, 327– 352. Maunsell, J. H., & Van Essen, D. C. (1983). Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. Journal of Neurophysiology, 49, 1127–1147. Newsome, W. T., Wurtz, R. H., & Komatsu, H. (1988). Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputs. Journal of Neurophysiology, 60, 604– 620. Orban, G. A. (1984). Neuronal operations in the visual cortex. Berlin: Springer-Verlag; 1984. Pandya, D. N., & Seltzer, B. (1982). Intrinsic connections and architectonics of posterior parietal cortex in the rhesus monkey. The Journal of Comparative Neurology, 204, 196–210. Richer, F., Martinez, M., Cohen, H., & Sthilaire, J. M. (1991). Visual motion perception from stimulation of the human medial parieto-occipital cortex. Experimental Brain Research, 87, 649. Riva Sanseverino, E., Galletti, C., Maioli, M. G., & Squatrito, S. (1979). Single unit responses to visual stimuli in cat cortical areas 17 and 18. III. Responses to moving stimuli of variable velocity. Archives Italiennes de Biologie, 117, 248–267. Rizzolatti, G., Fogassi, L., & Gallese, V. (1997). Parietal cortex: From sight to action. Current Opinion in Neurobiology, 7, 562–567. Robinson, D. L., & Petersen, S. E. (1985). Responses of pulvinar neurons to real and self-induced stimulus movement. Brain Research, 338, 392–394. Robinson, D. L., & Wurtz, R. H. (1976). Use of an extraretinal signal by monkey superior colliculus neurons to distinguish real from self-induced stimulus movement. Journal of Neurophysiology, 39, 852– 870. Sakata, H., Shibutan, H., Kawano, K., & Harrington, T. L. (1985). Neural mechanisms of space vision in the parietal association cortex of the monkey. Vision Research, 25, 453–463. Sherrington, G. S. (1918). Observations on the sensual role of the proprioceptive nerve supply of the extrinsic eye muscles. Brain, 41, 332–343. Shipp, S., Blanton, M., & Zeki, S. (1998). A visuo-somatomotor pathway through superior parietal cortex in the macaque monkey: Cortical connections of areas V6 and V6A. The European Journal of Neuroscience, 10, 3171–3193. Skavenski, A. A. (1972). Inflow as a source of extraretinal eye position information. Vision Research, 12, 221–229.
1727
Sperry, R. W. (1950). Neural basis of the spontaneous optokinetic response produced by visual inversion. Journal of Comparative and Physiological Psychology, 43, 482–489. Straschill, M., & Hoffmann, K. P. (1970). Activity of movement sensitive neurons of the cat’s tectum opticum during spontaneous eye movements. Experimental Brain Research, 11, 318–326. Sunaert, S., Van Hecke, P., Marchal, G., & Orban, G. A. (1999). Motion-responsive regions of the human brain. Experimental Brain Research, 127, 355–370. Tanne-Gariepy, J., Rouiller, E. M., & Boussaoud, D. (2002). Parietal inputs to dorsal versus ventral premotor areas in the macaque monkey: Evidence for largely segregated visuomotor pathways. Experimental Brain Research, 145, 91–103. Thiele, A., Henning, P., Kubischik, M., & Hoffmann, K. P. (2002). Neural mechanisms of saccadic suppression. Science, 295, 2460–2462. Volkmann, F. C. (1962). Vision during voluntary saccadic eye movements. Journal of the Optical Society of America, 52, 571–578. Volkmann, F. C. (1976). Saccadic suppression: A brief review. In R. A. Monty, J. W. Senders, R. A. Monty, & J. W. Senders (Eds.), Eye movements and psychological processes (pp. 73–154). Hillsdale, NJ: Laurence Erlbaum; 1976. Von Helmholtz, H. (1909). Handbuch der physiologischen Optik [J.P.C. Southall, Trans.], Ocmo Optical Society of America. Hamburg: Voss; 1909. Von Holst, E. (1954). Relations between the central nervous system and the peripheral organs. British Journal of Animal Behavior, 2, 89–94. Wallace, H. (1985). Perceiving a stable environment. Scientific American, 252, 92–98. Watson, J. D. G., Myers, R., Frakowiak, R. S. J., Hajnal, J. V., Woods, R. P., Mazziotta, J. C., Shipp, S., & Zeki, S. (1993). Area-V5 of the human brain—evidence from a combined study using positron emission tomography and magnetic resonance imaging. Cerebral Cortex, 3, 79– 94. Whipple, W. R., & Wallach, H. (1978). Direction-specific motion thresholds for abnormal image shifts during saccadic eye movement. Perception and Psychophysics, 24, 349–355. Yarbus, A. L. (1967). Eye movements and vision. New York: Plenum Press; 1967. Zeki, S. M. (1974). Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey. The Journal of Physiology, 236, 549–573. Zihl, J., Von Cramon, D., & Mai, N. (1983). Selective disturbance of movement vision after bilateral brain damage. Brain, 106, 313– 340.