Eye–hand coordination

(Redirected from Hand-eye coordination)

Eye–hand coordination (also known as hand–eye coordination) is the coordinated motor control of eye movement with hand movement and the processing of visual input to guide reaching and grasping along with the use of proprioception of the hands to guide the eyes, a modality of multisensory integration. Eye–hand coordination has been studied in activities as diverse as the movement of solid objects such as wooden blocks, archery, sporting performance, music reading, computer gaming, copy-typing, and even tea-making. It is part of the mechanisms of performing everyday tasks; in its absence, most people would not be able to carry out even the simplest of actions such as picking up a book from a table.



The eye–forelimb hypothesis


The eye–forelimb (EF) hypothesis suggests that the primate visual system changed in parallel with the specialization of the hand through a common evolutionary mechanism. The ultimate result became accurate depth perception, speed and exactness of the hand when it is gripping.

Primates and binocular vision


Primates, including humans, have eyes that are directed forward. Primates also have an optic chiasm (OC), with 45 percent made up of uncrossed nerves.[citation needed] The traditional idea is that such vision combined with high-grade binocularity to promote deep vision.[1] But an overview article in Brain, Behavior and Evolution [2] presents a new eye–forelimb hypothesis (EF hypothesis) that the neural architecture of primates' visual system evolved for a totally different purpose. The EF hypothesis postulates that it has selective value to have short neural pathways between areas of the brain that receive visual information about the hand and the motor nuclei that control the coordination of the hand. The heart of the EF hypothesis is that evolutionary transformation in OC will affect the length of these neural pathways.

A way to test the hypothesis is to compare the precision and speed of, for example, the left hand when performing tasks in the left and right field of view respectively. Several such experiments have been carried out. Tthough they were not done primarily to test the EF hypothesis, the results are clearly in accordance with the hypothesis: a higher precision and speed as long as the hand works in the ipsilateral field of vision.[3] Berlucchi et al. [4] believes that the hand's reactions to visual stimuli that are presented in the ipsilateral field of vision are integrated into the contralateral hemisphere, which results in fewer synapses for the signals to pass, resulting in faster motor skills than with visual stimuli presented counter-laterally.

Primates and felines skillfully use their anterior limbs under supervision of the eye. Primates and felines have a high proportion of ipsilateral retinal projections (IRP) (45% respectively 30% IRP)[clarification needed]. The fact that crocodiles, most birds and fishes lack IRP is also accommodated by the EF hypothesis.[5] For anatomical/functional reasons, crocodiles, birds and fishes have little use of the anterior limb in their frontal space.

The African clawed frog (Xenopus laevis) has only crossed projections before the metamorphosis, thereafter it develops binocular vision and anterior extremities with claws. Xenopus laevis uses its claws when it catches prey situated in front of the frog. Dolphins lack IRP, which is consistent with the hypothesis because the anterior extremity of the dolphin (the pectoral fin) is used only laterally. Among marsupials, three tree-climbing species have a high proportion of IRP. Vombater (Vombatidae), has very few IRP, which is in accordance with the EF hypothesis since it is a terrestrial herbivore. That kind of foraging reduces the need of excellent visual control of the forefoot. The other marsupials fall between these extremes.[5]

The EF hypothesis offers new perspectives on human evolution. Excellent eye–hand control are typical features of primates.[1][5] Fossil evidence suggests that the first actual primates appeared about 55 million years ago. Even then, the hand seems to have been specialized to grip. Early primate ancestors may have developed this special grip to retrieve and eat flowers, nectar, and leaves in the distal branches of trees.[6] Bloch and Boyer claim that the hand's grip ability evolved before the visual specialization of the primates.[6] The EF hypothesis, on the contrary, indicates that the primate vision system evolved in parallel with the specialization of the hand through a common evolutionary mechanism. In principle an increase in IRP has selective value in animals that regularly use the anterior limb in the frontal field of vision.[7]

Behavior and kinematics


Neuroscientists have extensively researched human gaze behavior, noting that the use of the gaze is very task-specific,[8] but that humans typically exhibit proactive control to guide their movement. Usually the eyes fixate on a target before the hands are used to engage in a movement, indicating that the eyes provide spatial information for the hands.[9] The duration that the eyes appear to lock onto a goal for a hand movement varies—sometimes the eyes remain fixated until a task is completed. Other times, the eyes seem to scout ahead toward other objects of interest before the hand even grasps and manipulates the object.

Eye-guided hand movement


When eyes and hands are used for core exercises, the eyes generally direct the movement of the hands to targets.[10] Furthermore, the eyes provide initial information of the object, including its size, shape, and possibly grasping sites for judging the force the fingertips need to exert to engage in a task.

For sequential tasks, eye-gaze movement occurs during important kinematic events like changing the direction of a movement or when passing perceived landmarks.[11] This is related to the task-search-oriented nature of the eyes and their relation to the movement planning of the hands and the errors between motor signal output and consequences perceived by the eyes and other senses that can be used for corrective movement. The eyes have a tendency to "refixate" on a target to refresh the memory of its shape, or to update for changes in its shape or geometry in drawing tasks that involve the relating of visual input and hand movement to produce a copy of what was perceived.[12] In high accuracy tasks, when acting on greater amounts of visual stimuli, the time it takes to plan and execute movement increases linearly, for example when using a computer mouse, per Fitts's law.[13]

Hand-guided saccades


Humans have the ability to aim eye movement toward the hand without vision, using the sense of proprioception, with only minor errors related to internal knowledge of limb position.[14] It has been shown the proprioception of limbs, in both active and passive movement, results in saccadic overshoots when the hands are used to guide eye movement. In experiments these overshoots result from the control of eye saccades rather than previous movement of the hands.[citation needed] This implies that limb-based proprioception is capable of being transformed into ocular motor coordinates to guide eye saccades, which allows for the guidance of the saccades by hands and feet.[citation needed]

Clinical syndromes


Numerous disorders, diseases, and impairments have been found to result in disruption to eye–hand coordination, owing to damage to the brain itself, degeneration of the brain due to disease or aging, or an apparent inability to coordinate senses completely.



Impairments to eye–hand coordination have been shown in older adults, especially during high-velocity and precise movements. This has been attributed to the general degeneration of the cortex, resulting in a loss of the ability to compute visual inputs and relate them to hand movements.[15] However, while older adults tend to take more time for these sorts of tasks, they are still able to remain just as accurate as younger adults, but only if the additional time is taken.[citation needed]

Bálint's syndrome


Bálint's syndrome is characterized by a complete lack of eye–hand coordination and has been demonstrated to occur in isolation to optic ataxia.[16] It is a rare psychological condition resulting most often from damage bilaterally to the superior parieto-occipital cortex.[17] One of the most common causes is from strokes, but tumours, trauma, and Alzheimer's disease can also cause damage. Balint's syndrome patients can suffer from three major components: optic apraxia, optic ataxia, and simultanagnosia.[18] Simultanagnosia is when patients have difficulty perceiving more than one object at a time.[17] There have been three different approaches for rehabilitation. The first approach is the adaptive or functional approach; it involves functional tasks that use a patient's strengths and abilities. The second approach is remedial approach and involves restoration of the damaged central nervous system by training perceptual skills. The last approach is multi-context approach and involves practising a targeted strategy in a multiple environment with varied tasks and movement demands, along with self-awareness tasks.[19]

Optic apraxia


Optic apraxia is a condition that results from a total inability of a person to coordinate eye and hand movements. Although similar to optic ataxia, its effects are more severe and do not necessarily come from damage to the brain, but may arise from genetic defects or tissue degeneration.[citation needed]

Optic ataxia


Optic ataxia or visuomotor ataxia is a clinical problem associated with damage to the occipital–parietal cortex in humans, resulting in a lack of coordination between the eyes and hand. It can affect either one or both hands and can be present in part of the visual field or the entire visual field.[20] Optic ataxia has been often considered to be a high-level impairment of hand–eye coordination resulting from a cascade of failures in the sensory to motor transformations in the posterior parietal cortex. Visual perception, naming, and reading are still possible, but visual information cannot direct hand motor movements.[20] Optic ataxia has been often confused with Balint's syndrome, but recent research has shown that optic ataxia can occur independently of Balint's syndrome.[16] Optic ataxia patients usually have troubles reaching toward visual objects on the side of the world opposite to the side of brain damage. Often these problems are relative to current gaze direction, and appear to be remapped along with changes in gaze direction. Some patients with damage to the parietal cortex show "magnetic reaching": a problem in which reaches seem drawn toward the direction of gaze, even when it is deviated from the desired object of grasp.[citation needed]

Parkinson's disease


Adults with Parkinson's disease have been observed to show the same impairments as found in normal aging, only to a more extreme degree, in addition to a loss of control of motor functions per normal symptoms of the disease.[15] It is a movement disorder and occurs when there is degeneration of dopaminergic neurons that connect the substantia nigra with the caudate nucleus. A patient's primary symptoms include muscular rigidity, slowness of movement, a resting tremor, and postural instability.[21] The ability to plan and learn from experience has been shown to allow adults with Parkinson's to improvement times, but only under conditions where they are using medications to combat the effects of Parkinson's. Some patients are given L-DOPA, a precursor to dopamine. It is able to cross the blood–brain barrier and then is taken up by dopaminergic neurons and then converted to dopamine.[21]

See also



  1. ^ a b Heesy, C. P. (2009). Seeing in Stereo: The Ecology and Evolution of Primate Binocular Vision and Stereopsis. Evol. Anthropol. 18, 21–35. doi: 10.1002/evan.20195.
  2. ^ Larsson, M. (2011). Binocular vision and ipsilateral retinal projections in relation to eye and forelimb coordination. Brain Behavior Evolution 77, 219–230. doi: 10.1159/000329257.
  3. ^ Larsson, M. (2013). The optic chiasm: a turning point in the evolution of eye/hand coordination. Front zool 10, 41. doi: 10.1186/1742-9994-10-41.
  4. ^ Berlucchi, G., Heron, W., Hyman, R., Rizzolat.G, and Umilta, C. (1971). Simple reactions times of ipsilateral and contralateral hand to lateralized visual stimuli. Brain 94, 419–30.
  5. ^ a b c Larsson, M. (2011). Binocular vision and ipsilateral retinal projections in relation to eye and forelimb coordination. Brain Behav Evol 77, 219–30. doi: 10.1159/000329257.
  6. ^ a b Bloch JI, Boyer DM (2002): Grasping primate origins. Science 298:1606–10.
  7. ^ Larsson M, Binocular vision, the optic chiasm, and their associations with vertebrate motor behavior. Frontiers in Ecol. Evol. 2015 – DOI: 10.3389/fevo.2015.00089
  8. ^ Vidoni, E. D.; McCarley, J. S.; Edwards, J. D.; Boyd, L. A. (2009). "Manual and oculomotor performance develop contemporaneously but independently during continuous tracking". Experimental Brain Research. 195 (4): 611–620. doi:10.1007/s00221-009-1833-2. PMID 19436998. S2CID 30618530.
  9. ^ Johansson, R. S.; Westling, G; Bäckström, A.; Flanagan, J. R. (2001). "Eye–hand co-ordination in object manipulation". Journal of Neuroscience. 21 (17): 6917–6932. CiteSeerX doi:10.1523/JNEUROSCI.21-17-06917.2001. PMC 6763066. PMID 11517279.
  10. ^ Liesker, H.; Brenner, E.; Smeets, J. (2009). "Combining eye and hand in search is suboptimal" (PDF). Experimental Brain Research. 197 (4): 395–401. doi:10.1007/s00221-009-1928-9. PMC 2721960. PMID 19590859.
  11. ^ Bowman, M. C.; Johannson, R. S.; Flanagan, J. R. (2009). "Eye–hand coordination in a sequential target contact task". Experimental Brain Research. 195 (2): 273–283. doi:10.1007/s00221-009-1781-x. PMID 19357841. S2CID 54559930.
  12. ^ Coen-Cagil, R.; Coraggio, P.; Napoletano, P.; Schwartz, O.; Ferraro, M.; Boccignone, G. (2009). "Visuomotor characterization of eye movements in a drawing task". Vision Research. 49 (8): 810–818. doi:10.1016/j.visres.2009.02.016. hdl:2434/53532. PMID 19268685. S2CID 15461410.
  13. ^ Lazzari, S.; Mottet, D.; Vercher, J. L. (2009). "Eye–hand coordination in rhythmical pointing". Journal of Motor Behavior. 41 (4): 294–304. doi:10.3200/JMBR.41.4.294-304. PMID 19508956. S2CID 27478401.
  14. ^ Ren, L.; Crawford, J. D. (2009). "Coordinate transformations for hand-guided saccades". Experimental Brain Research. 195 (3): 455–465. doi:10.1007/s00221-009-1811-8. PMID 19404624. S2CID 23564696.
  15. ^ a b Boisseau, E.; Scherzer, P.; Cohen, H. (2002). "Eye–hand coordination in aging and in Parkinson's disease". Aging, Neuropsychology, and Cognition. 9 (4): 266–75. doi:10.1076/anec. S2CID 144182594.
  16. ^ a b Jackson, S. R.; Newport, R.; Husain, M.; Fowlie, J. E.; O'Donoghue, M.; Bajaj, N. (2009). "There may be more to reaching than meets the eye: re-thinking optic ataxia". Neuropsychologia. 47 (6): 1397–1408. doi:10.1016/j.neuropsychologia.2009.01.035. PMID 19428405. S2CID 25641521.
  17. ^ a b Jackson; Swainson, G. M.; Mort, R.; Husain, D.; Jackson, M. (2009). "Attention, competition, and the parietal lobes: insights from Balint's syndrome". Psychol. Res. 73 (2): 263–270. doi:10.1007/s00426-008-0210-2. PMID 19156438. S2CID 26978283.
  18. ^ Udesen, H. (1992). "Balint's syndrome: visual disorientation". Ugeskrift for Lægerer. 154 (21): 1492–94. PMID 1598720.
  19. ^ Al-Khawaja, I. Haboubi (2001). "Neurovisual rehabilitation in Balint's syndrome". J. Neurol. Neurosurg. Psychiatry. 70 (3): 416. doi:10.1136/jnnp.70.3.416. PMC 1737281. PMID 11248903.
  20. ^ a b Bravo-Marques, J. M.; -1#Ferro, J. M. Castro-Caldas (1983). "Crossed optic ataxia: possible role of the dorsal splenium". J. Neurol. Neurosurg. Psychiatry. 46 (6): 533–9. doi:10.1136/jnnp.46.6.533. PMC 1027444. PMID 6875586.{{cite journal}}: CS1 maint: numeric names: authors list (link)
  21. ^ a b Carlson, N.R. (2012). Physiology of behavior (11th ed.). Boston: Pearson. ISBN 978-0-205-23939-9. [page needed]

Further reading