IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1002718.html
   My bibliography  Save this article

Very Slow Search and Reach: Failure to Maximize Expected Gain in an Eye-Hand Coordination Task

Author

Listed:
  • Hang Zhang
  • Camille Morvan
  • Louis-Alexandre Etezad-Heydari
  • Laurence T Maloney

Abstract

We examined an eye-hand coordination task where optimal visual search and hand movement strategies were inter-related. Observers were asked to find and touch a target among five distractors on a touch screen. Their reward for touching the target was reduced by an amount proportional to how long they took to locate and reach to it. Coordinating the eye and the hand appropriately would markedly reduce the search-reach time. Using statistical decision theory we derived the sequence of interrelated eye and hand movements that would maximize expected gain and we predicted how hand movements should change as the eye gathered further information about target location. We recorded human observers' eye movements and hand movements and compared them with the optimal strategy that would have maximized expected gain. We found that most observers failed to adopt the optimal search-reach strategy. We analyze and describe the strategies they did adopt. Author Summary: A variety of human daily activities, such as cooking, drawing, and driving, involve coordination of eye and hand. Typically your hand moves towards whatever you have just looked at. But is this coupling compulsory? To test whether human observers can adopt appropriate eye-hand coordination strategies to maximize rewards, we created an unusual task where good performance required that hand and eye move independently of each other in order to rapidly find and touch a target. Observers were rewarded for minimizing the overall time to find and touch a target among distractors and we made the visual search and hand movements very slow so that a simple “hand-follows-eye” strategy would reduce observers' winnings considerably. Most observers failed to choose the optimal visual search strategy but did intelligently coordinate hand movements to the visual search strategy they did pick. The “very slow search and reach” task we developed provides a novel approach to investigate coordination between perceptual and motor systems experimentally and computationally.

Suggested Citation

  • Hang Zhang & Camille Morvan & Louis-Alexandre Etezad-Heydari & Laurence T Maloney, 2012. "Very Slow Search and Reach: Failure to Maximize Expected Gain in an Eye-Hand Coordination Task," PLOS Computational Biology, Public Library of Science, vol. 8(10), pages 1-12, October.
  • Handle: RePEc:plo:pcbi00:1002718
    DOI: 10.1371/journal.pcbi.1002718
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1002718
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1002718&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1002718?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jiri Najemnik & Wilson S. Geisler, 2005. "Optimal eye movement strategies in visual search," Nature, Nature, vol. 434(7031), pages 387-391, March.
    2. Todd E Hudson & Laurence T Maloney & Michael S Landy, 2008. "Optimal Compensation for Temporal Uncertainty in Movement Planning," PLOS Computational Biology, Public Library of Science, vol. 4(7), pages 1-9, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joseph Snider & Dongpyo Lee & Howard Poizner & Sergei Gepshtein, 2015. "Prospective Optimization with Limited Resources," PLOS Computational Biology, Public Library of Science, vol. 11(9), pages 1-28, September.
    2. Shih-Wei Wu & Maria F Dal Martello & Laurence T Maloney, 2009. "Sub-Optimal Allocation of Time in Sequential Movements," PLOS ONE, Public Library of Science, vol. 4(12), pages 1-13, December.
    3. Frederick Callaway & Antonio Rangel & Thomas L Griffiths, 2021. "Fixation patterns in simple choice reflect optimal information sampling," PLOS Computational Biology, Public Library of Science, vol. 17(3), pages 1-29, March.
    4. Todd E Hudson & Hadley Tassinari & Michael S Landy, 2010. "Compensation for Changing Motor Uncertainty," PLOS Computational Biology, Public Library of Science, vol. 6(11), pages 1-14, November.
    5. Camille Morvan & Laurence T Maloney, 2012. "Human Visual Search Does Not Maximize the Post-Saccadic Probability of Identifying Targets," PLOS Computational Biology, Public Library of Science, vol. 8(2), pages 1-11, February.
    6. Emre Akbas & Miguel P Eckstein, 2017. "Object detection through search with a foveated visual system," PLOS Computational Biology, Public Library of Science, vol. 13(10), pages 1-28, October.
    7. Todd E Hudson & Uta Wolfe & Laurence T Maloney, 2012. "Speeded Reaching Movements around Invisible Obstacles," PLOS Computational Biology, Public Library of Science, vol. 8(9), pages 1-9, September.
    8. Constantin Carapencea & Irina Mocanu, 2015. "Real-Time Gaze Tracking With A Single Camera," Romanian Economic Business Review, Romanian-American University, vol. 9(1), pages 37-49, May.
    9. Michel Wedel & Rik Pieters & Ralf Lans, 2023. "Modeling Eye Movements During Decision Making: A Review," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 697-729, June.
    10. Sheng Zhang & Miguel P Eckstein, 2010. "Evolution and Optimality of Similar Neural Mechanisms for Perception and Action during Search," PLOS Computational Biology, Public Library of Science, vol. 6(9), pages 1-11, September.
    11. Sang-Hoon Yeo & David W Franklin & Daniel M Wolpert, 2016. "When Optimal Feedback Control Is Not Enough: Feedforward Strategies Are Required for Optimal Control with Active Sensing," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-22, December.
    12. Hang Zhang & Nathaniel D Daw & Laurence T Maloney, 2013. "Testing Whether Humans Have an Accurate Model of Their Own Motor Uncertainty in a Speeded Reaching Task," PLOS Computational Biology, Public Library of Science, vol. 9(5), pages 1-11, May.
    13. Niklas Wilming & Simon Harst & Nico Schmidt & Peter König, 2013. "Saccadic Momentum and Facilitation of Return Saccades Contribute to an Optimal Foraging Strategy," PLOS Computational Biology, Public Library of Science, vol. 9(1), pages 1-13, January.
    14. Luigi Acerbi & Daniel M Wolpert & Sethu Vijayakumar, 2012. "Internal Representations of Temporal Statistics and Feedback Calibrate Motor-Sensory Interval Timing," PLOS Computational Biology, Public Library of Science, vol. 8(11), pages 1-19, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1002718. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.