IDEAS home Printed from https://ideas.repec.org/a/pal/palcom/v9y2022i1d10.1057_s41599-022-01131-6.html
   My bibliography  Save this article

Manipulating image luminance to improve eye gaze and verbal behavior in autistic children

Author

Listed:
  • LouAnne Boyd

    (Chapman University)

  • Vincent Berardi

    (Chapman University)

  • Deanna Hughes

    (Chapman University)

  • Franceli Cibrian

    (Chapman University)

  • Jazette Johnson

    (University of California)

  • Viseth Sean

    (Chapman University)

  • Eliza DelPizzo-Cheng

    (Endicott College)

  • Brandon Mackin

    (Chapman University)

  • Ayra Tusneem

    (Chapman University)

  • Riya Mody

    (Chapman University)

  • Sara Jones

    (Speech and Language Development Center)

  • Karen Lotich

    (Speech and Language Development Center)

Abstract

Autism has been characterized by a tendency to attend to the local visual details over surveying an image to understand the gist–a phenomenon called local interference. This sensory processing trait has been found to negatively impact social communication. Although much work has been conducted to understand these traits, little to no work has been conducted to intervene to provide support for local interference. Additionally, recent understanding of autism now introduces the core role of sensory processing and its impact on social communication. However, no interventions to the end of our knowledge have been explored to leverage this relationship. This work builds on the connection between visual attention and semantic representation in autistic children. In this work, we ask the following research questions: RQ1: Does manipulating image characteristics of luminance and spatial frequency increase likelihood of fixations in hot spots (Areas of Interest) for autistic children? RQ2: Does manipulating low-level image characteristics of luminance and spatial frequency increase the likelihood of global verbal responses for autistic children? We sought to manipulate visual attention as measured by eye gaze fixations and semantic representation of verbal response to the question “What is this picture about?”. We explore digital strategies to offload low-level, sensory processing of global features via digital filtering. In this work, we designed a global filter to reduce image characteristics found to be distracting for autistic people and compared baseline images to featured images in 11 autistic children. Participants saw counterbalanced images way over 2 sessions. Eye gaze in areas of interest and verbal responses were collected and analyzed. We found that luminance in non-salient areas impacted both eye gaze and verbal responding–however in opposite ways (however versus high levels of luminance). Additionally, the interaction of luminance and spatial frequency in areas of interest is also significant. This is the first empirical study in designing an assistive technology aimed to augment global processing that occurs at a sensory-processing and social-communication level. Contributions of this work include empirical findings regarding the quantification of local interference in images of natural scenes for autistic children in real-world settings; digital methods to offload global visual processing to make this information more accessible via insight on the role of luminance and spatial frequency in visual perception of and semantic representation in images of natural scenes.

Suggested Citation

  • LouAnne Boyd & Vincent Berardi & Deanna Hughes & Franceli Cibrian & Jazette Johnson & Viseth Sean & Eliza DelPizzo-Cheng & Brandon Mackin & Ayra Tusneem & Riya Mody & Sara Jones & Karen Lotich, 2022. "Manipulating image luminance to improve eye gaze and verbal behavior in autistic children," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-9, December.
    • Handle: RePEc:pal:palcom:v:9:y:2022:i:1:d:10.1057_s41599-022-01131-6
    DOI: 10.1057/s41599-022-01131-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41599-022-01131-6
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1057/s41599-022-01131-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John Liechty & Rik Pieters & Michel Wedel, 2003. "Global and local covert visual attention: Evidence from a bayesian hidden markov model," Psychometrika, Springer;The Psychometric Society, vol. 68(4), pages 519-541, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sam Hui & Eric Bradlow, 2012. "Bayesian multi-resolution spatial analysis with applications to marketing," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 419-452, December.
    2. Krucien, Nicolas & Ryan, Mandy & Hermens, Frouke, 2017. "Visual attention in multi-attributes choices: What can eye-tracking tell us?," Journal of Economic Behavior & Organization, Elsevier, vol. 135(C), pages 251-267.
    3. Savannah Wei Shi & Michel Wedel & F. G. M. (Rik) Pieters, 2013. "Information Acquisition During Online Decision Making: A Model-Based Exploration Using Eye-Tracking Data," Management Science, INFORMS, vol. 59(5), pages 1009-1026, May.
    4. Lemmens, Aurélie & Croux, Christophe & Stremersch, Stefan, 2012. "Dynamics in the international market segmentation of new product growth," International Journal of Research in Marketing, Elsevier, vol. 29(1), pages 81-92.
    5. Jerzy Grobelny & Rafal Michalski, 2017. "Applying hidden Markov models to visual activity analysis for simple digital control panel operations," WORking papers in Management Science (WORMS) WORMS/17/06, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    6. Ricardo Montoya & Oded Netzer & Kamel Jedidi, 2010. "Dynamic Allocation of Pharmaceutical Detailing and Sampling for Long-Term Profitability," Marketing Science, INFORMS, vol. 29(5), pages 909-924, 09-10.
    7. Michel Wedel & Rik Pieters & Ralf Lans, 2023. "Modeling Eye Movements During Decision Making: A Review," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 697-729, June.
    8. Erik Reichle & Jessica Nelson, 2003. "Local vs. global covert visual attention: Are two states necessary? Comment on Liechty et al., 2003," Psychometrika, Springer;The Psychometric Society, vol. 68(4), pages 543-549, December.
    9. Eric M. Schwartz & Eric T. Bradlow & Peter S. Fader, 2014. "Model Selection Using Database Characteristics: Developing a Classification Tree for Longitudinal Incidence Data," Marketing Science, INFORMS, vol. 33(2), pages 188-205, March.
    10. Clarence Lee & Elie Ofek & Thomas J. Steenburgh, 2018. "Personal and Social Usage: The Origins of Active Customers and Ways to Keep Them Engaged," Management Science, INFORMS, vol. 64(6), pages 2473-2495, June.
    11. John R. Hauser & Glen L. Urban & Guilherme Liberali & Michael Braun, 2009. "Website Morphing," Marketing Science, INFORMS, vol. 28(2), pages 202-223, 03-04.
    12. Oded Netzer & Olivier Toubia & Eric Bradlow & Ely Dahan & Theodoros Evgeniou & Fred Feinberg & Eleanor Feit & Sam Hui & Joseph Johnson & John Liechty & James Orlin & Vithala Rao, 2008. "Beyond conjoint analysis: Advances in preference measurement," Marketing Letters, Springer, vol. 19(3), pages 337-354, December.
    13. Savannah Wei Shi & Hai Che & Lang Jin, 2021. "Strategic Product Displays Across Different Assortment Levels," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 8(3), pages 84-101, September.
    14. V. Kumar & S. Sriram & Anita Luo & Pradeep K. Chintagunta, 2011. "Assessing the Effect of Marketing Investments in a Business Marketing Context," Marketing Science, INFORMS, vol. 30(5), pages 924-940, September.
    15. Martinovici, A., 2019. "Revealing attention - how eye movements predict brand choice and moment of choice," Other publications TiSEM 7dca38a5-9f78-4aee-bd81-c, Tilburg University, School of Economics and Management.
    16. Peter Stüttgen & Peter Boatwright & Robert T. Monroe, 2012. "A Satisficing Choice Model," Marketing Science, INFORMS, vol. 31(6), pages 878-899, November.
    17. Berna Haktanirlar Ulutas & N. Fırat Özkan & Rafał Michalski, 2020. "Application of hidden Markov models to eye tracking data analysis of visual quality inspection operations," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 28(2), pages 761-777, June.
    18. Yegoryan, Narine & Guhl, Daniel & Klapper, Daniel, 2018. "Inferring Attribute Non-Attendance Using Eye Tracking in Choice-Based Conjoint Analysis," Rationality and Competition Discussion Paper Series 111, CRC TRR 190 Rationality and Competition.
    19. Lemmens, A. & Croux, C. & Stremersch, S., 2012. "Dynamics in international market segmentation of new product growth," Other publications TiSEM 306086bd-670f-48d2-97d1-3, Tilburg University, School of Economics and Management.
    20. Ralf van der Lans & Rik Pieters & Michel Wedel, 2008. "—Competitive Brand Salience," Marketing Science, INFORMS, vol. 27(5), pages 922-931, 09-10.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:palcom:v:9:y:2022:i:1:d:10.1057_s41599-022-01131-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: https://www.nature.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.