IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v5y2015i4p2158244015611937.html
   My bibliography  Save this article

A Novel Approach for Allocating Mathematical Expressions to Visual Speech Signals

Author

Listed:
  • Mohammad Hossein Sadaghiani
  • Niusha Shafiabady
  • Dino Isa

Abstract

In this article, visual speech information modeling analysis by explicit mathematical expressions coupled with words’ phonemic structure is presented. The visual information is obtained from deformation of lips’ dimensions during articulation of a set of words that is called visual speech sample set. The continuous interpretation of the lips’ movement has been provided using Barycentric Lagrange Interpolation producing a unique mathematical expression named visual speech signal. Hierarchical analysis of the phoneme sequences has been applied for words’ categorization to organize the database properly. The visual samples were extracted from three visual feature points chosen on the lips via an experiment in which two individuals pronounced the aforementioned words. The simulation results show that each individual word can be represented by a mathematical expression or visual speech signal whereas the sample sets can also be derived from the same mathematical expression, and this is a significant improvement over the popular statistical methods.

Suggested Citation

  • Mohammad Hossein Sadaghiani & Niusha Shafiabady & Dino Isa, 2015. "A Novel Approach for Allocating Mathematical Expressions to Visual Speech Signals," SAGE Open, , vol. 5(4), pages 21582440156, October.
    • Handle: RePEc:sae:sagope:v:5:y:2015:i:4:p:2158244015611937
    DOI: 10.1177/2158244015611937
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/2158244015611937
    Download Restriction: no
    File URL: https://libkey.io/10.1177/2158244015611937?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:5:y:2015:i:4:p:2158244015611937. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.