IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0159376.html
   My bibliography  Save this article

A Method for Non-Rigid Face Alignment via Combining Local and Holistic Matching

Author

Listed:
  • Yang Yang
  • Shaoyi Du
  • Zhuo Chen

Abstract

We propose a method for non-rigid face alignment which only needs a single template, such as using a person’s smile face to match his surprise face. First, in order to be robust to outliers caused by complex geometric deformations, a new local feature matching method called K Patch Pairs (K-PP) is proposed. Specifically, inspired by the state-of-art similarity measure used in template matching, K-PP is to find the mutual K nearest neighbors between two images. A weight matrix is then presented to balance the similarity and the number of local matching. Second, we proposed a modified Lucas-Kanade algorithm combined with local matching constraint to solve the non-rigid face alignment, so that a holistic face representation and local features can be jointly modeled in the object function. Both the flexible ability of local matching and the robust ability of holistic fitting are included in our method. Furthermore, we show that the optimization problem can be efficiently solved by the inverse compositional algorithm. Comparison results with conventional methods demonstrate our superiority in terms of both accuracy and robustness.

Suggested Citation

  • Yang Yang & Shaoyi Du & Zhuo Chen, 2016. "A Method for Non-Rigid Face Alignment via Combining Local and Holistic Matching," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-14, August.
    • Handle: RePEc:plo:pone00:0159376
    DOI: 10.1371/journal.pone.0159376
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0159376
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0159376&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0159376?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Scott P Jones & Dominic M Dwyer & Michael B Lewis, 2015. "Learning Faces: Similar Comparator Faces Do Not Improve Performance," PLOS ONE, Public Library of Science, vol. 10(1), pages 1-21, January.
    2. Zhan-Li Sun & Kin-Man Lam & Zhao-Yang Dong & Han Wang & Qing-Wei Gao & Chun-Hou Zheng, 2013. "Face Recognition with Multi-Resolution Spectral Feature Images," PLOS ONE, Public Library of Science, vol. 8(2), pages 1-12, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ya-Ping Wang & Zhan-Li Sun & Kin-Man Lam, 2015. "An Effective Approach for NRSFM of Small-Size Image Sequences," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-20, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0159376. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.