IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v16y2024i3p95-d1355061.html
   My bibliography  Save this article

Personalized Federated Learning with Adaptive Feature Extraction and Category Prediction in Non-IID Datasets

Author

Listed:
  • Ying-Hsun Lai

    (Department of Computer Science and Information Engineering, National Taitung University, Taitung 950309, Taiwan)

  • Shin-Yeh Chen

    (Department of Computer Science and Engineering, National Taiwan Ocean University, Keelung 202301, Taiwan)

  • Wen-Chi Chou

    (Taiwan Semiconductor Manufacturing Company, Hsinchu 300096, Taiwan)

  • Hua-Yang Hsu

    (School of Electronic and Computer Engineering (SECE), Peking University Shenzhen Graduate School, Shenzhen 518055, China)

  • Han-Chieh Chao

    (Department of Electrical Engineering, National Dong Hwa University, Hualien 974301, Taiwan
    Computer Science and Innovation, UCSI University, Kuala Lumpur 56000, Malaysia
    Department of Artificial Intelligence, Tamkang University, New Taipei City 251301, Taiwan)

Abstract

Federated learning trains a neural network model using the client’s data to maintain the benefits of centralized model training while maintaining their privacy. However, if the client data are not independently and identically distributed (non-IID) because of different environments, the accuracy of the model may suffer from client drift during training owing to discrepancies in each client’s data. This study proposes a personalized federated learning algorithm based on the concept of multitask learning to divide each client model into two layers: a feature extraction layer and a category prediction layer. The feature extraction layer maps the input data to a low-dimensional feature vector space. Furthermore, the parameters of the neural network are aggregated with those of other clients using an adaptive method. The category prediction layer maps low-dimensional feature vectors to the label sample space, with its parameters remaining unaffected by other clients to maintain client uniqueness. The proposed personalized federated learning method produces faster learning model convergence rates and higher accuracy rates for the non-IID datasets in our experiments.

Suggested Citation

  • Ying-Hsun Lai & Shin-Yeh Chen & Wen-Chi Chou & Hua-Yang Hsu & Han-Chieh Chao, 2024. "Personalized Federated Learning with Adaptive Feature Extraction and Category Prediction in Non-IID Datasets," Future Internet, MDPI, vol. 16(3), pages 1-13, March.
  • Handle: RePEc:gam:jftint:v:16:y:2024:i:3:p:95-:d:1355061
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/16/3/95/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1999-5903/16/3/95/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fotis Nikolaidis & Moysis Symeonides & Demetris Trihinas, 2023. "Towards Efficient Resource Allocation for Federated Learning in Virtualized Managed Environments," Future Internet, MDPI, vol. 15(8), pages 1-26, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qiang Duan & Zhihui Lu, 2024. "Edge Cloud Computing and Federated–Split Learning in Internet of Things," Future Internet, MDPI, vol. 16(7), pages 1-4, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:16:y:2024:i:3:p:95-:d:1355061. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.