IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v16y2024i7p224-d1422321.html
   My bibliography  Save this article

Evaluating Quantized Llama 2 Models for IoT Privacy Policy Language Generation

Author

Listed:
  • Bhavani Malisetty

    (Department of Computer Science, University of Nebraska at Omaha, Omaha, NE 68182, USA)

  • Alfredo J. Perez

    (Department of Computer Science, University of Nebraska at Omaha, Omaha, NE 68182, USA)

Abstract

Quantized large language models are large language models (LLMs) optimized for model size while preserving their efficacy. They can be executed on consumer-grade computers without the powerful features of dedicated servers needed to execute regular (non-quantized) LLMs. Because of their ability to summarize, answer questions, and provide insights, LLMs are being used to analyze large texts/documents. One of these types of large texts/documents are Internet of Things (IoT) privacy policies, which are documents specifying how smart home gadgets, health-monitoring wearables, and personal voice assistants (among others) collect and manage consumer/user data on behalf of Internet companies providing services. Even though privacy policies are important, they are difficult to comprehend due to their length and how they are written, which makes them attractive for analysis using LLMs. This study evaluates how quantized LLMs are modeling the language of privacy policies to be potentially used to transform IoT privacy policies into simpler, more usable formats, thus aiding comprehension. While the long-term goal is to achieve this usable transformation, our work focuses on evaluating quantized LLM models used for IoT privacy policy language. Particularly, we study 4-bit, 5-bit, and 8-bit quantized versions of the large language model Meta AI version 2 (Llama 2) and the base Llama 2 model (zero-shot, without fine-tuning) under different metrics and prompts to determine how well these quantized versions model the language of IoT privacy policy documents by completing and generating privacy policy text.

Suggested Citation

  • Bhavani Malisetty & Alfredo J. Perez, 2024. "Evaluating Quantized Llama 2 Models for IoT Privacy Policy Language Generation," Future Internet, MDPI, vol. 16(7), pages 1-17, June.
  • Handle: RePEc:gam:jftint:v:16:y:2024:i:7:p:224-:d:1422321
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/16/7/224/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1999-5903/16/7/224/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Francesco Contu & Andrea Demontis & Stefano Dessì & Marco Muscas & Daniele Riboni, 2021. "AI-Based Analysis of Policies and Images for Privacy-Conscious Content Sharing," Future Internet, MDPI, vol. 13(6), pages 1-21, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roberto Saia & Salvatore Carta & Olaf Bergmann, 2021. "Wireless Internet, Multimedia, and Artificial Intelligence: New Applications and Infrastructures," Future Internet, MDPI, vol. 13(9), pages 1-3, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:16:y:2024:i:7:p:224-:d:1422321. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.