Author
Listed:
- Na Guo
(School of Computer Science in Addition, Engineering, Northeastern University, Shenyang 110169, China
School of Computer Science, Shenyang Aerospace University, Shenyang 110136, China
These authors contributed equally to this work.)
- Yaqi Wang
(School of Computer Science, Shenyang Aerospace University, Shenyang 110136, China
These authors contributed equally to this work.)
- Haonan Jiang
(School of Computer Science, Shenyang Aerospace University, Shenyang 110136, China)
- Xiufeng Xia
(School of Computer Science, Shenyang Aerospace University, Shenyang 110136, China)
- Yu Gu
(School of Computer Science in Addition, Engineering, Northeastern University, Shenyang 110169, China)
Abstract
In the growing mass of social media data, how to efficiently extract the collection of interested concerns has become a research hotspot. Due to the large size and regularity of social media data, traditional indexing techniques are not applicable. Our “Learned Index”, which is a part of social media intelligence solutions, uses mathematical principles to summarize the laws from the data. It predicts the location of the data by learning the mathematical properties of the data distribution to build the model. Although existing methods over single dimension and multi-dimension such as setting gaps are proposed to further optimize the performance of index, they do not consider the update-distribution of data. In this paper, we propose an update-distribution-aware learned index for social media data (TALI) to support update operations and handle the data sliding. In TALI, underlying data are learned through machine learning models, and a recursive hierarchical model is built. It also learns the update-distribution of data to adjust the size of each leaf node. Thus, it can more effectively support all kinds of operations in databases due to the decrease of the leaf nodes’ sliding. In addition, TALI uses the model-based insertion method for bulkload and query, resulting in a small prediction error. Thus, exponential search is used to perform secondary lookup to improve query efficiency. Experiments were tested and compared on four realistic and synthetic social media datasets. Through extensive experiments, TALI performed better than the existing state-of-the-art learned index with less space occupancy on four realistic and synthetic social media datasets.
Suggested Citation
Na Guo & Yaqi Wang & Haonan Jiang & Xiufeng Xia & Yu Gu, 2022.
"TALI: An Update-Distribution-Aware Learned Index for Social Media Data,"
Mathematics, MDPI, vol. 10(23), pages 1-19, November.
Handle:
RePEc:gam:jmathe:v:10:y:2022:i:23:p:4507-:d:987529
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:10:y:2022:i:23:p:4507-:d:987529. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.