IDEAS home Printed from https://ideas.repec.org/a/inm/orijoc/v34y2022i5p2583-2610.html
   My bibliography  Save this article

Optimal Frameworks for Detecting Anomalies in Sensor-Intensive Heterogeneous Networks

Author

Listed:
  • Ramin Moghaddass

    (Department of Industrial and Systems Engineering, University of Miami, Coral Gables, Florida 33146; Department of Management Science, Miami Herbert Business School, University of Miami, Coral Gables, Florida 33146)

  • Yongtao Guan

    (Department of Management Science, Miami Herbert Business School, University of Miami, Coral Gables, Florida 33146)

Abstract

Many network/graph structures are continuously monitored by various sensors that are placed at a subset of nodes and edges. The multidimensional data collected from these sensors over time create large-scale graph data in which the data points are highly dependent. Monitoring large-scale attributed networks with thousands of nodes and heterogeneous sensor data to detect anomalies and unusual events is a complex and computationally expensive process. This paper introduces a new generic approach inspired by state-space models for network anomaly detection that can utilize the information from the network topology, the node attributes (sensor data), and the anomaly propagation sets in an integrated manner to analyze the entire network all at once. This article presents how heterogeneous network sensor data can be analyzed to locate the sources of anomalies as well as the anomalous regions in a network, which can be impacted by one or multiple anomalies at any time instance. Experimental results demonstrate the superior performance of our proposed framework in detecting anomalies in attributed graphs. Summary of Contribution: With the increasing availability of large-scale network sensors and rapid advances in artificial intelligence methods, fundamentally new analytical tools are needed that can integrate data collected from sensors across the networks for decision making while taking into account the stochastic and topological dependencies between nodes, sensors, and anomalies. This paper develops a framework to intelligently and efficiently analyze complex and highly dependent data collected from disparate sensors across large-scale network/graph structures to detect anomalies and abnormal behavior in real time. Unlike general purpose (often black-box) machine learning models, this paper proposes a unique framework for network/graph structures that incorporates the complexities of networks and interdependencies between network entities and sensors. Because of the multidisciplinary nature of the paper that involves optimization, machine learning, and system monitoring and control, it can help researchers in both operations research and computer science domains to develop new network-specific computing tools and machine learning frameworks to efficiently manage large-scale network data.

Suggested Citation

  • Ramin Moghaddass & Yongtao Guan, 2022. "Optimal Frameworks for Detecting Anomalies in Sensor-Intensive Heterogeneous Networks," INFORMS Journal on Computing, INFORMS, vol. 34(5), pages 2583-2610, September.
  • Handle: RePEc:inm:orijoc:v:34:y:2022:i:5:p:2583-2610
    DOI: 10.1287/ijoc.2022.1192
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/ijoc.2022.1192
    Download Restriction: no

    File URL: https://libkey.io/10.1287/ijoc.2022.1192?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Carey E. Priebe & John M. Conroy & David J. Marchette & Youngser Park, 2005. "Scan Statistics on Enron Graphs," Computational and Mathematical Organization Theory, Springer, vol. 11(3), pages 229-247, October.
    2. Ariyaluran Habeeb, Riyaz Ahamed & Nasaruddin, Fariza & Gani, Abdullah & Targio Hashem, Ibrahim Abaker & Ahmed, Ejaz & Imran, Muhammad, 2019. "Real-time big data processing for anomaly detection: A Survey," International Journal of Information Management, Elsevier, vol. 45(C), pages 289-307.
    3. Pierre Brice & Wei Jiang & Guohua Wan, 2011. "A Cluster-Based Context-Tree Model for Multivariate Data Streams with Applications to Anomaly Detection," INFORMS Journal on Computing, INFORMS, vol. 23(3), pages 364-376, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jana Diesner & Terrill L. Frantz & Kathleen M. Carley, 2005. "Communication Networks from the Enron Email Corpus “It's Always About the People. Enron is no Different”," Computational and Mathematical Organization Theory, Springer, vol. 11(3), pages 201-228, October.
    2. Xin Li & Kun Chen & Sherry X. Sun & Terrance Fung & Huaiqing Wang & Daniel D. Zeng, 2016. "A Commonsense Knowledge-Enabled Textual Analysis Approach for Financial Market Surveillance," INFORMS Journal on Computing, INFORMS, vol. 28(2), pages 278-294, May.
    3. Mi, Yunlong & Wang, Zongrun & Quan, Pei & Shi, Yong, 2024. "A semi-supervised concept-cognitive computing system for dynamic classification decision making with limited feedback information," European Journal of Operational Research, Elsevier, vol. 315(3), pages 1123-1138.
    4. Grothendieck, John & Priebe, Carey E. & Gorin, Allen L., 2010. "Statistical inference on attributed random graphs: Fusion of graph features and content," Computational Statistics & Data Analysis, Elsevier, vol. 54(7), pages 1777-1790, July.
    5. Ze Li & Duoyong Sun & Renqi Zhu & Zihan Lin, 2017. "Detecting event-related changes in organizational networks using optimized neural network models," PLOS ONE, Public Library of Science, vol. 12(11), pages 1-21, November.
    6. Iftikhar Ahmad & Qazi Emad Ul Haq & Muhammad Imran & Madini O. Alassafi & Rayed A. AlGhamdi, 2022. "An Efficient Network Intrusion Detection and Classification System," Mathematics, MDPI, vol. 10(3), pages 1-15, February.
    7. Ransome Epie Bawack & Samuel Fosso Wamba & Kevin Daniel André Carillo & Shahriar Akter, 2022. "Artificial intelligence in E-Commerce: a bibliometric study and literature review," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 297-338, March.
    8. Raymond Y. K. Lau & J. Leon Zhao & Wenping Zhang & Yi Cai & Eric W. T. Ngai, 2015. "Learning Context-Sensitive Domain Ontologies from Folksonomies: A Cognitively Motivated Method," INFORMS Journal on Computing, INFORMS, vol. 27(3), pages 561-578, August.
    9. N. Lee & C. Priebe, 2011. "A latent process model for time series of attributed random graphs," Statistical Inference for Stochastic Processes, Springer, vol. 14(3), pages 231-253, October.
    10. Mi, Yunlong & Wang, Zongrun & Liu, Hui & Qu, Yi & Yu, Gaofeng & Shi, Yong, 2023. "Divide and conquer: A granular concept-cognitive computing system for dynamic classification decision making," European Journal of Operational Research, Elsevier, vol. 308(1), pages 255-273.
    11. Anurat Chapanond & Mukkai S. Krishnamoorthy & Bülent Yener, 2005. "Graph Theoretic and Spectral Analysis of Enron Email Data," Computational and Mathematical Organization Theory, Springer, vol. 11(3), pages 265-281, October.
    12. Joseph Crawford & Tijana Milenković, 2018. "ClueNet: Clustering a temporal network based on topological similarity rather than denseness," PLOS ONE, Public Library of Science, vol. 13(5), pages 1-25, May.
    13. Priebe, Carey E. & Park, Youngser & Marchette, David J. & Conroy, John M. & Grothendieck, John & Gorin, Allen L., 2010. "Statistical inference on attributed random graphs: Fusion of graph features and content: An experiment on time series of Enron graphs," Computational Statistics & Data Analysis, Elsevier, vol. 54(7), pages 1766-1776, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orijoc:v:34:y:2022:i:5:p:2583-2610. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.