IDEAS home Printed from https://ideas.repec.org/a/inm/orinte/v48y2018i2p130-146.html
   My bibliography  Save this article

Improving U.S. Navy Campaign Analyses with Big Data

Author

Listed:
  • Brian L. Morgan

    (Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Harrison C. Schramm

    (CANA Advisors, Pacific Grove, California 93950)

  • Jerry R. Smith, Jr.

    (Naval Surface Warfare Center, Bethesda, Maryland 20817)

  • Thomas W. Lucas

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Mary L. McDonald

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Paul J. Sánchez

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Susan M. Sanchez

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Stephen C. Upton

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

Abstract

Decisions and investments made today determine the assets and capabilities of the U.S. Navy for decades to come. The nation has many options about how best to equip, organize, supply, maintain, train, and employ our naval forces. These decisions involve large sums of money and impact our national security. Navy leadership uses simulation-based campaign analysis to measure risk for these investment options. Campaign simulations, such as the Synthetic Theater Operations Research Model (STORM), are complex models that generate enormous amounts of data. Finding causal threads and consistent trends within campaign analysis is inherently a big data problem. We outline the business and technical approach used to quantify the various investment risks for senior decision makers. Specifically, we present the managerial approach and controls used to generate studies that withstand scrutiny and maintain a strict study timeline. We then describe STORMMiner, a suite of automated postprocessing tools developed to support campaign analysis, and provide illustrative results from a notional STORM training scenario. This new approach has yielded tangible benefits. It substantially reduces the time and cost of campaign analysis studies, reveals insights that were previously difficult for analysts to detect, and improves the testing and vetting of the study. Consequently, the resulting risk assessment and recommendations are more useful to leadership. The managerial approach has also improved cooperation and coordination between the Navy and its analytic partners.

Suggested Citation

  • Brian L. Morgan & Harrison C. Schramm & Jerry R. Smith, Jr. & Thomas W. Lucas & Mary L. McDonald & Paul J. Sánchez & Susan M. Sanchez & Stephen C. Upton, 2018. "Improving U.S. Navy Campaign Analyses with Big Data," Interfaces, INFORMS, vol. 48(2), pages 130-146, April.
    • Handle: RePEc:inm:orinte:v:48:y:2018:i:2:p:130-146
    DOI: 10.1287/inte.2017.0900
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/inte.2017.0900
    Download Restriction: no
    File URL: https://libkey.io/10.1287/inte.2017.0900?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jack P.C. Kleijnen, 2015. "Design and Analysis of Simulation Experiments," International Series in Operations Research and Management Science, Springer, edition 2, number 978-3-319-18087-8, April.
    2. James S. Hodges, 1991. "Six (Or So) Things You Can Do with a Bad Model," Operations Research, INFORMS, vol. 39(3), pages 355-365, June.
    3. Thomas W. Lucas & W. David Kelton & Paul J. Sánchez & Susan M. Sanchez & Ben L. Anderson, 2015. "Changing the paradigm: Simulation, now a method of first resort," Naval Research Logistics (NRL), John Wiley & Sons, vol. 62(4), pages 293-303, June.
    4. M Kress & I Talmor, 1999. "A new look at the 3:1 rule of combat through Markov Stochastic Lanchester models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(7), pages 733-744, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Justin L Anderson & Jessica M Astudillo & Zachary E Butcher & Matthew D Cornman & Anthony J Correale & James B Crumpacker & Nathaniel C Dennie & Alex R Gaines & Mark A Gallagher & John C Goodwill & Em, 2023. "Stochastic preemptive goal programming of Air Force weapon systems mix," The Journal of Defense Modeling and Simulation, , vol. 20(2), pages 147-158, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wen Shi & Xi Chen & Jennifer Shang, 2019. "An Efficient Morris Method-Based Framework for Simulation Factor Screening," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 745-770, October.
    2. Tian, Wei & Song, Jitian & Li, Zhanyong & de Wilde, Pieter, 2014. "Bootstrap techniques for sensitivity analysis and model selection in building thermal performance analysis," Applied Energy, Elsevier, vol. 135(C), pages 320-328.
    3. Alfieri, Arianna & Matta, Andrea, 2012. "Mathematical programming formulations for approximate simulation of multistage production systems," European Journal of Operational Research, Elsevier, vol. 219(3), pages 773-783.
    4. Dellino, Gabriella & Kleijnen, Jack P.C. & Meloni, Carlo, 2010. "Robust optimization in simulation: Taguchi and Response Surface Methodology," International Journal of Production Economics, Elsevier, vol. 125(1), pages 52-59, May.
    5. Angun, M.E. & Kleijnen, Jack P.C., 2012. "An asymptotic test of optimality conditions in multiresponse simulation optimization," Other publications TiSEM a69dfa59-b0e1-45bd-8cd6-a, Tilburg University, School of Economics and Management.
    6. Jack P. C. Kleijnen & Susan M. Sanchez & Thomas W. Lucas & Thomas M. Cioppa, 2005. "State-of-the-Art Review: A User’s Guide to the Brave New World of Designing Simulation Experiments," INFORMS Journal on Computing, INFORMS, vol. 17(3), pages 263-289, August.
    7. Ken R. McNaught, 2002. "Markovian models of three‐on‐one combat involving a hidden defender," Naval Research Logistics (NRL), John Wiley & Sons, vol. 49(7), pages 627-646, October.
    8. Jack P. C. Kleijnen, 2017. "Comment on Park et al.’s “Robust Kriging in computer experiments”," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(6), pages 739-740, June.
    9. Kleijnen, Jack P.C., 2009. "Kriging metamodeling in simulation: A review," European Journal of Operational Research, Elsevier, vol. 192(3), pages 707-716, February.
    10. Kleijnen, Jack P.C. & Ridder, A.A.N. & Rubinstein, R.Y., 2010. "Variance Reduction Techniques in Monte Carlo Methods," Other publications TiSEM 87680d1a-53c1-4107-ada4-7, Tilburg University, School of Economics and Management.
    11. Martin, Rebecca & Lazakis, Iraklis & Barbouchi, Sami & Johanning, Lars, 2016. "Sensitivity analysis of offshore wind farm operation and maintenance cost and availability," Renewable Energy, Elsevier, vol. 85(C), pages 1226-1236.
    12. Manuel Chica & Joaquín Bautista & Jesica de Armas, 2019. "Benefits of robust multiobjective optimization for flexible automotive assembly line balancing," Flexible Services and Manufacturing Journal, Springer, vol. 31(1), pages 75-103, March.
    13. Doole, Graeme J. & Romera, Alvaro J., 2014. "Cost-effective regulation of nonpoint emissions from pastoral agriculture: a stochastic analysis," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 58(3), July.
    14. Pettit, L. I. & Wiper, M. P. & Young, K. D. S., 2003. "Bayesian inference for some Lanchester combat laws," European Journal of Operational Research, Elsevier, vol. 148(1), pages 152-165, July.
    15. Frederic H. Murphy, 2005. "ASP, The Art and Science of Practice: Elements of a Theory of the Practice of Operations Research: Expertise in Practice," Interfaces, INFORMS, vol. 35(4), pages 313-322, August.
    16. Kleijnen, Jack P.C. & van Beers, W.C.M. & van Nieuwenhuyse, I., 2011. "Expected Improvement in Efficient Global Optimization Through Bootstrapped Kriging - Replaces CentER DP 2010-62," Discussion Paper 2011-015, Tilburg University, Center for Economic Research.
    17. Kleijnen, J.P.C., 2008. "Design of Experiments : An Overview," Discussion Paper 2008-70, Tilburg University, Center for Economic Research.
    18. Kleijnen, Jack P.C. & Mehdad, E., 2013. "Conditional simulation for efficient global optimization," Other publications TiSEM 52e4860d-9887-4a63-b19a-7, Tilburg University, School of Economics and Management.
    19. Morin, Michael & Gaudreault, Jonathan & Brotherton, Edith & Paradis, Frédérik & Rolland, Amélie & Wery, Jean & Laviolette, François, 2020. "Machine learning-based models of sawmills for better wood allocation planning," International Journal of Production Economics, Elsevier, vol. 222(C).
    20. Anne E. Dohmen & Jason R. W. Merrick & Lance W. Saunders & Theodore P. Stank & Thomas J. Goldsby, 2023. "When preemptive risk mitigation is insufficient: The effectiveness of continuity and resilience techniques during COVID‐19," Production and Operations Management, Production and Operations Management Society, vol. 32(5), pages 1529-1549, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orinte:v:48:y:2018:i:2:p:130-146. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.