IDEAS home Printed from https://ideas.repec.org/a/spr/jcsosc/v7y2024i2d10.1007_s42001-024-00293-4.html
   My bibliography  Save this article

A machine learning approach to detect collusion in public procurement with limited information

Author

Listed:
  • Bedri Kamil Onur Tas

    (Sultan Qaboos University)

Abstract

Public procurement spending reaches $9.5 trillion annually, yet bid-rigging remains a significant, undetected issue. Existing methods require detailed data often unavailable to competition authorities. Practitioners and researchers need effective and flexible tools with moderate data requirements to examine collusive behavior. This paper proposes a novel algorithm to detect collusion in auctions using readily available data about outcomes of public procurement processes. This method leverages theoretical findings about bidding behavior and machine learning algorithms. We demonstrate its effectiveness on data sets with known collusion cases (Italy, Japan, USA) and achieve superior results compared to traditional models. Further analyses on broader data sets encompassing Turkish and European contracts reveal a significant percentage (over 6% in Turkey, 4.5% in Europe) with high collusion probability. Collusion inflates procurement costs by 3-7%, highlighting the need for effective detection methods.

Suggested Citation

  • Bedri Kamil Onur Tas, 2024. "A machine learning approach to detect collusion in public procurement with limited information," Journal of Computational Social Science, Springer, vol. 7(2), pages 1913-1935, October.
    • Handle: RePEc:spr:jcsosc:v:7:y:2024:i:2:d:10.1007_s42001-024-00293-4
    DOI: 10.1007/s42001-024-00293-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s42001-024-00293-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s42001-024-00293-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jeremy Bulow & Paul Klemperer, 2002. "Prices and the Winner's Curse," RAND Journal of Economics, The RAND Corporation, vol. 33(1), pages 1-21, Spring.
    2. Hiroshi Ohashi, 2009. "Effects of Transparency in Procurement Practices on Government Expenditure: A Case Study of Municipal Public Works," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 34(3), pages 267-285, May.
    3. Huber, Martin & Imhof, David, 2019. "Machine learning with screens for detecting bid-rigging cartels," International Journal of Industrial Organization, Elsevier, vol. 65(C), pages 277-301.
    4. Mats A. Bergman & Johan Lundberg & Sofia Lundberg & Johan Y. Stake, 2020. "Interactions Across Firms and Bid Rigging," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 56(1), pages 107-130, February.
    5. Susan Athey & Philip A. Haile, 2002. "Identification of Standard Auction Models," Econometrica, Econometric Society, vol. 70(6), pages 2107-2140, November.
    6. Hannes Wallimann & David Imhof & Martin Huber, 2023. "A Machine Learning Approach for Flagging Incomplete Bid-Rigging Cartels," Computational Economics, Springer;Society for Computational Economics, vol. 62(4), pages 1669-1720, December.
    7. Robert H. Porter & J. Douglas Zona, 1999. "Ohio School Milk Markets: An Analysis of Bidding," RAND Journal of Economics, The RAND Corporation, vol. 30(2), pages 263-288, Summer.
    8. Tong Li & Xiaoyong Zheng, 2009. "Entry and Competition Effects in First-Price Auctions: Theory and Evidence from Procurement Auctions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(4), pages 1397-1429.
    9. Emmanuel Guerre & Isabelle Perrigne & Quang Vuong, 2009. "Nonparametric Identification of Risk Aversion in First-Price Auctions Under Exclusion Restrictions," Econometrica, Econometric Society, vol. 77(4), pages 1193-1227, July.
    10. Bolotova, Yuliya & Connor, John M. & Miller, Douglas J., 2008. "The impact of collusion on price behavior: Empirical results from two recent cases," International Journal of Industrial Organization, Elsevier, vol. 26(6), pages 1290-1307, November.
    11. Johannes Wachs & J'anos Kert'esz, 2019. "A network approach to cartel detection in public auction markets," Papers 1906.08667, arXiv.org.
    12. Aryal, Gaurab & Gabrielli, Maria F., 2013. "Testing for collusion in asymmetric first-price auctions," International Journal of Industrial Organization, Elsevier, vol. 31(1), pages 26-35.
    13. Rieko Ishii, 2014. "Bid Roundness Under Collusion in Japanese Procurement Auctions," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 44(3), pages 241-254, May.
    14. Auriol, Emmanuelle & Straub, Stéphane & Flochel, Thomas, 2016. "Public Procurement and Rent-Seeking: The Case of Paraguay," World Development, Elsevier, vol. 77(C), pages 395-407.
    15. Patrick Bajari & Lixin Ye, 2003. "Deciding Between Competition and Collusion," The Review of Economics and Statistics, MIT Press, vol. 85(4), pages 971-989, November.
    16. Jeffrey M. Wooldridge, 2015. "Control Function Methods in Applied Econometrics," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 420-445.
    17. David Imhof & Yavuz Karagök & Samuel Rutz, 2018. "Screening For Bid Rigging—Does It Work?," Journal of Competition Law and Economics, Oxford University Press, vol. 14(2), pages 235-261.
    18. Martin Huber & David Imhof & Rieko Ishii, 2022. "Transnational machine learning with screens for flagging bid‐rigging cartels," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1074-1114, July.
    19. Timothy G. Conley & Francesco Decarolis, 2016. "Detecting Bidders Groups in Collusive Auctions," American Economic Journal: Microeconomics, American Economic Association, vol. 8(2), pages 1-38, May.
    20. Gugler, Klaus & Weichselbaumer, Michael & Zulehner, Christine, 2015. "Competition in the economic crisis: Analysis of procurement auctions," European Economic Review, Elsevier, vol. 73(C), pages 35-57.
    21. Arthur Lewbel, 2012. "Using Heteroscedasticity to Identify and Estimate Mismeasured and Endogenous Regressor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 67-80.
    22. Adam, Isabelle & Fazekas, Mihály, 2021. "Are emerging technologies helping win the fight against corruption? A review of the state of evidence," Information Economics and Policy, Elsevier, vol. 57(C).
    23. Hannes Wallimann & Silvio Sticher, 2023. "On suspicious tracks: machine-learning based approaches to detect cartels in railway-infrastructure procurement," Papers 2304.11888, arXiv.org.
    24. Huber, Martin & Imhof, David, 2023. "Flagging cartel participants with deep learning based on convolutional neural networks," International Journal of Industrial Organization, Elsevier, vol. 89(C).
    25. Hainmueller, Jens & Hazlett, Chad, 2014. "Kernel Regularized Least Squares: Reducing Misspecification Bias with a Flexible and Interpretable Machine Learning Approach," Political Analysis, Cambridge University Press, vol. 22(2), pages 143-168, April.
    26. John Asker, 2010. "A Study of the Internal Organization of a Bidding Cartel," American Economic Review, American Economic Association, vol. 100(3), pages 724-762, June.
    27. An, Yonghong & Hu, Yingyao & Shum, Matthew, 2010. "Estimating first-price auctions with an unknown number of bidders: A misclassification approach," Journal of Econometrics, Elsevier, vol. 157(2), pages 328-341, August.
    28. Billor, Nedret & Hadi, Ali S. & Velleman, Paul F., 2000. "BACON: blocked adaptive computationally efficient outlier nominators," Computational Statistics & Data Analysis, Elsevier, vol. 34(3), pages 279-298, September.
    29. Silveira, Douglas & de Moraes, Lucas B. & Fiuza, Eduardo P.S. & Cajueiro, Daniel O., 2023. "Who are you? Cartel detection using unlabeled data," International Journal of Industrial Organization, Elsevier, vol. 88(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hannes Wallimann & David Imhof & Martin Huber, 2023. "A Machine Learning Approach for Flagging Incomplete Bid-Rigging Cartels," Computational Economics, Springer;Society for Computational Economics, vol. 62(4), pages 1669-1720, December.
    2. Imhof, David & Wallimann, Hannes, 2021. "Detecting bid-rigging coalitions in different countries and auction formats," International Review of Law and Economics, Elsevier, vol. 68(C).
    3. Huber, Martin & Imhof, David, 2023. "Flagging cartel participants with deep learning based on convolutional neural networks," International Journal of Industrial Organization, Elsevier, vol. 89(C).
    4. Brown, David P. & Eckert, Andrew & Silveira, Douglas, 2023. "Screening for collusion in wholesale electricity markets: A literature review," Utilities Policy, Elsevier, vol. 85(C).
    5. Granlund, David & Rudholm, Niklas, 2023. "Calculating the probability of collusion based on observed price patterns," Umeå Economic Studies 1014, Umeå University, Department of Economics, revised 13 Oct 2023.
    6. Martin Huber & David Imhof & Rieko Ishii, 2022. "Transnational machine learning with screens for flagging bid‐rigging cartels," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1074-1114, July.
    7. Brown, David P. & Eckert, Andrew & Silveira, Douglas, 2023. "Screening for Collusion in Wholesale Electricity Markets: A Review of the Literature," Working Papers 2023-7, University of Alberta, Department of Economics.
    8. David Imhof & Hannes Wallimann, 2021. "Detecting bid-rigging coalitions in different countries and auction formats," Papers 2105.00337, arXiv.org.
    9. Silveira, Douglas & de Moraes, Lucas B. & Fiuza, Eduardo P.S. & Cajueiro, Daniel O., 2023. "Who are you? Cartel detection using unlabeled data," International Journal of Industrial Organization, Elsevier, vol. 88(C).
    10. de Leverano, Adriano, 2019. "Collusion through market sharing agreements: Evidence from Quebec's road paving market," ZEW Discussion Papers 19-053, ZEW - Leibniz Centre for European Economic Research.
    11. Clark, Robert & Coviello, Decio & de Leverano, Adriano, 2020. "Complementary bidding and the collusive arrangement: Evidence from an antitrust investigation," ZEW Discussion Papers 20-052, ZEW - Leibniz Centre for European Economic Research.
    12. Ilke Onur & Bedri Kamil Onur Tas, 2019. "Optimal bidder participation in public procurement auctions," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 26(3), pages 595-617, June.
    13. Garcia Pires, Armando J. & Skjeret, Frode, 2023. "Screening for partial collusion in retail electricity markets," Energy Economics, Elsevier, vol. 117(C).
    14. Johannes Wachs & J'anos Kert'esz, 2019. "A network approach to cartel detection in public auction markets," Papers 1906.08667, arXiv.org.
    15. Lamy, Laurent, 2012. "The econometrics of auctions with asymmetric anonymous bidders," Journal of Econometrics, Elsevier, vol. 167(1), pages 113-132.
    16. Robert Clark & Decio Coviello & Jean-Fran�ois Gauthier & Art Shneyerov, 2018. "Bid Rigging and Entry Deterrence in Public Procurement: Evidence from an Investigation into Collusion and Corruption in Quebec," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 34(3), pages 301-363.
    17. Gabrielli, M. Florencia & Willington, Manuel, 2023. "Estimating damages from bidding rings in first-price auctions," Economic Modelling, Elsevier, vol. 126(C).
    18. Lu, Jiaxuan, 2023. "The economics of China’s between-city height competition: A regression discontinuity approach," Regional Science and Urban Economics, Elsevier, vol. 100(C).
    19. Hannes Wallimann & Silvio Sticher, 2023. "On suspicious tracks: machine-learning based approaches to detect cartels in railway-infrastructure procurement," Papers 2304.11888, arXiv.org.
    20. Robert Clark & Ignatius Horstmann & Jean-François Houde, 2021. "Hub and Spoke Cartels: Theory and Evidence from the Grocery Industry," NBER Working Papers 29253, National Bureau of Economic Research, Inc.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jcsosc:v:7:y:2024:i:2:d:10.1007_s42001-024-00293-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.