IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v13y2025i3p353-d1573871.html
   My bibliography  Save this article

Gaussian Process Regression with Soft Equality Constraints

Author

Listed:
  • Didem Kochan

    (Department of Industrial and Systems Engineering, Lehigh University, Bethlehem, PA 18015, USA)

  • Xiu Yang

    (Department of Industrial and Systems Engineering, Lehigh University, Bethlehem, PA 18015, USA)

Abstract

This study introduces a novel Gaussian process (GP) regression framework that probabilistically enforces physical constraints, with a particular focus on equality conditions. The GP model is trained using the quantum-inspired Hamiltonian Monte Carlo (QHMC) algorithm, which efficiently samples from a wide range of distributions by allowing a particle’s mass matrix to vary according to a probability distribution. By integrating QHMC into the GP regression with probabilistic handling of the constraints, this approach balances the computational cost and accuracy in the resulting GP model, as the probabilistic nature of the method contributes to shorter execution times compared with existing GP-based approaches. Additionally, we introduce an adaptive learning algorithm to optimize the selection of constraint locations to further enhance the flexibility of the method. We demonstrate the effectiveness and robustness of our algorithm on synthetic examples, including 2-dimensional and 10-dimensional GP models under noisy conditions, as well as a practical application involving the reconstruction of a sparsely observed steady-state heat transport problem. The proposed approach reduces the posterior variance in the resulting model, achieving stable and accurate sampling results across all test cases while maintaining computational efficiency.

Suggested Citation

  • Didem Kochan & Xiu Yang, 2025. "Gaussian Process Regression with Soft Equality Constraints," Mathematics, MDPI, vol. 13(3), pages 1-17, January.
  • Handle: RePEc:gam:jmathe:v:13:y:2025:i:3:p:353-:d:1573871
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/13/3/353/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/13/3/353/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zhang, Hao, 2004. "Inconsistent Estimation and Asymptotically Equal Interpolations in Model-Based Geostatistics," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 250-261, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rajala, T. & Penttinen, A., 2014. "Bayesian analysis of a Gibbs hard-core point pattern model with varying repulsion range," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 530-541.
    2. Zhang, Tonglin, 2017. "An example of inconsistent MLE of spatial covariance parameters under increasing domain asymptotics," Statistics & Probability Letters, Elsevier, vol. 120(C), pages 108-113.
    3. Girard, Didier A., 2016. "Asymptotic near-efficiency of the “Gibbs-energy and empirical-variance” estimating functions for fitting Matérn models — I: Densely sampled processes," Statistics & Probability Letters, Elsevier, vol. 110(C), pages 191-197.
    4. Lu, Zudi & Tjostheim, Dag & Yao, Qiwei, 2008. "Spatial smoothing, Nugget effect and infill asymptotics," LSE Research Online Documents on Economics 24133, London School of Economics and Political Science, LSE Library.
    5. Eric Yanchenko & Howard D. Bondell & Brian J. Reich, 2024. "Spatial regression modeling via the R2D2 framework," Environmetrics, John Wiley & Sons, Ltd., vol. 35(2), March.
    6. Sierra Pugh & Matthew J. Heaton & Jeff Svedin & Neil Hansen, 2019. "Spatiotemporal Lagged Models for Variable Rate Irrigation in Agriculture," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(4), pages 634-650, December.
    7. Victor De Oliveira & Zifei Han, 2022. "On Information About Covariance Parameters in Gaussian Matérn Random Fields," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(4), pages 690-712, December.
    8. Monterrubio-Gómez, Karla & Roininen, Lassi & Wade, Sara & Damoulas, Theodoros & Girolami, Mark, 2020. "Posterior inference for sparse hierarchical non-stationary models," Computational Statistics & Data Analysis, Elsevier, vol. 148(C).
    9. Denis Allard & Lucia Clarotto & Thomas Opitz & Thomas Romary, 2021. "Discussion on “Competition on Spatial Statistics for Large Datasets”," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 26(4), pages 604-611, December.
    10. Gelfand, Alan E. & Banerjee, Sudipto & Sirmans, C.F. & Tu, Yong & Eng Ong, Seow, 2007. "Multilevel modeling using spatial processes: Application to the Singapore housing market," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3567-3579, April.
    11. Lauren Hund & Jarvis T. Chen & Nancy Krieger & Brent A. Coull, 2012. "A Geostatistical Approach to Large-Scale Disease Mapping with Temporal Misalignment," Biometrics, The International Biometric Society, vol. 68(3), pages 849-858, September.
    12. Hong, Yiping & Zhou, Zaiying & Yang, Ying, 2020. "Hypothesis testing for the smoothness parameter of Matérn covariance model on a regular grid," Journal of Multivariate Analysis, Elsevier, vol. 177(C).
    13. Philip A. White & Alan E. Gelfand, 2021. "Multivariate functional data modeling with time-varying clustering," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(3), pages 586-602, September.
    14. Reihaneh Entezari & Patrick E. Brown & Jeffrey S. Rosenthal, 2020. "Bayesian spatial analysis of hardwood tree counts in forests via MCMC," Environmetrics, John Wiley & Sons, Ltd., vol. 31(4), June.
    15. Veronica J. Berrocal & Alan E. Gelfand & David M. Holland, 2012. "Space-Time Data fusion Under Error in Computer Model Output: An Application to Modeling Air Quality," Biometrics, The International Biometric Society, vol. 68(3), pages 837-848, September.
    16. Jaewoo Park & Sangwan Lee, 2022. "A projection‐based Laplace approximation for spatial latent variable models," Environmetrics, John Wiley & Sons, Ltd., vol. 33(1), February.
    17. Matthew J. Heaton & Stephan R. Sain & Andrew J. Monaghan & Olga V. Wilhelmi & Mary H. Hayden, 2015. "An Analysis of an Incomplete Marked Point Pattern of Heat-Related 911 Calls," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 123-135, March.
    18. Minhee Kim & Todd Allen & Kaibo Liu, 2023. "Covariate Dependent Sparse Functional Data Analysis," INFORMS Joural on Data Science, INFORMS, vol. 2(1), pages 81-98, April.
    19. Mahmoud, Hamdy F.F. & Kim, Inyoung, 2019. "Semiparametric spatial mixed effects single index models," Computational Statistics & Data Analysis, Elsevier, vol. 136(C), pages 108-122.
    20. Bachoc, François & Lagnoux, Agnès & Nguyen, Thi Mong Ngoc, 2017. "Cross-validation estimation of covariance parameters under fixed-domain asymptotics," Journal of Multivariate Analysis, Elsevier, vol. 160(C), pages 42-67.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:3:p:353-:d:1573871. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.