IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v46y1998i1p84-95.html
   My bibliography  Save this article

Direction Choice for Accelerated Convergence in Hit-and-Run Sampling

Author

Listed:
  • David E. Kaufman

    (AT & T Labs, Somerset, New Jersey)

  • Robert L. Smith

    (University of Michigan, Ann Arbor, Michigan)

Abstract

Hit-and-Run algorithms are Monte Carlo procedures for generating points that are asymptotically distributed according to general absolutely continuous target distributions G over open bounded regions S . Applications include nonredundant constraint identification, global optimization, and Monte Carlo integration. These algorithms are reversible random walks that commonly incorporate uniformly distributed step directions. We investigate nonuniform direction choice and show that, under regularity conditions on the region S and target distribution G , there exists a unique direction choice distribution, characterized by necessary and sufficient conditions depending on S and G , which optimizes the Doob bound on rate of convergence. We include computational results demonstrating greatly accelerated convergence for this optimizing direction choice as well as for more easily implemented adaptive heuristic rules.

Suggested Citation

  • David E. Kaufman & Robert L. Smith, 1998. "Direction Choice for Accelerated Convergence in Hit-and-Run Sampling," Operations Research, INFORMS, vol. 46(1), pages 84-95, February.
  • Handle: RePEc:inm:oropre:v:46:y:1998:i:1:p:84-95
    DOI: 10.1287/opre.46.1.84
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.46.1.84
    Download Restriction: no

    File URL: https://libkey.io/10.1287/opre.46.1.84?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Robert L. Smith, 1984. "Efficient Monte Carlo Procedures for Generating Points Uniformly Distributed over Bounded Regions," Operations Research, INFORMS, vol. 32(6), pages 1296-1308, December.
    2. Samuel H. Brooks, 1958. "A Discussion of Random Methods for Seeking Maxima," Operations Research, INFORMS, vol. 6(2), pages 244-251, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ziwei Dai & Weiyan Zheng & Jason W. Locasale, 2022. "Amino acid variability, tradeoffs and optimality in human diet," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    2. André Schultz & Amina A Qutub, 2016. "Reconstruction of Tissue-Specific Metabolic Networks Using CORDA," PLOS Computational Biology, Public Library of Science, vol. 12(3), pages 1-33, March.
    3. Shirin Fallahi & Hans J Skaug & Guttorm Alendal, 2020. "A comparison of Monte Carlo sampling methods for metabolic network models," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-24, July.
    4. Wout Megchelenbrink & Martijn Huynen & Elena Marchiori, 2014. "optGpSampler: An Improved Tool for Uniformly Sampling the Solution-Space of Genome-Scale Metabolic Networks," PLOS ONE, Public Library of Science, vol. 9(2), pages 1-8, February.
    5. Asli Sahin & Daniel R. Weilandt & Vassily Hatzimanikatis, 2023. "Optimal enzyme utilization suggests that concentrations and thermodynamics determine binding mechanisms and enzyme saturations," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    6. Boris Polyak & Elena Gryazina, 2011. "Randomized methods based on new Monte Carlo schemes for control and optimization," Annals of Operations Research, Springer, vol. 189(1), pages 343-356, September.
    7. Badenbroek, Riley & de Klerk, Etienne, 2022. "Complexity analysis of a sampling-based interior point method for convex optimization," Other publications TiSEM 3d774c6d-8141-4f31-a621-5, Tilburg University, School of Economics and Management.
    8. Carles Foguet & Yu Xu & Scott C. Ritchie & Samuel A. Lambert & Elodie Persyn & Artika P. Nath & Emma E. Davenport & David J. Roberts & Dirk S. Paul & Emanuele Angelantonio & John Danesh & Adam S. Butt, 2022. "Genetically personalised organ-specific metabolic models in health and disease," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    9. Cyril Bachelard & Apostolos Chalkis & Vissarion Fisikopoulos & Elias Tsigaridas, 2024. "Randomized Control in Performance Analysis and Empirical Asset Pricing," Papers 2403.00009, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luca Anzilli & Silvio Giove, 2020. "Multi-criteria and medical diagnosis for application to health insurance systems: a general approach through non-additive measures," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(2), pages 559-582, December.
    2. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore, 2014. "The SMAA-PROMETHEE method," European Journal of Operational Research, Elsevier, vol. 239(2), pages 514-522.
    3. Stephen Baumert & Archis Ghate & Seksan Kiatsupaibul & Yanfang Shen & Robert L. Smith & Zelda B. Zabinsky, 2009. "Discrete Hit-and-Run for Sampling Points from Arbitrary Distributions Over Subsets of Integer Hyperrectangles," Operations Research, INFORMS, vol. 57(3), pages 727-739, June.
    4. D. Bulger & W. P. Baritompa & G. R. Wood, 2003. "Implementing Pure Adaptive Search with Grover's Quantum Algorithm," Journal of Optimization Theory and Applications, Springer, vol. 116(3), pages 517-529, March.
    5. Qi Fan & Jiaqiao Hu, 2018. "Surrogate-Based Promising Area Search for Lipschitz Continuous Simulation Optimization," INFORMS Journal on Computing, INFORMS, vol. 30(4), pages 677-693, November.
    6. Reuven Rubinstein, 2009. "The Gibbs Cloner for Combinatorial Optimization, Counting and Sampling," Methodology and Computing in Applied Probability, Springer, vol. 11(4), pages 491-549, December.
    7. Luis V. Montiel & J. Eric Bickel, 2014. "A Generalized Sampling Approach for Multilinear Utility Functions Given Partial Preference Information," Decision Analysis, INFORMS, vol. 11(3), pages 147-170, September.
    8. Pavel Shcherbakov & Mingyue Ding & Ming Yuchi, 2021. "Random Sampling Many-Dimensional Sets Arising in Control," Mathematics, MDPI, vol. 9(5), pages 1-16, March.
    9. Cheng, Haiyan & Sandu, Adrian, 2009. "Efficient uncertainty quantification with the polynomial chaos method for stiff systems," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 79(11), pages 3278-3295.
    10. Sorawit Saengkyongam & Anthony Hayter & Seksan Kiatsupaibul & Wei Liu, 2020. "Efficient computation of the stochastic behavior of partial sum processes," Computational Statistics, Springer, vol. 35(1), pages 343-358, March.
    11. Ru, Zice & Liu, Jiapeng & Kadziński, Miłosz & Liao, Xiuwu, 2023. "Probabilistic ordinal regression methods for multiple criteria sorting admitting certain and uncertain preferences," European Journal of Operational Research, Elsevier, vol. 311(2), pages 596-616.
    12. Jan Heufer, 2014. "Generating Random Optimising Choices," Computational Economics, Springer;Society for Computational Economics, vol. 44(3), pages 295-305, October.
    13. Serpil Sayin, 2003. "A Procedure to Find Discrete Representations of the Efficient Set with Specified Coverage Errors," Operations Research, INFORMS, vol. 51(3), pages 427-436, June.
    14. Gryazina, Elena & Polyak, Boris, 2014. "Random sampling: Billiard Walk algorithm," European Journal of Operational Research, Elsevier, vol. 238(2), pages 497-504.
    15. Cyril Bachelard & Apostolos Chalkis & Vissarion Fisikopoulos & Elias Tsigaridas, 2022. "Randomized geometric tools for anomaly detection in stock markets," Papers 2205.03852, arXiv.org, revised May 2022.
    16. Postek, Krzysztof & Ben-Tal, A. & den Hertog, Dick & Melenberg, Bertrand, 2015. "Exact Robust Counterparts of Ambiguous Stochastic Constraints Under Mean and Dispersion Information," Other publications TiSEM d718e419-a375-4707-b206-e, Tilburg University, School of Economics and Management.
    17. Aur'elien Hazan, 2016. "Volume of the steady-state space of financial flows in a monetary stock-flow-consistent model," Papers 1601.00822, arXiv.org, revised Jan 2017.
    18. Silvia Angilella & Maria Rosaria Pappalardo, 2022. "Performance assessment of energy companies employing Hierarchy Stochastic Multi-Attribute Acceptability Analysis," Operational Research, Springer, vol. 22(1), pages 299-370, March.
    19. Hazelton, Martin L. & Karimi, Masoud, 2024. "When lattice bases are Markov bases," Statistics & Probability Letters, Elsevier, vol. 209(C).
    20. Postek, Krzysztof & Romeijnders, Ward & den Hertog, Dick & van der Vlerk, Maartne H., 2016. "Efficient Methods for Several Classes of Ambiguous Stochastic Programming Problems under Mean-MAD Information," Other publications TiSEM a03f895f-b941-41a9-84e0-b, Tilburg University, School of Economics and Management.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:46:y:1998:i:1:p:84-95. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.