CentER

CentER is a world-class research institute that draws on the academic expertise of some of the most outstanding minds in the field of economics and business.

Center

Publications by Jack P.C. Kleijnen















Latest update: March 30, 2011

Publications with hyperlinks can be downloaded as PDF files.

Reprints of the other publications may be downloaded from Tilburg University's website.

Publications may also be accessed on the Social Sciences Research Network (SSRN).

Many papers have been presented at seminars, for which slides are available.

Additional notes and slides can be downloaded from the Course on Simulation.

Recently, the contribution on "design of experiments" was published on Elsevier's Scirus Topic Pages, which is an electronic encyclopedia like Wikipedia but allows contributions on invitation only.

On March 3, 2011 Elsevier posted "Reviewer Profile: Meet Professor Kleijnen"

Return to Kleijnen's home page


A. Recent working papers (submitted for publication)

WP3 Expected improvement in efficient global optimization through bootstrapped Kriging. (Together with W.C.M. van Beers and I. van Nieuwenhuyse) (posted Feb. 9, 2011)

WP2 Monotonicity-preserving bootstrapped Kriging metamodels for expensive simulations. (Together with W.C.M. van Beers) Supplementary material: appendixes 1 and 2 (revised version posted February 17, 2010)

WP1 Robust solutions for supply chain management: Simulation, optimization,and risk analysis. (Together with B. Bettonvil and F. Persson)

B. Publications

229 Sealed-bid auction of Dutch mussels: statistical analysis (Together with F.D.J. Van Schaik). International Journal of Production Economics (accepted) (revised version posted 8 October 2010) Long version

228 Robust optimization in simulation: Taguchi and Krige combined. (Together with G. Dellino and C. Meloni) INFORMS Journal on Computing (accepted 28 March 2011) Online Supplement (Paper posted 17 January 2011; Supplement posted 28 July 2010)

227 Variance reduction techniques in Monte Carlo methods. (Together with A.A.N. Ridder and R.Y. Rubinstein) Encyclopedia of Operations Research & Management Science 3rd Edition, edited by S. Gass and M. Fu (posted October 27, 2010) (Preprint: CentER Discussion Paper 2010-117)

226 An asymptotic test of optimality conditions in multiresponse simulation-based optimization. Also see Online companion (Together with E. Angun) INFORMS Journal on Computing (accepted September 26, 2010)

225 Methodology for determining the acceptability of system designs in uncertain environments. (Together with H. Pierreval and J. Zhang) European Journal of Operational Research, 209, 2011, pp. 176-183 Also see DOI and Online appendix.

224 Design and analysis of Monte Carlo experiments. Chapter III. 3 of Handbook of computational statistics; Volume I: concepts and fundamentals, second edition, edited by J.E. Gentle, W. Haerdle, and Y. Mori, Springer-Verlag, Heidelberg, Germany (also see 186, below)

223 Sensitivity analysis of simulation models (available since March 24, 2011) In: "Wiley Encyclopedia of Operations Research and Management Science", edited by J.J. Cochran, L.A. Cox, P. Keskinocak, J.P. Kharoufeh, and J.C. Smith, Wiley, New York

222 Design and Analysis of Computational Experiments: Overview. Chapter 3 (pp. 51-72) of Empirical methods for the analysis of optimization algorithms, edited by T. Bartz-Beielstein, M. Chiarandini, L. Paquete, and M.Preuss, Springer, 2010

221 Parametric and distribution-free bootstrapping in robust simulation-optimization (Together with G. Dellino and C. Meloni) Proceedings of the 2010 Winter Simulation Conference edited by B. Johansson, S. Jain, J. Montoya-Torres, J. Hugan, and E. Yucesan, pp. 1283- 1294

220 Ethical issues in engineering models: an operations researcher's reflections Science and Engineering Ethics (accepted April 2010) Also see 4-minute video (in Dutch), summary , and comment (summary and comment are in Dutch, published in Tilburg University's weekly bulletin "Univers", 11 and 18 March 2010, p. 20)

219 Robust optimization in simulation: Taguchi and Response Surface Methodology. (Together with G. Dellino and C. Meloni) International Journal of Production Economics , 125, no. 1, 2010, pp. 52-59 Online companion paper. Also see DOI

218 Constrained optimization in simulation: a novel approach. (Together with W. van Beers and I. van Nieuwenhuyse) European Journal of Operational Research, 202, 2010, pp. 164-174 Online appendix; also see DOI

217 Robust simulation-optimization using metamodels (Together with G. Dellino and C. Meloni) Proceedings of the 2009 Winter Simulation Conference, edited by M.D. Rossini, R.R. Hill, B. Johansson, A. Dunkin, and R.G. Ingalls, pp. 540-550

216 Robust simulation-optimization methodology (Together with G. Dellino and C. Meloni) Proceedings of the 2009 INFORMS Simulation Society Research Workshop, edited by L. H. Lee, M. E. Kuhl, J. W. Fowler, and S. Robinson

215 When is the design of a manufacturing system acceptable in the presence of uncertainty? (Together with Henri Pierreval and Jin Zhang) In: Proceedings of the 39th International Conference on Computers & Industrial Engineering (CIE39) Troyes (France), 6-8 July 2009

214 Statistical testing of optimality conditions in multiresponse simulation-based optimization. (Together with B. Bettonvil and E. del Castillo) European Journal of Operational Research, 199, no. 2, 1 December 2009, pp. 448-458 DOI

213 Factor screening in simulation experiments: review of sequential bifurcation. In Advancing the Frontiers of Simulation: A Festschrift in Honor of George S. Fishman , edited by C.Alexopoulos, D. Goldsman, and J. R. Wilson, Springer: 2009, New York, pp. 169-173

212 Design Of Experiments: Overview , Proceedings of the 2008 Winter Simulation Conference, edited by S. J. Mason, R. R. Hill, L. Moench, O. Rose, pp. 479-488

211. Response surface methodology with stochastic constraints for expensive simulation.(Together with E. Angun, D. den Hertog and G. Gurkan) Journal of the Operational Research Society , 2009, 60, pp. 735-746

210. Kriging metamodeling in simulation: a review European Journal of Operational Research, 192, no. 3, 1 February 2009, pp. 707-716

209.Response Surface Methodology for constrained simulation optimization: an overview.Simulation Modelling Practice and Theory, 16, 2008, pp. 50-64 Corrections

208. Design and Analysis of Simulation Experiments, Springer, 2008, 216 pages; corrections & additions, slides, and book review Chinese translation published by Publishing House of Electronics Industry, Beijing, 2010

207. Simulation experiments in practice: statistical design and regression analysis. Journal of Simulation, 2, no. 1, March 2008, pp. 19-27

206. Kriging metamodels in constrained simulation optimization: an explorative study. (Together with W.E. Biles, W.C.M. van Beers, and I. van Nieuwenhuyse) Proceedings of the 2007 Winter Simulation Conference, edited by S. G. Henderson, B. Biller, M.-H. Hsieh, J. Shortle, J. D. Tew, and R. R. Barton, pp. 355-362

205. Regression models and experimental designs: a tutorial for simulation analysts. Proceedings of the 2007 Winter Simulation Conference, edited by S. G. Henderson, B. Biller, M.-H. Hsieh, J. Shortle, J. D. Tew, and R. R. Barton, pp. 183-194

204. Risk analysis: frequentist and Bayesians unite! Proceedings of the 2007 INFORMS Simulation Society Research Workshop, edited by E. Yucesan, pp. 61-65

203. Cost-effective control of a quarantine disease: a quantitative exploration using "design of experiments" methodology and bio-economic modeling.. (Together with A. Breukers, W. van der Werf, M. Mourits, A. Oude Lansink) Phytopathology, 97, no. 8, 2007, pp. 945-957

202. Customized sequential designs for random simulation experiments: Kriging metamodeling and bootstrapping (Together with W.C.M. van Beers) European Journal of Operational Research 186, no. 3, 2008, pp. 1099-1113 DOI

201. Optimization of simulated systems: OptQuest and alternatives. (Together with J. Wan) Simulation Modelling Practice and Theory, 15, 2007, pp. 354-362 final version: DOI link . For details, see Working Paper

200. Response surface methodology's steepest ascent and step size revisited: correction. (Together with D. den Hertog and E. Angun). European Journal of Operational Research, 170, 2006, pp. 664-666.

199. White noise assumptions revisited: Regression metamodels and experimental designs for simulation practice. Proceedings of the 2006 Winter Simulation Conference,edited byL. F. Perrone, F. P. Wieland, J.Liu, B.G. Lawson, D. M. Nicol, and R.M.Fujimoto, pp. 107-117.

198. Validation of regression metamodels in simulation: Bootstrap approach. (Together with D. Deflandre). European Journal of Operational Research, 170, no. 1, 1 April 2006, pp. 120-131.

197. The correct Kriging variance estimated by bootstrapping . (Together with D. den Hertog and A.Y.D. Siem) Journal of the Operational Research Society , 57, no. 4, April 2006, pp. 400-409.

196.Screening for the important factors in large discrete-event simulation: sequential bifurcation and its applications. (Together with B.Bettonvil and F.Persson) In: Screening: Methods for experimentation in industry, drug discovery, and genetics , edited by A. Dean and S. Lewis, Springer-Verlag, New York, 2006, pp. 287-307.

195. Bootstrapping to solve the limited data problem in production control: an application in batch processing industries. (Together with C. Ivanescu, W. Bertrand, and J. Fransoo) Journal of the Operational Research Society, 57, no. 1, January 2006, pp. 2-9.

194. International collaborations in Web-based simulation: a focus on experimental design and optimization. (Together with W.E. Biles). Proceedings of the 2005 Winter Simulation Conference , eds. M. E. Kuhl, N. M. Steiger, F. B. Armstrong, and J. A. Joines, Institute of Electrical and Electronics Engineers, Piscataway, NJ, pp. 218-222

193. State-of-the-Art Review: A user's guide to the brave new world of designing simulation experiments. Also see Online Supplement. (Together with S.M. Sanchez,T.W. Lucas, and T.M. Cioppa) INFORMS Journal on Computing , 17, no. 3, Summer 2005, pp. 263-289

192. Het meten van de kwaliteit van publicaties: Hoeveel treffers? (Measuring the quality of publications: how many hits?) In: Toga's & baretten, Liber Amicorum voor Jan Oonincx, Koninklijke Militaire Academie, Breda, Netherlands (ISBN-10: 90 72391 268), pp. 61-68

191. Supply chain simulation tools and techniques: a survey. International Journal of Simulation & Process Modelling, 1, nos 1/2, 2005, pp. 82-89.

190. Robustness of Kriging when interpolating in random simulation with heterogeneous variances: some experiments . (Together with W.C.M. van Beers). European Journal of Operational Research 165, no. 3, 16 September 2005,pp. 826-834.

189. Invited review: An overview of the designand analysis of simulation experimentsforsensitivity analysis.European Journal of Operational Research, 164, no.2, 16 July2005, pp. 287-300.

188.Kriging interpolation in simulation: a survey. (Together withW.C.M. van Beers). Proceedings of the 2004 Winter Simulation Conference , eds. R.G. Ingalls, M.D. Rossetti, J.S. Smith,B.A. Peter, Institute of Electrical and Electronics Engineers, Piscataway, NJ, pp. 113-121

187. Application-driven sequential designs for simulation experiments: Krigingmetamodeling (Together with W.C.M. van Beers) Journal of the Operational Research Society, 55, no. 9, August 2004, pp. 876-883.

186. Design and analysis of Monte Carlo experiments. Chapter III. 3 of Handbook of computational statistics; Volume I: concepts and fundamentals , editedby J.E. Gentle, W.Haerdle, and Y.Mori, Springer, Berlin,2004, pp. 497-516.

185. Response surface methodology's steepest ascent and step sizerevisited. (Together with D. den Hertog andE.Angun). European Journalof Operational Research 159, 2004, pp. 121-131.

184. Statistical analysis of random simulations: bootstrap tutorial (Together with D. Deflandre). Simulation News Europe,issue 38/39, December 2003, pp. 29-34

183. Performance metrics in supply chain management, (Together with M.T. Smits). Journal of the Operational Research Society, 54, no. 5, 2003, pp. 507-514

182. Kriging for interpolation in random simulation. (Together with W. Van Beers). Journal of the Operational ResearchSociety, 54, no. 3, 2003, pp. 255-262.

181.short-term robustness of production-management systems: a case study . (Together with E.G.A. Gaury). European Journal of Operational Research, 148, no. 2, July 2003, pp. 452-465.

180. Sensitivityanalysis byexperimental design and metamodeling: case studyon simulation in national animal disease control. (Togetherwith Antonie Vonk Noordegraaf and MirjamNielen).European Journal of Operational Research, 146, no. 3, May 2003, pp. 433-443.

179. Optimal facility allocation in arobotic milking barn. (Together with I. Halachmi, J.H.M. Metz, and S. Halachmi). Transactions of the American Society of Agricultural Engineers (ASAE), 45, no. 5, 2002, pp. 1539-1546.

178. Creating alternative electronic trading mechanisms in time-sensitive transaction markets (together with P. Ribbers, A.M. Fairchild, E. van Heck) Chapter 7 in Trustin Electronic Commerce,edited by J.E.J. Prins, P.M.A. Ribbers, H.C.A. van Tilburg, A.F.L. Veth, and J.G.L. van der Wees, Kluwer Law International, The Hague, 2002, ISBN#90-411-1845-4, pp. 147- 170

177. Response surface methodology revisited. (Together withE.Angun, G. Gurkan and D. denHertog). Proceedings of the 2002 WinterSimulation Conference(edited by E. Yucesan, C.H. Chen, J.L. Snowdon and J.M. Charnes), pp. 377-383.

176. Deterministic versus stochastic sensitivity analysis in investment problems: an environmental case study. (Together with W.J.H.van Groenendaal). European Journal of Operational Research, 141, no. 1, August 2002, pp. 8-20.

175. Sensitivityanalysis of censored output through polynomial, logistic and tobit models: theory and case study. (Together with Antonie Vonk Noordegraaf and Mirjam Nielen). Proceedings of the 2001 Winter Simulation Conference (edited by B.A. Peters, J.S. Smith, D.J. Medeiros and M.W. Rohrer), pp. 486-491.

174. Panel session: education for simulation practice - five perspectives - research. Proceedingsof the2001 Winter Simulation Conference (edited by B.A. Peters, J.S. Smith, D.J. Medeiros and M.W. Rohrer), pp. 1576-1578.

173. Validation of trace-driven simulation models: bootstrapped tests. (Together with R.C.H. Cheng and B. Bettonvil). Management Science, 47, no. 11, November 2001, pp.1533-1538.

172. Comments on M.C. Kennedy & A. O'Hagan's Bayesian calibration of computer models?, Journal Royal Statistical Society, Series B, 63, Part 3, 2001, pp. 458-459

171. Validation of a simulation model for robotic milking barn design. (Together with I. Halachmi, A. Dzidic, J.H.M. Metz, L. Speelman, and A.A. Dijkhuizen) European Journal of Operational Research, 134, no. 3, 2001, pp. 677-688.

170. A methodology to customize pull control systems. (Together with E.G.A. Gaury and H. Pierreval). Journal of the Operational Research Society,52, 2001, pp. 789-799.

169. Experimental designs for sensitivity analysis of simulation models. Proceedings of EUROSIM 2001 (edited by A.W. Heemink et al), ISBN: 90-806441-1-0, 7pages.

168.Monte Carlo sampling and variance reduction techniques. (Together with R.Y. Rubinstein). Encyclopedia of Operations Research and Management Science, Second edition, edited by Saul Gass and Carl Harris, Kluwer Academic Publishers, Boston, 2001, pp. 524-526.(See also number 128).

167. Ethical issues in modeling: some reflections. European Journal of Operational Research, 130, no.1, April 2001, pp. 223-230.

166. A Java-based simulation manager for web-based simulation. (Together with B.E. Biles and C. Marr) Proceedings of the 2000 WinterSimulation Conference (editedby J.A. Joines, R.R. Barton, K.Kang & P.A. Fishwick). pp. 1815-1822.

165. Strategic directions in verification, validation and accreditation research: apersonal view. Proceedingsof the2000 Winter Simulation Conference (edited by J.A.Joines, R.R.Barton, K.Kang & P.A. Fishwick), pp. 909-916.

164. Validation oftrace-driven simulationmodels: more onbootstrap tests. (Together with Cheng, R.C.H., and Bettonvil. B.) Proceedings of the 2000 Winter Simulation Conference (edited by J.A. Joines, R.R. Barton, K.Kang & P.A. Fishwick). pp. 882-892.

163. Simulatie. i-Catcher, 4, no. 3, October 2000, pp. 12-14.

162. An evolutionaryapproach to select a pull system among Kanban,Conwip, and Hybrid. (Together with Gaury, E.G.A.and H.Pierreval) Journal of Intelligent Manufacturing, 11, no. 2, April 2000, pp. 157-167.

161. Measuring the quality of publications: new methodology and case study. (Togetherwith W. vanGroenendaal.) Information Processing & Management, 36, 2000, pp. 551-570. (Unabridged version: CentER Discussion Paper, no. 2000-37)

160. Screeningmethods.(Together with F. Campolongo and T. Andres.)Chapter 4 in: Sensitivity Analysis, edited by A. Saltelli, K. Chan, and E.M. Scott, Wiley, Chichester (England), 2000 pp. 65-89.

159. Optimal design of experiments withsimulation models of nearly saturated queues. (Together with R.C.H. Cheng and V.B. Melas.) Journal of Statistical Planning and Inference, 85, no. 1-2, 2000, pp. 19-26.

158. A methodology for the fitting and validation of metamodels in simulation. (Together with R.G. Sargent.) European Journal of Operational Research, 120, no.1, January 2000, pp. 14-29.

157. Designing customized pull production control systems. (Together with E.G.A Gaury and H. Pierreval.) Proceedings of the 1999 ELA doctorateworkshop, pp. 59-74.

156. A Java-based simulation manager for optimization and response surface methodology in multiple-response parallelsimulation. (Together with B.E. Biles) Proceedings of the 1999 Winter Simulation Conference (edited by P.A. Farrington, H.B.Nembhard, D.T.Sturrock, and G.W.Evans), pp. 513-517

155. Validation ofmodels: statisticaltechniques and data availability. Proceedings of the 1999 Winter Simulation Conference(edited by P.A. Farrington, H.B. Nembhard, D.T.Sturrock, and G.W.Evans), pp. 647-654

154. Maximizing the simulation output: a competition. (Together with O. Pala.)Simulation, 73, no. 3, September 1999, pp. 168-173. (Preprinted in Kwantitatieve Methoden, 19, no. 59, 1998, pp. 5-14.)

153. Improveddesign of queueing simulation experiments with highly heteroscedastic responses. (Together with R.C.H. Cheng.) Operations Research, 47,no. 5,September-October 1999, pp. 762-777

152. Extending pull production control systems. (Together with E.G.A Gauryand H. Pierreval.) Proceedings International Conference on Industrial Engineering and production Management (IEPM'99),Book 2, 1999, pp. 433-442

151. Statistical analyses of scatter plots toidentifyimportant factors in large-scale simulations, 2: robustness of techniques.(Together with Jon Helton.) Reliability Engineering and SystemsSafety, 65, no. 2, August 1999, pp. 187-197

150. Statistical analyses of scatter plots to identify important factors in large-scale simulations,1: review and comparison of techniques.(Together withJon Helton.) Reliability Engineering and Systems Safety, 65, no. 2,August 1999, pp. 147-185. (Also published as Sandia Report SAND98-2202, April 1999.)

149. Statistical validation of simulation, including case studies. Validation of simulation models, eds. C. van Dijkum, D. DeTombe, and E. van Kuijk, SISWO (Netherlands Universities Institute forCoordination of Researchin Social Sciences), Publication 403, 1999, Amsterdam (ISBN-90-676-152-2), pp. 112-127

148. Identifying important factors in deterministic investment problems using design of experiments. (Together with W. van Groenendaal.) Proceedings ofthe 1998 Winter Simulation Conference (editedbyD.J. Medeiros, E.F. Watson, J.S. Carson, M.S. Manivannan), pp. 713-718

147. Riskanalysis of robust system design. (Together with E.G.A. Gaury.) Proceedings of the 1998 Winter Simulation Conference (edited by D.J. Medeiros, E.F. Watson, J.S. Carson,M.S. Manivannan), pp. 1533-1540

146. Bootstrapping and validation of metamodels in simulation. (Together with Ad J. Feelders and Russell C.H. Cheng.) Proceedings of the 1998 Winter SimulationConference (edited by D.J. Medeiros, E.F. Watson, J.S. Carson, M.S. Manivannan), pp. 701-706

145. Information technology's role in teaching. i-Catcher, 2, no. 4, 1998, pp. 11-14

144. Bootstrapping and cross-validation of metamodels in simulation. SAMO, Second International Symposium on Sensitivity Analysis of Model Output, edited by K. Chan, S. Tarantola, and F. Campolongo, European Commission, Luxembourg, 1998.

143. Statistical theory on design of experiments, applied to simulation. SAMO,Second InternationalSymposium on Sensitivity Analysis of Model Output, edited by K.Chan, S. Tarantola, and F.Campolongo, European Commission, Luxembourg, 1998.

142. Experimental design for sensitivity analysis, optimization, and validation of simulation models. Chapter 6 in: Handbook of Simulation, edited by J. Banks, Wiley, New York, 1998, ISBN# 0-471-13403-1,pp. 173-223

141. Validation of trace-driven simulation models: a novel regression test. (Together with B. Bettonvil and W. van Groenendaal). Management Science, 44, no. 6, June 1998, pp. 812-819.

140. Modelisation et simulation pour l' evaluation et l'optimalisationde systemes de type Kanban:une revue, (Modeling and simulation for the evaluation and optimization of Kanban type systems) (Together with E.G..A Gaury and H. Pierreval.) MOSIM '97, Actes de la PremiereConference Francophone, Modelisation et Simulation des Systemes de Production et de Logistique, Hermes, Rouen, 5-6 June1997

139. New entrants and the role of information technology; case-study: the Tele Flower Auction in the Netherlands. (Together with E. Van Heck, E. Van Damme, and P. Ribbers.) Proceedings of the Thirtieth Hawaii International Conference on System Sciences, Volume III; Information Systems Track; Organizational Systems and Technology, edited by J.F. Nunamaker and R.H. Sprague, IEEE Computer Society Press, Los Alamitos, California, 1997

138. On the assessment of economic risk: factorial design versus Monte Carlo methods. (Together with W.J.H. Van Groenendaal) Reliability Engineering and Systems Safety, 57, 1997, pp. 91-102

137. Sensitivity analysis and related analyses: a review of some statistical techniques. Journal Statistical Computation and Simulation, 57, nos. 1-4, 1997, pp. 111-142

136. Regression metamodels and design of experiments. (Together with W. Van Groenendaal) Proceedings of the 1996 Winter Simulation Conference (edited by J.M. Charnes, D.J. Morrice, D.T. Brunner, and J.J. Swain), pp. 1433-1439

135. Validation of trace-driven simulation models: regression analysis revisited.(Together with B. Bettonvil, and W. Van Groenendaal) Proceedings of the 1996 Winter Simulation Conference, edited by J.M. Charnes, D.J. Morrice, D.T. Brunnner, and J.J. Swain, pp. 352-359

134. Five-stage Procedure for the Evaluation of Simulation Models through Statistical Techniques. Proceedings of the 1996 Winter Simulation Conference, edited by J.M. Charnes, D.J. Morrice, D.T. Brunner, and J.J. Swain, pp. 248-254

133. Searching for important factors in simulation models with many factors: sequential bifurcation. (Together with B. Bettonvil.) European Journal of Operational Research, 96, no. 1, January 1996, pp. 180-194

132. Reliability and Maintenance of Complex Systems, NATO ASI Series, Series F: Computer and Systems Sciences, Volume 154, edited together with S. Ozekici,E. Cinlar, F. Van der Duyn Schouten, N.Z.Singpurwalla, and R. Dekker, Springer-Verlag, Berlin, 1996

131. Simulation: sensitivity analysis and optimization through regression analysis and experimental design. Reliability and Maintenance of Complex Systems,editedby S.Ozekici et al., Springer-Verlag, Berlin, 1996, pp. 429-441

130. Simulation: runlength selection andvariancereduction techniques. Reliability andMaintenance of Complex Systems,edited by S. Ozekici et al., Springer-Verlag, Berlin, 1996, pp. 411-428

129. Optimization and sensitivity analysis of computer simulation models by the score function method. (Together with R.Y. Rubinstein.) European Journal of Operational Research, 88, 1996, pp. 413-427

128. Monte Carlosampling andvariance reduction techniques. (Together with R.Y. Rubinstein.) Encyclopedia of Operations Research and Management Science, edited by Saul Gass and Carl Harris, Kluwer Academic Publishers, Boston, 1996, pp. 405-407

127. Economic value of management information systems in agriculture: a review of in evaluation approaches . (Together with J.A.A.M. Verstegen, R.B.M.Huirne, and A.A. Dijkhuizen.) Computers and Electronics in Agriculture, 13, no.4, December 1995, pp. 273-288

126. Sensitivity analysis and optimization insimulation: design of experiments and case studies. Proceedings of the 1995Winter Simulation Conference, edited by C. Alexopoulos, K. Kang, W.R. Lilegdon, and D. Goldsman, pp. 133-140

125. Sensitivity analysis and optimization of system dynamics models:regression analysis and statistical design of experiments. System Dynamics Review,11, no.4, 1995, pp.275-288

124 Two-stage versus sequential sample-size determination in regression analysis ofsimulation experiments. (Together with W. van Groenendaal.) American Journal of Mathematical and Management Sciences, 15, nos. 1&2, 1995, pp. 83-114

123. Case study: statistical validation of simulation models. European Journal of Operational Research, 87, no.1, November 1995, pp. 21-34

122. Verification and validation ofsimulation models. European JournalofOperational Research, 82, no. 1, April 1995, pp. 145-162

121. "Hetgebruik van statistiek bijsimulatie: een inleiding." (The use of statistics simulation: an introduction.) Simulatie in Nederland: een stand van zaken, edited by C. van Dijkum and D. de Tombe, SISWO Publikatie 384, Amsterdam, SISWO, 1994, pp. 31-40

120. Sensitivity analysis and optimizationof simulation models. Proceedings ofthe 1994 European SimulationSymposium, TheSociety forComputer Simulation, Book Order Dept., P.O. Box 17900, Ca 92177, USA, pp. 3-8

119. Sensitivity analysis versus uncertainty analysis: when to use what? Predictability and nonlinear modelling in natural sciences and economics, edited by J Grasman and G. van Straten, Kluwer, Dordrecht, The Netherlands, 1994, pp. 322-333. Preprinted in Kwantitatieve Methoden, 15,no. 45, February 1994,pp. 3-15

118. Simulation and optimization in production planning: a case study. Decision Support Systems, 9, 1993, pp. 269-280

117. Sensitivity analysis and optimization of simulation experiments, including case studies. Eurosim - Simulation News Europe, no. 6, November 1992, pp. 5-7

116. Sensitivity analysis of simulation experiments: regression analysis and statistical design. Mathematics and Computers in Simulation, 34, 1992, pp. 297-315

115. Pseudorandom number generators for supercomputers and classical computers: a practical introduction. (Together with B. Annink.) European Journal of Operational Research, 63, no. 1, November 1992, pp. 76-85

114. Sampling for quality inspection and correction: AOQL performance criteria. (Together with J. Kriens, M.C.H.M. Lafleur and J.H.F. Pardoel.)European Journal of Operational Research, 62, no. 3, November 1992, pp. 372-379

113. Simulation: a statistical perspective (Together with W. van Groenendaal.) John Wiley, Chichester (England), 1992, 241 pages

112. Regression metamodels for simulation with common random numbers: comparison of validation tests and confidence intervals. Management Science, 38, no. 8,August 1992, pp. 1164-1185

111. Techniquesfor sensitivity analysis of simulation models: a case study of the CO2 greenhouse effect. (Together with G. van Ham and J. Rotmans.) Simulation, 58, no.6, June 1992, pp. 410-417

110. A note on Wild and Pagnatiello's experimental design strategy. Simulation, 58, nol 6, June 1992, pp. 393-394

109. Analysis and comparison of two strategies for multi-item inventory systems with joint replenishment costs. (Together with M.J.G. van Eijs and R.J.M. Heuts.) European Journal of Operational Research, 59, no. 3, June 1992, pp. 405-412

108. Vector computers, Monte Carlo simulation, and regression analysis: an introduction. (Together with B. Annink.) Management Science, 38, no. 2, February 1992, pp. 170-181

107. Sensitivity analysis of simulation experiments: regression analysis and statistical design. Simulation and optimization: Proceedingsof the International Workshop on Computationally intensive Methods, edited by G. Pflug and U. Dieter, Springer-Verlag, Berlin, 1992, pp. 45-54

106. Supercomputers for Monte Carlo simulation: cross-validation versusRao's test in multivariate regression. Bootstrapping and RelatedTechniques, edited by K.-H. Jockel, G. Rothe, and W. Sendler,Springer-Verlag,Berlin, 1992, pp. 233-245

105. Variance heterogeneity in experimental design: a practical review. The Frontiers of Statistical Computation,Simulation, & Modeling, editedby P.R. Nelson,American Sciences Press, Inc., 1991,pp.43-56

104. Measurement scalesand resolution IV designs.(Together with B. Bettonvil.)American Journal of Mathematical and Management Sciences 10, nos. 3&4, 1990, pp.309-322

103. Statistics and deterministic simulation models: Why not? Proceedings of the 1990 Winter Simulation Conference, edited by O. Balci, pp. 344-346

102. Gevoeligheidsanalyse via metamodellen en proefopzetten, toegepast op het broeikassimulatiemodel IMAGE. (Sensitivity analysis through metamodels and experimental designs,applied tothe greenhouse simulation model IMAGE)(Together with G. van Ham and J. Rotmans.). Kwantitatieve Methoden, 11, no. 35, October 1990, pp. 51-72, 83-86

101. Regression sampling in statistical auditing: a practical survey and evaluation. (Together with J. Kriens, H. Timmermans and H. Van den Wildenberg; includingRejoinder). Statistica Neerlandica, 43, no. 4, 1989, pp.193-207, 225

100. "Experimental design issues forlarge scale simulationmodels: position statement".1989 Winter Simulation Conference Proceedings, edited by E. MacNair, K. Musselman and P. Heidelberger, AssociationforComputing Machinery, New York, 1989,pp.416-418

99. "Pseudorandom number generation on supercomputers". Supercomputer, 6, no. 6, November 1989, pp. 34-40

98. "Simulatie: technieken en toepassingen". (Simulation: techniques and applications.) Together with W. van Groenendaal.) Academic Service, Schoonhoven (Netherlands), 1988

97. "Simulatie". (Simulation.) Leidse Onderwijsinstellingen (L.O.I.), Leiderdorp (Netherlands), 1988

96.Experimental design and regression analysis: an FMS case study. (Together with C. Standridge.) European Journal ofOperational Research, 33, no. 3, February 1988, pp. 257-261

95. Analyzing simulation experiments with common random numbers. Management Science, 34, no.1,January1988, pp. 65-74

94. Stochastic simulation: experimentdesign. Systems and Control Encyclopedia, edited by M.G. Singh, Pergamon Press, Oxford, 1987. (Preprinted in: Modeling, no. 18, June 1983, pp. 16-20.)

93. Model behavior: regression metamodel summarization. Systems and Control Encyclopedia, edited by M.G. Singh, PergamonPress, Oxford, 1987 (Preprinted in: Modeling, no. 18, June 1983, pp. 9-15.)

92. Review of random and group-screening designs. Communications in Statistics, Theory andMethods, 16, no. 10, 1987, pp. 2885-2900

91. Simulation with too many factors: Review of random and group-screening designs. European Journalof Operational Research, 31,no. 1, July 1987, pp. 31-36

90. Apractical comment on resolution IV designs: bad properties of quantitative factors. Communications in Statistics, Theory and Methods, 16, no. 3, 1987, pp. 805-812

89. Jackknifing estimated weighted least squares: JEWLS. (Together with P.C.A. Karre mans, W.K. OortwijnandW.J.H. van Groenendaal.) Communications in Statistics, Theory and Methods,16,no. 3, 1987, pp. 747-764

88. Statistical tools for simulation practitioners. Marcel Dekker, Inc., New York, 1987, 448 pages

87. Decision Support Systems: Electronic brains without gut feelings. Excerpta Informatica, 2, no. 3, Nov. 1986, pp. 1-2

86. Regression analysis ofsimulation experiments: functional software specification. Kwantitatieve Methoden, 7, no. 22, Nov. 1986. pp. 93- 112

85. "Overleeft het computercentrum: eten kleine computers grote?" (Will the computer center survive:do small computerseat bigones?) Computable, 19, no. 45, Nov. 1986, pp. 47-51

84. "Decision SupportSystems (DSS), en de kleren van de keizer..." (DSS, and the emperor's clothing.) Bedrijfskunde,58, no. 3, 1986, pp. 219-225

83. A scenario for sequential experimentation. Communicationsin Statistics, Theory and Methods, 15, no. 10, 1986, pp. 3067-3078

82. Testing the mean of an asymmetricpopulation:Johnson's modified t test revisited. (Together with G.L.J. Kloppenburg and F.L. Meeuwsen.) Communicationsin Statistics, Simulation and Computation, 15, no. 3, 1986, pp.715-732

81. Selecting random number seeds in practice. Simulation, 47, no. 1, July 1986, pp. 15-17

80. Efficient estimation of power functions, (Together with H.M.M.T. Denis and R.M.G. Kerckhoffs). Communications in Statistics, Theory and Methods, 14, no. 8, 1985, pp. 1865-1877

79. "Discussie" (Discussion). In: Operations Research; praktijk en theorie, edited by W. Heins, Delft University Press, Delft (Neth.), 1985, pp. 28-33

78. On the interpretation of variables.Simulation, 44, no. 5, May 1985, pp. 237-241

77. Thepowerofweightedandordinary least squares with estimated unequalvariancesin experimental designs. (Together with P. Cremers and F. van Belle.) Communications in Statistics, Simulation andComputation, 14, no. 1, 1985, pp. 85-102

76. "Is informatie verhandelbaar goed?" (Can we trade in information?) Informatie, 27, no. 1, January 1985, pp. 76-77

75. "Nog eens:doorbelastingprincipes van computerkosten" (Once more: principles of charging computer costs). (Together with A.J. van Reeken.) Informatie, 26, no. 9, September1984, p. 751

74. "Statistische analyse: kans op informatie" (Statistical analysis: chance of information). In: Handboek informatieverzorging, edited by P.G. Bosch, W. Hartman, A.J. van 't Klooster, J.A.M. Oonincx, Samsom Uitgeverij, Alphen aan den Rijn (Neth.), 1984, pp. 1-19

73. Statistical analysis of steady state simulations: survey of recent progress. EuropeanJournalofOperational Research, 17, no. 2, August 1984, pp. 150-162

72. "Overleeft het computercentrum als informatiecentrum?" (Will the computer center survive as information center?). Systemica, 4, no. 3, April 1984, pp. 1-12

71. "Doorbelastingprincipes van computerkosten" (Principles of charging computer costs). (Together with A.J. van Reeken.)Informatie, 26, no. 3, March 1984, pp. 211-217. (Also in: De praktijk van de econometrie, edited by P.A. Verheijen et al., Stenfert Kroese, Leiden, Neth., 1984, pp. 323-333.)

70. Quantifying the benefits of information systems. European Journal of Operational Research, 15, no.1, Jan. 1984, pp. 38-45

69. "Regressie-analyse steunt commonsense" (Regression analysis supports common sense). Proceedings Summer Course "Software Crisis", Systems Group Netherlands, StamTijdschriften, Rijswijk (Neth.), 1983, pp. 30- 31

68. Risk analysis and sensitivity analysis:antithesis or synthesis.Simuletter, 14, no. 1-4, 1983, pp. 64-72

67. Principles of computer charging in a university - like organization. (Together with A.J. van Reeken.) Communications ACM, 26, no. 11, Nov. 1983, pp. 926-932

66. Cross-validation using the t statistic. European Journal of Operational Research, 13, no. 2, June 1983, pp. 133-141

65. "Nieuwe wegen in managing computercentra: inleiding" (New ways in managing computer centers: introduction). Proceedings NOVI Conference, NOVI, Maarssen (Neth.), 27 Jan. 1983, 24 pages

64. Statistical aspects of simulation: an updated survey. Statistica Neerlandica, 36, no. 4, 1982, pp. 1-19

63. "Modellen en simulatie: een inleiding" (Modeling and simulation: an introduction). In: Handboek informatieverzorging, edited by P.G. Bosch, W. Hartman, A.J. van 't Klooster, J.A.M. Oonincx, Samsom Uitgeverij, Alphen aan den Rijn (Neth.), 1982, pp. 1-19

62. Experimentation with models: statistical design and analysis techniques. In: Progress in modelling and simulation, edited by F. Cellier, Academic Press, London, 1982, pp. 173-185

61. Testing independence of simulation runs: a note on the power of the Von Neumann test. (Together with R. van der Ven and B. Sanders.) European Journal of Operational Research, 9, no. 1, Jan. 1982, pp. 92-93

60. On hierarchical modeling. Communications ACM, 24, no. 11, Nov. 1981, pp. 774-775

59. Optimization of priority class queues, with a computer center case study. (Together with F. Keijzer, E. Mullenders, and A. van Reeken.) American Journal of Mathematical and Management Sciences, 1, no. 4, 1981, pp. 341- 358. (Reprinted in: Dudewicz, E.J. and Z.A. Karian, Modern design and analysis of discrete-event computer simulations. IEEE Computer Society Press, Washington (D.C. 20036-1903), 1985, pp. 298-310.)

58. Small-sample behaviorofweighted least squares in experimentaldesign applications. (Together with R. Brent and R. Brouwers.) Communications in Statistics, B10, no. 3, 1981, pp. 303-313. (Preprinted in:Simuletter, 11, no. 3 + 4, Spring + Summer 1980, pp. 38-48.)

57. "Derol van wiskundige modellen en technieken in de bestuurlijkeinformatica" (The role of mathematical models andtechniques in management informatics). Samsom Uitgeverij, Alphen aan den Rijn (Neth.), 1981, 24 pages. (Reprinted: Informatie, 23,no. 6, June1981, pp.387-393.)

56. Regression analysis for simulation practitioners. Journal Operational Research Society, 32, 1981, pp. 35-43

55. Scoring methods, multiple criteria, and utility analysis.Performance Evaluation Review, 9, no. 3, Fall 1980, pp. 45-56

54. "Economische evaluatie van informatiesystemen" (Economic evaluation of information systems). Informatie, 22, no. 12, Dec. 1980, pp. 901-906

53. On performance statistics and input traffic distributions. Communications ACM, 23, no. 9, Sept. 1980, pp. 529-530

52. Regression estimation in simulation. (Together with A.C.M. Hopmans.) Journal Operational Research Society, 31, 1980, pp. 1030-1038

51. Bayesian information economics: an evaluation. Interfaces, 10,no.3, June 1980, pp.93-97

50. Analysis of simulation with common random numbers: a note on Heikes et al. Simuletter, 11, no. 2, Winter 1979-1980, pp. 7-13

49. Computers and profits: quantifying financialbenefitsof information. Addison-Wesley, Reading (Massachusetts), April 1980, 262 pages

48. "Managementinformatiesystemen: ekonomische evaluatie" (M.I.S.: economic evaluation). Sociaal Economisch Management, 7, no. 18, Nov. 1979, pp. 24- 26

47. Evaluationof management information systems. Omega, 7, 1979, no. 6, pp. 139-543

46. Computerization tax, CommunicationsACM,22, no.6, June 1979, p. 381. (Rejoinder: no. 10, Oct. 1979, p.577 and March 1980, pp. 187-188.)

45. An extension of Gitlow's methodology for designing abortion clinics. Management Science,25, no. 4, April 1979, p. 408

44. Theroleof statistical methodology insimulation. In: Methodology in Systems Modelling and Simulation, edited by B. Zeigler et al., North- Holland Publishing Company, Amsterdam, 1979, pp. 425-445

43. Importance sampling: a practical failure? (Together with A.C.M. Hopmans) Mathematics and Computers in Simulation, 21, 1979, pp. 209-220

42. Hartmanrevisited (A comment on "ARDI revisited of het ontwerpen van informatiesystemen") . Informatie, 21, no. 5, May 1979, p. 337

41. Regression metamodels for generalizing simulation results. IEEE Transactions on Systems, Man, and Cybernetics. SMC-9, no. 2, Feb. 1979, pp. 93-96

40. Generalization of simulation results: practicality of statistical methods.(Together with A.J. van denBurg en R.Th. van derHam.) European Journal ofOperational Research, 3, 1979,pp. 50-64

39. A note on computer system data gathering. Performance Evaluation Review, Jan. 1979, pp.1-2

38. The simulation startup problem. Simulation, 32, no. 1, Jan. 1979, p. 29

37. Reply to Fox and Schruben. Management Science, 24, no. 16, Dec. 1978, pp. 1772-1774

36. Operations research. In: Encyclopedia of Computer Science and Technology, edited by J. Belzer, A.G. Holzman and A. Kent, Marcel Dekker, Inc., New York, 1978, pp. 445-461

35. IMPACT revisited: a critical analysis of IBM's inventory package "IMPACT". (Together with P.J. Rens.) Production and Inventory Management, Journal of the American Production and Inventory Control Society, 19, no. 1, First Quarter, 1978, pp. 71-90

34. Robustness of a multiple ranking procedure: a Monte Carlo experiment illustrating design and analysis techniques.Communications in Statistics, Part B, Simulation and Computation, 6, no. 3, 1977, pp.235- 262

33. "Golfbeweging en autokorrelatie" (Cyclic movements and autocorrelation). (Together with B. Prakken.) Informatie, 19, no. 12, Dec. 1977, pp. 816- 817

32. Financial benefits of accurate information: a simulation experiment with an IBM business game. In: Economic Evaluation of Information Systems, Netherlands IAG, Amsterdam, May1977, 29 pages

31. "Information economics: inleiding en kritiek" (Information economics: introduction and critique). Maandblad voor Accountancy en Bedrijfshuishoudkunde, 51,no. 5, May 1977, pp. 237-243

30. "Doorberekenen van computerkosten: korte bibliografie" (Charging computer costs: short bibliography). Informatie, 19, no. 2, Feb. 1977, p. 90

29. Quantile estimation inregenerative simulation: a case study. (Together with G. Coppus and M. van Dongen.) Performance Evaluation Review, 5, no. 3, Summer 1977, pp. 5-15. (Reprinted in: Simuletter, 8, no. 2, Jan. 1977, pp. 38-47.)

28. Discrete simulation: types,applications, and problems. In: Simulation of Systems, edited by L. Dekker, North-Holland Publishing Company, Amsterdam, 1977, pp. 31-38

27. Design and analysis of simulation: practical statistical techniques. Simulation, 28, no. 3, March 1977, pp. 81-90

26. Financial benefits of computers: a framework. Management Datametics, 5, no. 6, 1976, p. 275

25. Computers and operations research: a survey. Computers &Operations Research, 3, no. 4, 1976,pp.327-335

24. "Het economisch nut van nauwkeurige informatie: simulatie van ondernemingsbeslissingen en informatie". (The economic benefits of accurate information: simulation of corporate decisions and information.) Maandblad voor Accountancy en Bedrijfshuishoudkunde, 50, no. 8, Sept. 1976, pp. 453-470

23. Computers and modern management.In: Proceedings Seminaron decision- making in business,Nijenrode (Neth.), Aug. 1976,19 pages

22. Statistical problems in the simulation of computersystems.In: Proceedings of "La statistique:outild'analysedes systemes informatiques",Chapitre Francais de l'ACM, 10-11 June1976. (Reprinted in: Modelling and performance evaluation of computer systems, editedbyH. BeilnerandE.Gelenbe, North-Holland Publishing Company, Amsterdam, 1977.)

21. Comparing means and variances of two simulations with common random numbers. Simulation, 26, no. 3, March 1976, pp. 87-88

20. Screening designs for poly-factor experimentation. Technometrics, 17, no. 4, Nov. 1975, pp. 487-493

19. "De rol van simulatie in de algemene econometrie". (The role of simulation in econometrics.) Informatie, 17, no. 10, Oct. 1975, pp. 491-495

18. Statistical design and analysis of simulation experiments. Informatie, 17, no. 10, Oct. 1975, pp. 531-535

(Also published in: Proceedings Simulation 75, ACTA Press,Zurich, 1975.)

17. "Computers en werkgelegenheid: pogingtot economische analyse". (Computers and employment: preliminaryeconomic analysis.) Informatie, 17, no.6,June 1975, pp. 327-331

16. Antithetic variates, common random numbers and optimum computer time allocation. Management Science, ApplicationSeries, 21, no. 10, June 1975, pp. 1176-1185

15. A comment on Blanning's metamodel for sensitivity analysis: the regression metamodel in simulation. Interfaces, 5, no.3, May 1975, pp. 21-23

14. Statistical techniques in simulation, volumes I and II. Marcel Dekker Inc., New York, 1974-1975, 775 pages (Russian translation, Publishing House "Statistics", Moscow, 1978)

13. . A note on sampling two correlated variables. Simulation, 22, no. 2, Feb. 1974, pp. 45-46

12. Computers and management science: their interface to-dayand to-morrow.Instituto Nacional de Racionalizacion y Normalizacion, Madrid, Spain, 1974, 60 pages. (Martin Balzola Award 1973.)

11. Monte Carlo simulation and its design andanalysis. BulletinInternational Statistical Institute, Proceedings 39th Session, Invited papers, 45, book 4, Vienna, 1973, pp. 268-278

(Also published in: Simuletter, 6, no. 1,Oct. 1974, pp. 23-29.)

10. "De computer en de toekomst van operations research"(The computer and the future of O.R.). Informatie, 15, no. 1, Jan. 1973, pp. 28-30

9. The design and analysis of Monte Carlo experiments: a case study on the robustness of a multiple ranking procedure. In: Proceedings Symposium on computer simulation versus analytical solutions, School of Business Administration, Gothenburg, 28-30 Aug. 1972, 24 pages

8. The statisticaldesign andanalysis of computersimulation experiments: a survey. ManagementInformatics,1, no.2, April1972, pp. 57-66

7. Theuse of multiple ranking procedures to analyzesimulations of management systems: a tutorial. (Togetherwith T.H. Naylor and T.G. Seaks.) Management Science, ApplicationSeries, 18, no. 6, Feb. 1972, pp. 245- 257

6. "Simulatie". In: Encyclopedie van de Bedrijfseconomie(Business Encyclopedia), Uitgeversmaatschappij W. deHaan, Hilversum, 1971, pp. 425-430

5. Variance reduction techniques in simulation. Doctoral dissertation, Katholieke Hogeschool,Tilburg, Jan. 1971, 200 pages

4. The use of multiple ranking procedures to analyze simulations of business and economicsystems. (Together with T.H. Naylor.) In: Proceedings of the business and economic statistics section, Annual Meeting of theAmerican Statistical Association, New York, 19-22 Aug. 1969, pp. 605-615

3. Monte Carlo techniques: A comment. In:The design of computer simulation experiments, edited by T.H. Naylor, Duke UniversityPress,Durham,N.C., 1969, pp. 289-297

2. "Een toepassing vanimportance sampling" (An application of importance sampling). Statistica Neerlandica, 22, no. 3, 1968, pp. 179-198

1. "Simulatie en simulatietalen" (Simulation an simulation languages). Economisch Statistische Berichten, 52, no. 2619, 15 Nov. 1967,pp.1156-1158.


Return to Kleijnen's home page