Simulation of Stochastic Chemical Systems: Applications in the Design and Construction of Synthetic Gene Networks A DISSERTATION SUBMITTED TO THE FACULTY OF THE GRADUATE SCHOOL OF THE UNIVERSITY OF MINNESOTA BY Howard Michael Salis IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY UNDER THE GUIDANCE OF Yiannis Kaznessis Month/Year of Degree Clearance: February 2007. UMI Number: 3244458 Copyright 2006 by Salis, Howard Michael All rights reserved. INFORMATION TO USERS The quality of this reproduction is dependent upon the quality of the copy submitted. Broken or indistinct print, colored or poor quality illustrations and photographs, print bleed-through, substandard margins, and improper alignment can adversely affect reproduction.
In the unlikely event that the author did not send a complete manuscript and there are missing pages, these will be noted. Also, if unauthorized copyright material had to be removed, a note will indicate the deletion. ® UMI UMI Microform 3244458 Copyright 2007 by ProQuest Information and Learning Company. All rights reserved.
This microform edition is protected against unauthorized copying under Title 17, United States Code. ProQuest Information and Learning Company 300 North Zeeb Road P. Box 1346 Ann Arbor, MI 48106-1346 This dissertation is copyrighted material. All rights reserved.
(Howard Salis 2006-2007 Acknowledgements My doctoral research would not have been possible except for the continued help and support of many dear people. Writing a dissertation can be an especially isolating task and | am grateful to those who made it an enjoyable experience. | would like to thank my advisor, Yiannis Kaznessis, for his generous time and commitment. Throughout my doctoral work, he encouraged me to develop independent thinking and research skills and allowed me to explore new areas of mathematics with no guarantee of success.
He continually stimulated new thoughts and greatly assisted me with scientific writing. | also extend my thanks to my fellow graduate students and friends in the Kaznessis research group for helping me in many ways with my graduate studies. Jonathan Tomshine, Vassily Sotiropou- los, and John Barrett each greatly assisted me in advancing the rational design of synthetic gene networks. In addition, | am also grateful to Himanshu Khandelia, Spyros Vicatos, Allison Langham, Abdallah Sayyed, Chandrika Mulakala, and Dan Bolintineau for both scholarly and not-so-scholarly discussions on a wide variety of topics, for sharing tea times and cookies, for baking (thanks Allison!) and eating birthday cakes, and for making graduate school more than just a list of published papers.
| will miss our time together. | would like to thank Jennifer Maynard for allowing me to use her laboratory and equipment, and for teaching me a variety of genetic engineering techniques with her usual zeal and happiness. | also express my gratitude to Benjamin Roy, Ryan Myhre, Kavita Ramalingam, and Rakesh Motani for their patience with my many questions while working in their lab. | also thank David Morse, Hans Othmer, Marie Contou-Carrere, Chetan Gadgil, and Chang Hyeong Lee for intellectual stimulation, discussions, and thoughtful suggestions on manuscripts.
| would also like to extend my sincerest gratitude to Prabhas Moghe and Jane Tjia who mentored my research studies while at Rutgers University. They gave an inexperienced freshman a real job in their lab. | will always be grateful for their patience, their training, and their encouragement. | would also like to thank Troy Shinbrot and Stephen Conway at Rutgers for continuing that encouragement.
Of course, | have had many teachers over the years and | would not be where | am without them. | thank them all, but would like to especially thank Mr. Holmquist, who instilled a love of biology in me, and to Mrs. D’Esposito who taught me that “It’s not ‘I Know’, it’s ‘| Do’ ”.
| have been blessed with some great friends who have always been there to share in difficult and joyous occasions, to lend an ear, or to simply study the sometimes hilarious behavior of that well-known vociferous species of Leporidae Brachylagus.M, Rick, Andy, Jane, Kristen, and Alan, | thank you all for your friendship. | also extend my heart-felt thanks to Alexis who has brightened my life and given me great joy. This dissertation would not have been possible without your daily encouragement. Finally, | thank my parents for always loving me and being there to help solve problems big and small.
They are my greatest teachers in life. Funding for this research was provided by the United States National Institute of Health’s biotech- nology training grant (GM08347), the United States National Science Foundation (BES-0425882), and the Army High Performance Research Computing Center (AHPCRC)} of the US Army Research Lab (Contract DAAD10-01-2-0014). Computational support was also provided by the University of Minnesota’s Digital Technology Center, the NSF Funded TeraGrid, and the National Center for Su- percomputing Applications (TG-MCA04N033). This dissertation is dedicated to my parents, Jan and Barry, who lovingly brought me into this world and taught me.
il Contents List of Tables vii List of Figures ix 1 Introduction Dune m 1.1 An Overview of our Methodology. c vu v2 1v và và và 1.2 Key Results Inside This Dissertation.3 A Brief Introduction to the Mathematical Results .1 The Initial Motivation .2 The Eirst Two Stochasttc NumericalMethods. Onwards to Random DynamicalSystems.4 Numerical Methods for Stochastic Bifurcation Analysis. c Q Q cu nu nà ng kg kg k Và 12 1.4 A Brief Introduction to the Biological Results.
Computer Aided Design of Synthetic Gene Networks.3 Protein Devices: A New Type of Synthetic Gene Network .4 Oscillatory Synthetic Gene Networks. Bottom-Up Mathematical Analysis of a Synthetic Promoter .ẨốẨ< 18 2 Stochastic Numerical Methods 2. c c Q Q n Q nu nà ng k n k kg ki v kg k va 2.1 An Owverview of the ChapfeE.2 A Brief Introduction to Probabiliry and Stochastic Processes.2 Random Variables and Probability Distributons. Commonly Used Random Variables .4 A Brief Overview of Stochastic Processes.3 The Numerical Simulation of Jump Markov and Poisson Processes.2 The Stochastic Simulation Algorthim.3 Poisson and BinomialLeapng.
cu 1 CONTENTS IV PC X92 on n ố nu.4 The Numerical Solution of Ité Stochastic Differential Equations .1 Definitions and Formal Solutions .2 Explicit Solutions of Some Stochastic Differential Equations .3 Strong and Weak Solutions.4 lô and Stratonovich Stochastic Inegrals.5 The It6 Formula and ltô-Taylor Expansions.6 Numerical Generation of Stochastic Inteprals .7 Itô-TaylorExpHct NumericalSchemes .8 Implicit Stochastic NumericalSchemes.9 Adaptive Time StepSchemes .5 HyJCMSS: The Hybrid Jump/Continuous Markov Stochastic Simulator. c c c c c ch ng ng ng kg vi kg kg va 71 2.4 Examples, Error Analysis, and Critical Comparisons .6 An Equation-Free Probabilistic Steady State Approximation. ee ee ee 96 2. Hy3S: Hybrid Stochastic Simulation for Supercomputes.3 Solution of a Hybrid Jump/Continuous Markov Process .4 The Fixed Euler--MaruyamaMethod.5 The Fixed Milstein Method.
Q vn nu 1v 2v và xa 123 2. The Graphical User Interface. ÈŠẽẽHqđ 141 3 Design of Synthetic Gene Networks 142 3.1 AnOwverview of the ChapfET.cu ee ee 143 3.2_ An Overview of Regulated Bacterial Gene Expression.3 The Regulation of Transcriptional Interactions .4 The Regulation of Translational Interactions.5 Messenger RNA and Protein Degradation and Dilution .3 The Modeling of Gene NetWOTKS. Q Q cu ng Quà và va 159 3.1 Kinetics and Equilibrium Data.
The Chemical Partition Function and Equilibrium Holoenzyme Formation.5 mRNA and Protein Degradation and Dduton.6 Protein-Protein Interactions.4 The “AND” Protein Device: Logical Regulation of Gene Expression.2 Molecular Design and MathematicalMethods.45 Conclusion and Outlook .6 Appendix Text: Notes on the Quantitative Model .5 An Oscillating Gene Network 2. cu ng vn kg kg kg kia 194 3. The lac-tet-ara Gene Network.4 Results and Discussion. Q0 HQ gà kg kia 200 3.-ddda ăằ(ỐỤựẶ: MA.
209 Construction, Characterization, and Mathematical Analysis of a Synthetic Promoter 210 41 Introduction.1 Overview of Chapter .2 Materials and Methods.21 Synthesizing and Cloning the ConsHuct.2 Initial Confirmation of “AND”-like Promoter Activity .23 Sampling Inducer-Dependent Expression over Time .4 Characterization of Samples with FACS .1 The “ON” Dynamics of the Synthetic Promoter Expression.2 The Steady-State Distribution of GFP Fluorescence over Varying Inducer Concentrations 2. Q Q Q kg kg k k k ko 220 4. Cell Division Rates over Varying Inducer Concentration .4 A Steady-State Mathematical Model of the Synthetic Promoter.1 The Participating Molecular Interactions.2 The Steady-State Governing Equations .5 Combining Experimenral and Model Resuls.1 Calculating an Unknown Parameter.2 Predicting the Behavior of Improved Synthetic Promoters .6 Discussion and Conclusions .2 21L u g kg va 234 CONTENTS VI 5 Stochastic Bifurcation Analysis: New Numerical Methods 236 5.2 Conceptual Background on Random DynamicalSvstems. LH nu gu kg v.
Stochastic Stability Analysis.4 Stochastic Bifurcation Analysis .3 New Numerical Methods for Stochastic Bifurcation Analysis .1 Approximation the Action of the Forward and Reverse Time Cocycle 239 5. Reverse Stochastc Simulalon.3 Iterative Forward-Reverse Sampling .4 Forward and Reverse Master Equations .5 Forward and Reverse Stochastic Simulation .6 Stationary and Non-Stationary Solutions.7 Iterative Forward-Reverse Sampling. và ki k k xa 246 BibHography 247 List of Tables 21 Four important characteristics of five useful probability distribution functions .2 A list of the mass action rate laws for stochastic chemical kinetics.Q Q Q LH vu vu V2 k KY V Và 2.3 Cvcle Test reactions and paframefffS.4 Ratios of Computational Run Times of Cycle Tests 2.5 A Simplified Model of the Pulse Generating Gene Network in Drosophila Circadian Rhythm 2.6 The crystallization reaction system and kinetic parameters .7 The effect of time step on the run time and number of SDE integration steps of three hybrid stochastic methods.8 A Benchmark Model for Large-Scale Reaction Networks .9 Computational Run Times and SDE Calls of the Benchmark Models of Large-Scale l1 51.10 The effect of Ø and w on the probabilistic steady state approximation’s speed up when simulating the illustrative example reaction network. Parameter 4 is constant at 10.11 Accuracy and speed up of the probabilistic steady state approximation for the second example reaction network.
Parameter À is constant at30000.12 The reactions, kinetic constants, and initial conditions of the protein-protein interaction network example.13 The effect of increasing @ on the accuracy and efficiency of the stochastic simulation of the non-linear protein-protein interaction network.14 A diagnostic reaction network with multiple timescales is shown.15 An overview of the Hy3S numerical methods .16 A description of each command line argument and their defaultvalues.17 A Non-Linear Cycle Test 2. Q Q LH nu nà vn g gà và va 2.18 A comparison of computational times of a large-scale system benchmark. The com- putational times of a large-scale system benchmark using the fixed Euler-Maruyama (EM) and Milstein implementations of the HyJCMSS algorithm and the Next Reaction variant of the stochastic simulation algorithm (SSA). ND: Not Determined.19 A bistable biochemical network with multiple timescales and spontaneous escape .1 A list of consensus sequences for E.0 020004 vil LIST OF TABLES Vili 3.2 A list of the thermodynamic binding free energies between the Jac, tet, and ara tran- scription factors and their respective DNA operators at physiological temperature, pH, and salt concentration.3 A list of the thermodynamic binding free energies between the inducer-bound /ac and tet repressors and their respective DNA operators.4 A selected list of ribosome binding sites (RBSs).
The DNA sequences starting with AGGA and ending with a start codon are shown. The sequences are qualitatively ranked by their translation efficiency (average proteins per mRNA transcript with all other de- terminants equal) with one being the most efficient. The Gibbs free energies of the mRNA folding into a secondary structure (AG foiding) and the rRNA:mRNA hybridiza- tion (AGpyp-ia) are Shown for comparison.5 The enumeration and Gibbs free energies of the regulatory states of an example pro- moter with two operators and a single transcription factor.6 A list of potentially useful protein-protein interaction domains, their peptide ligands, and affinities, 2.7 The baseline and range of values foreach model parameter.8 The reaction network describing the protein-protein interactions between scaffold and scaffold-binding proteins.9 The reaction network describing production and degradation of scaffold and scaffold- binding proteins.