This page intentionally left blank
D NA MICROARRAYS AND GE NE E X P R E S S IO N From experiments to data analysis an...
67 downloads
2024 Views
2MB Size
Report
This content was uploaded by our users and we assume good faith they have the permission to share this book. If you own the copyright to this book and it is wrongfully on our website, we offer a simple DMCA procedure to remove your content from our site. Start by pressing the button below!
Report copyright / DMCA form
This page intentionally left blank
D NA MICROARRAYS AND GE NE E X P R E S S IO N From experiments to data analysis and modeling
Massive data acquisition technologies, such as genome sequencing, highthroughput drug screening, and DNA arrays are in the process of revolutionizing biology and medicine. Using the mRNA of a given cell, at a given time, under a given set of conditions, DNA microarrays can provide a snapshot of the level of expression of all the genes in the cell. Such snapshots can be used to study fundamental biological phenomena such as development or evolution, to determine the function of new genes, to infer the role that individual genes or group of genes may play in diseases, and to monitor the effect of drugs and other compounds on gene expression. This interdisciplinary introduction to DNA arrays will be essential reading for researchers wanting to take advantage of this powerful new technology. is Professor and Director of the Institute for Genomics and Bioinformatics in the Department of Information and Computer Science and in the Department of Biological Chemistry at the University of California, Irvine. is a Professor in the Department of Microbiology and Molecular Genetics in the College of Medicine and the Department of Chemical Engineering and Material Sciences in the School of Engineering at the University of California, Irvine.
DNA M ICROARRAYS A ND G ENE E X P RE SSI O N From experiments to data analysis and modeling PIE RRE BAL DI University of California, Irvine
and G. WE SL E Y HAT F I E L D University of California, Irvine
Cambridge, New York, Melbourne, Madrid, Cape Town, Singapore, São Paulo Cambridge University Press The Edinburgh Building, Cambridge , United Kingdom Published in the United States of America by Cambridge University Press, New York www.cambridge.org Information on this title: www.cambridge.org/9780521800228 © Pierre Baldi and G. Wesley Hatfield 2002 This book is in copyright. Subject to statutory exception and to the provision of relevant collective licensing agreements, no reproduction of any part may take place without the written permission of Cambridge University Press. First published in print format 2002 - isbn-13 978-0-511-07167-6 eBook (EBL) - isbn-10 0-511-07167-1 eBook (EBL) - isbn-13 978-0-521-80022-8 hardback - isbn-10 0-521-80022-6 hardback
Cambridge University Press has no responsibility for the persistence or accuracy of s for external or third-party internet websites referred to in this book, and does not guarantee that any content on such websites is, or will remain, accurate or appropriate.
Contents
Preface
page viii
1
A brief history of genomics
1
2
DNA array formats In situ synthesized oligonucleotide arrays Pre-synthesized DNA arrays Filter-based DNA arrays Non-conventional gene expression profiling technologies
7 7 11 12 13
3
DNA array readout methods Reading data from a fluorescent signal Reading data from a radioactive signal
17 17 21
4
Gene expression profiling experiments: Problems, pitfalls, and solutions Primary sources of experimental and biological variation Special considerations for gene expression profiling in bacteria Problems associated with target preparation with polyadenylated mRNA from eukaryotic cells A total RNA solution for target preparation from eukaryotic cells Target cDNA synthesis and radioactive labeling for pre-synthesized DNA arrays Data acquisition for nylon filter experiments Data acquisition for Affymetrix GeneChip™ glass slide experiments Normalization methods
29 29 32 42 44 45 45 48 49 v
vi
Contents
5
Statistical analysis of array data: Inferring changes Problems and common approaches Probabilistic modeling of array data Simulations Extensions
6
Statistical analysis of array data: Dimensionality reduction, clustering, and regulatory regions Problems and approaches Visualization, dimensionality reduction, and principal component analysis Clustering overview Hierarchical clustering K-means, mixture models, and EM algorithms DNA arrays and regulatory regions
7
8
53 53 55 65 69
73 73 75 78 82 85 90
The design, analysis, and interpretation of gene expression profiling experiments Experimental design Identification of differentially expressed genes Determination of the source of errors in DNA array experiments Estimation of the global false positive level for a DNA array experiment Improved statistical inference from DNA array data using a Bayesian statistical framework Nylon filter data vs. Affymetrix GeneChip™ data Modeling probe pair set data from Affymetrix GeneChips™ Application of clustering and visualization methods Identification of differential gene expression patterns resulting from two-variable perturbation experiments
125
Systems biology Introduction The molecular world: Representation and simulation Computational models of regulatory networks Software and databases The search for general principles
135 135 137 146 163 165
97 99 100 101 103 109 109 124 124
Contents Appendix A Appendix B Appendix C Appendix D
Index
Experimental protocols Mathematical complements Internet resources CyberT: An online program for the statistical analysis of DNA array data
vii 177 185 195 199 207
Preface
A number of array-based technologies have been developed over the last several years, and technological development in this area is likely to continue at a brisk pace. These technologies include DNA, protein, and combinatorial chemistry arrays. So far, DNA arrays designed to determine gene expression levels in living cells have received the most attention. Since DNA arrays allow simultaneous measurements of thousands of interactions between mRNA-derived target molecules and genome-derived probes, they are rapidly producing enormous amounts of raw data never before encountered by biologists. The bioinformatics solutions to problems associated with the analysis of data on this scale are a major current challenge. Like the invention of the microscope a few centuries ago, DNA arrays hold promise of transforming biomedical sciences by providing new vistas of complex biological systems. At the most basic level, DNA arrays provide a snapshot of all of the genes expressed in a cell at a given time. Therefore, since gene expression is the fundamental link between genotype and phenotype, DNA arrays are bound to play a major role in our understanding of biological processes and systems ranging from gene regulation, to development, to evolution, and to disease from simple to complex. For instance, DNA arrays should play a role in helping us to understand such difficult problems as how each of us develops from a single cell into a gigantic supercomputer of roughly 1015 cells, and why some cells proliferate in an uncontrolled manner to cause cancer. One notable difference between modern DNA array technology and the seventeenth-century microscope, however, is in the output produced by these technologies. In both cases, it is an image. But unlike the image one sees through a microscope, an array image is not interpretable by the human eye. Instead, each individual feature of the DNA array image must be measured and stored in a large spreadsheet of numbers with tens to viii
Preface
ix
tens-of-thousands of rows associated with gene probes, and as many columns or experimental conditions as the experimenter is willing to collect. As a side note, this may change in the future and one could envision simple diagnostic arrays that can be read directly by a physician. Clearly, the scale and tools of biological research are changing. The storage, retrieval, interpretation, and integration of large volumes of data generated by DNA arrays and other high-throughput technologies, such as genome sequencing and mass spectrometry, demand increasing reliance on computers and evolving computational methods. In turn, these demands are effecting fundamental changes in how research is done in the life sciences and the culture of the biological research community. It is becoming increasingly important for individuals from both life and computational sciences to work together as integrated research teams and to train future scientists with interdisciplinary skills. It is inevitable that as we enter farther into the genomics era, single-investigator research projects typical of research funding programs in the biological sciences will become less prevalent, giving way to more interdisciplinary approaches to complex biological questions conducted by multiple investigators in complementary fields. Statistical methods, in particular, are essential for the interpretation of high-throughput genomic data. Statistics is no longer a poor province of mathematics. It is rapidly becoming recognized as the central language of sciences that deal with large amounts of data, and rely on inferences in an uncertain environment. As genomic technologies and sequencing projects continue to advance, more and more emphasis is being placed on data analysis. For example, the identification of the function of a gene or protein depends on many things including structure, expression levels, cellular localization, and functional neighbors in a biochemical pathway that are often co-regulated and/or found in neighboring regions along the chromosome. Clearly then, establishing the function of new genes can no longer depend on sequence analysis alone but requires taking into account additional sources of information including phylogeny, environment, molecular and genomic structure, and metabolic and regulatory networks. By contributing to the understanding of these networks, DNA arrays already are playing a significant role in the annotation of gene function, a fundamental task of the genomics era. At the same time, array data must be integrated with sequence data, with structure and function data, with pathway data, with phenotypic and clinical data, and so forth. New biological discoveries will depend strongly on our ability to combine and correlate these diverse data sets along multiple dimensions and scales. Basic research in bioinformatics
x
Preface
must deal with these issues of systems and integrative biology in a situation where the amount of data is growing exponentially. As these challenges are met, and as DNA array technologies progress, incredible new insights will surely follow. One of the most striking results of the Human Genome Project is that humans probably have only on the order of twice the number of genes of other metazoan organisms such as the fly. While these numbers are still being revised, it is clear that biological complexity does not come from sheer gene number but from other sources. For instance, the number of gene products and their interactions can be greatly amplified by mechanisms such as alternative mRNA splicing, RNA editing, and post-translational protein modifications. On top of this, additional levels of complexity are generated by genetic and biochemical networks responsible for the integration of multiple biological processes as well as the effects of the environment on living cells. Surely, DNA and protein array technologies will contribute to the unraveling of these complex interactions. At a time when human cloning and organ regeneration from stem cells are on the horizon, arrays should help us to further understand the old but still largely unanswered questions of nature versus nurture and perhaps strike a new balance between the reductionist determinism of molecular biology and the role of chance, epigenetic regulation, and environment on living systems. However, while arrays and other highthroughput technologies will provide the data, new bioinformatics innovations must provide the methods for the elucidation of these complex interactions. As we progress into the genomics era, it is anticipated that DNA array technologies will assume an increasing role in the investigation of evolution. For example, DNA array studies could shed light on mechanisms of evolution directly by the study of mRNA levels in organisms that have fast generation times and indirectly by giving us a better understanding of regulatory circuits and their structure, especially developmental regulatory circuits. These studies are particularly important for understanding evolution for two obvious reasons: first, genetic adaptation is very constrained since most non-neutral mutations are disadvantageous; and second, simple genetic changes can serve as “amplifiers” in the sense that they can produce large developmental changes, for instance doubling the number of wings in a fly. On the medical side, DNA arrays ought to help us better understand complex issues concerning human health and disease. Among other things, they should help us tease out the effects of environment and life style, including drugs and nutrition, and help usher in the individualized molecular medicine of the future. For example, daily doses of vitamin C
Preface
xi
recommended in the literature vary over three orders of magnitude. In fact, the optimal dose for all nutritional supplements is unknown. Information from DNA array studies should help define and quantify the impact of these supplements on human health. Furthermore, although we are accustomed to the expression “the human body”, large response variabilities among individuals due to genetic and environmental differences are observed. In time, the information obtained from DNA array studies should help us tailor nutritional intake and therapeutic drug doses to the makeup of each individual. Throughout the second half of the twentieth century, molecular biologists have predominantly concentrated on single-gene/single-protein studies. Indeed, this obsessive focus on working with only one variable at a time while suppressing all others in in vitro systems has been a hallmark of molecular biology and the foundation for much of its success. As we enter into the genomics era this basic paradigm is shifting from the study of single-variable systems to the study of complex interactions. During this same period, cell biologists have been following mRNA and/or protein levels during development, and much of what we know about development has been gathered with techniques like in situ hybridization that have allowed us to define gene regulatory mechanisms and to follow the expression of individual genes in multiple tissues. DNA arrays give us the additional ability to follow the expression levels of all of the genes in the cells of a given tissue at a given time. As old and new technologies join forces, and as computational scientists and biologists embrace the high-throughput technologies of the genomics era, the trend will be increasingly towards a systems biology approach that simultaneously studies tens of thousands of genes in multiple tissues under a myriad of experimental conditions. The goal of this systems biology approach is to understand systems of ever-increasing complexity ranging from intracellular gene and protein networks, to tissue and organ systems, to the dynamics of interactions between individuals, populations, and their environments. This large-scale, high-throughput, interdisciplinary approach enabled by genomic technologies is rapidly becoming a driving force of biomedical research particularly apparent in the biotechnology and pharmaceutical industries. However, while the DNA array will be an important workhorse for the attainment of these goals, it should be emphasized that DNA array technology is still at an early stage of development. It is cluttered with heterogeneous technologies and data formats as well as basic issues of noise, fidelity, calibration, and statistical significance that are still being sorted out. Until these issues are resolved
xii
Preface
and standardized, it will not be possible to define the complete genetic regulatory network of even a well-studied prokaryotic cell. In the meantime, most progress will continue to come from focused incremental studies that look at specific networks and specific interacting sets of genes and proteins in simple model organisms, such as the bacterium Escherichia coli or the yeast Saccharomyces cerevisiae. In short, the promise of DNA arrays is to help us untangle the extremely complex web of relationships among genotypes, phenotypes development, environment, and evolution. On the medical side, DNA arrays ought to help us understand disease, create new diagnostic tools, and help usher in the individualized molecular medicine of the future. DNA array technology is here and progressing at a rapid pace. The bioinformatics methods to process, analyze, interpret, and integrate the enormous volumes of data to be generated by this technology are coming.
Audience and prerequisites In 1996, Hillary Rodham Clinton published a book titled It Takes a Village. This book discusses the joint responsibilities of different segments of a community for raising a child. Just like it takes individuals with different talents to raise a child “it takes a village” to do genomics. More precisely, it takes an ongoing dialog and a two-way flow of information and ideas between biologists and computational scientists to develop the designs and methods of genomic experiments that render them amenable to rigorous analysis and interpretation. This book seeks to foster these interdisciplinary interactions by providing in-depth descriptions of DNA microarray technologies that will provide the information necessary for the design and execution of DNA microarray experiments that address biological questions of specific interest. At the same time, it provides the details and discussions of the computational methods appropriate for the analysis of DNA microarray data. In this way, it is anticipated that the computational scientists will benefit from learning experimental details and methods, and that the biologist will benefit from the discussions of the methods for the analysis and interpretation of data that results from these high dimensional experiments. At this time, most biologists depend on their computational colleagues for the development of data analysis methods and the computational scientists depend upon their biologist colleagues to perform experiments that address important biological questions and to generate data. Since this book is directed to both fields, we hope that it will serve as a catalyst to facilitate these critical interactions among researchers of differing talents and
Preface
xiii
expertise. In other words, we have tried to write a book for all members of the genomic village. In this effort, we anticipate that a biologist’s full appreciation of the more computationally intense sections might require consultation with a computational colleague, and that the computational scientists will benefit from discussions concerning experimental details and strategies with the biologist. For the most part, however, this book should be generally comprehensible by either a biologist or a computational scientist with a basic background in biology and mathematics. It is written for students, mostly at the graduate but possibly at the undergraduate level, as well as academic and industry researchers with a diverse background along a broad spectrum from computational to biomedical sciences. It is perhaps fair to say that the primary readers we have in mind are researchers who wish to carry out and interpret DNA array experiments. To this end, we have endeavored to provide succinct explanations of core concepts and techniques.
Content and general outline of the book We have tried to write a comprehensive but reasonably concise introductory book that is self-contained and gives the reader a good sense of what is available and feasible today. We have not attempted to provide detailed information about all aspects of arrays. For example, we do not describe how to build your own array since this information can be obtained from many other sources, ranging from Patrick Brown’s web site at Stanford University to a book by Schena et al.1 Instead, we focus on DNA array experiments, how to plan and execute them, how to analyze the results, what they are good for, and pitfalls the researcher may encounter along the way. The topics of this book reflect our personal biases and experiences. A significant portion of the book is built on material from articles we have written, our unpublished observations, and talks and tutorials we have presented at several conferences and workshops. While we have tried to quote relevant literature, we have concentrated our main effort on presenting the basic concepts and techniques and illustrating them with examples. The main focus of this book is on methods – how to design, execute and interpret a gene expression profiling experiment in a way that remains flexible and open to future developments. In Chapter 1 we present a brief history of genomics that traces some of 1
Brown, P. http://cmgm.stanford.edu/pbrown; Schena, M. (ed.) Microarray Biochip Technology. 2000. Eaton Publishing Co., Natick, MA.
xiv
Preface
the milestones over the past 50 years or so that have ushered us into the genomics era. This history emphasizes the technological breakthroughs – and the authors’ bias towards the importance of the model organism Escherichia coli in the development of the paradigms of modern molecular biology – that have led us from the enzyme period to the genomics era. In Chapter 2 we describe the various DNA array technologies that are available today. These technologies range from in situ synthesized arrays such as the Affymetrix GeneChip™, to pre-synthesized nylon membrane and glass slide arrays, to newer technologies such as electronic and beadbased arrays. In Chapter 3 we describe the methods, technology, and instrumentation required for the acquisition of data from DNA arrays hybridized with radioactive-labeled or fluorescent-labeled targets. In Chapter 4 we consider issues important for the design and execution of a DNA array experiment with special emphasis on problems and pitfalls encountered in gene expression profiling experiments. Special consideration is given to experimental strategies to deal with these problems and methods to reduce experimental and biological sources of variance. In Chapter 5 we deal with the first level of statistical analysis of DNA array data for the identification of differentially expressed genes. Due to the large number of measurements from a single experiment, high levels of noise, and experimental and biological variabilities, array data is best modeled and analyzed using a probabilistic framework. Here we review several approaches and develop a practical Bayesian statistical framework to effectively address these problems to infer gene changes. This framework is applied to experimental examples in Chapter 7. In Chapter 6 we move to the next level of statistical analysis involving the application of visualization, dimensionality reduction, and clustering methods to DNA array data. The most popular dimensionality and clustering methods and their advantages and disadvantages are surveyed. We also examine methods to leverage array data to identify DNA genomic sequences important for gene regulation and function. Mathematical details for Chapters 5 and 6 are presented in Appendix B. In Chapter 7 we present a brief survey of current DNA array applications and lead the reader through a gene expression profiling experiment taken from our own work using pre-synthesized (nylon membrane) and in situ synthesized (Affymetrix GeneChip™) DNA arrays. Here we describe the use of software tools that apply the statistical methods described in Chapters 5 and 6 to analyze and interpret DNA array data. Special emphasis is given to methods to determine the magnitude and sources of experi-
Preface
xv
mental errors and how to use this information to determine global false positive rates and confidence levels. Chapter 8 covers several aspects of what is coming to be known as systems biology. It provides an overview of regulatory, metabolic, and signaling networks, and the mathematical and software tools that can be used for their investigation with an emphasis on the inference and modeling of gene regulatory networks. The appendices include explicit technical information regarding: (A) protocols, such as RNA preparation and target labeling methods, for DNA array experiments; (B) additional mathematical details about, for instance, support vector machines; (C) a section with a brief overview of current database resources and other information that are publicly available over the Internet, together with a list of useful web sites; and (D) an introduction to CyberT, an online program for the statistical analysis of DNA array data. Finally, a word on terminology. Throughout the book we have used for the most part the word “array” instead of “microarray” for two basic reasons: first, in our minds DNA arrays encompass DNA microarrays; second, at what feature density or physical size an array becomes a microarray is not clear. Also, the terms “probe” and “target” have appeared interchangeably in the literature. Here we keep to the nomenclature for probes and targets of northern blots familiar to molecular biologists; we refer to the nucleic acid attached to the array substrate as the “probe” and the free nucleic acid as the “target”.
Acknowledgements Many colleagues have provided us with input, help, and support. At the risk of omitting many of them, we would like to thank in particular Suzanne B. Sandmeyer who has been instrumental in developing a comprehensive program in genomics and the DNA Array Core Facility at UCI, and who has contributed in many ways to this work. We would like to acknowledge our many colleagues from the UCI Functional Genomics Group for the tutelage they have given us at their Tuesday morning meetings, in particular: Stuart Arfin, Lee Bardwell, J. David Fruman, Steven Hampson, Denis Heck, Dennis Kibler, Richard Lathrop, Anthony Long, Harry Mangalam, Calvin McLaughlin, Ming Tan, Leslie Thompson, Mark Vawter, and Sara Winokur. Outside of UCI, we would like to acknowledge our collaborators Craig J. Benham, Rob Gunsalus, and David Low. We would like also to thank Wolfgang Banzhaf, Hamid Bolouri, Hidde de Jong, Eric Mjolsness,
xvi
Preface
James Nowick, and Padhraic Smyth for helpful discussions. Hamid and Hidde also provided graphical materials, James and Padhraic provided feedback on an early version of Chapter 8, and Wolfgang helped proofread the final version. Additional material was kindly provided by John Weinstein and colleagues, and by Affymetrix including the image used for the cover of the book. We would like to thank our excellent graduate students Lorenzo Tolleri, Pierre-François Baisnée, and Gianluca Pollastri, and especially She-pin Hung, for their help and important contributions. We gratefully acknowledge support from Sun Microsystems, the Howard Hughes Medical Institute, the UCI Chao Comprehensive Cancer Center, the UCI Institute for Genomics and Bioinformatics (IGB), the National Science Foundation, the National Institutes of Health, a Laurel Wilkening Faculty Innovation Award, and the UCI campus administration, as well as a GAANN (Graduate Assistantships in Areas of National Need Program) and a UCI BREP (Biotechnology Research and Education Program) training grant in Functional and Computational Genomics. Ann Marie Walker at the IGB helped us with the last stages of this project. We would like also to thank our editors, Katrina Halliday and David Tranah at Cambridge University Press, especially for their patience and encouragement, and all the staff at CUP who have provided outstanding editorial help. And last but not least, we wish to acknowledge the support of our friends and families.
1 A brief history of genomics
From time to time new scientific breakthroughs and technologies arise that forever change scientific practice. During the last 50 years, several advances stand out in our minds that – coupled with advances in the computational and computer sciences – have made genomic studies possible. In the brief history of genomics presented here we review the circumstances and consequences of these relatively recent technological revolutions. Our brief history begins during the years immediately following World War II. It can be argued that the enzyme period that preceded the modern era of molecular biology was ushered in at this time by a small group of physicists and chemists, R. B. Roberts, P. H. Abelson, D. B. Cowie, E. T. Bolton, and J. R. Britton in the Department of Terrestrial Magnetism of the Carnegie Institution of Washington. These scientists pioneered the use of radioisotopes for the elucidation of metabolic pathways. This work resulted in a monograph titled Studies of Biosynthesis in Escherichia coli that guided research in biochemistry for the next 20 years and, together with early genetic and physiological studies, helped establish the bacterium E. coli as a model organism for biological research [1]. During this time, most of the metabolic pathways required for the biosynthesis of intermediary metabolites were deciphered and biochemical and genetic methods were developed to identify and characterize the enzymes involved in these pathways. Much in the way that genomic DNA sequences are paving the way for the elucidation of global mechanisms for genetic regulation today, the biochemical studies initiated in the 1950s that were based on our technical abilities to create isotopes and radiolabel biological molecules paved the way for the discovery of the basic mechanisms involved in the regulation of metabolic pathways. Indeed, these studies defined the biosynthetic pathways for the building blocks of macromolecules such as proteins and 1
2
A brief history of genomics
nucleic acids and led to the discovery of mechanisms important for metabolic regulation such as end product inhibition, allostery, and modulation of enzyme activity by protein modifications. However, major advances concerning the biosynthesis of macromolecules awaited another breakthrough, the description of the structure of the DNA helix by James D. Watson and Francis H. C. Crick in 1953 [2]. With this information, the basic mechanisms of DNA replication, protein synthesis, gene expression, and the exchange and recombination of genetic material were rapidly unraveled. During the enzyme period, geneticists around the world were using the information provided by biochemists to develop model systems such as bacteria, fruit flies, yeast, and mice for genetic studies. In addition to establishment of the basic mechanisms for protein-mediated regulation of gene expression by F. Jacob and J. Monod in 1961 [3], these genetic studies led to fundamental discoveries that were to spawn yet another major change in the history of molecular biology. This advance was based on studies designed to determine why E. coli cells once infected by a bacteriophage were immune to subsequent infection. These seemingly esoteric investigations led by Daniel Nathans and Hamilton Smith [4] resulted in the discovery of new types of enzymes, restriction endonucleases and DNA ligases, capable of cutting and rejoining DNA at sequence-specific sites. It was quickly recognized that these enzymes could be used to construct recombinant DNA molecules composed of DNA sequences from different organisms. As early as 1972 Paul Berg and his colleagues at Stanford University developed an animal virus, SV40, vector containing bacteriophage lambda genes for the insertion of foreign DNA into E. coli cells [5]. Methods of cloning and expressing foreign genes in E. coli have continued to progress until today they are fundamental techniques upon which genomic studies and the entire biotechnology industry are based. The recent history of genomics also has been driven by technological advances. Foremost among these advances were the methodologies of the polymerase chain reaction (PCR) and automated DNA sequencing. PCR methods allowed the amplification of usable amounts of DNA from very small amounts of starting material. Automated DNA sequencing methods have progressed to the point that today the entire DNA sequence of microbial genomes containing several million base pairs can be obtained in less than one week. These accomplishments set the stage for the human genome project. As early as 1984 the small genomes of several microbes and bacteriophages had been mapped and partially sequenced; however, the modern era
A brief history of genomics
3
of genomics was not formally initiated until 1986 at an international conference in Santa Fe, New Mexico sponsored by the Office of Health and Environmental Research1 of the US Department of Energy. At this meeting, the desirability and feasibility of implementing a human genome program was unanimously endorsed by leading scientists from around the world. This meeting led to a 1988 study by the National Research Council titled Mapping and Sequencing the Human Genome that recommended the United States support a human genome program and presented an outline for a multiphase plan. In that same year, three genome research centers were established at the Lawrence Berkeley, Lawrence Livermore, and Los Alamos national laboratories. At the same time, under the leadership of Director James Wyngaarden, the National Institutes of Health established the Office of Genome Research which in 1989 became the National Center for Human Genome Research, directed by James D. Watson. The next ten years witnessed rapid progress and technology developments in automated sequencing methods. These technologies led to the establishment of largescale DNA sequencing projects at many public research institutions around the world such as the Whitehead Institute in Boston, MA and the Sanger Centre in Cambridge, UK. These activities were accompanied by the rapid development of computational and informational methods to meet challenges created by an increasing flow of data from large-scale genome sequencing projects. In 1991 Craig Venter at the National Institutes of Health developed a way of finding human genes that did not require sequencing of the entire human genome. He relied on the estimate that only about 3 percent of the genome is composed of genes that express messenger RNA. Venter suggested that the most efficient way to find genes would be to use the processing machinery of the cell. At any given time, only part of a cell’s DNA is transcriptionally active. These “expressed” segments of DNA are converted and edited by enzymes into mRNA molecules. Using an enzyme, reverse transcriptase, cellular mRNA fragments can be transcribed into complementary DNA (cDNA). These stable cDNA fragments are called expressed sequence tags, or ESTs. Computer programs that match overlapping ends of ESTs were used to assemble these cDNA sequences into longer sequences representing large parts, or all, of many human genes. In 1992, Venter left NIH to establish The Institute for Genomic Research, TIGR. By 1995 researchers in public and private institutions had isolated over 170000 1
Changed in 1998 to the Office of Biological and Environmental Research of the Department of Energy.
4
A brief history of genomics
ESTs, which were used to identify more than half of the then estimated 60000 to 80000 genes in the human genome.2 In 1998, Venter joined with Perkin-Elmer Instruments (Boston, MA) to form Celera Genomics (Rockville, MD). With the end in sight, in 1998 the Human Genome Program announced a plan to complete the human genome sequence by 2003, the 50th anniversary of Watson and Crick’s description of the structure of DNA. The goals of this plan were to: • Achieve coverage of at least 90% of the genome in a working draft based on mapped clones by the end of 2001. • Finish one-third of the human DNA sequence by the end of 2001. • Finish the complete human genome sequence by the end of 2003. • Make the sequence totally and freely accessible. On June 26, 2000, President Clinton met with Francis Collins, the Director of the Human Genome Program, and Craig Venter of Celera Genomics to announce that they had both completed “working drafts” of the human genome, nearly two years ahead of schedule. These drafts were published in special issues of the journals Science and Nature early in 2001 [6, 7] and the sequence is online at the National Center for Biotechnology Information (NCBI) of the Library of Medicine at the National Institutes of Health As of this writing, the NCBI databases also contain complete or in progress genomic sequences for ten Archaea and 151 bacteria as well as the genomic sequences of eight eukaryotes including: the parasites Leishmania major and Plasmodium falciparum; the worm Caenorhabditis elegans; the yeast Saccharomyces cerevisiae; the fruit fly Drosophila melanogaster; the mouse Mus musculus; and the plant Arabidopsis thaliana. Many more genome sequencing projects are under way in private and public research laboratories that are not yet available on public databases. It is anticipated that the acquisition of new genome sequence data will continue to accelerate. This exponential increase in DNA sequence data has fuelled a drive to develop technologies and computational methods to use this information to study biological problems at levels of complexity never before possible.
2
At the present time (September 2001) the estimate of the number of human genes has decreased nearly twofold.
A brief history of genomics
5
1. Roberts, R. B., Abelson, P. H., Cowie, D. B., Bolton, E. B., and Britten, J. R. Studies of Biosynthesis in Escherichia coli. 1955. Carnegie Institution of Washington, Washington, DC. 2. Watson, J. D., and Crick, F. H. C. A structure for deoxyribose nucleic acid. 1953. Nature 171:173. 3. Jacob, F., and Monod, J. Genetic regulatory mechanisms in the synthesis of proteins. 1961. Journal of Molecular Biology 3:318–356. 4. Nathans, D., and Smith, H. O. A suggested nomenclature for bacterial host modification and restriction systems and their enzymes. 1973. Journal of Molecular Biology 81:419–423. 5. Jackson, D. A., Symons, R. H., and Berg, P. Biochemical method for inserting new genetic information into DNA of simian virus 40: circular SV40 DNA molecules containing lambda phage genes and the galactose operon of Escherichia coli. 1972. Procedings of the National Academy of Sciences of the USA 69:2904–2909. 6. Science Human Genome Issue. 2001. 16 February, vol. 291. 7. Nature Human Genome Issue. 2001. 15 February, vol. 409.
2 DNA array formats
Array technologies monitor the combinatorial interaction of a set of molecules, such as DNA fragments and proteins, with a predetermined library of molecular probes. The currently most advanced of these technologies is the use of DNA arrays, also called DNA chips, for simultaneously measuring the level of the mRNA gene products of a living cell. This method, gene expression profiling, is the major topic of this book. In its most simple sense, a DNA array is defined as an orderly arrangement of tens to hundreds of thousands of unique DNA molecules (probes) of known sequence. There are two basic sources for the DNA probes on an array. Either each unique probe is individually synthesized on a rigid surface (usually glass), or pre-synthesized probes (oligonucleotides or PCR products) are attached to the array platform (usually glass or nylon membranes). The various types of DNA arrays currently available for gene expression profiling, as well as some developing technologies, are summarized here.
In situ synthesized oligonucleotide arrays The first in situ probe synthesis method for manufacturing DNA arrays was the photolithographic method developed by Fodor et al. [1] and commercialized by Affymetrix Inc. (Santa Clara, CA). First, a set of oligonucleotide DNA probes (each 25 or so nucleotides in length) is defined based on its ability to hybridize to complementary sequences in target genomic loci or genes of interest. With this information, computer algorithms are used to design photolithographic masks for use in manufacturing the probe arrays. Selected addresses on a photo-protected glass surface are illuminated through holes in the photolithographic mask, the glass surface is flooded with the first nucleotide of the probes to be synthesized at the 7
8
DNA microarray formats
selected addresses, and photo-chemical coupling occurs at these sites. For example, the addresses on the glass surface for all probes beginning with guanosine are photo-activated and chemically coupled to guanine bases. This step is repeated three more times with masks for all addresses with probes beginning with adenosine, thymine, or cytosine. The cycle is repeated with masks designed for adding the appropriate second nucleotide of each probe. During the second cycle, modified phosphoramidite moieties on each of the nucleosides attached to the glass surface in the first step are light-activated through appropriate masks for the addition of the second base to each growing oligonucleotide probe. This process is continued until unique probe oligonucleotides of a defined length and sequence have been synthesized at each of thousands of addresses on the glass surface (Figure 2.1). Several companies such as Protogene (Menlo Park, CA) and Agilent Technologies (Palo Alto, CA) in collaboration with Rosetta Inpharmatics (Kirkland, WA) of Merck & Co. Inc. (Whitehouse Station, NJ) have developed in situ DNA array platforms through proprietary modifications of a standard piezoelectric (ink-jet) printing process that unlike the manufacturing process for Affymetrix GeneChips™, does not require photolithography. These in situ synthesized oligonucleotide arrays are fabricated directly on a glass support on which oligonucleotides up to 60 nucleotides are synthesized using standard phosphoramidite chemistry. The ink-jet printing technology is capable of depositing very small volumes – picoliters per spot – of DNA solutions very rapidly and very accurately. It also delivers spot shape uniformity that is superior to other deposition methods. Researchers in the Nano-fabrication Center at the University of Wisconsin have developed yet another method for the manufacture of in situ synthesized DNA arrays that also does not require photolithographic masks [2]. This technology known as MAS for maskless array synthesizer capitalizes on existing electronic chips used in overhead projection known as digital light processors (DLPs). A DLP is an array of up to 500000 tiny aluminum mirrors arranged on a computer chip. By electronic manipulation of the mirrors, light can be directed to specific addresses on the surface of a DNA array substrate, thus eliminating the need for expensive photolithographic masks. This technology is being implemented by NimbleGen Systems, LLC (Madison, WI). DNA arrays containing over 307000 discrete features are currently being synthesized and plans are under way to synthesize a second-generation MAS array containing over 2 million discrete features. The Wisconsin researchers claim that this method will greatly reduce the time and cost for the manufacture of high-density in situ
Figure 2.1. The Affymetrix method for the manufacture of in situ synthesized DNA microarrays (courtesy of Affymetrix). (1) A photo-protected glass substrate is selectively illuminated by light passing through a photolithographic mask. (2) Deprotected areas are activated. (3) The surface is flooded with a nucleoside solution and chemical coupling occurs at photo-activated positions. (4) A new photolithographic mask pattern is applied. (5) The coupling step is repeated. (6) This process is repeated until the desired set of probes is obtained.
10
DNA microarray formats
Table 2.1. Commercial sources for DNA arrays Company Affymetrix1,2,3,4,5,6,7,8,18 Agilent Technologies18 AlphaGene1,18 Clontech1,2,3,18 Corning6 Eurogentec5,6,9,11,12,14,15,16,18 Genomic Solutions1,2,3 Genotech1,2 Incyte Pharmaceuticals1,2,3,4,9,10,18 Invitrogen1,2,3,6 Iris BioTechnologies1 Mergen Ltd1,2,3 Motorola Life Science1,3,18 MWG Biotech3,6,8,18 Nanogen NEN Life Science Products1 Operon Technologies Inc.1,6,18 Protogene Laboratories18 Radius Biosciences18 Research Genetics1,2,3,6 Rosetta Inpharmatics18 Sigma-Genosys1,2,8,11,12,13,18 Super Array Inc.1,2,18 Takara1,2,4, 8,17,18
Nylon Glass Plastic filters slides slides Chips Web site X
X X
X X X X X X
X
X X X
X X X X X X X X
X X X X
X
X
X X
www.affymetrix.com www.chem.agilent.com www.alphagene.com www.clontech.com www.corning.com/cmt www.eurogentec.be www.genomicsolutions.com www.genotech.com www.incyte.com www.invitrogen.com www.irisbiotech.com www.mergen-ltd.com www.motorola.com/lifesciences www.mwg-biotech.com www.nanogen.com www.nenlifesci.com www.operon.com www.protogene.com www.ultranet.com/~radius www.resgen.com www.rii.com www.genosys.com www.superarray.com www.takara.co.jp/english/bio_e
Notes: Human, 2Mouse, 3Rat, 4Arabidopsis, 5Drosophila, 6Saccharomyces cerevisiae, 7HIV, 8 Escherichia coli, 9Candida albicans, 10Staphylococcus aureus, 11Bacillus subtilis, 12 Helicobacter pylori, 13Campylobacter jejuni, 14Streptomyces lividans, 15Streptococcus pneumoniae, 16Neisseria meningitidis, 17Cyanobacteria, 18Custom. 1
synthesized DNA mircoarrays, and bring this activity into individual research laboratories. CombiMatrix (Snoqualmie, WA) and Nanogen (San Diego, CA) are developing electrical addressing systems for the manufacture of DNA arrays on semiconductor chips. The CombiMatrix method involves attaching each addressable site on the chip to an electrical conduit (electrode) applied over a layer of porous material. Each DNA probe is synthesized one base at a time by flooding the porous layer with a nucleoside and activating each electrode where a new base is to be added. Once activated, the electrode causes an electrochemical reaction to occur which produces
Pre-synthesized DNA arrays
11
chemicals that react with the existing nucleotides, or chains of DNA, at that site for bonding to the probe site or to the next nucleotide base. At present, CombiMatrix has produced DNA arrays with 100 m features that possess 1024 test sites within less than a square centimeter. Researchers at CombiMatrix believe that by using a standard 0.25-m semiconductor fabrication process, they can produce a biological array processor with over 1000000 sites per square centimeter. Nanogen uses a similar process to attach pre-synthesized oligonucleotides to electronically addressable sites on a semiconductor chip. To date, Nanogen has only produced a 99 probe array suitable for forensic and diagnostic purposes; however, Nanogen’s researchers anticipate electronic arrays with thousands of addresses for genomics applications.
Pre-synthesized DNA arrays The method of attaching pre-synthesized DNA probes (usually 100–5000 bases long) to a solid surface such as glass (or nylon filter) supports was conceived 25 years ago by Ed Southern and more recently popularized by the Patrick O. Brown laboratory at Stanford University. While the early manufacturing methods for miniaturized DNA arrays using in situ probe synthesis required sophisticated and expensive robotic equipment, the glass slide DNA array manufacturing methods of Brown made DNA arrays affordable for academic research laboratories. As early as 1996 the Brown laboratory published step-by-step plans for the construction of a robotic DNA arrayer on the internet. Since that time, many commercial DNA arrayers have become available. Besides the commercially produced Affymetric GeneChips™, these Brown-type glass slide DNA arrays are currently the most popular format for gene expression profiling experiments. The Brown method for printing glass slide DNA arrays involves the robotic spotting of small volumes (in the nanoliter to picoliter range) of a DNA probe sample onto a 25761 mm glass slide surface previously coated with poly-lysine or poly-amine for electrostatic adsorption of the DNA probes onto the slide. Depending upon the pin type and the exact printing technology employed, 200 to 10000 spots ranging in size from 500 to 75 m can be spotted in a 1-cm2 area. Many public and private research institutions in the USA and abroad have developed core facilities for the inhouse manufacture of custom glass slide DNA arrays. Detailed discussions of the instrumentation and methods for printing glass slide DNA arrays can be found in a book edited by Mark Schena titled Microarray Biochip Technology [3].
12
DNA microarray formats
Several additional methods for attaching pre-synthesized DNA probes to solid surfaces for the manufacture of DNA arrays have been developed. For example, the electronic methods of CombiMatrix and Nanogen and the piezoelectric methods of Agilent Technologies, described earlier, can also be used to attach pre-synthesized DNA probes to glass slides. In addition to these methods, Interactiva (Ulm, Germany) has developed a method for the attachment of DNA probes to a 0.1m layer of 24-karat gold overlaid with a hydrophobic teflon covering containing an array of 50m wells. A self-assembling monolayer of thio alkanes coupled to streptavidin is adsorbed to the gold surfaces in each well. This streptavidin surface serves as an anchor for the deposition of biotin-labeled DNA probes. Corning (Corning, NY) has developed a novel manufacturing process that enables the high speed, high capacity production of arrays. Drawing upon their experience in glass and plastics manufacturing, process engineering, and surface technologies, they have developed a method to simultaneously array thousands of spots onto specially formulated glass slides in a massively parallel and reproducible manner and at a high density. This process is based on Corning’s ability to construct a honeycomb-like glass structure with 1024 individual cells. Each cell is loaded with a unique DNA probe and the contents of the honeycomb structure are simultaneously printed onto the surface of a glass slide. Since more than a thousand probes are deposited onto each slide at the same time this process is much faster than current methods, and it allows the simultaneous printing of thousands of slides per manufacturing run. Unfortunately, Corning abandoned this array manufacturing process early in 2002.
Filter-based DNA arrays Although solid support matrices such as glass offer many advantages for high-throughput processing, nylon filter-based arrays continue to be a popular format. The primary reasons for this appear to be that gene expression profiling with nylon filters is based on standard southern blotting protocols familiar to molecular biologists, and because equipment to perform filter hybridizations with 33P-labeled cDNA targets and for data acquisition, such as a phosphorimager, are available at most research institutions. Although, primarily because of health risks, non-radioactive labeling is preferred in most settings, radioactive labeling of the targets for hybridization to nylon filter arrays offers the advantage of greater sensitivity com-
Non-conventional profiling technologies
13
pared to fluorescently labeled targets, and intensity measurements linear over a four to five log range are achieved with radio-labeled targets; whereas, linear ranges of only three logs are typically observed with fluorescently labeled targets. Additional advantages of nylon filter arrays are that many types are available on the commercial market (Table 2.1), and that there is a cost advantage inherent in the fact that nylon filters can be stripped and reused several times without significant deterioration [4]. Because of the porous nature of nylon filters, they are not amenable to miniaturization. However, they are suited for gene expression profiling studies in organisms with small genome sizes such as bacteria, or for the production of custom arrays containing DNA probes for a functional subset of an organism’s genes. For example, Sigma-Genosys (Woodland, TX) produces a nylon filter DNA array for gene expression profiling in E. coli. This filter array, which measures 1121 cm, contains over 18000 addresses spotted, in duplicate, with full-length PCR products of each of the 4290 E. coli open reading frames (ORFs). In addition to E.coli arrays, Sigma-Genosys also produces high-quality nylon filter arrays containing duplicate full-length PCR products of all of the ORFs of the bacteria Bacillus subtilis and Helicobacter pylori and additional genomic arrays of other bacteria are being developed. They and others also provide a nylon filter array containing human cytokine genes and an array containing human apoptosis genes. Several other companies also provide nylon filter arrays similarly spotted with DNA probe sets of related human genes (Table 2.1). For example Clonetech (Palo Alto, CA) produces nearly 30 nylon filter DNA arrays containing from 200 to 1200 DNA probes for functionally related sets of human, mouse, or rat genes. Research Genetics (Minneapolis, MN) sells filters with probes for functionally related human, mouse, and rat genes as well as the complete genome of Saccharomyces cerevisiae (6144 probes) contained on two nylon membrane filters. New products from these and other commercial suppliers are appearing at a rapid rate.
Non-conventional gene expression profiling technologies Lynx (Hayward, CA) has developed yet another strategy for identifying and isolating differentially expressed genes between two cell types. Their method employs a “fluid array.” This method involves hybridizing two probes prepared separately, one from each of the samples to be compared, with a population of micro-beads, each carrying many copies of a single DNA fragment or gene derived from either of the samples. Because each
14
DNA microarray formats
probe is labeled with a different fluorescent marker, genes or fragments that are under- or overrepresented in either sample are readily separated in a fluorescence activated cell sorter. Genes or fragments of interest can be recovered and cloned for further study. The Lynx approach has been extended by an intriguing bead-based fiber optic DNA array format suggested by David R. Walt of Tufts University. Since this format is a dramatic departure from other array platforms it warrants some comment. First, an array of thousands (typically 5000–50000) of individual optical fibers each 3 to 7 m in diameter are fused into a single bundle. Next, an agent such as hydrofluoric acid is used to etch 2 m wells (the size of microspheres) into the ends of each fiber, and microspheres each carrying a different DNA probe are inserted into the wells. The microspheres can contain oligonucleotide probes built up base by base using conventional phosphoramidite chemistry, or preformed oligonucleotides can be added directly to surface-activated microspheres. Fluorescent signals generated by probe hybridization to target DNA molecules on the microspheres are transmitted through the fiber to a photo-detection system. Since the resulting array is randomly distributed, any probe sequence can be positioned in any given well. Therefore, a strategy must be available for registering each array. Walt suggests several methods to accomplish this task. For example, each different type of microsphere can be tagged with a unique combination of fluorescent dyes either before or after probe attachment. This “optical bar code” is a combination of fluorescent dyes with different excitation and emission wavelengths and intensities that allow each bead to be independently identified. These optically bar-coded arrays can be decoded with conventional signal processing software by collecting a series of fluorescence signals at different excitation and emission wavelengths and analyzing the relative intensities emitted from each bead. Because of the necessity to insure that each array contain at least one bead for each probe, replicates of each bead must be present in each array. However, this redundancy provides two advantages. First, a voting scheme in which replicates must agree can be used to evaluate false positives and false negatives. Second, redundancy enhances sensitivity. Since signal-tonoise ratios scale as the square root of the number of identical sensing elements, sensitivity can be enhanced by looking at all the identical probe microspheres in the array. A disadvantage for the creation of fiber optic arrays is that each bead-based oligonucleotide probe must be synthesized individually as opposed to the combinatorial synthesis approaches available with light-directed or ink-jet techniques. On the other hand, a single synthesis can produce enough beads for thousands of arrays.
Non-conventional profiling technologies
15
An advantage of the fiber optic array is its sensitivity. Walt argues that the small size of individual beads ensures a high local concentration when only a few DNA target copies are bound. For example, a 3 m bead occupies a volume of only a few femtoliters; therefore, when only 1000 labeled target molecules hybridize to the probe microsphere, a local target concentration near 1 mmol is achieved – a relatively easy concentration for fluorescent dye to detect. Walt points out that this local concentration of fluorescent probe combined with the signal-to-noise enhancements from redundant array elements will enable detection limits of femtomolar concentrations and absolute detection limits of zeptomoles (1021 moles) of DNA. A limitation to this technology has been the fact that current fluorophores fade quickly, have a limited color range, and their overlapping absorption spectra make their combined use impractical for high-level multiplexing applications. However, researchers from the University of Indiana have recently described a sophisticated optical labeling system that relies on the unique properties of luminescent quantum dots (QDs) – lightemitting nanocrystals. Like conventional fluorophores, QDs absorb light and emit it at a different wavelength. However, QDs are brighter than conventional fluorophores, and they are resistant to photobleaching. QDs of different sizes emit different colors that can be excited by the light of a single wavelength, and unlike ordinary fluorophores, the emission spectra of individual QDs are very narrow. Thus, QDs can be embedded in polymer beads at precisely controlled ratios to produce a rainbow of colors. It appears that QD nanocrystals embedded in microspheres might be ideal for the bar-coding applications envisioned by Walt and others. 1. Fodor, S. P., Rava, R. P., Huang, X. C., Pease, A. C., Holmes, C. P., and Adams, C. L. Multiplexed biochemical assays with biological chips. 1993. Nature 364:555–556. 2. Singh-Gasson, S., Green, R. D., Wue, Y., Nelson, C., Blattner, F., Sussman, M. R. and Cerrine, F. Maskless fabrication of light-directed oligonucleotide microarrays using a digital micromirror array. 1999. Nature Biotechnology 17:974–978. 3. Schena, M. (ect.) Microarray Biochip Technology. 2000. Eaton Publishing Co., Natick, MA. 4. Arfin, S. M., Long, A. D., Ito, E., Riehle, M. M., Paegle, E. S., and Hatfield, G. W. Global gene expression profiling in Escherichia coli K12: the effects of integration host factor. 2000. Journal of Biological Chemistry 275:29672–29684.
3 DNA array readout methods
Once a DNA array experiment has been designed and executed the data must be extracted and analyzed. That is, the signal from each address on the array must be measured and some method for determining and subtracting the background signal must be employed. However, because there are many different DNA array formats and platforms, and because hybridization signals can be generated with fluorescent- or radioactive-labeled targets, no single DNA array readout device is suitable for all purposes. Furthermore, many instruments with different advantages and disadvantages for different types of array formats are available. Therefore, since accurate data acquisition is a critical step of any array experiment, careful attention must be paid to the selection of data acquisition equipment. Reading data from a fluorescent signal All arrays that emit a fluorescent signal must be read with an instrument that provides a fluorescence excitation energy source and an efficient detector for the light emitted from the fluorophore incorporated into the target. Currently, the fluorophores most commonly used for incorporation into cDNA targets are Cy3 and Cy5. These are cyanine dyes commercially available as dUTP or dCTP conjugates. Cy3 is an orange dye with a light absorption maximum at 550 nm and an emission maximum at 581 nm. Cy5 is a far-red dye with a light absorption maximum at 649 nm and an emission maximum at 670 nm. All commercial scanners for reading fluorescent array signals use lasers and filters that provide an excitation light source at a single wavelength near the absorption maxima of these and other commonly used dyes. Lasers eliminate pollution of fluorescence emissions at nearby wavelengths that would occur with a light source of multiple wavelengths. Defined laser emission wavelengths and filters also permit the use 17
18
DNA array readout methods
and efficient detection of fluorescent emissions from two or more fluorophores in a single experiment. This permits the common practice of combining cDNA targets prepared from a reference and an experimental condition, one containing Cy3-labeled and the other Cy5-labeled nucleotides, for analysis on a single array. Of course, instruments for this application must be equipped with multiple laser sources, one for each fluorophore used. In addition to providing an appropriate light source for fluorophore excitation, attention must be paid to the efficiency and accuracy of fluorescence emission measurements. Efficiency is an issue because the amount of light emitted from a fluorophore is generally orders of magnitudes (as much as 1000000-fold) weaker than the intensity of the light required to excite the fluorophore. This problem is further exacerbated by the fact that fluorophores emit light in all directions, not just toward the light detector system. Thus, some optical method to collect as much of the emitted light and eliminate as much of the excitation light as possible is required. This is accomplished with an objective lens that captures the emitted light and focuses it toward the detector. However, it is not possible to collect this light simultaneously from all directions. The best that can be accomplished is to collect that light that is emitted from the hemisphere of the fluorescence directed toward the detector. The efficiency of an objective lens in accomplishing this task is expressed as its numerical aperture. If it were possible to collect all of the light in a hemisphere, the objective would have a numerical aperture of 1.0. In reality, objective lenses in array readers have numerical apertures ranging from 0.5 to 0.9. Obviously, the numerical aperture of the objective lens directly affects an instrument’s sensitivity. Therefore, since instrument manufacturers often do not list this information in their product description, it is something that a purchaser should ask for. All organic molecules fluoresce. Any contamination on an array surface (commonly glass slides), including the coated surface of the slide itself, will produce background fluorescence that can seriously compromise the signal-to-noise ratio. The answer to this problem has been addressed by limiting the focus of the laser to a small field of view in three-dimensional space centered in the DNA sample on the array. This is accomplished by a confocal method comprising two lenses in series producing two reciprocal focal points, one focused on the sample and the other focused at a pinhole for transmission of the light signal to the detector. The beauty of this system is that the pinhole permits only the light from a very narrow depth of focus of the objective lens to be passed through to the detector (Figure 3.1). This allows very fine discrimination of noise and signal.
Reading data from a fluorescent signal Glass slide
Laser
Objective lens
Beam splitter
Filter Collector lens
19
Pinhole
Photomultiplier tube
Figure 3.1. The principle of confocal scanning laser microscopy. Confocal systems image only a small point (pixel) in three-dimensional space. This is achieved by employing a laser as an illumination source and a small aperture in front of the detector, which usually is a photomultiplier tube. A schematic of a simplified confocal optical path is shown above. The laser beam enters from above and is reflected by the beam splitter (a dichroic or multichroic filter that reflects light of short wavelengths and transmits light of longer wavelengths). The laser beam is focused to a spot on the surface of the glass slide by an objective lens and excites fluorophores in the focal plane of the objective. The fluorescent emissions (and the reflected laser beam rays) are collected by the objective and collimated into parallel rays (solid lines). Most of the reflected laser rays (95%) are reflected back toward the laser source by the beam splitter. The remaining laser rays are excluded by a downstream filter specific for the emission wavelength of the fluorophore. The parallel rays of the fluorescent light received from the focal plane of the objective lens are focused on a pinhole in a detector plate and passed through to the photomultiplier tube. The ray paths indicated with dashed lines shows how light from out-of-focus objects such as reflections and emissions from the second surface of the glass slide are eliminated by the design of the optical system. This out-of-focus fluorescent light takes a different path through the objective lens, the beam splitter, and the emission filter. As a result, it is not focused into the detector pinhole and, therefore only a small portion of this polluted light is passed on to the photomultiplier tube. Since confocal microscopy images only a small point in three-dimensional space proportional to the aperture of the pinhole in the detector plate, complete images must be obtained by scanning and digital reconstruction.
The depth of focus for most commercial laser-based array readers is 3 m, less than half the thickness of the DNA sample on the slide surface. However, since the diameters of the spots printed on glass slide DNA arrays range from 25 to 100 m, this means that at this 3 m (1 pixel) resolution slides must be scanned to collect all of the data even from a single spot. At this resolution, even the highest density arrays can be accurately
20
DNA array readout methods
scanned. Scanning at this resolution, however, requires several minutes. For this reason, manufacturers of confocal laser scanners provide the option to scan at lower resolutions ranging down to 50 m. This is useful for rapid pre-scanning of arrays for sensitivity and scanning alignment adjustments. There are three ways to scan an array – either move the array or move the laser, or both. In general systems that move the array under a fixed laser source are preferred because of their increased light-gathering efficiency. Another consideration for a confocal laser scanner is the detector system and its associated software for data aquisition. Most commercially available instruments use photomultiplier tubes with amplifiers that allow for high voltage adjustments that can provide up to a 10000-fold sensitivity range, sufficient for accommodating the signal variability and intensity ranges of most array experiments. In addition, the power of the laser can be adjusted. The greater the intensity of the laser beam the more fluorescence; however, this is partially offset by the short time during scanning that each pixel is illuminated. The optimal strength of laser intensity is further dictated by the fluorophore since excessive excitation light can damage the fluorophore and decease the signal-to-noise ratio (photo bleaching). Thus, efforts are under way to develop new fluorophores that can accept more excitation energy, and produce more fluorescence. Some commercially available scanners are equipped with a chargecoupled device (CCD) to detect photons rather than a photomultiplier tube to create an array image. The major drawbacks of CCD systems are the time required for image acquisition and the limited resolution of the image obtained. CCD systems use white light to excite the fluorophores on the array. Since this results in the release of many fewer photons than a focused high-intensity laser source, more time is required to generate an image of acceptable quality. This extended integration time results in higher backgrounds due the generation of dark-current noise. Also, even at a 10 m resolution the largest CCD chips (approx. 16001200 pixels) available at an acceptable price are too small to acquire a single image from a 2576 mm glass slide array. Thus, laser scanners equipped with photomultiplier tubes are the instruments of choice for most researchers. All scanners on the market today are controlled through a computer interface to set instrument parameters and retrieve array data. In addition, each manufacturer includes software bundles to filter and process these data, often in proprietary ways that may not fit the experimental designs of every researcher. Thus, given the myriad of ways that individual researchers might wish to process and analyze array data and the rapid advances occurring in this area, it is important to ascertain that the instrument’s data aqui-
Reading data from a radioactive signal
21
sition software fits the user’s needs and allows retrieval of primary unprocessed data. At present, there are several major suppliers of scanners for DNA arrays. The essential features of the instruments offered by these companies are described in Table 3.1.
Reading data from a radioactive signal Historically, nucleic acids have been labeled with beta-emitting radioisotopes such as 32P or 33P incorporated into the or phosphate position of nucleotide triphosphate molecules and visualized by exposure to X-ray film. While this is an efficient and proven labeling and imaging method routinely used in molecular biology laboratories, it is not suitable for small format, high-density DNA array platforms with DNA probes printed at 100 to 300 m intervals on glass slides or 20 to 24 m intervals on Affymetrix GeneChips™. This is because the omni-directional radioactive emissions from targets hybridized to one spot on the array can contaminate the signals obtained from neighboring probe sites. Furthermore, imaging and quantitation of arrays with X-ray film is excluded because the grain density is too large and the linear range of the film (100-fold) is far less than the linear range of signal intensities (10000-fold) obtained from array experiments. However, larger format arrays are feasible, and the signals from these arrays can be accurately measured by commercially available phosphorimaging instruments with a linear range over 100000fold. Figure 3.2 shows a phosphorimage of a large-format Sigma-Genosys Panorama™ E. coli Gene Array printed on a 1121 cm nylon membrane. This array contains over 18000 addresses. The size of each probe spot is 1 mm and they are centered at 1 mm intervals. Quantitative data can be extracted from DNA arrays of this type with any of a number of phosphorimaging instruments with a scanning resolution of at least 50 m. Phosphorimaging is based on a phenomenon known as photostimulated luminescence (PSL), a still poorly understood phenomenon said to have been discovered by Henri Becquerel in the mid eighteen hundreds. To understand the basic principle of PSL it is necessary to know that fluorescence differs from phosphoresence in that excited electrons of fluorescent atoms immediately return to their base state and emit fluorescent light, whereas excited electrons of phosphorescent atoms only slowly return to their base state and continue to emit light for a while after the stimulation stops. The PSL phenomenon is based on a substance that
22
DNA array readout methods
Table 3.1. Commercial sources for confocal laser scanners Number of Lasers
Company
Web address
Affymetrix
www.affy metrix.com
428 1 Array Scanner
2275 mm
Alpha Innotech Corp. Amersham/ Pharmacia Biotecha Applied Precision GeneFocus
www.alpha innotech.com
White lights
1622 mm
2
2273 mm
White light
2260 mm
Genomic Solutions
www.genomic solutions.com
Nanogen
www.nanogen.com
Packard
www.packard inst.com
Packard
www.packard inst.com
Packard
www.packard inst.com
Packard
www.packard inst.com
Alpha Array 7000 Gene Pix 4000A array WoRx ORF DNA scope Gene TAC LS IV Nano chip Reader Scan Array 4000 Scan Array 4000XL Scan Array 5000 Scan Array 5000XL
Virtek
www.virtek.ca
Vysis
www.vysis.com
Virtek Chip Reader Geno Sensor Reader
www.mdyn.com www.applied precision.com www.genefocus.com
Model
1
Scan area
1 Cy3 molecule/mm at greater than 3.5 S/N 0.06 fluor/ m2 0.1 molecule fluor/m2
0.1 molecule FAM/m2 11 mm to 0.1 molecule 2222 mm fluor/m2
4
0.1 molecule fluor/m2
2
22 mm
2
2273 mm
3
2273 mm
4
2273 mm
5
2273 mm
2
2265 mm
White light
0.5 cm2
Notes: a Not confocal. b PMT,photomultiplier tube; CCD,charge-coupled device
Sensitivity
0.1 molecule fluor/m2 0.1 molecule fluor/m2 0.1 molecule fluor/m2 0.1 molecule fluor/m2 0.1 molecule fluor/m2 0.1 molecule fluor/m2
23
Reading data from a radioactive signal
Pixel resolution
Filters
3, 6, 9, 12, 24 m
Mechanism of scanning
Scan speed
Supported dyes
Source type
(Up to 6) PMT Std. 551, 570, 665 nm
4 min
Fluorescein and phycoerythrin
Laser argon-ion 488 nm
3–30 m
Various
CCD
15 s
Various
5–100 m
None
Dual PMT
5 min
5–50 m
330–780 nm CCD (4 filters) Various PMT
30 s to 15 min
Various
PMT
2 min
532 nm 635 nm
PMT
16 bits/ pixel 1–100m
4 min
Nova Ray Light Mgt. System Cy dyes Laser diodes 532, 635 nm Cy3 and Cy5 Halide 380–800 nm Cy3 and Cy5 Laser Others optional Various Laser fluorescent dyes Cy3 and Cy5 Lasers 532, 635 nm
5, 10, 20, 30, 50 m
488–633 nm PMT (6 filters)
5 min
Various dyes
Confocal lasers
5, 10, 20, 30, 50 m
543, 594, PMT 633 nm (7 filters) 500–700 nm PMT (10 filters)
5 min
Various dyes
Confocal lasers
5 min
Various dyes
Confocal lasers
488, 513, PMT 543, 594, 633 nm (11 filters) 532, 635 nm PMT
5 min
Various dyes
Confocal lasers
3 min
Cy3 and Cy5 Laser diodes
(3 filters)
1 min
Various dyes
5, 10, 20, 30, 50 microns 5, 10, 20, 30, 50 m 10 m 20 m
CCD
Xenon
24
DNA array readout methods
Figure 3.2. Sigma-Genosys Panorama™ E.coli Gene Array. Each E. coli array contains three fields divided into 2416 (384) primary grids (1–24A-P). Each primary grid contains 16 secondary grids separated by 1 mm. Four different fulllength ORF probes are spotted in duplicate in every other secondary grid as shown in the blowup of Field 1, A2. The remaining eight secondary grids of each primary grid are blank. In the third field, some primary grids do not contain any ORFs.
differs from phosphorescence in that the primary stimulation results in the trapping of an excited electron in a higher energy state. This electron is not released to return to its base state to release fluorescent light until it is excited by a second stimulation of light, usually from a laser, having a longer wavelength than the primary stimulation source, for example radiation. A phosphorimager screen uses BaFBr:Eu 2 crystals to store radiation information and releases it at a later time. Phosphorimaging screens contain a layer of these crystals (grain size approx. 5 m) contained between a support and a transparent protective layer. When a europium electron is excited by a primary energy source (radiation) it is trapped in the crystal lattice structure producing a stable BaFBr:Eu 3 crystal with a
Reading data from a radioactive signal
A.
25
Radiation
Transparent layer
Phosphor crystal layer
BaFBr:Eu+2
BaFBr:Eu+3
Protective layer
Photomultiplier Phot tube
B.
Scanning laser Light
Transparent layer
Phosphor crystal layer
BaFBr:Eu+3
BaFBr:Eu+2
Protective layer
Figure 3.3. The principle of photo-stimulated luminescence.
visible light color center. This structure is stable until the crystal is excited a second time with laser light absorbed by the color center. This releases the trapped electron that emits fluorescent light captured by a photomultiplier tube during a laser scan of the screen. Since all of the crystals are not returned to the BaFBr:Eu 2 state during the scan, the screen is “erased” for subsequent use by flashing with visible light. The basic principle of PLS is schematically illustrated in Figure 3.3. Thus, when a DNA array hybridized with radioactively labeled targets is placed on the phosphorimaging screen in the cassette, trapped electrons are stored in the BaFBr:Eu 3 crystals at a rate proportional to the intensity of the radioactive signal. After an appropriate exposure time (often 12–48 hours) the DNA array is removed and the phosphorimaging screen is scanned with a laser and a photo-optical detection system containing a photomultiplier tube that measures and records the emitted light. This information is digitized and reconstructed into an image of the type shown in Figure 3.2. Since the scanning surfaces accommodated by phosphorimagers are much larger than those of glass slide arrays scanned with confocal laser scanners, time constraints dictate that they cannot be scanned at the same
26
DNA array readout methods
resolution. Therefore, to accommodate this time constraint, the highest scanning resolution for phosphorimaging instruments is 20 m; however, as scanning mechanics improve, scanning resolutions approaching the 5 m size of the phosphor crystal are anticipated. Some newer storage phosphorimaging instruments come equipped with multiple scanning laser sources and filters for the excitation of many commonly used fluorophores. For example, fluorescent dye combinations such as Cy3 and Cy5 can be imaged with these instruments. Nevertheless, while these detection methods are suitable for many applications, they do not offer the signal-to-noise and scanning resolution advantages necessary for high-density DNA arrays that are provided by confocal laser scanning instruments. The features of several currently available phosphorimagers are described in Table 3.2.
BAS5000 Cyclone
www.mdyn.com
www.fujimed.com
www.packardinst.com
Molecular Dynamics
Fuji
Packard
3543 cm
50 m
3543 cm
50,100, 200 m
Typhoon
2025 cm
3543 cm
50,100, 200 m
Storm
25 and 50 m
3543 cm
3543 cm
Scan area
50, 100, 200 m
50,100, 200, 800 m
Resolution
Phosphor imager SI
Molecular Imager FX
www.bio-rad.com
BioRad
Model
Web address
Name
Table 3.2. Commercial sources for phosphorimagers
1:105
1: 104
1:105
Radioisotopes
Radioisotopes
1:105
1:104–105
Radioisotopes 1:105 Fluoresence Chemiluminescence
Radioisotopes Fluorescence Chemiluminesce
Radioisotopes
Radioisotopes Fluoresence Chemiluminesce
Detects
Linear dynamic range
4 Gene expression profiling experiments: Problems, pitfalls, and solutions
In previous chapters, we have discussed the formats, methods of manufacture, and data aquisition instruments required for gene expression profiling with DNA arrays. In this chapter, we consider issues such as: heterogeneities encountered among experimental samples, isolation procedures for non-polyadenylated and polyadenylated RNA from bacteria and higher organisms; advantages and disadvantages of different target preparation methods; and general problems encountered during the execution of such experiments. Throughout this chapter we focus on ways to minimize experimental errors. In particular, we point out the pitfalls of current methods for the preparation of targets from polyadenylated RNA and discuss alternative methods of target synthesis from total RNA preparations from eukaryotic cells based on methods developed for the synthesis of bacterial targets. Regardless of the fact that we model many of our discussions around bacterial systems, it should be emphasized that the lessons of this chapter are applicable to gene expression profiling experiments in all organisms.
Primary sources of experimental and biological variation Differences among samples It is, of course, desirable to minimize extraneous biological and experimental variables as much as possible when analyzing gene expression profiles obtained under two defined experimental conditions such as a temporal or treatment gradient, or between two different cell sample types or genotypes [1, 2, 3, 4]. In Chapter 7, we compare the gene expression profiles between two genotypes, lrp and a lrp strains of E. coli. To minimize differences between the genotypes of these cells, care was taken to insure that both 29
30
Gene expression profiling experiments
strains were isogenic; that is, that they contained identical genetic backgrounds except for the single structural gene for the Lrp protein. This was accomplished by using a single wild-type E. coli K12 strain for the construction of the two isogenic strains. First, the natural promoter-regulatory region of the lacZYA operon in the chromosome was replaced with the promoter of the ilvGMEDA operon (known to be regulated by Lrp). This produced a strain (IH-G2490; ilvPG::lacZYA, lrp ) in which the known effects of Lrp on ilvGMEDA operon expression could be easily monitored by enzymatic assay of the gene product of the lacZ gene, -galactosidase. Next, the Lrp structural gene was deleted from this strain to produce the otherwise isogenic strain (IH-G2491; ilvPG::lacZYA, lrp) [5]. The ability to control this source of biological variation in a model organism such as E. coli with an easily manipulated genetic system is an obvious advantage for gene expression profiling experiments. However, most systems are not as easily controlled. For example, human samples obtained from biopsy materials will not only differ in genotype but also in cell types. Nevertheless, the experimenter should strive to reduce this source of biological variability as much as possible. For example, laser-capture techniques for the isolation of single cells from animal and human tissues for isolation and amplification of RNA samples that address this problem are being developed [6]. An additional source of biological variation in experiments comparing the gene profiles of two cell types comes from the conditions under which the cells are cultured. In this regard we have recommended that standard cell-specific media should be adopted for the growth of cells queried by DNA array experiments [2]. While this is not possible in every case, many experimental conditions such as the comparison of two different genotypes of the same cell line can be standardized. The adoption of such medium standards would greatly reduce experimental variations and facilitate the cross-comparison of experimental data obtained from different experiments and/or different experimenters. For E. coli, Neidhardt et al. [7] have performed extensive studies concerning the conditions required for maintaining cells in a steady state of balanced growth. Their studies have defined a synthetic glucose-minimal salts medium (glucose-minimal MOPS) that minimizes medium changes during the logarithmic growth phase. The experiments described in Chapter 7 were performed with cells grown in this medium. Similar studies have described defined media for the growth of many eukaryotic cell lines that should be agreed upon by researchers and used when experimental conditions allow.
Primary sources of variation
31
RNA isolation procedures Another large, in our experience the largest, source of error in data from DNA array experiments comes from the biological variations in individual mRNA expression levels in different cell populations, even when care is taken to culture cells under “identical” conditions [2]. This problem is exacerbated if extreme care in the treatment and handling of the RNA is not taken during the extraction of the RNA from the cell and its subsequent processing. For example, it is often reported that the cells to be analyzed are harvested by centrifugation and frozen for RNA extraction at a later time. It is important to consider the effects of these experimental manipulations on gene expression and mRNA stability. If the cells encounter a temperature shift during the centrifugation step, even for a short time, this could cause a change in the gene expression profiles due to the consequences of temperature stress. If the cells are centrifuged in a buffer with even small differences in osmolarity from the growth medium, this could cause a change in the gene expression profiles due to the consequences of osmotic stress. Also, removal of essential nutrients during the centrifugation period could cause significant metabolic perturbations that would result in changes in gene expression profiles. Each of these and other experimentally caused gene expression changes will confound the interpretation of the experiment. These are not easy variables to control. Therefore, the best strategy is to harvest the RNA as quickly as possible under conditions that “freeze” it at the same levels that it occurs in the cell population at the time of sampling. For example, in the experiments described in Chapter 7, total RNA was isolated from cells during balanced growth in a defined glucose-minimal MOPS medium during the mid-logarithmic phase of growth at a cell density of OD600 0.6. Avoidance of temperature stress was attempted by using a pipette equilibrated to the same temperature as the cell growth medium to rapidly transfer cells from the growth flask into a boiling solution of a cell lysis buffer containing an ionic detergent, sodium docecyl sulfate (SDS), described in Appendix A. This procedure instantly disrupts the cells and inhibits any changes in mRNA levels due to degradation by endogenous RNase activities. Additionally, all solutions and glassware used in this and subsequent steps are treated with an RNase inhibitor, diethylpyrocarbonate (DEPC). Rapid RNA isolation methods designed to minimize changes in gene expression profiles, and inhibit RNase activities, during RNA isolation from eukaryotic cells and tissues have also been described. For example, Ambion Inc. (Austin, TX) produces a product called RNA later™. This is a
32
Gene expression profiling experiments
storage reagent that inactivates RNase activities and stabilizes cellular RNA in intact unfrozen cells and tissue samples. Tissue pieces or cells can be submerged in RNA later™ for storage without compromising the quality or quantity of RNA obtained after subsequent RNA isolation. Even employing these experimental conditions to “freeze” the extracted RNAs at the levels present in the growing cells, comparisons of DNA array data of experimental replicates obtained with RNA preparations from the same cells, growing under the same conditions, reveal a significant degree of variability in gene expression levels. To reduce this variation even further, RNA preparations from three separate extractions from multiple cultures of cells growing under the same experimental conditions can be purified, labeled, and pooled prior to hybridization to an array. This practice tends to average out biological variations in gene expression levels due to, for instance, subtle differences in growth conditions and labeling efficiencies, and significantly reduces the false positive levels observed in gene expression profiling experiments (see Chapter 7).
Special considerations for gene expression profiling in bacteria The first step in any gene expression profiling experiment, whether it is with bacteria or higher eukaryotic organisms, is to isolate mRNA for the production of labeled targets to hybridize to DNA arrays. With eukaryotic organisms that contain 3 polyadenylated mRNA, it is simply purified away from bulk cellular RNA with oligo(dT) chromatography columns. However, unlike mRNA from eukaryotic cells, the vast majority of mRNA in bacteria is not polyadenylated. Thus, it was necessary to develop some other method to isolate bacterial mRNA. Otherwise, since mRNA comprises less than 10 percent of the total RNA in a bacterial cell, and indeed the cells of all organisms, it was feared that targets produced from total RNA preparations would produce unacceptable backgrounds because those targets derived from ribosomal RNA and other non-mRNA species would cross-hybridize to array probes. An early solution proposed to obtain labeled targets specifically derived from mRNA in total RNA preparations from bacteria was to synthetically prepare a collection of 3-oligonucleotide primers specific for the 3 ends of each bacterial open reading frame (ORF). These primers then could be used for DNA polymerase-mediated primer-directed synthesis of radioactive- or fluorescent-labeled cDNA targets for hybridization to DNA arrays containing ORF probes in much the same way that oligo(dT) primers are used for target synthesis with poly(A) mRNA from eukaryotes. In fact, the
Gene expression profiling in bacteria
33
first commercially available E. coli DNA arrays produced by SigmaGenosys were offered with such a set of oligonucleotide primers. However, while several gene expression profiling experiments using these messagespecific oligonucleotide primers appeared in the literature, it was soon realized that they did not produce acceptable results.
A comparison of the use of targets prepared with message-specific primers and targets prepared with random hexamer primers from total RNA preparation for use with pre-synthesized DNA arrays The alternative to the use of 3 message-specific primers for the synthesis of bacterial targets was to prepare targets from total RNA preparations with random primers. Early in 2000 we performed a systematic set of experiments to compare these alternatives [2]. For these experiments, we used Sigma-Genosys nylon filter DNA arrays spotted in duplicate with fulllength PCR products of each of the 4290 E. coli ORFs (Figure 3.2). We performed each experiment in duplicate and replicated each duplicate experiment four times. This experimental design, which results in four measurements of each target in each of four independent experiments, is diagrammed in Figure 4.1. In one case, we carried out this series of four independent experiments with 33 P-labeled cDNA targets prepared by primer extension of total RNA preparations directed by random hexamer oligonucleotides. In the other case, we performed the same series of experiments with 33P-labelled cDNA targets prepared by primer extension of total RNA preparations directed by a complete set 3 message-specific primers for each E. coli ORF. We found that at the high stringency hybridization conditions that can be used with arrays containing full-length ORF probes low backgrounds are observed (Figure 3.2), and that cDNA targets prepared with the random hexamer oligonucleotides detected an average expression of 2592 genes with at least two out of four, non-zero, background-subtracted measurements for both the control and experimental samples. However, filter hybridization with the cDNA targets prepared with the message-specific primers detected an average expression of only 1760 genes with at least two out of four non-zero, background-subtracted measurements for both samples. Thus, we detected one-third more genes with the random-hexamer-derived targets than with the message-specific-derived targets.1 Equally disturbing, we observed that while some genes of a given 1
Under the stringent hybridization conditions employed in this experiment (Appendix A), no hybridization of 33P-labeled targets prepared with random hexamers from purified ribosomal RNA was detected [2].
34
Gene expression profiling experiments
Figure 4.1. Experimental design. In Experiment 1, Filters 1 and 2 were hybridized with 33P-labeled, random hexamer generated cDNA fragments complementary to each of three RNA preparations (IH-G2490 RNA1–3) obtained from the cells of three individual cultures of strain IH-G2490 (Lrp ). These three 33P-labeled cDNA preparations were pooled prior to the hybridizations. Following phosphorimager analysis, these filters were stripped and hydridized with pooled, 33P-labeled cDNA fragments complementary to each of three RNA preparations (IH-G2491 RNA1–3) obtained from strain IH-G2491 (Lrp). In Experiment 2, these same filters were again stripped and this protocol was repeated with 33P-labeled cDNA fragments complementary to another set of three pooled RNA preparations obtained from strains IH-G2490 (IH-G2490 RNA 4–6) and IH-G2491 (IH-G2491 RNA 4–6) as described above. Another set of filters (Filter 3 and Filter 4) was used for Experiments 3 and 4 as described for Experiments 1 and 2. This protocol results in duplicate filter data for four experiments performed with the cDNA probes complementary to four independently prepared cDNA probe sets. Thus, since each filter contains duplicate spots for each ORF and duplicate filters are hydridized for each experiment, four measurements for each ORF are obtained from each of four experiments.
Gene expression profiling in bacteria
35
operon (ORFs in the same mRNA transcript) were detected, others were not. For example, hybridization with the message-specific targets detected signals above background for only three of the five genes of the ilvGMEDA operon, whereas hybridization with the random-hexamer-generated targets detected signals above background for all five genes of this operon. Furthermore, the expression level of the genes in each operon detected with the randomhexamer-generated targets usually varied less than threefold, while the expression levels of some of the genes of a common operon detected with the 3 message-specific primed targets either were not detected at all, or when they were detected they sometimes varied more than 1000-fold. To explain why the message-specific-generated targets did not detect as many mRNAs as the random-hexamer-generated targets, we suggested that some of the cDNA targets derived from the message-specific primers did not hybridize to their cognate mRNA. This suggestion was based on the simple fact that it is difficult at best to design 4290 individual primer sequences that will hybridize to their cognate sequences with the same efficiency under a single hybridization condition. We also suggested that some of the primers might contain complementary sequences and hybridize to one another rather than the DNA array probes; and further, that some of these primers might contain internally complementary sequences and hybridize to themselves instead of the probes on the array. To explain the observation that a wide variation of signals were observed with the message-specific-labeled targets for genes of a common operon, we suggested that a variable amount of 33P was incorporated into each target because of unequal hybridization efficiencies and different lengths of labeled 3-proximal cDNA fragments. On the other hand, since each mRNA (or mRNA fragment) is randomly primed with the random hexamers, the amount of 33P label incorporated into each cDNA target should be largely proportional to the ORF length. To test the validity of these suggestions, we reasoned that since the stoichiometry of each ORF in the genome is 1, and since each region of the chromosome is randomly primed with the random hexamers, 33P-labeled cDNA targets prepared from genomic DNA with random hexamers should hybridize to all of the full-length ORF probes on the array and produce signal intensities largely proportional to the length of the ORF. At the same time, hybridization of the 33P-labeled cDNA targets prepared with the 3specific primers should be dependent on a complex set of variables, including the length and the different hybridization efficiencies of each cDNA target generated with each ORF-specific primer.
36
Gene expression profiling experiments 10–3
Relative signal intensity
A
10–4
10–5
B 10–4
10–3
10–2
10–5 10–1
10–2
10–3
10–4
ORF length Figure 4.2. Relationships between the logarithm of hybridization signals and the logarithm of ORF lengths with targets prepared from genomic DNA. Scatter plots showing the relationships between hydridization signal intensities with 33P-labeled cDNA probes generated from genomic DNA with random-hexamer oligonucleotides (A) or 3-ORF-specific DNA primers (B).
The data presented in Figure 4.2 confirmed our expectations. DNA hybridization signals for each of the 4290 ORFs on the array are observed with the random-hexamer-labeled targets, while hybridization signals for only two-thirds of the ORFs on the array are observed with the messagespecific primer labeled targets (the same ratio of ORF-specific versus random-hexamer labeled probe hybridization signals we observed with the cDNA targets generated from RNA). Thus, as we expected, one-third of the message-specific primers did not hybridize to their cognate genomic sequence, either because of hybridization conditions or because they hybridized to themselves or to one another. Also as expected, the data displayed in Figure 4.2 show that the hybridization signal for the random-hexamer labeled targets generated from genomic DNA is reasonably proportional to
Gene expression profiling in bacteria
37
ORF length (r2 0.41). However, no significant correlation between ORF length and hybridization signal is observed with the ORF-specific labeled probes (r2 0.004) (Figure 4.2).
Rapid turnover of mRNA in bacterial cells An additional complication that contributes to the disparate results obtained with random hexamer and message-specific labeled targets pertains to the rapid turnover rates of mRNA in bacterial cells (from a few seconds to several minutes versus several hours to days in eukaryotes). In E. coli rapid mRNA decay is initiated by endonucleolytic cleavages followed by 3 to 5 exonucleolytic degradation; therefore, if the initial endonucleolytic site is adjacent to the 3 ORF-specific primer binding site, this region is rapidly degraded and little or no steady-state message is extracted for primer extension labeling of this gene-specific transcript. On the other hand, if the 3 ORF-specific primer binding site is located in a portion of the mRNA stabilized by secondary structure that is distant from the initial endonucleolytic site, it will be present in the cell at a high steady-state level (Figure 4.3). Therefore, since different parts of an mRNA molecule are degraded at widely differing rates, the 25 base pair region of each message complementary to each message-specific target can be present in the cell at different levels. Under these conditions varying amounts of message will be extracted for primer extension labeling of each gene-specific transcript depending on the location and degradation rate of the primer site. On the other hand, the random-hexamer-labeling procedure produces RNA–DNA duplexes for primer extension from all of the partial degradation products of each message. Since the exonucleolytic clearance of mRNA degradation products to free nucleotides follows endonucleolytic message inactivation (at a presumably constant enzymatic rate) the random hexamers detect the steady state level of all of these intermediate degradation products. This implies that although the functional half-lifes of E. coli mRNA are rapid and message specific, the “clearance” rate for message degradation intermediates to free nucleotides must occur at a more constant rate. Thus, the relative mRNA expression levels measured with the random hexamer labeled probes should be more closely related to their rates of synthesis and, therefore, their relative abundance in the cell. This conclusion is supported by two observations. First, nearly equal levels of expression of genes of a common operon are observed with the random-hexamer-generated targets, but not with the targets generated with the 3 message-specific primers. Second, a positive correlation between mRNA and protein abundance is observed
38
Gene expression profiling experiments
1 3'
5' 2 Endonucleolytic enzyme cleavage followed by rapid 3' to 5' exonucleolytic enzyme degradation
a
1
b
c
3' f
d e
5'
3'
5'
Figure 4.3. mRNA degradation in bacteria. The top structure represents the 3 region of an mRNA molecule. The triangle represents an endonuclease enzyme positioned at its RNA cleavage site. The gray boxes denote two alternative complementary regions for binding of a 3 message-specific primer oligonucleotide. Site 1 is protected from 3 to 5 exonucleolytic degradation following endonucleolytic cleavage because of its position in a secondary structure, whereas site 2 is readily susceptible to 3 to 5 exonucleolytic degradation. Higher in vivo steady-state levels of this mRNA would be detected with an oligonucleotide complementary to site 1 than to site 2.
with random-hexamer-generated targets, but this correlation is not observed when message-specific-generated targets are used [2]. As an aside, it might be thought that because DNA array hybridization data measured with random-hexamer-labeled probes shows a correlation with ORF length, each measurement should be corrected for this parameter. However, we do not feel that it is necessary to correct the expression
Gene expression profiling in bacteria
39
data obtained with random-hexamer-labeled cDNA targets for probe ORF lengths. This is because the less than ten-fold variance in ORF lengths contributes less than 1 percent of the greater than four orders of magnitude of variance in expression level measurements obtained with the RNA-derived targets.
Preparation of bacterial targets for in situ synthesized DNA arrays So, as it turns out, fears that random-hexamer-generated 33P-labeled cDNA targets prepared from total RNA would generate unacceptable backgrounds are unwarranted, at least for pre-synthesized DNA arrays containing PCR-generated, full-length ORF probes. As an example, a nylon filter array manufactured by Sigma-Genosys containing duplicate spots of PCRgenerated, full-length ORF probes of each of the 4290 genes of E. coli hybridized with 33P-labeled cDNA targets synthesized with random hexamers from a total RNA preparation is shown in Figure 3.2. It can be seen that backgrounds are very low, especially when care is taken to remove traces of genomic DNA in the RNA preparations, a common source of background contamination. This contamination is particularly serious since genomic DNA, of course, contains sequences complementary to all of the ORFs. Thus, if care is not taken to remove all traces of genomic DNA it will hybridize to all of the ORFs and obscure the message-specific target signals. Another reason for the low background on pre-synthesized arrays pertains to the high temperature and stringency hybridization conditions that can be used with DNA arrays containing full length ORF probes. These stringent hybridization conditions (Appendix A) are possible because the average length of each probe on these arrays is about 850 nucleotides and sizing of the random-hexamer-generated targets shows that they are of an average length of 400 nucleotides [8]. The background is low because the stringency of these hybridization conditions is such that no non-mRNA labeled cDNA targets with probe sequence identities less than about 100 nucleotides can hybridize to the DNA array probes. In spite of their advantages, the use of targets prepared from total RNA is not an option for gene expression profiling with in situ synthesized arrays such as Affymetrix GeneChips™ that contain short oligonucleotide (25 nucleotides) target-specific probes. In this case, much less stringent hybridization conditions must be used. Under these conditions, randomhexamer-directed target synthesis from a total RNA preparation produces labeled targets from abundant ribosomal and other non-mRNA targets that will cross-hybridize with all of the probes on the GeneChip™ and
40
Gene expression profiling experiments
mask gene-specific measurements. Methods to circumvent this problem are discussed below.
Target preparation with non-polyadenylated mRNA from bacterial cells Most in situ synthesized DNA arrays contain short oligonucleotide probes. For example, the E. coli Affymetrix GeneChip™ contains 15 25-mer oligonucleotide DNA probes perfectly complementary to sequences in each of 4241 ORFs. It also contains from 1 to 298 probes complementary to each of the 107 rRNAs, tRNAs, and small regulatory RNAs, as well as each of the 2886 intergenic ORF regions. Because of the short length of these probes, relatively low stringency hybridization conditions are required. Under these hybridization conditions, mismatch base pairing between perfect match (PM) probes and targets can occur that obscure experimental results. For this reason, each E. coli GeneChip™ also contains a 25-mer oligonucleotide mismatch (MM) probe differing from each corresponding PM probe by possessing a base pair mismatch in the middle of the probe. This allows an estimate of mismatch hybridization encountered by each probe. The hybridization signal for each target is measured as the average difference (AD) of the hybridization signals between each of the PM and MM probe pairs for each target (AD (PMMM) / number of probe pairs). Since each mRNA species obtained from purified polyadenylated mRNA from eukaryotic cells is, by and large, unique, this method produces low background measurements for each target. However, bacterial mRNA is not polyadenylated, and mRNA represents less than 10 percent of the total RNA extracted from bacterial cells. Therefore, without separation of the mRNA from at least the bulk RNA (ribosomal RNA), the levels of mismatch hybridization of biotinylated RNA targets prepared from total RNA would be unacceptable. To circumvent this problem, Affymetrix developed a procedure for enriching the mRNA to ribosomal RNA ratio of total RNA samples fourto fivefold (Figure 4.4). In this procedure, which we will see later is applicable to eukaryotic as well as prokaryotic total RNA samples, oligonucleotide primers specific for ribosomal RNA sequences are used to generate rRNA/cDNA hybrids. Next, the RNA moiety of these double stranded hybrids is digested away with RNase H. Finally, the cDNA strand is removed with DNase I (see Appendix A). Although high levels of hybridization to mismatch probes are observed, acceptable backgrounds and average difference signals between perfect match and mismatch probes are
41
Gene expression profiling in bacteria
mRNA
23S rRNA
Synthesis of rRNA/cDNA hybrid 16S rRNA
Digest away rRNA strand with RNase H mRNA cDNA
Digest away cDNA strand with DNase 1
mRNA Figure 4.4. A poly(A) independent method for mRNA enrichment. Oligonucleotide primers (short blue lines) specific for ribosomal RNA sequences are used to generate rRNA/cDNA (represented by the red-dashed arrows) hybrids. The RNA moiety (black line) of these double-stranded hybrids is digested away with RNase H. Finally, the cDNA strand is removed with DNase I.
obtained with the Affymetrix E. coli GeneChip™ when these messageenriched RNA samples are used to generate biotin-labeled RNA targets (see Chapter 7). Typically, this procedure gets rid of about 90 percent of the ribosomal RNA in a bacterial total RNA preparation. Other protocols for the preparation and hybridization of prokaryotic and eukaryotic labeled targets to Affymetrix GeneChips™ as well as nylon filters and glass slide arrays also are described in Appendix A.
42
Gene expression profiling experiments
Problems associated with target preparation with polyadenylated mRNA from eukaryotic cells To date, all reported eukaryotic DNA array experiments have been performed with targets prepared from poly(A) mRNA isolated with oligo(dT) chromatography columns or by synthesizing cDNA targets with oligo(dT) primers. This has been done because, like the bacterial case, it has been feared that targets prepared from total RNA would generate unacceptable backgrounds. However, again like the bacterial case, 33P- or fluorophore-labeled, random-hexamer-primed cDNA targets prepared from eukaryotic total mRNA preparations do not produce high backgrounds when they are hybridized under stringent conditions to DNA arrays containing full length ORF probes. In fact, several reports demonstrate that using poly(A) RNA for eukaryotic gene expression profiling experiments leads to erroneous conclusions. The reason for this is that efficient oligo(dT) purification requires poly(A) tails at least 20 nucleotides in length. This is a problem because, at least in yeast, it has been demonstrated that during balanced growth, as much as 25–50 percent of the total mRNA exists with a poly(A) tail length less than 20 nucleotides. This mRNA, which is not efficiently recovered from oligo(dT) columns or primer-extended with oligo(dT) primers but can be detected in northern gels with message-specific probes, is classified as poly(A) RNA. In other words, yeast mRNAs exist as a population with as much as 25–50 percent of the total mRNA pool in a poly(A) form [9, 10]. Clearly, this confounds the results of any yeast gene expression profiling experiment performed with targets prepared from poly(A) mRNA by oligo (dT) purification or priming. This conclusion is supported in a recent report by Olivas and Parker [10]. They have demonstrated large discrepancies between the results of gene expression profiling experiments performed with the yeast Saccharomyces cerevisiae that compared targets prepared from purified poly(A) and total RNA preparations. For example, they demonstrated that array experiments using targets prepared from poly(A) mRNA imply that the expression level of the COX17 gene decreases more than tenfold in a strain containing a puf3 deletion; however, northern analysis of total RNA with a COX17-specific probe show that this mRNA actually increases more than twofold in this strain. This over 20-fold discrepancy is explained by the fact that in the puf3 deletion strain COX17 transcripts are partially deadenylated and only poorly selected by purification with oligo(dT). At the same time, this message is stabilized in the puf3 deletion strain. The result is that
Polyadenylated mRNA from eukaryotic cells
43
while the COX17 message accumulates in the deletion strain it is not efficiently recovered by oligo(dT) purification and therefore appears to have decreased in the array experiment. Olivas and Parker [10] suggest that message-specific degradation mechanisms that affect polyadenylation levels are a major reason for discrepancies between DNA array measurements and subsequent northern blot results employing message-specific probes. In other words, if polyadenylation levels are differentially affected by different treatment conditions, then erroneous conclusions concerning gene expression levels from DNA array experiments performed with poly(A) derived targets might be reached. This suggests that gene expression profiling experiments in yeast should be performed with targets prepared from total RNA preparations. This same problem exists for gene expression profiling in mammalian systems where it is also known that some mRNAs such as actin mRNA have poly(A) tails shorter than 20 nucleotides and mRNA stabilities are regulated by deadenylation mechanisms. However, unlike with yeast, no systematic experiments have been performed with mammalian systems to determine the fraction of such mRNAs in the total mRNA pool. Nevertheless, prudence suggests that targets should be prepared from total RNA rather than poly(A) RNA whenever possible. The feasibility of this suggestion is supported by the results of Tan et al. [11]. They have demonstrated that glass slides arrayed with full-length PCR products of each of the 984 ORFs of Chlamydia trachomatis can be hybridized with randomhexamer-generated targets prepared from total RNA from infected mouse cells with low backgrounds. The targets for this experiment were randomhexamer-generated cDNA products of total RNA from Chlamydiainfected or uninfected mouse cells. Even though the Chlamydia-mRNA represented a small fraction of the total mouse cell RNA, and even though only a small fraction of the mouse cells were infected with Chlamydia, very little cross-hybridization of mouse-derived, random-hexamer-generated cDNA targets to the Chlamydia-specific probes was detected. This is because of the high stringency hybridization conditions that can be employed with arrays printed with full-length ORF PCR products as previously described for the E. coli system. Equally satisfying results have been obtained with random-hexamer-generated, 33P-labeled cDNA targets prepared from total human RNA hybridized to custom, medium-density (9000 probes) DNA arrays containing full-length human ORF probes [12]. A further advantage of using total RNA for target preparation is that it minimizes experimental manipulations. This means that variations due to mRNA degradation and loss during the target preparation procedure are
44
Gene expression profiling experiments
decreased. Also, even though mRNA half-lifes are much longer in mammalian than bacterial systems, any steady-state mRNA level differences that do arise because of differing message degradation rates in the 3 portion of mammalian mRNAs will be minimized with labeled cDNA targets prepared from total RNA with random hexamer priming [2]. Furthermore, as with the bacterial system discussed above and in Chapter 7, target synthesis from total RNA preparations significantly improves quantitation of the measurements of the relative abundance of each mRNA species.
A total RNA solution for target preparation from eukaryotic cells The most common method for the preparation of biotinylated RNA targets from poly(A) RNA for eukaryotic gene expression profiling with Affymetrix GeneChips™ includes the following steps: (1) total RNA is extracted from cells or tissue; (2) poly(A) mRNA is isolated with a cellulose oligo(dT) column; (3) cDNA is synthesized with oligo(dT) primers containing a T7 bacteriophage promoter; (4) the cDNA is used as a template for T7 RNA polymerase to synthesize RNA complementary to the genomic sense strand; (5) this cRNA is fragmented into molecules with an average length of 80–100 nucleotides; and (6) these cRNA molecules are biotinylated and hybridized to GeneChips™ containing sense strand probes. A common modification of this procedure is to skip the poly(A) purification step and to proceed directly to the oligo(dT)-directed primer extension step. In either case, the problem of missing transcripts with short poly(A) tails described by Olivas and Parker [10] remains a serious issue. The solution of this problem offered above for pre-synthesized arrays containing full-length ORF probes, that is to prepare targets from total RNA preparations, is not applicable for in situ synthesized arrays containing short oligonucleotide probes. Under the low-stringency hybridization conditions required for these arrays, the levels of mismatch hybridization of biotinylated RNA targets prepared from cDNA generated from total RNA would be unacceptable. One solution to isolate all of the mRNA in both the poly(A) and the poly(A) fractions while avoiding the oligo (dT)-dependent poly(A) mRNA purification and amplification steps would be to adopt the methods used for preparing targets from bacterial cells (Appendix A). In this procedure, ribosomal RNA-specific probes would be used to generate rRNA/cDNA hybrid duplexes. The rRNA moiety would be removed with RNase H and the rRNA-specific cDNA would be removed with DNase I. However, since the current Affymetrix GeneChips™ contain sense strand probes, it would not be possible to simply use hexamer-generated sense strand cDNA targets pre-
Data acquisition for nylon filter experiments
45
pared from this mRNA enriched preparation for hybridization to these arrays. This requires an extra step. That is to use random oligonucleotides containing a T7 bacteriophage promoter to generate antisense cRNA from the cDNA generated in the previous step. This cRNA could then be fragmented, biotin labeled, and hybridized to the currently available sense strand probe arrays. Protocols similar to those described for the bacterial system for the preparation of biotin-labeled cRNA targets as suggested here are described in Appendix A. Methods for the preparation of 33P- or fluorophore-labeled cDNA targets from total eukaryotic RNA using random hexamers for hybridization to nylon filter or glass slide DNA arrays containing full length ORF probes also are described in Appendix A.
Target cDNA synthesis and radioactive labeling for pre-synthesized DNA arrays Although radioisotope-labeled targets can be measured with greater sensitivity and over a greater linear range than fluorophore-labeled targets, their use has been limited to large-format arrays. There are two primary technical reasons for this. First, the 50 m limitation in the scanning resolution of most commercially available phosphorimagers (described in Chapter 3) requires probe sites with diameters of at least 250 m for reproducible signal quantitation. Second, because the omni-directional radioactive emissions from targets hybridized to one spot on an array can contaminate the signals obtained from neighboring probe sites, array formats containing probe sites spaced closer than about 300 m are not feasible. Nevertheless, target labeling with radioisotopes is the method of choice for large-format arrays such as nylon filters where probe features as large as 1 mm in diameter are separated from one another by as much as 2 mm. Data acquisition for nylon filter experiments Once a gene expression profiling experiment has been completed, methods for extracting the data from each feature on the array must be employed. For nylon-filter-based experiments with 33P-labeled target values, the filter is exposed to a phosphorimaging screen and the target intensities are visualized by scanning in a phosphorimager that generates a 16-bit TIFF (or proprietary format) image (Figure 3.2). At this point, software to extract and digitize the pixel density of each array feature in the image file and to correlate each feature with the correct ORF is required. Several commercial software packages are available for these purposes (Table 4.1). In the
Company
Packard Bioscience
Scanalytics
Imaging Reseach Inc.
Clontech Inc.
Genomic Solutions Inc.
BioDiscovery Inc.
Name
QuantArray for Windows NT
Microarray Suite for Mac/Win
ArrayVision v 4.0 Win NT
AtlasImage v 2.01 Win
GeneTAC Integrator Software, Win
ImaGene v4.1 Win/Mac(beta)
www.biodiscovery.com
www.genomicsolutions.com
www.clontech.com
www.imagingresearch.com
www.scanalytics.com
www.packardbiochip.com
Web address
Both
Fluorescent
TIFF
TIFF GEL BAS
Both
Both
Both
Fluorescent
Fluorescent/ radioactive
TIFF GEL
TIFF
TIFF
TIFF Bitmap
Type of processed image
Table 4.1. Commercial sources for DNA array data acquisition software
Yes
Yes
Glass slide
Glass slide, filter, membrane
Yes
Yes
Yes
Yes
Filter, glass slide
Filter, glass slide
Glass slide, chip, filter
Glass slide
Type of array
Spot address correlated to gene name?
Media Cybernetics
Axon
Eisen Lab/ Stanford University
Affymetrix
ResGen
AlphaInnotech
ArrayPro Analyzer, Win
GenePix Pro 3.0.5, Win
ScanAlyze Win/95/98/ NT 4.0
Microarray Suite Win NT 4.0
Pathways™ Win/Linux/Unix
ArrayEase Win
TIFF
TIFF
www.alphainnotech.com
www.resgen.com
www.affymetrix.com
TIFF
TIFF GEL
TIFF
rana.lbl.gov/EisenSoftware.htm TIFF
www.axon.com
www.mediacy.com
Fluorescent
Radioactive
Fluorescent
Fluorescent
Fluorescent
Fluorescent
No
Yes
No
Glass slide
Filter
Yes
Yes
Affymetrix chip Yes
Glass slide
Glass slide
Glass slide
48
Gene expression profiling experiments
experiments described in Chapter 7, we used DNA ArrayVision software, obtained from Imaging Research Inc. (St. Catharines, Ontario, Canada) to provide software to prepare an array template, to record the pixel density, and to perform the background subtraction for each of the 18432 addresses on Sigma-Genosys Panorama™ E. coli filters. A total of 8580 of the features on these filters contain duplicate copies of a full-length PCR product of each of the 4290 E. coli ORFs. We used the remaining interspersed 9852 empty addresses for background measurements. The backgrounds are usually quite low and constant over the surface of the filter. In this case, a global average background measurement is subtracted from each experimental measurement. If the background varies in certain areas of the filter, the software can calculate and apply local background corrections. It is important to be aware of the fact that some array analysis software packages only correlate target intensities values with filter addresses, not with gene names. This laborious task can either be performed in Excel with worksheets supplied by the array manufacturer, or by custom software programs such as the ArrayVision Data Conversion Interface program available for online use at the Functional Genomics internet site of the University of California, Irvine.
Data acquisition for Affymetrix GeneChip™ glass slide experiments Because of the high density of probe features on Affymetrix GeneChips™ and glass slide arrays, confocal laser scanners described in Chapter 3 are required to accurately measure target signal intensities. Since these scanners operate at resolutions as high as 3 m, probe feature diameters as small as 15 m can be accurately measured. As an example, the typical feature size on current Affymetrix GeneChips™ is 2424 m. In this case, each GeneChip™ array is scanned twice with an HP GeneArray™ confocal laser or equivalent scanner, typically at a 3 m resolution, and the intensities at each probe site from both scans are averaged and saved in a *.CEL file. In addition, an array image file is created and saved with a *.DAT extension. The data in the *.CEL file is used to determine the background subtracted average difference of each probe set (AD (PMMM) / number of probe pairs) as described earlier. These raw, backgroundsubtracted average difference values for each probe set are used as an indicator of the level of expression of each gene for statistical analysis with an appropriate software package such as Microsuite provided by Affymetrix or the CyberT statistical program discussed in Chapters 5 and 7 available for online use at www.genomics.uci.edu.
Normalization methods
49
Normalization methods Before we can determine the differential gene expression profiles between two conditions obtained from the data of two DNA array experiments, we must first ascertain that the data sets are comparable. That is, we must develop methods to normalize data sets in a way that accounts for sources of experimental and biological variations, such as those discussed above, that might obscure the underlying variation in gene expression levels attributable to biological effects. However, with few exceptions, the sources of these variations have not been measured and characterized. As a consequence, many array studies are reported without statistical definitions of their significance. This problem is even further exacerbated by the presence of many different array formats and experimental designs and methods. While some theoretical studies that address this important issue have appeared in the literature, the normalization methods currently in common use are based on more pragmatic biological considerations. Here we consider the pros and cons of these data normalization methods and their applicability to different experimental designs and DNA array formats. Basically, these methods attempt to correct for the following variables: • • • • •
number of cells in the sample total RNA isolation efficiency mRNA isolation and labeling efficiency hybridization efficiency signal measurement sensitivity.
Normalization to total or ribosomal RNA In some reports, the authors assume the total RNA in a cell remains constant under all conditions. This is based on the belief that ribosomal RNA is constituitively expressed in all cells. Thus, since it comprises more than 90 percent of the total RNA they conclude that it can be used as a normalization standard for small fluctuations in mRNA levels. In this case, the data from independent experiments can be normalized to one another by adjusting their gene expression levels to the amount of total or ribosomal RNA harvested from each sample. The problem with this method is that, as recently pointed out by Suzuki et al. [13], the underlying biological assumption is wrong. Different cell types or cells growing in different conditions can produce widely differing amounts of total RNA. Indeed it is well known that total RNA production in mammalian cells can vary by as much as 50-fold.
50
Gene expression profiling experiments Normalization to housekeeping genes
This method is based on the assumption that certain “housekeeping” genes such as GAPDH or actin are not regulated in growing cells. In spite of numerous reports that under certain circumstances this is not the case [13], this remains a popular method that can be appropriate for some experimental designs. For example, if one is comparing the expression levels of a small number of genes where other more global normalization methods are inappropriate this method is acceptable. However, even in these cases, it should be kept in mind that small differences could be attributable to differences in the standard. In general, this should not be considered an acceptable method for the normalization of DNA array data.
Normalization to a reference RNA A widely used method for all types of DNA arrays and experimental designs is to add a given amount of an RNA standard from another organism to each total RNA sample. For example, Affymetrix adds bacterial and bacteriophage probes to their eukaryotic GeneChips™. This allows the data from each array to be scaled to the levels of these known amounts of RNA standards. The major advantage of this method is that by comparison to the standards it allows an estimate of the absolute level of targets in each experimental sample. Another advantage of this method is that it effectively normalizes for variances in mRNA isolation, labeling, and hybridization efficiencies. The disadvantages arise from the compounded errors associated with the amounts of the standard applied to each array and errors in the measurements of these standards.
Normalization by global scaling The most widely used data normalization method that relies on the fewest assumptions and addresses all of the variables listed above is the global normalization method. Here, the sum of the measurements of each array are simply scaled to a common number. For example in the experiments described in Chapter 7 we divide each measurement from each DNA array by the sum of all measurements of that array. This scales the total signal on all arrays to a value of one with the advantage that each individual measurement is expressed as a fraction of the total signal, in other words as the fraction of total mRNA. While this is a simple method that performs well, it also has its drawbacks. It assumes that the total amount of mRNA remains constant under various experimental conditions. If one is examin-
Normalization methods
51
ing the gene expression profile of an entire genome this is probably a safe assumption, especially for bacterial cells. In this case, the large majority of genes remain relatively constant and those genes whose expression levels are increased are countered by genes whose expression levels decrease. However, this is a tenuous assumption at best if a small subset of functionally related genes or if specialized cell types are queried. Since none of these methods accommodates the many sources of variables encountered in DNA array experiments, this is an intense area of bioinformatics research. For example, Li and Wong [14] have considered the variance introduced by the use of different probes to interrogate the same gene in Affymetrix GeneChips™. They have developed model-based algorithms for identifying and handling cross-hybridizing probes that greatly improve the interpretation of GeneChip™ data, especially when only a few replicate experiments are performed (see Chapter 7). As DNA array formats become more standardized as more research in this area is performed it can be anticipated that general solutions for these basic problems will emerge. 1. DeRisi, J. L., Iyer, V. R., and Brown, P. O. The metabolic and genetic control of gene expression on a genomic scale. 1997. Science 278(5338):680–686. 2. Arfin, S. M., Long, A. D., Ito, E., Riehle, M. M., Paegle, E. S., and Hatfield, G. W. Global gene expression profiling in Escherichia coli K12: the effects of integration host factor. 2000. Journal of Biological Chemistry 275:29672–29684. 3. Schena, M., Shalon, D., Davis, R. W., and Brown, P. O. Quantitative monitoring of gene expression patterns with a complementary DNA microarray. 1995. Science 270:467–470. 4. Schena, M. Genome analysis with gene expression microarrays. Review. 1996. Bioessays 18:427–431. 5. Rhee, K., Parekh, B. S., and Hatfield, G. W. Leucine-responsive regulatory protein–DNA interactions in the leader region of the ilvGMEDA operon of Escherichia coli. 1996. Journal of Biological Chemistry 271:26499–26507. 6. Dolter, K. E., and Braman, J. C., Small-sample total RNA purification: laser capture microdissection and cultured cell applications. 2001. Biotechniques 6:1358–1361. 7. Neidhardt, F. C., Bloch, P. L., and Smith, D. F. Culture medium for enterobacteria. 1974. Journal of Bacteriology 119:736–747. 8. Ito, E. T., and Hatfield, G. W., unpublished data. 9. Decker, C. J., and Parker, R. Mechanisms of mRNA degradation in eukaryotes. Review. 1994. Trends in Biochemical Sciences 19:336–340. 10. Olivas, W., and Parker, R. The Puf3 protein is a transcript-specific regulator of mRNA degradation in yeast. 2000. EMBO Journal 19:6602–6611. 11. Yu, H., Tan, M., and Hatfield, G.W., unpublished data. 12. Vawter, M., and Hatfield, G. W., unpublished data.
52
Gene expression profiling experiments
13. Suzuki, T., Higgins, P. J., and Crawford, D. R. Control selection for RNA quantitation. 2000. Biotechniques 29:332–337. 14. Li, C., and Wong, W. H. Model-based analysis of oligonucleotide arrays: expression index computation and outlier detection. 2001. Proceedings of the National Academy of Sciences of the USA 98:31–36.
5 Statistical analysis of array data: Inferring changes
Problems and common approaches Although many data analysis techniques have been applied to DNA array data, the field is still evolving and the methods have not yet reached a level of maturity [1]. Even very basic issues of signal-to-noise ratios are still being sorted out. Gene expression array data can be analyzed on at least three levels of increasing complexity. The first level is that of single genes, where one seeks to establish whether each gene in isolation behaves differently in a control versus an experimental or treatment situation. Here experimental/treatment is to be taken, of course, in a very broad sense: essentially any situation different from the control. Differential single-gene expression analysis can be used, for instance, to establish gene targets for drug development. The second level is multiple genes, where clusters of genes are analyzed in terms of common functionalities, interactions, co-regulation, etc. Gene co-expression can provide, for instance, a simple means of gaining leads to the functions of many genes for which information is not available currently. This level includes also leveraging DNA array data information to analyze DNA regulatory regions and finding regulatory motifs. Finally, the third level attempts to infer and understand the underlying gene and protein networks that ultimately are responsible for the patterns observed. Other issues of calibration, quality control, and comparison across different experiments and technologies are addressed in Chapter 7 (see, for instance, also [2, 3]). It should be clear that this classification is useful only as an initial roadmap, and there are other possible viewpoints from which array data can be analyzed, notwithstanding that the boundaries between levels and between problems are fuzzy. In particular, this classification takes a genecentric viewpoint. Indeed, one could, for instance, look also at the data 53
54
Statistical analysis: inferring changes
from the angle of the conditions and ask how similar are two conditions from a gene expression standpoint [4], or cluster data according to experiments. If for nothing else than convenience, we shall still follow the simple roadmap. Thus, in this chapter we deal with the first problem of inferring significant gene changes. The treatment here largely follows our published work [5, 6]. To begin with, we assume for simplicity that for each gene X the data D consists of a set of measurements x 1c,...,x ncc and x1t ,...,xnt t representing expression levels, or rather their logarithms, in both a control and treatment situation. For each gene, the fundamental question we wish to address is whether the level of expression is significantly different in the two situations. One approach commonly used in the literature at least in the first wave of publications (see for instance, [7, 8, 9]), has been a simple-minded fold approach, in which a gene is declared to have significantly changed if its average expression level varies by more than a constant factor, typically two, between the treatment and control conditions. Inspection of gene expression data suggests, however, that such a simple “twofold rule” is unlikely to yield optimal results, since a factor of two can have quite different significance and meaning in different regions of the spectrum of expression levels, in particular at the very high and very low ends. Another approach to the same question is the use of a t-test, for instance on the logarithm of the expression levels. This is similar to the fold approach because the difference between two logarithms is the logarithm of their ratio. This approach is not necessarily identical to the first because the logarithm of the mean is not equal to the mean of the logarithms; in fact it is always strictly greater by convexity of the logarithm function. The two approaches are equivalent only if one uses the geometric mean of the ratios rather than the arithmetic mean. In any case, with a reasonable degree of approximation, a test of the significance of the difference between the log expression levels of two genes is equivalent to a test of whether or not their fold change is significantly different from 1. In a t-test, the empirical means mc and mt and variances s2c and s2t are used to compute a normalized distance between the two populations in the form:
兹
t (mc mt )/
s2c s2t nc nt
(5.1)
where, for each population, m i xi /n and s2 i (xi m)2/(n1) are the well-known estimates for the mean and standard deviation. It is well known
Probabilistic modeling of array data
55
in the statistics literature that t follows approximately a Student distribution (Appendix A), with f
[(s2c /nc ) (s2t /nt )]2 (s2c /nc ) 2 (s2t /nt ) 2 nc 1 nt 1
(5.2)
degrees of freedom. When t exceeds a certain threshold depending on the confidence level selected, the two populations are considered to be different. Because in the t-test the distance between the population means is normalized by the empirical standard deviations, this has the potential for addressing some of the shortcomings of the simple fixed fold-threshold approach. The fundamental problem with the t-test for array data, however, is that the repetition numbers nc and/or nt are often small because experiments remain costly or tedious to repeat, even with current technology. Small populations of size n1, 2 or 3 are still very common and lead, for instance, to poor estimates of the variance. Thus a better framework is needed to address these shortcomings. Here we describe a Bayesian probabilistic framework for array data, which bears some analogies with the framework used for sequence data [10] and can effectively address the problem of detecting gene differences.
Probabilistic modeling of array data The Bayesian probabilistic framework Several decades of research in sequence analysis and other areas have demonstrated the advantages and effectiveness of probabilistic approaches to biological data. Clearly, current DNA array data is inherently very noisy, due to experimental and biological variables discussed in Chapter 4 that are difficult to control. But in addition, biological data sets are characterized by high degrees of variability that go well beyond the level of measurement noise. In sequence data, for instance, measurement noise levels can be reduced practically to zero in most cases (highly repetitive regions can be an exception) by sequencing the same region multiple times. Nevertheless, probabilistic models of sequence data, such as graphical models and Markov models [10, 11] increasingly play a fundamental role. This is because variability is an integral part of biological systems – brought about by, among others, eons of evolutionary tinkering. Even if measurements were close to perfect, there is some degree of stochasticity in the gene-regulation machinery itself.
56
Statistical analysis: inferring changes
Biological systems also have very high dimensionality: even in a large array experiment, only a very small subset of relevant variables is measured, or even under control. The vast majority of variables remains hidden and must be inferred or integrated out by probabilistic methods. Thus array data requires a probabilistic approach because it is highly noisy and variable, and many relevant variables remain unobserved behind the massive data sets. This modeling problem is properly addressed using a Bayesian probabilistic framework. The general Bayesian statistical framework codifies how to proceed with data analysis and inference in a rational way in the presence of uncertainty. Under a small set of common sense axioms, it can be shown that subjective degrees of belief must obey the rules of probability and proper induction must proceed in a unique way, by propagation of information through Bayes’ theorem. In particular, at any given time, any hypothesis or model M can be assessed by computing its posterior probability in light of the data according to Bayes’ formula: P(M|D)P(D|M )P(M)/P(D), where P(D|M ) is the data likelihood and P(M ) is the prior probability capturing any background information one may have. The fundamental importance of Bayes’ theorem is that it allows inversion, going from the probability a given hypothesis assigns to the data (likelihood) to the probability of the hypothesis itself, given the data (posterior). Increasingly, the Bayesian framework is being applied successfully to a variety of data-rich domains. Whether one subscribes or not to the axioms and practices of Bayesian statistics [12, 13, 14, 15], it is wise to model biological data in general, and array data in particular, in a probabilistic way for the reasons outlined above. In order to develop a probabilistic approach for array data, the lessons learnt with sequence data are worth remembering. In sequence data, the simplest probabilistic model is a first-order Markov model, or a die, associated with the average composition of the family of DNA, RNA, or protein sequences under study (Figure 5.1). The next level of modeling complexity is a Markov model with one die per position or per column in a multiple alignment. The die model is the starting point of all more sophisticated models used today, such as higher-order Markov models, hidden Markov models, and so forth. In spite of their simplicity, these die models are still useful as a background against which the performances of more sophisticated models are assessed. Gaussian model for array data In array data, the simplest model would assume that all data points are independent of each other and extracted from a single continuous distribu-
Probabilistic modeling of array data
57
T
CA
G
Figure 5.1. DNA dice.
tion, for instance a Gaussian distribution. While trivial, this “Gaussian die” model still requires the computation of interesting quantities, such as the average level of activity and its standard deviation, which can be useful to calibrate or assess global properties of the data. The next equivalent level of modeling is a set of independent distributions, one for each dimension, i.e., for instance each gene. While it is obvious that genes interact with each other in complex ways and therefore are not independent, the independence approximation is still useful and underlies any attempt, probabilistic or other, to determine whether expression level differences are significant on a gene-by-gene basis. Here we first assume that the expression levels of a gene measured multiple times under the same experimental conditions will have a roughly Gaussian distribution. In our experience, with common technologies this assumption is reasonable, especially for the logarithm of the expression levels, corresponding to lognormal raw expression levels. To the best of our knowledge, large-scale replicate experiments have not been carried out yet to make very precise assessments. But at least to a first degree of approximation the normality assumption is correct. It is clear, however, that other distributions, such as gammas or mixtures of Gaussians/gammas, could be introduced at this stage. These would impact the details of the analysis (see also [16, 17]), but not the general Bayesian probabilistic framework. Thus, in what follows we assume that the data has been pre-processed – including taking logarithms if needed – to the point where we can model the corresponding measurements of each gene in each situation (treatment or control) with a normal distribution N (x; , 2). For each gene and each condition, we have a two-parameter model w(, 2), and by focusing on one such model we can omit indices identifying the gene or the condition.
58
Statistical analysis: inferring changes
Assuming that the observations are independent, the likelihood is given by: P(D | , 2 ) ⬇
N(x ; , ) i
2
i
C( 2 ) n/2e i (xi ) 2/2 2 C( 2 ) n/2e (n(m )2 (n1)s 2 )/2 2
(5.3)
where i ranges over replicate measurements. In this chapter, we write C to denote the normalizing constant of any distribution. The likelihood depends only on the sufficient statistics n, m, and s2. In other words, all the information about the sample that is relevant for the likelihood is summarized in these three numbers. The case in which either the mean or the variance of the Gaussian model is supposed to be known is of course easier and is well studied in the literature [12, 13, 14]. A full Bayesian treatment requires introducing a prior P(, 2). The choice of a prior is part of the modeling process, and several alternatives [12, 13, 14] are possible, a sign of the flexibility of the Bayesian approach rather than its arbitrariness. Several kinds of priors for the mean and variance of a normal distribution have been studied in the literature [12, 13, 14], including non-informative improper prior, semi-conjugate prior, and conjugate prior distributions. A prior is said to be conjugate if it has the same functional form as the corresponding posterior. In our experience, so far the most suitable and flexible prior for array data is the conjugate prior, which adequately captures several properties of DNA array data including the fact that and 2 are generally not independent. The conjugate prior When estimating the mean alone of a normal model of known variance, the obvious conjugate prior is also a normal distribution. When estimating the standard deviation alone of a normal model of known mean, the conjugate prior is a scaled inverse gamma distribution (equivalent to 1/ 2 having a gamma distribution; see Appendix A). Intuitively, if you are not familiar with gamma distributions, think of this prior as a bell-shaped distribution, restricted to positive values only, on the variance. The form of the likelihood in Equation 5.3 shows that when both the mean and variance are unknown, the conjugate prior density must also have the form P( | 2)P( 2), where the marginal P( 2) has a scaled inverse gamma distribution and the conditional distribution P( | 2) is normal. This leads to a hierarchical model with a vector of four hyperparameters for the prior (0, 0, 0 and 20) with the densities:
59
Probabilistic modeling of array data P( | 2 ) N( ; 0, 2/0 )
(5.4)
P( 2 ) I( 2; 0, 20 )
(5.5)
and The expression for the prior P(, 2)P(, 2 | ) is then
冤
C 1 ( 2 ) ( 0 /2 1) exp
0 2 0
( )2 2 2 0 2 2 0
冥
(5.6)
The expectation of the prior is finite if and only if 0 2. Notice that it makes perfect sense with array data to assume a priori that and 2 are dependent, as suggested immediately by visual inspection of typical array data sets (see Figure 5.3, below). The hyperparameters 0 and 2 /0 can be interpreted as the location and scale of , and the hyperparameters 0 and
20 as the degrees of freedom and scale of 2. After some algebra, the posterior has the same functional form as the prior P( , 2 | D, ) N( ; n, 2/n )I( 2; n, 2n )
(5.7)
with
n
0 n m 0 n 0 0 n
(5.8)
n 0 n
(5.9)
n 0 n
(5.10)
n 2n 0 20 (n 1)s 2
0n (m 0 ) 2 0 n
(5.11)
The parameters of the posterior combine information from the prior and the data in a sensible way. The mean n is a convex weighted average of the prior mean and the sample mean. The posterior degree of freedom n is the prior degree of freedom 0 plus the sample size n, and similarly for the scaling factor n. The posterior sum of squares n 2n is the sum of of the prior sum of squares 0 20, the sample sum of squares (n1)s 2, and the residual uncertainty provided by the discrepancy between the prior mean and the sample mean. While is is possible to use a prior mean 0 for gene expression data, in many situations it is sufficient to use 0 m. The posterior sum of squares is then obtained precisely as if one had 0 additional observations all associated with deviation 20. While superficially this may seem like setting the
60
Statistical analysis: inferring changes
prior after having observed the data, it can easily be justified [18]. Furthermore, a similar effect is obtained using a preset value 0 with 0 →0, i.e, with a very broad standard deviation so that the prior belief about the location of the mean is essentially uniform and vanishingly small. The selection of the hyperparameters for the prior is discussed in more detail below. It is not difficult to check that the conditional posterior distribution of the mean P( | , D, ) is normal N(n, 2/ n). The marginal posterior P( |D, ) of the mean is Student t(n, n, 2n /n) and the marginal posterior P( 2 |D, ) for the variance is scaled inverse gamma I(n, 2n). Finally, it is worth remarking that, if needed, more complex priors could be constructed using mixtures of conjugate priors, leading to mixtures of conjugate posteriors. Full-Bayesian treatment versus hypothesis testing The posterior distribution P(, 2 |D, ) is the fundamental object of Bayesian analysis and contains the relevant information about all possible values of and 2. At this stage of modeling, each gene is associated with two models wc (c, 2c) and wt (t, 2t ); two sets of hyperparameters c and t; and two posterior distributions P(wc |D, c) and P(wt |D, t) (Figure 5.2). A full probabilistic treatment would require introducing prior distributions over the hyperparameters. These could be integrated out to obtain the true posterior probabilities P(wc |D) and P(wt |D). The posterior distributions contain much more information than simple parameter point estimates, or the results of a simple t-test. The Bayesian approach could in principle detect interesting changes that are beyond the scope of the t-test. For instance, a gene with the same mean but a very different variance between the control and treatment situations goes undetected by a t-test, although the change in variance might be biologically relevant and correspond to a gene with oscillatory expression levels, with different amplitudes around the same mean (Figure 5.2). These and other more subtle differences could be captured by measuring the difference, for instance in terms of relative entropy [10], between the two posterior distributions. The very idea of deciding whether a gene behaves differently between different conditions is somewhat at odds with the Bayesian framework which assigns a richer posterior distribution to all possible parameter values and in the case of continuous distributions, a typical mass of 0 to a single point event. Unless additional decision criteria are provided, a Bayesian treatment of the non-Bayesian decision problem requires
92
94
96
98
100
102
104
106
108
110
Figure 5.2. Contour plots for the posterior distribution of two hypothetical genes, or the same gene in two different conditions, using the posterior defined above seen in the xy plane, with x and y 2. In both cases, the mean is equal to 100 therefore the two situations are indistinguishable with a t-test or a fold approach.Yet the behaviors are very different in terms of standard deviations.
90
5
10
15
20
25
30
35
40
45
50
62
Statistical analysis: inferring changes
assigning a non-zero prior to the null hypothesis, which seems quite contrived (see section “Hypothesis testing” in Appendix B). To address this decision issue, here we use a compromise between hypothesis testing and the more general Bayesian framework by leveraging the simplicity of the t-test, but using parameter and hyperparameter point estimates derived from the Bayesian framework. Parameter point estimates In order to perform the t-test we need to collapse the information-rich posterior distribution into single point estimates of the mean and variance of the expression level of a gene in a given situation. This can be done in a number of ways. In general, the most robust answer is obtained using the mean of the posterior (MP) estimate. An alternative is to use the mode of the posterior, or MAP (maximum a posteriori) estimate. For completeness, we derive both kinds of estimates. By integration, the MP estimate is given by
n and 2
n
2 n 2 n
(5.12)
provided n 2. If we take 0 m, we then get the following MP estimate:
m and 2
n 2n 0 20 (n 1)s 2 n 2 0 n 2
(5.13)
provided 0 n2. This is the default estimate implemented in the CyberT software described below. From Equation 5.7, the MAP estimates are:
n and 2
n 2n n 1
(5.14)
If we use 0 m, these reduce to:
n m and 2
n 2n 0 20 (n 1)s 2 n 1 0 n 1
(5.15)
Here the modes of the marginal posterior are given by
n and 2
n 2n n 2
(5.16)
In practice, Equations 5.13 and 5.15 give similar results and can be used with gene expression arrays. The slight differences between the two closely matches what is seen with Dirichlet priors on sequence data [10], Equation 5.13 being generally a slightly better choice. The Dirichlet prior is equiva-
Probabilistic modeling of array data
63
lent to the introduction of pseudo-counts to avoid setting the probability of any unobserved amino acid or nucleotide to zero. In array data, few observation points are likely to result in a poor estimate of the variance. With a single observation (n1), for instance, it would be unreasonable to think that the corresponding variance is zero; hence the need for regularization, which is achieved by the conjugate prior. In the MP estimate, the empirical variance is modulated by 0 “pseudo-observations” associated with a background variance 20. In summary, we are now modeling the expression level of a gene by a normal distribution with mean equal to the empirical mean and variance given by Equation 5.13. This requires estimating the hyperparameters 20 and 0, representing the background variance and its strength. Hyperparameter point estimates and implementation There are several possibilities for dealing with hyperparameters in general and in specific cases [5, 18, 19]. Here we describe a solution implemented in the CyberT web server [9] accessible through: www.genomics.uci.edu (Appendix C). In this approach, we use the t-test with the regularized standard deviation of Equation 5.13 and the number of degrees of freedom associated with the corresponding augmented populations of points, which incidentally can be fractional. In the simplest case, where we use 0 m, one must select the values of the background variance 20, and its strength 0. The value of 0 can be set by the user. The smaller n, the larger 0 ought to be be. A simple rule of thumb is to assume that l2 points are needed to estimate properly the standard deviation and keep n 0 l. This allows for a flexible treatment of situations in which the number n of available data points varies from gene to gene. A reasonable default is to use l10. A special case can be made for genes with activity levels close to the minimal detection level of the technology being used. The measurements for these genes being particularly unreliable, it may be appropriate to use a stronger prior for them with a higher value of 0. For 0, one could use the standard deviation of the entire set of observations or, depending on the available knowledge, of particular categories of “similar” genes. In a flexible implementation, the background standard deviation is estimated by pooling together all the neighboring genes contained in a window of size ws. CyberT automatically ranks the expression levels of all the genes and lets the user choose this window size. The default is ws101, corresponding to 50 genes immediately above and below the average expression level of the gene under consideration.
64
Statistical analysis: inferring changes control
control
4
2.5 2
3 std
1.5 2 1 1
0 14
0.5
12
10
8
6
4
0 14
12
experimental
10
8
6
4
6
4
experimental
4
2.5 2
3 std
1.5 2 1 1
0 14
0.5
12
10
8 mean
6
4
0 14
12
10
8 mean
Figure 5.3. DNA array experiment on Escherichia coli. Data obtained from reverse transcribed 33P-labeled RNA hydridized to commercially available nylon arrays (Sigma Genosys) containing each of the 4290 predicted E. coli genes. The sample included a wild-type strain (control) and an otherwise isogenic strain lacking the gene for the global regulatory gene, integration host factor (IHF) (experimental). n4 for both control and experimental situations. The horizontal axis represents the mean of the logarithm of the expression levels, and the vertical axis shows the corresponding standard deviations (std ). The left column corresponds to raw data; the right column to regularized standard deviations using Equation 5.13. Window size is ws101 and K10. Data are from [20].
Simulations We have used the Bayesian approach and CyberT to analyze a number of published and unpublished data sets. We have found that the Bayesian approach very often compares favorably to a simple fold approach or a straight t-test and partially overcomes deficiencies related to low replication in a statistically consistent way [6]. In every high-density array experiment
65
Simulations 100% Confidence level: 95%
Percent prediction samples are from different populations
90%
Position of first Gaussian: 10
n=5
80%
70%
n=4 60%
50%
n=3 40%
30%
20%
10%
0% 10
n=2
9.5
9 8.5 Position of second Gaussian (log activity)
8
7.5
Figure 5.4. Plain t-test run on simulated data in the same range as data in previous figure. n points are randomly drawn from two pairs of Gaussians 1000 times and a plain t-test is applied to decide whether the two populations are different or not with a confidence of 95%. n is varied from 2 to 5. Vertical axis represents the percentage of “correct” answers. One of the Gaussians is kept fixed with a mean of 10 and standard deviation of 0.492. The other Gaussians are taken at regular intervals away from the first Gaussian. Both Gaussians have the corresponding average standard deviation derived by linear regression on the data of the previous figure in the interval [11, 7] of log-activities. The parameters of the regression line a log (activity) b for log-activities in the range of [11, 7] are: a0.123 and b0.736. For low values of n, the t-test performs very poorly.
we have analyzed, we have observed a strong scaling of the expression variance over replicated experiments with the average expression level, on both a log transformed and raw scale). As a result, a threshold for significance based solely on fold changes is likely to be too liberal for genes expressed at low levels and too conservative for highly expressed genes. One informative data set for comparing the Bayesian approach to the simple t-test or fold change approaches is the high-density array experiment
66
Statistical analysis: inferring changes
Percent prediction samples are from different populations
100%
n=5
90%
Confidence level: 99%
80%
Position of first Gaussian: 10
n=4
70%
60%
50%
n=3
40%
30%
20%
10%
n=2 0% 10
9.5
8.5 9 Position of second Gaussian (log activity)
8
7.5
Figure 5.5. Same are previous figure but with 99% confidence interval.
reported in [20] comparing wild-type Escherichia coli cells to mutant cells for the global regulatory protein IHF (integration host factor). The main advantage of this data set is that it is fourfold replicated for both the wildtype and mutant alleles, according to the experimental design described in Figure 4.1. The regularizing effect of the prior based on the background standard deviation is shown in Figure 5.3 and in the simulation described below. The figure clearly shows that standard deviations vary substantially over the range of expression levels, in this case roughly in a monotonic decreasing fashion, although other behaviors also have been observed. Interestingly, in these plots the variance in log-transformed expression levels is higher for genes expressed at lower levels rather than at higher ones. These plots confirm that genes expressed at low or near background levels may require a stronger value of 0, or alternatively could be ignored in expression analyses. The variance in the measurement of genes expressed at a low level is large enough that in many cases it will be difficult to detect significant changes in expression for this class of loci.
Simulations
67
In analyzing the data we found that large fold changes in expression are often associated with p-values not indicative of statistical change in the Bayesian framework, and conversely subtle fold changes are often highly significant as judged by the Bayesian analysis. In these two situations, the conclusions drawn with CyberT appear robust relative to those drawn from fold change alone, as large non-statistically significant fold changes are often associated with large measurement errors. As a result of the level of experimental replication seen in [20], we were able to look at the consistency of the Bayesian estimator of statistical significance relative to the t-test. We found that in independent samples of size two from the integration host factor (IHF) data set (i.e., two experiments versus two controls) the set of 120 most significant genes identified using the Bayesian approach had approximately 50% of their member in common, whereas the set of 120 most significant genes identified using the t-test had only approximately 25% of their members in common. This suggests that for twofold replication the Bayesian approach is approximately twice as consistent as a simple t-test at identifying genes as up- or down-regulated, although with only twofold replication there is a great deal of uncertainty associated with highdensity array experiments (Figures 5.4 and 5.5). To further assess the Bayesian approach, here we simulate an artificial data set assuming Gaussian distribution of log expressions, with means and variances in ranges similar to those encountered in the data set of [20], with 1000 replicates for each parameter combination. Selected means for the log data and associated standard deviations (in brackets) are as follows: 6 (0.1), 8 (0.2), 10 (0.4), 11 (0.7), 12 (1.0). On this artificially generated data, we can compare the behavior of a simple ratio (twofold and fivefold) approach, with a simple t-test, with the regularized t-test using the default settings of CyberT. The main results, reported in Table 5.1, can be summarized as follows: • By 5 replications (5 control and 5 treatment) the Bayesian approach and t-test give similar results. • When the number of replicates is “low” (2 or 3), the Bayesian approach performs better than the t-test. • The false positive rate for the Bayesian and t-test approach are as expected (0.05 and 0.01 respectively) except for the Bayesian with very small replication (i.e., 2) where it appears elevated. • The false positive rate on the ratios is a function of expression level and is much higher at lower expression levels. At low expression levels the false positive rate on the ratios is unacceptably high.
68
Statistical analysis: inferring changes
Table 5.1. Number of positives detected out of 1000 genes Log expression
Ratio
Plain t-test
Bayes
n
from
to
2-fold
5-fold
p0.05
p0.01
p0.05
p0.01
2 2 2 2 2 2 3 3 3 3 3 3 5 5 5 5 5 5 2v4 2v4 2v4 2v4 2v4 2v4
8 10 12 6 8 10 8 10 12 6 8 10 8 10 12 6 8 10 8 10 12 6 8 10
8 10 12 6.1 8.5 11 8 10 12 6.1 8.5 11 8 10 12 6.1 8.5 11 8 10 12 6.1 8.5 11
1 13 509 0 167 680 0 36 406 0 127 674 0 9 354 0 70 695 0 38 446 0 123 635
0 0 108 0 0 129 0 0 88 0 0 62 0 0 36 0 0 24 0 0 85 0 0 53
38 39 65 91 276 202 42 51 44 172 640 296 53 35 65 300 936 688 35 36 46 126 475 233
7 11 10 20 71 47 9 11 5 36 248 139 13 6 11 102 708 357 4 9 17 32 184 60
73 60 74 185 730 441 39 39 45 224 831 550 39 31 54 321 966 752 39 40 43 213 788 339
9 11 16 45 419 195 4 6 4 60 587 261 8 3 4 109 866 441 6 3 5 56 509 74
Notes: Data was generated using normal distribution on a log scale in the range of [3], with 1000 replicates for each parameter combination. Means of the log data and associated standard deviations (in brackets) are as follows: 6 (0.1), 8 (0.2), 10 (0.4), 11 (0.7), 12 (1.0). For each value of n, the first three experiments correspond to the case of no change and therefore yield false positive rates. Analysis was carried out using CyberT with default settings and the hyperparameter set to 10. Regularized t-tests were carried out using degrees of freedom equal to: reps 1 hyperparameter 1.
• For a given level of replication the Bayesian approach at p0.01 detects more differences than a twofold change except for the case of low expression levels (where the false positive rate from ratios is elevated). • The Bayesian approach with 2 replicates outperforms the t-test with 3 replicates (or 2 versus 4 replicates).
Extensions
69
• The Bayesian approach has a similar level of performance when comparing 3 treatments to 3 controls, or 2 treatments to 4 controls. This suggests an experimental strategy where the controls are highly replicated and a number of treatments less highly replicated.
Extensions In summary, the probabilistic framework for array data analysis addresses a number of current approach shortcomings related to small sample bias and the fact that fold differences have different significance at different expression levels. The framework is a form of hierarchical Bayesian modeling with Gaussian gene-independent models. While there can be no perfect substitute for experimental replication (see also [21]), in simulations and controlled replicated experiments we have shown that the approach has a regularizing effect on the data, that it compares favorably to a conventional t-test, or simple fold approach, and that it can partially compensate for the absence of replication. New methods discussed in Chapter 7 are being developed to statistically estimate the rates of false positives and false negatives by modeling the distribution of p-values using a mixture of Dirichlet distributions and leveraging the fact that, under the null assumption, this distribution is uniform [22]. Depending on goals and implementation constraints, the present framework can be extended in a number of directions. For instance, regression functions could be computed offline to establish the relationship between standard deviation and expression level and used to produce background standard deviations. Another possibility is to use adaptive window sizes to compute the local background variance, where the size of the window could depend, for instance, on the derivative of the regression function. In an expression range in which the standard deviation is relatively flat (e.g., between 8 and 4 in Figure 5.3), the size of the window is less relevant than in a region where the standard deviation varies rapidly (e.g., between 12 and 10). A more complete Bayesian approach could also be implemented. The general approach described in this chapter also can be extended to more complex designs and/or designs involving gradients of an experimental variable and/or time series designs. Examples would include a design in which cells are grown in the presence of different stressors (urea, ammonia, oxygen peroxide), or when the molarity of a single stressor is varied (0, 5, 10 mmol). Generalized linear and non-linear models can be used in this context. The most challenging problem, however, is to extend the probabilistic framework towards the second level of analysis, taking into account
70
Statistical analysis: inferring changes
possible interactions and dependencies amongst genes. Multivariate normal models, and their mixtures, could provide the starting probabilistic models for this level of analysis (see also section “Gaussian processes” in Appendix B). With a multivariate normal model, for instance, is a vector of means and is a symmetric positive definite covariance matrix with determinant | |. The likelihood has the form
冤
C | |n /2 exp
1 2
n
兺 (X ) i
T
1 (Xi )
i1
冥
(5.17)
where T denotes matrix transpositions. The conjugate prior, generalizing the normal scaled inverse gamma distribution, is based on the inverse Wishart distribution (Appendix B) which generalizes the scaled inverse gamma distribution and provides a prior on . In analogy with the onedimensional case, the conjugate prior is parameterized by ( 0, 0/ 0, 0, 0). has an inverse Wishart distribution with parameters 0 and 0 1 (Appendix B). Conditioned on , has a multivariate normal prior N( ; 0, / 0). The posterior then has the same form, a product of a multivariate normal with an inverse Wishart, parameterized by ( n, n / n, n, n). The parameters satisfy:
n
0 n m 0 n 0 0 n
n 0 n n 0 n n 0
n
兺 (X m)(X m) i
i
t
1
0n (m 0 )(m 0 ) t 0 n
(5.18)
Thus estimates similar to Equation 5.13 can be derived for this multidimensional case to regularize both variances and covariances. While multivariate normal and other related models may provide a good starting-point, good probabilistic models for higher-order effects in array data are still at an early stage of development. Many approaches so far have concentrated on more or less ad hoc applications of clustering methods. This is one of the main topics of Chapter 6 and 7. In this chapter we hope to have provided convincing argument to the reader that it is effective in general to model
Extensions
71
array data in probabilistic fashion. Besides DNA arrays, there are several other kinds of high-density arrays, at different stages of development, which could benefit from a similar treatment. Going directly to a systematic probabilistic framework may contribute to the accleration of the discovery process by avoiding some of the pitfalls observed in the history of sequence analysis, where it took several decades for probabilistic models to emerge as the proper framework for many tasks.
1. Zhang, M. Q. Large-scale gene expression data analysis: a new challenge to computational biologists. 1999. Genome Research 9:681–688. 2. Beissbarth, T., Fellenberg, K., Brors, B., Arribas-Prat, R., Boer, J. M., Hauser, N. C., Scheideler, M, Hoheisel, J. D., Schutz, G., Poustka, A., and Vingron, M. Processing and quality control of DNA array hybridization data. 2000. Bioinformatics 16:1014–1022. 3. Zimmer, R., Zien, A., Aigner, T., and Lengauer, T. Centralization: a new method for the normalization of gene expression data. 2001. Bioinformatics 17 (Supplement 1): S323–S331. 4. Leach, S. M., Hunter, L., Taylor, R. C., and Simon, R. GEST: a gene expression search tool based on a novel bayesian similarity metric. 2001. Bioinformatics 17 (Supplement 1): S115–S122. 5. Baldi, P., and Long, A.D. A Bayesian framework for the analysis of microarray expression data: regularized t-test and statistical inferences of gene changes. 2001. Bioinformatics 17:509–519. 6. Long, A. D., Mangalam, H. J., Chan, B. Y., Tolleri, L., Hatfield, G. W., and Baldi, P. Global gene expression profiling in Escherichia coli K12: improved statistical inference from DNA microarray data using analysis of variance and a Bayesian statistical framework. 2001. Journal of Biological Chemistry 276:19937–19944. 7. Schena, A. M., Shalon, D., Davis, R. W., and Brown, P. O. Quantitative monitoring of gene expression patterns with a complementary DNA microarray. 1995. Science 270:467–470. 8. Schena, B. M., Shalon, D., Heller, R., Chai, A., Brown, P. O. and Davis, R. W. Parallel human genome analysis: microarray-based expression monitoring of 1000 genes. 1995. Proceedings of the National Academy of Sciences of the USA 93:10614–10619. 9. Heller, C. R. A., Schena, M., Chai, A., Shalon, D., Bedillon, T., Gilmore, J., Wolley, D. E., and Davis, R. W. Discovery and analysis of inflammatory disease-related genes using cDNA microarrays. 1997. Proceedings of the National Academy of Sciences of the USA 94:2150–2155. 10. Baldi, P., and Brunak, S. Bioinformatics: The Machine Learning Approach, 2nd edn. 2001. MIT Press, Cambridge, MA. 11. Durbin, R., Eddy, S., Krogh, A., and Mitchison, G. Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids. 1998. Cambridge University Press, Cambridge. 12. Box, G. E. P., and Tiao, G. C. Bayesian Inference in Statistical Analysis. 1973. Addison Wesley, New York.
72
Statistical analysis: inferring changes
13. Berger, J. O. Statistical Decision Theory and Bayesian Analysis. 1985. Springer-Verlag, New York. 14. Pratt, J. W., Raiffa, H., and Schlaifer, R. Introduction to Statistical Decision Theory. 1995. MIT Press, Cambridge, MA. 15. Gelman, A., Carlin, J. B., Stern, H. S., and Rubin, D. B. Bayesian Data Analysis. 1995. Chapman & Hall, London. 16. Wiens, B. L. When log-normal and gamma models give different results: a case study. 1999. American Statistician 53:89–93. 17. Newton, M. A., Kendziorski, C. M., Richmond, C. S., Blattner, F. R., and Tsui, K. W. On differential variability of expression ratios: improving statistical inference about gene expression changes from microarray data. In press. Journal of Computational Biology. 18. MacKay, D. J. C. Bayesian interpolation. 1992. Neural Computation 4:415–447. 19. MacKay, D. J. C. Comparison of approximate methods for handling hyperparameters. 1999. Neural Computation 11:1035–1068. 20. Arfin, S. M., Long, A.D., Ito, E.T., Tolleri, L., Riehle, M. M., Paegle, E. S., and Hatfield, G. W. Global gene expression profiling in Escherichia coli K12: the effects of integration host factor. 2000. Journal of Biological Chemistry 275:29672–29684. 21. Lee, M. T., Kuo, F. C., Whitmore, G. A., and Sklar, J. Importance of replication in microarray gene expression studies: statistical methods and evidence from repetitive cDNA hydribizations. 2000. Proceedings of the National Academy of Sciences of the USA 97:9834–9839. 22. Allison, D. B., Gadbury, G. L., Moonseong, H., Fernandez, J. R., CheolKoo, L., Prolle, T. A., and Weindruch, R. A mixture model approach for the analysis of microarray gene expression data. 2002. Computational Statistics and Data Analysis 39:1–20.
6 Statistical analysis of array data: Dimensionality reduction, clustering, and regulatory regions
Problems and approaches Differential expression is a useful tool for the analysis of DNA microarray data. However, and in spite of the fact that it can be applied to a large number of genes, differential analysis remains within the confines of the old one-gene-at-a-time paradigm. Knowing that a gene’s behavior has changed between two situations is at best a first step. In a cancer experiment, for instance, a significant change could be associated with a direct causal link (activation of an oncogene), a more indirect chain of effects (signaling pathway), a non-specific related phenomenon (cell division), or even a spurious event completely unrelated to cancer (“noise”). Most, if not all, genes act in concert with other genes. What DNA microarrays are really after are the patterns of expression across multiple genes and experiments. And to detect such patterns, additional methods such as clustering must be introduced. In fact, in the limit, differential analysis can be viewed as a clustering method with only two clusters: change and nochange. Thus, at the next level of data analysis, we want to remove the simplifying assumption that genes are independent and look at their covariance, at whether there exist multi-gene patterns, clusters of genes that share the same behavior, and so forth. While array data sets and formats remain heterogeneous, a key challenge in time is going to be the development of methods that can extract order across experiments, in typical data sets of size 300001000 and model, for instance, the statistical distribution of a gene’s expression levels over the space of possible conditions. Not surprisingly, conceptually these problems are not completely unlike those encountered in population genetics, such as detecting combinations of SNPs associated with complex diseases. 73
74
Dimensionality reduction, clustering, and regulatory regions
The methods and examples of Chapter 5 and 7 show how noisy the boundaries between clusters can be, especially in isolated experiments with low repetition. The key observation, however, is that even when individual experiments are not replicated many times complex expression patterns can still be detected robustly across multiple experiments and conditions. Consider, for instance, a cluster of genes directly involved in the cell division cycle and whose expression pattern oscillates during the cycle. For each individual measurement at a given time t, noise alone can introduce distortions so that a gene which belongs to the cluster may fall out of the cluster. However, when the measurements at other times are also considered, the cluster becomes robust and it becomes unlikely for a gene to fall out of the cluster it belongs to at most time steps. The same can be said of course for genes involved in a particular form of cancer across multiple patients, and so forth. In fact, it may be argued (Chapter 8) that robustness is a fundamental characteristic of regulatory circuits that must somehow transpire even through noisy microarray data. In many cases, cells tend to produce the proteins they need simultaneously, and only when they need them. The genes for the enzymes that catalyze a set of reactions along a pathway are likely to be co-regulated (and often somewhat co-located along the chromosome). Thus, depending on the data and clustering methods, gene clusters can often be associated with particular pathways and with co-regulation. Even partial understanding of the available information can provide valuable clues. Co-expression of novel genes may provide a simple means of gaining leads to the functions of many genes for which information is not yet available. Likewise, multi-gene expression patterns could characterize diseases and lead to new precise diagnostic tools capable of discriminating, for instance, different kinds of cancers. Many data analysis techniques have already been applied to problems in this class, including various clustering methods from k-means to hierarchical clustering, principal component analysis, factor analysis, independent component analysis, self-organizing maps, decision trees, neural networks, support vector machines, and Bayesian networks to name just a few. It is impossible to review all the methods of analysis in detail in the available space and counter-productive to try to single out a “best method” because: (1) each method may have different advantages depending on the specific task and specific properties of the data set being analyzed; (2) the underlying technology is still rapidly evolving; and (3) noise levels do not always allow for a fine discrimination between methods. Rather, we focus on the main methods of analysis and the underlying mathematical background.
Visualization
75
Array data is inherently high-dimensional, hence methods that try to reduce the dimensionality of the data and/or lend themselves to some form of visualization remain particularly useful. These range from simple plots of one condition versus another, to projection on to lower dimensional spaces, to hierarchical and other forms of clustering. In the next sections, we focus on dimensionality reduction (principal component analysis) and clustering since these are two of the most important and widely used methods of analysis for array data. For clustering, we partially follow the treatment in [1]. Additional information about other methods of array data analysis can be found in the last chapter (neural networks and Bayesian networks), in the Appendices (support vector machines), and throughout the references. Clustering methods of course can be applied not only to genes, but also to conditions, DNA sequences, and other relevant data. From array-derived gene clusters it is also possible to go back to the corresponding gene sequences and look, for instance, for shared motifs in the regulatory regions of co-regulated genes, as described in the last section of this chapter.
Visualization, dimensionality reduction, and principal component analysis The simplest approach to visually explore current array data is perhaps a two-dimensional plot of the activity levels of the genes in one experimental condition versus another. When each experiment is repeated several times, the average values can be used. In such plots, typically most genes are found along the main diagonal (assuming similar calibration between experiments) while differentially expressed genes appear as outliers. The methods described in Chapter 5 allow quantitative analysis of these outliers based on individual experimental values. A second more sophisticated approach for dimensionality reduction and visualization is principal component analysis. Principal component analysis (PCA) is a widely used statistical data analysis technique that can be viewed as: (1) a method to discover or reduce the dimensionality of the data; (2) a method to identify new meaningful underlying variables; (3) a method to compress the data; and (4) a method to visualize the data. It is also called the Karhunen–Loéve transform. Hotelling transform, or singular value decomposition (SVD) and provides an optimal linear dimension reduction technique in the mean-square sense. Consider a set of N points x1,..., xN in a space of dimension M. In the case of array data, the points could correspond to genes if the axes are associated with different experiments or to experiments if the axes are associated with
76
Dimensionality reduction, clustering, and regulatory regions
u
Figure 6.1. A two-dimensional set of points with its principal component axes and its unit vector u.
the probes/genes. We assume that the xs have already been centered by subtracting their mean value, or expectation, E[x]. The basic idea in PCA is to reduce the dimension of the data by projecting the xs on to an interesting linear subspace of dimension K, where K is typically significantly smaller than M. Interesting is defined in terms of variance maximization. PCA can easily be understood by recursively computing the orthonormal axis of the projection space. For the first axis, we are looking for a unit vector u1 such that, on average, the squared length of the projection of the xs along u1 is maximal. Assuming that all vectors are column vectors, this can be written as u1 arg max E [(uTx) 2]
(6.1)
|| u || 1
where uT denotes transposition, and E is the expected or average value (Figure 6.1). Any vector is always the sum of its orthogonal projections on to a given subspace and the orthogonal complement, so that here x(uTx)u (x(uTx)u). The second component maximizes the residual variance associated with (x(uTx)u) and so forth. More generally, if the first u1,..., uk1 components have been determined, the next component is the one that maximizes the residual variance in the form uk arg max E || u || 1
冤冢
x
兺 i1
冣冥 2
k1
(uTix)ui
(6.2)
Visualization
77
The principal components of the vector x are given by ci uTix. By construction, the vectors ui are orthonormal. In practice, it can be shown the uis are the eigenvectors of the (sample) covariance matrix E[xxT ] associated with the K largest eigenvalues and satisfy uk kuk
(6.3)
In array experiments, these give rise to “eigengenes” and “eigenarrays” [2]. Each eigenvalue k provides a measure of the proportion of the variance explained by the corresponding eigenvector. By projecting the vectors onto the subspace spanned by the first eigenvectors, PCA retains the maximal variance in the projection space and minimizes the mean-square reconstruction error. The choice of the number K of components is in general not a serious problem – basically it is a matter of inspecting how much variance is explained by increasing values of K. For visualization purposes, only projections on to two- or three-dimensional spaces are useful. The first dominant eigenvectors can be associated with the discovery of important features or patterns in the data. In DNA microarray data where the points correspond to genes and the axes to different experiments, such as different points in time, the dominant eigenvectors can represent expression patterns. For example, if the first eigenvector has a large component along the first experimental axis and a small component along the second and third axis, it can be associated with the experimental expression pattern “high–low–low”. In the case of replicated experiments, we can expect the first eigenvector to be associated with the principal diagonal (1/ 兹N , . . ., 1/ 兹N ). There are also a number of techniques for performing approximate PCA, as well as probabilistic and generalized (non-linear and project pursuit) versions of PCA [3, 4, 5, 6, 7], and references therein. An extensive application of PCA techniques to array data is described in [2] and in Chapter 7. Although PCA is not a clustering technique per se, projection on to lower dimensional spaces associated with the top components can help reveal and visualize the presence of clusters in the data (see Chapter 7 for an example). These projections however must be considered carefully since clusters present in the data can become hidden during the projection operation (Figure 6.2). Thus, while PCA is a useful technique, it is only one way of analyzing the data which should be complemented by other methods, and in particular by methods whose primary focus is data clustering.
78
Dimensionality reduction, clustering, and regulatory regions
A
B
C
Figure 6.2. Schematic representation of three data sets in two dimensions with very different clustering properties and projections onto principal components. A has one cluster. B and C have four clusters. A, B, and C have the same principal components. A and B have a similar covariance matrix with a large first eigenvalue. The first and second eigenvalues of C are identical.
Clustering overview Another direction for visualizing or compressing high-dimensional array data is the application of clustering methods. Clustering refers to an important family of techniques in exploratory data analysis and pattern discovery, aimed at extracting underlying cluster structures. Clustering, however, is a “fuzzy” notion without a single precise definition. Dozens of clustering algorithms exist in the literature and a number of ad hoc clustering procedures, ranging from hierarchical clustering to k-means have been applied to
Clustering overview
79
DNA array data [8, 9, 10, 11, 12, 13, 14, 15]. Because of the variety and “open” nature of clustering problems, it is unlikely that a systematic exhaustive treatment of clustering can be given. However there are a number of important general issues to consider in clustering and clustering algorithms, especially in the context of gene expression. Data types At the highest level, clustering algorithms can be distinguished depending on the nature of the data being clustered. The standard case is when the data points are vectors in Euclidean space. But this is by no means the only possibility. In addition to vectorial data, or numerical data expressed in absolute coordinates, there is the case of relational data, where data is represented in relative coordinates, by giving the pairwise distance between any two points. In many cases the data is expressed in terms of a pairwise similarity (or dissimilarity) measure that often does not satisfy the three axioms of a distance (positivity, symmetry, and triangle inequality). There exist situations where data configurations are expressed in terms of ternary or higher order relationships or where only a subset of all the possible pairwise similarities is given. More importantly, there are cases where the data is not vectorial or relational in nature, but essentially qualitative, as in the case of answers to a multiple-choice questionnaire. This is sometimes also called nominal data. While at the present time gene expression array data is predominantly numerical, this is bound to change in the future. Indeed, the dimension “orthogonal to the genes” covering different experiments, different patients, different tissues, different times, and so forth is at least in part non-numerical. As databases of array data grow, in many cases the data will be mixed with both vectorial and nominal components. Supervised/unsupervised One important distinction amongst clustering algorithms is supervised versus unsupervised. In supervised clustering, clustering is based on a set of given reference vectors or classes. In unsupervised clustering, no predefined set of vectors or classes is used. Hybrid methods are also possible where an unsupervised approach is followed by a supervised one. At the current early stage of gene expression array experiments, unsupervised methods such as k-means and self-organizing maps [11] are most commonly used. However, supervised methods have also been tried [12, 16], where clusters are predetermined using functional information or unsupervised clustering methods, and then new genes are classified in the various clusters using a classifier, such as linear and quadratic discriminant analysis, decision trees,
80
Dimensionality reduction, clustering, and regulatory regions
neural networks, or support vector machines, that can learn the decision boundaries between data classes. The feasibility of class discrimination with array expression data has been demonstrated, for instance for tumor classes such as leukemias arising from several different precursors [17], and B-cell lymphomas [18] (see also [19, 20]). Similarity/distance The starting-point of several clustering algorithms, including several forms of hierarchical clustering, is a matrix of pairwise similarities or distances between the objects to be clustered. In some instances, this pairwise distance is replaced by a distortion measure between a data point and a class centroid as in vector quantization methods. The precise definition of similarity, distance, or distortion is crucial and, of course, can greatly impact the output of the clustering algorithm. In any case, it allows converting the clustering problem into an optimization problem in various ways, where the goal is essentially to find a relatively small number of classes with high intraclass similarity or low intraclass distortion, and good interclass separation. In sequence analysis, for instance, similarity can be defined using a score matrix for gaps and substitutions and an alignment algorithm. In gene expression analysis, different measures of similarity can be used. Two obvious examples are Euclidean distance (or more generally L p distances) and correlation between the vectors of expression levels. The Pearson correlation coefficient is just the dot product of two normalized vectors, or the cosine of their angle. It can be measured on each pair of genes across, for instance, different experiments or different time steps. Each measure of similarity comes with its own advantages and drawbacks depending on the situation, and may be more or less suitable to a given analysis. The correlation, for instance, captures similarity in shape but places no emphasis on the magnitude of the two series of measurements and is quite sensitive to outliers. Consider, for instance, measuring the activity of two unrelated genes that are fluctuating close to the background level. Such genes are very similar in Euclidean distance (distance close to 0), but dissimilar in terms of correlation (correlation close to 0). Likewise, consider the two vectors 1000000000 and 0000000001. In a sense they are similar since they are almost always identical and equal to 0. On the other hand, their correlation is close to 0 because of the two “outliers” in the first and last position. Number of clusters The choice of the number K of clusters is a delicate issue, which depends, among other things, on the scale at which one looks at the data. It is safe to
Clustering overview
81
say that an educated partly manual trial-and-error approach still remains an efficient and widely used technique, and this is true for array data at the present stage. Because in general the number of clusters is relatively small, all possible values of K within a reasonable range can often be tried. Intuitively, however, it is clear that one ought to be able to assess the quality of K from the compactness of each cluster and how well each cluster is separated from the others. Indeed there have been several recent developments aimed at the automatic determination of the number of clusters [13, 21, 22, 23] with reports of good results. Cost function and probabilistic interpretation Any rigorous discussion of clustering on a given data set presupposes a principled way of comparing different ways of clustering the same data, hence the need for some kind of global cost/error function that can easily be computed. The goal of clustering then is to try to minimize such function. This is also called parametric clustering in the literature, as opposed to nonparametric clustering, where only local functions are available [24]. In general, at least for numerical data, this function will depend on quantities such as the centers of the clusters, the distance of each point in a cluster to the corresponding center, the average degree of similarity of the points in a given cluster, and so forth. Such a function is often discontinuous with respect to the underlying clustering of the data. Here again there are no universally accepted functions and the cost function should be tailored to the problem, since different cost functions can lead to different answers. Because of the advantages associated with probabilistic methods and modeling, it is tempting to associate the clustering cost function with the negative log-likelihood of an underlying probabilistic model. While this is formally always possible, it is of most interest when the structure of the underlying probabilistic model and the associated independence assumptions are clear. This is when the additive terms of the cost function reflect the factorial structure of the underlying probabilities and variables. As we shall see this is the case with mixture models, where the k-means clustering algorithm can be viewed as a form of expectation maximization (EM). In the rest of this section, we describe in more detail two basic clustering algorithms that can be applied to DNA array data, hierarchical clustering and k-means. Many other related approaches, including vector quantization [25], graph methods [13], factorial analysis, and self-organizing maps can be found in the references.
82
Dimensionality reduction, clustering, and regulatory regions Hierarchical clustering
Clusters can result from a hierarchical branching process. Thus there exist methods for automatically building a tree from data given in the form of pairwise similarities. In the case of gene expression data, this is the approach used in [8]. Hierarchical clustering algorithm The standard algorithm used in [8] recursively computes a dendrogram that assembles all the elements into a tree, starting from the correlation (or distance or similarity) matrix C. The algorithm starts by assigning a leaf of the tree to each element (gene). At each step of the algorithm: • The two most similar elements of the current matrix (highest correlation) are computed and a node joining these two elements is created. • An expression profile (or vector) is created for the node by averaging the two expression profiles (or vectors) associated with the two points (missing data can be ignored and the average can be weighted by the number of elements they contain). Alternatively, a weighted average of the distances is used to estimate the new distance between centers without actually computing the profiles. • A new smaller correlation matrix is computed using the newly computed expression profile or vector and replacing the two joined elements with the new node. • With N starting points, the process is repeated at most N1 times, until a single node remains. This algorithm is familiar to biologists and has been used in sequence analysis, phylogenetic trees, and average-linkage cluster analysis. As described, it requires O(N 3) steps since for each of the N1 fusions one must search for an optimal pair. An O(N2) version of the algorithm is described in [26]. The output of hierarchical clustering is typically a binary tree and not a set of clusters. In particular, it is usually not obvious how to define clusters from the tree since clusters are derived by cutting the branches of the tree at more or less arbitrary points. Tree visualization In the case of gene expression data, the resulting tree organizes genes or experiments so that underlying biological structure can often be detected and visualized [8, 9, 18, 27]. As already pointed out, after the construction of such a dendrogram there is still a problem of how to display the result
Hierarchical clustering
83
and which clusters to choose. Leaves are often displayed in linear order and biological interpretations are often made in relation to this order, e.g., adjacent genes are assumed to be related in some fashion. Thus the order of the leaves matters. At each node of the tree, either of the two elements joined by the node can be ordered to the left or the right of the other. Since there are N1 joining steps, the number of linear orderings consistent with the structure of the tree is 2N1. Computing the optimal linear ordering maximising the combined similarity of all neighboring pairs seems difficult, and therefore heuristic approximations have been proposed [8]. These approximations weigh genes using average expression level, chromosome position, and time of maximal induction. More recently, it was noticed in [28] that the optimal linear ordering can be computed in O(N4) steps simply by using dynamic programming, in a form which is essentially the well-known inside portion of the inside–outside algorithm for stochastic context-free grammars [1]. If G1,..., GN are the leaves of the tree and φ denotes one of the 2N1 possible orderings of the leaves, we would like to maximize N1
兺 C [G
(i),
G(i 1)]
(6.4)
i1
where Gφ (i ) is the ith leaf when the tree is ordered according to φ. Let V denote both an internal node of the tree as well as the corresponding subtree. V has two children: Vl on the left and Vr on the right, and four grandchildren Vll, Vlr, Vrl , and Vrr. The algorithm works bottom up, from the leaves towards the roots by recursively computing the cost of the optimal ordering M(V,U,W ) associated with the subtree V when U is the leftmost leaf of Vl and W is the rightmost leaf of Vr (Figure 6.3). The dynamic programming recurrence is given by: M(V,U,W ) max M(Vl,U,R) M(Vr,S,W ) C(R,S) RVl r SVrl
(6.5)
The optimal cost M(V ) for V is obtained by maximizing over all pairs, U, W. The global optimal cost is obtained recursively when V is the root of the tree, and the optimal tree can be found by standard backtracking. The algorithm requires computing M(V,U,W ) only once for each O(N 2) pair of leaves. Each computation of M(V,U,W ) requires maximization over all possible O(N 2) (R,S) pair of leaves. Hence the algorithm requires O(N 4) steps with O(N 2) space complexity, since only one M(V,U,W ) must be computed for each pair (U,W ) and this is also the size of the pairwise similarity
84
Dimensionality reduction, clustering, and regulatory regions
V
Vl
Vll
U
Vr
Vlr
R S
Vrl
Vrr
W
Figure 6.3. Tree underlying the dynamic programming recurrence of the inside algorithm.
matrix C. For some applications, O(N 4) is too slow. A faster algorithm on average is developed in [28] by early termination of search paths that are not promising. Hierarchical clustering has proved to be a useful for array data analysis in the literature, for instance for finding genes that share a common function [8, 18, 27]. The main clusters derived are often biologically significant and the optimal leaf ordering algorithm can further improve the quality and interpretability of the results [28]. Optimal leaf ordering helps in improving the definition of cluster boundaries and the relationships between clusters.
K-means, mixture models, and EM algorithm
85
K-means, mixture models, and EM algorithms K-means algorithm Of all clustering algorithms, k-means [29] is among the simplest and most widely used, and has probably the cleanest probabilistic interpretation as a form of EM on the underlying mixture model. In a typical implementation of the k-means algorithm, the number of clusters is fixed to some value of K based, for instance, on the expected number of regulatory patterns. K representative points or centers are initially chosen for each cluster more or less at random. In array data, these could reflect, for instance, the expected number of regulatory patterns. These points are also called centroids or prototypes. Then at each step: • Each point in the data is assigned to the cluster associated with the closest representative. • After the assignment, new representative points are computed for instance by averaging or taking the center of gravity of each computed cluster. • The two procedures above are repeated until the system converges or fluctuations remain small. Hence notice that using k-means requires choosing the number of clusters and also being able to compute a distance or similarity between points and compute a representative for each cluster given its members. The general idea behind k-means can lead to different software implementations depending on how the initial centroids are chosen, how symmetries are broken, whether points are assigned to clusters in a hard or soft way, and so forth. A good implementation ought to run the algorithm multiple times with different initial conditions and possibly also try different values of K automatically. When the cost function corresponds to an underlying probabilistic mixture model [30, 31], k-means is an online approximation to the classical EM algorithm [1, 32], and as such in general is bound to converge towards a solution that is at least a local maximum likelihood or maximum posterior solution. A classical case is when Euclidean distances are used in conjunction with a mixture of Gaussians model. A related application to a sequence clustering algorithm is described in [33]. Mixture models and EM To better understand the connection to mixture models, imagine a data set D (d1,.. .,dN) and an underlying mixture model with K components of the form
86
Dimensionality reduction, clustering, and regulatory regions P(d )
K
兺
P(Mk )P(d |Mk )
k1
K
兺 P(d |M ) k
k
(6.6)
k1
where k 0 and k k 1 and Mk is the model for cluster k. Mixture distributions provide a flexible way for modeling complex distributions, combining together simple building-blocks, such as Gaussian distributions. The Lagrangian associated with the log-likelihood and the normalization constraints on the mixing coefficients is given by L
N
兺
冢兺 K
log
i1
冣 冢 兺 冣
kP(di |Mk )
k1
K
k1
(6.7)
k1
with the corresponding critical equation N L P(di |Mk ) 0 k i1 P(di )
兺
(6.8)
Multiplying each critical equation by k and summing over k immediately yields the value of the Lagrange multiplier N. Multiplying again the critical equation across by P(Mk) k , and using Bayes’ theorem in the form P(Mk |di ) P(di |Mk )P(Mk )/P(di )
(6.9)
yields
*k
1 N
N
兺P(M |d ) k
i
(6.10)
i1
Thus the maximum likelihood estimate of the mixing coefficients for class k is the sample mean of the conditional probabilities that di comes from model k. Consider now that each model Mk has its own vector of parameters (wkj ). Differentiating the Lagrangian with respect to wkj gives N L k P(di |Mk ) wkj i1 P(di ) wkj
兺
(6.11)
Substituting Equation 6.9 in Equation 6.11 finally provides the critical equation N
兺 P(M |d ) k
i1
i
log P(di |Mk ) 0 wkj
(6.12)
for each k and j. The maximum likelihood equations for estimating the parameters are weighted averages of the maximum likelihood equations log P(di |Mk )/wkj 0
(6.13)
K-means, mixture models, and EM algorithm
87
arising from each point separately. As in Equation 6.10, the weights are the probabilities of membership of the di in each class. The maximum likelihood Equations 6.10 and 6.12 can be used iteratively to search for maximum likelihood estimates; this is in essence the EM algorithm. In the E step, the membership probabilities (hidden variables) of each data point are estimated for each mixture component. The M step is equivalent to K separate estimation problems with each data point contributing to the log-likelihood associated with each of the K components with a weight given by the estimated membership probabilities. Different flavors of the same algorithm are possible depending on whether the membership probabilities P(M|d ) are estimated in hard or soft fashion during the E step. The description of k-means given above corresponds to the hard version where these membership probabilities are either 0 or 1, each point being assigned to only one cluster. This is analogous to the use of the Viterbi version of the EM algorithm for hidden Markov models, where only the optimal path associated with a sequence is used, rather than the family of all possible paths. Different variations are also possible during the M step of the algorithms depending, for instance, on whether the parameters wkj are estimated by gradient descent or by solving Equation 6.12 exactly. It is well known that the center of gravity of a set of points minimizes its average quadratic distance to any fixed point. Therefore in the case of a mixture of spherical Gaussians, the M step of the k-means algorithm described above maximizes the corresponding quadratic log-likelihood and provides a maximum likelihood estimate for the center of each Gaussian component. It is also possible to introduce prior distributions on the parameters of each cluster and/or the mixture coefficients and create more complex hierarchical mixture models. PCA, hierarchical clustering, k-means, as well as other clustering and data analysis algorithms are currently implemented in several publicly or commercially (Table 6.1) available software packages for DNA array data analysis. It is important to recognize that many software packages will output some kind of answer, for instance a set of clusters, on any kind of data set. These answers should not be trusted always blindly. Rather it is wise practice, whenever possible, to track down the assumptions underlying each algorithm/implementation/package and to run the same algorithms with different parameters, as well as different algorithms, on the same data set, as well as on other data sets.
Win
Win
Web-based
Web-based
Web-based sources GeneMaths
CyberT
R Cluster
Win Mac Unix Win Unix Win
Platform
Data Mining Tool
GeneSight 2.1
Spotfire
Commercial sources GeneSpring 4.1
Program
UCI
UCI
Applied Maths
Affymetrix
Biodiscovery
Spotfire
Silicon Genetics
Provider name
www.genomics.uci.edu
www.genomics.uci.edu
www.applied-maths.com
www.affymetrix.com
www.biodiscovery.com
www.spotfire.com
www.sigenetics.com
Web address
Table 6.1. Commercially available software packages for DNA array data analysis
Hierarchical clustering, k-means, SOM, PCA, discrimination analysis with or without variance t-test or t-test with Bayesian framework Hierarchical clustering, k-means
t-test, hierarchical clustering, k-means, SOM, PCA, class predictor, experiment tree t-test, PCA, k-means, hierarchical clustering t-test, k-means, hierarchical clustering, SOM, PCA, pattern similarity search, non-linear normalization t-test, Mann–Whitney test, SOM, modified Pearson’s correlation coefficient
Types of functions
Linux Unix Mac Win Unix Win
SVM 1.2
GeneCluster
Xcluster
Win
Win
Cluster and TreeView
Significance analysis of microarray (SAM) dChip
Whitehead Institute/MIT
Stanford University/ Berkeley (Eisen) Columbia University (Noble) Stanford University (Sherlock)
Harvard University (Wong)
Stanford University
Molmine
Mac Win Unix Win
Freeware sources J-Express
European
Bioinformatic Institute
Web-based
EPCLUST/ means Expression Profiler
http://www.genome.wi.mit. edu/MPR
www.cs.columbia.edu/ ~noble/svm/doc/ genome-www.stanford. edu/ ~sherlock/cluster.Html
rana.lbl.gov/Eisen Software.htm
www-statclass.stanford.edu/SAM/ SAMServlet www.biostat.harvard.edu/ complab/dchip/dchip.exe
www.molmine.com
www.ebi.ac.uk/microarray
SOM
SOM, k-means
Class prediction
t-test, model-based analysis for GeneChips™ Hierarchical clustering, k-means, PCA, SOM
Hierarchical clustering, k-means, PCA, SOM, profile similarity search
and finding the nearest neighbors
Hierarchical clustering, k-
90
Dimensionality reduction, clustering, and regulatory regions DNA arrays and regulatory regions
Another important level of analysis consists in combining DNA array data with DNA sequence data, and in particular with regulatory regions. This combination can be used to detect regulatory motifs, but also to address global questions of regulation. While gene regulatory elements have been found in a variety of regions including introns, distant intragenic regions, and downstream regions, the bulk of the regulation of a given gene is, in general, believed to depend primarily on a more or less extended region immediately upstream of the gene. In [34], for instance, this model was tested on a genomic scale by coupling expression data obtained during oxidative stress response with all pairwise alignments of yeast ORF upstream regions. In particular, it was found that as the difference in upstream regions increases, the correlation in activity rapidly drops to zero and that divergent ORFs, with overlapping upstream regions, do not seem to have correlated expression levels. By and large, however, the majority of current efforts aimed at combining DNA array and sequence data are focused on searching for regulatory motifs. Several techniques have been developed for the discovery of “significant” patterns from a set of unaligned DNA sequences. Typically these patterns represent regulatory (transcription factor DNA binding sites) or structural motifs that are shared in some form by the sequences. The length and the degeneracy of the pattern are of course two important parameters [35, 36, 37]. Probabilistic algorithms such as EM and Gibbs sampling naturally play an essential role in motif finding, due to both the structural and location variability of motifs (see programs such as MEME and CONSENSUS). Simple measures of overrepresentation also have been shown to be effective for detecting such motifs, for instance in sets of gene-upstream or gene-downstream [38] regions. While these data mining algorithms can be applied using a purely combinatorial approach to genomic DNA [39, 40], the methods and results can be further refined, and the sensitivity increased, by focusing the search on specific clusters of genes derived from array data analysis, such as clusters of genes that appear to be co-regulated. In addition to regulatory motifs found in the TRANSFAC database [41], these methods can detect novel motifs in the large amounts of more or less unannotated genomic DNA that has become available through genome and other sequencing projects [34, 42, 43, 44, 45, 46]. The basic idea behind these approaches is to compute the number of occurrences of each k-mer, typically for values of k in the range of 3 to 10,
DNA arrays and regulatory regions
91
within a set of sequences, such as all gene-upstream regions, or all the upstream regions of a particular set of co-regulated genes, and look for kmers that are overrepresented. Overrepresentation is a statistical concept that can be assessed in a number of different ways and, depending on the problem, a number of points must be carefully considered. These include: • Regions: How are the upstream, or downstream, regions defined? Do they have fixed length? How are they treated with respect to neighboring genes on each strand and possible overlaps? • Counts: Are the two strands treated separately or aggregated? It is well known, for instance, that certain regulatory motifs are active regardless of the strand on which they occur and these are better detected if counts on both strands are aggregated. Other motifs are strand-specific. • Background model: overrepresentation must be assessed with respect to a statistical background model. The choice of the background model is critical and non-trivial. In particular the background model cannot be too good otherwise it would predict the counts exactly and therefore would be worthless. Typical models used in the literature are Markov models of various orders, measured on the data or some other reference set. Another possible background model, is to consider the average of single (or multiple) base pair mismatches [45], i.e., to estimate the counts of a given k-mer using the counts of all the k-mers that differ in one position. • Statistics: Several statistics can be used to detect significant overrepresentation from the raw counts, such as ratio, log-likelihood, z-score binomial, t-test, Poisson, and compound Poisson. As in the case of array data, inference based on ratio alone can be tricky, especially for low expected frequencies that can induce false positives (e.g., 1 versus 4 is very different from 1000 versus 4000). • Gene clusters: If the method is applied to the DNA sequences associated with a cluster of genes derived from array data, how is the cluster determined? Are the genes up- or down-regulated under a given condition? Etc. Notice also that array data can be used as a filter to detect overrepresentation before or after the counts, often yielding somewhat different results. Overrepresented k-mers are of particular interest and have been shown to comprise well-known regulatory motifs. For instance, when the algorithms are run on the yeast upstream regions using oxidative stress data, one immediately detects the well-known stress element CCCCT [47] and its reverse complement AGGGG, or the YAP1 element TTACTAA and its reverse complement TTAGTAA [48, 49, 50]. In general, however, only a
92
Dimensionality reduction, clustering, and regulatory regions GCGATGAGC 8
Number of occurrences
6
4
2
0
2
4
6 500
450
400
350
300
250
200
150
100
50
0
Upstream position
Figure 6.4. Distribution of the occurrences of the overrepresented 9-mer GCGATGAGC and its reverse complement (mirror histogram) across all 500 bp geneupstream regions in yeast. C0 is the total number of occurrences. C1 represents the total number of occurrences of all the 2739 9-mers that differ in only one position from the 9-mer (background model). Under this model, the 9-mer is over sixfold overrepresented.
fraction of the putative motifs detected by these techniques nowadays are typically found also in the TRANSFAC [41] database, or in the current literature, and most must await future experimental verification. In the meantime, overrepresented motifs can be further studied in terms of their patterns of localization and co-occurrence within, for instance, upstream regions and/or their DNA structure. Non-uniform patterns of localization, for instance, can be indicative of biological function. An example of localization pattern is given in Figure 6.4 for the overrepresented 9-mer GCGATGAGC in yeast. When one looks at the 500bp upstream regions of all the genes in yeast, this 9-mer and its reverse complement GCTCATCGC have roughly symmetric distributions with a noticeable peak 50 to 150 bp upstream from the genes they seem to regulate [39, 44, 45]. As far as DNA
DNA arrays and regulatory regions
93
structure is concerned, it can be analyzed to some extent by using some of the available DNA physical scales [45, 51, 52] (e.g., bendability, propeller twist) and DNA–protein co-crystal structures available in the Protein Data Bank [53]. Typical overrepresented k-mers that have peculiar structural properties include runs of alternating AT which are identical to their own reverse complement and correspond to highly bent or bendable DNA regions (such as the TATA box) or, at the opposite end of the structural spectrum, runs of As or runs of Ts which tend to be very stiff. All together, these techniques are helping inferential and other data mining efforts aimed at unraveling the “language” of regulatory regions. A somewhat orthogonal approach described in [54] computes for each motif the mean expression profile over a set of array experiments of all the genes that contain the motif in their transcription control regions. These profiles can be useful for visualizing the relationship between genome sequence and gene expression data, and for characterizing the transcriptional importance of specific sequence motifs. Detection of gene expression differences, clusters of co-regulated genes, and/or gene regulatory motifs are essential steps towards the more ambitious and long-term goal of inferring regulatory networks on a global scale, or even along more specific subcomponents [55, 56, 57] such as a pathway or a set of co-regulated genes. These are the topics of Chapter 8. 1. Baldi, P., and Brunak, S. Bioinformatics: The Machine Learning Approach, 2nd edn. 2001. MIT Press, Cambridge, MA. 2. Alter, O., Brown, P. O., and Botstein, D. Singular value decomposition for genone-wide expression data processing and modeling. 2000. Proceedings of the National Academy of Sciences of the USA 97:10101–10106. 3. Baldi, P., and Hornik, K. Neural networks and principal component analysis: learning from examples without local minima. 1988. Neural Networks 2:53–58. 4. Roweis, S. EM algorithm for PCS and SPCA. In M. I. Jordan, M. J. Kearns, and S. A. Solla, editors, Advances in Neural Information Processing Systems, vol. 10, pp. 626–632. 1998. MIT Press, Cambridge, MA. 5. Scholkopf, B., Smola, A., and Mueller, K. R. Nonlinear component analysis as a kernal eigenvalue problem. 1998. Neural Computation 10:1299–1319. 6. Bishop, C. M. Bayesian PCA. In M. S. Kearns, S. A. Solla, and D. A. Cohn, editors, Advances in Neural Information Processing Systems, vol. 11, pp. 382–388. 1999. MIT Press, Cambridge, MA. 7. Hand, D., Mannila, H., and Smyth, P. 2001. MIT Press, Cambridge, MA. 8. Eisen, M. B., Spellman, P. T., Brown, P. O., and Botstein, D. Cluster analysis and display of genome-wide expression patterns. 1998. Proceedings of the National Academy of Sciences of the USA 95:14863–14868. 9. Alon, U., Barkai, N., Notterman, D. A., Gish, K., Ybarra, S., Mack, D., and Levine, A. J. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays.
94
10. 11.
12.
13.
14.
15. 16.
17.
18. 19. 20.
21.
22.
23.
Dimensionality reduction, clustering, and regulatory regions 1999. Proceedings of the National Academy of Sciences of the USA 96:6745–6750. Heyer, L. J., Kruglyak, S., and Yooseph, S. Exploring expression data: identification and analysis of co-expressed genes. 1999. Genome Research 9:1106–1115. Tamayo, P., Slonim, D., Mesirov, J., Zhu, Q., Kitareewan, S., Dmitrovsky, E., Lander, E. S., and Golub, T. R. Interpreting patterns of gene expression with self-organizing maps: methods and application to hematopoietic differentiation. 1999. Proceedings of the National Academy of Sciences of the USA 96:2907–2912. Brown, M. P. S., Grundy, W. N., Lin, D., Cristianini, N., Walsh Sugnet, C., Ares, M. Jr., Furey, T. S., and Haussler, D. Knowledge-based analysis of microarray gene expression data by using support vector machines. 2000. Proceedings of the National Academy of Sciences of the USA 97:262–267. Sharan, R., and Shamir, R. CLICK: a clustering algorithm with applications to gene expression analysis. In Proceedings of the 2000 Conference on Intelligent Systems for Molecular Biology (ISMB00), La Jolla, CA, pp. 307–316. 2000. AAAI Press, Menlo Park, CA. Cheng, Y., and Church, G. M. Biclustering of expression data. In Proceedings of the 2000 Conference on Intelligent Systems for Molecular Biology (ISMB00), La Jolla, CA, pp. 93–103. 2000. AAAI Press, Menlo Park, CA. Xing, E. P., Jordan, M. I., and Karp, R. M. Feature selection for highdimensional genomic microarray data. Furey, T. S., Christianini, N., Duffy, N., Bednarski, D. W., Schummer, M., and Haussler, D. Support vector machine classification and validation of cancer tissue samples using microarray expression data. 2000. Bioinformatics 16:906–914. Golub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., Bloomfield, C. D., and Lander, E. S. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. 1999. Science 286:531–537. Alizadeh, A., Eisen M., et al. Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling. 2000. Nature 403:503–510. Poustka, A., von Heydebreck, A., Huber, W., and Vingron, M. Identifying splits with clear separation: a new class discovery method for gene expression data. 2001. Bioinformatics 17 (Supplement 1):S107–S114. Tamayo, P., Mukherjee, S., Rifkin, R. M., Angelo, M., Reich, M., Lander, E., Mesirov, J., Yeang, C. H., Ramaswamy, S., and Golub, T. Molecular classification of multiple tumor types. 2001. Bioinformatics 17 (Supplement 1):S316–S322. Tishby, N., Pereira, F., and Bialek, W. The information bottleneck method. In B. Hajek and R. S. Sreenivas, editors, Proceedings of the 37th Annual Allerton Conference on Communication, Control, and Computing, pp. 368–377. 1999. University of Illinois. Tishby, N., and Slonim, N. Data clustering by Markovian relaxation and the information bottleneck method. In T. Leen, T. Dietterich, and V. Tresp, editors, Neural Information Processing Systems (NIPS 2000), vol. 13. 2001. MIT Press, Cambridge, MA. Slonim, N., and Tishby, N. The power of word clustering for text classification. In Proceedings of the European Colloquium on IR Research, ECIR 2001. 2001.
DNA arrays and regulatory regions
95
24. Blatt, M., Wiseman, S., and Domany, E. Super-paramagnetic clustering of data. 1996. Physical Review Letters 76:3251–3254. 25. Buhmann, J., and Kuhnel, H. Vector quantization with complexity costs. 1993. IEEE Transactions on Information Theory 39:1133–1145. 26. Eppstein, D. Fast hierarchical clustering and other applications of dynamic closest pairs. In Proceedings of the 9th ACM-SIAM Symposium on Discrete Algorithms, pp. 619–628. 1998. 27. Spellman, P. T., Sherlock, G., Zhang, M. Q., Iyer, V. R., Anders, K., Eisen, M. B., Brown, P. O., Botstein, D., and Futcher, B. Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization. 1998. Molecular Biology of the Cell 9:3273–3297. 28. Bar-Joseph, Z., Gifford, D. K., and Jaakkola, T. S. Fast optimal leaf ordering for hierarchical clustering. 2001. Bioinformatics 17 (Supplement 1):S22–S29. 29. Duda, R. O., and Hart, P. E. Pattern Classification and Scene Analysis. 1973. Wiley, New York. 30. Everitt, B. S. An Introduction to Latent Variable Models. 1984. Chapman & Hall, London. 31. Titterington, D. M., Smith, A. F. M., and Makov, U. E. Statistical Analysis of Finite Mixture Distributions. 1985. Wiley, New York. 32. Dempster, A. P., Laird, N. M., and Rubin, D. B. Maximum likelihood from incomplete data via the EM algorithm. 1977. Journal of the Royal Statistical Society B39:1–22. 33. Baldi, P. On the convergence of a clustering algorithm for protein-coding regions in microbial genomes. 2000. Bioinformatics 16:367–371. 34. Hampson, S., Baldi, P., Kibler, D., and Sandmeyer, S. Analysis of yeast’s ORFs upstream regions by parallel processing, microarrays, and computational methods. In Proceedings of the 2000 Conference on Intelligent Systems for Molecular Biology (ISMB00), La Jolla, CA, pp. 190–201. 2000. AAAI Press, Menlo Park, CA. 35. Pevzner, P. A., and Sze, S. Combinatorial approaches to finding subtle signals in DNA sequences. In Proceedings of the 2000 Conference on Intelligent Systems for Molecular Biology (ISMB00), La Jolla, CA, pp. 269–278. 2000. AAAI Press, Menlo Park, CA. 36. Pevzner, P. A. Computational Molecular Biology: An Algorithmic Approach. 2000. MIT Press, Cambridge, MA. 37. Mauri, G., Pavesi, G., and Pesole, G. An algorithm for finding signals of unknown length in DNA. 2001. Bioinformatics 17 (Supplement 1):S207–S214. 38. van Helden, J., del Olmo, M., and Perez-Ortin, J. E. Statistical analysis of yeast genomic downstream sequences reveals putative polyadenylation signals. 2000. Nucleic Acids Research 28:1000–1010. 39. Brazma, A., Jonassen, I. J., Vilo, J., and Ukkonen, E. Predicting gene regulatory elements in silico on a genomic scale. 1998. Genome Research 8:1202–1215. 40. van Helden, J., Andre, B., and Collado-Vides, J. Extracting regulatory sites from the upstream region of yeast genes by computational analysis of oligonucleotide frequencies. 1998. Journal of Molecular Biology 281:827–842. 41. Wingender, E., Chen, X., Fricke, E., Geffers, R., Hehl, R., Liebich, I., Krull, M., Matys, V., Michael, H., Ohnhauser, R., Pruss, M., Schacherer, F., Thiele, S., and Urbach, S. The TRANSFAC system on gene expression regulation. 2001. Nucleic Acids Research 29:281–284.
96
Dimensionality reduction, clustering, and regulatory regions
42. Vilo, J., and Brazma, A. Mining for putative regulatory elements in the yeast genome using gene expression data. In Proceedings of the 2000 Conference on Intelligent Systems for Molecular Biology (ISMB00), La Jolla, CA, pp. 384–394. 2000. AAAI Press, Menlo Park, CA. 43. Bussemaker, H. J., Li, H., and Siggia, E. D. Building a dictionary for genomes: identification of presumptive regulatory sites by statistical analysis. 2000. Proceedings of the National Academy of Sciences of the USA 97:10096–10100. 44. Hughes, J. D., Estep, P. W., Tavazole, S., and Church, G. M. Computational identification of cis-regulatory elements associated with groups of functionally related genes in Saccharomyces cerevisiae. 2000. Journal of Molecular Biology 296:1205–1214. 45. Hampson, S., Kibler, D., and Baldi, P. Distribution patterns of locally overrepresented k-mers in non-coding yeast DNA. 2002. Bioinformatics 18:513–528. 46. Blanchette, M., and Sinha, S. Separating real motifs from their artifacts. 2001. Bioinformatics 17 (Supplement 1):S30–S38. 47. Martinez-Pastor, M. T., Marchler, G., Schuller, C., Marchler-Bauer, A., Ruis, H., and Estruch, F. The Saccharomyces cerevisiae zinc finger proteins MSN2p and Msn4p are required for transcriptional induction through the stress-response element (STRE). 1996. EMBO Journal 15:2227–2235. 48. Wu, A. L., and Moye-Rowley, W. S. GSH1 which encodes gammaglutamylcysteine synthetase is a target gene for YAP-1 transcriptional regulation. 1994. Molecular and Cellular Biology 14:5832–5839. 49. Fernandes, L., Rodrigues-Pousada, C., and Struhl, K. Yap, a novel family of eight bzip proteins in Saccharomyces cerevisiae with distinct biological functions. 1997. Molecular and Cellular Biology 17:6982–6993. 50. Coleman, S. T., Epping, E. A., Steggerda, S. M., and Moye-Rowley, W. S. Yap1p activates gene transcription in an oxidant-specific fashion. 1999. Molecular and Cellular Biology 19:8302–8313. 51. Baldi, P., and Baisnée, P.-F. Sequence analysis by additive scales: DNA structure for sequences and repeats of all lengths. 2000. Bioinformatics 16:865–889. 52. Gorm Pedersen, A., Jensen, L. J., Brunak, S., Staerfeldt, H. H., and Ussery, D. W. A DNA structural atlas for Escherichia coli. 2000. Journal of Molecular Biology 299:907–930. 53. Steffen, N. R., Murphy, S. D., Tolleri, L., Wesley Hatfield, G., and Lathrop, R. H. DNA sequence and structure: Direct and indirect recognition in protein–DNA binding. In Proceedings of the 2002 Conference on Intelligent Systems for Molecular Biology (ISMB02). (2002). (in press) 54. Brown, P. O., Chiang, D. Y., and Eisen, M. B. Visualizing associations between genome sequences and gene expression data using genome-mean expression profiles. 2001. Bioinformatics 17 (Supplement 1):S49–S55. 55. van Someren, E. P., Wessels, L. F. A., and Reinders, M. J. T. Linear modeling of genetic networks from experimental data. In Proceedings of the 2000 Conference on Intelligent Systems for Molecular Biology (ISMB00), La Jolla, CA, pp. 355–366. 2000. AAAI Press, Menlo Park, CA. 56. Friedman, N., Linial, M., Nachman, I., and Pe’er, D. Using Bayesian networks to analyze expression data. 2000. Journal of Computational Biology 7:601–620. 57. Zien, A., Kuffner, R., Zimmer, R., and Lengauer, T. Analysis of gene expression data with pathway scores. In Proceedings of the 2000 Conference on Intelligent Systems for Molecular Biology (ISMB00), La Jolla, CA, pp. 407–417. 2000. AAAI Press, Menlo Park, CA.
7 The design, analysis, and interpretation of gene expression profiling experiments
A long-term goal of systems biology, to be discussed in Chapter 8, is the complete elucidation of the gene regulatory networks of a living organism. Indeed, this has been a Holy Grail of molecular biology for several decades. Today, with the availability of complete genome sequences and new genomic technologies, this goal is within our reach. As a first step, DNA microarrays can be used to produce a comprehensive list of the genes involved in defined regulatory sub-circuits in well-studied model organisms such as E. coli. In this chapter we describe the use of DNA microarrays to identify the target genes of regulatory networks in E. coli controlled by global regulatory proteins that allow E. coli cells to respond to their nutritional and physical environments. We begin by describing the design and analysis of experiments to examine differential gene expression profiles between isogenic strains differing only by the presence or absence of a single global regulatory protein which controls the expression of a gene regulatory circuit (regulon) composed of many operons. Before we can identify the genes of any given regulatory circuit we need to be able to measure their behaviors with accuracy and confidence under various treatment conditions. However, because of the influences of experimental and biological errors inherent in high-dimensional DNA microarray experiments, discussed in Chapter 4, this is not a simple task. Therefore, much of the material of this chapter is devoted to the application and validation of statistical methods introduced in Chapters 5 and 6 to address these fundamental problems. In particular: we describe methods to locate sources of errors and estimate their magnitudes, including global false positive levels; we use data obtained from our experiments to show that the employment of the Bayesian framework described in Chapter 5 allows the identification of differentially expressed genes with a higher level of confidence with fewer replications; and we demonstrate that consistent inferences can 97
98
Design, analysis, and interpretation of experiments
be made from data obtained from different DNA microarray formats such as pre-synthesized nylon filter arrays and in situ synthesized Affymetrix GeneChips™. In sum, we employ a model system to show that appropriate applications of statistical methods allow the discovery of genes of complex regulatory circuits with a high level of confidence. We have chosen to use experiments performed with E. coli for the discussions of this chapter both because of our own scientific interests and because this model organism offers several advantages for the evaluation of DNA array technologies and data analysis methods that are applicable to gene expression profiling experiments performed with all organisms. Foremost among these advantages is the fact that 50 years of work with E. coli have produced a wealth of information about its operon-specific and global gene regulation patterns. This information provides us with a “gold standard” which makes it possible to evaluate the accuracy of data obtained from DNA array experiments, and to identify data analysis methods that optimize the identification of genes differentially expressed because of biological reasons from false positives (genes that appear to be differentially expressed due to chance occurrences exacerbated by experimental error and biological variance). The knowledge we have gained through these analyses with this well-defined model organism gives us confidence that these methods are equally applicable to other less well-defined systems. Indeed, Jacques Monod is credited with saying that “What is true for E. coli is true for elephants, only more so.” In the second half of this chapter, we turn our attention to the identification of more complex gene expression patterns involving groups of genes that behave similarly in time and/or across different treatment conditions. In these cases, we emphasize that robustness can be achieved by averaging out noise either by experiment replication with a limited number of treatment conditions or by measuring many samples across time, genotypes, etc. To illustrate this point we describe two different types of experiments. In the first example, we describe experiments that measure the gene expression patterns of E. coli cells grown under three different treatment conditions, in the presence and absence of oxygen, and in the presence and absence of a global regulatory protein for genes of anaerobic metabolism in the absence of oxygen. With these experiments we show that, when only three samples (two treatment conditions) are measured, individual experiment replication is required for accurate clustering of genes with similar regulatory patterns. In the second example, we describe experiments that measure the effects of 188 drugs on the expression patterns of 1376 genes in 60 cancer cell line samples. In this case, where 60 samples are measured under 188 conditions,
Experimental design
99
we demonstrate that direct applications of clustering methods to entire data sets reveal robust gene regulatory patterns in the absence of individual experimental replications.
Experimental design Many experimental designs and applications of gene expression profiling experiments are possible. However, no matter what the purpose of the experiment, a sufficient number of measurements must be obtained for statistical analysis of the data, either through multiple measurements of homogeneous samples (replication) or multiple sample measurements (e.g., across time or subjects). This is basically because each gene expression profiling experiment results in the measurement of the expression levels of thousands of genes. In such a high-dimensional experiment, many genes will show large changes in expression levels between two experimental conditions without being significant. These false positives arise from chance occurrences caused by uncontrolled biological variance as well as experimental and measurement errors. Experimental errors include variations in procedures involved in growing and harvesting cultures or obtaining biological samples discussed in Chapter 4. These errors can be minimized by appropriate experimental design and technical procedures. On the other hand, biological variance is more difficult to control. Even when two cultures of organisms with identical genotypes are grown under the same conditions differences in gene expression profiles are detected. In addition to these false positives, differentially expressed genes that may not be related to the experimental conditions will be detected when targets prepared from cells of different genotypes or even different tissues of the same genotype are queried. On top of these sources of errors, the quality of DNA microarray data can vary even further depending upon the type of the array and the array manufacturing methods and quality. With these considerations in mind, we employed the general design described below for the E. coli experiments of this chapter. The purpose of the first experiment is to identify the network of genes that are regulated by the global E. coli regulatory protein, leucine-responsive regulatory protein (Lrp). Lrp is a global regulatory protein that affects the expression of multiple genes and operons. In most cases, Lrp activates operons that encode genes for biosynthetic enzymes and represses operons that encode genes for catabolic enzymes. Interestingly, the intermediary metabolite, -leucine, is required for the binding of Lrp at some of its DNA
100
Design, analysis, and interpretation of experiments
target sites; however, at other sites -leucine inhibits DNA binding, and at yet other sites it exerts no effect at all. While the expression level of about 75 genes have been reported to be affected by Lrp under different environmental and nutritional growth conditions, its specific role in the regulation of cellular metabolism remains unclear. It has been suggested that it might function to coordinate cellular metabolism with the nutritional state of the environment by monitoring the levels of free -leucine in the cell. In spite of the fact that much remains to be learned about the Lrp regulatory network, its many characterized target genes make it an ideal system for the development and assessment of statistical methods for the identification of differentially expressed genes. As these methods are developed and as a better understanding of the gene network regulated by this important protein emerges, a clearer view of its physiological purpose will surely follow. The experimental design for our Lrp experiment consists of four independent experiments, each performed in duplicate, diagrammed in Figure 4.1. In Experiment 1, Filters 1 and 2 were hybridized with 33P-labeled, random-hexamer-generated, cDNA fragments complementary to each of three RNA preparations (Lrp RNA1–3) obtained from the cells of three individual cultures of strain IH-G2490 (Lrp ) These three 33P-labeled, cDNA preparations were pooled prior to hybridizations. Following phosphorimager analysis, these filters were stripped and hybridized with pooled, 33 P-labeled cDNA fragments complementary to each of three RNA preparations (Lrp RNA1–3) obtained from strain IH-G2491 (Lrp). In Experiment 2, these same filters were again stripped and this protocol was repeated with 33P-labeled cDNA fragments complementary to another set of three pooled RNA preparations obtained from strains IH-G2490 (Lrp RNA 4–6) and IH-G2491 (Lrp RNA 4–6) as described above. Another set of filters (Filter 3 and Filter 4) was used for Experiments 3 and 4 as described for Experiments 1 and 2. This protocol results in duplicate filter data for four experiments performed with four independently prepared cDNA target sets. Thus, since each filter contains duplicate spots for each ORF and duplicate filters are hybridized for each experiment, four measurements for each ORF are obtained from each of four experiments [1].
Identification of differentially expressed genes To identify genes regulated by Lrp, the four background subtracted and globally normalized (Lrp ) or (Lrp) measurements for each ORF from the control or experimental filters of each of the four experiments dia-
Sources of errors
101
Table 7.1. Distribution of genes with lowest p-values from a comparison of Lrp and Lrp (control vs. experimental) E. coli strains p-value
Number of genes
0.0001 0.0005 0.001 0.005 0.01
12 30 44 134 208
grammed in Figure 4.1 were averaged and compared to one another. A t-test analysis of this four-by-four comparison was carried out and the genes were ranked in ascending order of the p-values for each gene measurement based on the t-test distribution (Table 7.1). The 44 genes differentially expressed with a p-value less than 0.001 are shown in Table 7.2.
Determination of the source of errors in DNA array experiments While we can be most confident that these genes exhibiting the lowest p-values are differentially expressed between the Lrp and Lrp strains, we also expect false positives – genes that appear to be differentially expressed by chance occurrences driven by experimental and biological variables – even among these genes. Thus, we need some method of determining genes that exhibit low p-values by chance given a large number of individual measurements, and we need some method of determining the biological and experimental error inherent in each gene expression level measurement. For this reason, the experimental strategy described above was designed to include a sufficient number of replicate experiments for statistical estimation of the magnitude of the errors contributed by each of these variables. To estimate the magnitude of errors contributed by differences between filters or among RNA preparations we can determine the reproducibility of results obtained from different arrays hybridized with the same target preparations, or from different target preparations hybridized to the same arrays, respectively.
102
Design, analysis, and interpretation of experiments
Table 7.2. Genes differentially expressed between Lrp and Lrp (control vs. experimental) E. coli strains with a p-value less than 0.001 Gene name a
Control (mean)
Experimental (mean)
Control (SD)
Experi -mental (SD)
p-value
PPDE
yecI uvrA gdhA oppB* b2343 artP b1810 oppC* gltD* b1330 uup oppA* malE* oppD* galP lysU* hybA hybC yhcB yifM_2 ilvG* grxB phoP ydjA ydaA yddG emrA b1685 glpA manA ybeD cfa b3914 ybiK yggB amn b1976 speB hdeA pheA gst proC sdaC* SerA*
3.11E-05 1.28E-03 9.16E-05 7.51E-05 2.82E-05 6.73E-05 1.07E-04 2.01E-04 5.28E-04 1.07E-04 2.02E-04 1.62E-03 3.56E-04 8.97E-05 3.75E-04 1.81E-04 3.53E-04 3.54E-04 4.25E-05 1.12E-04 4.21E-04 5.95E-05 8.29E-05 1.10E-04 2.61E-04 1.77E-04 3.58E-04 3.71E-05 1.28E-04 8.71E-05 1.13E-04 2.89E-04 6.23E-05 2.03E-04 1.73E-04 4.31E-04 1.30E-04 1.21E-04 2.40E-04 9.11E-05 3.44E-06 1.76E-04 1.82E-04 2.90E-03
8.48E-05 1.04E-03 2.73E-04 1.14E-03 1.02E-04 4.23E-04 2.32E-04 1.08E-03 2.74E-05 1.58E-04 1.60E-04 3.16E-02 2.01E-04 6.55E-04 2.11E-04 1.24E-03 2.47E-04 2.34E-04 6.84E-05 6.74E-05 9.15E-04 3.38E-04 2.10E-04 1.79E-04 4.88E-04 3.25E-04 2.78E-04 2.64E-04 8.01E-05 2.40E-04 4.01E-04 4.89E-04 1.97E-04 2.76E-04 4.50E-04 6.51E-04 1.77E-04 3.56E-05 8.29E-04 3.41E-04 7.24E-05 6.04E-05 9.71E-05 6.56E-04
3.35E-06 1.15E-05 1.52E-05 2.12E-05 3.75E-06 1.24E-05 3.65E-06 2.34E-05 1.28E-04 5.44E-06 6.65E-06 7.63E-04 2.32E-05 2.76E-05 2.25E-05 7.48E-05 2.11E-05 2.20E-05 2.84E-06 5.35E-06 7.55E-05 1.92E-05 1.20E-05 1.26E-05 3.53E-05 2.52E-05 2.43E-05 1.20E-05 8.54E-06 2.16E-05 1.70E-05 2.83E-05 8.70E-06 1.50E-05 3.57E-05 4.47E-05 1.21E-05 2.09E-05 8.46E-05 3.78E-05 4.05E-06 5.17E-05 2.02E-05 1.14E-03
7.49E-06 3.37E-05 2.16E-05 3.79E-04 1.92E-05 1.16E-04 3.20E-05 3.61E-04 1.42E-05 9.60E-06 5.72E-06 1.03E-02 2.17E-05 2.05E-04 2.40E-05 2.78E-04 1.50E-05 1.81E-05 6.28E-06 7.61E-06 6.85E-05 1.07E-04 4.42E-05 1.06E-05 5.45E-05 3.37E-05 4.57E-06 1.22E-04 9.26E-06 4.08E-05 1.48E-04 6.08E-05 5.46E-05 1.47E-05 8.50E-05 4.72E-05 6.38E-06 1.08E-05 9.90E-05 4.17E-05 2.41E-05 6.99E-06 1.76E-05 1.12E-04
8.62E-06 1.70E-05 2.18E-05 2.48E-05 2.67E-05 3.60E-05 4.47E-05 5.44E-05 5.87E-05 7.16E-05 7.66E-05 8.45E-05 1.16E-04 1.16E-04 1.31E-04 1.44E-04 1.49E-04 1.61E-04 1.68E-04 1.81E-04 2.54E-04 2.92E-04 3.16E-04 3.54E-04 3.55E-04 3.84E-04 3.95E-04 4.13E-04 4.71E-04 4.80E-04 5.15E-04 5.16E-04 5.44E-04 5.78E-04 6.05E-04 6.07E-04 7.56E-04 7.73E-04 8.12E-04 8.36E-04 8.57E-04 8.89E-04 8.96E-04 1.00E-03
0.99516 2.73 0.99386 –1.23 0.99329 2.98 0.99298 15.12 0.99280 3.61 0.99200 6.28 0.99136 2.17 0.99074 5.38 0.99049 –19.27 0.98981 1.47 0.98956 –1.26 0.98920 19.44 0.98793 –1.78 0.98793 7.30 0.98740 –1.78 0.98697 6.87 0.98682 –1.43 0.98646 –1.51 0.98625 1.61 0.98589 –1.66 0.98411 2.17 0.98332 5.68 0.98285 2.54 0.98216 1.62 0.98214 1.87 0.98165 1.84 0.98147 –1.29 0.98118 7.10 0.98029 –1.59 0.98016 2.75 0.97967 3.55 0.97966 1.69 0.97928 3.16 0.97884 1.36 0.97850 2.61 0.97848 1.51 0.97677 1.36 0.97659 –3.40 0.97619 3.45 0.97595 3.75 0.97574 21.01 0.97543 –2.91 0.97536 –1.87 0.97405 -4.41
Note: a Known Lrp regulated genes are identified by an asterisk.
Fold
Global false positive level
103
To estimate the reproducibility between different filters, we employed a statistical t-test to compare data from each pair of filters hybridized with 33 P-labeled cDNA targets prepared from the same pooled RNA samples. For example, each normalized and background subtracted ORF measurement on Filter 1 (IH-G2490 (Lrp )) of Experiment 1 was compared to the data on Filter 2 (IH-G2490 (Lrp )) of Experiment 1 (Figure 4.1). Similar comparisons were made between filters hybridized with the same RNA preparations for Experiments 2, 3, and 4. This procedure was repeated for filter pairs hybridized with RNA preparations from the IH-G2491 (Lrp) strain. The results of these comparisons for the control (Lrp ) strain are shown in Table 7.3. Based on the t-test distribution, and in the absence of experimental error, 12 of the 2547 genes expressed at a level above background in all experiments should exhibit a p-value less than 0.005 based on chance alone (0.005254712). That is, at this level of measurement accuracy 12 false positives (genes that appear to be differentially expressed) out of the 2547 genes measured are expected, and experimental errors will increase this number of false positives to even higher levels. The data in Table 7.3 show that, in fact, an average of 43 genes with a p-value less than 0.005 is observed. This demonstrates that experimental errors introduced by differences between filters increase the global false positive level of this experiment about threefold beyond that expected by chance. The data in Table 7.3 demonstrate that even greater errors are introduced by differences among RNA preparations. In this case, the global false positive level expected from chance is elevated nearly tenfold. Thus, while some error is introduced by differences among filters, the major source of error is derived from differences among RNA preparations. These results illustrate the need to reduce experimental and biological differences among RNA preparations as much as possible. They also illustrate the advantage of pooling RNA preparations from independent samples for each experiment. For example, the RNA preparations used here were pooled from three independent cultures. However, when single RNA preparations were used, the false positive levels were more than twice the levels reported in Table 7.3.
Estimation of the global false positive level for a DNA array experiment The above results demonstrate the necessity of determining the global false positive level of a gene expression profiling experiment. The global false positive level reflects all sources of experimental and biological variation inherent in a DNA array experiment. With this information, a global level
Filter 1 of Exp. 1 vs. Exp. 2 Filter 2 of Exp. 1 vs. Exp. 2 Filter 3 of Exp. 3 vs. Exp. 4 Filter 4 of Exp. 3 vs. Exp. 4 False positive level observed (avg.) False positive level expected
3 3 8 1 4 0
2 1 0 3 2 0
Filter 1 vs.2 of Exp. 1 Filter 1 vs.2 of Exp. 2 Filter 3 vs.4 of Exp. 3 Filter 3 vs.4 of Exp. 4 False positive levels observed (avg.) False positive levels expected
Target Prep. Comparisons
p0.0001
Filter Comparisons
14 10 10 5 12 1
3 9 2 4 5 1
p0.0005
31 21 31 12 24 3
7 15 5 9 9 3
p0.001
113 126 131 75 111 12
38 57 31 47 43 12
p0.005
Table 7.3. False positive level elevations contributed by differences among filters and target preparations
224 215 230 163 208 25
59 119 68 96 86 25
p0.01
687 716 642 551 648 127
298 478 314 393 371 127
p0.05
Global false positive level
105
of confidence can be calculated for differentially expressed genes measured at any given statistical significance level. For example, consider the case where 10 genes are observed to be differentially expressed with a p-value less than 0.001 when control data is compared to control data, and 100 genes are differentially expressed with a p-value less than 0.001 when control data is compared to experimental data. In this case, since 10 false positives are expected from this data set it is reasonable to infer that we can be only 90% confident that the differential expression of any given gene in the set of 100 is biologically meaningful. This example demonstrates that although the confidence level based on the measurement for an individual gene may exceed 99.9% for two treatment conditions (local confidence 0.001), the confidence that this gene is differentially expressed might be only 90% (global confidence 0.9). This example defines an ad hoc method of comparing control to control data to derive an estimate of an experimentwide false positive level. An ad hoc empirical method To illustrate this ad hoc method for the estimation of false positive levels, we averaged the four measurements for each gene from the duplicate control filters of each experiment hybridized with labeled targets from the control strain (IH-G2490 (Lrp )). We compared these averaged values of the control data from Experiences 1 and 3 to the averaged values of Experiments 2 and 4. In another analysis, we compared the control data from Experiments 1 and 4 to the averaged values of Experiments 2 and 3. These particular two-by-two (control vs. control) comparisons were chosen because they average across experimental errors and biological differences both among filters and RNA preparations. A t-test analysis of the data from these comparisons was performed and the genes were ranked in ascending order of the p-values for each gene measurement based on the t-test distribution. The results of this statistical analysis are shown in Table 7.4. The data in Table 7.4 show that in the control vs. control data no genes exhibit a p-value less than 0.0001. However, an examination of the p-values observed when the control data are compared to the experimental data (Table 7.1) shows that six genes are differentially expressed with a p-value less than 0.0001. Thus, we can be fairly certain that these 12 genes are differentially expressed because of biological reasons and not by chance occurrence. This is the good news. The bad news is that we know more than 12 genes are regulated by Lrp. These results show us that, given the experimental errors inherent in this experiment, the differentially expressed levels of most genes cannot pass a statistical test as stringent as this. Thus, to identify
106
Design, analysis, and interpretation of experiments Table 7.4. Distribution of genes with lowest p-values from a comparison of Lrp to Lrp (control vs. control) E. coli strains p-value
Number of genes
0.0001 0.0005 0.001 0.005 0.01
0.0 0.25 1.00 3.75 7.25
other differentially expressed genes we must lower the stringency of our statistical criterion. The data in Table 7.1 show that as the p-value is raised to 0.005 we observe an additional 122 genes that are differentially expressed at this threshold level. At the same time, raising the statistical threshold to 0.005 reveals an average of 3.75 genes that appear differentially expressed with a p-value equal to or less than 0.005 when the control data sets are compared to one another (Table 7.4). This means that, given this complete data set from four replicate experiments, we expect at least 3.75 false positives among the 134 genes differentially expressed with a p-value equal to or less than 0.005. Therefore, our global confidence in the identification of any one of these 134 genes as differentially expressed genes is 97%. It should be emphasized that relaxing the p-value threshold rapidly increases the average number of false positives in the control (Lrp vs. Lrp ) data sets relative to the number of genes differentially expressed at the same p-value in the experimental (Lrp vs. Lrp) data set and, therefore, decreases the confidence with which differentially expressed genes can be identified. A computational method David Allison and colleagues have described a computational version of this ad hoc method for estimating the false positive level [2]. The basic idea is to consider the p-values as a new data set and to build a probabilistic model for this new data. When there is no change (i.e., no differential gene expression) it is easy to see that the p-values ought to have a uniform distribution between 0 and 1. In contrast, when there is change, the distribution
Global false positive level
107
Figure 7.1. Distribution of the p-values from the Lrp+ vs. Lrp data. The fitted model (dashed curve) is a mixture of one beta and a uniform distribution (dotted line).
of p-values will tend to cluster more closely to 0 than 1, i.e., there will be a subset of differentially expressed genes with “significant” p-values (Figure 7.1). One can use a mixture of beta distributions (Chapter 6 and Appendix B) to model the distribution of p-values in the form P(p)
K
兺 B(p; r , s ) i
i
i
(7.1)
i0
For i0, we use r0 s0 1 to implement the uniform distribution as a special case of a beta distribution. Thus K 1 is the number of components in the mixture and the mixture coefficients i represent the prior probability of each component. In many cases, two components (K1) are sufficient but some times additional components are needed. In general, the mixture model can be fit to the p-values using the EM algorithm, as in Chapter 6, or other iterative optimization methods to determine the values of , r, and s parameters. From the mixture model, given n genes, the estimate of the number of genes for which there is a true difference is n(1 0). Similarly, if we set a threshold T below which p-values are considered significant and representative of change, we can estimate the rates of false positives and false negatives. For instance, the false positive rate is given by
108
Design, analysis, and interpretation of experiments 1.2
1.0
100 genes
PPDE
0/8
0.6
0.4
0.2
0 10–11 10–10
10–9
10–8
10–7
10–6
10–5
10–4
10–3
10–2
10–1
1
p-value Figure 7.2. Relationship between posterior probability of differential expression (PPDE) and p-value. The dotted line correlates the number of genes differentially expressed with a PPDE of 0.95 that are measured with a p-value less than 0.0034.
P(p T no – change) P(p T)
0T 0T
兺 冮 K
i1
i
T
(7.2)
B(p; ri, si ) dp
0
The posterior probability for differential expression (PPDE) can then be calculated for each gene in the experiment with p-value p as K
PPDE P (change冟p)
兺 i1 K
兺 B(p; r , s ) i
i0
K
iB(p; ri, si ) i
i
兺 B(p; r , s ) i
i
i
i1
0
K
兺 B(p; r , s ) i
i
(7.3)
i
i1
The distribution of p-values from our Lrp vs. Lrp data is shown in Figure 7.1, and a plot of PPDE values vs. p-values is shown in Figure 7.2. A comparison of the ad hoc method for determining the global significance for the differential expression of a given gene and the computational method is presented in Table 7.5. It is satisfying to see that these data compare quite well.
Improved inference using a Bayesian statistical framework
109
Table 7.5. Determination of confidence level for differentially expressed genes
p-value
Number of genes (control vs. control)
Number of genes (control vs. experimental)
% Confidence (ad hoc)
Posterior probability of differential expression
0.0001 0.0005 0.001 0.005 0.01
0.00 0.25 1.00 3.75 7.25
12 30 44 134 208
100.00 99.2 97.7 97.2 96.5
0.989 0.980 0.975 0.955 0.944
Improved statistical inference from DNA array data using a Bayesian statistical framework Although there is no substitute for experimental replication, the confidence in the interpretation of DNA array data with a low number of replicates can be improved by using the Bayesian statistical approach developed in Chapter 5 which employs methods for robust estimate of variance. In this approach, the estimate of the variance of the expression level of a gene is improved by including the variance of additional genes in the neighborhood of the gene under consideration. In the implementation employed here, the neighborhood is defined in terms of genes with similar expression levels. More specifically, the variance of any gene within any given treatment can be estimated by the weighted average of the empirical variance of the gene calculated across experimental replicates and a gene-specific background variance estimated by pooling neighboring genes contained within a window of similar expression levels. Here the weight given to the background variance is a decreasing function of the number of experimental replicates. This leads to the desirable property that as additional replications are performed, the plain and regularized t-test converge on a common set of differentially expressed genes [3, 4]. Commonly used software packages for microarray data analysis do not possess algorithms for implementing Bayesian statistical methods. However, our statistical program, CyberT (Chapter 5 and Appendix D) does accommodate this approach. In the experiments described here, we use the statistical tools incorporated into CyberT to compare and analyze
110
Design, analysis, and interpretation of experiments
data from the gene expression profiling experiment with the E. coli IHG2490 (Lrp ) and IH-G2491 (Lrp) strains described above. Because the Lrp and Lrp gene expression profiling experiment described above was only replicated four times, and because it is known that the t-test does not perform well with a small number of replicate samples, we wished to determine if the identification of known differentially expressed genes could be improved by adding the Bayesian statistical framework of Chapter 5 to this statistical analysis. We therefore used the CyberT software to reanalyze the data from this experiment. Parameters values were set at ws101 (window size) and K10, corresponding to a neighborhood of 100 genes, and a total (experimental background) of 10 points per gene to estimate the variance (see Chapter 5). A comparison of the results of the analysis employing a simple t-test and a regularized t-test is shown in Table 7.6. The simple ad hoc method of comparing controls to controls can be used to demonstrate that the number of false positives expected at a given p-value is lower when the Bayesian statistical framework is employed. For example, only 2 false positives are expected at a p-value threshold less than 0.005 with the Bayesian regularization, whereas 3.75 false positives are expected at this same p-value threshold with the t-test alone. At the same time, 188 genes differentially expressed genes with a p-value less than 0.005 are observed with the regularized t-test, whereas only 134 genes are identified at this same threshold with the simple t-test (Table 7.6). Thus, since more genes are identified with a lower false positive level and a higher probability of differential expression, the confidence placed on these identifications is increased. In other words, complementing the empirical variance of the four experimental measurements for each gene with the corresponding background variance within an experiment improves our confidence in the identification of differentially expressed genes, and the number of genes that can be identified at a given p-value threshold base on a t-test distribution. While the data in Table 7.6 show that the Bayesian statistical approach using a regularized t-test identifies more genes with a higher level of global confidence than the simple t-test, the natural question that arises is whether these genes are true positives. That is, whether these are Lrp-regulated genes. This question is answered by the data shown in Figure 7.3. Of the 44 genes differentially expressed between Lrp and Lrp strains with a p-value less than 0.001 identified by a simple t-test, 10 are known to be Lrp-regulated (Table 7.2). However, among the 39 genes differentially
Number of genes (control vs. control)
0.0 0.25 1.00 3.75 7.25
p-value
0.0001 0.0005 0.001 0.005 0.01
12 30 44 134 208
Number of genes (control vs. experimental)
t-test
100 99.2 97.7 97.2 96.5
% Confidence 0.0001 0.0005 0.001 0.005 0.01
p-value 0.0 0.25 0.50 2.00 3.75
Number of genes (control vs. control)
39 62 79 188 268
Number of genes (control vs. experimental)
Regularized t-test
Table 7.6. Comparison of DNA array data analyzed with a simple t-test and a regularized t-test
100 99.6 99.4 98.9 98.6
% confidence
112
Design, analysis, and interpretation of experiments
(a)
(b)
(b)
Figure 7.3. Scatter plots showing the mean of the fractional mRNA levels obtained from eight filters hybridized with 33P-labeled cDNA targets prepared from three pooled RNA preparations extracted from E. coli K12 strains IH-G2490 (Lrp+) and IH-G2491 (Lrp). The larger black dots identify 100 genes differentially expressed between strains IH-G2490 and IH-G2491 with (A) p-values less than 0.004 and (B) p-values less than 0.002 based on a simple t-test distribution. The circled black dots identify genes known to be regulated by Lrp. The gray spots represent the relative expression levels of each of the 2885 genes expressed at a level above background in all experiments. The dashed lines demarcate the limits of twofold differences in expression levels.
Improved inference using a Bayesian statistical framework
113
expressed between Lrp and Lrp strains with a p-value less than 0.0001 identified by the Bayesian approach, 17 are known to be Lrp-regulated (Table 7.7). Why does the regularized t-test identify more Lrp-regulated genes? The answer lies in the fact that all the genes identified to be differentially expressed with a p-value less than 0.005 with the regularized t-test exhibit fold changes greater than 1.7-fold (Figure 7.3B). However, many genes identified to be differentially expressed with a p-value less than 0.005 with the simple t-test exhibit fold changes as small as 1.2-fold (Figure 7.3A). Furthermore, the 100 genes with the lowest p-values identified as differentially expressed by both methods contain only 43 genes in common. Thus, many of the genes identified by the simple t-test that are excluded by the Bayesian approach are genes that show small fold changes. In general, these genes with small fold changes identified by the simple t-test are associated with “too good to be true” within-treatment variance estimates, reflecting underestimates of the within-treatment variance when the number of observations is small. The elimination of this source of false positives by the Bayesian approach improves the identification of true positives. However, although this is desired, genes that are truly differentially expressed with small fold changes in the range of 1.2- to 1.7-fold will also be eliminated by the Bayesian approach. For example of the 16 genes of the top 100 with the lowest p-values identified by the simple t-test that are known to be regulated by Lrp, one was not identified by the Bayesian method. This Lrp-regulated gene that did not pass the regularized t-test was the sdaC gene, previously reported to be regulated by Lrp and measured to be regulated 1.9-fold in the experiment performed with the DNA arrays [5]. Nevertheless, although this gene is lost, the overall performance of the regularized t-test surpasses that of the simple t-test, and most researchers are interested in discovering genes that are differentially expressed with large fold changes. At first glance it might appear that the Bayesian approach validates the often-used 2-fold rule for the identification of differentially expressed genes. That is, the identification of genes differentially expressed between two experimental treatments with a fold change greater than 2 in, for example, three out of four experiments. This type of reasoning is based on the intuition that larger observed fold changes can be more confidently interpreted as a stronger response to the experimental treatment than smaller observed fold changes, which of course is not necessarily the case. An implicit assumption of this reasoning is that the variance among replicates within treatments is the same for every gene. In reality, the variance varies among genes (for example, see Figure D.3, Appendix D) and it is
Experimental (mean)
3.16E-02 1.24E-03 1.14E-03 1.08E-03 6.55E-04 6.56E-04 1.38E-03 1.47E-03 8.29E-04 1.47E-03 1.98E-03 1.83E-03 4.23E-04 5.80E-04 2.74E-05 9.15E-04 1.15E-04 4.01E-04 1.24E-04 1.80E-03
Control (mean)
1.62E-03 1.81E-04 7.51E-05 2.01E-04 8.97E-05 2.90E-03 2.36E-04 5.79E-05 2.40E-04 3.68E-04 3.99E-04 3.31E-04 6.73E-05 1.26E-04 5.28E-04 4.21E-04 4.16E-04 1.13E-04 4.05E-04 5.42E-04
Gene namea
oppA* lysU* oppB* oppC* oppD* serA* ftn rmf hdeA ilvPG::lacY*b hdeB ilvPG::lacA*b artP artI gltD* ilvG_1* livK* ybeD livH* uspA
7.63E-04 7.48E-05 2.12E-05 2.34E-05 2.76E-05 1.14E-03 1.29E-04 4.68E-05 8.46E-05 4.56E-05 2.58E-04 1.74E-04 1.24E-05 3.79E-05 1.28E-04 7.55E-05 1.47E-04 1.70E-05 8.18E-05 3.07E-04
Control (SD) 1.03E-02 2.78E-04 3.79E-04 3.61E-04 2.05E-04 1.12E-04 5.46E-04 3.35E-04 9.90E-05 8.10E-04 5.59E-04 7.48E-04 1.16E-04 2.80E-04 1.42E-05 6.85E-05 3.22E-05 1.48E-04 5.50E-05 7.43E-04
Experimental (SD) 5.14E-13 8.88E-10 1.02E-09 3.26E-09 2.69E-08 4.08E-08 2.27E-07 2.75E-07 2.99E-07 3.39E-07 4.50E-07 5.64E-07 1.42E-06 2.01E-06 2.34E-06 4.71E-06 6.18E-06 8.55E-06 9.07E-06 9.99E-06
p-value 19.44 6.87 15.12 5.38 7.30 –4.41 5.84 25.43 3.45 3.99 4.96 5.53 6.28 4.60 –19.27 2.17 –3.61 3.55 –3.26 3.32
Fold
1.00000 0.99999 0.99999 0.99998 0.99995 0.99994 0.99984 0.99982 0.99982 0.99980 0.99977 0.99974 0.99957 0.99948 0.99943 0.99916 0.99903 0.99884 0.99880 0.99874
Posterior probability of differential expression
Table 7.7. Genes differentially expressed between Lrp and Lrp (control vs. experimental) E. coli strains with a p-value less than 0.0001 identified with a regularized t-test
9.11E-05 5.95E-05 4.24E-04 1.30E-05 3.44E-06 1.57E-04 1.71E-04 5.44E-04 1.73E-04 3.35E-04 3.71E-05 6.80E-04 2.41E-04 8.10E-04 9.16E-05 1.16E-03 3.35E-04 9.05E-05 5.15E-05
3.41E-04 3.38E-04 9.00E-04 2.14E-04 7.24E-05 4.90E-04 4.35E-04 1.82E-04 4.50E-04 8.77E-04 2.64E-04 2.74E-04 5.82E-04 1.81E-03 2.73E-04 2.69E-03 7.82E-05 2.84E-04 2.62E-04
3.78E-05 1.92E-05 8.15E-05 1.22E-05 4.05E-06 2.82E-05 4.80E-05 6.88E-05 3.57E-05 1.21E-04 1.20E-05 1.38E-04 5.61E-05 4.51E-05 1.52E-05 5.03E-04 1.46E-04 2.99E-05 2.61E-05
4.17E-05 1.07E-04 1.50E-04 2.75E-05 2.41E-05 2.32E-04 7.29E-05 1.20E-04 8.50E-05 3.07E-04 1.22E-04 1.55E-04 1.32E-04 6.17E-04 2.16E-05 4.42E-04 3.08E-05 4.29E-05 5.61E-05
Notes: a Known Lrp-regulated genes are identified with an asterisk. b lac genes under the control of the Lrp-regulated ilvPG promotor–regulatory region.
pheA grxB b2253 hdhA gst oppF* rpoE yhjE yggB rpoS b1685 livM* rseA ilvPG::lacZ*b gdhA livJ* fimA* trxA ydaR
1.47E-05 1.61E-05 1.77E-05 1.86E-05 2.32E-05 2.59E-05 2.67E-05 2.91E-05 2.91E-05 3.03E-05 3.66E-05 4.24E-05 4.51E-05 4.60E-05 5.44E-05 5.80E-05 6.35E-05 7.43E-05 8.40E-05
3.75 5.68 2.12 16.49 21.01 3.13 2.55 –2.98 2.61 2.62 7.10 –2.48 2.42 2.24 2.98 2.32 –4.29 3.13 5.08
0.99844 0.99836 0.99827 0.99822 0.99800 0.99787 0.99784 0.99773 0.99773 0.99768 0.99743 0.99721 0.99712 0.99709 0.99681 0.99669 0.99652 0.99621 0.99595
116
Design, analysis, and interpretation of experiments
critical to incorporate this information into a statistical test. This is made clear by simply examining the scatter plots in Figure 7.3. Here many genes that appear differentially expressed greater than 2-fold do not exhibit pvalues less than 0.005 and a global confidence level of at least 95%. This does not mean that these might not be regulated genes, it simply means that they are false negatives that cannot be identified at this level of confidence. The power and usefulness of the statistical methods described here is that all of the genes examined in a DNA array experiment can be sorted by their p-values and global confidence (PPDE) levels based on the accuracy and reproducibility of each gene measurement. At this point, the researcher can set his/her own threshold level for genes worthy of further experimentation. After all, it is best to know the odds when placing a bet. The Bayesian approach allows the identification of more true positives with fewer replicates. As additional replications of DNA array experiments are performed, a simple t-test analysis results in the identification of a more consistent set of up- or down-regulated genes. This is of course because better estimates of the standard deviation for each gene are obtained as the number of experimental replications becomes larger. We have shown above that the use of a Bayesian prior estimate of the standard deviation for each gene used in the t-test further improves our ability to identify differentially expressed genes with a higher level of confidence than the simple t-test. This suggests that a more consistent set of differentially expressed genes identified with a higher level of confidence might be identified with fewer replications when the regularized t-test is employed. Long et al. [3] have demonstrated that this is indeed the case. In this work, they used CyberT to compare and analyze the gene expression profiles obtained from a wild-type strain of E. coli and an otherwise isogenic strain lacking the gene for the global regulatory protein, integration host factor (IHF), reported by Arfin et al. [6]. IHF is a DNA architectural protein that is important for the compaction of the bacterial nucleoid. However, unlike other architectural DNA proteins that bind to DNA with low specificity, IHF also binds to high-affinity sites to modulate expression levels of many genes during transitions from one growth condition to another by its effects on local DNA topology and structure. Long et al. [3] defined genes whose differential expression is likely to be due to a direct effect of IHF, and therefore true positives, as those genes that possess a documented or predicted high-affinity IHF binding site within 500 base pairs upstream of the ORF for each gene, or operon containing the gene. Of the 120 genes differentially expressed between IHF and IHF
Improved inference using a Bayesian statistical framework 2X2 t-test (51)
2X2 Bayes (59) 33 common
38 common
4X4 t-test (62)
4X4 t-test (62)
2X2 log t-test (47)
2X2 log Bayes (58) 33 common
4X4 log t-test (61)
117
37 common 4X4 log t-test (61)
Figure 7.4. Analysis of IHF data with and without Bayesian “treatment”. The numbers in parentheses represent the number of genes of the 120 genes with the lowest p-values that contain a documented or predicted IHF binding site less than 500 base pairs upstream of each ORF. In each case the raw or log-transformed data from two (22) or four (44) independent experiments were analyzed either with a simple t-test (t-test) or regularized t-test (Bayes).
strains with the lowest p-values identified by a simple t-test based on using the data from two independent experiments (22 t-test), 51 genes containing an upstream IHF site were observed; whereas, a regularized t-test (22 Bayesian) using these same two data sets identified 59 genes, or 15% more genes with upstream IHF sites (Figure 7.4). Furthermore, comparison of the differentially expressed genes identified by the simple t-test or the regularized t-test to the differentially expressed genes identified by a simple ttest performed on four experimental data sets (44 t-test) showed that the regularized t-test again identifies 15% more genes (38 vs. 33) in common with the genes identified with the 44 simple t-test. These data demonstrate that replicating an experiment twice and performing a Bayesian analysis is comparable in inference to replicating an experiment four times and using a traditional t-test. As data from more replicate experiments are included, the differentially expressed genes identified by the regularized and simple t-test analyses converge on a common set of differentially expressed genes. Deciding a cutoff level for differentially expressed genes worthy of further experimentation Once we have sorted our gene list based on the PPDE values, we are faced with the problem of deciding a cut-off level for genes worthy of further experimentation. While this is, of course, an empirical decision, common sense criteria can be used. For example, if we observe a gene with a PPDE value of 0.95 that we know, or strongly suspect, is differentially expressed under the experimental treatment conditions employed, then it is reason-
118
Design, analysis, and interpretation of experiments
able to assume that all genes expressed at a PPDE value greater than 0.95 are differentially expressed genes. It must be kept in mind, however, that even at this high level of confidence we still expect five false positives for each 100 genes in our list and we don’t know which five genes these are. Nevertheless, we are safe in concluding that the genes of this list are indeed worthy candidates for further experimentation. On the other hand, a gene that we suspect to be differentially expressed might have a relatively low PPDE value of for example 0.75. While the probability that this gene is differentially expressed is not as high as the genes in our list with PPDE values greater than 0.95, it is still a reasonable candidate for experimental verification. After all, the odds are 3 out of 4 in our favor. Finally, it is quite likely that we will find some genes that we know, or strongly suspect, should be differentially expressed that have low PPDE values. Such false negatives cannot be avoided. Simply because of small fold changes and/or experimental and biological variance, many differentially expressed genes will not be measured with sufficient accuracy for identification. These false negatives must be accepted as “the nature of the beast”. In high-dimensional DNA microarray experiments it is just not possible to identify all differentially expressed genes at a high confidence level. To illustrate these common sense methods of identifying differentially expressed genes we consider the results of our Lrp vs. Lrp experiments. In this experiment using a regularized t-test that compares differential gene expression between two otherwise isogenic E. coli strains either containing or missing the gene for the global regulatory protein Lrp, we observe 252 genes with a PPDE value greater than 0.95 and 100 with a PPDE value greater than 0.98. Of these 100 genes, 22 are known to be regulated by Lrp. Since we expect only two false positives among these 100 genes we are confident that at least 76 of these genes are newly recognized genes that are differentially expressed between these two E. coli strains. These 100 genes are distributed into six functional groups (Figure 7.5). Since the physiological purpose of Lrp is presumed to be the co-ordination of gene expression levels with the nutritional and environmental conditions of the cell, it is pleasing to discover that most of these Lrp-regulated genes encode gene products involved in small and macromolecule synthesis and degradation, as well as gene systems involved in small molecule transport and environmental stress responses. It is indicative of the power of gene expression profiling experiments that two-thirds of these genes measured with a 98% global confidence were previously unknown to be members of the Lrp regulatory network. Furthermore, nearly one-third of these genes are genes of unknown func-
Nylon filter vs. Affymetrix GeneChip™ data
119
Figure 7.5. Distribution of functions for genes expressed between Lrp and Lrp E. coli strains.
tion. As more experiments of this type are performed and as more functions are assigned to the gene products of these hypothetical ORFs and bioinformatics methods to identify degenerate protein binding sites typical of proteins that bind to many DNA sites are developed, a clearer picture of genetic regulatory networks and their interactions in E. coli will emerge. These will be the first steps towards the systems biology goals of Chapter 8.
Nylon filter data vs. Affymetrix GeneChip™ data The analyses of gene expression profiling experimental data described above clearly demonstrates that experimental errors arise from differences among DNA arrays and the experimental manipulations required for target preparation. When different array formats are used that require different target preparation methods, the magnitudes and sources of these experimental errors are surely different. This raises the question of whether or not results obtained from experiments performed with different DNA array formats can be compared to one another, or indeed if comparable results can be obtained. To address this question, we have assessed the results obtained from DNA array experiments performed with pre-synthesized nylon filters hybridized with 33P-labeled cDNA targets prepared with random hexamer primers from total RNA and in situ synthesized Affymetrix GeneChips™
120
Design, analysis, and interpretation of experiments
Lrp+ RNA1-3
Exp 1
Lrp– RNA1-3
Lrp+ RNA4-6
Exp 2
Lrp– RNA4-6
Lrp+ RNA7-9
Exp 3
Lrp– RNA7-9
Lrp+ RNA10-12
-Exp 4
Lrp– RNA10-12
Figure 7.6. Design of the Affymetrix GeneChip™ experiments. See text for details.
hybridized with biotin-labeled targets obtained from the same total RNA preparation. For the GeneChip™ experiments, the exact same four control and experimental pairs of pooled RNA preparations used in the Lrp vs. Lrp filter experiments described above were used for hybridization to four pairs of E. coli Affymetrix GeneChips™. However, in this case each experiment was not performed in duplicate, and only one measurement for each gene was obtained on each chip. Thus, instead of having four measurements for each gene expression level for each experiment (Figure 4.1), only one measurement was obtained from each GeneChip™ (Figure 7.6). On the other hand, this single measurement is the average of the difference between hybridization signals from 15 perfect match (PM) and mismatch (MM) probe pairs.1 While these are not equivalent to duplicate measurements because different probes are used, these data do increase the reliability of each gene expression level measurement. Because each filter experiment was performed in duplicate and each filter contained duplicate probes for each target, it was possible to assess the 1
While the number of perfect match and mismatch probe pairs for the vast majority of E. coli ORFs is 15, this number can range from 2 to 20 depending on the length of the ORF.
121
Nylon filter vs. Affymetrix GeneChip™ data Table 7.8. Differential gene expression data for Affymetrix GeneChip™ experiments using CyberT with a regularized t-testa p-values
Number of genes (control vs. control)b
Number of genes (control vs. experimental)
% Confidence (ad hoc)
0.0001 0.0005 0.001 0.005 0.01 0.05
1.00 2.33 3.67 16.50 32.17 151.67
19 27 32 53 66 152
94.7 91.4 88.5 68.9 51.3 0.2
Notes: a Calculated with 2128 control and experimental gene expression measurements (AD values from *.CEL file with negative values converted to 0) containing four non-zero values for four experiments. b Calculated by averaging the control or experimental measurements and comparing experiments 1 and 3 vs. 2 and 4 or 1 and 4 vs. 2 and 3 that average data across chips and RNA preparations.
magnitude of errors contributed by differences among the filters and differences among the target preparations (Table 7.3). However, since only one measurement from one GeneChip™ was obtained for each genotype for each experiment, it was not possible to distinguish sources of error contributed by differences among GeneChips™ from differences among target preparations as we did with the filter data. Nevertheless, it was possible to use the ad hoc control vs. control method and the computational method of Allison et al. [2] and CyberT software to compare data among the four control GeneChips™ hybridized with independent biotin-labeled mRNA targets from E. coli strain IH-G2490 (Lrp ). These methods were used to estimate the number of false positives expected at given p-value thresholds. These results for the GeneChip™ data, as well as the nylon filter data, are presented in Tables 7.8 and 7.9, respectively It is clear from these results that the filter data identifies more differentially expressed genes with lower p-values and higher confidence levels than the GeneChip™ data. This is not surprising since, as explained above, each gene measurement level in the filter data set is the average of four duplicate measurements from two separate filters, while each gene measurement in the GeneChip™ data set is based on a single measurement from each experiment. In fact, when the top 100 genes with the lowest p-values from the nylon filter and GeneChip™ experiments are compared, only 16 genes are common to both lists. This lack of correspondence is likely due to the greater variance among the GeneChip™ measurements and the fact that
122
Design, analysis, and interpretation of experiments
Table 7.9. Differential gene expression data for nylon filter experiments using CyberT with a regularized t-testa p-values
Control vs. controlb
Control vs. experimental
% Confidence (ad hoc)
PPDE
0.0005 0.001 0.005 0.010 0.050
0.25 0.50 2.00 3.75 17.75
62 79 188 268 613
99.6 99.4 98.9 98.6 97.1
0.089 0.085 0.964 0.947 0.878
Notes: a Calculated with 2775 control and experimental gene measurements containing four non-zero values for four experiments. b Calculated by averaging the control measurements of experiments 1 and 3 vs. 2 and 4 or 1 and 4 vs. 2 and 3 that average data across filters and RNA preparations.
fundamentally different DNA array formats are compared. However, when a Bayesian statistical framework (see above and Chapter 5) is applied to the analysis of each data set, the correspondence is doubled and 29 genes are found to be common to both lists. These results further strengthen the conclusions of Long et al. [3] that statistical analyses performed with a Bayesian prior identify genes that are up- or down-regulated more reliably than approaches based only on the t-test when only a few experimental replications are possible. The GeneChip™ results described above were obtained from raw data that was background subtracted and normalized to the total signal on each DNA array, and analyzed with the CyberT statistical software. However, Affymetrix has developed its own empirical algorithms for the analysis of GeneChip™ data that is commercially available in a software package called Microarray Suite. Below we compare the identification of differentially expressed genes identified with the CyberT and Microarray Suite software v4.0. The identification of differentially expressed genes by Microarray Suite is based on genes that fulfill two criteria: (1) the difference between the perfect match and the mismatch values for a given gene probe set must be greater than a defined threshold (CT);2 (2) the difference between the perfect match 2
CT is a value equal to a standard statistical difference threshold (SDT) of both control and experimental data. SDT is calculated by the relationship SDTQM where Q is the noise defined as the standard deviation of the pixel intensities of the probe cells exhibiting the lowest 2% intensity values in each of 16 sectors of each GeneChip™, and M is set by default to 2 if a strepavidin–phycoerythrin staining method is used, or 4 if an antibody amplification staining method is used.
Nylon filter vs. Affymetrix GeneChip™ data
123
Table 7.10. Number of differentially expressed genes identified by Affymetrix Microarray Suite software Number of replicates
Number of differentially expressed genes
1 2 3 4
416–682 118–184 68–95 55
and the mismatch values of the control and experimental chip divided by the perfect match and the mismatch values of the control chip must be greater than the percent change threshold divided by 100, where the percent change threshold is defined by the user (default 80). Based on these criteria the software identifies (calls) differentially expressed genes as marginally increased or decreased, increased or decreased, or not changed. Since the Affymetrix software allows the comparison of only one GeneChip™ pair at a time, it was run on each of the four independent experiments comparing Lrp genotypes. Each comparison identified between 500–700 genes as marginally increased or decreased, or increased or decreased (Table 7.10). However, filtering identified only 55 genes that were called differentially expressed in all four experiments. Comparison of these 55 genes to the 55 genes exhibiting the lowest p-values identified by the CyberT software employing a Bayesian statistical framework revealed 35 genes in common with both lists. Among these, were 17 known Lrpregulated genes. These results illustrate several important points. First, they stress the importance of replication when only two conditions are compared. Little can be learned about those genes regulated by Lrp from the analysis of only one experiment with one GeneChip™ pair since an average of 6