Lecture Notes in Computer Science Edited by G. Goos, J. Hartmanis, and J. van Leeuwen
2568
3
Berlin Heidelberg New York Barcelona Hong Kong London Milan Paris Tokyo
Masami Hagiya Azuma Ohuchi (Eds.)
DNA Computing 8th International Workshop on DNA-Based Computers, DNA8 Sapporo, Japan, June 10-13, 2002 Revised Papers
13
Series Editors Gerhard Goos, Karlsruhe University, Germany Juris Hartmanis, Cornell University, NY, USA Jan van Leeuwen, Utrecht University, The Netherlands Volume Editors Masami Hagiya University of Toyko Graduate School of Information Science and Technology Department of Computer Science 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8565, Japan E-mail:
[email protected] Azuma Ohuchi Hokkaido University Graduate School of Engineering Division of Complex Systems Technology N-13, W-8, KITA-KU, Sapporo, 060, Japan E-mail:
[email protected] Cataloging-in-Publication Data applied for A catalog record for this book is available from the Library of Congress. Bibliographic information published by Die Deutsche Bibliothek Die Deutsche Bibliothek lists this publication in the Deutsche Nationalbibliografie; detailed bibliographic data is available in the Internet at
.
CR Subject Classification (1998): F.1, F.2.2, I.2.9, J.3 ISSN 0302-9743 ISBN 3-540-00531-5 Springer-Verlag Berlin Heidelberg New York This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, re-use of illustrations, recitation, broadcasting, reproduction on microfilms or in any other way, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965, in its current version, and permission for use must always be obtained from Springer-Verlag. Violations are liable for prosecution under the German Copyright Law. Springer-Verlag Berlin Heidelberg New York a member of BertelsmannSpringer Science+Business Media GmbH http://www.springer.de © Springer-Verlag Berlin Heidelberg 2003 Printed in Germany Typesetting: Camera-ready by author, data conversion by Boller Mediendesign Printed on acid-free paper SPIN: 10872239 06/3142 543210
Preface
Biomolecular computing has emerged as an interdisciplinary field that draws together chemistry, computer science, mathematics, molecular biology, and physics. Our knowledge on DNA nanotechnology and biomolecular computing increases exponentially with every passing year. The international meeting on DNA Based Computers has been a forum where scientists with different backgrounds, yet sharing a common interest in biomolecular computing, meet and present their latest results. Continuing this tradition, the 8th International Meeting on DNA Based Computers (DNA8) focuses on the current theoretical and experimental results with the greatest impact. Papers and poster presentations were sought in all areas that relate to biomolecular computing, including (but not restricted to): algorithms and applications, analysis of laboratory techniques/theoretical models, computational processes in vitro and in vivo, DNA-computing-based biotechnological applications, DNA devices, error evaluation and correction, in vitro evolution, models of biomolecular computing (using DNA and/or other molecules), molecular design, nucleic acid chemistry, and simulation tools. Papers and posters with new experimental results were particularly encouraged. Authors who wished their work to be considered for either oral or poster presentation were asked to select from one of two submission “tracks”: – Track A - Full Paper – Track B - One-Page Abstract For authors with late-breaking results, or who were submitting their manuscript to a scientific journal, a one-page abstract, rather than a full paper, could be submitted in Track B. Authors could (optionally) include a preprint of their full paper, for consideration only by the program committee. We received 49 submissions in Track A, and 17 submissions in Track B. These submissions were then reviewed by the program committee members, and by some other, external reviewers. In principle, three committee members were allocated for each submission. In considering the returned review reports, all discussions pertaining to the final decisions were made online by the program committee members. The program committee wishes to thank the external reviewers, who spent much valuable time reading submissions. We finally selected 16 oral presentations from Track A. They have been included as full papers in the preliminary proceedings. Note that the competition was extremely tough for Track A submissions. We selected only one third of the submissions for oral presentations. In addition to the 16 oral presentations, we judged that 12 additional submissions in Track A were of good quality and relevance, and therefore decided to include these full papers in the preliminary proceedings. These papers were also selected for presentation as posters, during the conference. As for Track B, we selected 7 oral presentations.
VI
Preface
The meeting was held on June 10–13, 2002, in Hokkaido University, Japan. On the first day of the meeting, we had four tutorials in two tracks: one track on computer science and the other on biotechnology. Both tracks consisted of a basic tutorial held in the morning and an advanced one in the afternoon. The basic computer science tutorial was given by Takashi Yokomori (Waseda University) and was titled “Introduction to Natural Computing.” The advanced one was given by John A. Rose (University of Tokyo) and was titled “Nucleic Acid Sequence Design.” The basic biotechnology tutorial was given by Toshikazu Shiba (FUJIREBIO Inc.) and was titled “Introduction to Biotechnology.” The advanced one was given by Nadrian C. Seeman (University of New York) and was titled “DNA Self-assembly.” The next three days were for invited plenary lectures, and regular oral and poster presentations. Invited plenary lectures were by Willem P.C. Stemmer (Maxygen, Inc.), Tomoji Kawai (Osaka University), Akira Suyama (University of Tokyo), Tom Head (Binghamton University), and Bernard Yurke (Lucent Technologies). We were very honored to have these prominent researchers as plenary speakers. It is also our great pleasure to mention here that Tom Head, one of the invited speakers of the meeting, received the award The DNA Computing Scientist of 2002. The award ceremony was held at the banquet of the meeting. A paper by Tom Head, related to his invited lecture, is included in this volume. After the meeting, the full papers in the preliminary proceedings were revised by the authors and reviewed again by the program committee members and the external reviewers. The program committee thanks those reviewers again. This volume contains the final versions of the papers after the second review. Finally, the program committee wishes to thank all those who submitted papers and abstracts for consideration.
November 2002
Masami Hagiya
Organization
DNA8 was organized by Hokkaido University and CREST JST (Japan Science and Technology Corporation) in cooperation with NovusGene Inc. and the European Association for Theoretical Computer Science (EATCS).
Program Committee Masami Hagiya Anne Condon Lila Kari Thom LaBean Giancarlo Mauri John McCaskill
University of Tokyo, Japan (Program Chair) University of British Columbia, Canada University of Western Ontario, Canada Duke University, USA Universita degli Studi di Milano-Bicocca, Italy GMD-National Research Center for Information Technology, Germany Institute of Mathematics of the Romanian Academy, Romania University of Tokyo, Japan New York University, USA Tokyo Institute of Technology, Japan California Institute of Technology, USA University of Delaware, USA
Gheorghe Paun John Rose Ned Seeman Masayuki Yamamura Erik Winfree David Wood
Organizing Committee Azuma Ohuchi Masahito Yamamoto Toshikazu Shiba Hidenori Kawamura Masami Hagiya Akira Suyama Masayuki Yamamura
Hokkaido University, Japan (Organizing Committee Chair) Hokkaido University, Japan Hokkaido University, Japan Hokkaido University, Japan University of Tokyo, Japan University of Tokyo, Japan Tokyo Institute of Technology, Japan
External Reviewers J. Ackermann M. Arita D. Besozzi M. Daley R. Deaton
C. Ferretti A. Leporati E. Losseva V. Mitrana A. Nishikawa
A. Paun T. Ruecker Y. Sakakibara K. Sakamoto H. Someya
VIII
Organization
G. Stefan M. Takano H. Uejima
K. Wakabayashi G. Wozniak M. Yamamoto
T. Yokomori C. Zandron
Sponsoring Institutions Hokkaido University CREST JST (Japan Science and Technology Corporation) NovusGene Inc. European Association for Theoretical Computer Science (EATCS)
Table of Contents
Self-assembly and Autonomous Molecular Computation Self-assembling DNA Graphs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Phiset Sa-Ardyen, Nataˇsa Jonoska, Nadrian C. Seeman
1
DNA Nanotubes: Construction and Characterization of Filaments Composed of TX-tile Lattice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Dage Liu, John H. Reif, Thomas H. LaBean The Design of Autonomous DNA Nanomechanical Devices: Walking and Rolling DNA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 John H. Reif Cascading Whiplash PCR with a Nicking Enzyme . . . . . . . . . . . . . . . . . . . . . . 38 Daisuke Matsuda, Masayuki Yamamura
Molecular Evolution and Application to Biotechnology A PNA-mediated Whiplash PCR-based Program for In Vitro Protein Evolution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 John A. Rose, Mitsunori Takano, Akira Suyama Engineering Signal Processing in Cells: Towards Molecular Concentration Band Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 Subhayu Basu, David Karig, Ron Weiss
Applications to Mathematical Problems Temperature Gradient-Based DNA Computing for Graph Problems with Weighted Edges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73 Ji Youn Lee, Soo-Yong Shin, Sirk June Augh, Tai Hyun Park, Byoung-Tak Zhang Shortening the Computational Time of the Fluorescent DNA Computing . . 85 Yoichi Takenaka and Akihiro Hashimoto How Efficiently Can Room at the Bottom Be Traded Away for Speed at the Top? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95 Pilar de la Torre Hierarchical DNA Memory Based on Nested PCR . . . . . . . . . . . . . . . . . . . . . . 112 Satoshi Kashiwamura, Masahito Yamamoto, Atsushi Kameda, Toshikazu Shiba, Azuma Ohuchi
X
Table of Contents
Binary Arithmetic for DNA Computers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124 Rana Barua, Janardan Misra Implementation of a Random Walk Method for Solving 3-SAT on Circular DNA Molecules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133 Hubert Hug, Rainer Schuler Version Space Learning with DNA Molecules . . . . . . . . . . . . . . . . . . . . . . . . . . 143 Hee-Woong Lim, Ji-Eun Yun, Hae-Man Jang, Young-Gyu Chai, Suk-In Yoo, Byoung-Tak Zhang DNA Implementation of Theorem Proving with Resolution Refutation in Propositional Logic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156 In-Hee Lee, Ji-Yoon Park, Hae-Man Jang Young-Gyu Chai, Byoung-Tak Zhang Universal Biochip Readout of Directed Hamiltonian Path Problems . . . . . . 168 David Harlan Wood, Catherine L. Taylor Clelland, Carter Bancroft
Nucleic Acid Sequence Design Algorithms for Testing That Sets of DNA Words Concatenate without Secondary Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 182 Mirela Andronescu, Danielle Dees, Laura Slaybaugh, Yinglei Zhao, Anne Condon, Barry Cohen, Steven Skiena A PCR-based Protocol for In Vitro Selection of Non-crosshybridizing Oligonucleotides . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 196 Russell Deaton, Junghuei Chen, Hong Bi, Max Garzon, Harvey Rubin, David Harlan Wood On Template Method for DNA Sequence Design . . . . . . . . . . . . . . . . . . . . . . 205 Satoshi Kobayashi, Tomohiro Kondo, Masanori Arita From RNA Secondary Structure to Coding Theory: A Combinatorial Approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215 Christine E. Heitsch, Anne E. Condon, Holger H. Hoos Stochastic Local Search Algorithms for DNA Word Design . . . . . . . . . . . . . . 229 Dan C. Tulpan, Holger H. Hoos, Anne E. Condon NACST/Seq: A Sequence Design System with Multiobjective Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242 Dongmin Kim, Soo-Yong Shin, In-Hee Lee, Byoung-Tak Zhang A Software Tool for Generating Non-crosshybridizing Libraries of DNA Oligonucleotides . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252 Russell Deaton, Junghuei Chen, Hong Bi, John A. Rose
Table of Contents
XI
Theory Splicing Systems: Regularity and Below . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 262 Tom Head, Dennis Pixton, Elizabeth Goode On the Computational Power of Insertion-Deletion Systems . . . . . . . . . . . . . 269 Akihiro Takahara, Takashi Yokomori Unexpected Universality Results for Three Classes of P Systems with Symport/Antiport . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 281 Mihai Ionescu, Carlos Mart´ın-Vide, Andrei P˘ aun, Gheorghe P˘ aun Conformons-P Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291 Pierluigi Frisco, Sungchul Ji Parallel Rewriting P Systems with Deadlock . . . . . . . . . . . . . . . . . . . . . . . . . . . 302 Daniela Besozzi, Claudio Ferretti, Giancarlo Mauri, Claudio Zandron A DNA-based Computational Model Using a Specific Type of Restriction Enzyme . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 315 Yasubumi Sakakibara, Hiroshi Imai Time-Varying Distributed H Systems of Degree 2 Can Carry Out Parallel Computations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 326 Maurice Margenstern, Yurii Rogozhin, Sergey Verlan
Author Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 337
Self-assembling DNA Graphs Phiset Sa-Ardyen1 , Nataˇsa Jonoska2, and Nadrian C. Seeman1 1
2
New York University, Department of Chemistry, New York, NY 1003 [email protected], [email protected] University of South Florida, Department of Mathematics, Tampa, FL 33620, [email protected]
Abstract. We show experimental results of constructing non regular graphs using junction molecules as vertices and duplex DNA molecules as edge connections.
1
Introduction
A variety of computational models have been introduced recently that are based on DNA properties and Watson-Crick complementarity. Several researchers have observed that the inherent three dimensional structure of DNA and self-assembling of complex three dimensional structures can be used as computational devices as well as for improving the computational power of some models. DNA tiles that perform computation, made of double and triple cross-over molecules have been proposed for self-assembly of two-dimensional arrays [9,14]. Such arrays made of DNA tiles have been obtained experimentally [10,15]. In the case of triple cross-over molecules, a simple XOR operation was experimentally confirmed [8]. Branched junction molecules and graph-like DNA structures as computational devices have been proposed by several authors [5,6,16,14,13]. Splicing of tree-like structures made of junction molecules and hairpins based on the splicing model proposed by T. Head [4] was suggested in [16]. In [13], the authors propose to simulate Horn clause computation by self-assembly of three junctions and hairpins. Computations of a variety of problems by actual construction of graphs by DNA molecules was proposed in [5,6]. All these models using branched junction molecules and construction of graphs are yet to be confirmed experimentally. Branched junction DNA molecules are already fairly well understood experimentally and in fact they have been used to form certain three dimensional DNA structures such as a DNA cube and a truncated octahedron [1,17]. Although these DNA constructs were made out of junction molecules, they all represent regular graphs, i.e. the degrees of all of the vertices are same. The experimental design and construction of a non-regular graph solely by junction molecules (representing the vertices of the graph) and duplex molecules (representing the edges) has not been obtained. M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 1–9, 2003. c Springer-Verlag Berlin Heidelberg 2003
2
Phiset Sa-Ardyen, Nataˇsa Jonoska, and Nadrian C. Seeman
In this paper we show experimental progress in obtaining such non-regular DNA graph structures. A graph made of 5 vertices and 8 edges was chosen for self-assembly. For construction of the DNA graph we use junction molecules that represent the vertices and duplex molecules that represent the edges. The molecules have vertex-edge specific sticky ends and use WC complementarity for self-assembling the graph. In section 2 we explain the design of the oligos. The experimental results are shown in section 3.
2
Design of the Self-assembly
In [6,7] the graph depicted in Figure 1 (a) was used as an example to show how the three-vertex colorability and the Hamiltonian path problem could be solved by construction of the graph. For our experiment we chose the same graph. Since the vertex v5 has degree two, for the experiment we used one duplex molecule to represent the vertex v5 and the edges connecting v5 with v1 and v4 . Hence, the designed experiment uses 5 vertices and 8 edges as depicted in Figure 1(b). V
V
V4
5
6
V4
V3
V
e6
5
e7 e3
V
1 (a)
2
V
V3 e4
e8 V
e5
e1
1
V
e2
2
(b)
Fig. 1. The graph to be DNA self-assembled. The five vertices were designed to be junction molecules, 3-armed junctions for vertices v1 , v3 , v4 and v5 and a 4-armed junction molecule for v2 . The sticky ends were designed such that once the molecules hybridize and are ligated to form the graph structure, the final ligation product is one cyclic molecule (maybe one or more knots) which can be distinguished from the partially formed linear products by two-dimensional gel electrophoresis techniques. This final structure is depicted in Figure 2. Six DNA strands are involved in the construction of each edge that connects two vertices of the graph: two strands from the junction molecule representing one of the vertices, two strands from the junction molecule representing the other vertex molecule and two strands to form the duplex molecule that represents the edge (see Figure 3). The distances between the vertices were designed such that e1 = {v1 , v2 }; e2 = {v2 , v3 }; e5 = {v3 , v4 }; e8 = {v5 , v1 } are all 4 helical turns, i.e. the length
Self-assembling DNA Graphs 1 0 1 0 0 1 1 0 0 1 0 01 1
V4
1 0 0 1 0 1 1 0 1 0
V5
* 00 11 00 11 1 0 0 1 00 11
0 1 0 1 0 1 1 00 *1
* 00 11 0 1 1 0 00 11
11 00 1 0 00 11
0 1 0 1 00 1 1 0 1 0 1 0 1 0 1 0 1 1 00 *1
V1
1 0 1 0 0 1 0 1 1 0 1 0 00 11 1 0 00 11 0 1 00 11
V3
1 0 1 0 1 0 0 1 0 1 1 0 1 0
1 0 1 0 0 1 0 1 0 1 0 1
0 1 0 1 00 1 1 *
3
1 0 00 11 00 011 1
1 0 1 00 1 V2
Fig. 2. The final DNA structure representing the graph in Figure 1 (b). The double helix is not depicted and the shaded area represents the position of the sticky ends. The stars indicate the 5 ends that have been labeled with γ−32 PATP for the experiment with results shown in Fig. 7. The hairpins added to the four edges e3 , e4 , e6 and e7 are not presented.
vertex 1
edge
vertex 2
Fig. 3. Six DNA strands involved in assembling an edge connection.
of these DNA segments is 42 base pairs. In order to attain desired flexibility the other distances were longer. The edges e3 = {v2 , v5 }; e4 = {v2 , v4 }; e7 = {v3 , v5 } were chosen to be 6 helical turns, i.e. 63 base pairs. The longest segment of 8 helical turns (i.e. 84bp long) is e6 = {v1 , v4 }. Each of the longer edge molecules e3 , e4 , e6 , e7 contains an additional hairpin of one and a half helical turn in the middle of the molecule. The 3-junctions of the hairpins contain bulges of T’s at each turn, as can be observed in Figure 4. These hairpins are expected to add flexibility to the edge molecules. For similar reasons i.e. for increased flexibility of the junctions, bulges of two T’s were added to the junction molecules at the positions where the arms of the junction meet (Figure 5). Shorter edges obtained by connecting short duplex molecules with the arms of the appropriate junctions use sticky ends of 6 bases. The sticky ends for connection of the longer edges were designed to be 8 bases long.
Phiset Sa-Ardyen, Nataˇsa Jonoska, and Nadrian C. Seeman to V2 gAACCTAggCgCAgTCTC
gAgCTATAgTACATCCAC
to V3
gTACTATAgCTCAACCgA
gCgCCTAggTTCTgCCTA
to V1
to V2
to V3
edge E2
gAATgg CCTAAgTATgTA
CTTAggCCATTCACgAAT
4
to V4
edge E1
edge E5
g T gTgg AgCTCgATC T to V2 T
T
T ACTAgCTTAAgATCg T
CTTAgTTATgC T
TCAATgTTAgA T
T
CAgTgAAgCAgCTCTAgCg
T TT T TCTAACATTgACTgTgTCC CTgCTTCACTg T T
T CgATCTTAAgCTAgT T
to V2
T gATCgAgCTCCACAC T
TT
TT
CgTAgAATCggCgTACCTC to V5
to V4
edge E4
T TT T gCATAACTAAggAgTggTC CCgATTCTACg T T
edge E3
gTAgATAggTAAg gTCAgTAgCAgACATC
CTACTgACCTTACCTATCTAC T
T gAT TggTCgACACTg T
CATgAgACgTCCgAg T T
to V5
TT
TCCTACTAgAC T
T g gAgT TgATgAgCAggATC
TT TT T gTCTAgTAg gAgCgATCCg
T
gCAgTATACTTgACgCAg
T
to V1
edge E8
T CAgTgTCgACCAATC T
gCACTTCCATTACTgTTATCg
T CTCggACgTCTCATg T
to V1
CAAgTATACTgCCAAGCA
to V4
TT TT T CgATAACAgTAATg gAAgTgCgCTCAgAg
edge E6
TCATCAACTCCT
to V5
TT
to V3
edge E7
Fig. 4. DNA sequences for the edges. For the purposes of later, more detailed analysis, a unique restriction site was incorporated into the sequence of each edge. For the longer edge molecules, these restriction sites were included in the sequences of the hairpins. The sequences for each of the strands were designed by use of the program SEQUIN [11]. The sticky ends were designed by DNASequenceGenerator [3]. In use of SEQUIN, a special care was taken so that no “sticky end” sequence appears in the whole final product more than once. In the design of the 4-junction molecule that represents v2 we took advantage of the already well understood J1 molecule [12], and the first 8 bases of the arms of v2 contain the exact sequence of J1.
3
Experimental Results
The shorter DNA oligonucleotides used in five of the vertices and four of the shorter edges were ordered from IDT, Inc., non-phosphorylated. The longer molecules were synthesized on an Applied Biosystems 380 automatic DNA synthesizer. In contrast to the shorter oligonucleotides, these were phosphorylated with their syntheses. All molecules were purified by electrophoresis. 3.1
Preliminaries
All oligonucleotides were subjected to phosphorylation using kinase labeling. First, junction molecules and edge molecules were annealed by heating each
T ACTCgTgCAgTggACCACTC
T
Tg
Ag
gT
gC
gA
TC
AC
Ag C
CT
CA
g
TT
g
CAACTgAAggTggAT
T gAACggACATAgCggATCgC
T
CCggTATCA
TA
T
gCgATggACTACATA T C
vertex 4
gA
CA
TC
gT
T
gA
vertex 5
CT
gg
AT
Tg
Ag
gA
gg
TA
Cg
to V2 gT
CA
gA
AT
Tg
CT
gT
T Tg
TC
Tg
AT
AC
g T T T
TA
Ag
Ag
CA
TT
Cg
T
TA
TC
Cg
Ag
AT
to V1
gT
gC
CC
Tg
to V5
CA Tg
gC
CA
CT
g
TC
CC A
gA
T T CA
gA
to V1 gT
gT
gC
CT
C
CT
gg
T CA gg
gA
AT
Cg
vertex 3
CT
to V3
Tg
TA
T
to V3
CTATgTCCgTTC T
T A
to V2
gTCCATCgC T
T gC
CT
C TA
to V3
A
CC A
to V2
vertex 2
CA
A
CT
gC
gA T T C
Ag
TC
gT
Ag
Tg
to V4
TC C
T
T
ggCTTACgCgAgACT TA
T
Cg
vertex 1
CTTCAgTTg T
to V4
CA
T CCTAACgCTACAggACACAg
TgTAgCgTTAgg T
A
T
TT
gCgTAAgCC T
T TgATACCggTCggTT
TC
to V1
5
to v5
CACTgCACgAgT T
CC
to V5
g TA
to V4
CCAgTTCTAggAA T
TTCCTAgAACTggCTCTgAgC
Self-assembling DNA Graphs
gC
Ta
gA
g
to V2
gT
CT
g
Fig. 5. DNA sequences for the vertices. solution to 90o C for two minutes and slowly cooled to room temperature. Formation of each of the junction molecules and the edge molecules as well as the stoichiometry was established on 12% non-denaturing polyacrylamide gels. Figure 6 shows non-denaturing gels for two of the junctions representing vertices v2 and v5 . The lanes indicated by the arrows show the junction molecule with all of the strands. The remaining lanes show partial complexes that contain only one, two, or in the case of the four junction, three of the strands. From the lanes containing the junction molecule it is clear that almost all molecules are included in the formation of the complex and there are no stoichiometry problems. Similar experiments were performed with the other junctions and the hairpins. These results are not shown here. Four strands of the expected final product were chosen to be labeled with γ−32 P-ATP. One strand at each of the junctions representing vertices v1 , v3 , v4 and v5 were labeled. The labeled strands are marked with a in Figure 2. The labeling of a v2 strand was not succesful and no ligation product was visible. All labels were chosen such that they would appear evenly spread throughout the cyclic molecule that represents the final product. The ligation of the whole graph was done by annealing all junction molecules and edge molecules separately first, according to the determined stoichiometry. Then all these complexes were mixed together and treated with T4 DNA ligase at room temperature overnight. The final single cyclic DNA molecule that represents the graph is 1084 bases long. The gel of the ligation product of these four ligations using four distinctly labeled
6
Phiset Sa-Ardyen, Nataˇsa Jonoska, and Nadrian C. Seeman
Fig. 6. Non-denaturing gels for the junction molecules representing vertices v2 and v5 . strands is presented in Figure 7. The first lane contains a linear marker, and the lanes 2,3,4,5 contain ligation products with labeled strands of junctions at v1 , v3 , v4 and v5 respectively. It is clear that a band of approximately 1078 bases, i.e. the length of the expected final product has been formed in each reaction. Having this band in all four lanes indicates that all four labeled strands are included in formation of the molecules of this length. 3.2
Final Product Results
For obtaining the final cyclic molecule, the above procedure was slightly modified. There are 32 ligation sites in the self-assembly. Even with 90% efficiency of the ligase, we will not have more than 3% of the final product. By labeling a trace of the strands we are facing the possibility that the final cyclic molecule might not be visible on autoradiograph. The band of the expected size that is clearly visible in Figure 7 was eluted, but the eluted amount was hardly detectible and all additional experiments did not produce a visible product. For the two-dimensional electrophoresis we modified the labeling protocol. The junction and edge molecules were annealed as before, but this time prior to the phosphorylation. After annealing, all junctions and edge molecules were subjected to γ−32 P-ATP labeling for one hour with kinase. To improve the phosphorylation, unlabeled ATP molecules were added for additional 7 minutes. We expected that with this process the visibility of a small yield of the final circular product would improve. In Figure 8, a two dimensional gel is presented. The first dimension was run on the 3.5% denaturing gel and the second dimension on 5%. The circled cyclic
Self-assembling DNA Graphs
7
Fig. 7. Ligation product of self-assembly of the whole graph run on a superdenaturing gel.
bands (gel areas) denoted A-H were extracted and eluted. The final cyclic product has a very complex secondary structure and in fact it might take the form of many topoisomers and may appear in the gel at several places off-diagonal. Its behavior could not be predicted, so several different bands that were clearly not linear were tested. After elution, the excised molecules were subjected to linearization (heating at 95o C for 20 minutes). The result of this linearization is presented on the right in Figure 8. Lanes 3 and 6 corresponding to the excised areas B and E from the twodimensional gel show a unique clear band of the expected size of approximately 1100 bases. There appears to be no product in the lanes corresponding to A, G, H. On the other hand, there seem to be too many bands in the lanes corresponding to C and D. At this point there is no analysis of these extra bands. They may correspond to a dimer (double cover) molecule of the expected graph. Lane F shows two molecules, none of the size that was expected. Since the position of the area marked F in the two dimensional gel is somewhat below the curve of the other excised areas, it might not contain the target product.
8
Phiset Sa-Ardyen, Nataˇsa Jonoska, and Nadrian C. Seeman
Fig. 8. 2d denaturing gel of the ligation product (left) and a denaturing gel of the linearization of the bands extracted from the 2d-gel (right).
4
Concluding Remarks
Theoretically, by the design of the oligonucleotides and the sticky ends of the junctions such that the target molecule representing the graph is one circular molecule (or knot), the results in Figure 8 suggest that we sometimes form the expected product. Although our experiments up to this point are very encouraging, we have not confirmed with certainty that the desired cyclic molecule has been obtained. Such a confirmation would be obtained by sequencing the final product and confirming with the sequence of the designed oligonucleotides. Since the yield of the resulting molecules is very low, the extracted product from the two dimensional gel will need to be amplified by PCR. In that regard the restriction sites at the hairpins of the longer edges can be utilized to specify the primers to be picked for the PCR reaction. Acknowledgement This work has been supported by grants GM-29554 from NIGMS, N00014-98-1-0093 from ONR, grants CTS-9986512, EIA-0086015, EIA0074808, DMR-01138790, and CTS-0103002 from NSF, and F30602-01-2-0561 from DARPA /AFOSR.
References 1. J.H. Chen, N.C. Seeman, Synthesis from DNA of a molecule with the connectivity of a cube, Nature 350 (1991) 631-633.
Self-assembling DNA Graphs
9
2. J.H. Chen, N.R. Kallenbach, N.C. Seeman, A specific quadrilateral synthesized from DNA branched junctions, J. Am. Chem. Soc. 111 (1989) 6402-6407. 3. U. Feldkamp, S. Saghafi, H. Rauhe, DNASequenceGenerator: A program for the construction of DNA sequences, DNA Computing: Proceedings of the 7th International Meeting on DNA Based Computers (N. Jonoska, N.C. Seeman editors), Springer LNCS 2340 (2002) 23-32. 4. T. Head, Formal language theory and DNA: an analysis of generative capacity of recombinant behaviours, Bul. of Mathematical Biology 49 (1987) 735-759. 5. N. Jonoska, S. Karl, M. Saito, Creating 3-dimensional graph structures with DNA, DNA computers III, (H. Rubin, D. Wood editors), AMS DIMACS series 48 (1999) 123-135. 6. N. Jonoska, S. Karl, M. Saito, Three dimensional DNA structures in computing, BioSystems 52 (1999) 143-153. 7. N. Jonoska, 3D DNA patterns and computing, Pattern formation in biology, vision and dynamics, (A.Carbone, M.Gromov, P.Pruzinkiewicz editors) World Scientific Publishing Company, Singapore (1999) 310-324. 8. C. Mao, T.H. LaBean, J.H. Reif, N.C. Seeman, Logical computation using algorithmic self-assembly of DNA triple-crossover molecules, Nature 407 (2000) 493-496. 9. J.H. Reif, Local parallel biomolecular computation, in DNA Based Computers III (H. Rubin, D.H. Wood edtors) AMS DIMACS series 48 (1999) 217-254. 10. P.W.K. Rothemund, Using lateral capillary forces to compute by self-assembly, Proc. of Nat. Acad. Sci. (USA) 97 (2000) 984-989. 11. N.C. Seeman, De novo design of sequences for nucleic acid structural engineering J. of Biomolecular Structure & Dynamics 8 (3) (1990) 573-581. 12. N.C. Seeman, N.R. Kallenbach, Nucleic acid junctions: a successful experiment in macromolecular design, Molecular Structure: Chemical Reactivity and Biological Activity (J.J. Stezowski, J.L. Huang, M.C. Shao editors) Oxford Univ. Press, Oxford (1988) 189-194. 13. H. Uejima, M. Hagiya, S. Kobayashi, Horn clause computation by self-assembly of DNA molecules, DNA Computing: Proceedings of the 7th International Meeting on DNA Based Computers (N. Jonoska, N.C. Seeman editors), Springer LNCS 2340 (2002) 308-320. 14. E. Winfree, X. Yang, N.C. Seeman, Universal computation via self-assembly of DNA: some theory and experiments, DNA computers II, (L. Landweber, E. Baum editors), AMS DIMACS series 44 (1998) 191-214. 15. E. Winfree, F. Liu, L.A. Wenzler, N.C. Seeman, Design and self-assembly of twodimensional DNA crystals, Nature 394 (1998) 539-544. 16. Y. Sakakibara, C. Ferretti, Splicing on tree-like structures, DNA computers III, (H. Rubin, D.H. Wood editors.) AMS DIMACS series 48 (1999) 361-275. 17. Y. Zhang, N.C. Seeman, The construction of a DNA truncated octahedron, J. Am. Chem. Soc. 160 (1994) 1661-1669.
DNA Nanotubes: Construction and Characterization of Filaments Composed of TX-tile Lattice Dage Liu, John H. Reif, and Thomas H. LaBean Department of Computer Science Duke University, Durham, NC 27708 USA {liudg, reif, thl}@cs.duke.edu
Abstract. DNA-based nanotechnology is currently being developed for use in biomolecular computation, fabrication of 2D tile lattices, and engineering of 3D periodic matter. Here we present recent results on the construction and characterization of DNA nanotubes – a new self-assembling superstructure composed of DNA tiles. Triple-crossover (TAO) tiles modified with thiol-containing dsDNA stems projected out of the tile plane were utilized as the basic building block. TAO nanotubes display a constant diameter of approximately 25 nm and have been observed with lengths up to 20 microns. We present high resolution images of the constructs from transmission electron microscopy (TEM) and atomic force microscopy (AFM) as well as preliminary data on successful metallization of the nanotubes. DNA nanotubes represent a potential breakthrough in the self-assembly of nanometer scale circuits for electronics layout since they can be targeted to connect at specific locations on largerscale structures and can subsequently be metallized to form nanometer scale wires. The dimensions of these nanotubes are also perfectly suited for applications involving interconnection of molecular scale devices with macroscale components fabricated by conventional photolithographic methods.
1 1.1
Background & Introduction Self-assembling DNA Nanostructures
Adleman’s initial report of the experimental implementation of an artificial computer utilizing DNA molecules as integral components has helped to spur widespread interest in the use of DNA in information processing systems [1]. DNA-based computing can be thought of as a subfield of the broader endeavor known as DNA nanotechnology [2], [3], [4], [5], [6]. These enterprises seek to engineer synthetic DNA polymers to encode information necessary for realization of desired structures or processes on the molecular level. Properly designed sets of DNA oligonucleotides are able to self-assemble into complex, highly organized structures. The major advantage of DNA as a self-assembling structural material over all other currently known chemical systems is DNA’s well-understood base-pairing M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 10–21, 2003. c Springer-Verlag Berlin Heidelberg 2003
DNA Nanotubes
11
rules which essentially act as a programming language with which to input organizational instructions. In particular, B-form DNA, the structure adopted by double-stranded DNA (dsDNA) under standard solution conditions, consists of the famous, anti-parallel, double-helix of complementary strands. Its specifically programmable molecular recognition ability, as well as the huge diversity of available sequences, make DNA ideal for controlling the assembly of nanostructures. Annealing of complementary strands is achieved by simply heating dissolved oligonucleotide strands above their dissociation temperature then cooling them very slowly thus allowing strands to find their sequence complements and bind. Unpaired, single-strand regions (ssDNA) extending from the ends of doublestrand domains can be used to specifically bind other dsDNA displaying a complementary ssDNA sticky-end. Regions of ssDNA therefore, can act as address codes capable of orienting attached substructures to neighboring points in 3space. If DNA is appended to nanoscale objects and chemical moieties, it can act as smart glue for organizing such objects and group in space. An obvious advantage of DNA self-assembly for fabrication is the simultaneous creation of millions or billions of copies of a desired structure due to the massive parallelism inherent in molecular processes. 1.2
DNA Tiles, Lattices, and Templates
DAO
TAE
Fig. 1. Example DNA tiles. DAO 2 double helices, 2 crossovers. TAE 3 double helices, 4 crossovers. TAO tiles with some important features of each were used in construction of the nanotubes. DNA nanotechnology and some approaches to DNA-based computing rely on unusual structural motifs including the immobile branched junction [2], [7] which is a stable analogue of the Holliday intermediate in genetic recombination [8]. Normal, linear double-strand DNA can only be used to form linear, 1D structures, while DNA complexes containing stable branched junction motifs
12
Dage Liu, John H. Reif, and Thomas H. LaBean
can be used to construct 2D and 3D lattices. The smallest stable complexes contain two branched junctions (also known as “crossovers”) connecting two double helices [9] where the helices are designed to be co-planar and are said to be linked by strand exchange at the crossover points. One strand from each helix crosses over and begins base-pairing on the opposite helix. These complexes are known as DX tiles; TX tiles contain three coplanar double-helices linked at each of four crossover points. An example of a DX and a TX tile are shown in Figure 1. DNA tiles can be programmed to assemble in large 2-dimensional sheets or lattices by properly designing their sticky-ends. Lattices composed of hundreds of thousands of DX or TX tiles and extending up to at least 10 microns on their long edge have been created and examined by AFM and TEM [10], [11]. Surface features of DX lattices have been manipulated not only by addition of hairpins directed out of the lattice plane, but also by enzymatic cleavage and by annealing of DNA carrying sticky-ends complementary to projecting ssDNA [12]. Besides being attractive structural members for simple lattice formation, multi-helix tiles have been utilized as components of self-assembling DNA computers [13], [14], [15]. Shown in Figure 2 is a schematic of a simple periodic tile lattice composed of two tile types (A and B*) and a TEM image from an assembled lattice. The neighbor relations of tiles in the lattice are shown on the far left. Given cornerto-corner tile associations and matching rules as shown, where 1 binds to 1’, 2 to 2’, etc., assembled sheets exhibit the pattern shown with alternating stripes of light (A) and dark (B*) tiles.
1 3
A
2
A
4
A
A B* B*
A
A
4’ 2’
3’
B*
A
1’
A
A
A
A
B* A
B* A
B*
B* A
B*
B* A
B*
A B*
B*
B*
B*
B* A
B*
B*
A
A B*
A
B* A
B*
B*
Fig. 2. Schematic and Platinum Rotary Shadow-TEM image of DNA lattice composed of two types of TAO tile: with (dark) and without (light) stem-loops directed out of the lattice plane. Stripes of dark B* tiles are approximately 28 nm apart as expected. Note that individual tiles with 14x6.5 nm edge dimensions are discernible. The TAO tiles used in the construction of the DNA nanotubes described here are very slightly modified versions of those described above and explained in detail previously [11]. One aim of further development of these tile and lattice structures is their use are templates upon which to organize desired patterns of materials other than DNA, for example, metals, carbon nanotubes, proteins, and peptides. Such DNA templates may be useful as scaffolds for the
DNA Nanotubes
13
creation of nanoelectronic circuits and other desired objects and devices requiring nanometer scale feature resolution. Toward this end, we tested various attachment chemistries for modification of tiles and lattices including the incorporation of thiol groups (-SH). Here we report on the interesting filamentous structures which resulted from some of these chemical modifications, analysis of the nanotube structures, preliminary results of metallization of the tubes, and some speculation on their possible future usefulness as nanowire templates and as nano- to micro-scale interconnects.
2 2.1
Materials and Methods DNA Seq. Design, Synthesis, Purification, Annealing
The TAO tiles used here have been extensively described and characterized [11]. Briefly, oligonucleotide sequences were designed using a random hill-climbing algorithm to maximize the likelihood of formation of the desired base-pairing structures while minimizing the chances of spurious pairings; tiles were shown to form as designed by electrophoretic and chemical analyses; and large, flat lattice sheets were observed by AFM imaging. Custom oligonucleotides were ordered (Integrated DNA Technology) and gel purified after receipt. Sequences of oligos used here (in 5’ to 3’ direction) are: Tile type A: A1: TCGGCTATCGAGTGGACACCGAAGACCTAACCGCTTTGCGTTCCTGCTCTAC A2: AGTTAGTGGAGTGGAACGCAAAGCGGTTAGGTCTTCGGACGCTCGTGCAACG A3: ACGAGCGTGGTAGTTTTCTACCTGTCCTGCGAATGAGATGCCACCACAGTCACGGATGGACTCGAT A4: TGCTCGGTAGAGCACCAGATTTTTCTGGACTCCTGGCATCTCATTCGCACCATCCGTGACTGTGGACTAACTCCGCTT
Tile type B*: B1: CGAGCAATGAAGTGGTCACCGTTATAGCCTGGTAGTGAGCTTCCTGCTGTAT B2: ACACAGTGGAGTGGAAGCTCACTACCAGGCTATAACGGACGATGATAAGCGG B3a: AGCCGAATACAGCACCATCTTTTGATGGACTCCTGAATCGACGTAACTT B3b: TTGTTACGTCTTTCTACTCGCACCTTCGCTGAGTTTGGACTGTGTCGTTGC B4: ATCATCGTGGTTCTTTTGAACCTGACCTGCGAGGTATGTGATTTTTCACATACTTTAGAGATTCACCAAACTCAGCGAAGGACTTCAT B4a: ATCATCGTGGTTCTTTTGAACCTGACCTGCGAGGTATGTGATTT B4b: TTCACATACTTTAGAGATTCACCAAACTCAGCGAAGGACTTCAT
Strand B3a was ordered with (B3aSH) and without (B3a) a thiol group attached to its 5’ end, while B3b was made with (B3bSH) and without (B3b) a thiol on its 3’ end. The 5’ end of strand B3a and the 3’ end of B3b form a basepaired stem projecting out of the plane of the tile, likewise for B4a and B4b. Thiol modified oligos were delivered with –SSH moieties and were reduced to –SH by treatment with dithiothreitol (DTT) and buffer exchanged into annealing buffer by gel permeation chromatography prior to use (NAP-5 columns, Pharmacia).
14
Dage Liu, John H. Reif, and Thomas H. LaBean
Oligos were annealed to form tiles and lattices in stoichiometric mixtures by heating to 95˚C for 5 minutes and slowly cooling to room temperature in a thermal cycler by dropping 0.1˚C per minute (total annealing time was approximately 12 hours). Exact stoichiometry is determined, if necessary, by titrating pairs of strands designed to hydrogen bond, and visualizing them by nondenaturing gel electrophoresis; absence of monomer is taken to indicate equimolar ratios have been achieved. 2.2
Polyacrylamide Gel Electrophoresis
Gels contain 8 to 10% acrylamide (19:1, acrylamide:bisacrylamide) and a buffer consisting of 40 mM Tris-HCl (pH 8.0), 2 mM EDTA and 12.5mM magnesium acetate (TAEMg) was used for non-denaturing gels, while a Tris-borate EDTA buffer without magnesium was used for denaturing gels which also contained 8.3 M urea. The DNA was dissolved in 10 µL of TAEMg or in water. Tracking dye (1 µL) containing TAEMg, 50% glycerol and 0.2% each of Bromophenol Blue (plus Xylene Cyanol FF in non-denaturing gels) is added to the sample buffer. Gels are run on a Hoefer SE-600 electrophoresis unit at 4 V/cm at room temperature (Non-denaturing) or 55˚C (Denaturing), and exposed to X-ray film for up to 15 hrs or stained with Stains-all (0.01% Stains-All from Sigma, 45% formamide) or ethidium bromide, then photographed. 2.3
TEM (Direct, Negative Stain, Platinum Rotary Shadow)
Transmission electron micrographs were obtained on a Phillips 301 TEM. Direct examination of DNA structures was carried out by pipetting 2-4 µL of annealed DNA solution onto a copper grid which had previously been layered with carbon film. Negative staining involved application of ∼10 µL of 2% uranyl acetate solution to the grid. In all cases excess liquid was blotted from the sample by lightly touching an edge or corner of filter paper to the edge of the grid. Platinum rotary shadow samples were prepared by gently mixing annealed DNA sample with one volume of 80% glycerol, then spraying the mixture onto freshly cleaved mica using a micro capillary and compressed air. The sample was dried on the mica under high vacuum overnight in a Balzer evaporator, tilted to a 4◦ angle, and rotated 180◦ (around the normal to the sample plane) during deposition by thermal evaporation of a thin layer of platinum. The sample was then tilted to 90◦ (flat faced toward the electrodes) and coated with a carbon layer. The carbon/platinum film was floated off the mica onto the surface of a domed droplet of buffer and finally captured on a copper grid. Samples were air dried prior to examination in the TEM. 2.4
AFM (Tapping Mode in Air)
Atomic force micrographs were obtained on a Digital Instruments Nanoscope III with a multimode head by tapping mode in air. AFM tips (Silicon OTESTP)
DNA Nanotubes
15
were obtained from Digital Instruments. Samples were prepared by pipetting annealed DNA solution (∼2 µL) onto freshly cleaved mica (Ted Pella, Inc.), allowed to adhere 2 minutes, rinsed gently by doming a drop of milliQ water onto the mica, then air dried either under a stream of nitrogen or by gentle waving.
3
Experimental
In order to develop DNA tile self-assemblies as templates for nano-scale patterning of various materials we tested chemically modified oligonucleotides in several attachment chemistry schemes. First, thiolated DNA strands were studied for reaction with monofunctional monomaleimido nanogold (1.4 nm) (Nanoprobes, Inc., Yaphank, NY)) and with nanoparticulate gold colloid (4 – 10 nm) formed by the reaction of gold chloride with sodium borohydride. Next, oligos labeled with a free amine on the 5’ or 3’ end were reacted with monofunctional sulfo-N-hydroxysuccinimido nanogold (1.4 nm) (Nanoprobes, Inc.). Finally, thiol modified oligos were studied under conditions which promoted the formation of disulfide and polysulfide structures between tiles and lead to observations of DNA nanotube formation.
Fig. 3. AFM image of TAO AB* Nanotube. Stripes perpendicular to the long axis of the filaments are clearly visible and indicate closed ring structures in successive layers rather than a spiral structure which would have given stripes with noticeable diagonal slant.
Previous imaging of TAO AB* flat, lattice sheets demonstrated lattice fragments with widely varying dimensions and often with rough edges. On the other hand, DNA nanotubes exhibit uniform apparent diameter of approximately 25 nm for lengths of 10 to 20 microns. These structures were observed by AFM and TEM on negative stained samples. AFM peak-peak width measurement
16
Dage Liu, John H. Reif, and Thomas H. LaBean
indicated that the individual subunit is separated by 27 nm. AFM height measurements (Figure 3) give a mean value of ∼4.4 nm, which is twice the height of the two-dimensional DNA nanostructure.
{
{
{
{
SS
A
B*
A
B*
Fig. 4. Schematic drawing of a proposed structure for the DNA nanotubes. Shown are layers consisting of six tiles.
Figure 4 shows a section of the proposed structure of the tubes with B* tile layers alternating with A tile layers, dsDNA helix axes are aligned parallel with the tube axis, sulfur groups are located inside the tube, and there are approximately 6 or 8 tiles per ring layer. Negative stained TEM samples (Figures 5 and 6) have provided images of sufficiently high resolution to observe that B* stripes (from outwardly projecting dsDNA stems) are perpendicular to the long axis of the fibers. This provides good evidence for an even number of tiles per ring layer and flat rings rather than a spiral structure, but based on the tube diameter there may be 8 tiles per layer rather than 6 depending upon how much the tubes are flattened during sample preparation and the extent of feature broadening artifacts in AFM examinations.
400 nm
200 nm
Fig. 5. Negative stained TEM images. The right panel is a zoom in on the structure observed on the far left of the left-hand panel. It appears to show a portion of a long, well-formed nanotube which has torn open along and parallel to the main axis of the tube. B* tube stripes are visible.
DNA Nanotubes
17
It is interesting that the negative stained TEM shows detailed information of the fiber with unit periodicity of 27 nm, in good agreement with the modeled length of AB* tile. The width of the fiber is around 25 nm. These indications show that the modified AB* tiles assembled periodically and their further selfassembly lead to the formation of regular DNA fibers. It is necessary to point out that, for the self-assembled DNA two-dimensional nanostructure sample after the same negative staining treatment, only outlines of the two-dimensional sheets could be discerned by TEM, no further detailed periodic unit structure could be identified (data not shown). The contrast difference between negative stained TEM samples of 2D lattice sheets and nanotubes indicates a significant structural difference between the assemblies. The DNA tube structure containing a hole inside may accommodate relatively more negative staining agent, and thus show relatively stronger contrast and reveal more detailed periodic unit structure. The revealed DNA tube structure by AFM appears relatively fatter than that imaged by TEM, which is due to the well-known convolution effect in AFM images.
250 nm
Fig. 6. TEM of negative stained image. B* tile layers are again discernable along with what appears to be merger or bifurcation structures.
Figure 6 demonstrates another structural feature observed with low but significant frequency – the bifurcation or merging of tubes. Further experiments are required to clarify whether these are actual forks in the tile superstructures or if they are artifacts of the sample preparation and examination, however, they may turn out to be useful for targeted binding and interconnect formation if their formation can be in some way controlled. Burial of the sulfur moieties within the tubes makes logical sense because disulfide bridges and poly-sulfide rings are preferred structures formed by thiol groups under physiologic-like solution conditions such as those employed here. Internalized sulfur is also indicated by the lack of thiol available for gold binding on the outer surface of the tubes and by the tubes’ ability to bind nanogold on their surface if amino groups are added
18
Dage Liu, John H. Reif, and Thomas H. LaBean
to the dsDNA stem on the face opposite the thiol containing stem on the B* tiles (see Figure 9).
Fig. 7. Negative stained TEM image of a large colloidal gold particle apparently bound to the very end of a DNA nanotube where some exposure of sulfur could occur.
The possible existence of free thiols on the outer surface of the nanotubes was probed using two different gold reagents with reactivity toward sulfur – monomaleimido nanogold and fresh colloidal gold nanoparticles. The monofunctional nanogold failed to react significantly with the tube surfaces, while the colloidal gold displayed the interesting reactivity illustrated in Figure 7. With very low background levels of unbound gold, the bound gold particles showed a very high probability of attachment to the ends of nanotubes and not to the outer surface anywhere else along the tubes’ length. The indication is that sulfur which is buried within the tubes becomes exposed to some extent at the open ends of the nanotubes. This observation, besides offering prima facia evidence of the location of the sulfur groups, may also be exploited in future work on targeted binding or formation of electrical contacts with the ends of DNA nanotubes. To test the effect of thiol oxidation state on nanotube formation, the same set of oligos was annealed in the presence of 20 mM dithiothreitol (DTT). AFM observation of this sample showed a DNA nanostructure rather different than the nanotubes (Figure 8). The former appears to be two sheets of self-assembled DNA nanostructure stacked one on top the other. There may be interactions between –SH group from one sheet to another sheet. Further experiments must be completed to clarify an interpretation of this observation. To test metallization of the DNA nanotubes in order to produce functional nanowires and also to further characterize the orientation of TAO tiles in the tubular lattices, primary amine groups were added to the oligonucleotides (B4a and B4b) which base-pair to form the dsDNA stem projecting out of the tile plane and on the tile face opposite that of the thiol-containing stem. According
DNA Nanotubes
19
Fig. 8. AFM image of nanotube forming oligonucleotides which were annealed in the presence of 20 mM DTT.
to our model of the nanotubes, this should place the primary amines on the outside of the tubes and accessible to reaction with to sulfo-N-hydroxy-succinimido nanogold.
a
Fig. 9. AFM images of DNA nanotubes with 1.4 nm gold particles bound to the outer surface (left panel), with 1.4 nm gold followed by 2 minute reaction with silver enhancement reagent (middle panel), and 1.4 nm gold with 5 minute silver enhancement.
As shown in Figure 9, incorporation of amine modified oligo allowed reaction with the monofunctional nanogold reagent which successfully bound 1.4 nm gold particles to the outside surface of the assembled tubes. Reaction with unmodified tubes resulted in no gold labeling (data not shown). Also shown in Figure 9 are progressive time points of chemical silver deposition onto the prebound gold nanoparticles. Silver deposition is one possible route to the complete metallization of DNA nanotubes for formation of functional nanowires. The sil-
20
Dage Liu, John H. Reif, and Thomas H. LaBean
ver enhancement reagent does not deposit silver efficiently onto DNA nanotubes in the absence of bound nanogold.
4
Discussion and Conclusions
Use of a programmable, self-assembling polymer like DNA appears to be one of the most promising avenues available for positioning components for molecule electronics and for targeted connections which can subsequently be metallized to form functional nanowires. The annealing of oligonucleotides has already been used to direct specific association of gold nanospheres into 3D clusters [16], [17], [18]. Nanometer-scale gold rods have also been bound to one another via hybridization of oligonucleotides [19]. The assembly of a silver wire between two prefabricated leads by a DNA hybridization technique has also been reported [20]. However, previous studies have utilized only linear dsDNA, therefore the available structures were limited and fine control of associations was not sufficiently diverse to allow for a wide selection of programmable superstructures. The length scale of the DNA nanotubes described here is intermediate between the molecular world where distances are measured in ˚ Angstroms (10−10 meters) and the macro world, the lower end of which can be measured in microns (10−6 meters). One eventual goal of this line of basic research and materials development is the fabrication of reliable interconnects useful in bridging between these disparate length scales. Acknowledgements. This work was supported in part by research grants from DARPA/NSF (NSF-CCR-97-25021), from NSF (NSF-EIA-00-86015), and from a sponsored research agreement with Taiko Denki Co., Ltd., Tokyo.
References 1. Adleman, L.M. (1994) Molecular computation of solutions to combinatorial problems. Science 266, 1021-1024. 2. Seeman, N.C. (1982) Nucleic Acid Junctions and Lattices. J. Theor. Biol. 99, 237247 . 3. Seeman, N.C. (1999) “DNA engineering and its application to nanotechnology”, Trends in Biotechnology 17, 437-443. 4. Reif, J.H., LaBean, T.H., and Seeman, N.C., (2001) Challenges and Applications for Self-Assembled DNA Nanostructures, Proc. Sixth International Workshop on DNA-Based Computers, Leiden, The Netherlands, June, 2000. DIMACS Series in Discrete Mathematics and Theoretical Computer Science, Edited by A. Condon and G. Rozenberg. Lecture Notes in Computer Science, Springer-Verlag, Berlin Heidelberg, vol. 2054, pp. 173-198. 5. LaBean, T.H. (in press, 2002) Introduction to Self-Assembling DNA Nanostructures for Computation and Nanofabrication. in CBGI 2001, Proceedings from Computational Biology and Genome Informatics, held 3/2001 Durham, NC, World Scientific Publishing.
DNA Nanotubes
21
6. Reif, J.H. (to appear, 2002) DNA Lattices: A Programmable Method for Molecular Scale Patterning and Computation, to appear in the special issue on BioComputation, Computer and Scientific Engineering Journal of the Computer Society. 2002. 7. Seeman, N.C.; Chen, J.-H.; Kallenbach, N.R., 1989 Electrophoresis 10 345-354. 8. Holliday, R. (1964) Genet. Res. 5, 282-304. 9. Fu, T.-J. and Seeman, N.C. (1993) Biochemistry 32, 3211-3220. 10. Winfree, E., Liu, F., Wenzler, L.A., and Seeman, N.C. (1998) “Design and SelfAssembly of Two-Dimensional DNA Crystals”, Nature 394, 539-544. 11. LaBean, T. H., Yan, H., Kopatsch, J., Liu, F., Winfree, E., Reif, J.H. & Seeman, N.C. (2000) “The construction, analysis, ligation and self-assembly of DNA triple crossover complexes”, J. Am. Chem. Soc. 122, 1848-1860. 12. Liu, F. R., Sha, R. J. and Seeman, N. C. (1999) Modifying the surface features of two-dimensional DNA crystals, J. Am. Chem. Soc. 121, 917-922. 13. LaBean, T.H., Winfree, E., and Reif, J.H. (2000) “Experimental progress in computation by self-assembly of DNA tilings”, 5th DIMACS Workshop on DNA Based Computers, MIT, June, 1999. DNA Based Computers, V, DIMACS Series in Discrete Mathematics and Theoretical Computer Science, (ed. E. Winfree), American Mathematical Society, 2000. 14. Winfree, E., Yang, X., Seeman, NC, “Universal Computation via Self-assembly of DNA: Some Theory and Experiments.” In DNA Based Computers II: DIMACS Workshop, June 10-12, 1996 (Volume 44 in DIMACS). Laura F. Landweber and Eric B. Baum, editors. American Mathematical Society, 1998, 191–213. 15. Mao, C., LaBean, T.H., Reif, J.H., and Seeman, N.C. (2000) “Logical computation using algorithmic self-assembly of DNA triple-crossover molecules”, Nature, 407 493-496. 16. Alivisatos, A.P., K.P. Johnsson, X. Peng, T.E. Wilson, C.J. Loweth, M.P. Bruchez Jr., and P.G. Schultz (1996) Organization of ’nanocrystal molecules’ using DNA. Nature, 382, 609-611. 17. Mirkin, C.A., Letsinger, R.L., Mucic, R.C., and Storhoff, J.J. (1996) “A DNABased Method For Rationally Assembling Nanoparticles Into Macroscopic Materials”, Nature 382, 607-609. 18. Mucic, R. C.; Storhoff, J. J.; Mirkin, C. A.; Letsinger, R. L., (1998) “DNA-directed synthesis of binary nanoparticle network materials”, J. Am. Chem. Soc. 120, 1267412675. 19. Mbindyo, J.K.N., Reiss, B.D., Martin, B.R., Keating, C.D., Natan, M.J., and Mallouk, T.E. (2001) Advanced Materials 13, 249-254. 20. Braun, E., Eichen, Y., Sivan, U., and Ben-Yoseph, (1998), G. DNA-templated assembly and electrode attachment of a conducting silver wire, Nature 391, 775778.
The Design of Autonomous DNA Nanomechanical Devices: Walking and Rolling DNA John H. Reif Department of Computer Science, Duke University, Box 90129, Durham, NC 27708-0129. [email protected]
Abstract. We provide designs for the first autonomous DNA nanomechanical devices that execute cycles of motion without external environmental changes. These DNA devices translate across a circular strand of ssDNA and rotate simultaneously. The designs use various energy sources to fuel the movements, include (i) ATP consumption by DNA ligase in conjunction with restriction enzyme operations, (ii) DNA hybridization energy in trapped states, and (iii) kinetic (heat) energy. We show that each of these energy sources can be used to fuel random bidirectional movements that acquire after n steps an expected translational √ deviation of O( n). For the devices using the first two fuel sources, the rate of stepping is accelerated over the rate of random drift due to kinetic (heat) energy. Our first DNA device, which we call walking DNA, achieves random bidirectional motion around a circular ssDNA strand by use of DNA ligase and two restriction enzymes. Our other DNA device, which we call rolling DNA, achieves random bidirectional motion without use of DNA ligase or any restriction enzyme, and instead using either hybridization energy (also possibly just using kinetic (heat) energy at a unfeasible low rate of resulting movement).
1
Introduction
Prior Work. Nanomechanical devices built of DNA have been developed using two distinct approaches: (i) Seeman’s group [MSS+99] used rotational transitions of dsDNA conformations between the B-form (right handed) to the Z-form (left-handed) controlled by ionic effector molecules and extended this technique to be DNA sequence dependant [YZS+02]. (ii) Yurke and Turberfield[YTM+00, YMT00,TYM00] demonstrated a series of DNA nanomechanical devices that used a fuel DNA strands acting as a hybridization catalyst to generate a sequence of motions in another tweezers strand of DNA; the two strands of DNA bind and unbind with the overhangs to alternately open and shut the tweezers.
Supported by DARPA/AFSOR F30602-01-2-0561, NSF ITR EIA-0086015, DARPA/NSF CCR-9725021. Paper URL: http://www.cs.duke.edu/∼reif/paper/DNAmotor/DNAmotor.pdf
M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 22–37, 2003. c Springer-Verlag Berlin Heidelberg 2003
The Design of Autonomous DNA Nanomechanical Devices
23
These prior DNA nanomechanical devices have some key restrictions that restrict their use: (a) they can only execute one type of motion (rotational or translational). It seems feasible to re-design these DNA nanomechanical devices to have both translational and rotational motion, but this still needs to be done. (b) More importantly, these prior DNA devices require environmental changes such as temperature cycling or bead treatment of biotin-streptavidin beads to make repeated motions. The Technical Challenge. A key challenge, which we address in this paper, is to make an autonomous DNA nanomechanical device that executes cycles of motion (either rotational or translational or both) without external environmental changes. Our Results. We provide designs for two autonomous DNA nanomechanical devices. Both move across a circular ssDNA strand which we call a road and simultaneously exhibit both translational and rotational movement. However, they use distinct energy sources to fuel the movements. (i) Our first nanomechanical device design, which we call walking DNA, uses as its energy source ATP consumption by DNA ligase in conjunction with two restriction enzyme operations. Our walking DNA construction, though technically quite distinct and with a different objective, might be viewed as analogous to Shapiro’s recent autonomous DNA computing machine [BPA+01].
Rolling DNA Device
Walking DNA Device dsDNA Walker
ssDNA Road:
ssDNA Road:
Bidirectional Translational & Rotational Movement
ssDNA Roller:
Bidirectional Random Translational& Rotational Movement
Fig. 1. (a)The DNA Walking Mechanism. (b)The DNA Rolling Mechanism. (ii) Our next nanomechanical device design, which we call rolling DNA (Note: the illustration on the right in Figure 1has been simplified; the small wheel loop DNA strand would in fact be topologically linked (intertwined) with the road strand of DNA). It makes no use of DNA ligase or any restriction enzyme. Instead, it uses as its energy source the hybridization energy of DNA in temporally trapped states. This involves the use of fuel DNA and the application of DNA catalyst techniques for liberating DNA from these loops conformations, and to harness their energy as they transit into lower energy conformations. Unlike the prior work of [YTM+00,YMT00,TYM00], our resulting nanomechanical device is autonomous. We also observe that a similar movement, but possibly at an
24
John H. Reif
unusable lower rate, can also be achieved using this basic design using simply kinetic (heat) energy. Potential Applications. In principle, these DNA nanomechanical devices can be incorporated at multiple sites of larger DNA nanostructures such as selfassembled DNA lattices. The DNA nanomechanical devices might be used to induced movements to hold state information and to sequence between distinct conformations. Possible applications include: (a) Array Automata: The state information could be stored at each site of a regular DNA lattice (see [WLW98,S99,LYK+00,LWR00,MLR+00,RLS01,R01]), and additional mechanisms for finite state transiting would provide for the capability of a cellular array automata. (b) Nanofabrication: These capabilities might be used to selectively control nanofabrication stages. The size or shape of a DNA lattice may be programmed through the control of such sequence-dependent devices and this might be used to execute a series of foldings (similar to Japanese paper folding techniques) of the DNA lattice to form a variety of 3D conformations and geometries.
2
Our Walking DNA Device
Here we describe a DNA nanomechanical device (see Figure 1a) that achieves autonomous bidirectional translational and rotational motion along a DNA strand. We will be using, as the energy source, ATP consumption by DNA ligase in conjunction with restriction enzyme operations. We will use the following notation: (i) superscript R to denote the reverse of a sequence, and (ii) overbar to denote the complement of an ssDNA sequence. Overview of Our Walking DNA Device Construction. The basic idea is to form a circular repeating strand R of ssDNA we call the road, which will be written in 5 to 3 direction from left to right. The road (See Figure 2 ) will consist of an even number n of subsequences, which we call steppingstones, indexed from 0 to n-1 modulo n. The ith steppingstone consists of a length L(where L is between 15 to 20 base pairs) sequence Ai of ssDNA. (In our constructions, the Ai repeat with a period of 2.) A0
A1
A2 …An-1
An … …
Fig. 2. The DNA Road. Let us designate the direction 5 to 3 to be direction right on the road R, and let us designate the direction 3 to 5 to be direction left on the road R. At any given time, there is a unique a partial duplex DNA strand Wi which we call the th i th walker with 3 ends Ai−1 and Ai that are hybridized to consecutive (i − 1) th and i steppingstones Ai−1 and Ai , respectively, as illustrated on the left in Figure 3.
The Design of Autonomous DNA Nanomechanical Devices
Wi
Wi+1:
A i-1
A0
25
A1 … Ai-1
Step
Ai
Ai
Ai+1
A0
A1 … Ai-1
Ai
A i+1
Ai
Ai+1
Fig. 3. A Step of the DNA Walker The Goal of the Device Construction. The below construction will have the goal of getting the ith walker Wi to reform to another partial duplex DNA strand, namely the (i+1)th walker Wi+1 which is shifted one unit over to the left or the right. In the case of the latter movement to the right, the movement results in the 3 ends Ai and AI+1 being hybridized to consecutive ith and (i + 1)th steppingstones Ai and Ai+1 , respectively, as illustrated on the right in Figure 3(the movement to the left is reversed). Hence, the movement we will achieve is bidirectional, translational movement either in the 5 to 3 direction (from left to right) on the road, or in the 3 to 5 direction. We will describe in detail the movement in the 5 to 3 direction, and then observe that the in the 3 to 5 direction is also feasible. We cycle back in 2 stages, so that Wi+2 = Wi for each stage i. To achieve the movements, we will use two distinct type-2 restriction enzymes. We will also make use of DNA ligase, which provides a source of energy (though ATP consumption) and a high degree of irreversibility. Simultaneous Translational and Rotational Movements. Due to the well known secondary structure of B-form dsDNA (rotating 2π radians every approx 10.5 bases), it follows that in each such step of translational movement, the walker will rotate around the axis of the road by approximately L2π/10.5 = Lπ/5.25 radians. Hence the DNA walker construction will execute a very simple type of motion with simultaneous translation and rotation. Avoiding Unwanted Interactions. To ensure there is no interaction between a walker and more than one distinct road at a time, we use a sufficiently low road concentration and solid support attachment of the roads. To ensure there is no interaction between a road and more than one walker, we use a sufficiently low walker concentration. Details of Our Device Construction. In the following detailed description given below, we describe the sequence of movements involving all the components: walker, road, restriction enzymes and ligase. And we provide a sequence of cartoon Figure s illustrating these movements. Definition of the Walker and Oglionucleotides used in Walking DNA Construction: For each i = 0, 1, we define ssDNA (in the 5‘ to 3‘ direction): R R R Ci−1 C i B i Ai R . Here Bi (a) Gi = BiR CiR C i−1 B i−1 Ai−1 and (b) Hi = Bi−1 Ci and the previously defined Ai are distinct oglionucleotides of low annealing cross-affinity. To ensure we cycle back in 2 stages, the subscripts of the Ai Bi Ci are taken modulo 2, and so: Ai+1 = Ai−1 , Bi+1 = Bi−1 and Ci+1 = Ci−1
26
John H. Reif
for each i. Note that Gi has subsequence BiR CiR C i−1 B i−1 and Hi has, as a R R subsequence, the reverse complement Bi−1 Ci−1 C i B i of that subsequence. We th define the i walker Wi to be the partial duplex resulting by hybridization of Gi and Hi at these reverse complementary subsequences, with ssDNA 3‘ overhangs Ai−1 and Ai , as given in Figure 4.
BiR B iR
Ai
CiR C i-1 C iR
Fig. 4. (a)The DNA walker. (b)The DNA stepper. We inductively assume that ith walker Wi has the 3 end Ai−1 of its component strand Gi hybridized to steppingstone Ai−1 on the road R and the 3 end Ai of its component strand Hi hybridized to steppingstone Ai on the road R. Definition of the Stepper: To aid us in this movement, for each i = 0, 1 we include in solution the following partial duplex Si which we call the i th stepper strand illustrated on the right in Figure 4. Note that each of the ith steppingstone Ai subsequences will hybridize with a complementary subsequence Ai of the ith stepper Si . We assume that this occurs at each steppingstone, except the steppingstones where the walker’s ends are hybridized, as illustrated on the left in Figure 5.
Ci
A
0
A0
A1 …
A i-1
Ai
A1 … Ai-1 Ai
A
i+1
Ai+1
… …
Restriction Enzyme Cleavage
CiR
A0
A1 …
A i-1
Ai
A
A0
A1 … Ai-1
Ai
A
Fig. 5. Cleavage of the DNA walker. Restriction Enzyme Cleavage of the Walker: For each i = 0, 1, we use a type two restriction enzyme that matches with the duplex subsequence containing Ci−1 Bi−1 and its complement C i−1 B i−1 within Wi , and then cleaves Wi just before C i and just after Ci , as illustrated on the right in Figure 6. This can result in the following products: (P1) A i th truncated walker T Wi (still attached to the ith steppingstone Si ) consisting of a partial duplex with an ssDNA overhang (Ci )R at one 3 end, as illustrated on the left in Figure 6, and also (P2) A partial duplex, as also illustrated on the right in Figure 6, which we can observe is the (i − 1)th stepper Si−1 , still attached to the (i − 1)th steppingstone
The Design of Autonomous DNA Nanomechanical Devices
27
Si−1 (To see this is the (i − 1)th stepper Si−1 , note that the right illustration in Figure 6can be flipped left to right and top to bottom so as to be equivalently viewed as C i ; since C i = C i−2 , this above cleavage product is identical to above defined (i − 1)th stepper Si−1 .) with an ssDNA overhang (C i )R at one 3 end.
Ai
BiR CiR B iR
Products of
Cleavage
Fig. 6. Products of the cleavage of the DNA walker. We assume that the sequences of sufficiently short length that the only strands with an ssDNA subsequence C i which can possibly hybridize with the ssDNA subsequence Ci of the above ith truncated walker T Wi are the adjacent steppers Si−1 and Si+1 . Reversals. It will be important to observe, when at the end of this section further below we observe bi-directionality of the movement of the walker, that the walker has two possible (dual) restriction enzyme recognition sites, and so the dual use of the two restriction enzymes also can result in other pair of products, resulting in a reversal of movement. However, to simplify the discussion, we ignore these reversals for the moment. Stalls. Observe that it is certainly quite possible that the above cleavage operation might simply be reversed by re-hybridization of subsequence C i of stepper Si−1 with the complementary subsequence Ci of the above truncated walker T Wi (and possibly a subsequent ligation), reforming the original walker Wi . We will call this restriction enzyme cutting and then re-hybridization a stall event for Wi . Each stall event has a constant probability q, where 0 < q < 1. The consecutive repetition of stall events for Wi might continue any number of times, but as we shall see, the likelihood drops rapidly with the number of repeated stall events. To see this, observe that the number of repeats has, by definition, a geometric probability distribution with geometric parameter p = 1 − q. This geometric probability distribution is known to have expectation E = p/(1 − p), which is a fixed constant. Furthermore, the probability of sE repeats of consecutive stall events for Wi (that is, a factor s more than the expected number E) can be shown to drop exponentially with s, for s > 2. The Stepping of the Walker. In the following, we now consider the case where there have been possibly already been a number of stall events for Wi , but now there is not a further repeat of a stall event for Wi . In this case, we show that what eventually occurs is the intended modification of the truncated walker T Wi into the (i + 1)th walker Wi+1 . Observe that by flipping the left Figure 6for TDi (the flip is top to bottom and left to right), the truncated walker TDi can be redrawn as illustrated on the right in Figure 7and the (i + 1)th stepper strand Si+1 is by definition as illustrated on the left in Figure 7.
28
John H. Reif
Bi
A iR
Ci Bi
Hybridization
Fig. 7. Hybridization with the DNA walker. This (i + 1)th stepper strand Si+1 was assumed to be hybridized with a complementary subsequence Ai+1 of (i + 1)th stepper Si+1 . This (i + 1)th stepper strand Si+1 can also hybridize with the truncated walker T Wi at their C i and Ci ssDNA overhangs, to form the duplex as illustrated on the left in Figure 8, and the DNA ligase can concatenate the strands, forming the following duplex as illustrated on the right in Figure 8.
ligation
Fig. 8. Ligation within the DNA walker. But the above duplex is by definition the (i + 1)th walker Wi+1 . We now claim that this (i + 1)th walker Wi+1 has its 3 ends hybridized to consecutive steppingstones Ai and Ai+1 in its required position as given on the right of Figure 9.
Ci
CiR
A0
A1 …
A i-1
Ai
A i+1
A0
A1 …
A i-1
Ai
A i+1 …
A0
A1 … Ai-1
Ai
Ai+1
A0
A1 …
Ai-1
Ai
Ai+1 …
Fig. 9. State after one cycle of stepping by the DNA walker. This follows since: (a) A 3 end of the ith walker Wi was assumed to be hybridized with a complementary subsequence Ai of stepper Si , so that the same 3 end of the ith truncated walker T Wi remains hybridized with a complementary subsequence Ai of stepper Si , and further the (i + 1)th walker Wi+1 inherits this hybridization of that 3 end. (b) A 3 end of the (i + 1)th steppingstone subsequence Ai+1 was assumed to be hybridized with a complementary subsequence Ai+1 of stepper Si+1 , so it follows the (i + 1)th walker Wi+1 inherits this
The Design of Autonomous DNA Nanomechanical Devices
29
hybridization of that 3 end. The above described movement of the ith walker Wi to reformed (i + 1)th walker Wi+1 on the road R is always from direction 3 to 5 once ligation occurs, and it is very unlikely to be reversed after that. The above discussion of the feasibility of movement in the 3 direction can be summarized as follows:. We assumed the situation STATE(i) where: (a) walker Wi has the 3 end of Gi hybridized to steppingstone Ai−1 and the 3 end of Hi hybridized to steppingstone Ai , and also (b) the steppingstone Ak subsequence is hybridized with a complementary subsequence Ak of stepper Sk , for each k, where k < i − 1ork > i. The above discussion has demonstrated that given STATE(i), and then in an expected constant number of phases, it is feasible for us to have a movement in the 3 direction on the road to STATE(i+1). But this does not complete our description of all possible movements of the walking DNA construction. Feasible Reverse Movements. The above does not ensure the movement is only in the 5 direction along the road. In the above subsection titled “Restriction Enzyme Cleavage of the Walker” we described a pair of products (P1) and (P2) that can result from the use of the restriction enzymes described there. (To simplify the description of 3 movements, we temporarily ignored other possible products in that above discussion.) We now observe that the walker actually has two possible (dual) restriction enzyme recognition sites, so dual use of the two restriction enzymes defined there also can result in: (P1 ) A partial duplex, consisting of the ith stepper Si (still attached to the ith steppingstone Si ) with th an ssDNA overhang (Ci−1 )R at one 3 end, or (P1 ) A (i − 1) truncated walker th T Wi−1 (still attached to the (i − 1) steppingstone Si−1 ) consisting of a partial duplex with an ssDNA overhang ( C i−1 )R at one 3 end. By a similar argument to the above, it can easily be shown: there is also a feasible movement of the walker in the 5 direction on the road from STATE(i) to STATE(i-1). By symmetry, both these possible movements have equal likelihood. Summarizing, we have shown that there are two equally likely movements: (forward) in the 3 direction on the road from STATE(i) to STATE(i+1), and (reverse) in the 5 direction on the road from STATE(i) to STATE(i-1). Expected Drift Via Random Translational Movement and the Use of Latching. We have shown that the resulting movement forms a random, bidirectional translational movements in both directions along the road. Due to the symmetry of the construction, both translational movements would have equal probability in either direction. It is well known (see Feller [F82]) from the theory of random walks in 1 dimension, that the expected deviation after n steps is √ O( n ). We can easily modify the above design to include a “latching mechanism” that fixes the wheels position at specified locations along the road. This can be done by appending to each 3 end of the walker an additional “latching” sequence and also inserting the complements of these “latching” sequences at a specified pair of locations along the road, which can fix (via their hybridization) the walker’s location once the locations are reached and these “latching” hybridizations occur.
30
3
John H. Reif
Our Rolling DNA Device
It is an interesting question whether bidirectional autonomous motion can be achieved without use of DNA ligase or any restriction enzyme and also without changes in the environmental condition of the system. Here we answer the question positively. We give a description of a DNA device (see Figure 1b), that we call Rolling DNA, which achieves bidirectional autonomous motion, without use of DNA ligase or any restriction enzyme and also without changes in the environmental condition of the system. The motion is random and bidirectional, forming a random walk across a DNA strand. Overview of our Rolling DNA Construction. Let A0 , A1 , B0 , B1 each be distinct oglionucleotides of low annealing cross-affinity, consisting of L (L R R R R typically would be between 15 to 20) bases pairs, and let A0 , A1 , B 0 , B 1 each be their respective reverse complements. Let a0 , a1 be oglionucleotides derived from A0 , A1 by changing a small number of bases, so their annealing affinity R R with A0 , A1 respectively is somewhat reduced, but still moderately high. A R hybridization between A0 and reverse complementary sequence A0 (or between R A1 and reverse complementary A1 ) will be called a strong hybridization, where R as a hybridization between a0 and A0 R (or between a1 and A1 ) will be called a weak hybridization. We assume that at the appropiate temporature, strong hybridization will be able to displace a weak hybridization. We now define (using descriptive names) some DNA strands that will be of use: (i) The road (See Figure 10) consists of an ssDNA with a0 , a1 , a0 , a1 , a0 , a1 , . . . in direction from 5 to 3 , consisting of a large number of repetitions of the sequences a0 , a1 .
a0
a1
a0
a1
a0
a1 … …
Fig. 10. The DNA wheel’s road. R
R
R
R
(ii) The wheel consists of a cyclic ssDNA of base length 4L with A0 , A1 , A0 , A1 in direction from 5 to 3 ; this corresponds to A1 , A0 , A1 , A0 in direction from 3 to 5 . (Note: in the following we will illustrate the wheel with the subsequences at the top of the wheel labeled in the 5 to 3 direction, and the subsequences at the bottom of the wheel labeled in the 3 to 5 direction.) The wheel has two distinguished positions with respect to the road: (0) A type 0 wheel position, as illustrated on the left in Figure 11 , where two of the wheel subsequences A0 , A1 are weakly hybridized to a consecutive pair of subsequences R R a0 , a1 on the road. (Note that the left in Figure 11 lists A1 , A0 at top of the circular DNA wheel in the 5 to 3 direction, where as the second pair below the wheel are written in the opposite 3 to 5 direction as A0 , A1 . Also, note that for
The Design of Autonomous DNA Nanomechanical Devices
31 R
R
sake of simplicity in the left in Figure 11 illustration the subsequences A1 , A0 at the top of the wheel are illustrated as not hybridized to any other sequences, but in fact they may also be weakly hybridized to a further consecutive pair of subsequences a0 , a1 of the road.) (1) A type 1 wheel position, as illustrated on the right in Figure 11 , where two of the wheel subsequences A1 , A0 are weakly hybridized to a consecutive pair of subsequences a1 , a0 on the road. (Note again R R that the right in Figure 11 lists A0 , A1 at top of the circular DNA wheel in the 5 to 3 direction, where as the second pair below the wheel are written in the opposite 3 to 5 direction as A1 , A0 . Also, again note that for sake of simplicity R R in the illustration on the right in Figure 11 the subsequences A0 , A1 at the top of the wheel are illustrated as not hybridized to any other sequences, but in fact they may also be weakly hybridized to a further consecutive pair of subsequences a1 , a0 of the road.)
a0
A 1R
A 0R
A0
A1
a1 a0
a1
A 0R
a0
a1 …
Step
…
… a0
A 1R
A1
A0
a1
a0
a1
a0
a1 …
Fig. 11. One step of the wheel’s movement. Note In the Figure 11 illustration the binding of the wheel with the road has been simplified; the wheel DNA strand would in fact be topologically linked (intertwined) with the road strand of DNA. Avoiding Unwanted Interactions. To ensure there is no interaction between a wheel and more than one distinct road at a time (e.g., to ensure the wheel is not sandwiched between two road strands), we use a sufficiently low road concentration and solid support attachment of the roads. To ensure there is no interaction between a road and more than one wheel, we use a sufficiently low wheel concentration. Random Translational Movement Fueled by Heat Energy. Note that the kinetics (similar to those occurring in branch migrations classically found in Holiday junctions with exact symmetry, and very well understood), will allow for a slow rate of random movements of the wheel in direction 5 to 3 or its reverse, resulting in transitions between these two position types. Note that these translational movements would be in both directions along the road. Due to the symmetry of the construction, both translational movements would have equal probability in either direction. √ As noted in the previous section, the expected deviation after n steps is O( n ). Again, it is possible to modify the above design to include a “latching mechanism” that fixes the wheels position at specified locations along the road (e.g., by hybridization with an additional pair of complementary ssDNA strands inserted into in the wheel and also at
32
John H. Reif
a specified pair of locations along the road, which can fix the wheel’s location once the locations are reached and these annealing occur). In each such step of translational movement, the wheel will simultaneously rotate around its center by 2π/4 = π/2 radians. Again, due to the well-known secondary structure of B-form dsDNA (rotating 2Π radians every approxamately 10.5 bases), it follows that the wheel will also rotate around the axis of the road by approximately L2π/10.5 = Lπ/5.25 radians. Hence the above Rolling DNA construction, even without the further elements described below, can be viewed as executing a very simple type of autonomous motion, which is both translational and rotational, fueled by kinetic (heat) energy. (The physics literature is full of schemes – some possibly violating the laws of thermodynamics, and others theoretically feasible but of very limited use - for harnessing heat energy to fuel nanomechanical motion. For a feasible method using heat energy, see [HLN01].) However, by the laws of thermodynamics, this random autonomous motion will eventually reverse itself. Hence, we feel it would likely be too slow to be of use if it is fueled only by heat energy, and we do not feel it could do useful work. We next face the challenge of accelerating this random walk movement via some other energy source. Accelerated Random Movement Fueled by DNA Hybridization. Our construction, further detailed below, will provide for an acceleration of this random walk movement, by the use of fuel DNA strands, which provide a facility of energy exchange. This initial conformation of the fuel DNA is a state, which temporarily traps its hybridization energy. We will describe the application of DNA catalyst techniques for liberating DNA from these loop conformations, and harness their energy as they transition into lower energy conformations. (Note: We wish to emphasize that the idea of using fuel DNA strands and hybridization catalysts to generate a sequence of motions is not a new idea; it was used by Yurke and Turberfield [YTM+00,YMT00,TYM00] to demonstrate a series of DNA nanomechanical devices such as their DNA tweezers. However, to induce repetitions of the motions by their DNA devices, their devices required external environmental changes; in particular, the use of biotin-streptavidin beads.) The main difference here from that prior work is that here we require no external environmental changes to induce repetitions of the motions by our DNA devices. Instead, we will gradually consume the energy of the DNA fuel loop strands. (This was suggested by Turberfield as a possible mechanism for obtaining autonomous motion.) Details of Our Device Construction. (Note: in the following we will illustrate the fuel strands with the subsequences at the top of the stem loops labeled in the 5 to 3 direction, and the subsequences at the bottom of the stem loops labeled in the 3 to 5 direction.) We define: the type 0 primary fuel strand, as illustrated on the left in Figure 12, consisting of an ssDNA of base length 4L R with A1 , A0 , B0 , A1 . Initially, we assume an initial loop conformation (prepared in a distinct test tube from the complementary fuel strand) of the type 0 primary fuel strand, as illustrated in the right in Figure 12, with its 5 end segment
The Design of Autonomous DNA Nanomechanical Devices
33
R
Ai annealed to its 3 end segment Ai and its third segment B i annealed to an R additional strand B i (which we call its protection segment). A1
A1
A0
B0
A 1R
Hybridization
A0
A1
B0R B 0R
at the ends of the primary fuel strand.
Fig. 12. The primary fuel strand. A type 0 complementary fuel strand, as illustrated on the left in Figure 13, R R R consists of an ssDNA of base length 4L with A1 , B 0 , A0 , A1 .Similarly, we assume the following initial loop conformation of the type 0 complementary fuel strand, as illustrated in the right in Figure 13, with its 5 end segment Ai R annealed to its last segment AR i and its third segment Ai is annealed to an additional strand Ai (which we call its protection segment). (The type 1 primary fuel strands and type 1 complementary fuel strands are defined identically to the type 0 primary and complementary fuel strands, respectively, but with the subscripts 0 and 1 exchanged.)
B 0R
A1 A1
Hybridization at the ends of the fuel strand.
A0
A0
Fig. 13. The type 0 complementary fuel strand. Energetics of the Fuel Strands. Note that the whole complementarity of the primary and complementary fuel strands of a given type implies that the duplex DNA resulting from their complete hybridization has lower free energy. So eventually, over a sufficiently long time interval, the free energy will drive these two species to a double stranded duplex, which is their lowest energy equilibrium state. (For example, the Seeman lab has previously demonstrated [LGM+92] that when two 4-arm junctions are mixed together at an appropriately high temperature, and cooled, they will go to 4 duplex.) The duplex DNA consisting of the complete hybridization of the type 0 primary and complementary fuel strands is as given in Figure 14. (The duplex consisting of the complete hybridization of the type 1 primary and complementary fuel strands is identical, but with the 0 and 1 subscripts exchanged.) However, we are concerned with the special case where the primary
34
John H. Reif
A1
A0
A1
A0
B0 B0
A 1R
A1R
Fig. 14. Complete hybridization between the fuel strands. fuel strands and the complementary fuel strand are prepared separately to form the initial conformations define above, By setting a sufficiently low temperature, that equilibrium duplex state can be made to take any given time duration to reach on the average. So we will use an appropriately chosen sufficiently low temperature to ensure that initially, the primary and complementary fuel strands of the same type will each hold its own state and are not likely to anneal to each other to form a duplex state for say 5 hours on the average. Many cycles of motions described below will then be feasible within this limited time interval. The Sequence of Events of a Feasible Movement. Now suppose the wheel is in type 0 position with respect to the road. Observe that the 0th primary fuel strand can interact with the wheel in the type 0 position by the following hybridizations: (i) First a hybridization of the second segment A0 of the 0th primary fuel strand R with the reverse complementary segment A0 of the wheel, resulting in the conformation illustrated on the left in Figure 15. (Note that if one or both of the subsequences A1 , A0 at the top of the wheel were previously weakly hybridized to a further consecutive pair of subsequences a1 , a0 on the road, then these weak hybridizations will be displaced by the stronger hybridization of the second segment a0 of the 0th primary fuel strand with the reverse complementary segment R A0 of the wheel.) (ii) Then that single segment hybridization extends to a hybridization of two first segments A1 , A0 (in the 3 to 5 direction) of the 0th primary fuel strand R R with the consecutive reverse complementary segments A1 A0 (in the 3 to 5 direction) of the wheel. (Note again that the previous weakly hybridization of these wheel subsequences with subsequences of the road, will be displaced by the strong hybridization of subsequences of the primary fuel strand with the reverse complementary segment s of the wheel.) (iii) This displaces the prior hybridization of segment A1 of the wheel strand with road segment a1 (which recall is of lower energy). As a consequence of this: (a) The wheel moves by one segment in the 5 direction along the road, effecting a transition of the state of the wheel from the type 0 position to type 1 position. (b)This also displaces the prior hybridization of the 5 end segment A1 with its R 3 end segment A1 of the primary fuel strand, which now is exposed. This results in the conformation illustrated on the right in Figure 15. Next, a type 0 complementary fuel strand consisting of an ssDNA of base length R R 4L with A1 , B 0 , A0 , AR 1 (in the 3 to 5 direction) is now be susceptible to hybridizations with reverse complementary subsequences of the type 0 primary
The Design of Autonomous DNA Nanomechanical Devices
35
Wheel rotation due to displaced hybridization with primary fuel strand.
Fig. 15. A rotation of the DNA wheels. fuel strand, first at that fuel strand’s newly exposed 3 end segment AR 1 and then at B0 . This results in the conformation illustrated on the left in Figure 16.
A 0R
Hybridization between primary & complementary fuel strands.
… a0
A 1R
A1
A0
a1
a0
a1
a0
a1 …
Fig. 16. Hybridization of the DNA fuel strand withthe wheel. We will show below that the formation of a type 0 fuel strand duplex removes the type 0 fuel strands from the wheel, completing the step, as illustrated on the right in Figure 16. (Also, note that for sake of simplicity, in the illustration R R on the right in Figure 16, the subsequences A0 , A1 at the top of the wheel are illustrated as not hybridized to any other sequences, but in fact they may also be weakly hybridized to a further consecutive pair of subsequences a1 , a0 of the road.) The type 0 fuel strand duplex consists of the mutual hybridization of the entire type 0 primary fuel strand with the type 0 complementary fuel strand, as illustrated in the left in Figure 17. Its formation removes the type 0 fuel strands from the wheel. The same resulting duplex of the type 0 fuel strands is also illustrated on the right in Figure 17(it is flipped top to bottom and left to right), so it can be compared with the prior illustrations of the type 0 primary fuel strands:
A1
B 0R
A 0R
A 1R
A1
B0R
A0R
A1R
FLIP
A1
A0
A1
A0
B0 B0
Fig. 17. Flipping of the DNA fuel strand.
A 1R
A1R
36
John H. Reif
We conclude that: (a) There is a feasible transition of the state of the wheel from type 1 position to type 0 position driven by the fuel strands of type 0, where the wheel moves by one segment in the 5 direction along the road. (b) Also, there is also a similarly feasible transition of the state of the wheel from a type 0 position to type 1 position driven by the type 1 fuel strands, where again the wheel moves by one segment in the 5 direction along the road. (This is almost exactly the same as described above, but with 0 and 1 reversed.) Other Feasible Movements. The above does not ensure the movement is only in the 5 direction along the road. In fact, there are multiple other feasible interactions of the wheel with the fuel strands. By a similar argument, it can easily be shown: (c) There is a feasible transition of the state of the wheel from type 1 position to type 0 position driven by the type 0 fuel strands, where the wheel moves by one segment in the 3 direction along the road. (d) There is a feasible transition of the state of the wheel from a type 0 position of to a type 1 position driven by the type 1 fuel strands, where the wheel moves by one segment in the 3 direction along the road. (e) For each i=0, 1, there is a feasible hybridization of the exposed (top) portion of the wheel in a type i position with a fuel strand that makes no transition of the state of the wheel (the wheel remains in a type i position, though the fuel strand is transformed into its duplex state), so the wheel stalls for a moment in its movement along the road. The Accelerated Random Bidirectional Movement of the Wheel. Hence the movement of the wheel with respect to the road remains a random walk with either direction or a momentary stall possible on each step with fixed probability. By symmetry in the construction, it can be shown that the likelihood of each direction (from 5 to 3 , or its reverse) of movement is equally likely. Recall again that for unbiased random walks √ in 1 dimension, that the expected translational deviation after n steps is O( n ). However, the fuel strands appear to considerably accelerate the rate that steps of this random walk are executed (as compared to random movements fueled by kinetic (heat) motion). Hence the acceleration in the rate of these transitions may be of use, and the above has the potential of being feasible design of an autonomous bidirectional DNA nanomechanical device without use of DNA ligase or restriction enzymes.
4
Conclusion
A key open problem is to design and demonstrate a DNA Device achieving unidirectional movement (either translational or rotational). We conjecture such as device will need to use irreversible reactions (e.g., ligation). Acknowledgments. We wish to thank Tingting Jiang, Thom Labean, and Hao Yan and Peng Yin, for their valuable and insightful comments that led to many improvements in this paper. As stated above, Turberfield proposed to us the use of DNA fuel loop strands to provide energy for autonomous motion by DNA devices and some possible mechanisms to use them, but these were distinct from what we have presented.
The Design of Autonomous DNA Nanomechanical Devices
37
References [BPA+01] Benenson, Y., T. Paz-Elizur, R. Adar, E. Keinan, Z. Livneh, and E. Shapiro, Programmable and autonomous computing machine made of biomolecules. Nature, 414, 430 - 434, (2001). [F82] Feller, W., An Introduction to Probability Theory and Its Applications, John Wiley & Sons, New York, (1971) [HLN01] T. Humphrey, H. Linke, and R. Newbury, Pumping Heat with Quantum Ratchets, to appear in Physica E (2001), cond-mat/0103552. [LYK+00] T. H. LaBean, Hao Yan, Jens Kopatsch, Furong Liu, Erik Winfree, John H. Reif, Nadrian C. Seeman. “Construction, analysis, ligation, and self-assembly of DNA triple crossover complexes.” J.Am.Chem.Soc. 122, 1848-1860(2000). [LWR00] T. H. LaBean, E. Winfree, and J.H. Reif, Experimental Progress in Computation by Self-Assembly of DNA Tilings, Gehani, A., T. H. LaBean, and J.H. Reif, DNA-based Cryptography, Proc. DNA Based Computers V: Cambridge, MA, June 14-16, 1999. DIMACS Volume 54, edited by E. Winfree and D.K. Gifford, American Mathematical Society, Providence, RI, pp. 123-140, (2000). URL: http://www.cs.duke.edu/∼reif/paper/DNAtiling/tilings/labean.pdf [LGM+92] M. Lu, Q. Guo, L.A. Marky, N.C. Seeman and N.R. Kallenbach, Thermodynamics of DNA Chain Branching Journal of Molecular Biology 223, 781-789 (1992). [MLR+00] C. Mao, T. LaBean, J.H. Reif and N.C. Seeman, Logical Computation Using Algorithmic Self-Assembly of DNA Triple Crossover Molecules, Nature 407, 493-496 (2000). [MSS+99] C. Mao, W. Sun, Z. Shen and N.C. Seeman, A DNA Nanomechanical Device Based on the B-Z Transition, Nature 397, 144-146 (1999). [RLS01] J.H. Reif, T.H. LaBean, and N.C. Seeman, Challenges and Applications for Self-Assembled DNA Nanostructures, Proc. Sixth Inter.l Workshop on DNA-Based Computers, Leiden, The Neth., June, 2000. DIMACS Ed. by A. Condon and G. Rozenberg. Lecture Notes in CS, Springer-Verlag, Berlin Heidelberg, vol. 2054, 2001, pp. 173-198. http://www.cs.duke.edu/∼reif/paper/SELFASSEMBLE/selfassemble.pdf [R01] J. H. Reif, DNA Lattices: A Programmable Method for Molecular Scale Patterning and Computation, to appear in the special issue on Bio-Computation, Computer and Scientific Engineering Journal of the Computer Society. 2001. URL: http://www.cs.duke.edu/∼reif/paper/DNAlattice/DNAlattice.pdf [S99] N.C. Seeman, DNA Engineering and its Application to Nanotechnology, Trends in Biotech. 17, 437-443 (1999). [WLW98] Winfree, F. Liu, L. A. Wenzler, and N.C. Seeman, Design and Self-Assembly of Two-Dimensional DNA Crystals, Nature 394, 539-544 (1998). [YZS+02] H. Yan, X. Zhang, Z. Shen and N.C. Seeman, A robust DNA mechanical device controlled by hybridization topology, Nature, 415,62-65, 2002. [YTM+00] Yurke, B., Turberfield, A. J., Mills, A. P.Jr, Simmel, F. C. & Neumann, J. L. A DNA-fuelled molecular machine made of DNA. Nature 406, 605-608 (2000).
Cascading Whiplash PCR with a Nicking Enzyme Daisuke Matsuda1 and Masayuki Yamamura2 1
2
Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, 4259 Nagatsuda, Midori-ku, Yokohama 226-8502 Japan; [email protected] CREST, Japan Science and Technology Corporation(JST) and Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology; [email protected]
Abstract. Whiplash PCR has been proposed as a unique mechanism realizing autonomous inference machines and used in various applications of DNA coumputing. However, it is not easy to increase step sizes within a single molecule because of back annealing. This paper proposes a sheme to cascade results of WPCR from molecules to molecules by using a nicking enzyme. We also show preliminary experiments to produce output fragments continuously from WPCR.
1
Introduction
Whiplash PCR(WPCR) was proposed by Hagiya et al, as a unique mechanism to realize autonomous inference machines with single strand DNAs forming hairpin structures [1]. Early WPCR required a certain thermal control like normal PCR. Sakamoto et al. established an isothermal protocol so that DNA molecules act as completely autonomous ways without any outside control [2]. They also proposed an elegant input method for WPCR[3]. WPCR is used not only in abstract computation but also in various applications. Wood et al. used WPCR to represent strategies for game in their research on evolving intelligent agents[4]. Yamamura et al. proposed a memory state copy procedure with WPCR in their research on aqueous computing with PNAs[5]. WPCR has a difficulty called back annealing that the active edge of DNA will hybridize already processed sites more frequently than expected ones. Rose et al. proposed a scheme to inhibit back annealing with bis-PNA. Although the step size will be increased, it is not easy to extend it only with intramolecular activity. This paper proposes a scheme to cascade results of WPCR from molecules to molecules. We expect to ease the difficulty on the step size and also expect new applications by introducing intermolecular activities. This paper consists of 4 sections. Section two proposes a scheme to cascade WPCR with a nicking enzyme. Section three shows preliminary experiments to examine feasibility of proposed idea. Section four discusses on practical and further issues. M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 38–46, 2003. c Springer-Verlag Berlin Heidelberg 2003
Cascading Whiplash PCR with a Nicking Enzyme
2
39
Sheme to Cascade WPCR
We designed a scheme to cascade WPCR by using a nicking enzyme. 2.1
Nicking Enzyme
TypeII and TypeI restriction enzymes are useful in DNA engineering because they cleave DNA at a specific site. Most restriction enzymes catalyze doublestranded cleavage on DNA substrates. But there are some proteins called nicking enzymes that cleave only one DNA strand, and introduce a nick into the DNA molecule. We used N.BstNBI as a nicking enzyme[7]. It recognizes a nonpalindromic sequence,5’-GAGTC- 3’, and cleaves only on the top strand 4 base pairs away from its recognition sequence (5’-GAGTCNNNNˆN-3’). 2.2
Output Reaction and Cascading
Figure1 shows the scheme to cascade results of WPCR from molecules to molecules. In order to cascade WPCR, we must prepare a DNA sequence with a special output site. In final step of WPCR, molecular machine has an output fragment along with a recognition sequence of a nicking enzyme. The nicking enzyme makes nick between the output fragment and the recognition sequence. Finally, the output fragment leaves the molecular machine. It can be considered that the output fragment is new data fragment that defines the state of a system. So, the state of a system is updated because the output fragment joins the set of data fragments. An ssDNA fragment can be used as inputs for other molecular machines[3]. An data fragment consists of two parts, paste part and definition part. The paste part hybridizes to the 3’-end of a rule region, and an initial primer is appended to the 3’-end of the rule region by polymerization using the definition part as a template. The extended rule region can work as a molecular machine for next WPCR. At this point, rule regions have no complementary sequence of definition part.
3
Preliminary Experiments
We designed preliminary experiments to examine the feasibility of proposed idea. 3.1
Mateirials and Methods
Molecular Machine. The DNA sequences used in this paper are listed in Table1.The molecular machine Tran3, in the form shown in Figure2, was commercially synthesized by greiner bio-one. Since the recognition sequence of the enzyme usually contains all kinds of basis (A, T, C, G), C18-spacer is used as a stopper in Tran3. And it can make enzymatic reaction to Tran3 possible. s4 that is complementary strand of s4 plays the part as an output fragment.
40
Daisuke Matsuda and Masayuki Yamamura
5VCVGQH5[UVGO
4WNGTGIKQPU 4WNG 4WNG
&CVCHTCIOGPVU
4WNGP
&CVCC
G
&CVCD &CVCP
H
C
F KPKVKCNRTKOGT
1WVRWVHTCIOGPVU
(KPCNUVGRQH92%4 TGEQIPKVKQPUGSWGPEG
D
QWVRWVHTCIOGPV
E
Fig. 1. The scheme to cascade results of WPCR from molecules to molecules. (a) A molecular machine in an initial state starts WPCR. (b) The nicking enzyme nicks the molecular machine between the output fragment and the recognition sequence. And the output fragment leaves the molecular machine. (c) The Molecular machine restores the output fragment. (d) The output fragment is added into the set of data fragments that define the state of a system, and new state is formed.(e) One of rule regions was paired with one of data fragments. (f) An initial primer is appended to the 3’-end of the rule region by polymerization using the data fragment as a template.
No s0 s1 s2 s3 s4 s5
Sequence CCGTCATCTTCTGCT TACCCTCCCTCACTT CGTCCTCCTCTTGTT GCTTGACTC CATTTCTGGCTCGTC TCGTGCCGTTCGTCCATTTCTGGCTCGTC Table 1. DNA sequences used in this paper
Cascading Whiplash PCR with a Nicking Enzyme
U
U
U
U
U
U
U
41
U
5VQRRGT
Fig. 2. The structure of Tran3. s3 contains the recognition sequence of the nicking enzyme N.BstNBI. And Tran3 is nicked between s3 and s4.
Output Reaction from WPCR. At first, three successive transitions were performed in a reaction mixture containing Tran3 (7pmol), dNTP (60µmol each), Bst DNA Polymerase (4 units, BioLabs inc.), Bst DNA Polymerase buffer, and N.BstNBI buffer. The thermal cycle of WPCR was 64 for 1 min, shift up to 80 in 1 min, 80 for 5 min[3]. And the WPCR consists of 8 reaction cycles. Secondly, the reaction mixture that had undergone WPCR was incubated at 64 for 90 min with the addition of N.BstNBIand the template s4-s5. In this experiment, output reaction is separated from WPCR, so we called this reaction ”separated output reaction”. separated output reaction is a control reaction. In this reaction, two partical reactions(WPCR and output reaction) are performed separately. N.BstNBI and the template s4-s5 were poured into the reaction mixture before WPCR, were used in isothermal and thermal output reaction from WPCR. In contrast to separated output reaction, ”thermal output reaction” underwent two partical reactions continuously. And ”isothermal output reaction” were performed at 64 for 90 min. 3.2
Results
WPCR. The transition products were analyzed on a denaturing 10% polyacrylamide gel stained with ethidium bromide (Figure4). As the result of three successive transitions, it is expected that the reaction mixture contain three kinds of product (Figure3), and Figure4 shows that. Therefore, the molecular machines completely underwent three successive transitions and C18 spacer plays the part as the stopper perfectly. Output Reaction from WPCR. The product of third transition has the double stranded recognition sequence of N.BstNBI, that makes nick between the output fragment s4 and s3. s4 leaves molecular machine, and it plays the part as the primer of s4-s5 that is a template of the output product(Figure5). There is not so great difference among the results of output reaction from WPCR under three conditions (Figure6).
4
Discussion and Conclusion
We proposed a scheme to cascade WPCR from molecules to molecules, and showed preliminary experiments.
42
Daisuke Matsuda and Masayuki Yamamura
U
U
U
U
U
=5VCVG? U
U
U
=5VCVG?
U
U
U U
U
U
U
U
U U
U
U
U
U
U
U
U
=5VCVG?
U U
Fig. 3. The products of the transitions. State1 is the product of first transition, State2 is that of second transition, and State3 is that of third transition.
/
Fig. 4. Gel electrophoresis of the transition products. Lane1 underwent no transition phase. Lane2 underwent WPCR. The band of lane1 shows State1. Lane2 shows State2 (lower band) and State3 (upper band).
=5VCVG?
U
U
U
U
PKEM DGVYGGPUCPFU
=QWVRWVUGSWGPEG? U
U
GZVGPF
=QWVRWVRTQFWEV? Fig. 5. The model of output reaction
Cascading Whiplash PCR with a Nicking Enzyme
/
43
/
C
Fig. 6. The results of output reaction from WPCR. This shows the marker output product (laneM2), the output product of separated output reaction (lane1), that of thermal output reaction (lane2), and that of isothermal output reaction (lane3).
4.1
Discussion about Preliminary Experiments
Since the temperature condition of output reaction and that of incubation phase in WPCR are the same, the output reaction is considered as an extended reaction of WPCR. Therefore, it is natural that the output reaction is performed as an autonomous reaction, and that it does not make much difference whether the efficiency of the autonomous output reaction or that of separated output reaction. And those experiments show that qualitatively. As a result of continuous production of output fragments, the output reaction has the specialty of amplification. But, the pilot experiment of output reaction qualitatively shows that the concentration of the output products tends to converge (data not shown). This means that equilibrium between divorced output fragments and back-annealed output fragments is formed. We suppose the concentration of the output products is decided by two factors that are the concentration of the molecular machines in final step of WPCR and this equilibrium. In order to test this possibility, we hereafter will have to do quantitative analysis. The output product of isothermal output reaction was observed. In previous paper[2],On the contrary, incubation at 80 is recommended because products of transitions are not observed under the conditon at 64. The differences between this paper and previous paper are the polymerase used in experiment and the target observed. Since the target in this paper is the double stranded DNA and is amplified by output reaction, the efficiency of detection is improved. We suppose
44
Daisuke Matsuda and Masayuki Yamamura
those two factors makes observation of WPCR under the condition of 64 possible. In order to say incubation at 64 performs WPCR strictly, we hereafter will have to observe products of transitions.
C=+(##0&$6*'0%?
D=+(##0&$6*'0%? #
# C
$ D
D
C
D UVQRRGT
C
$ D
D
TGEQIPKVKQPUGSWGPEG
%
D
D
% D
C
C
D
TGEQIPKVKQPUGSWGPEG
C
# C
D
D
$
D
D
D
D
% %
%
D
C
D
C
=#CPF$? #
$ D
D
D
D
C
D
C
D
C
D
D
% %
%
%
D
% =#CPF$?
QWVRWVTGCEVKQP %
% %
D
%
D
Fig. 7. Ideas to realize [IF A AND B THEN C] and [IF ¬A AND B THEN C]. The State of system is defined by rule molecules, A and B.
Cascading Whiplash PCR with a Nicking Enzyme
4.2
45
Further Issues
We have a plan to apply proposed method to implement an expert system for medical diagnosis. A molecular machine is synthesized from rule region and data fragment, each concentration of synthesized molecular machines depends on that of data fragments. We expect the concentration of each data fragments will work as the certainty factor of expert systems. For example, we show two concrete ideas to realize logical operation in Figure7. These operations are performed according to the probability that depend on each data fragment concentrations, and the concentration is used as the certainty factor in such meanings. The state of a system is defined by data fragment A and B. (a) shows an idea to realize [IF A AND B THEN C]. Data fragment C is outputted by molecular machine when data fragment A and B exist in a system. (b) shows an idea to realize [IF ¬A AND B THEN C]. In this idea, C is outputted by molecular machine under existence of B. The output of C is blocked by existence of A. Therefore, when both of A and B exist, outputs of C decreases gradually. That is, The output of C can be ignored comparatively if it observed when time fully passes. Consequently, the higher the certainty of A is, the lowwer the certainty of C becomes. We have proposed a scheme to cascade WPCR, and shown a reliability study to produce output fragments by a nicking enzyme. We must develop programinig techniques as discussed, in the next stage. We expect expert systems as nice application field. Direct molecular I/O, that is one of the most fruitful characteristics of DNA computing, leads to micro diagnosis models in Biotechnology on Medicine.
References 1. M.Hagiya, M.Arita, D.Kiga, K.Sakamoto, and S.Yokoyama, ”Towards parallel evaluation of Boolean µ-formulas with molecules”, in (H.Rubin and D.H.Wood,Eds.) DNA Based ComputersIII, (American Mathematical Society, 1999), 57-72. 2. Kensaku Sakamoto, Daisuke Kiga, Ken Komiya, Hidetaka Gouzu, Shigeyuki Yokoyama, Shuji Ikeda, Hiroshi Sugiyama, and Masami Hagiya. State Transitions by Molecules. BioSystems, Vol.52, No.1–3, 1999, pp.81–91. 3. K.Komiya, K.Sakamoto, H.Gouzu, S.Yokoyama, M.Arita, A.Nishikawa, and M.Hagiya, ”Succesive State Transitions with I/O Interface by Molecules”, in (A.Condon and G.Rozenberg, Eds.) DNA Computing, Springer-Verlag LNCS, Vol.2054, (Springer, Berlin, 2001), 17-26. 4. David Harlan Wood, Hong Bi, Steven O. Kimbrough, Dongjun Wu, and Jumghuei Chen. DNA Starts to Lean Poker. DNA7, 7th International Meeting on DNA Based Computers, Preliminary Proceedings, 2001,pp.23-32. 5. Masayuki YAMAMURA, Yusuke HIROTO, and Taku MATOBA. Another Realization of Aqueous Computing with Peptide Nucleic Acid. DNA7, 7th International Meeting on DNA Based Computers, Preliminary Proceedings, 2001,pp.251-259. 6. J.A.Rose, R.J.Deaton, M.Hagiya, A.Suyama: An Equilibrium Analysis of the Efficiency of an Autonomous Molecular Computer, Physical Review E, Vol.65, No.2-1, 2002, 021910, pp.1-13.
46
Daisuke Matsuda and Masayuki Yamamura
7. Richard D. Morgan, Celine Calvet, Matthew Demeter, Refael Agra Huimin Kong.Characterization of the Specific DNA Nicking Activity of Restriction Endonuclease N.BstNBT. Biol. Chem. Vol. 381, 1123-1125 (2000).
A PNA-mediated Whiplash PCR-based Program for In Vitro Protein Evolution John A. Rose1,4 , Mitsunori Takano2 , and Akira Suyama3,4 1
Department of Computer Science, The University of Tokyo, [email protected] 2 Institute of Physics, The University of Tokyo, [email protected] 3 Institute of Physics, The University of Tokyo, [email protected] 4 Japan Science and Technology Corporation (JST-CREST)
Abstract. The directed evolution of proteins, using an in vitro domainal shuffling strategy was proposed in (J. Kolkman and W. Stemmer, Nat. Biotech. 19, 423 (2001). Due to backhybridization during parallel overlap assembly, however this method appears unlikely to be an efficient means of iteratively generating massive, combinatorial libraries of shuffled genes. Furthermore, recombination at the domainal level (30-300 residues) appears too coarse to effect the evolution of proteins with substantially new folds. In this work, the compact structural unit, or module (10-25 residues long), and the associated pseudo-module are adopted as the fundamental units of protein structure, so that a protein may be modelled as an N to C-terminal walk on a directed graph composed of pseudomodules. An in vitro method, employing PNA-mediated Whiplash PCR (PWPCR), RNA-protein fusion, and restriction-based recombination is then presented for evolving protein sets with high affinity for a given selection motif, subject to the constraint that each represents a walk on a predefined pseudo-module digraph. Simulations predict PWPCR to be a reasonably high efficiency method of producing massive, recombined gene libraries encoding for proteins shorter than about 600 residues.
1
Introduction
The generation of shuffled dsDNA libraries by DNase I digestion and parallel overlap assembly (POA) (i.e., DNA shuffling) has been established as a powerful means of implementing random recombination between homologous genes [1,2]. Simulations, however predict that this approach is unlikely to be capable of evolving substantially novel protein folds, and that the non-homologous swapping of folded structures (i.e., exon or domain shuffling) is key for optimizing the search of protein sequence space [3]. Many proteins can be modelled as a string of non-overlapping, independently folding elements, or domains, each of which is typically 30-300 residues in length [4]. This has recently prompted the suggestion of protein evolution by in vitro domainal shuffling [5]. In this model, a polynucleotide species encoding for each domain is combined in solution with a set of M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 47–60, 2003. c Springer-Verlag Berlin Heidelberg 2003
48
John A. Rose, Mitsunori Takano, and Akira Suyama
chimeric oligonucleotides, each of which encodes a domain-domain boundary. The iterated annealing, polymerase extension, and dissociation of this strand set (i.e., POA) then results in the production of a library of domain-shuffled dsDNAs. Although this operation preserves domainal integrity during initial shuffling, additional crossover following expression and screening requires either (1) DNase I digestion, which destroys the domainal integrity preserved by the initial process, or (2) a secondary, low-efficiency POA process, in which selected strands are used to implement the iterated extension of a set of added primers. In particular, the efficiency of POA is compromised by the high stability of backhybridized duplexes, relative to extendable hybrids [6,7], in a fashion similar to that reported for Whiplash PCR (WPCR) [8,9]. In a secondary domainal shuffling process, this inefficiency will be exacerbated by both the increased length of backhybrids, and the tendency for strands to stably hybridize away from extendable ends, due to the high sequence similarity conferred by the domainal shuffling strategy. Recombination at the domainal level, which focuses on swapping existing folds, also appears to be too coarse to effect the evolution of substantially new folds. Finally, it is not clear how an iterative DNA shuffling strategy can be designed to ensure that a high proportion of dsDNAs encode promoter and ribosomal binding sites, to facilitate the use of an in vitro system for expression and selection (e.g., RNA-protein fusion [10,11]), which is necessary for overcoming the transfection limit of about 109 strands [12]. In previous theoretical work, the efficiency of WPCR [13] was optimized [8,9], and the resulting architecture, PNA-mediated Whiplash PCR (PWPCR), was adapted to produce an in vitro genetic program for evolving approximate solutions to instances of Hamiltonian Path [14]. For related work, in which WPCR is used to evolve strategies for a simple version of Poker, readers are referred to [15]. In this work, PWPCR is combined with RNA-protein fusion [10,11] to implement a high-efficiency exon shuffling operation. For this purpose, the compact structural unit, or module [16], rather than the domain, is adopted as the basic element of protein structure, so that each shuffled protein represents a walk on a predefined graph, in which each vertex represents a pseudo-module contained in an initial protein set of interest.
2 2.1
Protein Representation The Module Picture of Protein Architecture
The domain, or independently folding unit, is well established as a basic element of protein structure [4]. As pointed out by M. Go, et al. [16,17], however the frequent occurrence of introns within domains belies the view that each exon encodes a domain, and suggests the decomposition of domains into a set of smaller, compact structural unit, or modules, each of which forms a compact structural unit within the larger domain, and corresponds roughly to an exon. Any globular protein with a known 3D structure can be decomposed into an Nterminal to C-terminal sequence of modules, by exploiting either the tendency for module junctions to be buried, or the tendency of modules to form a locally
A PNA-mediated Whiplash PCR-based Program
49
compact unit [17]. Module and exon boundaries have been shown to correlate strongly in ancient proteins [18], supporting the view that ancient conserved proteins were evolved via exon (module) shuffling, as expected by the Exon Theory of Genes [19]. The basic module structure is that of a “unit-turn-unit”, with a length which correlates with the radius of the protein [18]. Typical module lengths vary from 10-25 residues (about half the mean exon length), and are clustered tightly around a mean of 18 residues. Interestingly, this mean length is very close to the optimal length (20 residues) of exchanged segments, reported for simulations of genetic recombination [3]. Longer modules reported for globins (up to 45 residues) are decomposable into a set of shorter modules [20]. The element between the approximate midpoints of adjacent modules (the pseudo-module), which has the general structure of coil-unit-coil, has also been investigated as a basic structural element of proteins [21]. 2.2
The Pseudo-module Generating Graph
The module picture of protein structure suggests that a protein, P which can be decomposed into a N to C-terminal sequence of q + 1 pseudo-modules, may be modelled as a q step tour of the digraph, GP (V, E), composed of q + 1 vertices, V = {Vi : i = 1, . . . , q + 1}, so that Vi represents the ith pseudo-module from P ’s N-terminus, and edges, E = {Ei,i+1 : i = 1, . . . q}, where Es,t is the directed edge between source and target vertices, Vs and Vt , respectively. This pseudomodule graph representation facilitates a discussion of the generation problem for sets of proteins derived from P by various forms of pseudomodule sampling. For instance, the protein set generated by the random sampling of q + 1 pseudomodules from P (colloquially referred to as “shuffling”) corresponds to the set of q-step walks on the fully interconnected graph, GP (V, E † ), with edges, E † = {Ei,j : i, j ∈ {1, . . . , q}}. This model conveniently generalizes to discuss the generation of protein sets by restricted forms of pseudomodule “shuffling”. In particular, it may be desirable to generate a set of proteins by pseudo-module shuffling between (or within) specific regions of P , while other regions remain unshuffled. This constrained sampling on P can be expressed as a set of edges, Es ∈ E † on GP (V, E † ), which preserves the desired pseudo-module adjacencies. The protein set generated under the application of this sampling will then be equal to the set of random walks on the pseudo-module graph, GP (V, Es ). The framework also generalizes straightforwardly to discuss the generation of protein sets by the pseudo-module sampling of multiple proteins. Consider the sampling of a set of n proteins, P = {Pk : k = 1, . . . , n}, each of which can be expressed as a sequence of pseudo-modules, and thus, as a tour of a simple pseudo-module graph, Gk (V (k), E(k)). Furthermore, suppose that each protein, Pk ∈ P is to be sampled subject to an internal sampling constraint, Es (k), and each pair of proteins, Pk , Pk ∈ P is to be sampled subject to the pairwise constraint Es (k, k ), which specifies a set of allowed adjacencies (i.e., a set of edges) between Pk and Pk . The set of proteins which may be generated by means of this sampling procedure is then identical to the set of random
50
John A. Rose, Mitsunori Takano, and Akira Suyama
walks on the pseudo-module graph, GP (V , E ), where V = ∪k V (k), and E = (∪k Es (k)) ∪ (∪k,k Es (k, k )).
3
An In Vitro Genetic Program for Protein Evolution
In this section, an in vitro method is presented for evolving sets of proteins with high affinity for a predefined selection motif, subject to the constraint that each represents a directed walk on a specified pseudo-module graph, GP (V , E ). This method begins with initialization by self-assembly of a set of ssDNAs, each of which encodes a PWPCR program for the generation of a 3’ DNA tail which encodes a walk on GP (V , E ). Initialization is followed by the iterated application of a three step cycle: (1) genotype generation by PWPCR [8] followed by parallel strand conversion to dsDNA, (2) fitness evaluation and selection, by the generation of a set of RNA-protein fusions [10,11] (i.e., the phenotypes), followed by selection based on affinity to an immobilized selection motif, and (3) recombination, using a restriction enzyme-based crossover operation. (a)
_ xt
W as X
_ xs
Y
(b)
PNA (Watson-Crick strand)
at Z
tether H 2 NLys [C C T ]4
Pro
P
_ xi
X
Y
_ Ini
ai Z
as
[ G G A]
4
H[J J T]
_ xt
4
W
af
X
_ T
_ xf
Q
Ini
PNA (Hoogsteen strand)
(c) first edge strand _ _ x2 x 1 a2
initiation strand _ _ Ini a1 x1
a1
_ a1
_ a1
Pro P
second edge strand _ _ x3 x 2 a3
a2
_ _ a2 a2 r-region
_ a3
termination strand _ _ T x 3 Q Ini
a3
_ a3
Fig. 1. PWPCR representation and assembly (see text for details). (a) Generalized edge strand (top), initiation strand (middle), and termination strand (bottom) structure. (b) Targeted PNA2 /DNA triplex formation (at codeword, X). (c) Process of assembly from shorter strands, for a strand which computes the path, V1 → V2 → V3 .
3.1
Initialization
Initialization begins with the construction of four sets of ssDNA strands: (1) an edge strand for each edge, Vs → Vt in the pseudomodule graph of interest, GP (V , E ), where Vs and Vt denote the edge’s source and target vertices, respectively; (2) an initialization strand for each vertex, Vi in GP (V , E ) which is
A PNA-mediated Whiplash PCR-based Program
51
to serve as the initial state of a directed walk on GP (V , E ); (3) a termination strand for each vertex, Vf in GP (V , E ), which may serve as the final state of a directed walk on GP (V , E ); (4) a splinting strand for each vertex in GP (V , E ). Edge strand structure is shown in Fig. 1(a; top structure), where codewords xs , xt , as , and at are edge-specific, while codewords W , X, Y and Z are fixed, for all strands. 5’ to 3’ orientation is indicated by a vertical fin at the strand’s 3’ terminus. An overscore denotes Watson-Crick complementation. as and at identify the source and target vertices of the encoded edge, respectively, and serve to direct the process of PWPCR strand assembly (Fig 1(c)). W and Z encode the 5’ and 3’ halves of one strand of the restriction site of the restriction endonuclease, BseDI (C↓CTTGG) [22], respectively. For convenience, W Z is illustrated as a light, x’ed rectangle. Together, these words enable the directed recombination at this edge (c.f., Sec. 3.4). X, xs , Y , and xt collectively implement the transition, Vs → Vt , by directing primer extension during PWPCR (c.f., Sec. 2). xs and xt are the reverse complements of DNA triplet encodings of the transition’s source and target pseudo-module vertices, respectively. X = (GGA)4 is the target site for formation of a PNA2 /DNA triplex (Fig. 1b), a structure which is known to arrest polymerase extension [23], in order to implement the WPCR/PWPCR operation, polymerization stop. Y = X directs the insertion of word X between words xs and xt , in the extending 3’ tail of the assembled PWPCR strand, which will be used for targeted formation of an additional, backhybridization-inhibiting PNA2 /DNA triplex, during PWPCR. Initiation strand structure is shown in Fig. 1(a; middle structure), where code words xi and ai are strand-specific, while codewords P ro, P , X, Y , Z and Ini are fixed, for all strands. Black oval denotes 5’ biotinylation. P ro encodes a T7 promoter sequence [24] to direct transcription (c.f., Sec. 3.3). P directs primer annealing during PCR. ai identifies the initial vertex specified by the encoded strand, and directs the process of PWPCR strand assembly. X, xi , Y , and Ini collectively serve to initiate PWPCR by directing the appendage of codeword, xi to the 3’ terminus of the fully assembled strand (c.f., Sec. 3.2). Termination strand structure is shown in Fig. 1(a; bottom structure), where xf and af are strand specific, while W , X, T , Y , Q, and Ini are fixed for all strands. af identifies the terminal vertex specified by the encoded strand, and serves to 3’-terminate the process of PWPCR strand assembly. X, T , Y , and xf collectively serve to terminate PWPCR by directing the appendage of the codeword, T to the 3’ terminus of the assembled strand at completion of PWPCR (c.f., Sec. 3.2). Q is a codeword for primer annealing during PCR. Ini encodes a Shine-Delgarno sequence [25], spacer sequence, and start codon, and serves (following transcription) to initiate the translation process (c.f., Sec. 3.3). The splint strand for each vertex, Vi has structure, ai W Zai , where W Z is represented in Fig. 3 as a darkened, x’ed rectangle. Words, ai aid in splinting. The parallel assembly of the initial strand set, which encodes a set of walks on GP (V , E ), is most straightforwardly accomplished by an Adleman-like assembly process [26], implemented by mixing all strands under conditions appropriate for annealing and ligation (T4 DNA ligase). This process is illustrated in
52
John A. Rose, Mitsunori Takano, and Akira Suyama
Fig. 1(c), in the context of the path, V1 → V2 → V3 . In practice, a serial assembly process, beginning with a set of initiation strands, should be more efficient. The elimination of incompletely assembled strands may be accomplished by retaining only the strand set with (a) affinity to Ini, as determined by extraction using the dig-antidig system [27], and (b) a biotinylated 5’ end. The expansion of this architecture to enforce the assembly (and evolution) of PWPCR strands which compute deterministically is discussed in Sec. 5. (a)
Ini
1
Pro P
_ x1
_ Ini a 1
a1
_ x2
_ x 1 a2
a2
_ x3
_ x2
a3
a3
_ T
_ x3
_ Ini a 1
a1
_ x2
_ x 1 a2
a2
_ x3
_ x 2 a3
a3
_ T
_ x3
a2
_ x3
_ x 2 a3
a3
_ T
_ x3
2
x1
Pro P
_ x1
x1
Pro P
_ x1
_ Ini a 1
(b)
a1
_ x 1 a2
_ x2 1
q-1 cycles
2
x3
1
Pro P
_ x1
_ Ini a 1
a1
_ x2
a3
x2
x1
_ _ T x3 Q
3
(c) 4
Pro P
r-region
_ Q
5
Q
Ini
x1
x2
6
_ T x3 T _ Q _ T
Pro P
r-region
Q
Ini
x1
x2
x3 T
Fig. 2. PWPCR-based generation of a dsDNA library (see text for details). (a) The basic PWPCR process. (b) Termination of PWPCR by addition of word, T . (c) Conversion to dsDNA by double primer extension.
3.2
PWPCR-based Generation of a dsDNA Library
The generation of a dsDNA library suitable for expression as a set of proteins on GP (V , E ) is initiated by applying a low salt (20 mM [Na]+ ), excess bis-PNA
A PNA-mediated Whiplash PCR-based Program
53
wash to the initialized ssDNA mixture. This procedure has been reported to result in the rapid attainment of a near unity fractional saturation of dsDNA target sites (codeword X) [28], which is virtually irreversible, at temperatures beneath the PNA2 /DNA melting transition. This set of triplexes will be used to implement polymerization stop. The parallel generation of a protein-encoding 3’ tail for each library strand begins by applying a reaction temperature, Trx which promotes hairpin formation at words, Ini and Ini. As shown in Fig. 2 (a; top structure) for a PWPCR strand encoding the walk, V1 → V2 → V3 , addition of DNA polymerase then results in the self-directed, 3’ extension (horizontal arrow) of each strand, to the adjacent PNA2 /DNA triplex (white oval). This process 3’ appends word X and word xi , which encodes initial (N-terminal) pseudomodule in the strand’s encoded walk (x1 , in Fig. 2). Following extension, the ssDNA mixture is exposed to a low salt, excess bis-PNA wash, which results in the formation of a PNA2 /DNA triplex at word X (Fig. 2(a; middle structure)). As described in [8], this triplex destabilizes each newly extended hairpin, promoting denaturation and renaturation in the configuration required for the next extension (Fig. 2 (a; bottom structure)). The application of q − 1 further cycles of polymerase extension (q = 3, in Fig. 2) and bis-PNA treatment then facilitates the high-efficiency, self-directed appendage of q − 1 additional codewords to the 3’ end of each strand. PWPCR is terminated, for each strand, by the 3’ appendage of a termination codeword, T (Fig. 2(b)). The conversion to dsDNA is accomplished in parallel, for all terminated strands as follows. Bis-PNAs are first denatured and washed (Fig. 2(c), process 3). Unwanted secondary structure is then removed by the annealing and polymerase extension of primer, Q (Fig. 2(c)), process 4), which forms a protecting strand. The annealing and polymerase extension of a second primer T (Fig. 2(c)), process 5), then displaces the protecting strand (Fig. 2(c), process 6), and completes dsDNA conversion. 3.3
Fitness Evaluation and Selection via RNA-protein Fusion
The parallel evaluation and selection of the set of walks on GP (V , E ) represented by the dsDNA library is accomplished in a 7-step process which is essentially identical to the strategy for in vitro selection of proteins by RNA-protein fusion described in [12], which has been experimentally optimized for high efficiency. For clarity, this process (Fig. 3) is described in the context of a strand encoding the short walk, V1 → V2 → V3 . In the first step (Fig. 3(a)), the dsDNA library is used to direct the in vitro synthesis of an mRNA pool, using T7 RNA polymerase [24]. For each dsDNA, transcription is initiated at word, Pro, which encodes a T7 Promoter. Each mRNA transcript (see Fig. 3(b)) is synthesized using the biotinylated strand as the sense strand, and encodes both (1) the r-region, and (2) the triplet code for the walk on GP (V , E ) encoded by the transcribed dsDNA. These two regions are separated by word Ini, which contains a Shine-Delgarno sequence to direct ribosomal binding. Each mRNA transcript is then modified (Fig. 3(b), process
54
John A. Rose, Mitsunori Takano, and Akira Suyama
2) by the addition of a protecting cDNA strand, by the reverse transcriptasemediated extension of the primer, Q. This strand eliminates undesired secondary structure, protects the mRNA transcript’s r-region from specific interaction during affinity-based selection, and copies the r-region into the cDNA protecting strand, which may be conveniently recovered following selection. Next, a short ssDNA strand containing a 5’ puromycin (terminal p), an antibiotic which inhibits translation by mimicking the aminoacyl end of tRNA, is attached to each mRNA’s 3’ end, by splint-mediated ligation (Fig. 3(b), process 3). This group will serve to direct the synthesis of an RNA-protein fusion (RPF) [11] during normal translation.
(a)
T7 RNA polymerase
pro
1
P
x1
Q Ini
r-region
x3
x2
_ T
puromycin
(b)
r-region
P
2
p
RNA transcript x2 x1 Q Ini
x3
_ T
_ Q
3 Protein
5 4 r-region
P
(c)
p
N
Q Ini
x2
x1
_ Q
x3
bound selection motif r-region
P
Q Ini
6
N p
(d)
x3
x1
Pro P
,
7
_ _ Q Ini
(e) Pro P
_ x1
_ _ Ini a 1 a 1 x 2
_ _ x1 a 2 a 2 x3
_ x2 a 3 a 3
_ _ T x 3 Q Ini
Fig. 3. Fitness Evaluation and Selection (see text for details): (a) Transcription; (b) 3’ puromycin attachment; (c) Translation and RNA-protein fusion; (d) Selection by affinity to a bound motif; (e) cDNA recovery and reinitialization by PCR.
A PNA-mediated Whiplash PCR-based Program
55
Translation of the mRNA transcript set (Fig. 3(c), process 4) is accomplished using the E. coli in vitro translation system [29]. For each transcript, translation is initiated by ribosomal binding at the Shine-Delgarno sequence [25] encoded by word, Ini. In the normal course of translation, which proceeds 5’→3’ along the mRNA, the ribosome then pauses at the RNA-DNA interface, allowing the 3’ puromycin to enter the ribosome’s A-site, and be covalently attached by the ribosome to the C-terminus of the nascent peptide, forming a stable RNA-protein fusion (Fig. 3(c), process 5). This process essentially results in the physical linkage of the encoded protein’s genotype and phenotype. The generated protein consists of a pseudomodule sequence, punctuated by short Glycine coils (Gly4 ) generated by the embedded target sequences, X. This minor increase in the length of the coils at pseudomodule boundaries is expected have a negligible impact on the structure and function of the folded protein. In Fig. 3(c), the protein encoded by the path, V1 → V2 → V3 has been expressed as a 3-helix bundle. The RPF library is then subjected to a fitness evaluation and selection procedure (also referred to as screening), based on affinity to an immobilized selection motif (Fig. 3(d), process 6). This motif may be a nucleic acid, protein, or small molecule of interest, such as a transition state analog (TSA) [30]. RPF formation is reported to have negligible impact on the binding specificity of the nascent protein [12]. Following denaturation and purification of the attached set of cDNAs from the selected RPF set (Fig. 3, process 7), the purified cDNA set is PCR amplified using the biotinylated primer, P roP and the 5’ digoxygen-conjugated primer, IniQ. After amplification, which also implements point mutation (albeit somewhat problematically (c.f., Sec. 5)), the resulting dsDNA set is denatured, and the set of digoxygenin-conjugated strands are removed by (anti-dig) antibodies [27]. The remaining strands comprise a biotinylated ssDNA library, each element of which encodes a selected PWPCR program for generating a walk on the pseudo-module graph, GP (V , E ). 3.4
Restriction Enzyme-Based Recombination
Prior to recombination, a subset of psuedomodule-encoding vertices in GP (V ,E ), at which crossover is to be implemented should be identified. Single-point, two parent crossover will then be performed on a subset of the biotinylated ssDNA library, extracted separately for each selected vertex, Vi , by application of the following elementary crossover procedure. For clarity, this basic crossover operation is illustrated in Fig. 3.4 for crossover implemented at V2 , between a strand encoding the path, V1 → V2 → V3 and a second strand (not shown), which encodes a path of the form, Vj → V2 → V4 , where Vj is some vertex in GP (V , E ) other than V2 . The first step (Fig 3.4(a), process 1) is the extraction of a subset of the strands in the ssDNA library which encode a walk that visits Vi , by affinity extraction using the digoxygen-conjugated primer, ai (a2 , in Fig. 3.4(a)). Crossover point formation within the codeword string, ai ZW ai of each strand is then initiated by annealing of primer ai W Zai (Fig 3.4(b), process 2). Restriction with BseDI at the restriction site formed by this process at W Z (crossed box) (Fig 3.4(b), process 3), then results in the division of the strand into a pair
56
John A. Rose, Mitsunori Takano, and Akira Suyama
of restriction fragments, where the biotinylated fragment encodes a partial path ending at vertex i, while the unbiotinylated fragment encodes a partial path beginning at vertex i. The low temperature annealing and ligation of random pairs of biotinylated and unbiotinylated restriction fragments then implements the desired 2-parent, single-point crossover operation at V2 . The viability of each progeny strand (in the sense of encoding a valid, connected walk on GP (V , E )) is ensured by the representation of each parent strand (c.f., Sec. 3.1). In particular, the assembly process ensures that the order of the edges traversed by an encoded walk is identical to the physical ordering (i.e., 5’ to 3’) of the PWPCR rules encoded for executing the traversal, on the strand. Recombination at Vi is completed by strand anchorage, followed by a wash. This elementary crossover operation is to be repeated on a separate extract removed from the ssDNA library for each selected vertex in GP (V , E ), or until the library is exhausted. The merging of all recombined extracts into a single tube completes recombination, and the first round of the genetic program. This process of in vitro evolution should be repeated until a protein having the desired affinity is produced, as determined during fitness-evaluation and selection (screening), or until some predetermined maximum number of rounds have been executed.
_ a2
(a)
Pro P
_ x1
_ _ Ini a1 a 1 x 2
1 _ _ _ x 2 a3 a 3 T x 3 Q Ini
_ _ x 1 a2 a 2 x 3
3 _ _ a2 a2
(b) Pro P
_ x1
_ _ Ini a1 a 1 x 2
2
Pro P
_ x1
_ _ Ini a1 a 1 x 2
_ x1 a 2
_ x3
a2
_ a2
(c)
_ _ _ x 2 a3 a 3 T x 3 Q Ini
_ _ x 1 a2 a 2 x 3
_ _ _ x 2 a3 a 3 T x 3 Q Ini
_ a2
+
a2
_ x4
_ _ _ x 2 a4 a 4 T x 4 Q Ini
4
(d) Pro P
_ x1
_ _ Ini a1 a 1 x 2
_ _ x 1 a2 a 2 x 4
_ _ _ x 2 a4 a 4 T x 4 Q Ini
Fig. 4. Restriction site-based recombination of a PWPCR strand encoding the path, V1 → V2 → V3 , with a strand encoding a path of the form, Vj → V2 → V4 , where Vj is some vertex in GP (V , E ), other than V2 . This operation implemented at common vertex, V2 (see text for details).
A PNA-mediated Whiplash PCR-based Program
4
57
The Efficiency of PWPCR-based Library Generation
The model of PWPCR efficiency reported in [8], which treats the extension of each strand as a Markov chain, and estimates the probability of extension during each effective encounter with DNA polymerase, was applied to estimate the efficiency of library generation by PWPCR. The adopted word lengths were: |xi | = 42 nucleotides (nt) and |X| = |Y | = 12 nt, for a uniform module length of 18 residues; |P | = |Q| = 18 nt; |W | = |Z| = 3 nt; |ai | = 10 nt; |T | = 15 nt; |Ini| = 42 nt. The following modifications were also adopted (values applied in [8] listed in parenthesis): mean pseudomodule codeword GC content = 0.50 (8/15); [Mg2+ ] = 1.0 mM (1.5 mM); PNA target sequence, X = [G2 A]4 (A2 GA2 GA4 ). In [8], the loop lengths of extendable hairpins were modelled by a mean value, which increased as a function of extension number, r. Here, the 5’ to 3’ ordering of each strand’s set of rules for graph traversal allowed the explicit calculation of a loop length for each extendable hairpin, which decreases with r. This is significant, because the extension efficiency is a low order polynomial of the ratio of extendable and backhybridized (i.e., previous) loop sizes.
(b)
1.0 0.8
-2 -3 -4 -55 20
χ(q)
log10 ε r
(a)
5 81 15
r
5
346 73
0.4 0.2 0
77
10
0.6
o
Trx ( C)
0
10
20
30
40
50
q (edges)
Fig. 5. The efficiency of PWPCR-based library generation. (a) Efficiency per strand-polymerase encounter, r vs. extension process, r and Trx ; (b) completion efficiency per strand vs. path length, q (in edges). Fig. 5(a) illustrates the efficiency/effective polymerase encounter, r predicted for a q = 20 implementation (22 extensions), as a function of r and Trx . The first extension (data not shown) is predicted to proceed with nearunity efficiency, at Trx < 71◦ C. The predicted optimal Trx is nearly constant for r > 1, and ranges from 76.5 ◦ C (r = 2) to 77.8 ◦ C (r = 22). For each extension, 1 < r ≤ 22, application of the corresponding optimal Trx is predicted to result in an efficiency of r>1 ≈ 10−2 . Use of a constant Trx = 77.6◦ is predicted to maintain an efficiency of at least 82% of the optimal value, for all r > 1. The simple model of PWPCR kinetics employed in [8] was then applied to estimate the characteristic relaxation time to equilibrium, τ for PWPCR hairpins. In particular, the predictions of an equilibrium model can be expected to be valid only under conditions for which τ < 10tenc , where tenc is the mean time
58
John A. Rose, Mitsunori Takano, and Akira Suyama
between successive polymerase encounters for a given strand. At Trx = 77.6◦ C, predicted relaxation times range from 0.67 sec (r = 2) to 0.052 sec (r = 22), where the variation is due to the decreasing loop size of hairpins implementing successive extensions. The conditions suggested in [8] (27 units of Taq DNA polymerase, with a polymerization cycle time of 60 min), which implement a total of approximately 543 effective encounters/(strand cycle), yielding a mean time between encounters of tenc ≈ 6.7 sec are therefore predicted to just meet the requirement for equilibrium. Fig. 5(b) illustrates the estimated completion efficiency per strand, χ(q), as a function of encoded path length, q (in edges) for a combinatorial PWPCR mixture of 1.2 × 1013 strands, under buffer conditions of [8]. Simulations were performed assuming a uniform reaction temperature of Trx = 77.6 ◦ C, which was predicted to be within 1 C◦ of the optimal Trx for each value of q. As shown, a q = 20 implementation is predicted to complete 84% of the encoded strands, a substantial improvement over [8].
5
Practical Considerations
Based on the simulations presented in Sec. 4, the current method is predicted to be an efficient method of producing massively parallel, recombined gene libraries encoding for proteins shorter than about 600 residues, which compares favorably with the mean protein length of about 350 residues [4]. Although each round of crossover is certain to generate PWPCR strands encoding longer paths, the subset of recombined strands which encodes paths above a fixed threshold length can be removed by size fractionization [27]. The near constancy of the optimal Trx predicted with variations in q also indicates that a single Trx can be selected to implement PWPCR with near uniform efficiency, variations in strand length notwithstanding. A related, and critical issue is the requirement that the thermal stabilities of the set of pseudomodule-encoding DNA words be both approximately uniform, and substantially lower than that of the adjacent PNA2 /DNA triplexes. The uniformity of pseudomodule codeword thermal stability can be ensured by exploiting the degeneracy in the 3rd nucleotide, inherent in the triplet code. Furthermore, as the melting transition of the 10 nt, 20% G/C PNA2 /DNA triplex is reported to occur in a very narrow (5 C◦ in width) temperature range, centered at 85 ◦ C, use of the suggested Trx = 77.6◦ should result in negligible melting of the more stable (12 nt, 67% G/C) triplexes adopted for the current implementation. As pointed out in Sec. 3.3, the current architecture effectively implements point mutation during both PCR (and PWPCR). Each point mutation, however also results in the divergence of the mutated codeword and its matching, unmutated partner, on the strand. Due to the high stability reported for single mismatches in a longer Watson-Crick sequence [31], however this effect should have a negligible impact on PWPCR efficiency, given modest mutation rates. The present implementation does not enforce the assembly or evolution of strands which encode for deterministic PWPCR (i.e., so that each strand encodes
A PNA-mediated Whiplash PCR-based Program
59
for exactly 1 completed protein). If desired, determinism may be enforced in SAT Engine-like style [32], by the codeword assignment, aj = aj , ∀ j ∈ {1, · · · , q + 1}, combined with the use of a fully palindromic restriction site for BseDI (e.g., C↓CTAGG). Hairpins which encode multiple visits to any vertex, Vj will then form very stable hairpin loops at self-complementary words, aj ZW aj , which are then subject to digestion, prior to each round of PWPCR. The downside of this procedure is an increased potential for kinetic trapping in PWPCR hairpins, and a decreased recombination efficiency due to the potential for ligation of biotinylated pairs and unbiotinylated pairs of restriction fragments. Another important issue is the impact on protein structure and function on the Gly4 coils inserted between pseudomodule pairs. Given that these pairs are assumed by the basic model to be punctuated by turns, and glycine is a helixbreaker, the impact of Gly4 insertion on 2◦ structure is likely to be negligible, in general. the impact on 3◦ structure and function appears to be a more complex issue. For coils which primarily provide sufficient flexibility for a turn, a modest length increase is unlikely to impact overall protein functionality. For coils which contain an active residue, on the other hand, both length and placement within the coil may assume greater importance, and will have to be carefully considered during the decomposition of the parent protein into a pseudomodule graph.
Acknowledgements The authors would like to thank M. Hagiya and K. Sakamoto of the University of Tokyo for helpful discussions, and S. Suzuki for help during preparation of the figures. Support provided by a JSPS Postdoctoral Fellowship and Grant-in-Aid, and by JST CREST.
References 1. Stemmer, W., “Rapid evolution of a protein in vitro by DNA shuffling”, Nature 370, 389 (1994). 2. Crameri, A., et al., “DNA shuffling of a family of genes from diverse species accelerates directed evolution”, Nature 391, 288 (1998). 3. Bogarad, L. and Deem, M., “A hierarchical approach to protein molecular evolution”, Proc. Natl. Acad. Sci. USA 96, 2591 (1999). 4. Doolittle, R., “The multiplicity of domains in proteins”, Annu. Rev. Biochem 64, 287 (1995). 5. Kolkman, J. and Stemmer, W., “Directed evolution of proteins by exon shuffling”, Nat. Biotech. 19, 423 (2001). 6. Kaplan, P., “Parallel overlap assembly for the construction of computational DNA libraries”, et al., J. Theor. Biol. 188, 333 (1997). 7. Rose, J., The Fidelity of DNA Computation, Ph.D. Thesis, The University of Memphis, 155 (1999). 8. Rose, J., Deaton, R., Hagiya, M., and Suyama, A., “Equilibrium analysis of the efficiency of an autonomous molecular computer”, Phys. Rev. E 65, Article 021910 (2002); also in V. J. Biol. Phys. 3(2), (2002).
60
John A. Rose, Mitsunori Takano, and Akira Suyama
9. Rose, J., Deaton, R., Hagiya, M., and Suyama, A., “PNA-mediated whiplash PCR”, in Jonaska, N. and Seeman, N. (Eds.), DNA Computing (Springer-Verlag LNCS, Vol. 2340, Springer-Verlag, Berlin, 2002), 104. 10. Nemoto, N., Miyamoto-Sato, E., Husimi, Y., Yanagawa, H., “In vitro virus: Bonding of mRNA bearing puromycin at the 3’-terminal end to the C-terminal end of its encoded protein on the ribosome in vitro”, FEBS Lett. 414, 405 (1997). 11. Roberts, R. and Szostak, J., “RNA-Peptide fusions for the in vitro selection of peptides and proteins”, Proc. Natl. Acad. Sci. U.S.A. 94, 12297 (1997). 12. Liu, R., Barrick, J., Szostak, J., Roberts, R., “Optimized synthesis of RNA-Protein fusions for in vitro protein selection”, Methods Enzymol. 318, 268 (2000). 13. Sakamoto, K. et al., “State transitions by molecules”, BioSystems 52, 81 (1999). 14. Rose, J., Hagiya, M., Deaton, R., and Suyama, A., “A DNA-based in vitro genetic program”, J. Biol. Phys. 28, 493 (2002). 15. Wood, D. H., et al., “DNA starts to learn poker”, in Jonaska, N. and Seeman, N. (Eds.), DNA Computing (Springer-Verlag LNCS, Vol. 2340, Springer-Verlag, Berlin, 2002), 92. 16. Go, M., “Correlation of DNA exonic regions with protein structural units in Haemoglobin”, Nature 291, 90 (1981). 17. Go, M. and Nosaka, M., “Protein architecture and the origin of introns”, Cold Spring Harbor Symp. Quant. Biol. 52, 915 (1987). 18. de Souza, S., “Intron positions correlate with module boundaries in ancient proteins”, et al., Proc. Natl. Acad. Sci. USA , 14632 (1996). 19. Gilbert, W., “Why genes in pieces?”, Nature 271, 501 (1978). 20. Inaba, K. et al., “Structural and functional roles of modules in Hemoglobin”, J. Biol. Chem. 272, 30054-30060 (1997). 21. Inaba, K., Ishimori, K. Imai, K., Morishima, I., “Structural and functional effects of pseudo-module substitution in Hemoglobin subunits”, J. Biol. Chem. 273, 8080 (1998). 22. REBase restriction enzyme database, http://rebase.neb.com. 23. Giovannangeli, C., and Helene, C., “Triplex-forming molecules for modulation of DNA information processing”, Curr. Opin. Molec. Ther. 2, 288 (2000). 24. Milligan, J. and Uhlenbeck, O., “Synthesis of small RNAs using T7 RNA polymerase”, Methods Enzymol. 180, (Acad. Press, 1989), 51. 25. Kozak, M., “Comparison of the initiation of protein synthesis in prokaryotes, eukaryotes, and organelles”, Microbiol. Rev. 47, 1 (1983). 26. Adleman, L., “Molecular computation of solutions to combinatorial problems”, Science 266, 1021 (1994). 27. Sambrook, J., Fritsch, and E., Maniatis, T, Molecular Cloning: A Laboratory Manual, 3rd Ed., (Cold Spring Harbor Press, Cold Spring Harbor, New York, 2001). 28. Kuhn, H., et al., “Kinetic sequence discrimination of cationic bis-PNAs upon targeting of double-stranded DNA”, Nuc. Acids Res. 26, 582 (1998). 29. Ellman, J., et al., “Biosynthetic method for introducing unnatural amino acids site-specifically into proteins”, Methods Enzymol. 202, 301 (1991). 30. Griffiths, A. and Tawfik, D., “Man-made enzymes-from design to in vitro compartmentalisation”, Curr. Opin. Biotech. 11, 338 (2000). 31. Peyret, P., et al., “Nearest-neighbor thermodynamics and NMR of DNA sequences with internal A·A, C·C and T·T mismatches”, Biochemistry 38, 3468 (1999). 32. Sakamoto, K., et al., “Molecular computation by DNA hairpin formation”, Science 288, 1223 (2000).
Engineering Signal Processing in Cells: Towards Molecular Concentration Band Detection Subhayu Basu, David Karig, and Ron Weiss Princeton University, Princeton, New Jersey {basu, dkarig, rweiss}@princeton.edu
Abstract. We seek to couple protein-ligand interactions with synthetic gene networks in order to equip cells with the ability to process internal and environmental information in novel ways. In this paper, we propose and analyze a new genetic signal processing circuit that can be configured to detect various chemical concentration ranges of ligand molecules. These molecules freely diffuse from the environment into the cell. The circuit detects acyl-homoserine lactone ligand molecules, determines if the molecular concentration falls within two prespecified thresholds, and reports the outcome with a fluorescent protein. In the analysis of the circuit and the description of preliminary experimental results, we demonstrate how to adjust the concentration band thresholds by altering the kinetic properties of specific genetic elements, such as ribosome binding site efficiencies or dna-binding protein affinities to their operators.
1
Introduction
Cells are complex information processing units that respond in highly sensitive ways to environmental and internal signals. Examples include the movement of bacteria toward higher concentrations of nutrients through the process of chemotaxis, detection of photons by retinal cells and subsequent conversion to bioelectrical nerve signals, release of fuel molecules due to hormones that signal hunger, coordinated secretion of virulence factors and degradative enzymes by bacterial cells using quorum sensing molecules, and cell differentiation based on signal gradients. We strive to engineer cells that process internal and environmental information in novel ways by integrating protein-ligand interactions with synthetic gene networks. Applications include patterned biomaterial fabrication, embedded intelligence in materials, multi-cellular coordinated environmental sensing and effecting, and programmed therapeutics. These applications require synthesis of sophisticated and reliable cell behaviors that instruct cells to process information and make complex decisions based on factors such as extra-cellular conditions and current cell state. In this paper, we propose a new genetic signal processing circuit for detecting tunable ranges of chemical concentrations of ligand molecules that freely diffuse into the cell. The signal processing is performed in engineered Escherichia coli hosts to detect acyl-homoserine lactone (acyl-HSL) quorum sensing molecules. M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 61–72, 2003. c Springer-Verlag Berlin Heidelberg 2003
62
Subhayu Basu, David Karig, and Ron Weiss
OO O O N H
OO O O N H OO O O N H
LuxR
OO
OO O O N H
OLuxR NO H
P(R)
P(X)
X
Z1
P(Z)
Y
P(Y)
W
P(W)
GFP
Z2
Fig. 1. Gene Network for a chemical concentration band detector
The underlying mechanisms rely on ligand molecules binding to cytoplasmic proteins and the binding of cytoplasmic proteins to DNA segments that regulate the expression of other proteins. The genetic circuit consists of components that detect the level of acyl-HSL, determine if the level is within the range of two prespecified thresholds, and report the outcome with a fluorescent protein (Figure 1). The acyl-HSL signal is produced either by naturally occurring organisms [5] or by bacterial hosts engineered to secrete the molecules in order to perform cell-cell communications[12]. The acyl-HSL freely diffuses from the environment into cells and binds to the luxR cytoplasmic protein, enabling the protein to form a dimer. In turn, the dimer complex binds to the DNA and activates the lux P(R) promoter. The activated transcription results in the expression of regulatory proteins (X and Y) that control two series of downstream promoters. Here, DNA-binding repressor proteins X, Y, W, and Z, and their promoter counterparts are carefully chosen or engineered to have desired kinetic properties. The sub-circuit originating from the X protein determines the lower threshold of the acceptable acyl-HSL range, while the sub-circuit originating from the Y protein determines the high threshold. If the acyl-HSL chemical concentration falls within the range, the reporter green fluorescent protein (GFP) is expressed at high levels and can be detected externally. In the analysis of the circuit and the description of preliminary experimental results, we demonstrate how to adjust these thresholds by altering the kinetic properties of specific genetic elements, such as the ribosome binding site (RBS) efficiencies or the dna-binding protein affinities to their operators. The output of the band detection circuit can be coupled to other genetic circuits and regulatory responses. This circuit is therefore useful for monitoring many protein-ligand interactions that affect gene regulation and can serve as a modular component for a variety of signal processing tasks. For example, it can be used in cell-cell communications systems, in the detection of chemical gradients, and in synthetic cell aggregate systems that gather, process, and respond to environmental signals spanning large-scale areas. In the remainder of the paper, we describe relevant work and background (Section 2), introduce the design of the band detection circuit (Section 3), analyze the ability to modify band thresholds (Section 4), report on preliminary
Engineering Signal Processing in Cells
0
P1
R2 P2
[Off]
R3 CFP
63
YFP P3
I2 measure TC
P1
R2
P3
I2
P2
R3
YFP
CFP
Fig. 2. Genetic circuit to measure the device physics of an R3 /P3 cellular gate: digital logic circuit and the genetic regulatory network (Px : promoters, Rx : repressors, CFP/YFP: reporters) experimental results that demonstrate the functioning of certain sub-components of this circuit (Section 5), and offer conclusions and a discussion of the issues in implementing the full circuit (Section 6).
2 2.1
Background Quorum Sensing
Quorum sensing enables coordinated behavior among bacteria[2]. Specifically, acyl-homoserine lactones (acyl-HSLs) diffuse freely through cell walls and serve as intercellular communication signals. Significant accumulation of acyl-HSL results in interaction of this signal chemical with specific DNA-binding R-proteins. This bound complex then activates transcription of a certain gene or sets of genes. Synthesis of acyl-HSLs is mediated by specific I-genes. As an example, the quorum sensing system in Vibrio fischeri, which grows in a symbiotic relationship with sea organisms such as the Hawaiian sepiolid squid, regulates density dependent bioluminescence. In this system, the luxI gene codes for production of LuxI, which is responsible for synthesis of 3-oxohexanoyl-homoserine lactone (3OC6HSL). The luxR gene codes for the LuxR protein, which binds to accumulated 3OC6HSL to activate gene transcription. Previously, we successfully transferred this quorum sensing mechanism to E. coli hosts for use in engineered cell-cell communications[12]. 2.2
Synthetic Gene Networks
Other recent projects have also experimentally demonstrated forward-engineered genetic regulatory networks that perform specific tasks in cells. Becskei’s autorepressive construct[3] is a single gene that negatively regulates itself to achieve
64
Subhayu Basu, David Karig, and Ron Weiss
a more stable output. Gardner’s toggle switch[6] is a genetic system in which two proteins negatively regulate the synthesis of one another. This system is bistable, and sufficiently large perturbations can switch the state of the system. Elowitz’s represillator[4] is a genetic system in which three proteins in a ring negatively repress each other. This system oscillates between low and high values. For the above systems, the analysis and experimental results reveal that the genetic components must be matched to achieve correct system operation, as also discussed in [11]. 2.3
Device Physics of Genetic Circuit Components
We have previously defined genetic process engineering as a method for genetically altering system components until their device physics are properly matched. These components can then be combined into more complex circuits that achieve the desired behavior. For example, ribosome binding sites (RBS) can be mutated to alter rates of translation of mRNA into protein. We constructed genetic circuits to measure the device physics of cellular gates[10], as shown in Figure 2. In one instance of this network, the R2/P2 component consists of a lacI/p(lac) gate and the R3/P3 component consists of a cI/λP (R) gate. In this case, the level of the IPTG inducer molecule (I2) controls the level of the cI input repressor. With matching gates, the logic interconnect of this circuit should result in YFP fluorescence intensities that are inversely correlated with the IPTG input levels. The lowest curve in Figure 2 (RBS R1) shows the transfer curve of a cI/λP (R) inverter prior to genetic process engineering. The transfer curve relates IPTG input concentrations to the median fluorescence of cells grown in a culture at these IPTG concentrations. The cells were grown for several hours in log phase until protein expression reached a steady state. The unmodified cI/λP (R) circuit responds weakly to variations in the IPTG inducer levels. Genetic process engineering was used to modify the cI/λP (R) inverter to obtain improved behavioral characteristics. Ribosome Binding Site (RBS) sequences significantly control the rate of translation from messenger RNA(mRNA) molecules to the proteins for which they code. We replaced the original highly efficient RBS of cI with a weaker RBS site by site-directed mutagenesis and were able to noticeably improve the response of the circuit (Figure 2, RBS R2). In further genetic process engineering (Figure 2, RBS R2/OpMut4), a one base pair mutation to the cI operator site of λP (R) yields a circuit with an improved inverse sigmoidal response to the IPTG signal. The signal processing circuits described in Section 3 are assembled by combining multiple genetic components with matching characteristics into compound circuits. To effectively synthesize these compound circuits, the device physics of circuit components can be engineered using site-directed mutagenesis and molecular evolution techniques. Note that the genetic constructs for digital logic inverters described in this section are also used for the low threshold component of the band detection circuit.
Engineering Signal Processing in Cells 0.4
0.4 mRNA XY mRNA Z1
0.3 mRNA conc
mRNA conc
0.3 0.2 0.1 0 −1 10
65
0.2 0.1
0
10
1
[HSL]
(a) low threshold
10
0 −1 10
mRNAXY mRNA W mRNAZ2
0
10
1
[HSL]
10
(b) high threshold
Fig. 3. Low threshold and high threshold sub-circuits
3
Design of a Chemical Concentration Band Detection Circuit
The proposed construction for a chemical concentration band detector circuit, shown in Figure 1, expresses high levels of the reporter gene (GFP) only when the concentration of the acyl-HSL signal is within a specific range. The genetic circuit consists of three subcircuits: a low threshold detector, a high threshold detector, and a negating combiner. The series of transcriptional regulators that originates from the repressor protein X determines the lower threshold. When acyl-HSL binds to the R-protein, the molecular complex activates transcription of protein X. In turn, high concentrations of protein X repress the production of protein Z from the P(X) promoter (labeled as Z1 because protein Z can also be expressed from the P(W) promoter). Figure 3(a) shows a simulation of the steady state response of P(X) transcription of protein Z with respect to varying HSL concentrations. The simulations illustrate the average messenger RNA (mRNA) levels for X and Z1 in a cell that contains the band detect circuit, with all units denoting µmolar concentrations. As shown, mRNAZ1 is high only if the level of HSL is low. Notice that P(R) is multi-cistronic, coding for both X and Y that are expressed from mRNAXY . However, the translation rates of X and Y are different due to the fact that the carefully chosen RBS efficiencies for the respective proteins differ. In [10] and Section 2, we demonstrate the ability to quantitatively modify the transfer curve characteristics of genetic components by using a variety of RBSs. The second subcircuit, which determines the high threshold, consists of transcriptional regulators that originate from protein Y. Figure 3(b) shows the steady state relationship between HSL input levels and mRNA levels for XY, W, and Z2 . The RBS for Y is weaker than the RBS for X. Therefore Y is produced at lower rates than X for any given level of HSL (Figure 4(a)). As a result of the lower rate of protein Y expression, protein W is still highly expressed in response to high HSL levels when P(X) is already inactivated. This allows P(W) to act
66
Subhayu Basu, David Karig, and Ron Weiss 15
15
protein conc
protein conc
X Y 10
5
0 −1 10
0
[HSL]
10
5
0 −1 10
1
10
X W Z
10
(a) X versus Y expression
0
1
10
[HSL]
10
(b) X and W determine total Z
Fig. 4. Determinants of the band detector
20
20
Z GFP
15 protein conc
protein conc
15
10
10 Z GFP
5
5
0 −1 10
0
10
1
10
(a) original band detector
0 −1 10
0
10
1
[HSL]
10
(b) modified band detector
Fig. 5. Different band detectors from negating Z
as the high threshold detector by transcribing Z only when the HSL input is above a certain level. The last subcircuit combines the output of the two preceding subcircuits and negates their total product to produce the band detector. Figure 4(b) illustrates how the level of Z in the cell is determined by both X and W. Logically, Z is high when either X or W is low (Z = X NAND W). The output protein Z functions as a band-reject circuit. Finally, Figure 5(a) shows how the combined level of Z from transcription of both P(X) and P(W) represses the final GFP output, resulting in a band detector. By tuning reaction kinetics such as RBS efficiencies, protein decay rates, and protein-operator affinities, this synthetic gene network can be configured to respond to different signal ranges. For example, Figure 5(b) shows how to modify the band detector to accept a lower threshold by choosing ribosome binding sites for proteins X and Y that are three-fold more efficient. The simulation results described here were obtained by integrating ordinary differential equations that describe the biochemical reactions of the band de-
2
4
1.8
3.5
1.6
3
1.4
2.5
hsl−width
hsl−mid
Engineering Signal Processing in Cells
1.2 1
67
2 1.5
0.8
1
0.6 0.9
0.5 0.9 0.8
0.1 0.7
0.15 0.2
0.6 0.5 kxlate−X
0.8
0.1 0.7
0.15
0.35
kxlate−Y
(a) HSL midpoint of band detector
0.25
0.5
0.3 0.4
0.2
0.6
0.25 kxlate−X
0.3 0.4
0.35
kxlate−Y
(b) HSL width of band detector
Fig. 6. Impact of modifying X and Y RBS efficiencies on band midpoint and width
tector circuit. Kinetic rates published in the literature for various components, as well as educated guesses[11], were used in the simulations. The simulations demonstrate the qualitative effects of modifying genetic components in the forward engineering of synthetic gene networks. In the graphs, the nonlinear response of the components is due to repressor protein dimerization and the existence of multiple operator sites. We have used both of these common genetic regulatory motifs in previous experiments[10]. The next section analyzes the ability to change band thresholds by modifying various kinetic parameters of the circuit components.
4
Forward Engineering of Band Characteristics
This section examines forward engineering of band characteristics through the modification of two genetic regulatory elements: RBS’s and repressor/operator affinities. Two key characterizations of a band detect circuit are the midpoint of its detection range and the width of this range. The width is defined as the distance between the low and high cutoff points. The cutoff point is the HSL level at which the output of the band detector switches between what a downstream circuit considers high or detectable and what it considers low or undetectable. For the analysis below, we define the cutoffs as the HSL input levels at which the output GFP concentration is 0.3 µM. We assume that GFP concentrations above this threshold can be reliably detected by flow cytometry. Figure 6 depicts the effects of simultaneously changing the RBS efficiencies of X (kxlatex ) and Y (kxlatey ) on the midpoint and width of the band detector. The x and y axes represent the various RBS efficiencies, while the z axis depicts the HSL midpoint and HSL band width. As the RBS efficiency of protein X increases, a given HSL level results in additional translation of protein X. Thus, less mRNAZ1 is transcribed, and the low threshold component of the Z protein
68
Subhayu Basu, David Karig, and Ron Weiss
1.5
3 2.5
hsl−width
hsl−mid
2 1
1.5 1 0.5
0.5 4
0 4 0.5
3
0.5
3
1 1.5
2
2 1
k−bind−X2−P−X
1
3.5 4
k−bind−Y2−P−Y
(a) HSL mid point for band detector
2 2.5
1
3 0
1.5
2
2.5 k−bind−X2−P−X
3 0
3.5 4
k−bind−Y2−P−Y
(b) HSL width for band detector
Fig. 7. Impact of modifying X and Y protein/operator binding affinities
curve shifts left. This shift increases the band width and moves the midpoint left. As the RBS efficiency for Y increases, the high threshold component of the Z protein curve also shifts left, causing the band width to decrease and the midpoint to move left. The impact of simultaneously altering the binding affinities of the X2 and Y2 dimer proteins to their respective promoters is illustrated in Figure 7. If an X2 dimer binds more readily to the promoter responsible for transcription of mRNAZ1 , the low threshold component of the Z protein curve shifts left. This shift in turn causes the width of the band to increase and moves the midpoint to the left. As the strength of Y repression increases, the high threshold component of the Z protein curve shifts left, decreasing the band width and moving the midpoint left. A recurring trend in the analysis here is that changes in the RBS efficiency and the repression strength of Y have a greater impact on the shape of the band than comparable changes in the RBS efficiency and repressive strength of X. One reason that the constants associated with Y have greater impact is that Y influences the Z protein curve through an additional gain stage resulting from the W repressor. Simulations reveal that if the binding constant of W to its promoter and the RBS efficiency of W are reduced, the impact of Y on the HSL midpoint and band width are also reduced (graphs not shown). Another reason for the discrepancy is that Y controls Z values that correspond to a higher range of the HSL input signal than the Z values controlled by X.
5
Preliminary Experimental Results
In this section, we describe preliminary experimental results that demonstrate the functioning of certain subcircuits for performing band detection. Section 2 describes previous results of a low threshold subcircuit tunable by modifications of ribosome binding site efficiencies and repressor/operator affinities. In the next
Engineering Signal Processing in Cells
P3 P
69
Lambda P(R-O12-mut4) RBSII
CFP
EYFP
APr
pCMB-2 4397 bp
lacI
RBS II
pCMB-100
Kan(r)
P(LtetO-1)
4940 bp
P(LAC) tetR
RBS H T0 Term cI ColE1 ORI
p15A ori T1 Term
Fig. 8. pCMB-2 and pCMB-100
two sections, we present new experimental data for detecting a high threshold and for responding to acyl-HSL signals. 5.1
Implementation of a High Threshold Detection Component
To detect molecular concentrations above specific thresholds, we constructed the two plasmids in Figure 8 using standard DNA cloning techniques[1, 8]. The pCMB-2 plasmid contains an ampicillin resistance gene and a medium copy number origin of replication (ColE1 ORI). It also has a tet repressor (TetR) gene coding sequence that is transcribed from the ampicillin p(bla) promoter. The tetR regulates the P(LtetO-1) promoter on the pCMB-100 plasmid (kanamycin resistance, p15A medium copy number origin of replication). The lac repressor (lacI) and cyan fluorescent protein (CFP) from Clontech are transcribed from the P(LtetO-1) promoter. CFP reports the lacI levels. When the anhydrotetracycline (aTc) inducer molecule is introduced into the cell, it binds to TetR and prevents TetR from repressing P(LtetO-1). The aTc inducer molecule functions as the external input to the high threshold circuit component. The lacI protein represses P(lac) and regulates the expression of cI, the λ repressor protein[7]. cI is a highly efficient repressor that exhibits dimerization and cooperative binding to its operator. Finally, the λP (R−O12−mut4) promoter[10] on pCMB-2 is repressed by cI and regulates the expression of the enhanced yellow fluorescent protein (EYFP) output of the circuit. Therefore, the relationship between the aTc input and EYFP output describes the behavior of the high threshold component. To experiment with this circuit, we prepared twelve tubes each of 2ml LB ampicillin/kanamycin solution with different concentrations of aTc. We transformed E. coli STBL2 cells from Invitrogen with both the pCMB-2 and pCMB100 plasmids and picked a single colony into fresh media. The culture was distributed to the twelve different tubes that were shaken at 250RPM and @37◦ C
70
Subhayu Basu, David Karig, and Ron Weiss 10000
Median Fluorescence
1000
100
10
P(bla)
tetR
P(lac)
aTc
pCMB-2/pCMB-100
cI 1 0.1
P(tet)
lacI
CFP
λP(R)
YFP
1
10
100
[aTc] (uM)
Fig. 9. High threshold component of the band detector: circuit design and experimental results for approximately 6 hours until they reached an optical density at 600nm of approximately 0.3. The cells were washed with 0.22µm filter-sterilized phosphate buffered saline (PBS) twice, and the fluorescence levels of the cells were measured using Fluorescence-Activated Cell Sorting (FACS)[9] on a FACSVantage flow cytometer. The machine has two argon excitation lasers, one set at 458nm with an emissions filter of 485/22nm for detecting CFP, and the other laser set at 514nm excitation with an emissions filter of 575/26nm for detecting EYFP. Filters were obtained from Omega Optical. Figure 9 shows the median fluorescence level for the cell populations grown with different aTc inducer concentrations. The EYFP exhibits a strong sigmoidal relationship to the aTc input levels with a sharp transition from low to high output. The results in Figures 9 and 2 demonstrate components that respond specifically to signals bound by low or high thresholds. However, these subcircuits currently respond to either iptg or aTc inputs, and their behavior cannot be compared directly. To synthesize an operational band detector, it is likely that we will need to reduce the strength of the response for the high threshold. The next section describes a circuit that responds to acyl-HSL levels. 5.2
Implementation of an Acyl-HSL Detect Circuit
We previously constructed plasmids for performing cell-cell communications[12]. These plasmids are pSND-1, pPROLAR.A122, and pRCV-3. The pSND-1 plasmid, which has a p(Lac) promoter and a luxI gene sequence, is used to produce acyl-HSL. This plasmid has a ColE1 replication origin and ampicillin resistance. The luxI gene encodes an acyl-homoserine lactone synthesase that uses highly available metabolic precursors found within most gram negative prokaryotic bacteria (acyl-ACP from the fatty acid metabolic cycle, and S-adenosylmethionine from the methionine pathway) to synthesize N-(3-oxohexanoyl)-3-amino-dihydro2-(3H)-furanone, or 3OC6HSL. The pPROLAR.A122 plasmid is used as a negative control and contains only a p15A origin of replication and kanamycin resistance. The pRCV-3 plasmid, which contains a luxP(R) promoter followed by a GFP(LVA) coding sequence from Clontech, and a luxP(L) promoter followed by
Engineering Signal Processing in Cells
71
Fluorescence
1000.00
100.00
10.00
1.00 10
100
1000
HSL
Fig. 10. Median fluorescence of cell cultures with different levels of HSL a luxR coding sequence. pRCV-3 is used for quantifying the response to acyl-HSL signals. The results in [12] report on the relationship between acyl-HSL levels and the corresponding GFP fluorescence induced in pRCV-3. For high levels of an acyl-HSL extract, the level of fluorescence was observed to decrease. The decrease in fluorescence was likely due to the toxicity of the acyl-HSL extract. For this paper, we modified the experimental protocol in order to avoid using the acyl-HSL extract. Cells with pSND-1 plasmids were first grown @37◦ C to an optical density of 0.3. These plasmids produced acyl-HSL, which diffused freely through the cell membrane. The cells were centrifuged at 6000g, and the HSLcontaining supernatant was extracted. At the same time, different cells with pPROLAR.A122 were grown @37◦ C to an optical density of 0.3, and the supernatant was extracted following centrifugation at 6000g. The pPROLAR.A122 supernatant was used to dilute the HSL-containing supernatant to various concentrations. This was done to keep the nutrient concentration the same in all of the tubes while varying the HSL concentrations. Each dilution was aliquotted into a tube containing 1ml of fresh LB with ampicillin and kanamycin. We also added ampicillin and kanamycin as appropriate to keep the final concentrations of these antibiotics the same as in the original 1ml LB/ampicillin/kanamycin solution. A single colony of cells transformed with both the pRCV-3 and the pPROLAR.A122 plasmids was selected and grown in the separate tubes @37◦ C until the cultures reached optical density of approximately 0.3. Next, the cells were washed and resuspended in 0.22µm filter-sterilized PBS, and the fluorescence of the cell population was measured using a FACScan flow cytometer with an argon laser excitation at 488nm and emissions filter of 530/30nm. Figure 10 shows the median fluorescence of each of the different samples that exhibits a direct sigmoidal relationship to increasing HSL concentrations. The cells did not exhibit any decrease in fluorescence as the HSL concentration was increased.
72
6
Subhayu Basu, David Karig, and Ron Weiss
Conclusions
In this paper, we propose to couple protein-ligand interactions with synthetic gene networks for detecting molecular signal concentration bands. The analysis of the circuit demonstrates several factors that can help forward-engineer this circuit to acquire different thresholds for the band detection. We also presented preliminary experimental results of the functioning of the low threshold component, the high threshold component, and the ability to respond to acyl-HSL signals. In the effort to build the complete version of this circuit, great emphasis will be placed on the quantitative characterization of the components, including the study of cell population statistics. To arrive at components with the appropriate device physics, we plan to employ site-directed mutagenesis and molecular evolution techniques. The mechanisms employed and lessons learned in building this particular circuit are likely to be beneficial for the broader goal of building a variety of novel signal processing circuits in cells.
References [1] F. M. Ausubel, R. Brent, R. E. Kingston, D. D. Moore, J. G. Seidman, J. A. Smith, and K. Struhl. Short Protocols in Molecular Biology. Wiley, 1999. [2] B. L. Bassler. How bacteria talk to each other: regulation of gene expression by quorum sensing. Current Opinion in Microbiology, 2:582–587, 1999. [3] A. Becskei and L. Serrano. Engineering stability in gene networks by autoregulation. Nature, 405:590–593, June 2000. [4] M. Elowitz and S. Leibler. A synthetic oscillatory network of transcriptional regulators. Nature, 403:335–338, January 2000. [5] W. C. Fuqua, S. Winans, and E. P. Greenberg. Quorum sensing in bacteria: The luxr-luxi family of cell density-responsive transcriptional regulators. J. Bacteriol, 176:269–275, 1994. [6] T. Gardner, R. Cantor, and J. Collins. Construction of a genetic toggle switch in escherichia coli. Nature, 403:339–342, January 2000. [7] M. Ptashne. A Genetic Switch: Phage lambda and Higher Organisms. Cell Press and Blackwell Scientific Publications, Cambridge, MA, 2 edition, 1986. [8] J. Sambrook, E. F. Fritsch, and T. Maniatis. Molecular Cloning: A Laboratory Manual. Cold Spring Harbor Laboratory Press, Plainview, NY, 1989. [9] H. M. Shapiro. Practical Flow Cytometry. Wiley-Liss, New York, NY, 1995. Third Edition. [10] R. Weiss and S. Basu. The device physics of cellular logic gates. In NSC-1: The First Workshop of Non-Silicon Computing, Boston, Massachusetts, February 2002. [11] R. Weiss, G. Homsy, and T. F. Knight Jr. Toward in-vivo digital circuits. In Dimacs Workshop on Evolution as Computation, Princeton, NJ, January 1999. [12] R. Weiss and T. F. Knight Jr. Engineered communications for microbial robotics. In DNA6: Sixth International Workshop on DNA-Based Computers, DNA2000, pages 1–16, Leiden, The Netherlands, June 2000. Springer-Verlag.
Temperature Gradient-Based DNA Computing for Graph Problems with Weighted Edges Ji Youn Lee1 , Soo-Yong Shin2 , Sirk June Augh3 , Tai Hyun Park1 , and Byoung-Tak Zhang2,3 1
Cell and Microbial Engineering Laboratory School of Chemical Engineering, 2 Biointelligence Laboratory School of Computer Science and Engineering, 3 Center for Bioinformation Technology (CBIT), Seoul National University, Seoul 151-742, Korea {jylee, syshin, sjaugh, thpark, btzhang}@bi.snu.ac.kr
Abstract. We propose an encoding method of numerical data in DNA using temperature gradient. We introduce melting temperature (Tm) for this purpose. Melting temperature is a unique characteristic to manipulate the hybridization and denaturation processes that used in the key steps in DNA computing such as the solution generation step and the amplification step. DNA strands of lower melting temperature tend to denature with ease and also be easily amplified by slightly modified polymerase chain reaction, called denaturation temperature gradient polymerase chain reaction. Using these properties, we implement a local search molecular algorithm using temperature gradient, which is contrasted to conventional exhaustive search molecular algorithms. The proposed methods are verified by solving an instance of the travelling salesman problem. We could effectively amplify the correct solution and the use of temperature gradient made the detection of solutions easier.
1
Introduction
Since Adleman’s pioneering work[1], DNA computing has been applied to various fields of research including combinatorial optimization [9], massive parallel computing [7], Boolean circuit development [11], nanotechnology [17], huge database [12], and so on. Though many researches achieve the good results, most of these applications do not consider the problem of representing numerical data in DNA molecules. However, many real world applications involve graph problems which have weighted edges. Examples include the shortest path problem, the travelling salesman problem, the minimum spanning tree problem, and the Steiner tree problem [4]. The numerical data representation method in DNA strands is the one of the important issue to extend the field of DNA computing. Though some researchers tried to represent the numerical data using DNA, the results are not satisfactory yet. M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 73–84, 2003. c Springer-Verlag Berlin Heidelberg 2003
74
Ji Youn Lee et al.
In this paper, we propose a novel encoding method that uses temperature gradient to overcome the drawbacks of the previous works. We represent the numerical data using melting temperature gradient, and implement a local search molecular algorithm with the temperature gradient method. The travelling salesman problem (TSP) is used as a benchmark problem for the proposed technology. TSPs are interesting in that their solution requires representing the path weights. This is contrasted with the Hamiltonian path problem where the connection cost is binary. Our bio-lab experiments show that the correct DNA strands are effectively amplified and the detection of optimal solutions made easier. In Section 2, we describe the molecular encoding of numerical data in DNA molecules. Section 3 explains the molecular algorithm and experimental procedure for solving TSP. Section 4 presents the results and discusses them. The conclusions are drawn in Section 5.
2 2.1
Molecular Encoding for Edge Weights of Graph Previous Encoding Methods
Firstly, Narayanan and Zorbalas proposed DNA algorithms to solve travelling salesman problems [8]. Their method makes the length of weight sequences proportional to the edge costs in the edge sequences. This method is inefficient in representing a wide range of weights because, in some cases, one edge sequence with a high weight must be very long. For the same reason, it is also inefficient to represent real values. In addition, the fact that larger weights are encoded as longer sequences is contrary to the biological fact; the longer the sequences are, the more likely they hybridize with other DNA strands, though we have to find the shortest DNA strands. Yamamura et al. proposed a concentration control method to represent the weights [18]. The concentration of each DNA is used as input and output data, i.e. the numerical data is encoded by concentrations of DNAs. This method enables local search among all candidate solutions instead of exhaustive search. However, the concentration control method has some drawbacks in detecting the solutions. One cannot be sure that the most intensive band (in the gel) has the optimal solutions, because the most intensive band can be made by a number of partial non-optimal solutions with low concentration rather than optimal solutions with high concentration. In addition, it is technically difficult to extract a single optimal solution from the most intensive band. In previous work [15], we proposed a method for representing real-values in fixed-length DNA strands using GC contents. Edge sequences contain two components: link sequences and weight sequences. The weight of edges is represented by varying the amount of A/T pairs and G/C pairs in weight sequences. Since there are two hydrogen bonds formed between A and T and three hydrogen bonds between G and C, the hybridizations between the G/C pairs are preferred to those between A/T pairs. Therefore, the search procedure can be guided by including more A/T pairs to higher weight sequences and more G/C
Temperature Gradient-Based DNA Computing for Graph Problems
75
pairs to smaller weight sequences. And we verified our method by the computer simulation. 2.2
Melting Temperature Control Encoding
Based on previous work, we improve the weight representation method by allowing the hybridization process to be controlled by melting temperature. Though the number of hydrogen bonds is an important factor deciding the thermal stability of DNA strands, it is not the only one. The melting temperature (Tm) is the more direct characteristic of the stability of the DNA hybrid and Tm is determined by more complex function consists of various factors including GC content. So, we adopt a melting temperature to encode the DNA strands. Many methods have been proposed to determine the Tm value of DNA duplex. In the absence of destabilizing agents, like formamide or urea, Tm depends on three major parameters: the GC content and thermodynamic factors, the strand concentration, and the salt concentration. If we ignore the reaction conditions, Tm only depends on the GC content and thermodynamic factors. The classical method is using GC content, salt concentration, and the length [16]. But recently a statistical method using the thermodynamic parameters such as ∆H and ∆S is proposed [5, 10]. The latter model is known as the nearest-neighbor (NN) model that is more accurate and applicable to DNA duplex up to 108 bp. We use both the GC content method and the nearest-neighbor method to calculate the Tm. If the sequences are short, the NN method is used, otherwise the classical method is mainly applied. Though Tm of the DNA duplex up to 108 bp can be accurately determined by the NN method, Tm of the longer DNA strands formed after hybridization and ligation depends on the classical method rather than the NN method.
3 3
0 5
3
3 3
1
4 7
9 3
2
AGCT TAGG P1A P1B
1
11 11 3 5
6 3
3 ATCC ATCA TACC P1B W12 P2A
2
7 ATCC GCCT GCTA P1B W13 P3A
3
Fig. 1. Graph for the travelling salesman problem (left) and its example of encoding in DNA (right). The vertex sequence is 5 → 3 and the edge sequence is 3 → 5 . The optimal path for this problem is ‘0 → 1 → 2 → 3 → 4 → 5 → 6 → 0’. The melting temperature control encoding scheme is illustrated for the travelling salesman problem in Fig. 1. Basic representation is similar to Adleman’s
76
Ji Youn Lee et al.
method [1]. The difference is that edge sequences have the weight sequence part in the middle of their sequences, W12 , W13 (Refer to the right part of Fig. 1). To design the sequences for weighted-graph problems using the proposed method, the vertex sequences are designed firstly. Each vertex sequence is designed to have a similar Tm using both the nearest-neighbor and the classical method. That is why the vertex sequences should not affect the hybridization fidelity. Then, the edge sequences are generated. The edge sequence consists of the two parts such as the link sequence (P1B , P2A , P3A ) and the weight sequence (W12 , W13 ). This scheme is motivated from [9]. The link sequences are based on the vertex sequences to be linked and have also a similar Tm, since the link sequences of the edge sequences are decided by the vertex sequence. The weight sequences are designed to have a various Tm according to their representative cost. To produce more variation in generating low cost paths, the weight sequences with smaller weights have a lower Tm. If DNA strands have a lower Tm, it can be easily denatured and also easily amplified by denaturation temperature gradient polymerase chain reaction. For example, as shown in Fig. 1, the first part (P1B ) of the edge sequence is complementary to the last half (P1B ) of the starting vertex sequence. And the last part (P2A ) is complementary to the first half of the ending vertex sequence (P2A ). The weight sequence W12 with cost 3 contains more A/T pairs than the weight sequence W13 with cost 7 to lower the Tm. 2.3
Travelling Salesman Problems
We selected travelling salesman problem as a benchmark. The travelling salesman problem (TSP) is to find a minimum weight (cost) path for a given set of vertices (cities) and edges (roads). In addition, the solution path must contain all the cities given, each only once, and begin from the specified city to which the tour ends [4]. We solve the TSP with 7 nodes, 23 edges and 5 weights as shown in Fig. 1. For convenience, we represent the weights by decimal numbers such as 3, 5, 7, 9, and 11. The example of DNA sequences for solving TSP is shown in Table 1. These sequences are generated by the NACST sequence generator (NACST/Seq) [6]. The sequences are generated to prevent mis-hybridization and unexpected secondary structure using seven constraints such as similarity, H-measure, Hmeasure in the 3’-end, GC ratio, continuity, the unexpected secondary structure, and melting temperature [14, 13]. For the vertex sequences, Tm ranges 55o C to 60o C using the NN model with 1M salt concentration and 10nM oligomer concentration, GC content is restricted to 50%, the unexpected secondary structure such as hairpin formation is prohibited. In the weight sequences, Tm is increased by the cost; GC content is varied from 30% to 70% (see Table 1). To avoid the extreme case, i.e. the sequence consists of all C or G, we set the range as 30% ∼ 70%. As the result of evolutionary algorithms, NACST/Seq assigns the 30% to weight 3, 40% to weight 5, and so on. NACST/Seq increases GC content by 10%, as the weight is increased by two. After hybridization and ligation, the long sequences are generated which are not fit to the NN model. Therefore, evolutionary algorithm changed the GC ratio more precisely than melting temperature.
Temperature Gradient-Based DNA Computing for Graph Problems
77
Table 1. Vertex sequences and weight sequences for TSP. Tm is calculated by the NN method with 1M salt concentration and 10nM oligomer concentration. Vertex sequences Sequence (5 → 3 ) AGGCGAGTATGGGGTATATC CCTGTCAACATTGACGCTCA TTATGATTCCACTGGCGCTC ATCGTACTCATGGTCCCTAC CGCTCCATCCTTGATCGTTT CTTCGCTGCTGATAACCTCA GAGTTAGATGTCACGTCACG Weight sequences Edge cost Sequence (5 → 3 ) 3 ATGATAGATATGTAGATTCC GGATGTGATATCGTTCTTGT 5 GGATTAGCAGTGCCTCAGTT 7 TGGCCACGAAGCCTTCCGTT 9 GAGCTGGCTCCTCATCGCGC 11 No. 0 1 2 3 4 5 6
Tm GC% 60.73 50 59.24 50 59.00 50 56.81 50 58.13 50 59.44 50 56.97 50 Tm GC% 47.89 30 54.62 40 58.37 50 64.51 60 68.88 70
Additionally, the higher weight sequences have higher melting temperatures with the NN method.
3 3.1
Molecular Algorithms for TSP Previous Work
Most of the existing DNA computing methods to solve combinatorial optimization problems are similar to Adleman’s in several ways. First, all possible solutions are generated and then the correct solutions among them are selected. Also the previous works [8, 15, 18] on travelling salesman problems or shortest path problems are similar to each other. They only differ in their weight encoding schemes such as sequence length, GC content, and strand concentration. The former two studies were not verified by lab experiments, the last method is proved by lab experiments, though the results are not satisfactory. And last method [18] gives a bias to search space by concentration control. 3.2
Temperature Gradient Algorithms
In order to utilize the massive parallelism of biochemical materials and to guide search space, it is useful to give some biases in the experimental steps. For this purpose, we give some constraints in DNA concentration and the PCR step. By varying the concentration of each oligomer strands [18], we can generate more paths that contains a smaller sum of weights. Also by modifying the PCR protocol, we can specifically amplify and detect the correct solution easier. DNA strands of low melting temperature can
78
Ji Youn Lee et al.
be more strongly amplified in PCR by varying the denaturation protocol. Usually, we vary the annealing temperature to optimize the reaction condition. But by denaturing the dsDNA in the lower temperature in the starting cycles and gradually increasing the denaturation temperature, we can specifically amplify the DNA strands with a lower melting temperature. So we can amplify the correct solutions more than other solutions that have the same length but a higher melting temperature. The whole procedure to solve TSP is shown in Fig. 2. In step 1, we generate the solution set. Steps 2 ∼ 5 find the solution satisfying the restrictions (the starting vertex is the same as the end vertex). Step 6 separates the sequences visiting all vertexes. In steps 7 ∼ 8, we amplify the solutions based on its path cost and find the optimal solution. Finally, we check the path of the solution. Step 1: Hybridization and ligation [Generation of random paths] Step 2: PCR with primer vout (comp.) [Check the end vertex] Step 3: Gel electrophoresis Seperation by size and elution Step 4: PCR with primer vin [Check the start vertex] Step 5: Gel electrophoresis Seperation by size and elution
Step 6: Affinity-separation with a biotin-avidin magnetic beads system [Check the each vertex] Step 7: DTG-PCR with v in and vout (comp.) [Amplify the correct solutions more]
Step 8: Gel electrophoresis separation by size and Tm: TGGE Step 9: Sequencing and readout
Fig. 2. The molecular algorithms for solving TSP.
Oligomer Synthesis All 7 vertexes and 5 weights are designed in 20 mer ssDNA as listed in Table 1. And 23 edges in 40 mer ssDNAs are designed according to their vertexes and weight sequences. All oligomers are 5’-phosphorylated. Other 5’-biotinylated vertexes were prepared for affinity-separation. All oligomers were synthesized at Bioneer Co. Hybridization and Ligation Edge and weight oligomers were differently added by their weights. The amount decreased by 20% according to the weight increase by 2, set on the basis of weight 3 as a 100%. Oligomer mixture was heated to 95o C and slowly cooled to 20o C by 1o C per 1 minute, and stored at 4o C. Mix 5µl of hybridization mixtures and 350 units of T4 DNA ligase (TaKaRa, Japan), ligase buffer (66mM Tris-HCl, pH 7.6, 6.6mM M gCl2 , 10mM DTT, 0.1mM ATP), and add H2 O to a total volume of 10µl. We incubated the reaction mixture for 16 hours at 16oC.
Temperature Gradient-Based DNA Computing for Graph Problems
79
PCR Amplification and Gel Electrophoresis All PCR amplifications were performed on a PTC-200 DNA Engine (MJ Research, MA, USA). For normal amplification, 0.5µM of primer and AccuPower PCR PreMix (Bioneer, Korea) which containing 1 unit of T aq DNA polymerase in 10mM T ris-HCl, pH 9.0, 1.5mM M gCl2 , 40mM KCl, 0.25mM each dNTP were dissolved to distilled water to a total volume of 20µl. And PCR was processed for 34 cycles at 95o C for 30 seconds, at (T m − 5)o C for 30 seconds and at 72o C for 30 seconds. Initial denaturation and prolonged polymerization was executed for 5 minutes. All gel electrophoresis were performed with 2% Agarose-1000 (GibcoBRL, NY, USA) in 0.5X tris-borate-EDTA buffer and the gel was ethidium bromide stained. 50bp DNA Ladder (GibcoBRL, NY, USA) was used as a marker. Affinity Separation We roughly followed the affinity separation protocol in the Adleman’s experiments. The ssDNA for the affinity purification were produced by replacing the forward primer with 5’-biotinylated analog. The amplified product was annealed to streptavidin paramagnetic particles (Promega, Madison, WI) by incubating in 200ml of 0.5× saline sodium citrate (SSC) for 1 hour at room temperature with constant shaking. Particles were washed three times in 300ml of 0.5× SSC and then heated to 80o C in 100ml of ddH2 O for 5 minutes to denature the bound dsDNA. The aqueous phase with ssDNA was retained. For affinity separation, 1nmol of 5’-biotinylated vertex strands was annealed to particles as above and washed three times in 300ml of 0.5× SSC for 1 hour at room temperature with constant shaking. Particles were washed four times in 300ml of 0.5× SSC to remove unbound ssDNA and then heated to 80o C in 100ml of ddH2 O for 5 minutes to release ssDNA bound to the complementary vertex 1. The aqueous phase with ssDNA was retained. This process was then repeated with each vertexes. Denaturation Temperature Gradient PCR For denaturation temperature gradient PCR (DTG-PCR), the denaturation temperature was kept initially 70o C and gradually decreased 1o C per one cycle and kept 95o C for the remaining 10 cycles. Other conditions are identical with normal PCR described in the PCR amplification section. Temperature Gradient Gel Electrophoresis For TGGE analysis, we used 8% denaturing polyacrylamide gel containing 20% formamide and 4.2M urea. The electrophoresis was performed over 55o C ∼ 70o C temperature range at 200 volt for three hours. After the electrophoresis, the gel was silver stained. Cloning and Sequencing After the TGGE, the DNA strands in main band were excised, eluted and PCR amplified. This PCR product was cloned into pBluescript SK+ and sequenced using T7 primer.
80
Ji Youn Lee et al.
(A)
M
1
2
3
(B)
M
1
350bp
(C)
M
1
2
(D)
M
1
M
1
Fig. 3. Gel electrophoresis on a 2% agarose gel. The lanes contain: lane M denotes DNA size marker (50 bp ladder), (A) lanes 1,2: first ligation result, lane 3: oligomer mixture, (B) lane 1: second ligation result, (C) lanes 1,2: first PCR with Vout result, (D) lane 1: second PCR with Vin result
4 4.1
Results and Discussion Random Path Formation and Size Sieving
The start point to solve TSP is generating initial pool, random path formation. Searching a correct solution in the candidate pool is an important step to solve the problem. However, more generation of the possible solution in the candidate pool is readily achievable if we utilize the advantages of molecular computing. The reaction rate of biochemical reaction is related with the reaction constant and the reactant concentrations. Therefore, concentration gradient can be useful to obtain the correct solution. This approach was already tried by [18]. By increasing the concentration of DNA sequences of smaller weights and vice versa, paths which contains a smaller sum of weights will be more frequently generated. In our work, the concentration gradient was only a tool to generate more possible solutions. The hybridization and ligation results are shown in Fig. 3 (A). Compared with the oligomer mixture, the ligated DNA strands became elongated. But,
Temperature Gradient-Based DNA Computing for Graph Problems
81
there are few copies around the 300 bp that indicates the length of paths including 8 vertexes. So we executed the ligation reaction again and obtained an upper shifted ligation product as shown in Fig. 3 (B). However, still shorter DNA strands mainly occupy the ligation product. Ligation is an essential step to generate random paths, so efficient ligation is needed to produce DNA strands long enough to solve large problems. 4.2
PCR with In and Out Vertex and Affinity Purification
After the hybridization and ligation, double-stranded DNAs with sticky ends were generated. We cannot use the primer pair because the start and the end point are identical in TSP and the primer pair is exactly complementary to each other. So we executed PCRs with only one primer. First, we executed PCR with a primer that is complementary with the end vertex (vertex 0). Blunt-ended double-stranded DNAs that end with the vertex 0 will be generated by this PCR. Subsequently, we executed the second PCR with vertex 0, and we could amplify the DNAs that start with vertex 0. We sieved the PCR product by 2% agarose gel electrophoresis (Fig. 3 (C), (D)). The second PCR product appeared in several bands in the gel. We excised and eluted the band around 300 bp and amplified with 5’-biotinylated vertex 0 as a primer. The amplified product was used in the following affinity separation with streptavidin paramagnetic particles. 4.3
Denaturation Temperature Gradient PCR
The DNA strands that passed the implementation procedures up to step 6 have the same length and contains same oligomer segments. So, they have similar characteristics and cannot be easily separated. However, we designed the weight sequence to have different GC content, so the Tm of the correct solution is the lowest among the candidate solutions. Therefore, if we decrease the denaturation temperature to a certain level, mainly DNA strands of correct solutions will be denatured at that temperature, and be amplified. As the denaturation temperature increases, other DNA strands also will be amplified. But the amount of correct solutions will be exponentially increased cycle by cycle, and occupy the major part of the solution. By simple modification of the typical PCR, we can amplify the correct solution and detect it easily. We can show the effectiveness of DTG-PCR by the relative amplification in Fig. 4 (A). Shorter DNA strands in the lane 2 are more amplified by DTG-PCR when compared with the normal PCR product in the lane 1 (See the boxed area in Fig. 4). After the DTG-PCR, we obtained the DNA strands as shown in amplification in Fig. 4 (B). This band might contains four different DNA strands of the possible Hamiltonian paths, ‘0 → 1 → 2 → 3 → 4 → 5 → 6 → 0 (the sum of weights: 21)’, ‘0 → 1 → 6 → 5 → 4 → 3 → 2 → 0 (31)’, ‘0 → 2 → 1 → 3 → 4 → 5 → 6 → 0 (27)’, ‘0 → 2 → 3 → 4 → 5 → 6 → 1 → 0 (31)’. Those strands have the identical length, and they cannot be separated by normal gel electrophoresis. However, we can separate these strands by the temperature gradient gel electrophoresis (TGGE), because they have distinct
82
Ji Youn Lee et al.
(A)
M
1
2
(B)
M
1
(C)
Main band 300bp (8vertex)
Fig. 4. Gel electrophoresis on a 2% agarose gel. The lanes contain: lane M denotes DNA size marker (50 bp ladder), (A) lane 1: normal PCR result, lane 2: DTG-PCR result, (B) lane 1: the final DTG-PCR result, (C) TGGE separation of solutions melting behaviors. Similar work has studied using denaturing gradient gel electrophoresis (DGGE) [3]. 4.4
Temperature Gradient Gel Electrophoresis and Sequencing
TGGE is analogous to DGGE and it is based on the correlation of the melting characteristic of a DNA strand. TGGE is an extremely sensitive method and even fragments differing in only one nucleotide in sequence can be separated by TGGE. Usually this property was used to detect point mutations. But we utilized this electrophoresis method to separate the correct solution from other possible Hamiltonian paths. The GC content of the strands varies from 40.67% to 44.00%, and the melting temperature of the DNA strands are respectively 84.80oC, 86.51oC, 85.68oC, 86.62oC by NN model [5] with 1M salt concentration and 10nM oligomer concentration, and 92.69oC, 94.05oC, 93.51oC, 94.05oC by GC content method. The PCR mixture containing those possible Hamiltonian paths was separated by TGGE, and one main band and other sub bands were observed in Fig 4 (C). The DNA strands in main band were cloned and sequenced, and it showed that the path 0 → 1 → 2 → 3 → 4 → 5 → 6 → 0 has the lowest cost. The sequencing result confirmed the whole experimental procedures. 4.5
Scalability
The solvable problem size is restricted to the capabilities of the current biochemical tools. In case of solving TSP, PCR is the critical step in the procedure. We can amplify DNA strand of up to 40,000 bases with current PCR technology. Though considering this limitation, we can scale up to 1,000 cities problems roughly, if we apply this temperature gradient encoding method. And The another important point of scalability is the ability of separation and detection. We
Temperature Gradient-Based DNA Computing for Graph Problems
83
can separate DNA strands whose GC content differs by 0.49 % with the current resolution of TGGE and this difference is easily achievable with our encoding method. However, there exist some limitations in scaling up to 1,000 city problems. The first and critical problem is that it is impossible to discriminate the solutions which have the identical melting temperatures. And it is not also discriminative when there exist two solutions that melting temperature differences are not exceeding 0.2o C. The second problem is the presence of elaborate and timeconsuming implementation steps. In the experimental view, 1,000 times affinity separation is almost impossible. This is the most time-consuming step in our implementation steps. But, if we introduce the affinity separation method proposed by [2], the affinity separation steps can be automated with high efficiency and can became easier. Other possible obstacle in our encoding method arises when the DNA strands with stable mismatches have lower melting temperature and are amplified exclusively. So the sophisticated sequence design to avoid the stable mismatches is needed.
5
Conclusions
We introduced a temperature gradient method to solve the graph problems with numerical data. This method can overcome the restrictions of other encoding methods and be easily implemented by the simple modification of the existing experimental techniques. We can more strongly amplify the correct solution relatively during the reaction and the solution can be easily detected. This method drives the DNA pool to contain more correct solutions, rather than to search randomly for the correct solution in the DNA pool. We showed the feasibility of our computing method by solving the travelling salesman problem with adequate biochemical tools. The combination of the orthogonal design of DNA sequences and denaturation temperature gradient PCR provides a novel method to solve general graph problems with weighted edges. This is applicable to any Tm-involved implementation steps to amplify low melting temperature DNA strands.
Acknowledgments This research was supported in part by the Ministry of Education & Human Resources Development under the BK21-IT Program and the Ministry of Commerce, Industry and Energy through the Molecular Evolutionary Computing (MEC) Project. The RIACT at Seoul National University provides research facilities for this study.
References [1] L. M. Adleman. Molecular computation of solutions to combinatorial problems. Science, 266:1021–1024, 1994.
84
Ji Youn Lee et al.
[2] R. S. Braich, N. Chelyapov, C. Johnson, P. W. K. Rothemund, and L. Adleman. Solution of a 20-varaible 3-SAT problem on a DNA computer. Science, 296:499– 502, 2002. [3] J. Chen, E. Antipov, B. Lemieux, W. Cede˜ no, and D. H. Wood. In vitro selection for a MAX 1s DNA genetic algorithm. In Proceedings 5th International Workshop on DNA-Based Computers, pages 23–46, 2000. [4] M. R. Garey and D. S. Johnson. Computers and Intractability: A Guide to the Theory of NP-completeness. W. H. Freeman and company, 1979. [5] J. SantaLucia Jr. A unified view of polymer, dumbbell, and oligonucleotide DNA nearest-neighbor thermodynamics. Proc. Natl. Acad. Sci. USA, 95:1460–1465, 1998. [6] D. Kim, S.-Y. Shin, I.-H. Lee, and B.-T. Zhang. NACST/Seq: A sequence design system with multiobjective optimization. In Preliminary Proceedings of 8th International Meeting on DNA Based Computer, pages 241–251, 2002. [7] Q. Liu, L. Wang, A. G. Frutos, A. E. Condon, R. M. Corn, and L. M. Smith. DNA compouting on surface. Nature, 403:175–179, 2000. [8] A. Narayanan and S. Zorbalas. DNA algorithms for computing shortest paths. In Proceedings of Genetic Programming 1998, pages 718–723, 1998. [9] Q. Ouyang, P. D. Kaplan, S. Liu, and A. Libchaber. DNA solution of the maximal clique problem. Science, 278:446–449, 1997. [10] R. Owczarzy, P. M. Vallone, F. J. Gallo, T. M. Paner, M. J. Lane, and A. S. Benight. Predicting sequence-dependent melting stability of short duplex DNA oligomers. Bioploymers, 44:217–239, 1998. [11] G. G. Owenson, M. Amos, D. A. Hodgson, and A. Gibbsons. DNA-based logic. Soft Computing, 5(2):102–105, 2001. [12] J. H. Reif, T. H. LaBean, M. Pirrug, V. S. Rana, B. Guo, C. Kingsford, and G. S. Wickham. Experimental construction of a very large scale DNA database with associatice search capability. In The 7th International Workshop on DNA-Based Computers, pages 241–250. [13] S.-Y. Shin, D. Kim, I.-H. lee, and B.-T. Zhang. Multiobjective evolutionary algorithms to design error-preventing DNA sequences. Technical Report BI-02-003, Seoul National University, School of Computer Science and Engineering, Seoul National University, Seoul, Korea, March 2002. [14] S.-Y. Shin, D.-M. Kim, I.-H. Lee, and B.-T. Zhang. Evolutionary sequence generation for reliable DNA computing. In Proceedings of Congress on Evolutionary Computation 2002, pages 79–84, 2002. [15] S.-Y. Shin, B.-T. Zhang, and S.-S. Jun. Solving traveling salesman problems using molecular programming. In Proceedings of Congerss on Evolutionary Computation 1999, pages 994–1000, 1999. [16] J. G. Wetmur. DNA probes: applications of the principles of nucleic acid hybridization. Crit. Rev. Biochem. Mol. Biol., 26:227–259, 1991. [17] E. Winfree, F. Lin, L. A. Wenzler, and N. C. Seeman. Design and self-assembly of two-dimensional DNA crystals. Nature, 394(6693):539–545, 1998. [18] M. Yamamura, Y. Hiroto, and T. Matoba. Solutions of shortest path problems by concentration control. In Proceedings of 7th International Workshop on DNABased Computers, pages 231–240, 2001.
Shortening the Computational Time of the Fluorescent DNA Computing Yoichi Takenaka1 and Akihiro Hashimoto2 1
2
Graduate School of Information Science and Technology, Osaka University, Machikaneyama 1-3, Toyonaka, Osaka 560-8531, Japan, [email protected] Faculty of Informatics, Osaka Gakuin University, Kishibe-Minami 2-36-1, Suita, Osaka 564-8511, Japan, [email protected]
Abstract. We present a method to shorten the computational time of the fluorescent DNA computing. Fluorescent DNA computing is proposed to solve intractable computation problems such as SAT problems. They use two groups of fluorescent DNA strands. One group of fluorescent DNA represents that a constraint of the given problem is satisfied, and another group represents that a constraint is unsatisfied. The calculation is executed by hybridizing them competitively to DNA beads or spots on DNA microarray. Though the biological operation used in the fluorescent DNA computing is simple, it needs the same number of beads or spots on microarray as the number of candidate solutions. In this paper, we prove that one bead or spot can represent plural candidate solutions through SAT problem, and show the algorithm and an experimental result of the fluorescent DNA computing.
1
Introduction
Since Adleman demonstrated the possibility of solving NP-complete problems by using DNA, biomolecular computation has become a new vista of computation that bridges computer science and biochemistry [1]. DNA provides a massive computational parallelism that allows us to tackle intractable combinatorial problems exhaustively. In the area of formal language theory, a great number of theoretical studies [3,12,13] were inspired by this experimental possibility. Recently, there is a growing interest in using SAT as a practical tool for solving real-world problems. In fact, some problems are reported to be solved more efficiently by a SAT-solver than by the specialized algorithm[2,7]. Many researchers on DNA computing also report their studies through SAT. In 1998 and 2000, Smith and Liu proposed a surface-based approach to DNA computation [8,16]. In 2000, Sakamoto et al. proposed a fluorescent DNA computing that uses DNA hairpin formation where the computational paradigm differs from the Adleman-Lipton paradigm [14]. In 2001, Takenaka et al. proposed a fluorescent DNA computing that uses DNA beads, fluorescent DNA and mix & divide method[11][17]. M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 85–94, 2003. c Springer-Verlag Berlin Heidelberg 2003
86
Yoichi Takenaka and Akihiro Hashimoto
In this paper, we present an algorithm that improves the computational time of fluorescent DNA computing through SAT problem. The fluorescent DNA computing uses fluorescent DNA strands and DNA microarray for its calculation. DNA microarray is used to measure the expression of thousands of genes simultaneously[9,15]. There are many spots on the microarray and each spot holds multiple copies of one DNA strand. DNA strands can be labeled by fluorescers such as Cy3 and Cy5. When we hybridize two types of labeled DNA strands on microarray, we can measure the proportion of the number of Cy3labeled DNA strands and Cy5-labeled strands by intensity of the fluorescence. In the fluorescent DNA computing, each candidate solution for a given problem one-to-one corresponds to a DNA strand that is spotted on the microarray. Make Cy3-labeled DNA strands if the candidate solution satisfies a constraint of the problem. Then, make Cy5-labeled one if the candidate solution doesn’t satisfy one of the constraints. After competitive hybridization of these strands on the microarray, the spots only with Cy3 fluorescence hold the strands that correspond to the true solution. As the biological operation used in the fluorescent DNA computing is simple, it holds the potential to solve large-scale problems. In fact, Takenaka et al. shows the way to solve 24-variable SAT problem with DNA beads, which is one of the derivative technologies of DNA microarray and a DNA bead corresponds to a spot in microarray[17]. However, it has a shortcoming; it takes exponential time to read out the solution because one spot represents only one candidate solution in the computing. In this paper, we present an algorithm to avoid this shortcoming by letting one spot represents plural candidate solutions.
2
Definitions
This section introduces the notation used in the paper. Variables are denoted x1 , · · · , xn , and can be assigned truth-values 0 (False) or 1 (True). A literal l is either a variable x or its negation x. A CNF formula ϕ is a conjunction of clauses ω1 , · · · , ωm , where ωi is a disjunction of literals. A clause is said to be satisfied if at least one of its literals assumes value 1, unsatisfied if all of its literals assume value 0. A formula is said to be satisfied if all its clauses are satisfied, and be unsatisfied if at least one clause is unsatisfied. The SAT problem is to decide whether there exists a truth assignment to the variables such that the formula becomes satisfied. There are 2n assignments on the n variables and the assignments are denoted y1 , · · · , y2n . We define a function fϕ (y) that returns the number of clauses in CNF formula ϕ that the assignment y doesn’t satisfy. In the followings, we use a CNF formula (1) as a SAT instance for explanation. It contains 5 variables and 11 clauses. ϕ=
(x2 ∨ x4 ∨ x5 ) ∧ (x2 ∨ x3 ∨ x4 ) ∧ (x1 ∨ x2 ∨ x5 ) ∧ (x1 ∨ x2 ∨ x3 ) ∧ (x1 ∨ x3 ∨ x5 ) ∧ (x3 ∨ x4 ∨ x5 ) ∧ (x2 ∨ x3 ∨ x4 ) ∧ (x1 ∨ x2 ∨ x5 ) (1) ∧ (x1 ∨ x2 ∨ x4 ) ∧ (x1 ∨ x4 ∨ x5 ) ∧ (x3 ∨ x4 ∨ x5 )
Shortening the Computational Time of the Fluorescent DNA Computing
87
Table 1. Assignments and its number of unsatisfied clauses x5 = 0 00 x1 x2 01 11 10
00 1 2 1 1
x3 x4 01 11 1 1 1 3 1 2 1 1
x5 = 1 10 1 2 0 1
00 01 11 10
00 2 2 2 1
x3 x4 01 11 3 2 1 2 1 2 1 1
10 1 1 1 1
Table 1 shows the value of fϕ (y) for each assignment. The CNF formula (1) is satisfiable and a true assignment is (x1 x2 x3 x4 x5 ) = (11100).
3
Fluorescent DNA Computing
DNA strands can be labeled by fluorescers such as Cy3, Cy5, and R110. Assume there are many copies of a DNA strand and they are divided into two groups, and DNA strands in each group are labeled by a different fluorescer. We can measure the proportion of the number of DNA strands between two groups by this labeling technique and “competitive hybridization”. In the followings, we show the steps to measure the proportion. 1. Label the strands of each group by a different fluorescer respectively. 2. Spot the complementary strands on the surface of glycidal methacrylate plate. 3. Hybridize the strands of two groups to the spot competitively. 4. Wash out the strands that don’t hybridize to the spot. 5. Measure the intensity of two fluorescences. The proportion of the intensity is equivalent to the proportion of the number of DNA strands between two groups. We call this measurement “competitive hybridization”. The competitive hybridization is used in the microarray technology that can provide scientists with genome-scale insight into the state of a cell under different conditions. There are many spots on the microarray and each spot holds multiple copies of one DNA strand or one cDNA of a gene. A single microarray experiment measures the relative level of expression of every gene in the organism at the same time[4]. The fluorescent DNA computing uses competitive hybridization and microarray to calculate the solution. Each spot of microarray represents a candidate solution for a given problem. Consider candidates to be the DNA strands that encode candidate solutions. Also, consider co-candidates to be the complementary strands of candidates. The DNA computing by competitive hybridization requires the following five steps.
88
Yoichi Takenaka and Akihiro Hashimoto
00111 01111 11111 10111 00110 01110 11110 10110 00101 01101 11101 10101 00100 01100 11100 10100 00011 01011 11011 10011 00010 01010 11010 10010 00001 01001 11001 10001 00000 01000 11000 10000 2nd step: Labeled by Cy5
1st clause
3rd clause
00100 10100
01010 01110
00000 10000
01000 01100
2nd clause 01001 11001
4th clause 5th clause
01000 10000
11th clause
3rd step: Labeled by Cy3
Fig. 1. Complement strands made in the second and third step
1. Make a microarray each of whose spot holds multiple copies of a candidate. 2. Synthesize all the co-candidates that are labeled with a fluorescer. 3. For each constraint of the problem, synthesize co-candidates that don’t satisfy the constraint and label them with another fluorescer. 4. Hybridize competitively two groups of the co-candidates to the microarray. 5. Measure the intensity of the two fluorescent lights of each spot. We describe these five steps through the formula (1). As this instance has five variables, there are a total of 25 or 32 candidate solutions. In the first step, synthesize all the candidates and attach them to the spot respectively. In the second step, synthesize the co-candidates, and label them with a fluorescer. With loss of generality, use Cy5 as the fluorescer. Left side of Fig. 1 shows the complementary strands to be synthesized. In the figure, each square represents co-candidate and the number in the square means the assignment of (x1 x2 x3 x4 x5 ). Constraints of the SAT are clauses to be satisfied. In the third step, for each clause, synthesize complementary strands of candidates that don’t satisfy the clause. For the first clause (x2 ∨ x4 ∨ x5 ), we synthesize complementary strands of (x1 x2 x3 x4 x5 ) = (00000), (00100), (10000), (10100). Right side of Fig. 1 shows the complementary strands made in this step. Throughout the step, the co-candidate of the assignment yi is synthesized fϕ (yi ) times. For example, the strand of (x1 x2 x3 x4 x5 ) = (01000) are synthesized in second and third clauses. With loss of generality, we use Cy3 as the fluorescer. In the fourth step, competitively hybridize co-candidates synthesized in the second and third steps to candidates on the microarray. After competitive hybridization, the spots with the true assignment hold only Cy5 labeled strands, and the spots with the false assignment hold both Cy5 labeled strands and Cy3 labeled strands. As the assignment (x1 x2 x3 x4 x5 ) = (11100) holds the proportion of Cy5/Cy3=1/0, it is a true assignment and the formula (1) is satisfiable. Now, we count the computational time of the fluorescent DNA computing. As the computing uses O(2n ) spots on the DNA microarray in the first step,
Shortening the Computational Time of the Fluorescent DNA Computing
89
Fig. 2. DNA strands are synthesized by eight rounds of combinatorial synthesis, where in each word, w1-w8, is added in a separate column of a DNA synthesizer.
it seems to need O(2n ) time. In fact, it takes O(n) time with DNA beads and mix & divide combinatorial synthesis [17]. A DNA bead is approximately a 5µm diameter glycidal methacrylate bead that carries multiple copies of a DNA sequence. In [10], DNA strands are composed of eight words (W1 ∼ W8 ) and are synthesized by eight rounds of the mix & divide method. Figure 2 shows schema of the method. The second step takes O(n) time and the third step takes O(nm) time if you encode according to the mix & divide method used in the first step. The fourth step needs a constant time. In the fifth step, as measurement of a fluorescent light takes a constant time per spot and there are 2n spots, it takes O(2n ) time. The total time of the computational time is dominated by the fifth step. Therefore, it takes O(2n ) time.
4
Idea and Mathematical Background
The bottleneck of the fluorescent DNA computing is the number of spots on microarray. As a spot (or a bead) represents one candidate solution, the time required to measure all the fluorescent light becomes O(2n ). Assume that if one spot can represent plural candidate solutions, the computation time will be shortened. This is the idea to shorten the computational time of fluorescent DNA computing. To realize the idea, we bias the quantity of synthesized DNA strands (cocandidates) between the second and third steps of the fluorescent DNA comput-
90
Yoichi Takenaka and Akihiro Hashimoto
Table 2. Proportions of the two fluorescer Cy5/Cy3 x5 = 0 00 x1 x2 01 11 10
00 1/α 1/2α 1/α 1/α
x3 x4 01 11 1/α 1/α 1/α 1/3α 1/α 1/2α 1/α 1/α
x5 = 1 10 1/α 1/2α 1/0 1/α
00 1/2α 1/2α 1/2α 1/α
00 01 11 10
x3 x4 01 11 1/3α 1/2α 1/α 1/2α 1/α 1/2α 1/α 1/α
10 1/α 1/α 1/α 1/α
ing in section 3. Let the quantity of synthesized DNA per one assignment for each clause in the third step be α times more than that in the second step. The proportion of two fluorescers Cy5/Cy3 becomes 1/αfϕ(y) for an assignment y. Table 2 shows the proportions 1/fϕ(y) for formula (1). Let β be the number of candidate solutions that are represented by one spot, and the spot holds same amount of DNA strand (candidate). Then, we define the value γ as the proportion of two fluorescers Cy5/Cy3, which is shown in equation (2). β 1 i=1 1+αf (yi ) αf (yi ) i=1 1+αf (yi )
γ = β
(2)
As f (yi ) becomes larger, the numerator becomes smaller and the denominator becomes larger. Therefore, γ monotonically decreases as f (yi ) increases. Equation (3) shows the value γ of the formula (1) with β = 32. γ=
1+ 0+
20 α+1 20α α+1
+ +
9 2α+1 18α 2α+1
+ +
2 3α+1 6α 3α+1
.
(3)
Using this γ, we prove the existence of threshold T that holds following condition. The formula is
satisfied by an assignment in the spot if γ > T (4) unsatisfied by any assignments in the spot otherwise
Consider the value γ of the spot in two cases: Case1 γupper : minimum value of γ when the formula is satisfied by an assignment in the spot. Case2 γlower : maximum value of γ when the formula is unsatisfied by any assignments in the spot. The threshold T exists if γupper ≥ γlower . Case1: The formula is satisfied by an assignment in the spot. With loss of generality, let y1 be the assignment which satisfies the formula, i.e. f (y1 ) = 0. The lower bound of γupper is calculated as following equations.
Shortening the Computational Time of the Fluorescent DNA Computing
β 1 αf (yi ) 0+ γ = 1+ 1 + αf (yi ) 1 + αf (yi ) i=2 i=2 β β 1 α·m 0+ ≥ 1+ 1+α·m 1+α·m i=2 i=2
β
(where m is the number of clauses) 1 α·m = 1 + (β − 1) (β − 1) 1+α·m 1+α·m 1 α·m (β − 1) > lim 1 + (β − 1) m→∞ 1+α·m 1+α·m 1 = β−1 1 =⇒ γupper > β−1
91
(5)
(6)
(7) (8) (9) (10)
Case2: The formula is not satisfied by any assignments in the spot. From the condition of Case2, each assignment unsatisfies at least one clause. Therefore, f (yi ) ≥ 1 for every i. As the value of γ monotonically increases as f (yi ) decreases, γ holds the largest value when f (yi ) = 1 for every i. Therefore, β β α·1 1 (11) γlower = 1+α·1 1+α·1 i=1 i=1 β β·α 1 = (12) = 1+α 1+α α The threshold T exists if the equation γupper > γlower holds. From the two 1 cases, if β−1 is larger than α1 , the equation holds. As α and β are plus constants, T exists if α > β − 1 and T holds the equation γupper ≥ T > γlower . QED
5
Algorithm
Using the idea described in Section 4, we show the fluorescent DNA computing for a SAT. Let n be the number of variables in the formula, m be the number of clauses, n δ be the number of spots on a microarray, β be 2δ and α be a constant that is larger than β −1. Consider candidates as the DNA strands that encode candidate solutions, and co-candidates as the complementary strands of candidates. The algorithm of the fluorescent DNA computing with our idea is followings. 1. Make disjointed δ groups of β candidates. Then, attach each group of candidates to a spot on a microarray.
92
Yoichi Takenaka and Akihiro Hashimoto
2. Synthesize all the co-candidates that are labeled with a fluorescer. 3. For each clause ω, synthesize co-candidates that don’t satisfy the constraint. Then, adjust the amount of DNA strands as 2αp times as DNA strands synthesized in step 2, where p is the number of literals in ω. Label them with another fluorophore. 4. Hybridize competitively two groups of co-candidates to the microarray. 5. Measure the intensity of two fluorescences for each spot. 6. If the proportion of the two fluorescences for a spot γ is larger than the threshold T , the formula is satisfiable. Else, the formula is unsatisfiable. We use threshold T as average of γupper and γlower , where γupper and γlower are calculated by equation (7) and (12) respectively. The algorithm can only determine the formula is satisfiable or not. When we need to find the assignment that satisfies the formula, we use binary search after the above algorithm. Suppose the algorithm determine a spot with β candidates holds an assignment that satisfies the formula. We divide the β candidates into two groups and re-call the above algorithm. You can reduce the number of candidate solution to β/2, and repeat it until the number of candidate solutions becomes one. In the followings, we show how the algorithm solves SAT through the formula (1). Let the parameters be α = 4, β = 4 and δ = 8. Firstly, we encode 32 candidate solutions to 40-mer DNA sequence. The first half of 20-mer encodes three variables x5 ∼ x3 , and the second half of 20-mer encodes two variables x2 ∼ x1 . We use “DNASequenceGenerator” to determine eight 20-mer sequences [5]. Table 3 shows the encoding scheme. For example, the assignment (x5 x4 x3 x2 x1 ) = (00000) is encoded by AAAGCTCGTCGTTTAAGGAATAGGTGCGTGCATAACTGGG. In the first step, we make a microarray each of whose spot holds four kinds of candidate solutions. Fig. 3 shows the spots and the candidate solutions attached on them. The four assignments in a spot have same values of (x5 x4 x3 ). We use Cy5 and Cy3 as the fluorescer in second and third step. Amount of the DNA strands per a clause generated in third step is α/23 = 4/8 = 1/2 times as much as amount of the DNA strand generated in second step. Before hybridization we adjust density of the DNA strand to 100µM. After hybridization in the fourth step, the ideal values and experimental values of γ of each spot are described in Table 4. As γupper = 4/11 and γlower = 1/4, the threshold T is 27/88 ≈ 0.307. Because an experimental value γ of spot B is 0.335 and it is larger than T , we can determine that the spot B holds an assignment that satisfies the formula. The algorithm takes O(nm + δ) time to determine if the formula is satisfiable or not, and takes O(nm log n + δ) to find an assignment to be satisfied. As δ is 2n /β, the computation time is O(2n ) when β = 1. And when β = O(2n ), the computation time becomes O(nm log n). Therefore, we have to enlarge the value β to reduce the computation time.
Shortening the Computational Time of the Fluorescent DNA Computing
93
Fig. 3. Four candidate solutions are attached on each spot. Table 3. Variables and corresponding DNA sequence (x5 x4 x3) (000) (001) (010) (011) (100) (101) (110) (111)
6
Sequence AAAGCTCGTCGTTTAAGGAA GAAGCCTACTGTACTCTGCG TATCGTGATTTGGAGGTGGA CAGCCACGTAGTAGAGCTAG TACCCAATCGAACTGATAAG TCGGTCAACGGAGGGGGCTC GCGTTTTTGCGAGGCATGTG GCCTAAAGAATTGATCGCTT
(x2 x1) (00) (01) (10) (11)
Sequence TAGGTGCGTGCATAACTGGG CTAAGTGCGGCTGCATGACC TGGGGTTTTATCTTACGACC TGAGATTTTTAACGCCGTTA
Conclusion
We present a method to shorten the computation time of the fluorescent DNA computing for satisfiability problems. The method allows one bead or one spot can represent plural candidate solutions. Then we show an experimental result of the algorithm. As the computation time of the fluorescent DNA computing depends on the number of beads or spots, the method can dramatically reduce computation time of the fluorescent DNA computing.
References 1. Adleman, L.: Molecular computation of solutions to combinatorial problems. Science 266(11), (1994) 1021–1024. 2. Bejar, R., Manya, M.: Solving the round robin problem using propositional logic, In Proc. of 17th National Conference on Artificial Intelligence (AAAI’2000), AAAI press/MIT press (2000), 262–266.
94
Yoichi Takenaka and Akihiro Hashimoto
Table 4. The ideal values and experimental values γ of each spot. Spot A B C D
ideal γ 0.216 0.607 0.250 0.172
experimental γ 0.282 0.335 0.255 0.235
Spot E F G H
ideal γ 0.154 0.250 0.204 0.154
experimental γ 0.124 0.213 0.253 0.234
3. Calude, C.S., P˘ aun, G.: Computing with cells and atoms. Taylor & Francis Publisher, London, (2000). 4. DeRisi, J.L., Iyer, V.R., Brown, P.O.: Exploring the metabolic and genetic control of gene expression on a genomic scale. Science 278, (1997), 680-686. 5. Feldkamp, U., Saghafi, S., Banzhaf, W., Rauhe, H.: DNASequenceGenerator: a program for the construction of DNA sequences. DNA7, 7th International Meeting on DNA Based Computers, Preliminary Proceedings, (2001), 179–188. 6. Garey, R., Johnson, S.: Computers and Intractability, a guide to the theory of NPcompleteness. Freeman and Company (1991). 7. Kautz, H., Selman, B.: Pushing the envelope: planning, propositional logic, and stochastic search, Proc. of 13th National Conference on Artificial Intelligence (AAAI’96), AAAI press/MIT press 2, (1996) 1194–1201. 8. Liu, Q. et al.: DNA computing on surfaces. Nature 403, (2000) 175–179. 9. Lockhart, D., et al.: Expression monitoring by hybridization to high–density oligonucleotide arrays. Nature Biotechnol., 14, (1996) 1675–1680. 10. Brenner, S., et al.: In vitro cloning of complex mixtures of DNA on microbeads: physical separation of differentially expressed cDNAs. PNAS 97, (2000) 1665–1670. 11. Brenner, S., et al.: Gene expression analysis by massively parallel signature sequencing (MPSS) on microbead arrays. Nature Biotechnology 18, (2000) 630–634 12. Paun, G., Rozenberg, G., Salomaa, A.: DNA computing: new computing paradigms. Springer Verlag, (1998). 13. Rozenberg, G., Salomaa, A.: Handbook of formal languages. Springer Verlag, 1–3, (1997). 14. Sakamoto, K., Gouzu, H., Komiya, K., Kiga, D., Yokoyama, S., Yokomori, T., Hagiya, M.: Molecular computation by DNA hairpin formation. Science 288, (2000) 1223–1226. 15. Schena, M., Shalton, D., Davis, R.W., Brown, B.O.: Quantative monitoring of gene expression patterns with a complementary DNA microarray. Science 270, (1995) 467–470. 16. Smith L. M. et al.: A surface-based approach to DNA computation. J. Computational Biology 5, (1998) 255–267. 17. Takenaka, Y., Hashimoto, A.: A proposal of DNA computing on beads with application to SAT problems. DNA7, 7th International Meeting on DNA Based Computers, Preliminary Proceedings, (2001), 331–339.
How Efficiently Can Room at the Bottom Be Traded Away for Speed at the Top? Extended Abstract Pilar de la Torre Department of Computer Science, University of New Hampshire, Durham, New Hampshire 03824, USA [email protected]
Abstract. Given exponential 2n space, we know that an AdlemanLipton [1,9] computation can decide many hard problems – such as boolean formula and boolean circuit evaluation – in a number of steps that is linear in the problem size n. We wish to better understand how to design biomolecular algorithms that trade away “weakly exponential” 2n/c , c > 1, space to achieve low running times and analyze the efficiency of their space-time utilization relative to that of their best extant classical/biomolecular counterparts. We present deterministic and probabilistic parallel algorithms for the Covering Code Creation and k-SAT problems which are based on the biomolecular setting as abstracted by a randomized framework that augments that of the sticker model of Roweis et al. [13]. We illustrate the power of the randomized framework by analyzing the space-time efficiency of these biomolecular algorithms relative to the best extant classical deterministic/probabilistic algorithms [6,14] which inspired ours. This work points to the proposed randomized sticker model as a logical tool of independent interest.
We consider hard computational problems for which the time required by the n best extant classical algorithm is “weakly exponential”, that is 2 c , where c > 1. We wish to better understand how to design biomolecular algorithms that trade away weakly exponential space to achieve as low of a running time as possible, and to analyze the efficiency of their space-time utilization relative to that of their best extant classical/biomolecular counterparts. A bit more formally, let a and b denote classical/biomolecular algorithms with space-time product requirements sta (n) = sa (n) × ta (n) and stb (n) = sb (n) × tb (n) respectively, We propose to compare their relative efficiency by comparing their respective space-time product requirements. We will say that algorithm a is space-time (product) efficient relative to algorithm b up to at most an f (n) factor if sta (n) = O(stb (n)f (n)). We will say that algorithm a is at least an f (n) factor more space-time (product) efficient than algorithm b, if sta (n)f (n) = O(stb (n)). Given a problem for which the best currently known classical time-bound is at most weakly exponential, we strive M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 95–111, 2003. c Springer-Verlag Berlin Heidelberg 2003
96
Pilar de la Torre
to come up with biomolecular/classical algorithms solutions that: (1) are as fast as possible, (2) are space-time product efficient relative to the best extant classical/biomolecular algorithm up to at most a factor f (n) that is bounded by a polynomial in n, and (3) f (n) is as slow growing a function of n as possible. We propose a natural framework for probabilistic computation which consists of the sticker model of Roweis et al. [13]. augmented by two probabilistic primitives: rand-initialize, and rand-partition. The intent is for these primitives to abstract the randomness enjoyed by biomolecules and offer logical access and control of randomness to the algorithm designer. Based on ideas which this writer perceives are part of the DNA computing community folklore, we present thought experiments that describe possible physical implementations for these primitives in the spirit of the sticker model. We illustrate the power of this randomized sticker setting by presenting deterministic and probabilistic parallel algorithms for the Covering Code Creation and k-SAT that exploit parallelism not only at the string (biomolecule) level, but also at the set-of-strings (tube) level and at the bits-within-string level. Notable among our contributions are the following: We develop biomolecular implementations of the previously best classical determinitic and probabilistic algorithms for the two computational problems [6,14] and analyze their relative space-time efficiency. While attempting attempting to do that, we discovered a classical algorithm for Covering Code Creation that is, by an exponential factor, space-time more efficient than the previously best algorithm [6]. We present a randomized biomolecular algorithm that runs in constant time and is, by an n factor, more space-time efficient than the best previously known randomized classical Covering Code Creation [6] algorithm, and is an exponential factor more space-time efficient that the best currently known deterministic or biomoecular competitor. We analyze relative space-time efficiency among a collection of new and previously known classical/biomolecular algorithms. The results of the analysis are summarized in Figure 1. For the Covering Code Creation Problem they are summarized in TABLE I and those for the k-SAT problem in TABLE II. Our results show that, for each of the problems considered, the best known probabilistic sticker algorithm is, by an exponential factor, more space-time efficient than the best known deterministic sticker or classical competitor. This and prior related work, such as that in [2,13,3,7], point to biomolecular settings for probabilistic algorithm design as logical tools of independent interest that deserve and remain to be systematically investigated.
How Efficiently Can Room at the Bottom Be Traded Away
97
TABLE I: Covering Code Creation Problem sec
ref
3
DANTSIN et al. [6]
CLASSICAL DETERMINISTIC
2[1−h(ρ)]n
3
DANTSIN et al. [6]
CLASSICAL DETERMINISTIC
3.4
THIS PAPER
3.3 3.4 3 3.5
algorithm’s time
algorithm’s space×time
22
2[1−h(ρ)]n
2[1−h(ρ)]n 2 2
2[1−h(ρ)+δ]n
Θ(n)
2[1−h(ρ)+δ]n
2[1−h(ρ)+δ]n
STICKER DETERMINISTIC
2[1−h(ρ)+δ]n
2[1−h(ρ)+δ]n
Θ(n)
2[1−h(ρ)+δ]n
THIS PAPER ♠
CLASSICAL DETERMINISTIC
2[1−h(ρ)+o(1)]n
Θ(n)
THIS PAPER ♠
STICKER DETERMINISTIC
2[1−h(ρ)+o(1)]n 2[1−h(ρ)+o(1)]n
DANTSIN et al. [6] ♣
CLASSICAL RANDOMIZED
2[1−h(ρ)]n
STICKER RANDOMIZED rand-initialize
2[1−h(ρ)]n
THIS PAPER ♣
model
covering code covering code size space n
n
2[1−h(ρ)+o(1)]n 2[1−h(ρ)+o(1)]n Θ(n)
2[1−h(ρ)+o(1)]n
Θ(n)
2[1−h(ρ)]n
2[1−h(ρ)]n
2[1−h(ρ)]n
Θ(1)
2[1−h(ρ)]n
TABLE II: k-SAT Problem sec
ref
4
DANTSIN et al. [6]
CLASSICAL DETERMINISTIC
22
4
DANTSIN et al. [6]
CLASSICAL DETERMINISTIC
Θ(n)
4.1
THIS PAPER
STICKER DETERMINISTIC
4.1
THIS PAPER ♠
CLASSICAL DETERMINISTIC
4.1
THIS PAPER ♠
STICKER DETERMINISTIC
2 4.2
model
algorithm’s space
STICKER RANDOMIZED rand-initialize rand-partition
n
2−
2 k+1
2−
2−
2 k+1
n
+ o(1)
Θ(n)
2−
2−
+
2 n k
algorithm’s space×time
n 2 k+1
2 k+1
n
2−
n
2 k+1
+ o(1)
Θ(mn)
2−
2 n k
Θ(knm)
n 2 k+1
2−
2 k+1
+
2 k+1
+
2−
n
2−
+
Θ(mn)
Θ(n)
¨ SCHONING CLASSICAL [14] RANDOMIZED ♣ THIS PAPER ♣
algorithm’s time
n
22
n n
2−
2 k+1
+ o(1)
2−
2 k+1
+ o(1)
2−
2−
n n
2 n k
2 n k
Fig. 1. The results of our relative space-time efficiency analysis, among a collection new and previously known classical/biomolecular algorithms for the Covering Code Creation problem, are summarized in TABLE I and those for the k-SAT problem in TABLE II. Each row of a table corresponds to an algorithm, where the entry in column one indicates the section discussing the algorithm in the article cited in column two. For the table of a given problem, a row annotated with a ♣(randomized) or ♠(deterministic) symbol indicates that its corresponding algorithm has been identified as best of its type based on space-time relative efficiency. Each table entry corresponding to an exponential expression has been represented by a simplified expression that is within a polynomial factor in n of the actual entry.
98
Pilar de la Torre
Related Work The “room at the bottom” in our title is intended to evoke Feynman’s seminal article [8] referenced by Adleman in [1]. Our algorithmic ideas build on those of Sch¨ oning on probabilistic k-SAT [14], and of Dantsin et al. [6] on covering code creation and deterministic k-SAT. Our formulation of the augmented probabilistic sticker model setting and biomolecular algorithms were inspired, and enlightened, by the DNA based models of Lipton [9], Adleman [1]. Bach et al. [2], and Roweis et al. in [13], and the biomolecular algorithm realizations of Chen and Ramchandran [3] and Diaz et al. [7] for classical probabilistic k-SAT algorithms [12,11,14].
1
Augmented Model
We briefly review the basic concepts behind the standard sticker model and explain how we adapt it to describe our algorithms. Our proposed augmentation to the standard sticker model consists of adding two randomized operations, rand-initialize and rand-partition, whose definition and proposed physical realization will be explored below. These are aimed at providing the algorithm designer with access to, and control of, the native randomness enjoyed by DNA molecules. Each of them abstracts a modeling assumption that this writer, as a newcomer to the field, perceives as part of the folklore within the DNA computing literature. The significance of these operations is illustrated by the role they play in the biomolecular algorithmic solution to two computational problems: the Minimal Covering Code Creation Problem in Subsection 3.5 and the k-SAT Problem in Subsection 4.2. 1.1
Operations
As in the standard sticker model, the operations of the augmented model are partitioned into blind operations and boundary operations. Blind Operations. These are the standard combine, separate, set, and clear, to which we add the following rand-partition operation. Let S be a strings multiset and d is a divisor of |S|. • rand-partition(1 : d , S; A, B) creates two multisets A and B such that: (1) A ∪ B = S, and (2) for each string instance s in S, s belongs to A with probability 1/d. For d = 2, rand-partition will also be denoted rand-halving(S; A, B). Boundary Operations. These are the two standard operations read and initialize, to which we add the following rand-initialize operation. Let K, L, and N be integers satisfying L ≤ K and N ≤ 2L . • rand-initialize(K, L, N ; Rrand−init ) creates the (K, L, N ) randomized library multiset Mrand−init = SL,N {0K−L}, where SL,N consists of N strings, which have been drawn one at a time independently at random with replacement from {0, 1}L.
How Efficiently Can Room at the Bottom Be Traded Away
99
For future reference, let us recall that initialize(K, L; Minit ) creates the L (K, L) library set Minit = {0, 1} {0K−L}, for K and L satisfying K ≤ L [13]. It should be noted that the rand-initialize operation can be realized as a computation that requires one initialize, and O(L) set operations, and O(L) rand-partition operations. Our goal, however, is to obtain constant time physical realizations for initialize and rand-initialize. 1.2
Computation and Control
Computation. A computation in the augmented stickers setting begins with either an initialize(K, L; M ) operation or a rand-initialize(N, K, L; M ) operation, which is followed by a sequence of blind operations. Starting from the “initial set” M , this sequence of operations is to yield a designated “answer set”. We consider two possible ways of ending a computation, which depends on the overall purpose of the computation. If the purpose is to decide a language, as in the standard sticker model, then the computation ends by applying the read operation to the “answer set”. In our augmented setting, however, the purpose of a computation may also be to generate a multiset of strings, in which case the answer is the “answer set” itself. Control. The selection and execution of the sequence of blind operations is provided by a sequential or a parallel classical algorithm. Through the configuration of sets and modification of their bit strings, the algorithm can exploit parallelism at two levels: tube parallelism at the set-of-strings level, and molecule parallelism at the string level. In particular, our algorithms exploit tube parallelism via vector-parallel versions of the boundary operations, which will be denoted by combine, separate, set, clear, and rand-partition. They operate on µ-tuples of sets of strings A = A1 , . . . , Aµ .
2
Physical Realization
Possible constant time physical realizations of the standard sticker operations are offered in [13]. Our primary goal here is to come up with a constant time realization for each of the operations rand-partition and rand-initialize that is compatible with those for the standard sticker operations. As it turns out, operation rand-initialize yields a biomolecular algorithm for Covering Creation Problem presented in Section 3.5. This algorithm is trading efficient with respect to the best known classical algorithm for the problem. Specifically, it has as low a running time as possible, its space-time product is polynomially equivalent to that of the best known classical Covering Code Creation algorithm, and it uses a constant number of tubes. Due to space limitations, we outline one physical realization setting below and postpone discussion of alternative settings to the journal version.
100
2.1
Pilar de la Torre
Augmented Physical Setting
As in the original Sticker Model physical setting, information is represented in terms of memory strands and sticker strands. The augmented physical setting however, employs an additional type of strand that we term coin strand or simply coin. A memory strand consists of a sequence r0 r1 . . . rL rL+1 . . . rK of K + 1 regions, each of which is M bases long. The first region, r0 , is a universal region for which there is no sticker-strand available. Based on region r0 , and assisted by an appropriately designed enabling probe, the memory complexes within a given mixture can be separated from sticker strands and coin strands. Sticker strands are M base long strands r1 , . . . , rK where each ri is complementary to region ri . Coin strands are also M base long strands κ1 , κ2 , . . . , κK . Each κi is complementary to sticker-strand ri , and hence identical to region ri of each memory strand. Randomized Partition. A possible realization of rand-halving(S; A, B) can be based in volume-halving: divide the contents of S by pouring one half into A and the rest into B. Analogously, for d > 2, a corresponding volume division yields a realization for rand-partition(1 : d , S; A, B). Randomized Initialization. We now outline a thought experiment that points to how one would attempt to go about generating the library Mrand−init = SL,N {0K−L}, specified by operation rand-initialize(K, L, N ; Mrand−init) in a stickers and coins setting, which is meant to be understood in the context of the physical realization of the sticker model operations as presented in [13]. This experiment was inspired in part by Roweis et al. [13] in their original implementation of the library {0, 1}L{0K−L } which, remarkably enough taps into the native randomness of the biomolecular setting. Thought Experiment. The idea behind this logical experiment for generating a (K, L, N ) randomized library set can be viewed as being composed of two phases: strand synthesis and bit extraction. Strand Synthesis Phase: First, we create two tubes A and B. Tube A contains N strands, which are synthesized identical copies of the memory strand r0 r1 r2 . . . rL rL+1 . . . rK . Tube B comprises, for each i from 1 to L, N coin-strands κi resulting from synthesizing N identical copies for the region ri . Second, we set bits 1, . . . , L to 1(on) in all the memory-strands in A. This could be done by first adding excess sticker-strands r1 ,, . . . , rK , and then removing the excess sticker-strand copies by isolating into tube C the memory-complexes based on the universal region r0 . Bits Extraction Phase: As the initial step, we combine the contents of B and C into a tube R. Within R, the native randomness enjoyed by molecules is first going to be triggered and subsequently extracted as random bits. By raising the temperature of the mixture in R, we trigger the dissociation of all stickerstrands. At this point, for each sticker-strand in R there are two complementary
How Efficiently Can Room at the Bottom Be Traded Away
101
regions available in R: one as a coin-strand and the other as a sub-strand of a memory-strand. In this model, each of them is capable of competing for the sticker-strand attachment with identical probability of success. Next, by letting the solution cool back down we enable the competition. This causes each sticker to randomly choose to attach itself to either a memory-strand or a coin-strand. In this way, one random bit gets recorded on each of the bit regions 1, . . . , L of each memory-strands. Finally, by a separation based on the universal region r0 , the memory-complexes are isolated into the mother tube Mrand . This concludes the description of our thought experiment. We thus model each recorded bit as a random bit (which comes up heads with probability one-half and tails with probability one-half) independently across memory-strands and across bit positions 1, . . . , L within a memory-strand. Thus, at this point, the contents of Mrand−init encode the set SL,N {0K−L } that we have called the (K, L, N ) randomized library multiset.
3
The Covering Code Creation Problem
This section considers two computational problems about covering codes. It presents deterministic classical and sticker model based algorithms for the δ(n)Almost Minimal Covering Creation problem, and a probabilistic sticker model algorithm for the Minimal Covering Creation problem. 3.1
Background
A code of length n is a subset of the Hamming space Hn = {0, 1}n of all nbit strings called points or codewords. The Hamming distance between points x and y is the total number d(x, y) of bit positions in which x and y differ. The sphere or ball of center x, radius r, and normalized radius ρ = r/n is the subset y if y B(x, r) = {y : d(x, y) ≤ r} of Hn . We say that ball B(x, r) covers point r is V (n, r) = |B(x, r)| = belongs to B(x, r). The volume of B(x, r) in H n i=0 n i
. A set S covers x if x belongs to S. A family F of subsets of set X is a set cover of X if every element of X is covered by some set in F . A covering code, or simply a covering, of length n and radius α, is a length n code C such that F = {B(x, α) : x ∈ C} is a set cover of Hn . We say that C has covering radius r if r is the smallest α such that {B(x, α) : x ∈ C} is a set cover of Hn . Let K(n, r) denote the size of the smallest covering code with length n and radius r = ρn. If ρ satisfies 0 < ρ < 1/2, then to within a polynomial factor in n, V (n, r) and K(n, r) can be estimated in terms of 2h(ρ)n and β(n), where h(x) is the binary entropy function (h(0) = 1 and 1/2 h(x) = −x lg x − (1 − x) lg(1 − x) for 0 < x < 1) and β(n) = [nρ(1 − ρ)] . Lemma 1 ([4]). If n and r = ρn are integers satisfying 0 < ρ < 1/2, then 2[1−h(ρ)]n ≤ 2n /V (n, r) ≤ K(n, r) ≤ n2n /V (n, r) ≤ nβ(n)2[1−h(ρ)]n ≤ ν(n), where ν(n) = nβ(n)2[1−h(ρ)]n differs from K(n, ρn) by at most a polynomial factor.
102
Pilar de la Torre
These bounds on K(n, ρn) motivate the following definitions: Definition 1. (1) A covering code C of length n and normalized radius ρ is called minimal if 1 ≤ |C|/2[1−h(ρ)n] ≤ poly(n), that is its size differs from 2[1−h(ρ)]n by at most a polynomial factor. (2) Let δ(n) be a function such that 0 < δ(n) ≤ d < 1 for some constant d. A covering code C of length n and normalized radius ρ is called δ(n)-almostminimal if, 1 ≤ |C|/2[1−h(ρ)]n ≤ 2δ(n)n , that is its size differs from 2[1−h(ρ)]n by at most the exponential factor 2δ(n)n . (3) If δ(n) = δ is a positive constant, we say that C is almost minimal. In particular, if δ(n) = c lg n/n for some constant c > 0, then C is minimal. As observed in [6], the problem of creating a minimal covering for a given length n and radius ρn, can be viewed as being that of finding a subcollection of F = {B(x, ρn) | x ∈ Hn } with the minimum number of balls that covers X = Hn , which is an instance of the Minimum Set Cover problem. Definition 2. Problem. Minimum Set Cover Input: A set X and a family F of subsets of X that covers X. Output: A minimum size subfamily of F that covers X. finds a set The well known classical Greedy Set Cover(X, F ; U) algorithm cover whose size is within 1 + ln |X| of optimal in worst-case time O( S∈F |S|) (see, for example, [5]). Let Greedy Code(n, ρ; C, |C|) denote the classical algorithm that, given n and ρ, computes a covering code C of length n, radius ρn, and cardinality |C| as follows: first it invokes Greedy Set Cover(X, F ; U) with X = Hn , F = {B(x, ρn) : x ∈ Hn }, subsequently it assigns to C the collection of codewords that are centers of balls in U, and it concludes by determining the number |C| of elements in C. The covering C created by this algorithm is a minimal, because |C| is within a factor 1 + ln |Hn | = θ(n) of the minimum, and hence, by Lemma 1 differs from 2[1−h(ρ)]n by at most a polynomial time of this factor. The running algorithm is within a polynomial factor of θ V (n, r)2n = θ 22n poly(n)2h(ρ)n , which is superexponential when ρ satisfies 1 < ρ < 1/2. Lemma 2 ([6]). For each n ≥ 1 and 0 < ρ < 1/2, a minimal covering C of length n and radius ρn can be created by the deterministic classical algorithm Greedy Code(n, ρ; C) in Ω( 2[2+h(ρ)]n worst-case time. As we will discuss next, it is possible to achieve subexponential computing times if we allow the covering to be almost minimal. Systematic treatment of codes, coverings, and the Minimum Set Cover problem can be found, for example, in [4,10,5] and references therein.
How Efficiently Can Room at the Bottom Be Traded Away
3.2
103
Covering Creation Problems
We formulate the optimization covering creation problem as follows Definition 3. Problem. Minimal Covering Creation Input: Integers n and r = ρn, satisfying n ≥ 1 and 0 < ρ < 1/2. Output: A covering C, of length n and radius ρn, that is minimal (i.e. |C| differs from 2[1−h(ρ)]n by at most a polynomial factor poly(n)). The approximation version of the problem is specified by a parameter δ(n) satisfying 0 < δ(n) ≤ d < 1 for some constant d. Definition 4. Problem. δ(n)-Almost Minimal Covering Creation Input: Integers n ≥ 1 and r = ρn where 0 < ρ < 1/2. Output: A covering C, of length n and radius ρn, that is δ(n)-almost minimal (i.e. |C| differs from 2[1−h(ρ)]n by a factor 2δ(n)n ). 3.3
Covering Creation: Classical Deterministic Algorithms
Two main techniques are often used in code theory to find good codes: randomization, which we will apply in the following Section 3.4, and divide-and-conquer, which is behind the deterministic algorithms we are about to describe. The deterministic divide-and-conquer algorithms build long codes from short codes by code concatenation (direct sum). The classical covering creation algorithm presented in [6] proceeds in two phases: Phase one creates a minimal covering Cλ of short length λ = λ(n) by applying the greedy set cover algorithm; Phase two generates the long length n covering Cn by concatenating n/λ copies of Cλ . Exploring an Algorithmic Space-Time Trade-Off In [6], two cases of the above construction are considered: (1) the case λ(n) = c where c is a positive constant (with respect to n), and (2) the case λ(n) = n/c. For the case λ = n/c, the resulting covering code Cn solves the Minimal Covering Creation Problem, but it requires exponential space. For the case λ = c, Cn solves the δ(n)-Almost Minimal Covering Creation Problem where δ is a constant, but it requires a different c (and hence a different algorithm where c depends on δ) for each given δ satisfying 0 < δ < 1/2. In the following reformulation of the results in [6] we let the parameter λ = λ(n) remain temporarily undetermined. In this way we uncover a new covering code algorithm that we will consider as case (3) λ(n) = (1/3 lg n. As Corollary 1 below shows, this algorithm compares favorably with the other two in that the size of the covering it computes is exponentially smaller than that produced by the algorithm corresponding to case λ = c, and it requires only polynomial workspace, unlike the exponential requirement of the algorithm corresponding to case n/c.
104
Pilar de la Torre
We now describe a family of algorithms parameterized by λ = λ(n), each of which creates a covering code of length n and radius ρn based on λ. Each builds such covering Cn in two stages: the first stage computes a good short code Cλ n/λ and the second generates the power code Cn = Cλ . c-Covering Code(n, ρ; Cn , |Cc |) assume. n ≥ 1, 0 < ρ < 1/2, c | n, and an available copy of Cc computed offline by Greedy Code(c, ρ; Cc , |Cc |). 1. Compute Cn = Ccn/c .
Flex Code n, ρ, λ(n); Cn , |Cλ(n) | assume: n ≥ 1, 0 < ρ < 1/2, λ(n) | n. 1. Greedy Code(λ(n), ρ; Cλ(n) , |Cλ(n) |) n/λ(n) 2. Compute Cn = Cλ(n) .
Lemma 3. Let 0 < ρ < 1/2, λ = λ(n, ρ) a positive integer, and n a multiple of λ. Let Cλ be the covering of length λ and radius ρλ and size at most 1/2 λ3/2 [ρ(1 − ρ)] 2[1−h(ρ)]λ computed by algorithm Greedy Code in time O(23λ ) and space O(2λ ). Then, n/λ
1. Cλ
is a code of length n, radius ρn, and size at most 2[1−h(ρ)]n 2[
3 lg λ 2λ
]n .
2. It can be computed by c-Covering Code if λ = c, and Flex Code otherwise. 3. The workspace requirement for this classical computation is O((n/λ(n))23λ(n) ), which is polynomial for λ(n) = O(lg n) and is exponential otherwise. 4. The time requirement is O(23λ + 2[1−h(ρ)]n 2
3 lg λ 2λ n
).
The following corollary give us bounds for the size of the covering computed by the algorithms under consideration and their time and space requirements. The algorithms corresponding to parameter values λ(n) = c and λ(n) = n/c where c is a constant, were considered in [6]. Corollary 1. 1. Given an integer n multiple of 6, a covering code of length n, radius ρn, and size at most poly(n)2[1−h(ρ)]n can be computed by Flex Code with λ(n) = n/6. This algorithm requires time poly(n)2[1−h(ρ)]n , and exponential workspace Ω(2n/2 ). 2. Given δ > 0 there is an integer constant c = c(δ, ρ) such that for each multiple n of c a covering code of length n, radius ρn, and size at most poly(n)2[1−h(ρ)]n 2δn can be computed by the classical algorithm c–Covering Code. This algorithm requires poly(n)2[1−h(ρ)]n 2δn time, and polynomial O(n) workspace. 3. Given an n multiple of an integer 13 lg n, a covering code of length n, radius lg lg n ρn, and size at most 2[1−h(ρ)+o( lg n )]n is computed by the classical algorithm lg lg n Flex Code with λ(n) = (1/3) lg n. It requires 2[1−h(ρ)+o( lg n )]n time, and polynomial θ(n) workspace.
How Efficiently Can Room at the Bottom Be Traded Away
3.4
105
δ(n)-Almost Minimal Covering Creation
This section gives two sticker model algorithms for the Covering Code problem. Power Code(λ, Cλ , n, L ; T1 ) 1. Let (K, L) be a sticker memory library T1 with K = L + n, L = (n/λ) lg |Cb | + L . That is, T1 = {0, 1}(n/λ) lg |Cλ |+L {0}n . 2. For t = 1 to n/λ { 2.1 Separate T1 into tubes T1 , . . . T|Cλ | , based on (t − 1) lg |Cλ | + 1, . . . , t lg |Cλ |: For l ← 1 to lg |Cλ | { For all σ, 1 ≤ σ ≤ 2l , in parallel { separate (Tσ , (t − 1) lg |Cλ | + σ; T2σ−1 , T2σ ) } 2.2 For each w ∈ Cλ = {w1 , . . . , w|Cλ | } and each strand s in Tj , copy wj into s’s substrand sL+(t−1)λ+1 sL+tλ . For all j, 1 ≤ j ≤ |Cλ |, in parallel { For l ← 1 to λ { If the lth bit of wj equals 1, then j , (t − 1)λ + j). } } set(T 2.3. Parallel Merge T1 , . . . , T|Cλ | ; T1 } } c-Code-Sticker(n, ρ, L ; T1 , |Cc |) assume. n ≥ 1, 0 < ρ < 1/2, c | n, a copy of Cc computed offline by Greedy Code(c, ρ; Cc , |Cc |). Power Code(c, Cc , n, L ; T1 ) .
Flex Code-Sticker n, ρ, λ(n), L ; T1 , |Cλ(n) | assume: n ≥ 1, ρ, 0 < ρ < 1/2, λ(n) | n. λ(n), ρ Cλ(n) 1. Greedy Set Cover(n, , |Cλ(n) |) 2. Power Code λ(n), Cλ(n) , n, L ; T1
They are obtained through the classical algorithms above by replacing their step 2 with the following sticker model implementation of the computation of n/λ Cn = Cλ from Cλ . Given a subset L of {0, 1}K and an integer µ, multi-suffixµ (L) (multi-prefixµ (L)) will denote the multiset of strings of length µ, each of which is the length n suffix (prefix) of one of the strings from multiset L. Given an integer n > 1 and a length λ = λ(n) covering code Cλ as input, the following procedure generates as output a set T1 of sticker model memory complexes. These complexes represent a binary language L of length K = (n/λ) lg |Cλ | + L +n with the following properties: (1) multi-suffixn (L) is the multiset of strings representing elements of Cn , each of which appears with multiplicity 2L , and (2) (n/λ) lg |Cλ |+L multi-prefixK−n (L) = {0, 1} . Theorem 1. Given δ > 0 and ρ satisfying 0 < ρ < 1/2, there is a constant c = c(δ, ρ) such that for each multiple n of c the invocation c-CodeSticker(n, ρ, L ; T1 , |Cc |) computes a covering code of length n, radius ρn, and size at most 2[1−h(ρ)]n 2δn . The algorithm has the following requirements. 1. The time required by the classical preprocessing is O(1), and that required by the biomolecular requires is Θ(n) operations from {initialize, set, clear, combine, separate}. 2. The classical phase requires O(1) space. The biomolecular phase requires O(n) tubes of O(n + L ) length strands and O(2[1−h(ρ)+δ]n poly(n)) space. 3. The space-time product required is asymptotically equal to that of the classical algorithm of Dantsin et al. in [6], which the current biomolecular algorithm implements.
106
Pilar de la Torre
Theorem 2. Given a number ρ such that 0 < ρ < 1/2, for each multiple n of (1/3) lg n, the invocation Flex Code-Sticker n, ρ, λ(n), L ; T1 , |Cλ(n) | comlg lg n putes a covering code of length n, radius ρn, and size at most 2[1−h(ρ)+o( lg n )]n .
The algorithm has the following requirements. 1. The time required is O(n) for classical preprocessing and O(n) biomolecular operations from {initialize, set, clear, combine, separate}. 2. The space required by the preprocessing phase is θ(n). The biomolecular phase lg lg n requires 2[1−h(ρ)+o( lg n )]n space, and O(n) tubes of O(n + L ) length strands. 3. The space-time product requirement is asymptotically equal to that of the best known polynomial space classical algorithm for the problem (which is our algorithm in Part 3 of Corollary 1) that the current biomolecular algorithm implements. The algorithm is an exponential number of times more space-time efficient than the best previously known algorithms [6]. 3.5
Minimal Covering Creation Problem
We now describe a beautiful classical probabilistic algorithm from [6] that, with high probability, solves the Minimal Covering Creation problem. We present a rand-initialize based probabilistic sticker model algorithm that implements it, is space-time efficient with respect to it up to constant factors, and is θ(n) times faster. The size of a covering created by these algorithms is, in fact, within a n factor of minimum. Dantsin et al. [6]’s probabilistic algorithm is implied by the following fact, which is the heart of their probabilistic proof for the upperbound on K(n, ρ) stated in Lemma 1. Lemma 4 ([6]). Let S be a set of n2n /V (n, r) elements that have been chosen uniformly at random with replacement from Hn satisfying n > 1. Then S is a covering code, of length n and radius at most r, with probability at least 1−2n /en . As observed in [6], given n ≥ 1 and ρ satisfying 0 < ρ < 1/2, Lemma 4 yields a classical algorithm, which with high probability computes a minimal covering code of length n, radius ρn, and size n2n /V (n, r). By Lemma 1, this size is bounded by, and polynomially equivalent to, ν(n) = nβ(n)2[1−h(ρ)]n . Rand Code(n, ρ; Crand ){ Set C = ∅ and repeat the following step ν(n) times: STEP: For i from 1 to n { Set bi to a random bit}; Add b1 · · · bn to Crand } }
We observe that the covering code Crand created by Rand Code is none other than a multiset Sn,ν(n) of ν(n) strings drawn uniformly and independently at random with replacement from Hn . We therefore conclude that the following randomized algorithm, based on the sticker model augmented with operation rand-initialize, implements Rand Code. Rand Code-Sticker(n, ρ; Trand ){ Invoke rand-initialize(n, n, ν(n); Trand ) }
How Efficiently Can Room at the Bottom Be Traded Away
107
Our conclusions are summarized below. Let us recall that functions h(·) and β(·) were defined in Section 3.1. Theorem 3. For every n ≥ 1 and ρ satisfying 0 < ρ < 1/2, an invocation to the probabilistic sticker model algorithm Rand Code-Sticker(n, ρ; Trand ), based on primitive rand-initialize, creates a minimal covering code Trand of length n, radius ρn, and size at most ν(n) = nβ(n)2[1−h(ρ)]n . 1. The time required is one rand-initialize operation that takes O(1) physical biomolecular steps. 2. The space required is nβ(n)2[1−h(ρ)]n and Θ(1) tubes of length Θ(n) strands. 3. Its space-time product is θ(n) times smaller than that of the best known randomized classical algorithm for the Minimal Covering Creation problem, which the current biomolecular algorithm implements, and its running time is as low as possible. It is θ(n) times more space-time efficient than the best known classical algorithm.
4
The k-SAT Problem
This section summarizes our results on deterministic and randomized sticker model based algorithms for the k-SAT problem. Due to space limitations we attempt to outline the algorithms and summarize the results of the analysis, and leave their elaboration for the journal version of this extended abstract. Definition 5. Problem. k-SAT Input. A k-CNF Boolean formula F = F (X1 , . . . , Xn ) = γ1 ∧ · · · ∧ γm of n variables, where each of the m clauses γi = li,1 ∨ · · · ∨ li,k has exactly k ≥ 3 literals and each literal li,j is either one of the variables Xν or its negation ¬Xν . Decision Output: Either “satisfiable”, if F (x1 , . . . , xn ) = 1 for some truth assignment x = (x1 , . . . , xn ) in Hn = {0, 1}, or “unsatisfiable”.Search Output: Either an x = (x1 , . . . , xn ) in Hn such that F (x1 , . . . , xn ) = 1, if one exists, or “unsatisfiable”. Representing F as an m-tuple γ1 , . . . , γm specifies a fixed order among the clauses. All of the following k-SAT algorithms can be viewed as having the following two phase structure, which offers a remarkable degree of parallelism. k-SAT Multiroot-Local-Search(n, m, F = γ1 , . . . , γm ) 1. Roots-Generation: Generate N initial assignments in set I ⊆ Hn = {0, 1}n . 2. Local-Search:For all x in I, invoke a Local Search(n, m, F = γ1 , . . . , γm , x) of r steps.
In Sch¨ oning’s k-SAT algorithm [14], Phase 1 is performed by probabilistic sampling and Phase 2 by a random-walk based local search involving r = 3n steps where n is the number of variables in the input instance. For each of the two k-SAT algorithms in Dantsin et al. [6] Phase 1 is performed by one of their two deterministic covering code creation algorithms (which correspond to cases
108
Pilar de la Torre
λ(n) = n/c and λ(n) = c in Part 1 and Part 2 of Corollary 1), and Phase 2 by a derandomized version of Sch¨ oning’s local-search algorithm, for the m clauses n k-SAT instance F , consisting of r = k+1 steps. 4.1
Deterministic Sticker Model Based k-SAT Algorithms
This section summarizes our results on two sticker model based k-SAT algorithms each of which, through parameter λ(n), are expressed by the parametrized algorithm k-SAT-SKINNY Sticker(n, λ(n), m, F = γ1 , . . . , γm ). For λ(n) = c, our biomolecular algorithm implements the classical deterministic k-SAT algorithm of Dantsin et al. [6], which uses algorithm c-Covering Code to perform Phase 1. For λ(n) = (1/3) lg n, our biomolecular algorithm implements a new classical k-SAT algorithm that results from the algorithm of Dantsin et al. using Flex Covering Code(n, ρ, λ(n) = (1/3) lg n; Cn ) to perform Phase 1. Algorithm: k-SAT-SKINNY Sticker (n, λ(n), m, F = γ1 , . . . , γm ) n Set L = k+1 1 + lg k.
Phase 1. Roots-Generation:
If λ(n) = c (, k) = c then c - Code-Sticker n, ρ, L ; MCn , |Cλ(n) | . If λ(n) = (1/3) lg n then Flex Code-Sticker n, ρ, λ(n), L ; MCn , |Cλ(n) | . Set I = 1 + (n/λ(n)) lg |Cλ(n) |. Phase 2.
Local-Search:
Local Search SKINNY-Sticker(MCn , I, L , m, γ1 , . . . , γm )f V ← MCn ; For level ← 1 to r do f Split by Unsat Clause(I, L , level, V, m, γ1 , . . . , γm ; U1 , . . . , Um , Sanswer ) Read(Sanswer ): If Sanswer = ∅, then fReport a truth assignment from Sanswer and Halt g elsef Flip Assignments(I, L , level, U1 , . . . , Um , m, γ1 , . . . , γm ; V1 , . . . , Vm ) Parallel-Merge(U1 , . . . , Um ; V ) g g Report “unsatisfiable”. Split by Unsat Clause(I, L , level, V, m, γ1 , . . . , γm ; U1 . . . , Um , R)) f L ← I + L For µ ← 1 to m do fcomment: Separate into Uµ assignments failing to satisfy γµ . For κ ← 1 to k do f Let Xµκ be the variable in γµ ’s κth literal lκ . If lκ = Xµκ then separate(R, L + µκ ; R, Runsat ) else separate(R, L + µκ ; Runsat , R) combine(Runsat , Uµ ; Uµ ) g g g
How Efficiently Can Room at the Bottom Be Traded Away
109
Flip Assignment(I, L , level, U1 , . . . , Um , m, γ1 , . . . , γm ; U1 , . . . , Um )f L ← I + L ; For all µ, 1 ≤ µ ≤ m, in parallel dof , comment: Flip bit values in Uκ Partition by–Flipping–Variable(I, level, Uµ , γµ ; Vµ,1 , . . . , Vµ,k ); For κ ← 1 to k in parallel do f Let Xν be the variable corresponding to γµ ’s κth literal separate(Vµ,κ , L + µκ , Aµκ , Bµ,κ ); clear(Aµ,κ , L + µκ ); set(Bµ,κ , L + µκ ) Parallel–Merge(Vµ,1 , . . . , Vµ,k ; Uµ ) g g g Partition by Flipping–Variable (I, level, Uµ , γµ ; Uµ,1 , . . . , Uµ,k ) For i ← 1 to 1 + lg k do f Set νi = i + (level − 1) 1 + lg k + I; Separate Uµ,1 , . . . , Uµ,2i , ν1 , . . . , ν2i ;
Uµ,1 , . . . , Uµ,2i , . . . , Uµ,1+(k/2i ) , . . . , Uµ,2i +(k/2i ) g
Theorem 4. Given 4 > 0 and k ≥ 3 there is an integer constant c = c (4, k) such that, for each multiple n of c , an k-SAT-SKINNY Sticker(n, λ(n), m, F ) invocation, with λ(n) = c , solves k-SAT instances F of n variables and m clauses. The algorithm has the following requirements. 1. The required time is θ(n) classical preprocessing and a sequence of O(knm) bio operations from {initialize, set, clear, combine, separate}. 2. The space required is θ(n) for the classical preprocessing. The biomolecular n phase requires [2 − 2/(k + 1) + 4] poly(n) space and O(km) tubes of O(n lg k) length strands. 3. The space-time product requirement is within a polynomial factor O(n) of that of the best previously known polynomial space classical algorithm (which is Dantsin et al’s algorithm in [6]) that the current biomolecular algorithm implements. Theorem 5. Let k ≥ 3, λ(n) = (1/3) lg n, and n be a multiple of λ(n). Invoking algorithm k-SAT-SKINNY Sticker(n, λ(n), m, F ) solves k-SAT instances F of n variables and m clauses. The algorithm has the following requirements. 1. The time required is O(n) classical preprocessing and a sequence of O(knm) operations from {initialize, set, clear, combine, separate}. 2. The space required is θ(n) preprocessing workspace. For the biomolecular phase the space requires O(km) tubes, O(n lg k) length strands, and is within n a polynomial factor of [2 − 2/(k + 1) + o((lg lg n)/ lg n)] space. 3. Its space-time product requirement is smaller, by at least the exponential facn tor [1 + 4(k + 1)/(k − 1)] , than that of the best previously known polynomial space deterministic classical algorithm for k-SAT , which is presented in Sec 4 of [6]; this makes k-SAT-SKINNY Sticker exponentially more space-efficient than that algorithm. 4.2
Probabilistic Sticker Model Based k-SAT Algorithm
This section summarizes our results on the probabilistic sticker model based implementation of Sch¨ oning’s k-SAT algorithm [14]. This classical algorithm
110
Pilar de la Torre
has probabilistic elements in both of its phases. The creation of the pool of roots for the multiroot local-search is implemented by a single invocation to rand-initialize. The randomized k-way choice of a literal within an unsatisfied clause required by the local-search update of the assignments is implemented using the rand-partition primitive.
Algorithm: k-SAT-Rand-Sticker (n, m, F = γ1 , . . . , γ , α) Phase 1. Roots-Generation:
Set K = n, L = n, and N = αpSch (n) 2 − Invoke rand-initialize(n, K, L, N ; M ).
2 n . k
Phase 2. All-Sources Local-Search: All-Sources Local-Search Randomized-Sticker(M, n, m, γ1 , . . . , γm ) Repeat 3n times f Separate by First Unsat Clause(M, m, γ1 , . . ., m, γm ; M1 , . . ., Mm , Sanswer ) Read(Sanswer ): if Sanswer = ∅, then report an element from Sanswer , and Halt. else f Flip Unsat Assignments(M1 , . . . , Mm , m, γ1 , . . . , γm ; M1 , . . . , Mm ) Parallel-Merge(M1 , . . . , Mm ; M ) g g Report: “probably unsatisfiable” Separate by First Unsat Clause(V, m, γ1 , . . . , γ ; M1 . . . , Mm , R)) For µ ← 1 to m do f , Comment: Separate from R into Mµ all truth assignments not satisfying γµ . For κ ← 1 to k do f Let Xµκ be the variable in γµ ’s κth literal lκ . If lκ = Xµκ then separate(R, µκ ; R, Runsat )else separate(R, µκ ; Runsat , R) combine(Runsat , Mµ ; Mµ ) gg Flip Unsat Assignment(M1 , . . . , Mm , m, γ1 , . . . , γ ; M1 , . . . , Mm ) For all µ, 1 ≤ µ ≤ m, in parallel do f , Comment: Flip bit values guided by γµ . For κ ← 1 to k do f rand-partition(1 : k − κ , Mµ ; Mµ,κ , Mµ ) g For κ ← 1 to k in parallel do f Let Xµκ be the variable in γµ ’s κth literal lκ . separate(Mµ,κ , µκ ; Aµ,κ , Bµ,κ ) clear(Aµ,κ , µκ ); set(Bµ,κ , µκ ) g Parallel-Merge(Mµ,1 , . . . , Mµ,k ; Mµ ) g
Theorem 6. An invocation of k-SAT-Rand Sticker(n, m, F, α) succeeds in finding a satisfying assignment for the k-SAT instance F of n variables and m clauses, if one exists, with high probability (1 − e−a ). The requirements of this algorithm are as follows. 1. The time required is O(n) rand-partition operation and Θ(knm) operations from {set, clear, combine, separate}. n 2. The space required is N = αpSch (n) 2 − k2 and Θ(kmn) tubes of O(n) length strands. 3. The space-time product requirement is within a polynomial O(km) factor of that of the best currently known classical randomized k-SAT algorithm [14]),
How Efficiently Can Room at the Bottom Be Traded Away
111
which the current algorithm implements. Hence k-SAT-Rand Sticker is spacetime efficient relative to the currently best known classical counterpart up to an O(km) factor. Acknowledgments. I am grateful to Anne Condon for many fruitful discussions. Thanks are due to Mark Bochert and an anonymous referee for suggestions that improved the quality of the presentation.
References 1. L. M. Adleman. Molecular computation of solutions to combinatorial problems. Science, 266:1021–1024, November 11, 1994. 2. E. Bach, A. Condon, E. Glaser, and C. Tanguay. DNA models and algorithms for NP-complete problems, 1996. 3. K. Chen and V. Ramachandran. A space-efficient randomized DNA algorithm for k-SAT. In DNA Computing, 6th International Workshop on DNA-Based Computers, DNA 2000, Leiden, The Netherlands, June 2000, volume 2054 of LNCS. Springer Verlag, Berlin, Heidelberg, New York., 2000. 4. G. Cohen, I. Honkala, S. Litsyn, and A. Lobstein. Covering Codes. NorthHolland, 1997. 5. T. Cormen, C. Leiserson, R. Rivest, and S. Stein. Introduction to Algorithms. McGraw-Hill, second edition, 2001. 6. E. Dantsin, A. Goerdt, E. A. Hirsch, R. Kannan, J. Kleinberg, C. Papadimitriou, P. Raghavan, , and U. Sch¨ oning. A deterministic (2 − 2/(k + 1))n algorithm for k-SAT based on local search. To appear in Theoretical Computer Science. 7. S. Diaz, J. L. Esteban, and M. Ogihara. A DNA-based random walk method for solving k-SAT. In DNA Computing, 6th International Workshop on DNABased Computers, DNA 2000, Leiden, The Netherlands, June 2000, volume 2054 of LNCS. Springer Verlag, Berlin, Heidelberg, New York., 2000. 8. R. P. Fynman. There’s plenty of room at the bottom. In Miniaturization, D. H. Gilber Editor, Reinhold, New York, pages 282-296, 1961. 9. R. J. Lipton. DNA solution of hard computational problems. Science, 268:542–545, 28, 1995. 10. F. J. MacWilliams and N. J. A. Sloane. The Theory of Error-Correcting Codes. North-Holland, Amsterdam, Holland, 1977. 11. R. Paturi, P. Pudlak, M. E. Saks, and F. Zane. An improved exponential-time algorithm for k -SAT. In IEEE Symposium on Foundations of Computer Science, pages 628–637, 1998. 12. R. Paturi, P. Pudlak, and F. Zane. Satisfiability coding lemma. Chicago Journal of Theoretical Computer Science, 1999. 13. S. Roweis, E. Winfree, R. Burgoyne, N. V. Chelyapov, M. F. Goodman, P. W. K. Rothemund, and L. M. Adleman. A sticker-based model for DNA computation. Journal of Compuataional Biology, 5(4), pages 615–629, 1998. 14. U. Sch¨ oning. A probabilistic algorithm for k-SAT and constraint satisfaction problems. Prooceedings of 40th Symposium on Foundations of Computer Science, pages 410–414, 1999. IEEE Computer Society Press, Los Alamitos, CA.
Hierarchical DNA Memory Based on Nested PCR Satoshi Kashiwamura1, Masahito Yamamoto1 , Atsushi Kameda2 , Toshikazu Shiba3 , and Azuma Ohuchi3 1
3
Graduate School of Engineering, Hokkaido University North 13, West 8, Kita-ku, Sapporo 060-8628, Japan {kashiwa, masahito}@dna-comp.org http://ses3.complex.eng.hokudai.ac.jp/index.html 2 Japan Science and Technology Cooperation (JST) Honmachi 4-1-8, Kawaguchi 332-0012, Japan [email protected] CREST, Japan Science and Technology Cooperation (JST) and Graduate School of Engineering, Hokkaido University North 13, West 8, Kita-ku, Sapporo 060-8628, Japan {shiba, ohuchi}@dna-comp.org
Abstract. This paper presents a hierarchical DNA memory based on nested PCR. Each DNA strand in memory consists of address blocks and a data block. In order to access specific data, we specify the order of the address primers, and nested PCR are performed by using these primers. Our laboratory experiments are also presented to demonstrate the feasibility of the proposed memory.
1
Introduction
DNA is an excellent memory unit because it has the capability to store vast amount of data in a very small space. Focusing on this aspect of DNA, our study aims to propose and to construct DNA memory with high memory capacity at an extremely minute scale. We present an implementation of a hierarchical DNA memory based on nested PCR, which is called Nested Primer Molecular Memory (NPMM). In an NPMM, a data block sequence is concatenated with address block sequences. Address blocks consist of primer-annealing sites for the addressing of data. In order to access specific data, we specify the order of address primers, and nested PCR are performed by using these primers. In the NPMM systems, a high-level reaction specificity and a very secure memory system can be achieved. In this paper, we focus on the addressing of the data but do not discuss the encoding of the data into DNA sequences or the decoding of the sequences. The structure and design strategy of NPMM is described, and our laboratory experiments are presented in order to demonstrate the feasibility of NPMM. M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 112–123, 2003. c Springer-Verlag Berlin Heidelberg 2003
Hierarchical DNA Memory Based on Nested PCR
2
113
Related Works
The most famous work on Molecular Memory may be the efforts of Head et al., who proposed memory with an aquatic feature. In their approach, any problem could be solved by handling aquatic memory appropriately. This is called as aqueous computing [1][2]. Their idea overcomes the overhead of the sequence design problem, which is a serious issue in conventional DNA computation. On this point, their memory is an excellent breakthrough, but it does not focus on achieving the high memory capacity and compactness of DNA. Actually, it may be difficult to enlarge their memory system experimentally. On the other hand, Baum was the first to propose to constructing memory (in his ward, database) by focusing on the high memory capacitance and compactness of DNA[3]. In his model, a massively parallel associative search in a vast database made of DNA can be realized by affinity separation methods, but he did not show the feasibility of his idea, experimentally. Rief et al. refined the previous memory idea by using various information theoretical coding techniques [4], and large DNA database was constructed experimentally [5]. They constructed DNA database, which is the random pool constructed by the random assembly of short subsequences. We have a question about the effectiveness of the random pool. Here, we propose a new DNA memory system based on PCR. Our system has new advantages that were not in the previous models, which are described in the next section. In this paper, we do not discuss the associative search in our model, but associative search will become possible by using a few devices.
3
Nested Primer Molecular Memory
In the case of conventional memory, data is encoded to {0,1} bit sequence data and then stored in media. In the case of Nested Primer Molecular Memory (NPMM), data is encoded to {A,T,G,C} base sequence data and then stored in a DNA strand. NPMM is a aqueous solution in which DNA (data) are mixed, and each DNA sequence in NPMM consists of the areas where stored data and the data address are expressed. If we specify the address of target data, we can get the target data from NPMM. 3.1
Data Structure of NPMM
NPMM consists of some DNA sequences in which data are stored. Each DNA sequence consists of three types of blocks: data block, address blocks, and Re block. – Data block is the site where data are encoded into a base {A,T,G,C} sequence.
114
Satoshi Kashiwamura et al.
– Address blocks are the sites where addresses are specified and consist of some blocks at the 5’end of the data block. – Re block is the site where the reverse primer should be hybridized, and is the common sequence in all DNA sequences in NPMM. In this paper, the number of address blocks is fixed to three (named A block, B block, C block) and the number of sequences in each address block is three (labeled 0, 1, 2). The oligo (working as a forward primer) that should be hybridized to the sequence labeled i (i ∈{0,1,2}) in X block (X ∈{A,B,C}) is denoted by Xi . We define a reverse primer as Re, the data sequence following the Ai ,Bj ,Ck annealing site as dataijk , and the overall DNA sequence as templateijk (Fig. 1).
Fig. 1. Data structure of templates.
We define P and T as P = {Ai , Bj , Ck , Re|i, j, k ∈ {0, 1, 2}} and T = {templateijk |i, j, k ∈ {0, 1, 2}}. 3.2
Addressing the Data
The addressing procedure is as follows; Select Re ∈ P . Repeat this procedure the number of address blocks. Select p ∈ P , then perform PCR using p and Re, sequentially. By following the above procedure, we can obtain one sequence coding the target data. A set of used p and its order serve as the data address in NPMM, and we denote the address by [p1 , p2 ,. . .]. (pi (i is integer): forward primer used in ith PCR.) In order to deepen our understanding, we show an instance of extracting data101 from NPMM in Fig. 2. We know the address of data101 is [A1 , B0 , C1 ]. For the first PCR, A1 and Re are used in NPMM. Then, after PCR, the diluted solution consists of nine DNA containing an A1 annealing site, because only these nine DNA are amplified. For the second PCR, B0 and Re are used in the diluted solution after the first PCR. Then, only three DNA containing a B0 annealing site are amplified out of the nine DNA. Finally, C1 and Re are used in the diluted solution after the second PCR. As a result, there is only sequence coding data101 in the solution; hence we can obtain the target data data101 .
Hierarchical DNA Memory Based on Nested PCR A1,Re
B0,Re
C1,Re
PCR
PCR
PCR
templateijk
template1jk
i, j , k Î {0,1,2}
j , k Î {0,1,2}
template10k k Î {0,1,2}
27 mix
9 mix
3 mix
115
template101
Fig. 2. Target data sequence coding data101 is extracted from a 27-templates mix by [A1 , B0 , C1 ]. (The shortening of the length of templates by PCR is omitted here.)
3.3
Merits of NPMM
NPMM provides a high level of data security It is impossible to acquire a readout of the target data unless all primers are provided. Accordingly, each primer works as a key, and each key is independent of other keys. In other words, the primers work as distributed keys. Furthermore, even if you could get all of the primers, the order of each primer to specify an address would be complicated in permutation, i.e. even in the case of the previous example shown in Fig.2, there are 5040(= 10 P4 ) ways of how to select primers. Since we must get primers as keys and must know the order of each primer in order to acquire a readout of the specific data, a very secure memory system with some distributed keys would be realized. NPMM has a large capacity with a high reaction specificity The number of primers we should design is much less than that of data stored in NPMM. Because of the abundant use of PCR, a very high level of specificity of primers is absolutely essential for NPMM. Needless to say, an increase in the number of primers we have to design decreases the reaction specificity of the primers. NPMM realizes a large memory capacity in spite of a small number of primers. In fact, the capacity of NPMM grows exponentially with an increase in address blocks. The memory capacity of NPMM is determined as follows. M (bit) = 2 × Data(bp) × P rimerBlock M : memory capacity of NPMM. Data: length of the sequence in the data block. Block: number of address blocks. P rimer: number of primers in each address block. One base is equal to 2 bits because one base consists of 4 elements (A,T,G,C). In addition, using nested PCR raises the specificity of the final reaction products.[9]
116
Satoshi Kashiwamura et al.
Ease of extracting the target data from NPMM We can extract the target data from NPMM by using only PCR and Sequencing. PCR, as well as sequencing, is a very sophisticated, common-use, automated and easy tool. Therefore, anyone can extract the target data from NPMM easily, without special tools or experimental skill. 3.4
Potential Applications
NPMM can be used for media in which very secure data is stored. NPMM can also be used as media to store the data that is not usually referenced but shouldn’t be erased (e.g. accumulated log files). Another application is media to store human genetic information. The advances in genetic information have posed privacy problems in recent years. At present, an individual’s genetic information is read out and then converted to digital data. Genetic information is stored as this digital data in some media. Since genetic information is read out once, genetic information may leak out. On the other hand, the individual’s genetic information could be saved in NPMM as a raw gene, without reading and translating individual genetic information. Accordingly, NPMM would protect the privacy of genetic information.
4
NPMM Design
In order to investigate the feasibility of NPMM, we designed a small-sized NPMM. The evaluation function for the sequence design was originally formulated by consulting some references [6][7][8]. 4.1
Size of NPMM
In this paper, we set the size of NPMM: 27(33 ) kinds of data can be stored in this NPMM, and the memory capacity is 135 bytes. The number of primers to be designed is 10 (=3 × 3 + 1). The other parameters are described as follows. – length of data sequences: 20 bp – length of primers (p ∈ P ): All 15 bp – length of template (t ∈ T ): 80 bp (=15+15+15+20+15) 4.2
Design of Sequences
We designed data sequences and primer sequences with the following procedure. 1. Design 27 data sequences randomly. 2. Design 10 primer sequences so as to prevent mishybridization of each template and each primer by computer simulation as follows.
Hierarchical DNA Memory Based on Nested PCR
117
Strategy of primer design In this instance, we must design P because data sequences are designed randomly, and T is created automatically when P and data sequences are designed. We took following the 3 evaluation items into consideration in designing P . Each evaluation value is calculated on each evaluation item. 1. GC content 2. Hamming distance 3. 3’end complementary P is designed so as to optimize the evaluation functions, which are calculated as linear sums of each evaluation value by Simulated Annealing Method. GC content It is necessary to make the T m (melting temperature) of each primer regularity to achieve a high specificity in the PCR reaction. Therefore, each primer should share the GC content. The evaluation value (GC value) of GC content on P is calculated as follows. GC value = max((GCdef ine − GCp )2 ) + GC max number/|P |, where GCdef ine is the target value of the GC content of the primer and GCp is the GC content of p (∃p ∈ P ). GC max number is the number of the primers that is evaluated as the worst value in P and |P | is the number of elements in P . The smaller the GC value is, the better P is for GC content. Hamming distance We propose this evaluation item in order to prevent mishybridization between a primer and a template or a primer and a primer. Given two sequences x = x1 x2 . . . xl and y = y1 y2 . . . yl (xi , yi ∈ {A, T, G, C}), H(x, y) indicates the hamming distance between two sequences x, y, which indicate the number of bases such as xi = yi . To evaluate the hamming distance between x, y with different length(|x| ≤ |y|), we define HM (x, y). To count HM (x, y), we find total |y| − |x| + 1 H(x, yi ), where yi (1 ≤ i ≤ |y| − |x| + 1) is subsequence of length |x| in y. Additionally, in order to take into consideration the case where x mishybridizes to y with the sticky end at 5’ or 3’end of y, we find total (2|x| − 2) H(x , y ) (|x| − 1 at 5’, 3’end, respectively), where x , y are the subsequences forming duplex between x and y, respectively. HM (x, y) indicates the maximum in |y| − |x| + 1 H(x, yi ) and 2|x| − 2 H(x , y ). The evaluation value (H value) of Hamming distance on P is calculated as follows. For ∃p ∈ P , ∃t ∈ T , H value = max(HM (p, t), HM (p, t)) + H max number/ALL combinations H max number indicates the number of the pairs between p and t that is evaluated as the worst value. ALL combinations indicates the number of all combinations between p and t.
118
Satoshi Kashiwamura et al.
3’end complementary We propose this evaluation item in order to prevent mispriming (a misextension reaction caused by mishybridization at 3’end of a primer). Given two sequences x = x1 x2 . . . xl and y = y1 y2 . . . yl (xi , yi ∈ {A, T, G, C}), E(x, y) indicates the sum of the suffix of each base such as xi = yi (i.e., x = AT T GC, y = AAGGC, E(x, y) = 1 + 4 + 5 = 10). To evaluate the 3’end complementary between two sequences x, y of different length(|x| ≤ |y|), we define EM (x, y). EM (x, y) indicates the maximum E(x, y ) between x and y (|y| − |x| + 1 subsequences of length |x| in y). The evaluation value (E value) of the 3’end complementary on P is calculated as follows. For ∃p ∈ P , ∃t ∈ T , E value = max(EM (pn , t), EM (pn , t)) + E max number/ALL combinations For sequence x, xn indicates the subsequence of length n (0 ≤ n ≤ |x|) in x from 3’end (i.e., x = AT GT AGCCAT GG, x5 = CAT GG). E max number indicates the number of pairs between p and t that is evaluated as the worst value. Evaluation Function The evaluation value of P (f itness) is calculated by the following function. The smaller f itness is, the better P is. f itness = GC weight×GC value +H weight×H value +E weight×E value ∗ ∗ weight indicates the weight (positive integer) of each item. ∗ ∗ value is translated ∗ ∗ value to [0.0,1.0] (scale conversion).
5
Laboratory Experiments
5.1
Extracting Target Data Sequence Using PCR
Here, in order to verify that a target data sequence is extracted from NPMM by means of the above addressing method, we perform laboratory experiments for small NPMM. In the previous section, although we designed 10 primers and 27 templates, here we select 4 templates out of 27 templates and deal with a small NPMM (T4-NPMM) consisting of template000, template001 , template010 and template011 . These sequences are shown in Table. 1. Thus, we can obtain data000 by addressing [B0 , C0 ], data001 by [B0 , C1 ], data010 by [B1 , C0 ], and data011 by [B1 , C1 ]. We obtain these 4 data as described in Protocol 1 below. The results are shown in Fig. 3. Protocol 1. Amplify the target data Equipment and reagents – KOD DASH DNA Polymerase (TOYOBO) – 10 × KOD DASH buffer (TOYOBO)
Hierarchical DNA Memory Based on Nested PCR
119
Table 1. Designed sequences of templates and primers Name A0 B0 C0 data000 data010 template000 template010
Length Sequence Name 15mer GCAAAGAGCCTGTGA Re 15mer CAGTGTAAGTTCGTG B1 15mer TCCATGCGCTCTAAT C1 20mer GAGCATGTTCACTCTGGACG data001 20mer TTATAAACTCTCTTGACCCC data011 80mer A0 B0 C0 data000 Re template001 80mer A0 B1 C0 data010 Re template011
Length Sequence 15mer CATCAATGTCTGGCG 15mer AACGGAAAGATGCCT 15mer TACCAAACCGAGGTC 20mer AGTAAGAGTCTAGCCTAGCG 20mer GCTGGCATTACACGTCTCAG 80mer A0 B0 C1 data001 Re 80mer A0 B1 C1 data011 Re
– dNTP MIX (2 mM of each dNTP) – DNA thermal cycler (Biometra)
A. Primary PCR using Bj (0 ≤ j ≤ 1) 1. In a PCR reaction tube, add the following. – – – – – – – –
distilled water 13.875 µl 10× PCR buffer 2.5 µl dNTP mix 2.5 µl T4-NPMM (each 10 pM) 1 µl B0 or B1 (5 µM) 2.5 µl Re (5 µM) 2.5 µl KOD DASH Polymerase 0.125 µl Total volume is 25 µl
The reaction in primary PCR using B0 is named B0 af ter, the one using B1 is named B1 af ter. 2. Perform 23 cycles of PCR in automated thermal cycler: – – – –
denature (94◦ C for 10 sec) anneal (50◦ C for 30 sec) polymerize (72◦ C for 5 sec) perform the final polymerization step for an additional 60 sec
B. Secondary PCR using Ck (0 ≤ k ≤ 1) 1. Dilute B0 af ter and B1 af ter 164 folds. 2. For each dilution, add 1 µl of each to a PCR reaction tube containing as follows: – – – – – – –
distilled water 13.875 µl 10× PCR buffer 2.5 µl dNTP mix 2.5 µl C0 or C1 (5 µM) 2.5 µl Re (5 µM) 2.5 µl KOD DASH Polymerase 0.125 µl Total volume is 25 µl
The reaction in B0 af ter using C0 is named B0 C0 af ter, the one using C1 is named B0 C1 af ter; the reaction in B1 af ter using C0 is named B1 C0 af ter, the one using C1 is named B1 C1 af ter. 3. Perform 23 cycles of PCR using the same cycle parameters as for the primary PCR (part A, step 2) 4. Run 5 µl of the 6 reactions on a 10% PolyAcrylamide Gel, then visualize by ethidium bromide. Determine whether a strong band of the expected size is obtained for each reaction (Fig. 3).
120
Satoshi Kashiwamura et al.
Fig. 3. M: 100 bp ladder. M’: DNA marker of length 65, 50, and 35 bp. Lane 1: B0 af ter. Lane 2: B1 af ter. Lane 3: B0 C0 af ter. Lane 4: B0 C1 af ter. Lane 5: B1 C0 af ter. Lane 6: B1 C1 af ter.
5.2
Detection of Amplified Sequence
In Fig. 3, we can expect that each lane (numbered 3-6) consists of only one sequence coding: data000 , data001 , data010 and data011 , respectively. To confirm this, we make the following experiments with PCR, because 50 bp is not an adequate length to read out the sequence by a sequencer. For diluted B0 C0 af ter, we perform PCR using Re and data000 primer, which is the sequence of length 15 in data000 at 5’end (shown in Table. 2). In the same way, PCR is performed on the diluted B0 C0 af ter with data001 primer, data010 primer, data011 primer, and Re. If, and only if, a sequence of length 35 bp is amplified by using data000 primer, then B0 C0 af ter consist of the only sequence containing data000 . Thus to check out the sequence in B0 C0 af ter, a total of 4 PCR is needed. For B0 C1 af ter, B1 C0 af ter, and B1 C1 af ter, we performed the same operations described in Protocol 2 below. Table 2. Sequence of data primers Name Length Sequence Name Length Sequence data000 primer 15mer GAGCATGTTCACTCT data001 primer 15mer AGTAAGAGTCTAGCC data010 primer 15mer TTATAAACTCTCTTG data011 primer 15mer GCTGGCATTACACGT
Protocol 2. Detection by using data primers 1. Dilute B0 C0 af ter, B0 C1 af ter, B1 C0 af ter and B1 C1 af ter 164 folds. 2. Add 1 µl of each dilution to a PCR reaction tube containing the following (for each diluted mix, each data primer is used, therefore a total of 16 reactions are needed). – – – –
distilled water 13.875 µl 10× PCR buffer 2.5 µl dNTP mix 2.5 µl data000 primer, data001 primer, data010 primer, or data011 primer (5 µM) 2.5 µl
Hierarchical DNA Memory Based on Nested PCR
121
– Re (5 µM) 2.5 µl – KOD DASH Polymerase 0.125 µl – Total volume is 25 µl
3. Perform 25 cycles of PCR using the same cycle parameters as for the primary PCR (part A, step 2 in Protocol 1). 4. Run 5 µl of each of the 16 reactions on a 10% PolyAcrylamide Gel, then visualize by ethidium bromide (shown in Fig. 4).
Fig. 4. M: DNA marker of length 65, 50, and 35 bp. The index of 1: use data000 primer. 2: use data001 primer. 3: use data010 primer. 4: use data011 primer
Discussions Figure 4 indicates that almost the only sequence containing data000 exists in B0 C0 af ter. The desired results are obtained for other solutions as well. Although some weak bands appear, those are primer dimmers because these weak bands also appear without templates. (data not shown). From these results, we can conclude that a desired target data is extracted from T4-NPMM. 5.3
Amplification Using Concatenation Primer
Here, we perform PCR for T4-NPMM with a concatenation primer made up of two consecutive primers (in this experiment, we use B0 C0 , which is B0 concatenated C0 ). The purpose of this experiment is to see whether we can extract the target data by only one PCR procedure. Of course, whether that is possible depends on annealing temperature(Ta ). We perform the experiment as described in Protocol 3 below. We can regard this PCR as competitive PCR between template000 and template010 , so the number of cycles in PCR using B0 C0 is not a critical parameter [10]. Protocol 3. Amplify the target data using B0 C0 A. PCR to T4-NPMM using B0 C0 1. in a PCR reaction tube, add the following. – distilled water 13.875 µl – 10× PCR buffer 2.5 µl – dNTP mix 2.5 µl
122
Satoshi Kashiwamura et al. – – – – –
T4-NPMM 1 µl B0 C0 (5 µM) 2.5 µl Re (5 µM) 2.5 µl KOD DASH Polymerase 0.125 µl Total volume is 25 µl
– – – –
denature (94 C for 10 sec) anneal (50, 58, 66 or 74◦ C for 30 sec) polymerize (72◦ C for 5 sec) perform the final polymerization step for an additional 60 sec
2. Perform 25 cycles of PCR at 4 kinds of Ta: ◦
B. Detection of sequence amplified with B0 C0 1. Dilute the reactions at each annealing temperature 164 folds. 2. Add 1 µl of each dilution to a PCR reaction tube as in Protocol 2: – – – – – – –
distilled water 13.875 µl 10× PCR buffer 2.5 µl dNTP mix 2.5 µl data000 primer, data001 primer, data010 primer, or data011 primer (5 µM) 2.5 µl Re (5 µM) 2.5 µl KOD DASH Polymerase 0.125 µl Total volume is 25 µl
3. Perform PCR using the same cycle parameters as in Protocol 1, and set aside each solution from the thermal cycler every 2 cycles from 17 to 25 cycles. 4. Run 5 µl of all the reactions (80 samples) on a 10% PolyAcrylamide Gel, then visualize by ethidium bromide.
Fig. 5. Results of Detection Experiment, as in the previous subsection for T4NPMM amplified by using B0 C0 at Ta 66◦ C. M: DNA marker of length 65, 50, and 35 bp. Index of 1: the solution set aside from the thermal cycler at the 17th cycle. 2: 19th cycle. 3: 21st cycle. 4: 23rd cycle. 5: 25th cycle. Discussion In the case of PCR using B0 C0 at Ta 50, 58, or 66◦ C, some sequences are amplified. In the other case at annealing temperature 74◦ C, no sequence is amplified. Figure 5 shows the results of the data detection experiment after the PCR solution at 66◦ C. From the fact that the solutions amplified with data000 primer and data010 primer are visualized at almost the same step rate, the solution contains two sequences including data000 and data010 , respectively. This indicates that mispriming occurs between template010 and B0 C0 in spite of a high temperature such as 66◦ C. Therefore, we believe that decreasing the times of PCR would be difficult. (We have no data at higher Ta than 66◦ C (below 74◦ C), but this is no concern if each primer is lengthened.)
Hierarchical DNA Memory Based on Nested PCR
6
123
Concluding Remarks and Future Works
In this paper, we proposed a DNA memory with high capacity, high data security and high specificity of chemical reaction and we showed the feasibility of NPMM through some experiments. In the future, we should consider the design strategy for a set of primers that can be used without dependence on the data sequence. Also, we should investigate the scaling-up of NPMM. Since NPMM has the potential for high reaction specificity, even if the size of NPMM become larger, we believe that NPMM would work appropriately. Scaled-up NPMM will be realized in the near future.
References 1. T. Head, M. Yamamura, and S. Gal: “Aqueous Computing. writing on molecules”, Proceedings of CEC 99, (Congress on Evolutionary Computation), pp. 1006-1010 (1999) 2. T. Head, G. Rozenberg, R. S. Bradergroen, C. K. D. Breek, P. H. M. Lommerse and H. P. Spaink: “Computing with DNA by operating on plasmids”, Biosystems, Vol.57, pp. 875-882 (2000) 3. E. B. Baum: “Building an Associative Memory Vastly Larger Than the Brain”, Science, Vol.268, pp. 583-585 (1995) 4. J. H. Reif and T. H. LaBean: “Computationally Inspired Biotechnologies: Improved DNA Synthesis and Associative Search Using Error-Correcting Codes and VectorQuantization”, Sixth International Meeting on DNA Based Computers (DNA6), in Lecture Notes in Computer Science, pp. 145-172 (2001) 5. J. H. Reif, T. H. LaBean and M. Pirrung: “Experimental Construction of Very Large Scale DNA Databases with Associative Search Capability”, Seventh International Meeting on DNA Based Computers (DNA7), in Lecture Notes in Computer Science, pp. 231-247 (2002) 6. M. Arita, A. Nishikawa, M. Hagiya, K. Komiya and H. Gouzu and K. Sakamoto: “Improving Sequence Design for DNA Computing”, Proceedings of GECCO’00 (Genetic and Evolutionary Computation Conference), pp. 875-882 (2000) 7. M. Garzon, R. Deaton, L. F. Nino and Ed Stevens: “Encoding Genomes for DNA Computing”, Proceedings of the Third Annual Genetic Programming Conference, pp. 684-690 (1998) 8. F. Tanaka, M. Nakatsugawa, M. Yamamoto, T. Shiba and A. Ohuchi: “Developing Support System for Sequence Design in DNA Computing”, Seventh International Meeting on DNA Based Computers (DNA7), in Lecture Notes in Computer Science, pp. 129-137 (2002) 9. M. J. McPherson, P. Quirke and G. R. Taylor: “PCR A Practical Approach”, IRL PRESS, (1991) 10. M. J. McPherson, B. D. Hames and G. R. Taylor: “PCR2 A Practical Approach”, IRL PRESS, (1995).
Binary Arithmetic for DNA Computers Rana Barua1 and Janardan Misra2 1
Division of Theoretical Statistics and Mathematics, Indian Statistical Institute, 203 B.T. Road, Calcutta 700 108, India. [email protected] 2 Texas Instruments India Ltd. Bangalore 560017, India Present Address: School of Computing, National University of Singapore [email protected]
Abstract. We propose a (recursive) DNA algorithm for adding two binary numbers which require O(log n) bio-steps using only O(n) different type of DNA strands, where n is the size of the binary string representing the largest of the two numbers. The salient feature of our technique is that the input strands and the output strands have exactly the same structure which makes it fully procedural unlike most methods proposed so far. Logical operations of binary numbers can easily be performed by our method and hence can be used for cryptographic purpose.
1
Introduction
One of the earliest attempts to perform arithmetic operations (addition of two positive binary numbers) using DNA is by Guarneiri et al [11], utilizing the idea of encoding differently bit values 0 and 1 as single-stranded DNAs, based upon their positions and the operand in which they appear. This enabled them to propagate carry successfully as horizontal chain reaction using intermediate place holders because of the presence of appropriate complementary substrands, which annealed together. PCR then allowed one to insert correct value of carry and to further propagate it. Though their technique yields the correct result of addition of two given binary numbers, it is highly non-procedural in nature since the output strands are vastly different in structure from the input strands (which themselves are coded differently). The later attempts were by Vineet Gupta et al [14]. They performed logic and arithmetic operations using the fixed bit encoding of the full corresponding truth tables. They construct the strands for bits in first operand (level one) and corresponding to each bit value (0 or 1), all possible bit values (00, 01, 10, 11)1 in second operand(level two) such that in the next phase when first operand - strands are pored into the pot containing all possible second operand 1
In fact they use along with usual dnts other nucleotides like Uracil(U), 2,6diaminopurine(P) to achieve some additional complementary structures
M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 124–132, 2003. c Springer-Verlag Berlin Heidelberg 2003
Binary Arithmetic for DNA Computers
125
- strands (including the correct one ) annealing results in a structure which can be interpreted according to the type of the operation. In case of arithmetic operation, in later stages of computation, they add all possible intermediate results and successively propagate carry from the lowest weighted bit to the highest weighted bit. Though the encoding works well with logic operations, it does not seem to be so easy for the arithmetic operation as the technique requires that all the possible intermediate results be coded and added manually one by one during processing. This is a labor intensive and time consuming job. Other later attempts are due to Z. Frank Qiu and Mi Lu [16], which use substitution operation to insert results (by encoding all possible outputs of bit by bit operation along with second operand) in the operand strands. Though they propose to extend their method to higher radix like octal, decimal etc; the possible number of encoding of different intermediate results seems to be exponential. Moreover, the cleansing operation which makes the output similar to first input, for reuse in further operations, is not an error resistant operation. Ogihara, Ray and Amos, Dunne [15,1] present methods to realize Boolean circuits (with bounded fan-in) using DNA strands in a constructive fashion. Here the problem is that of constructing large Boolean circuits for arithmetic operations, (manually or automating the process) rendering the technique of theoretical importance only. Other new suggestions to perform all basic arithmetic operations are by Atanasiu [4] using P systems, and by Frisco [9] using splicing operation under general H systems, and by Hubert and Schuler [13] In the present article, we describe a simple, new and efficient recursive DNA computing technique for basic arithmetic operations like addition, multiplication and subtraction of binary numbers, based upon their set representations. The salient features of our technique are the following. 1. Our method is fully procedural i.e., the structure of the output strands is exactly similar to that of the input strands. Thus the result can be further reused without any changes, making iterative as well as parallel operations feasible. 2. The number of different DNA strands required is at most of the order of size of the binary number. That means it avoids the problem of increasing volume. 3. The number of bio-steps required by the technique for addition is, on the average, O(log2 n) and for multiplication it is O((log2 n)2 ), where n is the size of the binary numbers. 4. All logical operations on binary numbers can be performed very easily using our method.
126
2
Rana Barua and Janardan Misra
Recursive DNA Arithmetic
2.1
Underlying Mathematical Model
Let α = αn . . . α1 and β = βn . . . β1 be two n -bit binary numbers, where αi , βi ∈ {0, 1} for all 1 ≤ i ≤ n and α1 , β1 denote the less significant bits. Let X[α] = {i: αi = 1} and X[β] = {j: βj = 1}; i.e. they are the sets containing the positions where binary representation of these numbers sets bits to 1. For any set Z of integers and any integer i, we define Z + i = {z + i: z ∈ Z} and let Z + = Z + 1. For any two sets of integers X1 , X2 we define X1 ⊕ X2 = {x: x ∈ X1 ∪ X2 but x ∈ / X1 ∩ X2 } (symmetric dif f erence). We denote by V al(X) the binary number represented by set X (of positive integers); e.g. V al(X[α]) = α and V al(X[β]) = β and V al(φ) = 0. In terms of this symbolism we can state the abstract recursive procedures for addition and multiplication of the two given positive binary numbers as follows. Addition. Add(α, β) = V al(RecursiveAdd(X[α], X[β])); where RecursiveAdd(Y, Z) = Y if Z = φ = Z if Y = φ = RecursiveAdd((Y ⊕Z), (Y ∩Z)+ ); otherwise. It is easy to see that this procedure terminates and that for two binary numbers α, β, Add(α, β) represents α + β. This follows from the fact that α + β = α ⊕ β + 10 × (α ∧ β), where ⊕ denotes bitwise addition modulo 2 and ∧ bitwise multiplication.(Note that 10 above is the binary representation of 2.) Multiplication. The multiplication procedure can be realized, using successive additions of left shifted α’s, according to the following formula. α×β =
α × 2j−1 ,
1≤j≤n,bj =1
where we also use α etc. to denote the integer whose binary representation is α. Since multiplication of a binary number with power of 2, say 2j , is obtained by a left shift of the number by j, we have X[2j × α] = (X[α]) + j.
Binary Arithmetic for DNA Computers
127
Hence, we have Mul(α, β) = Add({V al(X[α] + (j − 1))}βj =1 ), where Add(α, β, γ) = Add(Add(α, β), γ) etc. Subtraction operation for integers can be performed as 2’s complement addition ([12] p 23). Division. Once we can perform addition and subtraction operation then mapping of division operation in terms of these can be done using any of the standard digital arithmetic techniques ([12] p 250). For instance we may consider nonrestoring division ([12] p 253) which requires an average of n additions or subtractions. 2.2
DNA Algorithm
Since the procedure described above is recursive in nature and as can be seen easily in context of currently available DNA tool - kit operations and other high level operations as suggested in [6], the most important operation to be realized is incrementing all the integers in the sets like X[α] by one. Actually the coding of numbers and various other steps basically rest upon the ease with which this step can be realized. Keeping this point in mind we propose the following DNA algorithm: DNA Encoding of Binary Numbers Note that each binary number is represented by a set of integers which are positions where bits are set to 1. Thus each binary number is represented as a test tube ( a multi set of strings over Γ = {A, C, G, T }) of DNA double strands encoding the integers ( positions where bit is set to 1) from 1 to n, such that the DNA strand for integer i is (cf. [5] for notation) dsi = S0 (GAAT T GC 5 )i GAAT T CS1 . ( Note that GAAT T C is the restriction site for EcoRI. ) Here S0 , S1 may be any suitable 20 to 30 base-pair long DNA double strand not containing GAAT T C as a substrand. (An alternate way of encoding position i, for minimizing errors due to sliding, is discussed later in section 2.5) Thus the test tube T [α] representing binary number α is T [α] = {dsi : i ∈ X[α]}. We first present the DNA-based implementation for addition. 1. Addition Step0. Check whether T [α] or T [β] is empty. If yes, then the other tube contains the final result (which can be obtained by detecting the presence of all different strands using gel electrophoresis or extraction technique).
128
Rana Barua and Janardan Misra
Else go to step 1. Initially T [α] and T [β] represent the test tubes encoding α and β respectively. Step1. Melt the double strands in test tubes T [α], T [β] to extract up-strands (using ↓ S0 ) from T [α] and down-strands (using ↑ S0 ) from T [β]. Now mix these two extracts so that complementary strands can get annealed to form stable double strands. As can be seen, the resulting double strands in the tube are exactly those coming from T [α] T [β] and single strands are those coming from T [α] − T [β] (up-strands containg ↑ S0 ) and from T [β] − T [α] (down-strands with ↓ S0 ). Using standard DNA toolkit operations, single strands can be separated from double strands and then, using PCR, the single strands can be complemented using S0 , S1 as primers. Denote by T [α] the tube containing these double strands obtained afterPCR (i.e. T [α] ⊕ T [β]) and by T [β] the annealed double strands (i.e. T [α] T [β]). Step2.(Increment by One). Add restriction enzyme EcoRI to T [β] to cut all the double strands at their 3 end. This restriction enzyme activity leaves double strands with 5 hanging ends, of the form S0 (GAAT T GC 5 )i G ↓ AAT T. Now up-strands ↑ AAT T GC 5 GAAT T C and ligation enzyme are added to the test tube which results in the strands of the form S0 (GAAT T GC 5 )i GAAT T ↑ GC 5 GAAT T CS1 . These strands can now be polymerased to form S0 (GAAT T GC 5 )i+1 GAAT T CS1 . Thus T [β] contains strands representing (X[α] X[β])+ . Step3. Go back to step0. 2. Multiplication Step1. For each j ∈ X[β], j ≥ 2, construct test - tubes Tj [α] similar to Step 2 above with the difference that for annealing we add ↑ AAT T GC 5 (GAAT T GC 5 )j−2 GAAT T CS1 instead of adding ↑ AAT T GC 5 GAAT T CS1 (add it when j = 2). For j = 1, take T1 [α] = T [α]. Step2. If the test tubes obtained in step1 are Tj1 [α], Tj2 [α], Tj3 [α] · · ·, do the following: Step2.1 Perform Addition operation (described above) concurrently with successive pairs of tubes (Tj1 [α], Tj2 [α]), (Tj3 [α], Tj4 [α]) · · · Let the result be kept in Tj11 [α], Tj12 [α], . . .. Step2.2 Repeat Step2.1 until a single tube T is obtained.
Binary Arithmetic for DNA Computers
129
3. Subtraction The subtraction operation can be done utilizing ideas from the conventional digital arithmetic, that is to say as per 2’s complement method. To perform α − β we do the following: Step0 By gel electrophoresis, determine whether α ≥ β or β ≥ α. Assume α ≥ β. Step1. Construct T [α], T [β] and T that consists of dsi for all i ∈ {1, . . . , n}. Step2. Obtain T1 = T − T [β] as described above in Addition operation or as a set extract operation described in [6]. Step3. Perform addition operation with T [α] and T1 and keep the result in T1 . Step4. Perform addition operation with T1 and T [1] (the latter consisting of only one type of DNA strands viz. S0 GAAT T GC 5 GAAT T C encoding position 1). Step5. Extract the DNA strands encoding n + 1. The residual test tube gives the desired result. 4. Logical operations method.
on binary strings can easily be performed by our
To obtain the bitwise OR of α and β form the test tubes T [α] and T [β] and mix them together. The resulting tube represents α OR β. To obtain bitwise XOR, construct T [α] ⊕ T [β] as in Step1 of Addition. The resulting tube represents α XOR β. The bitwise AND is obtained by forming T [α] T [β] as in Step1 of Addition using only set extract operations. To obtain the NAND of two n-bit strings α and β, simply construct the test tubes T [α], T [β] and the tube T consisting of strands encoding all the integers from 1, . . . , n. Then obtain the tube T representing T [α] T [β] as in Step1 of Addition. Now obtain T = T − T by set extraction as in [6]. T represents the desired result. 2.3
Use in Cryptography
Due to the simplicity of performing XOR (needing only constant number of biosteps), one can easily implement the Vernam one-time-pad (cf. [17]). Let α (in binary) be the plaintext and κ the random key of the same length as α. The random key can be constructed by randomly synthesising a strand consisting of two nucleotides, say A and G standing for 0 and 1 respectively. To encrypt, the sender constructs the test tube T = T [α] ⊕ T [κ] and transmits T . On receiving T , the receiver decrypts by constructing T = T ⊕ T [κ]. One can recover α from T by reading its contents. In view of the ease with which both encrypting and decryption can be carried out (using only a few extractions), we feel that our method is much simpler than what is proposed in Gehani, LaBean and Reif [10].
130
2.4
Rana Barua and Janardan Misra
Complexity Analysis
Time Complexity Addition. As each level of recursion in addition operation involves a fixed number of bio steps, therefore the total number of steps depends on the number of recursion levels in the abstract model. We shall compute the expected number of bio-steps for two random n-bit numbers α, β. Since the probability that at each position bit will be set to 1 (or 0) is 1/2, the expected number of 1’s in any randomly chosen binary number of length n are n/2. Similarly probability that at any position both the numbers set the bit to 1 is (1/2)×(1/2) = (1/4). Therefore, expected number of positionswhere both the numbers set bits to1 is n/4, which is the expected size of X[α] X[β] and consequently of (X[α] X[β])+ . Also, the probability that at any position both the numbers set bits differently is (1/2).(1/2) + (1/2).(1/2) = (1/2) so that the expected number of 1’s in α ⊕ β as n/2. This is same as the expected number of integers in X[α] ⊕ X[β]. Now for 2nd level of recursion, the probability that position number i is present in both the sets from the 1st step is (1/2) × (1/4) = (1/8). Hence, expected number of integers after set intersection and shifting by one is n/8; while expected number of integers in symmetric difference of the sets is n/2 since, probability that an integer is present in only one of the two sets is (1/2).(1/4) + (1/2).(3/4) = (1/2). Following the same argument, it can be seen that after ith level of recursion, the expected size of set resulting after set intersection and shifting will be n/2i+1 . Therefore, the expected number of recursion levels will be [log2 n] − 1. Thus the expected number of bio-steps needed in the addition operation is O(log2 n). Multiplication. In case of multiplication, the expected number of addition that has to be performed is (log n − 2). Hence the expected number of bio-steps will be O((log n)2 ). Subtraction. Since subtraction involves only two additions and a constant number of bio-steps, the expected number of bio-steps in this case is also O(log n). Logical Operations. Each logical operation needs a constant (at most 7 or 8) number of bio-steps and is independent of the size of the strings (except for preprocessing). Volume Complexity At no stage do we require some strand to be destroyed or filtered out. So the total number of strands remains more of less constant. 2.5
Errors
Errors in DNA computing experiments are of primary concern and the issue has been looked into by many researchers [7,2,3,8]. We shall consider the possible errors that may take place in the Addition algorithm. The first source of error is the extract operation which is not error-free. At the cost of more time and space, one may use compound extract instead of simple extract as explained in [8]. This could reduce the error to a tolerable level. A more serious source of error seems to be sliding or partial annealing [18] which could take place because of
Binary Arithmetic for DNA Computers
131
periodic nature of our coding. Partial annealing can be considerably reduced if one adopts the following coding. dsi = S0 B0 S1 C 5 B1 S1 C 5 ....Bi−1 S1 C 5 Bi S1 . One can then carry out Step2 of the Addition algorithm, using only extracts, by the method of [6] concurrently for all strands as follows. Heat the test tube and then extract upstrands ↑ S0 B0 S1 C 5 B1 S1 C 5 ....Bi−1 S1 C 5 Bi S1 using the downstrands ↓ S0 . Then add downstrands ↓ Bi S1 C 5 Bi+1 S1 , for all i < n. Annealing takes place to form strands of the form ↑ S0 B0 S1 C 5 B1 S1 C 5 ....Bi−1 S1 C 5 Bi S1 ↓ C 5 Bi+1 S1 . Polymerase will then yield complete double strands of the form S0 B0 S1 C 5 B1 S1 C 5 ....Bi−1 S1 C 5 Bi S1 C 5 Bi+1 S1 . Consequently, every strands dsi in the test tube will be replaced by dsi+1 . The remaining partially annealed or unannealed strands, if any, may be filtered out using extracts several times.
3
Conclusion
We have present methods for carrying out arithmetic and logical operations which can be easily implemented in the DNA computing paradigm, though we require one test tube for each binary number. Moreover, we have discussed ways of reducing errors by changing our codings and using only compound extract. This is, however, at the expense of more time and space. Since it is simple to perform XOR using only constant number of bio-steps, it has the potential for being used in cryptograhic implementation of Vernam one-time-pad. The potential use for DNA computers, however, depends on the efficiency of the bio-steps involved. Acknowledgement: The first author would like to thank Zhongwei Li of Dupont for many useful discussions that led to significant improvements.
References 1. M.Amos and P.E.Dunne, DNA Simulation of Boolean Circuits, Tech Report CTAG-97009, Dept of Computer Science, University of Liverpool, Dec 1997. 2. M.Amos, S.Wilson, D.A.Hodgson, G.Owenson and A.Gibbons, Practical Implementation of DNA Computation. In: Proc 1st International Conference of Unconventional Models of Computation, Aukland, N.Z., Jan 1998, pp 1-18. 3. Y.Aoi, T.Yoshinobu, K.Tanizawa, K.Kinoshita and H.Iwasaki, Ligation Errors in DNA Computing. In: Proc 4th DIMACS Workshop on DNA Based Computers, U Penn, 1998, pp 181-187.
132
Rana Barua and Janardan Misra 4. A.Atanasiu, Arithmetic with Membrames. In: Proc of the Workshop on Mutiset Processing, Curtea de Arges, Romania, Aug 2000, pp 1-17. 5. S.Biswas, A Note on DNA Representation of Binary Strings. In: Computing with Bio-Molecules. Theory and Experiments, Ed G.Paun, 1998, pp 153-157. 6. D.Boneh, C.Dunworth, R.Lipton and J.Sgall, On Computational Power of DNA, Princeton CS Tech Report No. CSTR49995, 1995. 7. D.Boneh, C.Dunworth, J.Sgall and R.Lipton, Making DNA Computers Error Resistant. In: Proc 2nd DIMACS Workshop on DNA Based Computers, Princeton, 1996, pp 102-110. 8. K.Chen and E.Winfree, Error Correction in DNA Computing: Misclassification and Strand Loss. Proc of the 5th DIMACS Workshop on DNA Based Computers, MIT, Cambridge, 1999, pp 49-63. 9. P.Frisco, Parallel Arithmetic with Splicing. Romanian Journal of Information Science and Technology, 3, 2000, pp 113-128. 10. A.Gehani, T.H.LaBean and J.H.Reif, DNA-based Cryptography, In: Proc of the 5th DIMACS Workshop on DNA Based Computers, MIT, Cambridge, 1999. 11. F.Guarneiri, M.Fliss and C.Bancroft, Making DNA Add. Science 273, 1996, pp 220-223. 12. J.P.Hayes, Computer Architecture and Organization. McGraw-Hill International, Singapore, 2nd ed. 1988. 13. H.Hug and R.Schuler, DNA Based Parallel Computation of Simple Arithmetic. In: Proc of 7th DIMACS Workshop on DNA Based Computers, Tampa, 2001, pp 159-166. 14. V.Gupta, S.Parthasarathy and M.J.Zaki, Arithmetic and Logic Operations with DNA. In:Proc of 3rd DIMACS Workshop on DNA Based Computers, U Penn 1997, pp 212-220. 15. M.Ogihara and A.Ray, Simulating Boolean Circuits on a DNA Computer. Tech Report TR631, Department of C.Sc., University of Rochester, Aug 1996. 16. Z.F.Qiu and M.Lu, Arithmetic and Logic Operations with DNA Computers, Proc of 2nd IASTED International Conference on Parallel and Distributed Computing and Networks, Brisbane, 1998, pp 481-486. 17. D.R.Stinson, Crypytography: Theory and Practice, CRC Press, Boca Raton, 1995. 18. M.Yamamoto, J.Yamashita, T.Shiba, T.Hirayama, S.Takiya, K.Suzuki, M.Munekata and A.Ohuchi, A Study on the Hybridization Process in DNA Computing, In: Proc of the 5th DIMACS Workshop on DNA Based Computers, MIT, Cambridge, 1999, pp101-110.
Implementation of a Random Walk Method for Solving 3-SAT on Circular DNA Molecules Hubert Hug1 and Rainer Schuler2 1
Universit¨ ats-Kinderklinik Ulm, Prittwitzstrasse 43, D-89075 Ulm, Germany Abt. Theoretische Informatik, Universit¨ at Ulm, D-89069 Ulm, Germany [email protected]
2
Abstract In a DNA computation a select operation is used to separate DNA molecules with different sequences. The implementation of the select operation requires specialized hardware and non-standard modification of DNA molecules by adding e.g., magnetic beads to a primer sequence or using other methods to separate DNA in solution. In this paper we consider DNA computations which use enzymatic reactions and secondary structure formation to perform computations. We show that it is possible to implement an efficient (exponential-time) probabilistic algorithm to solve instances of the satisfiability problem on circular single stranded DNA.
1
Introduction
It is generally accepted that NP-complete problems cannot be solved efficiently. The best known probabilistic algorithms for 3-SAT have an expected running time of p(n) · (4/3)n , where n is the number of variables and p is some polynomial [13,9]. Hence, the size of the instances which can be solved on a computer is bounded by some small constant. For example, if 1010 operations can be performed in a reasonable amount of time, the satisfiability problem can be decided for every 3-CNF formula with less than 80 variables (since (4/3)80 ≈ 1010 ). For every additional variable the number of steps increases by a factor of (4/3). In contrast, the trivial approach to solve the 3-SAT problem (which of course is more general and can be applied to solve the satisfiability problem for boolean formulas in general) considers all 2n different truth assignments. In this case the number of variables which can be used in a formula is bounded by 34 (since 234 > 1010 ). The more efficient heuristic allows us to more than double the number of variables of a formula, and this fact is independent of the current state of technology (see e.g., [3] for algorithms for other NP-complete problems). The advantage of DNA computing is the parallelism which can be exploited by the huge number of DNA molecules in a single probe. However, if we implement the trivial approach to solve the 3SAT problem and consider all possible assignments, much of the advantage of the parallel processing will be lost. For example, since the trivial approach requires 280 steps for 80 variables we need to perform 246 ≈ 1015 steps in parallel to beat the efficient algorithm on a single M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 133–142, 2003. c Springer-Verlag Berlin Heidelberg 2003
134
Hubert Hug and Rainer Schuler
processor. Here we assume a work efficient implementation and that at most 1010 ≈ 234 steps can be performed sequentially on each processor. Even if a DNA computer can handle 270 DNA molecules in a single test tube, we still need more than 1000 sequential reactions. A different aspect of DNA computations that we consider here is the number of physical separate operations. These operations are necessary to implement a selection step during a computation, e.g., to select all DNA molecules containing a specific sequence. The implementation [7] of the efficient algorithm for the 3-SAT problem mentioned above [13] uses n3 separate operations. In general an implementation of an efficient algorithm for an NP complete problem (compared to the trivial approach) requires for each iteration step of the algorithm, the separation of DNA molecules into several test tubes. Here the number of iterations corresponds to the length of a solution and the number of test tubes corresponds to the number of different extensions of a partial solution, e.g. the number of literals of a clause, or the number of edges leaving a node in a graph problem. The separation into different tubes is necessary since the extension step usually determines some property of the partial solutions (see e.g., [5,3]). In each separate operation there is some not too small probability that the actual solution may be lost. The probability depends on the reaction conditions and is error prone in particular if it is done manually. Even a quadratic number of such operations might be too large. Separate operations can be performed also with specialised hardware, e.g. micro-flow reactors [11]. In this paper we consider the satisfiability problem, which has been solved with DNA molecules on solid surfaces for small examples [10,14]. Here the search space, i.e., all possible assignments, are coded in the molecules attached to the surface. An alternative approach for solving a small instance of 3SAT uses DNA hairpin formation [12]. Very recently the satisfiability problem has been solved for a 20 variable 3CNF formula [4] after an exhaustive search of 220 possible assignments.
2
The Model
We consider computations performed in a test tube (i.e., in solution). Our goal is to use the more complex biochemical reactions to modify DNA molecules. In particular we want to avoid operations, e.g., extraction of marked molecules, which separate molecules according to the operations which have to be performed. In our model we use the following operations 1. Add nucleic acid molecules (DNA or RNA) of specific sequences with the following restrictions. The number of different molecules (sequences) should be small, e.g., linear in the input size. The total number of molecules is bounded by the size of the tube (270 ). If the number grows exponentially with the input size, then this gives a limit on the size of the instances. 2. Add enzymes (DNA polymerase, ligase, DNase, RNase, restriction enzymes) 3. Set reaction conditions (temperature, pH, salt concentrations)
Implementation of a Random Walk Method for Solving 3-SAT
135
4. Destroy enzymes and digest nucleic acid molecules 5. Combine contents of several test tubes A striking example that a computation is possible without separation steps during computation was given by Sakamoto et al [12] to solve instances of the 3-SAT problem. Here, DNA molecules code for consistent assignments to the n variables of the formula. For a growing number of clauses each DNA molecule contains a (short) subsequence indicating which variable of each clause should be set to 0 or 1 (to satisfy the clause). If a contradicting assignment is chosen, then the molecule will form an intramolecular hairpin, and the double stranded (part of the) molecule will be cut by a restriction enzyme. Both the assembling of the DNA molecules (by hybridization) and the digestion by restriction enzymes can be done without separation of the DNA molecules (according to sequence). Unfortunately, at least from a theoretical point of view, the algorithm implemented and verified by experiments is not efficient. The molecules coding for a solution will contain a literal of each clause. If m is the number of clauses then the search space, and hence the number of molecules, is 3m . Typically the number of clauses is larger than the number of variables and can be as large as m = n3 = θ(n3 ). In the next section we give an implementation of the trivial 2n -time algorithm for the 3-SAT problem using our model. The implementation is then modified to implement the more efficient algorithm from [13].
3
Implementation of the 2n Time Algorithm for the Satisfiability Problem of CNF Formulas
A formula F is in conjunctive normal form, if it is the conjunction of a set of clauses. Each clause contains a set of literals, i.e., variables and negated variables. A variable can be set to 1 (true) or 0 (false) and any function which assigns a value to each variable is called a truth assignment. Given an assignment, a clause is said to be true if it contains a variable which is set to 1 or a negated variable which is set to 0. A formula in conjunctive normal form is true if every clause is true. A formula F is called satisfiable, if there exists an assignment a such that F is true. In this case a is called satisfying assignment. The satisfiability problem is to decide whether a given formula is satisfiable. The task to find such an assignment is the corresponding search problem. A formula F is in 3-CNF if every clause contains 3 literals. The 3-SAT problem is to decide whether a formula in 3-CNF is satisfiable. The trivial algorithm to check whether a formula F is satisfiable considers all assignments. Let n denote the number of variables of F , then there are 2n different assignments. For every assignment and every clause C of F we test whether C is true. If a satisfying assignment is found, then F is satisfiable, otherwise F is unsatisfiable. Note that given an assignment a it is easy to check for all clauses C whether C (and hence F ) is true.
136
3.1
Hubert Hug and Rainer Schuler
First Method
Our implementation on a DNA computer is in two steps. First we create a set of oligonucleotides which code for all assignments. The oligonucleotide sequences are selected such that cross hybridization is minimal [8]. For each variable a we choose a sequence coding for variable a set to 1, denoted by a, and a sequence coding for variable a set to 0, denoted by ¬a. An assignment contains for each variable a either sequence a or sequence ¬a. Note that we use a to denote the reverse complementary sequence of a (see Figure 1). The second step is repeated for every clause. In this step the oligonucleotides which do not satisfy this clause are destroyed. This is done by selecting and protecting the assignments which satisfy the clause, i.e. contain some literal of the clause. The complexity of the second step is independent of the number of variables and clauses. In the second implementation the complexity grows linearly with the number of literals per clause (which is constant in the case of 3SAT). The space complexity is (polynomial) in 2n and the time complexity (number of iterations) is linear in m the number of clauses. Implementation For each literal we assign a DNA sequence of approximately 20 bp. We synthesize oligonucleotides for every possible assignment. The 3’ end of all oligonucleotides contains the same sequence (adaptor sequence) of approximately 50 bp. The oligonucleotides can be assembled from oligonucleotides coding for the literals. Adaptor oligonucleotides consisting of reverse complementary sequence of the beginning of a literal and the reverse complementary sequence of the end of the previous literal and the oligonucleotides coding for the literals are put into solution. The oligonucleotides hybridize and are then ligated. In this way oligonucleotides coding for all possible assignments can be obtained [1]. For each clause oligonucleotides are synthesized. The sequence of the oligonucleotides contains sequences of all the literals which occur in the clause and the reverse complementary 50 bp adaptor sequence at the 5’ end. The oligonucleotides are hybridized with oligonucleotides containing reverse complementary sequences. The double stranded DNA is now amplified by the polymerase chain reaction (PCR) with primers containing 5’ and 3’ topoisomerase attachment sites (Invitrogen, USA). Then DNA sequences containing promoters for RNA polymerases (e. g. T7 promoter and T3 promoter, Invitrogen) are attached by the ligase activity of topoisomerase I (Invitrogen). The resulting DNAs are again amplified by PCR with promoter element specific primers. RNA consisting of the sequences for the clauses in now synthesized by in vitro translation (Invitrogen). Now the clauses are ready for use in the DNA computer. The DNA oligonucleotides coding for the assignments are now hybridized to the RNA molecule coding for the first clause (Fig. 1). The temperature has to be above the melting temperature for the literal sequences. The 3’ end of the DNA is elongated with reverse transcriptase. The RNA is then removed with RNase H. RNase H digests RNA in a DNA-RNA heteroduplex [2]. If necessary, unhybridized RNA molecules could be removed by RNase A. A hybridization
Implementation of a Random Walk Method for Solving 3-SAT
137
temperature that allows for hairpin formation is now used. Only molecules that contain a literal and the reverse complement of the literal form a hairpin structure (Fig. 1). We then use exonuclease I from E. coli (Epicentre Technologies, USA, Biozym Diagnostik GmbH). Exonuclease I is a single strand-specific exonuclease that digests DNA in a 3’ to 5’ direction. It requires Mg2+ and a free 3’ hydroxyl terminus. After denaturation only solutions for the clause under investigation remain intact. The solutions are separated from the pieces of attached clauses by hybridizing a short reverse complementary adaptor sequence (Fig. 1).The 3’ overlapping single stranded DNA sequence is again degraded with exonuclease I and the short oligonucleotide is removed by denaturation. (The short oligonucleotide will be degraded in the cycle for the following clause.) Then the solutions are ready for the hybridization with the next clause sequence. The readout is by DNA sequencing [1]. Instaed of RNA, the clauses could also consist of DNA. Corresponding oligonucleotides would then code for the clause sequences and the adopter sequence with the restriction endonuclease recognition site at the 3’ end. Either the 5’ or the 3’ end are biotinylated. After hybridization of the oligonucleotides coding for the solution with the oligonucleotide coding for the clause the free 3’ ends are extended with a DNA polymerase. Double stranded DNA is denatured and the strands containing the clause sequences and the biotin are removed with a magnet [1]. 3.2
Second Method
An alternative implementation uses each literal of a clause for hybridization to the solutions instead of the whole clause. Again, the literals consist of RNA (Fig. 2). In the i-th iteration of step two we add the molecules of clause i. These molecules consist of adaptor sequence A and the reverse complementary sequence of one of the literals of clause i. After hybridization, the 3’ end of the DNA is elongated as described in section 3.1. DNA molecules which contain the sequence of the attached literal will form an intramolecular hairpin (Fig. 2). The double stranded portion (stem) of the hairpin protects from digestion by exonuclease I. Removal of the attached literal is as described in section 3.1. We observe that in each step approximately 2/3 of the DNA coding for assignments that satisfy the clause migth be lost since in the worst-case only one of the literals of the clause will be present in the assignment. After each cycle, the remaining DNA can be amplified by linear PCR (only one of the primers is added).
4
A Probabilistic Algorithm for 3-SAT
The best known (worst-case) probabilistic algorithms for the 3-SAT problem use the following strategy. First guess an assignment a by choosing a truth value from 0 or 1 for each variable independently with probability 1/2. Then repeat the following step 3n times, where n is the number of variables. Take any clause
138
Hubert Hug and Rainer Schuler
that is not true, choose one of the literals (with probability 1/3) and flip its truth value in a. The probability that a satisfying assignment is found is (3/4)n , i.e., the expected number of (independent) restarts of the algorithm needed to find a satisfying assignment is (4/3)n [13]. We give an implementation of the method using intramolecular hairpin formation. We note that the particular secondary structure we predict seems possible but has to be verified experimentally. A different implementation was proposed in [7] which uses separation of molecules according to the operations to be performed. Our implementation is in two steps. In a first step we prepare a set of oligonucleotides coding for a random subset of the possible assignments. The number of assignments can in fact be smaller than (4/3)n , provided that the number of copies is large, e.g., 1.2n different assignments are sufficient [6]. The DNA coding for an assignment forms a circle (Fig. 3). Single stranded circular DNA can be prepared from bacteriophage M13 [2] or the pBluescript System (Stratagene,USA) can be used. For each clause C = {l1 , l2 , l3 } we prepare oligonucleotides containing the reverse complementary sequences of the negated literals (Fig. 3). Between the base pairs coding for the negated literals we prepare a recognition sequence for a restriction endonuclease (RE e.g., BamH1). To be able to cut any of the three literals we prepare three different oligonucleotides for each clause by shifting the literals by 1, i.e., ¬l1 RE ¬l2 RE ¬l3 , ¬l2 RE ¬l3 RE ¬l1 , and ¬l3 RE ¬l1 RE ¬l2 . We note that, all three parts of the oligonucleotides can bind to the appropriate reverse complementary part of the circular molecules coding for assignments that do not satisfy the clause C. We have to set the hybridization conditions (and possibly further enzymatic reactions) such that clauses which are satisfied by the assignment (and have maximal 2 reverse complementary parts) do not hybridize. One of the three literals is cut by an restriction enzyme and (reverse complementary) sequences for all negated literals (of the clause) with appropriate overlapping parts are added. The 3’ end of the these oligonucleotides are blocked in order that they cannot be elongated by DNA polymerase (ThermoHybaid, Ulm, Germany). The oligonucleotide coding for the negated literal will hybridize. The DNA is then treated with DNA polymerase followed by T4 DNA ligase. The complex is denatured and the result is a closed single stranded DNA circle with one literal replaced by the negated literal (Fig. 3). The space complexity is of order (4/3)n . The initial set of oligonucleotides can be implemented by a random assembly of literals li , li+1 , where li is the oligonucleotide (sequence) coding for the i-th variable or the negation of the i-th variable. The second step (the modification of the molecules, Fig. 3) is iterated 3n times. In each iteration all clauses have to be considered. If we consider the clauses sequentially the time complexity will be m · n.
¬c
Add next clause
Exonuclease I, Denaturation
Exonuclease I, Denaturation
Hybridize short adapteroligonucleotide
b a 5´
No hairpin:
¬b
c
Allow for hairpin formation
¬b a
¬a c
b
¬a c
3´
¬c
a
c
b
b
b
a
a
a
b a
Hairpin:
b a 5´
b DNA: RNA:
5´
a
5´
c
c
3´
b
b
c
¬a
¬a
b
b
¬c
Rnase H
¬c b ¬a
¬a
b ¬a c
c ¬b a 5´
¬c b ¬a
Reverse transcriptase
¬c b ¬a
¬c
¬c 3´
¬a
¬a
b
b
¬c
¬c b ¬a 3´
c ¬b a 5´ 3´
c
139
3´
Solutions Clause
Implementation of a Random Walk Method for Solving 3-SAT
Figure 1: Steps for the selection of correct solutions. As an example two solutions, consisting of DNA with the adaptor sequence, out of a set of 23 possible solutions are given. The clauses consist of in vitro transcribed RNA and hybridize via the adaptor sequence. One clause sequence is added in each cycle. The reactions are explained in the text. Letters describe literals. Lines above letters mark reverse complementary sequences of the literals. Thick bars represent sequences for literals, thinner bars adaptor sequences. All sequences are given in the 5’ to 3’ direction.
140
Hubert Hug and Rainer Schuler
DNA: RNA:
5´
a
d
¬c
b
Solutions Literal
3´
5´
b
a
b
¬c
d
a
b
¬c
d
3´ 5´
c
3´
¬d Reverse transcriptase, Rnase H
5´
5´
5´
a
b
¬c
d
b
a
b
¬c
d
c
a
b
¬c
d
¬d
3´
3´
3´
Allow for hairpin fomation
¬c a
5´
Hairpin:
d
b 3´
b
No hairpin:
a
5´
a
5´
b
¬c
d
c
b
¬c
d
¬d
3´
3´
Exonuclease I, Denaturation
5´
a
d
¬c
b
b
3´
Hybridize short adapter oligonucleotide
a
5´
d
¬c
b
b
3´
Exonuclease I, Denaturation
5´
a
b
¬c
d
3´
Add next clause
Figure 2: An alternative strategy for the selection of correct solutions.
Implementation of a Random Walk Method for Solving 3-SAT
a
Solutions:
h
Clause:
b
(¬a v ¬d v ¬f)
g
c
141
Synthesize
f
5´
a
d
f
3´
e
d
Hybridize g b c e d a f h
5´
3´
a
f
d
Remove d by restriction cutting and then denature g h b c e a f Hybridize reverse complementar
a
h
b
g
c
f 3´
c
e ¬d
a
3´-block
e DNA polymerase T4 DNA ligase Denaturation
h
b
g
c
f ¬d
e
Figure 3: Substitution of a literal d in a circular single stranded DNA molecule containing an assignment by the negated literal ¬d. Letters a to h represent literals. The reverse complement of a literal x is denoted by x. The negation of x is denoted by ¬x.
142
Hubert Hug and Rainer Schuler
It is possible to consider the oligonucleotides of all clauses simultaneously. In this case the time complexity is 3n. We note that circular molecules might get cut into several pieces, if more than one clause is not satisfied by the assignment and the corresponding oligonucleotides hybridize simultaneously. However we believe that the loss due to such events will be very small since simultaneous hybridization of the oligonucleotides should be unlikely.
References 1. L.M. Adleman. Molecular computation of solutions to combinatorial problems. Science, 266:1021–1024, 1994. 2. F.M. Ausubel, R. Brent, R.E. Kingston, D.D. Moore, J.G. Seidman, J.A. Smith, and K. Struhl, editors. Current Protocols in Molecular Biology. Wiley and Sons, 2001. 3. E. Bach, A. Condon, E. Glaser, and C. Tanguay. DNA models and algorithms for NP-complete problems. In Proc. of 11th Conference on Computational Complexity, pages 290–299. IEEE Computer Society Press, 1996. 4. R.S. Braich, N. Chelyapof, C. Johnson, P.W.K. Rothemund, and L.M. Adleman. Solution of a 20-variable 3-SAT problem on a DNA computer. Science, 96:478–479, 2002. 5. K. Chen and V. Ramachandran. A space-efficient randomized DNA algorithm for k-sat. In A. Condon, editor, Sixth International Workshop on DNA-based Computers, volume 2054 of LNCS. Springer-Verlag, 2001. 6. E. Dantsin, A. Goerdt, Hirsch E.A., R. Kannan, J. Kleinberg, C. Papadimitriu, P. Raghavan, and U. Sch¨ oning. Deterministic local search decides k-SAT in time (2 − 2/(k + 1))n . TCS, in press, 2002. 7. S. Diaz, J. L. Esteban, and M. A Ogihara. A DNA-based random walk method for solving k-sat. In A. Condon, editor, Sixth International Workshop on DNA-based Computers, volume 2504 of LNCS. Springer-Verlag, 2001. 8. A. G. Frutos, Q. Liu, A. J. Thiel, A. M. Sanner, A. E. Condon., L. M. Smith, and R. M. Corn. Demonstration of a word design strategy for DNA computing on surfaces. Nucleic Acids Res, 25(23):4748–4757, 1997. 9. T. Hofmeister, U. Sch¨ oning, R. Schuler, and O. Watanabe. A probabilistic 3-SAT algorithm further improved. In Proceedings 19th Symposium on Theoretical Aspects of Computer Science, volume 2285 of LNCS, pages 192–203. Springer-Verlag, 2002. 10. Q. Liu, L. Wang, A. G. Frutos, A. E. Condon, R. M. Corn, and L. M. Smith. DNA computing on surfaces. Nature, 403:175–179, 2000. 11. J. S. McCaskill. Optically programming DNA computing in microflow reactors. Biosystems, 59:125–138, 2001. 12. K. Sakamoto, H. Gouzu, K. Komiya, D. Kiga, S. Yokoyama, T. Yokomori, and M. Hagiya. Molecular computation by DNA hairpin formation. Science, 288:1223– 1226, 2000. 13. U. Sch¨ oning. A probabilistic algorithm for k-SAT and constraint satisfaction problems. In Porc. 40th FOCS, pages 410–414. ACM, 1999. 14. L. Wang, J. G. Hall, M. Lu, Q Liu, and L. M. Smith. A DNA computing readout operation based on structure-specific cleavage. Nature Biotech., 19:1053–1059, 2001.
Version Space Learning with DNA Molecules Hee-Woong Lim1 , Ji-Eun Yun1 , Hae-Man Jang2 , Young-Gyu Chai2 , Suk-In Yoo1 , and Byoung-Tak Zhang1 1
Biointelligence Laboratory School of Computer Science and Engineering Seoul National University, Seoul 151-742, Korea 2 Department of Biochemistry and Molecular Biology Han-Yang University, Ansan, Kyongki-do 425-791, Korea {hwlim,jeyun,hmjang,ygchai,siyoo,btzhang}@bi.snu.ac.kr
Abstract. Version space is used in inductive concept learning to represent the hypothesis space where the goal concept is expressed as a conjunction of attribute values. The size of the version space increases exponentially with the number of attributes. We present an efficient method for representing the version space with DNA molecules and demonstrate its effectiveness by experimental results. Primitive operations to maintain a version space are derived and their DNA implementations are described. We also propose a novel method for robust decision-making that exploits the huge number of DNA molecules representing the version space.
1
Introduction
Learning can be formulated as a search for a hypothesis in the space of possible hypotheses that are consistent with the training examples. Version space learning was proposed as a method for representing the hypothesis space [7]. It maintains the general boundary and the specific boundary to represent the consistent hypotheses consisting of conjunctions of attribute values. However, Haussler [4] shows that the size of the boundaries can increase exponentially in some cases. Hirsh [6] shows that if the consistency problem, i.e. whether there exists a hypothesis in the hypothesis space that is consistent with the example, is tractable, the boundaries are not needed and new examples can be classified only by positive examples and negative examples. In this paper, we present a DNA computing method that implements the version space learning without maintaining boundary sets. We exploit the huge number of DNA molecules to maintain and search the version space. To use the massive parallelism of DNA molecules efficiently, the encoding scheme is important. Therefore, we present an efficient and reliable method to express the hypothesis in the version space. In proposed encoding scheme, the number of necessary sequences increases linearly, not exponentially, with the number of attributes. We verify the reliability of this encoding scheme by bio-lab experiments. We also show that the version space learning can be reduced to two primitive set M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 143–155, 2003. c Springer-Verlag Berlin Heidelberg 2003
144
Hee-Woong Lim et al.
operations of intersection and difference. Experimental methods are described for these primitive operations as well as for predicting the classification of new examples. And some experimental results to verify these method are presented. Our work is related with Sakakibara [9] and Hagiya et al. [3] in the sense that they try to learn a concept of predefined form from training examples and adopt the general framework of generate-all-solution and search, like in Adleman [1]. Sakakibara suggested a method to express k-term DNF with DNA molecules, to evaluate it, and to learn a consistent k-term DNF with the given examples. Hagiya et al. developed the method to evaluate µ-formula and to learn consistent µ-formula with whiplash PCR. This paper is organized as follows. In Section 2, it is shown that the process of maintaining a version space can be formulated as a set operation and that the version space learning can be performed by two primitive set operations. Section 3 describes the method for version space learning with DNA molecules. In Section 4, the experimental results of these method are presented. Finally, the conclusion and future work are given in Section 5.
2
Version Space Learning as a Set Operation
An excellent description of version space learning can be found in [7]. Here we describe the basic terminology for our purposes. Attributes are features that are used to describe an object or concept. A hypothesis h is a set of restrictions on the attributes. Instance x is a set of attribute values that describe it and all attributes have its values. In this paper, we assume that an attribute takes binary values. For the purpose of illustrating, let us consider a concept: “An office that has recycling bin” in [2]. If all offices can be described by attributes, department (cs or ee), status (faculty or staff), and floor (four or five), “An office on the fourth floor belonging to a faculty” can be expressed as {status=faculty, floor =four}, or {faculty, four} in an abbreviated form. We define the version space VS as a set of hypotheses consistent with training examples. In this paper, this does not include the concept of general and specific boundaries. VS e denotes a version space for a single positive example e, i.e. a set of all hypotheses that classify an example e as positive. By above definition, an instance x is classified as positive by hypothesis h if and only if h ⊆ x. Therefore, a power set of instance x is equivalent to a set of hypotheses that classify the instance x as positive. In the case of above example, an instance {cs, faculty, four} is classified as positive by a hypothesis {faculty, four}, and is classified as negative by a hypothesis {faculty, five}. Version space learning can be viewed as a process that refines the version space by removing inconsistent hypotheses and searches as the training examples are observed (Fig. 1). Thus, this process can be reduced to the following set operations. If a positive example is given, we select all hypotheses that classify the example as positive in version space. In contrast, if a negative example is given, we eliminate all hypotheses that classify the example as positive in
Version Space Learning with DNA Molecules
145
the version space. Therefore, the version space learning can be performed by intersection and difference operations.
VS = Initial whole hypothesis space New Example e Repeat for every example
VSe = Power_Set( e) e is positive? No Yes
VS = VS + VS e
VS = VS - VSe
Fig. 1. Procedure for maintaining a version space
3 3.1
DNA Implementation Encoding
Basically, a hypothesis is represented as a single strand, and the strand is composed by ligation of the sequences that correspond to the attribute values. When generating the initial hypothesis space, double strands with sticky ends are used for conjunctions of attribute values. The difference of the sticky ends between the attributes determines the order of attribute values in the hypothesis, and in consequence, a hypothesis can take no more than one attribute value of the same kind of attribute. In addition to the attribute value strand, another double strand with a sticky end is used equivalently to encode the “don’t-care symbol” to make intersection and difference operations easy. The process to create the initial version space is as follows. At first, we put all the double strands with sticky ends, which correspond to each attribute values, into a test tube and let them hybridize each other. Next, ligation is performed to make the conjunctions of attribute values. Finally, after extracting single strands that we want, the initial version space is completed. This extraction of single strands can be done by affinity separation with magnetic beads (Fig. 2). By this process, we can generate all the possible hypotheses and the length of each hypothesis is all the same. The advantage of this encoding method is that the number of sequences that is needed is the number of attribute values + the number of attributes and it increases linearly, not exponentially, with the number of attributes. And by concatenating another common strand to the first attribute and the last attribute for primer, we can easily amplify the version space with PCR.
146
Hee-Woong Lim et al.
cs
faculty
ee
four
staff
five
? status
? floor
cs
faculty
four
cs
faculty
five
cs
faculty
?
cs
staff
four
...
? dept
cs
?
?
...
ee
faculty
?
...
Primer ee
?
?
...
Sticky End ?
?
?
Fig. 2. All attribute strands are put into a test tube, and they are hybridized and ligated. This generates all possible hypothesis strands. “?a ” denotes the “don’t-care symbol” for attribute a
In addition to the above encoding scheme, we can also use the Adleman [1] style encoding scheme. Assume that an attribute value corresponds to a city in the Hamiltonian path problem, and the conjunction of two attribute values corresponds to the road that connects two cities. Then we can make an order of attribute values and restrict the ligation of the attribute values by the existence of an edge strand. The graphs below show two possible directed assembly graphs. Graph (a) in Fig. 3 encodes “don’t care symbol” with the absence of attribute value. So, the length of the hypothesis strands is variable. Graph (b) in Fig. 3 encodes “don’t-care symbol” with another DNA strand like an attribute value. In this case, the length of hypothesis strand is fixed.
( a)
cs
ee
( b)
four
faculty
staff
cs
faculty
four
ee
staff
five
? dept
? status
? floor
five
Fig. 3. Two possible directed assembly graphs to encode the hypotheses.
However, the number of the necessary strands is the number of nodes plus the number of edges in the graph, and it increases exponentially with the number of attribute values. So, this encoding scheme is infeasible.
Version Space Learning with DNA Molecules
147
We use the first encoding method by considering the number of needed strands and the implementation of intersection and difference operation. 3.2
Primitive Operations
Basically, an affinity separation with magnetic beads is used to perform the set intersection and difference that are the primitive operations to maintain the version space, and all separations are positive selections. We designed an experiment that does not need the power set of the examples explicitly, but uses only the individual attribute values separately. To do this, magnetic beads with DNA single strands are needed and the number of the beads is the same as the number of attribute values including “don’t-care symbol”. In the example described in Section 2, there are nine kinds of bead. Intersection In case of a positive example, we should select the hypotheses that are composed of the example attribute values and “don’t-care symbol”. Therefore, affinity separation with beads that have the attribute values or “don’tcare symbol” must be performed by the order of each attribute. For example, if the positive input example is , the hypotheses that must be selected are as follows: , , faculty, four>, , , , , faculty, ?>, , ?, four>, , ?, ?>. To obtain theses hypotheses, at first, an affinity separation with the beads “cs” and “?department ” is performed simultaneously, and we select all the DNA strands that are hybridized with magnetic beads. And then with the beads “faculty” and “?status ”, and, finally, with the beads “four” and “?f loor ” (Fig. 4).
Fig. 4. Intersection operation for a positive example {cs, faculty, four}. DNA strands that are hybridized with beads are selected step by step.
When the number of attributes increases, the experimental process may be complicated because the affinity separation must be performed as many times as
148
Hee-Woong Lim et al.
the number of attributes. However, the experimental step increases only linearly with the number of attributes. Difference Because a difference operation is equivalent to the selection of the hypotheses that are not elements of the intersection set, we can consider the hypotheses that are not selected by the intersection operation, as the result of difference operation. However, because of the reversibility of the chemical processes involved in our experiments, there can be remaining molecules that are not selected even though they are elements of the intersection set. So, choosing the rest of the intersection as difference can be a primary factor of error. Therefore, difference operation must be performed through affinity separation, e.g. using the beads that are not used in intersection. In difference operation, the beads that are different kinds of attribute can be used simultaneously. For example, if the negative example is , we must select the hypotheses whose department is “ee”, status is “staff”, or floor is “five”. To get such hypotheses, the beads “ee”, “staff” and “five” can be used to perform affinity separation. And all DNA strands that are hybridized with one or more of the three beads are selected (Fig. 5).
Fig. 5. Difference operation for a negative example {cs, faculty, four}. The beads are used simultaneously and the DNA strands that are hybridized with beads are selected.
3.3
Classification
So far, the method to maintain the version space for observed examples is presented. The question now to ask is: How to use this version space? How to classify new examples? There are various ways to classify new examples using current version space [7]. On the one hand, the version space classifies the new example as positive if it has at least one hypothesis that classifies the example
Version Space Learning with DNA Molecules
149
as positive, and classifies it as negative when there are none. On the other hand, version space can use a majority-voting method. In this case, the new example is classified as the majority of hypotheses in the version space decide. In this paper the latter method is implemented as follows. First, we divide the solution into two parts with an equal volume. And then in one tube, we perform intersection operation with the new example, and in the other tube, we perform difference operation. Now, assuming that the mass of each hypothesis strand is fixed and the distribution is uniform, we can classify the example to the part that has the more DNA molecules. That is to say, if the tube of intersection has more intensity, then we classify the new example as positive, otherwise as negative. To compare the intensity of hypothesis molecules, we can use gel-electrophoresis or fluorescence. If one tube has more DNA molecules, the band in gel-electrophoresis will be thicker, or the intensity of fluorescence will be stronger (Fig. 6).
intersection
A A B
difference
This example is negative!
B
Fig. 6. Classification process. The intersection and difference are performed respectively. The remaining molecules are compared by the fluorescence intensity of DNA molecules. Then, the majority part is selected.
4 4.1
Experimental Results on Hypothesis Space Generation Sequence Design and Generation of Initial Version Space
To solve the example in Section 2, we needed to design nine DNA sequences for nine attribute values, and two DNA sequences for two sticky ends. We used the sequence generator NACST/Seq [10] to design the DNA sequences for experiment. When generating, we restricted the Tm and GC contents so that all sequences have a similar probability to hybridize and the distribution of hypothesis is uniform. Similarity and H-measure are considered to prevent cross hybridization. The designed sequences are given in Table 1. We used the right half of sequence no. 7, and the left half of sequence no. 11 as sticky ends, and used the rests as attribute values, because the similarity between no. 7 and no. 11 was low. All 18 sequences that were used in the experiment are shown in Table 2.
150
Hee-Woong Lim et al.
Table 1. Sequences that are designed by the sequence generator [10] 1 2 3 4 5 6 7 8 9 10 11
Sequence CTCCGTCGAATTAGCTCTAA AGTCAGTTGGTGACCGCAGA GCATATCAGGCGAGTAGGTG ACAAGGGCTCAGAACCAATG CAGTACTCGGTTTCCGCTAA CGTATGCGCATCCGTTTCAT TTCTTGTGTACAACCGCGGC ATCATGTAGGAACTGTCGCA ACTCCGTATCGGGTAGCTTT GGAGTTGACACTATCGTCGT ATAGCCTCGA GGGACGAATA
Tm(◦ C) GC% 57.17 61.13 61.85 60.07 59.10 62.07 62.44 59.43 60.00 58.82 61.23
45 55 55 50 50 50 55 45 50 50 50
Table 2. DNA strands that are used in the experiment. Primer
Tm(◦ C)
Sequence
cs
5’- CTCCG TCGAA TTAGC TCTAA ATAGC CTCGA -3’ 3’- GAGGC AGCTT AATCG AGATT -5’
65.2 48.9
ee
5’- ACAAG GGCTC AGAAC CAATG ATAGC CTCGA -3’ 3’- TGTTC CCGAG TCTTG GTTAC -5’
69.3 53.7
5’- ATCAT GTAGG AACTG TCGCA ATAGC CTCGA -3’
66.9
3’- TAGTA CATCC TTGAC AGCGT -5’
50.0
?dept
faculty
5’-
AGTCA GTTGG TGACC GCAGA CAACC GCGGC -3’
3’- TATCG GAGCT TCAGT CAACC ACTGG CGTCT staff
?status
- 5’
5’CAGTA CTCGG TTTCC GCTAA CAACC GCGGC -3’ 3’- TATCG GAGCT GTCAT GAGCC AAAGG CGATT - 5’ 5’-
ACTCC GTATC GGGTA GCTTT CAACC GCGGC -3’
3’- TATCG GAGCT TGAGG CATAG CCCAT CGAAA
- 5’
77.1 70.3 73.7 66.9 74.0 66.9
four
5’- GCATA TCAGG CGAGT AGGTG -3’ 3’- GTTGG CGCCG CGTAT AGTCC GCTCA TCCAC -5’
52.0 76.5
five
5’- CGTAT GCGCA TCCGT TTCAT -3’ 3’- GTTGG CGCCG GCATA CGCGT AGGCA AAGTA -5’
58.0 79.0
5’- GGAGT TGACA CTATC GTCGT -3’
48.5
3’- GTTGG CGCCG CCTCA ACTGT GATAG CAGCA -5’
75.2
?f loor
Version Space Learning with DNA Molecules
151
Each sequence was synthesized as a single strand by Bioneer Corporation (Tae-Jeon, Korea) and has been purified by PAGE and 5’ phosphorylated. a. Hybridization of Molecules First, all 18 single strands which were adjusted to 100 pmol were mixed with 10µ. Initial denaturation was performed at 95 ◦ C for 5 minutes and then it was cooled down to 16 ◦ C by the rate of 1 ◦ C per 1 cycle in iCycler thermal cycler (Bio-rad, USA). b. Ligation of Molecules Ligation was performed with T4 DNA ligase at 16 ◦ C overnight. The reaction buffer was 50 mM Tris-HCl (pH 7.8), 10 mM MgCl2 , 5 mM DTT, 1 mM ATP, and 2.5 µg/m BSA. c. Native Gel-electrophoresis (Confirmation) Ligation mixture was defined by 3 % native gel-electrophoresis. The running buffer consists of 40 mM Tris-acetate, 1 mM EDTA, and pH 8.0 (TAE). Gel was run on Bio-rad Model Power PAC 3000 electrophoresis unit at 60 W (6 V/cm), and constant power. We confirmed the generation of the initial version space by gel-electrophoresis. As a result, the band of double stranded 80 bp DNA (60 bp for three attribute values, 20 bp for two sticky ends) was generated (Fig. 7).
Fig. 7. Result of gel-electrophoresis for the version space generated. Lane 1 and 2: all 18 single strands were mixed simultaneously to generate initial version space. Lane 3 and 4: After the hybridization of two single strands for making double strands for attribute values respectively, the double strands were mixed.
152
Hee-Woong Lim et al.
4.2
Primitive Operation
And we also tested the affinity separation for primitive operation by PCR with different primers and gel-electrophoresis. a. Preparation of probe sequence with amino linker Nine probe sequences were synthesized by Koma biotech (Seoul. Korea) and each sequence is complement with the sequence of the attribute value. Each sequence contains a primary amino group at 5’ end to couple with the magnetic bead. It was concentrated to 200 pmol by ethanol precipitation method and resuspended by 100 µ of coupling buffer. b. Preparation of magnetic probe Magnetic bead system of CPG (USA) was used. It has a 15 ˚ A extension aliphatic arm terminating in an active primary amine. These magnetic bead were coupled with the modified probe sequences respectively. c. Separation with magnetic probe Affinity separation was performed with magnetic beads “ee”, “staff”, and “five” sequentially in 100 µ of initial version space. In other word, the hypothesis <ee, staff, four> was selected. In each separation, we performed hybridization for 2 hours at room temperature, removed supernatant magnetically and added 100 µ of pure water. Then we performed denaturation for 5 min at 95 ◦ C and separated the supernatant. d. Confirmation by PCR & Gel-electrophoresis The above supernatant product was amplified by PCR with different primer sets and the products were confirmed by Gel-electrophoresis. We used four different sets of primers. First, the correct primers “ee” and “five”, second, incorrect primers “?dept ” and “four”, third, incorrect primers “?dept ” and “?f loor ”, and the last, no primers. Each PCR was performed with 50 µM of each dNTP (Takara, Korea) and 5 U of Taq polymerase (Bioneer, Korea) in 10 mM. The reaction was cycled by 30 times in iCycler thermal cycler (Bio-rad, USA) using the following temperature and cycle times; 95 ◦ C 30 s, 58 ◦ C 2 min, and 72 ◦ C 1 min. And the PCR products were defined by 3 % native gel-electrophoresis with Tris HCl, pH 8.0, 50mM KCl, 2.5mM MgCl2 Fig. 8 shows that the amplification was performed well in case of the primer set, “ee” and “five”. Though we can see that some amplification was performed in second case and third case, the band in first case is lighter than the others. This means that the above separation product contains the hypothesis that begins with “ee” and ends with “five” rather than others. The second attribute can be confirmed by PCR with primer set, “ee” and “staff”, or “staff” and “five”. We also tested the possibility of the majority voting. The UV spectrophotometry and the luminescence spectrometry can be used to compare the number of hypotheses i.e. DNA molecules. We measured the signals of different concentration of DNA solution. In case of UV spectrophotometry, we used initial version space without any modification. Photometric assay was performed using spectrophotometer UV-1601 (SHIMADZU), and Fig. 9 shows the result. And
Version Space Learning with DNA Molecules
153
Fig. 8. Result of gel-electrophoresis of the PCR products. Lane 1: primers “ee” and “five”. Lane 2: primers “?dept ” and “four”. Lane 3: primers “?dept ” and “?f loor ”. Lane 4: no primers.
in case of luminescence spectrometry, in generating initial version space, we attached FITC at 5’ end of the third attributes “floor”. As a result, all hypotheses in version space had FITC at their 5’ end. Fluorescence signal was measured by luminescence spectrometer, SLM-AMINCO series 2 (AMINCO) at 520 nm excitation wave length. Fig. 10 shows the result. Considering that the X-axis is log scale, these results show that the values of UV spectrophotometry and luminescence spectrometry are proportional to the concentration of DNA solution. Therefore, it is possible to compare the number of hypotheses in two DNA solutions.
5
Conclusion
We proposed an experimental method to implement version space learning with DNA molecules. An efficient encoding scheme for representing version spaces is presented, where the number of necessary DNA molecules increases only linearly with the number of attribute values. We also showed that the version space learning is reduced to a set operation on hypothesis sets, and defined two primitive operations for maintaining version spaces. Simple experimental methods to maintain a version space were proposed, along with a method to predict the class of a new example with the current version space by majority voting. The number of experimental steps to perform primitive operations and to predict the new example increases only linearly with the number of attributes and the number of attribute values. We confirmed that hypothesis strands of correct length were generated by an experimental result, and tested the magnetic bead separation method for primitive operations in simple experimental process. And the possibility of the method to perform majority voting for prediction was shown.
154
Hee-Woong Lim et al.
Fig. 9. UV spectrophotometry
Fig. 10. Luminescence spectrometry using FITC
The more experimental verification of the methods for the primitive operations for version space maintenance and for prediction of new examples remains as future work. And the experimental verification must be performed by full learning process. The success of experiments depends on the accuracy of affinity separation using magnetic beads. However, this error of experimental process may make version space learning robust to the noisy training examples. Some theoretical and experimental work on this possibility is still necessary. Another point to consider is the case in which an attribute can have more than two val-
Version Space Learning with DNA Molecules
155
ues. In this case, it must be specified how the generalization should be performed [5]. Finally, because all experimental processes described in this paper need only affinity separation by magnetic beads, it seems very plausible that this learning process can be automated by the network of microreactor as described in [8].
Acknowledgement This research was supported in part by the Ministry of Education & Human Resources Development under the BK21-IT program, and the Ministry of Commerce, Industry and Energy through the Molecular Evolutionary Computing (MEC) project, and by the project, RIACT 04212000-0008. The RIACT at Seoul National University provides research facilities for this study.
References 1. L. M. Adleman: Computing with DNA, Scientific American, pages 34-41, August, 1998 2. T. Dean, J. Allen, and Y. Aloimonos: Artificial Intelligence, Addison-Wesley, 1995 3. M. Hagiya, M. Arita, D. Kiga, K. Sakamoto, S. Yokoyama: Towards parallel evaluation and learning of Boolean µ-formulas with molecules, DNA Based Computers III, DIMACS Series in Discrete Mathematics and Theoretical Computer Science, Vol. 48, pages 57-72, 1999 4. D. Haussler: Quantifying inductive bias: AI learning algorithms and Valiant’s learning framework, Artificial Intelligence, Vol. 36, pages 177-221, 1988 5. H. Hirsh: Generalizing version spaces, Machine Learning, Vol. 17(1), pages 5-45, Kluwer Academic Publishers, 1994 6. H. Hirsh, N. Mishra, L. Pitt: Version spaces without boundary sets, Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI97), pages 491-496, AAAI Press/MIT Press 1997 7. T. M. Mitchell: Machine Learning, McGraw-Hill, 1997 8. D. van Noort, F.-U. Gast, J. S. McCaskill: DNA computing in microreactors, In Proceedings of 7th International Meeting On DNA Based Computers, pages 128137, 2001 9. Y. Sakakibara: Solving computational learning problems of Boolean formulae on DNA computers, DNA Computing, Springer-Verlag, Heidelberg, pages 220-230, 2000 10. S.-Y. Shin, D.-M. Kim, I.-H. Lee, and B.-T. Zhang: Evolutionary sequence generation for reliable DNA computing, Proc. of Congress on Evolutionary Computation 2002, pages 79-84, 2002.
DNA Implementation of Theorem Proving with Resolution Refutation in Propositional Logic In-Hee Lee1 , Ji-Yoon Park2, Hae-Man Jang2 , Young-Gyu Chai2 , and Byoung-Tak Zhang1 1
Biointelligence Laboratory School of Computer Science and Engineering Seoul National University, Seoul 151-742, Korea 2 Department of Biochemistry and Molecular Biology Hanyang University, Ansan, Kyongki-do 425-791, Korea {ihlee,jypark,hmjang,ygchai,btzhang}@bi.snu.ac.kr
Abstract. Theorem proving is a classical AI problem having a broad range of applications. Since its complexity grows exponentially with the size of the problem, many researchers have proposed methods to parallelize the theorem proving process. Here, we use the massive parallelism of molecular reactions to implement parallel theorem provers. In particular, we show that the resolution refutation proof procedure can be naturally and efficiently implemented by DNA hybridization. Novel DNA encoding schemes, i.e. linear encoding and hairpin encoding, are presented and their effectiveness is verified by biochemical experiments.
1
Introduction
DNA computing is famous for its power of massive parallelism. Since Adleman’s first experiment [1], many researchers utilized parallel reactions of DNA molecules to solve hard computational problems [3,7,18]. Recently, several research groups have proposed DNA computing methods for logical reasoning [6,10,16,17]. Theorem proving is a method for logical reasoning and has a variety of applications, including diagnosis and decision making [8,11]. Resolution refutation is a general technique to prove a theorem given a set of axioms and rules. But theorem proving by resolution refutation has a difficulty in practice. If the goal becomes complex or the number of axioms gets large, the time for theorem proving grows exponentially. To overcome this drawback, parallel theorem provers have been proposed [5,9,15]. However, these parallel machines do not overcome the difficulties inherent to silicon-based technology. Wasiewicz et al. [17] describe an inference system using molecular computing. Their inference system is different from ours in that theirs does not use a resolution refutation technique. A resolution method for Horn clause computation was suggested in [6,16], but was not used for theorem proving. Mihalache proposed an implementation of Prolog interpreter with DNA molecules which is an important practical application of resolution refutation theorem proving M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 156–167, 2003. c Springer-Verlag Berlin Heidelberg 2003
DNA Implementation of Theorem Proving
157
[10]. But his suggestion is not physically feasible, because it requires too many experimental steps. Except for the inference system in [17], none of these was implemented in real bio-lab experiments. In this paper, we describe resolution refutation theorem proving methods using DNA, which are verified by experiments. We develop two different encoding methods for logical formulas, i.e. linear and hairpin encodings. These make use of the DNA hybridization reaction in a natural way to perform resolution refutation. Our implementation requires only a constant number of lab steps. The feasibility of the methods is confirmed by lab experiments. The rest of the paper is organized as follows. A brief introduction to theorem proving and resolution refutation is given in Section 2. Sections 3 and 4 describe the linear and hairpin implementation methods and their experimental results, respectively. Conclusions are drawn in Section 5.
2
Theorem Proving with Resolution Refutation
Theorem proving is a method for automated reasoning [8,11]. In theorem proving, one must decide methods for representing information and inference rules for drawing conclusions [8]. Here, we confine ourselves to propositional logic. We use the resolution as inference rule. In this section, we will briefly describe propositional logic, resolution principle, and resolution refutation. Propositional logic formula consists of Boolean variables and logical connectives. Boolean variable is a variable which can take only T (true) or F (false) as its value. Among basic logical connectives, there are ∧ (and, logical product), ∨ (or, logical sum), ¬ (not, negation), and → (implication). A Boolean variable or its negation is called a literal. More exactly, a Boolean variable with ¬ connective is called a negative literal and one without it is called a positive literal. It is proven [2] that any n-ary connective can be defined using only ∧, ∨, and ¬. For example, A → B can be defined as ¬A ∨ B for any Boolean variables A, B. To prove theorems using resolution refutation, every formula must be expressed in clause form. A clause form in propositional logic is defined as follows: (clausef orm) := (clause) ∧ (clause) ∧ · · · ∧ (clause) (clause) := (literal) ∨ (literal) ∨ · · · ∨ (literal) A clause with no literal is called an empty clause. Now the resolution principle can be defined. Let A and B be clauses, and v be a literal such that v ∈ A and ¬v ∈ B. Then, from both A and B we can draw (A − {v}) ∨ (B − {¬v}). We say that we resolved A and B on v and the product of resolution is called a resolvent. In general, a resolution refutation for proving an arbitrary formula ω from a set of formulas ∆ proceeds as follows [11]: 1. Put the formulas in ∆ into the clause form. 2. Add the negation of ω, in clause form, to the set of clauses and call it C.
158
In-Hee Lee et al.
Fig. 1. Theorem proving using resolution refutation. 3. Resolve these clauses together, producing a resolvent that logically follows from them. 4. If an empty clause is produced, a contradiction is occurred. Thus, it is proved that ω is consistent with ∆. Stop. 5. If no new resolvent can be produced, ω is proved not to be consistent with ∆. Stop. 6. Else, add the resolvent to C and go to step 3. When an empty clause is drawn, C is called the proof of the goal ω. Fig. 1 shows an example of theorem proving process. The set of formulas ∆ = {P ∧Q → R, S ∧T → Q, S, T , P } is given. We want to prove R is consistent with ∆. After converting the formulas into clause form, we get a set of clauses {¬P ∨ ¬Q ∨ R, ¬S ∨ ¬T ∨ Q, S, T , P }. Then we add the negation of R, i.e. ¬R, to this set. Each box in Fig. 1 contains one clause. The clauses and their resolvents are connected with arrows. Resolving on P from ¬P ∨ ¬Q ∨ R and P results in ¬Q ∨ R. Similar steps can be continued until an empty clause is produced. The symbol nil denotes an empty clause. The above theorem proving process becomes complex as the number of formulas grows. In the case of the propositional calculus, one must decide the literal to resolve on. Therefore, if there are n different literals, there are n! different theorem proving processes with n! = O(nn ) by Stirling’s approximation. Thus, the complexity of proof grows exponentially. So it is impossible for large n to test one by one with digital computer which one is a logically correct proof. To speed up finding proofs, two approaches were developed. One approach is to use heuristics such as the breadth-first strategy, the set of support strategy, or the unit preference strategy [8]. The other approach is to parallelize the theorem proving process [5,9,15]. We took the second approach and chose to use the massive parallelism of DNA molecular reactions for implementing parallel theorem provers.
DNA Implementation of Theorem Proving (a)
159
(b) 1. 1. Represent Represent Clauses Clauses with with DNA DNA
A
ACGTTAGA
¬A
TCTAACGT
B
TCGTCAGC
2. 2. Hybridization Hybridization
3. 3. Ligation Ligation
4. 4. Polymerase Polymerase Chain Chain Reaction Reaction (PCR) (PCR)
5. 5. Gel Gel Electrophoresis Electrophoresis
Fig. 2. (a) Encoding for a Boolean variable and its negation (The arrows are from 5’ to 3’). (b) The general procedure for our experiments.
3
Linear Implementation of Resolution Refutation
We solved the theorem proving problem shown in Fig. 1 by biochemical experiments. We developed two versions of implementation and performed experiments separately. Each implementation consists of two steps. In the first step, we represent formulas in clause form with DNA molecules. Because we restrict ourselves to propositional logic, we just need to encode each Boolean variable with different DNA sequences. Our implementations are different from each other in the way to make a clause from these variable sequences. In both implementations, we encoded each variable with different sequences of the same length. The negation of a variable is denoted as a Watson-Crick complementary sequence encoding the variable. Encoding for a Boolean variable and its negation is shown in Fig. 2. In the second step, we implemented resolution refutation steps with molecular reactions. This step varies, depending on the representation method used in the previous step. But the general procedure is identical in our two implementations as follows (see Fig. 2-(b)). 1. 2. 3. 4.
Mix DNA molecules corresponding to clauses. Hybridize DNA molecules to perform resolution. Ligate hybridization products to make it easy to find a proof. Perform PCR to amplify ligation products. In this step, only the ligation product which is a valid proof can be amplified. 5. Perform gel electrophoresis to see whether we found a proof or not. 3.1
Representation of Clauses
A clause is designed with single-stranded DNA that consists of each variables in the clause. We determined the order in which a literal in a clause appears so that a valid proof make a linear double-stranded molecule after hybridization step. As an example, sequence for a clause ¬Q ∨ ¬P ∨ R is a concatenation of sequences for ¬Q, ¬P , and R (see the topmost box in Fig. 3).
160
In-Hee Lee et al.
GAGT CAAT CTGA
GACT TGCA ACGT
¬Q
¬P
¬S
R
CTCA
ACGT
GTTA
S
P
T
CTCA
¬T
Q
TGAC
¬R
GTTA
S
T GACT TGCA ACGT R ¬P GAGT CAAT CTGA Q ¬S ¬T ACGT TGAC P
¬R
CTCA GTTA GACT TGCA ACGT GAGT CAAT CTGA ACGT TGAC
¬S
¬T
Q
P
¬R
Fig. 3. Simplified process of linear implementation (The arrows are from 5’ to 3’). 3.2
Implementation of Resolution Refutation
Resolution of a variable between two clauses is represented with hybridization of two regions corresponding to that literal in each clause. For example, when a variable v is resolved from clauses A and B, regions corresponding to v or ¬v in each clause hybridize and other regions remain unchanged. Therefore, if the resolvent is an empty clause, no region will remain as single-stranded DNA. Therefore, to see whether an empty clause is produced, one needs to verify if there exists a molecule with no single-stranded region. We used ligation, PCR, and gel electrophoresis to find this molecule. During ligation, every clause sequence used to produce the empty clause will be ligated into a long double-stranded molecule. In the next step, we amplify this ligation product by PCR with the goal sequence as a primer. Finally, the result is examined by gel electrophoresis. All of these experimental steps are summarized in Fig. 3. 3.3
Experimental Results
The sequences used in the experiment were designed by NACST using evolutionary optimization [14] and synthesized by Bioneer Co. (Tae-Jeon, Korea). The oligomer sequences are given in Table 1. The experiment consists of the following steps: 1. Purification of oligomers: Each oligomer was 5’-phosphorylated and purified by PAGE. Briefly, 1 nM of each oligomer was mixed and incubated for 1 h at 37◦ C with 10 U T4 polynucleotide kinase (Life Technologies) in 70 mM Tris-HCl (pH 7.6) buffer containing 10 mM MgCl2 , 100 mM KCl, 1 mM 2-mercaptoethanol and 1 mM ATP (Sigma, St. Louis, MO, USA), in a volume of 100 µl. The T4 kinase was inactivated by heating to 95◦ C for 10 min.
DNA Implementation of Theorem Proving 587 540 504 458 434
M
1
161
2
267 234 213 192 184 124/123 104 89/80
75 bp
64/57/51 21/18/11/8
Fig. 4. Electrophoretogram of the PCR product in the linear implementation. Lane 1: PCR products with S and ¬R as primers. Lane 2: PCR products with ¬S and R as primers. Lane M is a size marker. 2. Hybridization of oligomers: 100 pM of each oligomer was mixed. Initial denaturation was achieved at 95◦ C for 10 min. During hybridization we lowered temperature from 95◦ C to 16◦ C (1◦ C / min) using iCycler thermal cycler (Bio-rad, USA). 3. Ligation of hybrid molecules: Ligation was achieved with T4 DNA ligase at 16◦ C for overnight using iCycler thermal cycler. The reaction buffer contains 50 mM Tris-HCl (pH 7.8), 10 mM MgCl2 , 5 mM DTT, 1 mM ATP, and 2.5 µg/ml BSA. 4. PCR amplification for ‘readout’: 50 µl PCR amplification contained 100 pM of primer and template. The reaction buffer consists of 10mM Tris-HCl (pH 7.8) containing 50 mM KCl, 1.5 mM MgCl2 , 0.1% Triton X-100, 0.2 mM dNTP, and 1 U DNA Taq polymerase (Korea Bio-technology, Korea). PCR condition is given in Table 2. 5. Gel electrophoresis: Amplified PCR products were purified by electrophoresis on a 15% polyacrylamide gel (30% acrylamide [29:1 acrylamide / bis (acrylamide)]). The running buffer consists of 100 mM Tris-HCl (pH 8.3) 89 mM boric acid, and 2 mM EDTA. The sample buffer is Xylene Cyanol FF tacking dye. Gels were run on a Bio-rad Model Power PAC 3000 electrophoresis unit at 60 W (6V/cm) with constant power. Table 1. Sequences for linear implementation (in order of from 5’ to 3’). clause sequence ¬Q ∨ ¬P ∨ R CGTACGTACGCTGAA CTGCCTTGCGTTGAC TGCGTTCATTGTATG Q ∨ ¬T ∨ ¬S TTCAGCGTACGTACG TCAATTTGCGTCAAT TGGTCGCTACTGCTT S AAGCAGTAGCGACCA T ATTGACGCAAATTGA P GTCAACGCAAGGCAG ¬R CATACAATGAACGCA
162
In-Hee Lee et al.
Table 2. The PCR condition for linear implementation. cycle denaturation (94◦ C) annealing (58◦ C) polymerization (72◦ C) 1 4 min 0.5 min 0.5 min 2 ∼ 26 0.5 min 0.5 min 0.5 min 27 0.5 min 0.5 min 10 min
The electrophoretogram is given in Fig. 4. To make an empty clause, all of the 5 variables must be resolved. Every time one variable is resolved, double-stranded region with 15 bp is produced. Therefore, we can expect a 75 bp band will appear after gel electrophoresis. As can be seen in Fig. 4, an empty clause is produced. Thus, we found a proof for the given problem. 3.4
Discussion
There are some points to be considered to expand this implementation. First of all, we should rearrange variables in each clauses to make an empty clause form a linear double-stranded molecule. This requirement poses a limitation on the type of clauses we can use. That is, some kind of clauses does not make a linear double-stranded molecule no matter how we rearrange the variables. Also, it is impossible to know in advance which sequence to use as a primer. And there are possibilities of false positive. Even if S and T does not exist in Fig. 3, our implementation will make band with expected length. But we can reduce the possibilities of false positive by including exonuclease treatment step before PCR step.
4
Hairpin Implementation of Resolution Refutation
As mentioned in previous section, there are several limitations in linear implementation. To overcome these limitations, we introduce branched molecules and hairpin molecules to represent clauses. In this implementation, we can always use the negation of goal as a primer. Similar idea was introduced by Uejima and others[16] for Horn clause computation. But their work was intended to perform Horn clause computation not resolution refutation. Also in their work, molecular form of the empty clause is different from ours. 4.1
Representation of Clauses
Each clause with n literals is denoted by a branched molecule with n arms except for the clause with one literal. Each n-arm has a sticky end corresponding to each literal. Sticky ends for the positive and negative literals of one variable are complementary. For a clause with one literal which is not the goal, we represent it with a hairpin molecule having a sticky end. We encode the goal clause with a linear single-stranded molecule as in the linear implementation described in the
DNA Implementation of Theorem Proving
163
Fig. 5. The simplified process of hairpin implementation (The arrows are from 5’ to 3’). Table 3. Sequences for hairpin implementation (in order of from 5’ to 3’ ). clause sequence P TATTAAGACTTCTTGTAGTCT ¬P ∨ Q TAATAAGGAA TCATGTTCCT ¬Q CATGA
previous section. For example, if there were ¬Q ∨ ¬P ∨ R, S, and ¬R (the goal), the clause ¬Q ∨ ¬P ∨ R is represented by a 3-armed branched molecule, S by a hairpin molecule, and ¬R by a single-stranded molecule (see Fig. 5). 4.2
Implementation of Resolution Refutation
As in the linear implementation, resolution between two clauses is implemented as hybridization between two molecules. When an empty clause is drawn, it will start with a goal sequence and end with its negation, since clauses are either branched molecules or hairpin molecules except for the goal. Therefore, at the PCR step, we used the negation of goal variable only as a primer. To read the PCR product, we used gel electrophoresis. If a band is formed, we can conclude that the goal is consistent with the given clauses. If not, we say that the goal is not consistent with them. Because each band corresponds to a proof, we can find several different proofs at one time.
164
In-Hee Lee et al. (a)P
(c)¬Q
(b)¬P V Q
5mer
¬P
6mer
P
¬Q 5mer
Q
5mer
5mer
Fig. 6. The form of molecules used in experiments for hairpin implementation. (The arrows are from 5’ to 3’.) Table 4. The PCR condition for hairpin implementation cycle denaturation (98◦ C) annealing (58◦ C) polymerization (72◦ C) 1 5 min 1 min 1 min 2 ∼ 26 1 min 1 min 3 min 27 1 min 1 min 7 min
4.3
Experimental Results
To test our idea, we solved a very simple theorem proving problem: given P and P → Q, is Q consistent with them? Putting it in clause form, we get the clauses {P, ¬P ∨ Q, ¬Q}. The form of molecules representing these clauses are given in Fig. 6. As in the previous experiment, all sequences were designed by NACST [14] and were synthesized by Bioneer Co. The sequences we used are given in Table 3. Experimental steps are the same as in the previous experiment. The main differences between two experiments were the PCR condition and the type of gel used in gel electrophoresis. The PCR condition for this experiment is given in Table 4. We should have used ¬Q, the negation of the goal variable, as a primer in principle. But in this case, the sequence corresponding to it is too short to use it as a primer. Therefore, we used lower part of the molecule in Fig. 6-(b) as a primer. We used 3% agarose gel at the gel electrophoresis step. The electrophorestogram of hairpin implementation is given in Fig. 7. In Fig. 7, we can see bands of 23bp and 46bp as expected in Fig. 6. From this result, we can say our method can find a proof if it exist. If there is no such proof, we should fail to get band with that length. To verify this, we performed the same experiments without one or more molecules in Fig. 6 (see Fig. 8). Only lane 12 in Fig. 8 contains all of them. Therefore a band must appear in lane 12 only. But we can see short bands in lane 2∼7. We think that short bands in lane 3∼7 are formed by hybridization of two P s(see Fig. 6-(a)). And the longer bands in lane 2 seems to be formed by hybridization of P and ¬P ∨ Q (see Fig. 6-(a) and Fig. 6-(b)). But this longer band must be shorter than the band in lane 12, for it does not contain molecule ¬Q. To compare both lanes, we draw dashed lines
DNA Implementation of Theorem Proving
M
50 bp 25 bp
1
2
3
4
5
6
7
8
165
M
23 bp
Fig. 7. The result of ligation mixture after PCR and electrophoresis. Lane 1-8: Ligation mixture under various conditions. Lane M: a 25 bp size marker. The arrow indicates the 23 bp PCR product.
in Fig. 8. We find that the band in lane 2 is shorter than that of lane 12 as we expected. 4.4
Discussion
In this experiment, because of self-complementary sequences such as hairpin and group of sequences with complementary subsequence such as branch, PCR step is extremely difficult. If some of these complementary sequences hybridize during PCR step due to their thermodynamical properties such as melting temperature, amplification will stop at that point and we will get false negative result. Also as you can see in Fig. 7, one proof can have two bands of different length. We think it is due to the hybridization of two hairpin molecules. And there are some cases when our method can not tell whether a proof is found or not. For example, if the goal variable is resolved more than once, our method will tell there exists a proof regardless of the existence of empty clause. To solve this problem, we need a different detection method for empty clause or a different encoding scheme. Also, for we did not restricted the form of clause, non-Horn clause can form a complicated self-loop structure. And even if we restrict ourselves to Horn-clauses, if there are two clauses which have two resolvable variables, they can form a self-loop structure, too. For example, if there are ¬P ∨ Q and P ∨ ¬Q ∨ ¬R, after resolving P or Q, the resolvent can form a self-loop structure. What is worse, as the number of variable grows, we should use longer sequences to encode each variable and the possibility of self-hybridization will grow. To solve this problem, we need to make procedure removing this self-loop or to design new representations for clauses.
166
1
In-Hee Lee et al.
2
3
4
5
6
7
8
9
10
11 12
M
50 bp 25 bp
Fig. 8. The verification of detection method. Lane 1: without Fig. 6-(a). Lane 2: without Fig. 6-(c). Lane 3: without upper part of Fig. 6-(b). Lane 4: without lower part of Fig. 6-(b). Lane 5: Fig. 6-(a) and (c) only. Lane 6: Fig. 6-(a) and lower part of (b) only. Lane 7: Fig. 6-(a) and upper part of (b) only. Lane 8: Fig. 6-(b) only. Lane 9: lower part of Fig. 6-(b) and (c) only. Lane 10: upper part of Fig. 6-(b) and (c) only. Lane 11: the same as lane 8. Lane 12: with all of molecules. Lane M: a 25bp size marker.
When using branched molecules, branch migration may occur. But as suggested in [12], inserting T’s to junction point can reduce the possibility of branch migration.
5
Conclusions
Using molecular reactions of DNA, we proved theorems in the propositional calculus. We presented methods for encoding clauses with DNA molecules and solved theorem proving problems with lab experiments. Our methods are distinguished from other work in several points. First, it does not need additional operations except hybridization. Only simple operations such as ligation and PCR are needed to verify the results. Second, the number of experimental steps does not vary with the problem size. Our implementation methods require only hybridization, ligation, PCR, and gel electrophoresis, and these operations are all O(1) operations. Finally, taking the limit of PCR operation (10,000bp) into consideration, our methods can solve theorem proving problems with up to 660 literals (15mer per literal). As we discussed above, there are several things to consider in both implementations. And we are trying to improve our implementations.
Acknowledgements This research was supported in part by the Ministry of Education under the BK21-IT program and the Ministry of Commerce through the Molecular Evo-
DNA Implementation of Theorem Proving
167
lutionary Computing (MEC) project. The RIACT at Seoul National University provided research facilities for this study.
References 1. Adleman, L., Molecular computation of solutions to combinatorial problems, Science, 266:1021–1024, 1994. 2. Fitting, M., First-Order Logic and Automated Theorem Proving, Springer-Verlag New York Inc., 1942. 3. Hagiya, M., Arita, M., Kiga, D., Sakamoto, K., and Yokoyama, S., Towards parallel evaluation and learning of Boolean µ-formulas with molecules, Preliminary Proceedings of the Third DIMACS Workshop on DNA Based Computers, 105–114, 1997. 4. Hagiya, M., From molecular computing to molecular programming, Lecture Notes in Computer Science, 2001. 5. Hasegawa, R., Parallel theorem-proving system: MGTP, Proceedings of Fifth Generation Computer System, 1994. 6. Kobayashi, S., Horn clause computation with DNA molecules, Journal of Combinatorial Optimization, 3:277-299, 1999. 7. Lipton, R.J., DNA solution of hard computational problem, Science, 268:542–545, 1995. 8. Luger, G.F. and Stubblefield, W.A., Artificial Intelligence: Structures and Strategies for Complex Problem Solving, 2nd Ed., Benjamin/Cummings, 1993. 9. Lusk, E.L. and McCune, W.W., High-performance parallel theorem proving for shared-memory multiprocessors, http://wwwfp.mcs.anl.gov/∼lusk/papers/roo/paper.html, 1998. 10. Mihalache, V., Prolog approach to DNA computing, Proceedings of the IEEE International Conference on Evolutionary Computation, IEEE Press, 249–254, 1997. 11. Nilsson, N.J., Aritificial Intelligence: A New Systhesis, Morgan Kaufman Publishers Inc., 1998. 12. Sa-Ardyen, P., Jonoska, N., and Seeman, N.C., Self-assembling DNA Graphs, Preliminary Proceedings of the Eighth International Meeting on DNA Based Computers, 20–28, 2002. 13. Sakamoto, K., Gouzu, H., Komiya, K., Kiga, D., Yokoyama, S., Yokomori, T., and Hagiya, M., Molecular computation by DNA hairpin formation, Science, 288:12231226, 2000. 14. Shin, S.-Y., Kim, D., Lee, I.-H., and Zhang, B.-T., Evolutionary sequence generation for reliable DNA computing, 2002 IEEE World Congress on Evolutionary Computation, 2002 (accepted). 15. Suttner, C., SPTHEO - A parallel theorem prover, Journal of Automated Reasoning, 18(2):253-258, 1997. 16. Uejima, H., Hagiya, M., and Kobayashi, S., Horn clause computation by selfassembly of DNA molecules, Preliminary Proceedings of the Seventh International Meeting on DNA Based Computers, 63–71, 2001. 17. Wasiewicz, P., Janczak, T., Mulawka, J.J., and Plucienniczak, A., The inference based on molecular computing, International Journal of Cybernetics and Systems, 31(3):283–315, 2000. 18. Winfree, E., Algorithmic self-assembly of DNA, Ph.D. Thesis, California Institute of Technology, 1998.
Universal Biochip Readout of Directed Hamiltonian Path Problems David Harlan Wood1 , Catherine L. Taylor Clelland2 , and Carter Bancroft2 1
Computer and Information Science University of Delaware Newark, DE 19716 USA [email protected] 2 Department of Physiology and Biophysics, Box 1218. Mount Sinai School of Medicine. One Gustave L. Levy Place, New York, NY 10029 USA {Catherine.Clelland, Carter.Bancroft}@mssm.edu
Abstract. A universal design for a biochip that reads out DNA encoded graphs is enhanced by a readout technique that may resolve multiple solutions of Hamiltonian path problems. A single laboratory step is used. DNA encoded graphs are labeled with many quantum dot barcodes and then hybridized to the universal biochip. Optical readouts, one for each barcode, yield multiple partial readouts that may isolate individual paths. Computer heuristics then seek additional individual paths.
1
Introduction
The design of a universal biochip for readout of any DNA encoded graph with n or fewer nodes is presented. We emphasize reading out multiple solutions of Directed Hamiltonian path (DHP) problems. We do not solve DHP problems. We merely wish to read out DHP solutions. However, an innovative simultaneous quantum dot barcode labeling of DHP solutions with n2 probes yields partial readouts of the biochip. These multiple partial readouts may fully determine some paths, even when multiple paths are present. Further processing by conventional computers seeks additional paths. Since the pioneering molecular computation of a DHP problem [1], careful design of execution conditions and DNA encodings has been employed to successfully solve DHP problems using DNA [2,3,4]. Detection, but not readout, of solutions of the DHP problem was originally performed by a series of DNA strand purifications followed by gel electrophoresis [1]. However, readout of DHP solutions has received less attention. DHP readout by biochip hybridization has been suggested [2,5]. However, DHP and other graph problems can have multiple solutions, and this presents an important difficulty in that following hybridization to the biochip, all paths
The following partial support is gratefully acknowledged: NSF Grant No. 0130385, NSF Grant No. 9980092, and DARPA/NSF Grant No. 9725021
M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 168–181, 2003. c Springer-Verlag Berlin Heidelberg 2003
Universal Biochip Readout of Directed Hamiltonian Path Problems
169
become superimposed upon one another, leaving any one path indistinguishable from other paths. Proposed modifications of the original biochip approach have, in principle, overcome the superposition difficulties. One modification uses biochip readout to direct further laboratory steps, including additional biochip readouts, to eventually isolate all of the individual Hamiltonian paths [5]. This method may require O(nk) laboratory steps to find and read out k paths, each of length n. We have designed a readout procedure using innovative multiple labeling and a universal biochip. We describe here a laboratory approach for readout of DHP problems having multiple solutions. We show resolution of multiple DHP solutions may be obtained from n2 partial readouts, one for each of our multiple labels. Heuristics for computational determination of further multiple DHP solutions from our partial readouts are presented. These and further heuristics are under development [6].
2
Graphs and Their Adjacency Matrix Representations
A graph is a set of nodes, usually drawn as points, plus a set of edges, usually drawn as arrows joining pairs of nodes. The graph representation we use is the adjacency matrix of a graph. It should be noted that any graph with at most n nodes can be represented by an n × n adjacency matrix. This is one reason our universal biochip design is able to read out unrestricted graphs (up to size n) encoded in DNA. 2.1
The Adjacency Matrix of a Graph
If there are n vertices in a graph, then we form an n × n adjacency matrix of 0s and 1s. If there is a 1 in the ith row at the jth column, this means that the graph has a directed edge from the ith vertex to the jth vertex. A 0 in that position means there is no such edge. An example of an adjacency matrix representing a map of airline routes involving four cities is Depart c1
Depart c2 Depart c3 Depart c4
Arrive c1 0
Arrive c2 1
Arrive c3 1
1
0
1
1
0
0
1
1
1
Arrive c4 0 1 . 1 0
(1)
From the city in row 1, one must go to either city 2 or city 3. From city 2, one can return to city 1, or go on to either city 3 or city 4. From city 3, one must go to city 1 or city 4, where one can either return or continue to city 2 or city 1.
170
2.2
David Harlan Wood, Catherine L. Taylor Clelland, and Carter Bancroft
Superpositions of Adjacency Matrices
Sometimes we are given the superposition of the adjacency matrices of a collection of graphs. Technically, superposition is just the operation of elementwise logical OR applied to two or more adjacency matrices. (Logical OR is defined by 0 OR 0 = 0, 1 OR 0 = 0 OR 1 = 1, and 1 OR 1 = 1.) That is, we obtain a superposition matrix with a nonzero element in position i, j if and only if at least one of the graphs in the collection has a nonzero element in position i, j of its adjacency matrix. Note that the airline map in (1) might represent a superposition of three maps: one map for an airline with round robin service, and two more maps for associate airlines providing local shuttle services:
0 0 0 1
1 0 0 0
0 1 0 0
0 0 , 1 0
0 0 1 0
0 0 0 1
1 0 0 0
0 0 1 1 , 0 0 0 0
1 0 0 0
0 0 0 1
0 0 . 1 0
(2)
But notice that several other collections of adjacency matrices could also be superimposed to produce (1). It is clear that when multiple adjacency matrices are superimposed there is no general method for recovering the individual adjacency matrices from the superposition. However, in this paper we present a technique for the optical readout of an n × n universal biochip to be decomposed into n2 partial readouts that may decompose superpositions of adjacency matrices describing collections of directed Hamiltonian paths. Individual adjacency matrices from the collections may be isolated in this way.
3
Universal Graph Biochip and Q-dot Barcode Labels
Let n be the maximum number of nodes in any graph in a collection of graphs. Suppose each input graph in the collection is encoded in a DNA strand containing encodings of its edges (each edge twice, for convenience). Suppose each edge is encoded by appending the encoding of its departure node to the encoding of its arrival node. 3.1
Standardized DNA Encoding of Graph Nodes
DNA sequences encoding each of the n nodes are to be agreed upon in advance, and these DNA sequences are designated c1 , c2 , c3 , . . . , cn . This establishes standard DNA sequences allowing any graph with n or fewer nodes to be encoded in DNA. These standardized sequences only need to be designed once. This means that our universal DNA biochip could be fabricated in quantity without advance knowledge of what graphs it may be used to read out. Only two assumptions are made about the DNA encodings of graphs to be read out.
Universal Biochip Readout of Directed Hamiltonian Path Problems
171
1. Specific standard sequences are used to encode the graph edges. 2. Any additional DNA sequences must not hybridize to the standard sequences or their complements. Thus, we are able to design our own DNA sequences to make them convenient for biochip readout for all graphs. 3.2
Standardized DNA Encoding of Graph Edges
DNA Encodings of Biochip Spots. A universal biochip for readout of all graphs (up to size n) uses standard sequences that need to be designed only once. Each of the n2 spots on our biochip contains the DNA sequence complementary to the sequence resulting from appending the sequence encoding some node ci followed immediately by the sequence encoding some node cj . This is done for each pair i and j, with both i and j running between 1 and n. Thus the DNA in the spot in ith row and the jth column on the biochip will preferentially hybridize to input strands that contain the sequence ci immediately followed by the sequence cj . Figure 1 below shows the layout of the universal chip in the case of n = 4.
Depart Depart Depart Depart
c1 c2 c3 c4
Arrive c1 c1 c1 c2 c1 c3 c1 c4 c1
Arrive c2 c1 c2 c2 c2 c3 c2 c4 c2
Arrive c3 c1 c3 c2 c3 c3 c3 c4 c3
Arrive c4 c1 c4 c2 c4 c3 c4 c4 c4
Fig. 1. Given four standard node sequences, c1 , c2 , c3 , and c2 , the 4×4 universal biochip would have sequences complementary to those shown.
The appended sequences for the n2 spots can be designed and tested for noncrosshybridization without regard for the particular graphs to be read out. One of many methods for obtaining non-crosshybridizing DNA sequences is found in [7]. Non-crosshybridization of DNA sequences for other biochips has been specifically investigated before [8,9]. However, our universal design makes stronger demands than prior investigations. Since we are limited to choosing only n node sequences, we are not able to use n2 independently chosen DNA edge sequences. Preventing cross-hybridization is more challenging in our case because each of our node sequences is used as one-half of many edge sequences (see Fig. 1). Encoding Graphs in DNA Strands. A graph is constructed as a DNA strand that includes encodings of all of the edges of the graph. Although it is not strictly necessary, let us assume each edge occurs twice in the graph encoding. Labels (e.g. fluorescent) can be attached to the DNA strand, and the strand hybridized
172
David Harlan Wood, Catherine L. Taylor Clelland, and Carter Bancroft
to a universal biochip. Each spot on the biochip is complementary to one of the n2 possible edges. The spots on the universal biochip are prearranged so that when the graph strand is hybridized to the biochip and the labels are observed, the adjacency matrix of the graph is displayed. An example is shown in Fig. 2.
Depart c1
Depart c2 Depart c3 Depart c4
Arrive c1
h x x x
Arrive c2
x h h x
Arrive c3
x x h x
Arrive c4
h x x h
Fig. 2. Appearance of biochip readout for the graph in (1).
3.3
Fabrication of the Universal Biochip
Construction of numerous copies of the universal biochip will involve printing each DNA edge sequence onto glass slides using current protocols. Printing 10,000 spots per biochip is possible [10]. Specifically, our DNA sequences to be printed on the biochip can be commercially synthesized, and then printed onto the array in specific positions, using commercial microarray printers, such as the Affymetrix 477 arrayer. (However, the design of the n2 complementary edge sequences permits constructing them by ligating n synthesized sequences in pairs.) The use of standard hybridization conditions [8] will allow DNA strands to hybridize to spots on the array that contain sequences complementary to edges encoded within each graph. 3.4
Quantum Dot Barcodes for Optical Readout
A fluorescent quantum dot (Q-dot) consists of a nanocrystal cadmium selanide core, wrapped in a zinc sulphur shell [11]. When hit by a beam of light, the electrons in a Q-dot emit light at a specific wavelength (through quantum confinement). The wavelength is directly related to the size of the Q-dot. By varying the shell size, Q-dots with unique, spectrally distinct wavelengths can be produced. A single wavelength of light can be used for simultaneous excitation of all Q-dots [11]. Because Q-dots emit at precise wavelengths, Q-dot emission detection is free of the problems arising from signal overlap or photobleaching [11]. For our purposes, it is important that Q-dots can be integrated into microbeads to form Q-dot barcodes [12] attached to DNA strands. Specifically, Q-dots emitting distinct wavelengths are mixed in known concentrations and incorporated into polystyrene microbeads. This yields beads emitting correspondingly different spectra following excitation. The combinatorial power obtained by varying both the wavelengths and intensities within the fluorescent emission
Universal Biochip Readout of Directed Hamiltonian Path Problems
173
spectra of these microbeads yields large numbers of distinct Q-dot barcodes. It has been suggested that “a realistic scheme” could use 5-6 single frequencies, each with 6 intensity levels, yielding approximately 10,000 to 40,000 distinguishable barcodes [12]. For our applications, the Q-dot barcode microbeads can be attached to DNA strands. The carboxylic acid groups on the surface of Q-dot beads can be conjugated to streptavidin molecules, which can then be conjugated to biotinylated DNA strands. As described in the following section, the optical readout of multiple graphs can exploit the diversity of Q-dot beads that are bound to DNA strands, together forming Q-dot barcode labels. It is important to note that individual Q-dot barcode microbead images are much smaller than the spots on a typical biochip.
4
Graph Readout Using the Universal Biochip
In this section we consider three labeling techniques applicable to collections of graphs each of which is encoded in single stranded DNA. In Subsection 4.1 we use simple uniform labeling of graphs. In this case, all graphs in the collection are superimposed on the biochip. This can give good information if there are very few distinct graphs. In Subsection 4.2 we label only the graphs that contain a specific edge. In this case, only the graphs containing the specific edge are superimposed. This is most useful if only one, or a few, graphs contain the specific edge. The total information is limited, however, by the choice of the specific edge. In Subsection 4.3, we simultaneously label all possible edges in all of the graphs. Again, all graphs in the collection are superimposed, but if each edge label is distinct, we can isolate separate readouts (corresponding to Subsection 4.2) for each possible edge. The visually oriented reader may want to glance ahead to the examples shown in Fig. 4 and Fig. 5. 4.1
Labeling All Graphs in a Collection
Particularly if we have only one DNA encoded graph we wish to read out, it suffices to simply label all the input DNA strands. If there is more than one graph in the input the effect is that all the graphs will be superimposed on the biochip. If there are very few distinct graphs, this may be adequate. 4.2
Labeling a Single Specific Edge
Let us concentrate on the labeling of one specific edge. Focus on only those graphs encoded in DNA strands which contain the encoding of the edge ci → cj . Now let us add a label consisting of DNA complementary to the encoding of the edge ci → cj . This label is attached to a unique Q-dot barcode microbead. This barcode label can hybridize to any input strand that encodes the edge ci → cj .
174
David Harlan Wood, Catherine L. Taylor Clelland, and Carter Bancroft
C2C1’
C1C2 C1C2 C2C1 C2C1 C3C4 C3C4 C4C3 C4C3
C1C2’
C2C1’
C1C2’
Probe: C2C1 barcode labeled DNA
C2C1’
C1C2’
C2C1’
C2C1’
C1C2’ C1C2’
Probe: C1C2 barcode labeled DNA
C2C1’
Probe: C3C4 barcode labeled DNA
C1C2’
pot in
DNA Encoded Permutation C2C1’
C1C2’
DNA Encoded Permutation C1C2 C1C2 C2C1 C2C1 C3C4 C3C4 C4C3 C4C3
1st
Row,
2nd
Column
Probe: C4C3 barcode labeled DNA
Immobilized DNA strands encoding C2C1’
Spot in
2nd
Row, 1st Column
Fig. 3. A labeled graph hybridized to two typical spots on the universal biochip. All it takes for a spot at the k, l position on the chip to light up is that some graph in the input mixture somewhere contains ci followed by cj (to bind to the ci → cj barcode label) and somewhere contains ck followed by cl (to bind to the k, l spot). Recall we are using just this one label, namely, on the DNA encoding the edge from ci → cj . When we view the whole chip, we see the superposition of all the input graphs that somewhere contain ci followed by cj . The overall effect is that a label corresponding to a particular edge produces the superposition of all graphs containing that edge. 4.3
Labeling All Possible Edges Simultaneously
In the previous subsection a single specific edge was barcode labeled. But in this subsection all edges are labeled. We present a technique where n2 different Q-dot barcode labels are used, one label for each of the possible edges that can occur in a graph. We apply all of these labels simultaneously in one laboratory step. The labels are scarce enough that the DNA encoded graph strands bind to only one, or a few, labels. Labeling is followed by hybridization to the universal biochip. This sets the stage for Section 5, where a single optical readout is separated into n2 images of the biochip, one image for each different barcode edge label. Figure 3 shows how our scheme using multiple labels interconnects with hybridization to the universal biochip. Two examples are shown in Fig. 3, namely, the biochip spots immobilizing DNA complementary to DNA encoding (a) the edge from c1 → c2 and (b) the edge from c2 → c1 . At the top of Fig. 3, as in all the horizontal lines, we have the DNA encoding of a particular permutation graph.
Universal Biochip Readout of Directed Hamiltonian Path Problems
175
(Notice that each edge of the permutation graph is encoded twice.) Watson-Crick complements are indicated by primes. For example, C1 C2 is the complement of C1 C2 . Each of the edges C1 → C2 , C2 → C1 , C3 → C4 , and C4 → C3 , is assigned its own unique Q-dot barcode. Recall the barcoded labels are added so that most graph strands have only one label bound. The left of the figure shows the encoded graph, with various barcode labels, hybridizing to the spot in the first row and second column of the biochip. The right hand side of the figure corresponds to the spot in second row and first column of the biochip. From Fig. 3 it is seen that when encoded as a DNA strand, a graph literally carries a barcode label corresponding to a particular edge to every spot on the biochip that corresponds to some edge of that graph. Or, in the words of one of the reviewers of this manuscript, “each strand is multiply indexed: once by its position on the chip (which identifies one edge in the encoded Hamiltonian path (i, j)), and a second time by an attached label (which identifies a second edge in the encoded Hamiltonian path (k, l))”
4.4
Example Readouts Using Universal Biochip
Figure 4 schematically shows examples of biochip readouts using n2 different Qdot edge barcode labels (Q-dots enlarged about one thousand-fold for clarity).
A
B
C
D
Fig. 4. Part (A) defines a scheme assigning sixteen unique Q-dot barcodes to edges. Part (B) shows the readout of a simple graph. Notice that each lighted spot contains four colors, one for each edge in the graph. Part (C) shows the (superimposed) readout from two graphs. Part (D) shows the readout from an example collection of graphs defined by (3) below.
176
David Harlan Wood, Catherine L. Taylor Clelland, and Carter Bancroft
The readout in Fig. 4(D) comes from an example collection of tation) graphs having the following adjacency matrices 1 0 0 0 0 1 0 0 0 1 0 0 0 0 0 1 0 0 1 0 0 0 1 0 0 0 1 0 , , , 0 0 1 0 0 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 1 0 0 1 0 0 1 0 0 1 0 0 0 0 1 0 0 0 1 0 0 0 0 0 1 1 0 0 0 0 1 0 0 0 0 , , , 1 0 0 0 0 1 0 0 1 0 0 0 0 1 0 1 0 0 0 0 1 0 0 0 1 0 1 0
eight (permu1 0 0 0 0 1 0 0
0 0 , 1 0 1 0 . (3) 0 0
This example collection of graphs will be used to illustrate the methods of the next section. To end this section, we summarize the most important concept of this paper: we label the input graphs with n2 distinct edge barcode labels, and allow the labeled inputs to hybridize on the universal chip; in the next section, optical readout of the universal biochip is obtained and then separated into n2 partial readouts that correspond to the n2 possible graph edges.
5
Optical Readout from n2 Distinct Barcode Labels
In Subsection 4.3 we labeled a collection of DNA encoded graphs with n2 distinct Q-bit edge barcode labels. The n2 barcodes correspond to the complements of every possible edge in the graph. In the laboratory, we can hybridize all labels to all inputs using an automated 384 multi-well format. We then allow the labeled collection of DNA encoded graphs to hybridize on the universal chip. After the hybrid probes of labeled inputs are hybridized to the biochip, hybridization is detected by the fluorescence emission of Q-dots. Standard microarray protocols can be used for hybridization of biochips [13]. Traditional fluorescent microscopy can then be employed for biochip readout using a single wavelength to excite all Q-dot barcode microbeads. Images are then captured with an ImagePoint cooled CCD video camera (Photometrics), through a Labophot-2A fluorescence microscope (Nikon) [14]. 5.1
Separation of n2 Barcode Readouts
Next we extract from the optical readout the contributions from each one of the n2 distinct Q-dot barcode labels. Thus, we obtain n2 separate partial readouts of the biochip data. Our motivation is that the superposition of graphs is lessened in the partial readouts. Each partial readout corresponds to a ci → cj edge barcode for a particular i and j. Such a partial readout exhibits the superposition of only those input graphs containing ci → cj , as discussed in Subsection 4.2. We resolve the images from each of the n2 barcode Q-dot beads distributed randomly over the surface of individual spots on the biochip. These images are
Universal Biochip Readout of Directed Hamiltonian Path Problems
177
about one thousand times smaller than the biochip spots. To our knowledge, no attempts have been made previously to resolve images arising from subsections of single spots on a biochip. 5.2
Readout Constraints on Scaleup for Large Biochips
Biochips with up to 10,000 spots can be fabricated with present technology [10]. Assuming a particular biochip has a value of n2 = 10,000 (a 100 × 100 biochip), and each edge within the input graphs has a unique barcoded bead attached; there would be 10,000 labeled hybrid probes, each with a unique Q-dot barcode. Scaleup is constrained by the following consideration. The diameter of a given Q-dot barcode bead can be between 0.1-5µm depending on manufacturing design, and this size is independent of the number of Q-dots contained within the bead [12]. Q-dot beads are approximately one thousand times smaller in diameter than one biochip spot (Clelland and Bancroft, personal observation). Thus, Q-dot barcode bead images could be resolved over the surface of any spot for barcode readout for rather fewer than one million barcodes. Thus, 10,000 input+label hybrid probes should be distinguishable after hybridization to a biochip. Software that permits measurement of intensity, hue, and saturation from thousands of image objects (e.g. SigmaScan Pro, SPSS Science), can then be employed to scan each biochip spot and thus yield readout of individual barcodes. A simple dilution of input+label hybrid probes would allow simultaneous readout of more beads. Using this approach, we can say that one laboratory step is sufficient for readout when n2 = 10, 000. When n2 > 10, 000 the number of laboratory steps is n2 /10, 000. Our new approach for Hamiltonian path readout could replace the O(nk) laboratory steps of [5] with n2 /10,000 laboratory steps. For example, suppose n = 100, and nk has a maximum value of n2 − n = 9900. In this case, 9900 laboratory steps would be replaced by one. We know of no physical principles that would forbid scaling up universal graph readout to the level described here, and beyond.
6
Isolating Individual DHP from n2 Partial Readouts
Up to this point we have presented designs and techniques for general, unrestricted graphs. We now specialize our results to permutation graphs, which are a modest generalization of directed Hamiltonian paths. A graph is said to be a permutation graph if its adjacency matrix has all 0 entries except one 1 in each row and one 1 in each column. Notice that the graphs in our example collection of graphs in (3) are all permutation graphs. 6.1
Displaying n2 Partial Readouts
Consider a typical partial readout corresponding to the edge ci → cj . Denote this n × n readout matrix by Ri,j . This matrix is the superposition of all graphs
178
David Harlan Wood, Catherine L. Taylor Clelland, and Carter Bancroft
that contain the edge ci → cj . We can form a large array with Ri,j at the i, j position. For the example collection of graphs given in (3) the partitioned matrix of partial readouts is shown in Fig. 5.
Fig. 5. For the collection of permutation graphs in (3), the n2 partial readouts, one for each edge, are here arranged according to the color scheme in Fig. 4(A). Since the barcode corresponding to Ri,j is placed at position i, j it follows that no information is lost by replacing the information in Fig. 5 with the partitioned matrix 1
0 0 0 0 1 0 0 R = 0 0 1 0 0 0 0 1
0 1 0 0 1 0 1 1 0 1 0 1 0 0 1 0
0 0 1 0 1 0 1 1 1 0 0 1 0 1 0 0
0 0 0 1 1 0 1 1 1 1 0 0 1 0 0 0
0
1
0
0
0
0
1
0
0
0
0
1
1 0 0 0 1 0 0 1 1 1 1 0 0 0 1 1 1 0 0 1 1 1 0 0 0 0 1 1 0 1 0 0 1 0 1 0 1 0 0 1 0 0 0 1 0 0 1 0 0 1 0 0 0 0 1 0 0 0 0 1 1 0 1 0 0 1 0 0 1 0 0 0 0 0 1 1 1 0 0 0 0 1 0 0. 0 0 0 1 1 1 0 0 0 1 1 0 1 0 1 0 1 1 0 0 1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1 1 0 1 0 0 0 0 1 0 1 1 0 0 0 1 0 0 1 0 1 1 1 0 0 1 0 0 1 1 1 0 0 1 1 0 0 1 0
0 1
0 0
1 0
1 0
1 0
0 1
1 0
0 0
0 0
1 0
0 1
(4) The partial readouts in (4) have their superpositions reduced compared to the same data before separation (shown in Fig. 4(D)). Indeed, some individual permutation matrices are apparent in (4):
Universal Biochip Readout of Directed Hamiltonian Path Problems
R1,1
1 0 = 0 0
0 1 0 0
0 0 1 0
0 0 0 0 , R2,4 = 0 1 1 0
0 0 0 1
1 0 0 0
0 0 1 0 , R2,3 = 0 0 0 1
0 0 1 0
0 1 0 0
179
1 0 . 0 0 (5)
These are three of the eight permutations in the input collection (3). 6.2
Logical AND of Partial Readouts
For any two partial readout matrices, we define Ri,j AND Rk,l to be elementwise logical AND, which is defined by 0 AND 0 = 0, 1 AND 0 = 0 AND 1 = 0, and 1 AND 1 = 1. Recall that for all i, j, the matrix Ri,j is the superposition of all graphs that contain the edge ci → cj . Using this fact, it can be shown that if some particular permutation matrix in a collection has a nonzero i, j element and it also has a nonzero k, l element, then the matrix Ri,j AND Rk,l must contain this permutation. In fact, it must contain the superposition of all permutation matrices in the collection that have both their i, j and their k, l elements nonzero. Of course, the AND of two partial readout matrices has fewer (or the same) number of nonzero elements than either of the two individual matrices. That is, for any i, j, k, l, the matrix Ri,j AND Rk,l will often have its superposition reduced compared to Ri,j and Rk,l individually. Proceeding with the example collection of permutation graphs from (3) we AND all pairs of the 16 partial readout matrices from (4). We display the maximum number of permutations that could be contained in each of the 256 resulting matrices in the following format
R1,1 R1,2 R1,3 R1,4 R2,1 R2,2 R2,3 R2,4 R3,1 R3,2 R3,3 R3,4 R4,1 R4,2 R4,3 R4,4
R1,1 1
R2,1
R3,1 2
2
1
1
1 1
2 3 2
1
2 6
2
2 1
2 1 1
1 1
1 1
1
1
1 1
R4,1
1 1 1 1 1
1 1 1
1
1 1 1
1
1 2
1 1 1
1 1 1
1 2
1 1
1 2 1
1 1 1
1 1
1 1
1 1
2 2
1 1 2
1 2 1
1 1 2
2 1
2
1
1 1
1 1 1
1 1
2 1
1 1
2 2
1
3
1
1 . 1 2
Collecting all the above 256 matrices Ri,j AND Rk,l that contain only one permutation, we recover exactly the eight distinct permutations that form the original collection that was given by (3).
180
6.3
David Harlan Wood, Catherine L. Taylor Clelland, and Carter Bancroft
Further Observations
Reductions and heuristics are under development [6] for resolving superpositions of collections of permutation graphs. These are founded on three principles. The Exclusion Principle. The partial readout Ri,j has its ith row and the jth column zero except at position i, j. Were this not the case, some permutation matrix would have more than one 1 in some row or column, which is forbidden. A consequence of the Exclusion Principle is the following. The Verification Principle. The adjacency matrix of any permutation in a collection has non-zero entries only at positions 1, p1 and 2, p2 and 3, p3 . . . and 2, pn , where p1 , p2 , p3 , . . . , pn is some ordered rearrangement of 1, 2, 3, . . . , n, only if R1,p1 AND R2,p2 AND R3,p3 . . . AND R1,p1 recreates the adjacency matrix of the permutation. We stated another principle at the beginning of the previous subsection. We repeat it here. The AND Principle. If some permutation matrix in a collection has nonzero elements in its i, j and k, l positions, then the matrix Ri,j AND Rk,l contains the superposition of all permutation matrices in the collection that also have nonzero elements in both their i, j and k, l positions.
7
Summary
We have described a novel technique for reading out arbitrary graphs with up to n nodes using an n × n biochip incorporating standardized DNA sequences, making this biochip universal for all graphs of this size. Multiple graphs, when simultaneously present, limit readout by superimposing their individual biochip data. We dilute superposition by detecting n2 different quantum dot barcode labels (one for each possible graph edge) within the spots on the universal biochip. For the special class of permutation graphs, computer-based heuristics isolated individual graphs from an example collection of graphs. Our only laboratory process is hybridization of an unknown collection of DNA encoded graphs to quantum dot microbead barcode labels, followed by biochip hybridization and optical readout. Future scaleup to graphs with one hundred nodes seems possible using a single laboratory step because (a) pairwise ligation of one hundred standard sequences can yield ten thousand graph edge encodings, (b) printing ten thousand spots on a biochip is about the state of the art, (c) ten thousand distinct quantum dot barcode beads are on the horizon [11,12], and (d) ten thousand distinct barcode images are likely to be resolvable within each spot on a biochip.
Universal Biochip Readout of Directed Hamiltonian Path Problems
8
181
References
[1] L.M. Adelman. Molecular Computation of Solutions to Combinatorial Problems. Science 266:1021-1024, 1994. [2] J. A. Rose, R. Deaton, M. Garzon, R. C. Murphy, D. R. Franceschetti, and S.E. Stevens, Jr. The effect of uniform melting temperatures on the efficiency of DNA computing. In DNA Based Computers III: DIMACS Workshop, June 23-25, 1997, pages 35-42, June 1997. [3] M. H.. Garzon, N. Jonoska, and SA. Karl. The bounded complexity of DNA computing. Biosystems 52;63-72. 1999. [4] CM. Lee, SW. Kim, SM. Kim and U. Sohn. DNA computing the Hamiltonian path problem. Molecular Cells. Oct 31;9(5): 464-469. [5] DH Wood. A DNA computing algorithm for directed Hamiltonian paths. In John Koza, Wolfgang Banzhaf, Kumar Chellapilla, Kalyanmoym Deb, Marco Dorigo, DB Fogel, MH Garzon, DE Goldberg, H Iba, and R Riolo, editors, Genetic Programming 1998: Proceedings of the Third Annual Conference, July 22-25, 1998, University of Wisconsin, Madison, Wisconsin, pages 731-734, San Francisco, 1998. Morgan Kaufman. [6] DH Wood. Determining superimposed permutation matrices from n2 partial readouts. In preparation. [7] R Deaton. J Chen, H Bi, M Garzon, H Rubin, DH Wood. A PCR-based protocol for in vitro selection of non-crosshybridizing oligonucleotides. These proceedings. [8] AA BenDor, et. al., Universal DNA tag systems: A combinatorial scheme. J Comp Biol 7,503, 2000. [9] BJ Rose, R Deaton, M Hagiya, and A Suyama. The fidelity of the tag- antitag system. Preliminary Proceedings of the 7th International Conference on DNA-Based Computing, 302-310, 2001. Also to appear in LNCS series, in press. [10] E Wurmbach, T Yuen, BJ Ebersole, SC Sealfon. Gonadotropin-releasing hormone receptor-coupled gene network organization. J Biol Chem Dec 14;276(50) 47195-201, 2001 [11] E Klarreic. Biologists join the dots. Nature, 413(6855):450-452, October 2001. [12] M Han, X Gao, JZ Su, and S Nie. Quantum-dot-tagged microbeads for multiplexed optical coding of biomolecules. Nature Biochemistry, 19:631-635, July 2001. [13] CL Taylor Clelland, D M P Morrow, and C Bancroft. Gene expression in prostate cancer; microarray analysis of tumor specimens and the LNCaP prostate tumor model series. American Journal of Human Genetics, 67(4):81, 2000. [14] CL Taylor Clelland, B Levy, J M McKie, A M V Duncan, K Hirschhorn, and C Bancroft. Cloning, and characterization of human PREB: a gene that maps to a genomic region associated with trisomy 2p syndrome. Mammalian Genome, 11(8):675681, August 2000.
Algorithms for Testing That Sets of DNA Words Concatenate without Secondary Structure Mirela Andronescu1 , Danielle Dees2 , Laura Slaybaugh3 , Yinglei Zhao1 , Anne Condon1 , Barry Cohen4 , and Steven Skiena4 1
4
University of British Columbia, The Department of Computer Science [email protected], [email protected], [email protected] 2 Georgia Institute of Technology, College of Computing [email protected] 3 Rose-Hulman Institute of Technology, Computer Science Department [email protected] State University of New York at Stony Brook, Computer Science Department [email protected], [email protected]
Abstract. We present an efficient algorithm for determining whether all molecules in a combinatorial set of DNA or RNA strands are structure free, and thus available for bonding to their Watson-Crick complements. This work is motivated by the goal of testing whether strands used in DNA computations or as molecular bar-codes are structure free, where the strands are concatenations of short words. We also present an algorithm for determining whether all words in S ∗ , for some finite set S of equi-length words, are structure-free.
1
Introduction
In search-and-prune DNA computations, many long, DNA strands are created from a small number of short strands, called words. For example, Braich et al. [1] use the words pairs (TATTCTCACCCATAA, CTATTTATATCCACC), (ACACTATCAACATCA, ACACCTAACTAAACT), (CCTTTACCTCAATAA, CTACCCTATTCTACT), (CTCCCAAATAACATT, ATCTTTAAATACCCC), (AACTTCACCCCTATA, TCCATTTCTCCATAT), (TCATATCAACTCCAC, TTTCTTCCATCACAT)
to construct 26 strands, namely those obtainable by taking one of the words from each pair, and concatenating these in pair order. (Since there are two strands per pair and 6 pairs in total, the number of strands obtainable in this way is 26 .) Word sets are carefully designed using computational or information-theoretic methods, so that the resulting long strands behave well in the computation. One
This material is based upon work supported by the U.S. National Science Foundation under Grant No. 0130108, by the National Sciences and the Engineering Research Council of Canada, and by the by the Defense Advanced Research Projects Agency (DARPA) and Air Force Research Laboratory, Air Force Materiel Command, USAF, under agreement number F30602-01-2-0555.
M. Hagiya and A. Ohuchi (Eds.): DNA8, LNCS 2568, pp. 182–195, 2003. c Springer-Verlag Berlin Heidelberg 2003
Algorithms for Testing
183
property of well-designed words is that the long strands formed from these words do not form secondary structures. For example, the design of Braich et al. uses a 3-letter alphabet, ensures that no sequence of length 8 appears more than once in any strand, and more. The success of the design rests (in part) on the hypothesis that words satisfying these design criteria form strands with no secondary structure. While this hypothesis seems plausible, to our knowledge there is currently no rigorous argument that supports the hypothesis, either for the design of Braich et al. or for any other word design currently employed in DNA computing. For this reason, an efficient algorithm that can test whether a given word set produces strands with no secondary structure would be valuable. With this motivation, we consider the following problem, which we call the structure freeness problem for combinatorial sets. We are given a list of t pre-designed pairs of words {w(i), w(i), ¯ 1 ≤ i ≤ t}. (Here the bar notation is not intended to represent Watson-Crick complementation). All words have the same length l, and are strings over {A, C, G, T } representing DNA strands with the start of the string corresponding to the 3’ end of the strand. Determine whether all of the 2t strands in the set S denoted by the regular expression (w(1) + w(1))(w(2) ¯ + w(2)) ¯ . . . (w(t) + w(t)) ¯ are structure free, that is, are predicted to have no secondary structure, according to the standard, pseudoknotfree, thermodynamic models. Zuker and Steigler [14] developed an efficient algorithm, based on dynamic programming, for determining the optimal (lowest energy) secondary structure of an RNA molecule. Their method can also be applied to DNA molecules, given suitable thermodynamic parameters [13]). The running time of their algorithm is O(n4 ) on a strand of length n, and an improved algorithm of Lyngso et al. [10] runs in time O(n3 ). If the algorithm of Lyngso et al. were applied to each of the words in S independently, the running time would be O(2t n3 ), where n = tl is the length of the strands in S. In Section 3 we describe an algorithm for the structure freeness problem for combinatorial sets that runs in time O(n3 ). The algorithm is a simple generalization of the algorithms of Zuker and Steigler and Lyngso et al. [14,10]. We also present experimental results that compare the performance of our algorithm with an exhaustive search approach to the structure freeness problem for combinatorial sets, and describe cases where we have found structures in previously reported word designs. Our algorithm easily generalizes to solve the following problem. Let Si be a set of strands, all having the same length li , for 1 ≤ i ≤ t, where the li are not restricted to be of the same length. Are all strands in the set S = S1 × S2 . . . St structure free? The running time of our algorithm for this extended problem is O(maxi |Si |2 n3 ), where here n = l1 + l2 + . . . + lt is the length of strands in S. The generalized algorithm can be used to verify structure freeness of strands in the combinatorial sets of Faulhammer et al. [5], and others. Our algorithm can also be used to verify that sets of molecular tags, or barcodes, such as those of Brenner et al. [3], are structure free. In this design, tags are constructed from the set of 8 4mer words
184
Mirela Andronescu et al. {TTAC, AATC, TACT, ATCA, ACAT, TCTA, CTTT, CAAA}.
This set of words is constructed over a 3-letter alphabet (G’s omitted), each word has exactly one “C”, and each word differs from the others in three of the four bases. Call this set S. The tags constructed by Brenner et al. are all of the 88 strands in the set S 8 . This example motivates the second problem studied in this paper. Suppose that in the future, Brenner et al. need more tags, and use strands from the set S 9 or S 10 . Even if all strands in the set S 8 are structure free, it might be possible that some strand in S 9 or S 10 has structure. Ideally, one would like to know that all words in S ∗ are structure free. Here, S ∗ is the set of strands obtained by concatenating zero or more copies of strands in S together. Note that S ∗ contains an infinite number of strands if S is not empty. The set S ∗ is often called the Kleene closure of S. Thus, we define the structure freeness problem for Kleene sets as follows. Given a set S of words, are all words in S ∗ structure free? In Section 4 we show that there is a constant m (depending on S) such that if some word of S ∗ has structure, then some word in S m has structure. This reduces the structure freeness problem for Kleene sets to the structure freeness problem for combinatorial sets. However, our bound on m is exponential in the size of S and the length of the words in S. Whether or not a better bound on m can be obtained is an interesting open question. Before getting to our algorithms in Sections 3 and 4, we provide background on thermodynamic models for calculating the free energy of RNA and DNA secondary structures in Section 2, along with an overview of the secondary structure prediction algorithm of Zuker and Steiglitz [14]. 1.1
Related Work
Our algorithm for determining structure freeness of combinatorial sets was already developed by Cohen and Skiena [4], but applied to a different problem in that work. They were interested in determining, among the RNA sequences coding for a given protein P , which has the most stable secondary structure? Other important related work concerns algorithms for predicting the secondary structure of a RNA or DNA strand. In contrast with the Zuker-Steigler algorithm which is the basis for our work and returns the free energy of the most stable structure accessible to a given strand, the partition function approach of McCaskill [11] measures the propensity of a strand to fold in terms of the sum of the Gibb’s factors (Z = exp(−∆G/RT )) of all folded structures. The quantity Z can be calculated in O(n3 ) time, using a dynamic programming algorithm. An extension of the approach used in our paper to use the partition function of McCaskill would provide more insight on the propensity of a strand to fold than does the “all or nothing” approximation of our current algorithm. We believe that the techniques described in our paper can be extended to the partition function approach, and view this as an important next step for this work.
Algorithms for Testing
185
Other thermodynamic models for DNA and RNA structure folding, that could be used as a basis for approaching the structure freeness problem for combinatorial sets, have been proposed by Hartemink et al. [7] and by Rose et al. [12]). In addition, Rose et al. [?] describe a thermodynamic model (based on a statistical zipper model), for estimating folding propensity of a mixture of DNA strands.
2
Background and Notation
Under the appropriate chemical conditions, an RNA or DNA strand may fold upon itself by forming intramolecular bonds between pairs of its bases, as illustrated in Figure 1 below. In what follows, if s = s1 s2 . . . sn is an RNA sequence and 1 ≤ i < j ≤ n, then i.j denotes the base-pairing of si with sj . A secondary structure of s is a set of base pairs such that each base is paired at most once. More precisely, for all i.j and i .j in the set, i = i if and only if j = j . A pseudoknot in a secondary structure is a pair of base pairs i.j, i .j in the structure with i < i < j < j . Throughout this work, we restrict our attention to secondary structures that have no pseudoknots. Hairpin loop
Multibranched loop
Bulge Stacked pairs
Internal loop External base
Fig. 1. Secondary structure of an RNA strand. The thick black line indicates the backbone and the thin lines indicate paired bases. We can classify loops formed by the bonding of base pairs in a structure according to the number of base pairs that they contain. A hairpin loop contains exactly one base pair. An internal loop contains exactly two base pairs. A bulge is an internal loop with one base from each of its two base pairs adjacent. A stacked pair is a loop formed by two consecutive base pairs (i, j) and (i + 1, j − 1). A multibranched loop is a loop that contains more than two base pairs. An external base is a base not contained in any loop. One base pair in any given loop is closest to the ends of RNA strand. This is known as the exterior or closing pair. All other pairs are interior. More precisely, the exterior pair is the one that maximizes j −i over all pairs i.j in the loop. Speaking qualitatively, bases that are bonded tend to stabilize the RNA, where as unpaired bases form destabilizing loops. The so-called free energy of a
186
Mirela Andronescu et al.
secondary structure, measures (in kcal/mole) the stability of a secondary structure at fixed temperature - the lower the free energy, the more stable the structure. The free energy of a folded RNA or DNA strand can be estimated as the sum of the free energies of its component loops, if the secondary structure contains no pseudoknots. Through thermodynamics experiments, it has been possible to estimate the free energy of common types of loops (see for example [13] for thermodynamic data for DNA). 2.1
Standard Free Energy Model and Notation
Computational methods for predicting the secondary structure of an RNA or DNA molecule are based on models of the free energy of loops. The parameters of these models are driven in part by current understanding of experimentally determined free energies, and in part by what can be incorporated into an efficient algorithm. The free energy of a loop depends on temperature; throughout we assume that the temperature is fixed. We next summarize the notation used to refer to the free energy of loops, along with some standard assumptions that are incorporated into loop free energy models. We refer to a model that satisfies all of our assumptions as a standard free energy model. – eSs (i, j). This function gives the free energy of a stacked pair that consists of i.j and (i+1).(j −1). eSs (i, j) depends on the bases involved in the stack. We use the notation e-Stack(a, b, c, d), where a, b, c, d ∈ {A, C, G, T }, to denote the free energy of a stacked pair involving ab (with the 3’ end at a) and cd (with the 3’ end at c, so that the pairs are (a, d) and (b, c)). Thus, for a strand s = s1 s2 . . . sn , eSs (i, j) = e-Stack(si , si+1 , sj−1 , sj ). Because stacked complementary base pairs are stabilizing, eSs values are negative if si is the Watson-Crick complement of sj and si+1 is the Watson-Crick complement of sj−1 . (The values may be negative in other cases, such as when one of the base pairs is G-U, sometimes called a “wobble pair”.) – eHs (i, j). This function gives the free energy of a hairpin loop closed by i.j. We assume that for all but a finite number of small cases, eHs (i, j) depends only on the length of the loop, si and sj , and on the unpaired bases adjacent to si and sj on the loop. In particular, eH(i, j) = e-Stack(si , si+1 , sj−1 , sj )+ e-Length(j − i − 1), for some function e-Length. Moreover, we assume that the function e-Length(j) grows at most linearly in j. – eLs (i, j, i , j ). This function gives the free energy of an internal loop or bulge with exterior pair i, j and interior pair i , j . We assume that eLs (i, j, i , j ) is given by e-Stack(si , si+1 , sj−1 , sj ) +e-Stack(sj , sj +1 , si −1 , si ) +e-Length(i − i − 1, j − j − 1) where we abuse notation slightly by using e-Length as a function with two parameters here, different from the function e-Length(·) used for hairpins, in this case growing at most linearly in i + j. We omit the free energy of multiloops for brevity in this abstract. The free energy of a strand s with respect to a fixed secondary structure F is
Algorithms for Testing
187
the sum of the free energies of the loops of F . Sometimes when the strand s is understood, it is convenient to refer simply to the free energy of the structure F . In this paper, we define the free energy of a strand s to be the minimum free energy of the strand, with respect to all structures F . (We note that this is a simplification; a better approach would be to define the free energy in terms of the sum of Gibb’s factors [11].) We say that a strand s is structure free (at a given fixed temperature) if its free energy is greater than 0. If the free energy of s is less than 0, we say that the strand s has structure. We note that our algorithm can trivially be modified to test whether any strand in a combinatorial set has free energy below any other threshold, too. 2.2
An Algorithm for Secondary Structure Prediction
Let Ws (j) be the minimum free energy taken over all structures of the strand s1 s2 . . . sj . Our goal is to compute Ws (n), which is the free energy of strand s. Zuker and Steigler [14] described a dynamic programming algorithm for computing Ws (j); their algorithm can easily be extended to produce a structure whose free energy is Ws (n). The algorithm is based on the following recurrences:
8 <0, for j = 0 Ws (j) = :min(Ws (j − 1),
min (Vs (i, j) + Ws (i − 1)), for j > 0.
1≤i<j
Here, Vs (i, j) is the free energy of the optimal structure for si . . . sj , assuming i.j forms a base pair in that structure, also expressible as a recurrence:
(
Vs (i, j) =
+∞ for i ≥ j min(eHs (i, j), eSs (i, j) + Vs (i + 1, j − 1), V BIs (i, j), V Ms (i, j)); for i < j
In turn, V BIs (i, j) is the free energy of the optimal structure for si . . . sj , assuming i.j closes a bulge or internal loop:
8 > <+∞ for j − i ≤ 1 V BIs (i, j) = > : min (eLs (i, j, i , j ) + Vs (i , j )) i .j i
V Ms (i, j) is the free energy of the optimal structure for si . . . sj , assuming i.j closes a multibranched loop (details omitted). The running time of the resulting for the above algorithm is O(n4 ). It can be improved to O(n3 ) using the method of Lyngso et al. [10].
3
Structure Freeness for Combinatorial Sets
In this section, we describe an algorithm for testing that all strands in a combinatorial set are structure free. The input to our algorithm is a list of words w(1), w(1), w(2), w(2), . . . w(t), w(t), each word has length l. Let S = {z1 z2 . . . zt |zi ∈ {w(i) or w(i)}}.
188
Mirela Andronescu et al.
Intuitively, the set S is the set of strands of length n = lt obtained by following a path in the graph of Figure 2 (first suggested by Lipton [9]) from the left end to the right end and concatenating the edge labels along the path.
Fig. 2. “Diamond Graph”: paths in the graph correspond to strands of S. While conceptually the algorithm is quite simple, the description uses a lot of notation that blurs the intuition. In Section 3.1 we first describe an algorithm for a very simple model of secondary structure formation, which captures the intuition. The details of our algorithm for the standard free energy model are presented in Section 3.2. 3.1
Algorithm for the No Repeated k-Strings Model
A simple model of RNA folding is the no repeated k-strings model (simplified from the staggered zipper model), which defines a sequence to have non-empty secondary structure if there is a string of length k that repeats without overlaps anywhere in the string. This captures the notion that long runs of stacked pairs are a primary source of secondary structure, and correspond to occurrences of a given substring and its reverse complement in sequence S. Avoiding the reverse complement instead of a repetition does not introduce any important algorithmic complexity. Cohen and Skiena [4] prove, under the no repeated k-strings model, that it is NP-complete to verify that there is at least one structure-free sequence in a combinatorial set generated in a similar fashion to the diamond graph above. Here, we show that verifying all are structure-free can be done in polynomial time. The distinction is exactly that of proving a given CNF-formula is satisfiable versus proving that it is a tautology. We can verify that all 2t sequences of length n = lt contain no repeated k-string in O(kn2 ) time. For each of the n starting positions in the sequence, there are at most two such positions in the “diamond graph” which generate the sequence starting from this position (either w(i) or w(i)). ¯ Given any two word/position pairs, we now walk forward a total of k characters, comparing the equality of the symbol on each path at every character. At most two such paths are active in each walk, because the paths meet at in-degree-2 vertices of the diamond graph. The existence of a length-k shared walk represents a repeated k-string in at least one sequence, and terminates the algorithm. We next enhance this basic approach for the more general class of secondary structures of the standard models.
Algorithms for Testing
3.2
189
Algorithm for the Free Energy Model
Let WS (n) be the minimum of Ws (n) (as defined in Section 2.2), taken over all s ∈ S. We present in this section an algorithm to compute WS (n). The algorithm runs in time O(n4 ). Using techniques of Lyngso et al. [10] the running time can be improved to O(n3 ). In describing our algorithm, we follow the approach of Section 2.2. Let Sj be the set of prefixes of length j of strands in S and let WS (j) be the minimum of Ws (j) taken over all s ∈ Sj . That is, WS (j) is the optimal energy of the strand in Sj , with the lowest energy secondary structure:
(
WS (j)
=
0, for j = 0, mins∈Sj Ws (j), for 0 < j ≤ n.
Roughly speaking, we would like to be able to express WS (j) in terms of WS (j − 1). It turns out to be more convenient to introduce some new functions to work with in our recurrences. We use word#(j) to refer to the index of the word to which base j of a string in S belongs. Thus, word#(j) = j/l , where l is the word length. Let S(T, j) be the subset of S in which the word containing the jth base is w(word#(j)). Intuitively, S(T, j) corresponds to the set of paths that go through the top of the diamond containing the jth base in Figure 2. Then, S(T, j) is {z1 z2 . . . zt |zi ∈ {w(i), w(i)} for i = word#(j) and zword#(j) = w(word#(j))}. Similarly, let S(B, j) be the subset of S in which the word containing the jth base is w(word#(j)). Intuitively, S(B, j) corresponds to the set of paths that go through the bottom of the diamond containing the jth base in Figure 2. Let WS (bj , j) be the minimum of Ws (j) for all s ∈ S(bj , j). Formally: WS (bj , j) =
Also, WS (j) =
min
s∈S(bj ,j)
Ws (j), for bj ∈ {T, B}.
WS (bj , j). So if we can calculate the WS (bj , j), we are
min
bj ∈{T,B}
done. It turns out to be easier to obtain recurrence for WS (bj , j) than for WS (j). Similarly, we use generalizations of the functions Vs , V BIs , in our recurrences. For example, we use VS (bi , bj , i, j) to denote mins∈S(bi ,bj ,i,j) Vs (i, j), where S(T, T, i, j) is the subset of S corresponding to the set of paths that go through the top of the diamond containing the ith base and the diamond containing the jth base. S(bi , bj , i, j) is defined similarly for other values of bi and bj . The base case is WS (b0 , 0) = 0, for b0 ∈ {T, B}. For j > 0 we have WS (bj , j)
= min
min
bj−1 ∈X(j−1)
min
WS (bj−1 , j − 1)
(bi ,bi−1 )∈X(i,j)
(VS (bi , bj , i, j) + WS (bi−1 , i − 1))
where X(j − 1) and X(i, j) are given by the tables of Figure 3. Due to space limitations, we do not describe further recurrences here.
190
Mirela Andronescu et al.
word#(j) X(j − 1) == word#(j − 1) yes {bj } no {∗}
word#(i) word#(i) X(i, j) == == word#(i − 1) word#(j) yes yes {(bj , bj )} yes no {(T, T ), (B, B)} no yes {(bj , ∗)} no no {(∗, ∗)}
Fig. 3. Tables for X(j − 1) and X(i, j). In the entries of the right hand column of each table, each ∗ may be replaced by a T or a B. 3.3
Experimental Results
We have implemented our algorithm, which we refer to as comfold in what follows. Our implementation uses Turner’s free energy parameters, as incorporated in the mfold algorithm [15]. At this version (1.0 alpha), there are still some small differences in the calculated energy values, compared with Zuker’s mfold or Vienna package’s RNAfold. Another difference is that comfold does not return suboptimal energies, as mfold does. We compared the running time performance of comfold with that of a simple (exponential time) exhaustive search algorithm, which we call exhaust v. The exhaust v algorithm uses the Vienna package’s library to fold each of the possible combinations of words, computes the energy for each, and then returns the combination that folds into the smallest energy. Figure 4 shows the running time of comfold compared to exhaust v, plotted on a logarithmic scale. Our results were obtained on a dual Pentium III 1GHz processor machine, with 1GB of RAM We measured the CPU time in seconds (y) when running comfold and exhaust v, for different number of groups (x) of randomly generated strands. For the left graph, we used 2 words of length 10 in each group and for the right graph we used 3 words of length 10 in each group. The graph indicates that the running time of exhaust v grows exponentially, while that of comfold grows polynomially. At this version of comfold, exhaust v is faster for a small number of groups. However, it is outperformed by comfold when the number of groups is 13 and 9 for the 2 words in a group set and the 3 words in a group set, respectively. Our results also show that for a set with 4 strands in a group, comfold is faster than exhaust v starting with 8 groups. We have also tested several carefully designed combinatorial sets for structure freeness, using our algorithms. The free energy results reported here in Table 1 are for both comfold and exhaust v. We note that the results reported here use the RNA free energy values at 37 degrees Celsius, rather than the DNA values. Every time we found that a set had structure, we computed the minimum free energy of the combination having the smallest minimum free energy. We calculated this strand’s DNA free energy by using Michael Zuker’s folder for DNA. The results are reported in Table 1, together with the CPU time in seconds for both comfold and exhaust v.
Algorithms for Testing 1e+06
191
100000
100000
10000
10000
CPU time (seconds)
CPU time (seconds)
1000 1000
100
10
100
10
1 1 0.1
0.1 exhaust_v comfold
exhaust_v comfold
0.01
0.01 4
6
8
10 12 Number of groups
14
16
18
20
3
4
5
6
7 8 Number of groups
9
10
11
12
Fig. 4. Performance of comfold compared to exhaust v. We measured the CPU time (seconds) for both comfold and exhaust v, for a variable number of groups, of 2 words each (left) and 3 words each (right). Combinatorial set (source) RNA mfe DNA mfe time comfold time exhaust v Braich et al.[1] 0 0 36.50 0.53 Braich et al.[2] 0 0 2,826.63 165,317.00 Brenner et al.[3] -0.10 0 1,027.25 6,851.59 Faulhammer et al.[5] -2.90 -2.20 444.01 63.95 Frutos et al.[6] -18.40 -11.80 1,062.31 7.31
Table 1. Results from testing some cited combinatorial sets for structure freeness.
Our results show that the combinatorial set of Braich et al.[1] described in the introduction is indeed structure free, as well as the set for solving the 20-variable 3-SAT problem with a DNA computer [2]. In contrast, one strand in the set of Brenner et al. did have a very slight negative energy (−0.10kcal/mol), namely, the strand TCTAATCATACTAATCCTTTTACTATCATTAC with corresponding structure ..((((.(((.(((.....))).))).)))) (here parentheses denote matching pairs, and dots denote unpaired bases). However, we obtained a positive DNA energy for this sequence. We also found a strand with negative free energy in the reported sets of Faulhammer et al.[5]. This is CTCTTACTCAATTCTTCTACCATATCAACATCT TAATAACATCCTCCACTTCACACTTAATTAAAATCTTCCCTCTTTACA CCTTACTTTCCATATACAAGTACATTCTCCCTACTCCTTCATAATCTT ATATTCTCAATATAATCACATACTTCTCCAACATTCCTTATCCCACAC ACATTTTAAATTTCACAA, that has an energy of −2.90kcal/mol for RNA, and an energy of −2.20kcal/mol for DNA. The sets of Frutos et al. [6] with two pairs of word labels contain the strand AACGGCATGAAGGCAATTCGCCTTCATGCGTT, with an RNA free energy of −18.40kcal/mol and a DNA free energy of −11.80kcal/mol.
192
Mirela Andronescu et al.
We note the tests reported here were done at a folding temperature of 37 degrees Celsius. The tests can be run at other folding temperatures, depending on the design requirements of the user.
4
Structure Freeness for Kleene Sets
In this section we provide an algorithm for the following problem: given a finite set S of words of equal length, are all words in S ∗ structure free? We call this the structure freeness problem for Kleene sets. We show that there is a constant m, which depends on S, such that if there is a word with structure in S ∗ , then there is a word with structure in S m . The constant m is bounded by exp(poly(|S|, l)), where l is the maximum length of the words in S. With the constant m in hand, the structure-freeness problem for Kleene sets is solvable using the method of Section 3. We prove the existence of m as follows. 1. There is a strand with structure in S ∗ if and only if there is a strand in S ∗ with a so-called energy bounded structure. We define what is an energy bounded structure in detail in Section 4.1, but the intuition is as follows. If there is a strand with structure in S ∗ that has a very long hairpin loop, we can remove whole words from the unpaired bases of the loop to obtain a shorter strand in S ∗ which also has structure, and the energy of the shorter hairpin is bounded. Other parts of the structure that contribute a high positive free energy to the structure can similarly be replaced by a hairpin with bounded energy. 2. The set of strands of S ∗ that have energy bounded structures is context free. Moreover, the size of the context free grammar that generates this set is bounded by a polynomial in |S| and the maximum length l of the words in S. We note that for a given strand with an energy bounded structure, the optimal structure for this strand may not be an energy bounded structure. From this, in Theorem 1 we apply standard results on context free languages that if there is a strand in S ∗ that has structure, then there is such a strand of length at most exp(poly(|S|, l). 4.1
Energy Bounded Structures
A secondary structure F is E-energy bounded for a strand s if, with respect to s, no substructure of F has negative energy, and no substructure of F is expensive, i.e. has energy above some threshold E. Here, a substructure of F is any proper subset of F that contains all base pairs (i , j ) of F with i ≤ i ≤ j ≤ j, for some (i, j) in F , and contains no other base pairs. We call this the substructure of F that is bounded by (i, j). We say that a strand s has E-energy bounded structure if the free energy of some E-energy bounded structure is less than 0.
Algorithms for Testing
193
Lemma 1. Let S be a set of strands. There exists a constant E that grows at most linearly in the length l of words in S such that the following is true: There is a strand with structure in S ∗ if and only if there is a strand with E-energy bounded structure in S ∗ . One direction of the proof is easy: regardless of the value of E, if there is a strand with E-energy bounded structure in S ∗ , then trivially this strand is a strand with structure in S ∗ . The proof of the other direction is based on the fact that for suitable E, expensive substructures can be “cut” out of a structure, and replaced by E-energy bounded structures. 4.2
The Language of Strands with Energy Bounded Structures Is Context Free
There is a context free grammar that generates the language of strands with energy bounded structures. Lemma 2. The language of strands with E-energy bounded structures, when the energy is measured according to the standard energy assumptions, is context free. There is a context free grammar that generates this language which has a number of nonterminals linear in E, in which each production has bounded length (independent of E). Proof. The proof provides a context free grammar for the language of strands with energy bounded structures. The terminals of the grammar are {A, C, G, T }, and the nonterminals generate structures with fixed energy values. First, we consider a simple case, namely how to generate energy bounded hairpins. Specifically, we focus on developing a context free grammar that generates the set of all possible strings that can form a hairpin loop (with no dangling ends) that is closed by the base pair (t, t¯) and has energy e. Call this set H(t, e). We will use the nonterminal Ht,e to generate the set H(t, e). Since H(t, e) is finite, we could simply have one production from Ht,e that directly generates each string in H(t, e). However, according to the standard energy model, other than a few special cases (such as tri-loops or tetra-loops), the free energy of a hairpin formed by pairing the outside bases in the string tau1 u2 . . . uj bt¯ (where t, a, b and ui , 1 ≤ i ≤ j are in {A, C, G, T }) can be expressed as the sum of two terms, namely a stacking energy term, e-Stack(t, a, b, ¯t), and a length term e-Length(j), where j + 2 is the number of unpaired bases in the hairpin. By taking advantage of this, fewer rules are needed. Specifically, from Ht,e , we add rules of the form: Ht,e → taUj−2 bt¯ for each a, b ∈ {A, C, G, T } for which there exists a j for which e − e-Stack(t, a, b, t¯) = e-Length(j). Here, Uj−2 is a nonterminal that generates all sequences of j − 2 bases: for each t ∈ {A, C, G, T } and 1 < i ≤ j, we add the rules Ui → tUi−1 and U1 → t.
194
Mirela Andronescu et al.
The total number of rules generated from Ht,e is a constant independent of e. In addition, the number of nonterminals Ui is approximately e-Length−1 (e). Generalizing from the case of hairpins, we need other new nonterminals in our grammar that generate different types of structures. Mirroring the notation used in the recurrence relations of Section 2.2, we use the following nonterminals (details omitted): – We : generates the set of strings that can form an E-energy-bounded structure with energy e. – Vt,e : generates the set of strings that can form an E-energy bounded structure that is closed by the base pair (t, t¯) and has energy e; – It,e : generates the set of strings that can form an E-energy-bounded structure with energy e, the outermost loop of which is an interior loop (other than stacked pair) that is closed by the base pair (t, t¯). – Mt,e : generates the set of strings that can form an E-energy bounded structure with energy e, the outermost loop of which is a multi-loop that is closed by the base pair (t, t¯). All of the productions above have length that is bounded (there is a maximum of nine symbols on the right hand side of any rule). Lemma 3. Let S be a set of strands, each of length l. Let L be the language of strands in S ∗ with E-energy bounded structures. Then L is context free, and there is a context free grammar that generates L, for which the number of nonterminals is O(E(l|S|)3 ) and each rule has bounded length (independent of E, l, and S). The proof of this lemma follows from classical results of automata theory, that the intersection of a context free language and a regular language is context free (details omitted). The main theorem of this section follows from the previous lemmas, together with classical results from automata theory. Theorem 1. There is a constant m, which depends on S, such that if there is a word with structure in S ∗ , then there is a word with structure in S m . The constant m is bounded by exp(poly(|S|, l)), where l is the length of words in S.
5
Conclusions
We present an efficient algorithm for determining structure freeness of combinatorial sets. The algorithm should prove useful in verifying the quality of word sets designed for DNA and RNA computations. An important direction for future work is to use partition functions to cover the range of alternative structures. Another direction for future work is to study whether our algorithm can be generalized to determine structure freeness of more general sets of strands, such as those used in Adleman’s Hamiltonian graph experiment.
Algorithms for Testing
195
References 1. Braich, R. S., C. Johnson, P. W.K. Rothemund, D. Hwang, N. Chelyapov and L. M. Adleman. Solution of a satisfiability problem on a gel-based DNA computer. Proceedings of the 6th International Conference on DNA Computation SpringerVerlag LNCS, vol. 2054, 2000, pages 27-41. 2. Braich, R. S., Chelyapov, N., Johnson, C., Rothemund, P. W.K. and Adleman, L. Solution of a 20-variable 3-SAT Problem on a DNA computer. Science 296, 2002, 499-502. 3. Brenner, S., Williams, R. S., Vermaas, E. H., Storck, T., Moon, K., McCollum, C., Mao, J-I., Luo, S., Kirchner, J. J., Eletr S., DuBridge, R. B., Burcham, T., and Albrecht. G. In vitro cloning of complex mixtures of DNA on microbeads: Physical separation of deferentially expressed cDNAs. Proceedings of the National Academy of Sciences of the United States of America 2000 February 15; 97(4): 1665-1670. 4. Cohen, B. and S. Skiena. Designing RNA Sequences: Natural and Artificial Selection, Proc. 6th Int. Conf. Computational Molecular Biology (RECOMB ’02). 5. Faulhammer, D., Cukras, A. R., Lipton, R.J., and Landweber, L.F. Molecular computation: RNA solutions to chess problems. Proc. Natl. Acad. Sci. USA, 97: 1385-1389. 6. Frutos, A. G., Liu, Q., Thiel, A. J., Sanner, A. M. W., Condon, A. E., Smith, L. M., and Corn, R. M. Demonstration of a Word Design Strategy for DNA Computing on Surfaces. Nucleic Acids Research, 25 4748 (1997). 7. A.J. Hartemink and D. K. Gifford, Thermodynamic simulation of deoxyoligonucleotide hybridization. Prel. Proc. 3rd DIMACS Workshop on DNA Based Computers, June 23-27, 1997, U. Penn., pages 15-25. 8. I. L. Hofacker, W. Fontana, P. F. Stadler, L. S. Bonhoeffer, M. Tacker, and P. Schuster, Fast Folding and Comparison of RNA Secondary Structures. Monatsh.Chem. 125, 1994, 167-188. 9. R. Lipton, DNA solution of hard computational problems Science 268 (1995), 542545. 10. Lyngso, R. B., Zuker, M., and Pedersen, C. N. S. Internal Loops in RNA Secondary Structure Prediction. Proc. Third International Conference in Computational Molecular Biology, pages 260-267, April 1999. 11. J.S. McCaskill, The equilibrium partition function and base pair binding probabilities for RNA secondary structure. Biopolymers, Vol 29, pages 1105-1119, 1990. 12. J. A. Rose, R. Deaton, D. R. Franceschetti, M. Garzon, and S. E. Stevens, Jr., A statistical mechanical treatment of error in the annealing biostep of DNA computation. Special program in DNA and Molecular Computing at the Genetic and Evolutionary Computation Conference (GECCO-99), Orlando, FL., July 13-17, 1999, Morgan Kaufmann. 13. SantaLucia, Jr., J. A Unified View of Polymer, Dumbell, and Oligonucleotide DNA Nearest-Neighbor Thermodynamics. Proc. Natl. Acad. Sci. 1998, 95, 1460. 14. Zuker, M. and Steigler, P. Optimal Computer Folding of Large RNA Sequences using Thermodynamics and Auxiliary Information. Nucleic Acids Research, 9, (1981), pages 133-148. 15. Zuker, M., D.H. Mathews, and D.H. Turner, Algorithms and Thermodynamics for RNA Secondary Structure Prediction: A Practical Guide. In RNA Biochemistry and Biotechnology, J. Barciszewski and B.F.C. Clark, eds., NATO ASI Series, Kluwer Academic Publishers, Dordrecht, NL, 1999, pages 11-43.
A PCR-based Protocol for In Vitro Selection of Non-crosshybridizing Oligonucleotides Russell Deaton1 , Junghuei Chen2 , Hong Bi2 , Max Garzon3 , Harvey Rubin4 , and David Harlan Wood5 1
5
Computer Science and Engineering, University of Arkansas Fayetteville, AR, USA 72701 [email protected] http://www.ai.uark.edu 2 Chemistry and Biochemistry, University of Delaware Newark, DE, USA 19716 [email protected], [email protected] 3 Computer Science, University of Memphis Memphis, TN, USA 38152-3240 [email protected] 4 School of Medicine, University of Pennsylvania Philadelphia, PA, USA 19104 [email protected] Computer and Information Science, University of Delaware Newark, DE, USA 19716 [email protected]
Abstract. DNA computing often requires oligonucleotides that do not produce erroneous cross-hybridizations. By using in vitro evolution, huge libraries of non-crosshybridizing oligonucleotides might be evolved in the test tube. As a first step, a fitness function that corresponds to noncrosshybridization has to be implemented in an experimental protocol. Therefore, a modified version of PCR that selects non-crosshybridizing oligonucleotides was designed and tested. Experiments confirmed that the PCR-based protocol did amplify maximally mismatched oligonucleotides selectively