Theory of Computation p.1/?? Theory of Computation p.2/?? A Turing machine can do everything that any computing

Similar documents
Variants of Turing Machines

Theory of Languages and Automata

Outline. Language Hierarchy

CISC 4090 Theory of Computation

Turing Machines. A transducer is a finite state machine (FST) whose output is a string and not just accept or reject.

CS21 Decidability and Tractability

CSE 105 THEORY OF COMPUTATION

pp Variants of Turing Machines (Sec. 3.2)

Equivalence of NTMs and TMs

Closure Properties of CFLs; Introducing TMs. CS154 Chris Pollett Apr 9, 2007.

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION

Turing Machines, continued

ECS 120 Lesson 16 Turing Machines, Pt. 2

TAFL 1 (ECS-403) Unit- V. 5.1 Turing Machine. 5.2 TM as computer of Integer Function

Computability and Complexity

Introduction to Computers & Programming

Enumerations and Turing Machines

Limitations of Algorithmic Solvability In this Chapter we investigate the power of algorithms to solve problems Some can be solved algorithmically and

Theory of Computation, Homework 3 Sample Solution

Actually talking about Turing machines this time

CT32 COMPUTER NETWORKS DEC 2015

COMP 382: Reasoning about algorithms

CS5371 Theory of Computation. Lecture 8: Automata Theory VI (PDA, PDA = CFG)

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2016

Computer Sciences Department

Recursively Enumerable Languages, Turing Machines, and Decidability

CS402 - Theory of Automata Glossary By

CS 125 Section #4 RAMs and TMs 9/27/16

Does this program exist? Limits of computability. Does this program exist? A helper function. For example, if the string program is

14.1 Encoding for different models of computation

Theory Bridge Exam Example Questions Version of June 6, 2008

Decidable Problems. We examine the problems for which there is an algorithm.

Theory of Computations Spring 2016 Practice Final Exam Solutions

Limits of Computation p.1/?? Limits of Computation p.2/??

Midterm Exam II CIS 341: Foundations of Computer Science II Spring 2006, day section Prof. Marvin K. Nakayama

Finite Automata. Dr. Nadeem Akhtar. Assistant Professor Department of Computer Science & IT The Islamia University of Bahawalpur

Theory of Programming Languages COMP360

R10 SET a) Construct a DFA that accepts an identifier of a C programming language. b) Differentiate between NFA and DFA?

Chapter 14: Pushdown Automata

Turing Machine Languages

(a) R=01[((10)*+111)*+0]*1 (b) ((01+10)*00)*. [8+8] 4. (a) Find the left most and right most derivations for the word abba in the grammar

Name: CS 341 Practice Final Exam. 1 a 20 b 20 c 20 d 20 e 20 f 20 g Total 207

Lecture 7: Primitive Recursion is Turing Computable. Michael Beeson


1 Parsing (25 pts, 5 each)

Source of Slides: Introduction to Automata Theory, Languages, and Computation By John E. Hopcroft, Rajeev Motwani and Jeffrey D.

Formal Languages and Compilers Lecture IV: Regular Languages and Finite. Finite Automata

Final Course Review. Reading: Chapters 1-9

Lecture 18: Turing Machines

We can create PDAs with multiple stacks. At each step we look at the current state, the current input symbol, and the top of each stack.

Assignment 4 CSE 517: Natural Language Processing


(Refer Slide Time: 0:19)

Languages and Models of Computation

CS 275 Automata and Formal Language Theory. First Problem of URMs. (a) Definition of the Turing Machine. III.3 (a) Definition of the Turing Machine

lec3:nondeterministic finite state automata

PDA s. and Formal Languages. Automata Theory CS 573. Outline of equivalence of PDA s and CFG s. (see Theorem 5.3)

05. Turing Machines and Spacetime. I. Turing Machines and Classical Computability.

CSCI 340: Computational Models. Turing Machines. Department of Computer Science

Automata & languages. A primer on the Theory of Computation. The imitation game (2014) Benedict Cumberbatch Alan Turing ( ) Laurent Vanbever

CpSc 421 Final Solutions

1. (10 points) Draw the state diagram of the DFA that recognizes the language over Σ = {0, 1}

I have read and understand all of the instructions below, and I will obey the Academic Honor Code.

QUESTION BANK. Formal Languages and Automata Theory(10CS56)

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018

Problems, Languages, Machines, Computability, Complexity

1. Draw the state graphs for the finite automata which accept sets of strings composed of zeros and ones which:

Last lecture CMSC330. This lecture. Finite Automata: States. Finite Automata. Implementing Regular Expressions. Languages. Regular expressions

CSE 105 THEORY OF COMPUTATION

Formal Definition of Computation. Formal Definition of Computation p.1/28

Theory of Computations Spring 2016 Practice Final

Context Free Languages and Pushdown Automata

Multiple Choice Questions

University of Nevada, Las Vegas Computer Science 456/656 Fall 2016

Skyup's Media. PART-B 2) Construct a Mealy machine which is equivalent to the Moore machine given in table.

Lecture 2 Finite Automata

Limited Automata and Unary Languages

Lec-5-HW-1, TM basics

Final Exam 1, CS154. April 21, 2010

2.8 Universal Turing Machines and the Halting Problem

THEORY OF COMPUTATION

A Characterization of the Chomsky Hierarchy by String Turing Machines

Theory of Computation

Denotational semantics

COMP Logic for Computer Scientists. Lecture 25

2. Lexical Analysis! Prof. O. Nierstrasz!

Regular Languages (14 points) Solution: Problem 1 (6 points) Minimize the following automaton M. Show that the resulting DFA is minimal.

Storage capacity of labeled graphs

Definition 2.8: A CFG is in Chomsky normal form if every rule. only appear on the left-hand side, we allow the rule S ǫ.

Regular Languages and Regular Expressions

UNIT I PART A PART B

Ambiguous Grammars and Compactification

COMPUTABILITY THEORY AND RECURSIVELY ENUMERABLE SETS

Theory of Computation Dr. Weiss Extra Practice Exam Solutions

Chapter 4 Turing Machines

The Turing Machine. Unsolvable Problems. Undecidability. The Church-Turing Thesis (1936) Decision Problem. Decision Problems

Midterm Exam. CSCI 3136: Principles of Programming Languages. February 20, Group 2

The Big Picture. Chapter 3

About the Tutorial. Audience. Prerequisites. Copyright & Disclaimer. Compiler Design

Transcription:

Turing Machines A Turing machine is similar to a finite automaton with supply of unlimited memory. A Turing machine can do everything that any computing device can do. There exist problems that even a Turing machine cannot solve. Theory of Computation p.2/?? TM versus FA, PDA 1. write: A TM tape allows both write and read operations. DFA and NFA have only an input tape which is read-only and the tape head moves from left to right. PDA has both an input tape and a stack tape. We can write and read on the stack tape: when the head moves right, it writes; when the head moves left, it erases the current symbol. 2. size: The tape of a TM is infinite; the input tape of FA and PDA is finite; the stack tape of PDA is infinite. 3. accept: FA and PAD accept a string when it has scanned all the input symbols and enters a final state; TM accepts a string as long as it enters a final state (one suffices). Theory of Computation p.4/?? 22c:135 Theory of Computation Hantao Zhang http://www.cs.uiowa.edu/ hzhang/c135 The University of Iowa Department of Computer Science Theory of Computation p.1/?? Tape of a Turing Machine (TM) Memory is modeled by a tape of symbols. Initially the tape contains only the input string and is blank everywhere else. If a TM needs to store info, it may write on the tape. To read the info that it has written, TM can move its head back. TM continues to move until it enters a state whose next move is not defined. Theory of Computation p.3/??

Example TM computation Construct a TM M1 that tests the membership in the language L1 = {w#w w {0, 1} } s0: if first symbol is 0 or 1, replace it by x, remember it as a; if it is #, goto s5; else reject; s1(a): move right until #; if no # before, reject; s2(a): move right until 0 or 1; if the current symbol is the same as a, then replace it by x; else reject; s3: move left until #; s4: move left until x and goto s0; s5: move right until 0, 1, or ; accept if ; reject if 0, 1. Theory of Computation p.6/?? Computations M = (Q, Σ, Γ,δ,q0,qaccpt,qreject) computes as follows: M receives as input w = a1a2...an Σ, ai Σ, written on the leftmost squares of the tape and the rest of the tape is blank (i.e., filled with ) The head starts on the leftmost square of the tape. The first blank encountered shows the end of the input. Once it starts, it proceeds by the rules defined by δ. If M ever tries to move to the left of the leftmost square the head stays in the leftmost square even though δ indicates L. The computation continues until M cannot move; if M enters qaccept, the input string is accepted. M may go on forever as long as δ is defined. Theory of Computation p.8/?? Example TM computation Construct a TM M1 that tests the membership in the language L1 = {w#w w {0, 1} } In other words: we want to design M1 such that M1(w) = accept iff w L1 Theory of Computation p.5/?? Formal definition A Turing machine is a 7-tuple M = (Q, Σ, Γ,δ,q0,qaccpt,qreject) where Q, Σ, Γ are finite sets and 1. Q is a set of states 2. Σ is the input alphabet and Σ 3. Γ is the tape alphabet, Γ, Σ Γ 4. δ : Q Γ Q Γ {L, R} is the transition function 5. q0 Q is the initial state 6. qaccept Q is the accept state (sometimes denoted qa) 7. qreject Q is the reject state (sometimes denoted qr) Note: qreject is optional in the definition. Theory of Computation p.7/??

Example TM computation s3: move left until #; δ(s3,a) = s3,a,l, where a {0, 1,x},δ(s3, #) = s4, #,L s4: move left until x and goto s0; δ(s4,a) = s4,a,l, where a {0, 1},δ(s4,x) = s0,x,r s5: move right until 0, 1, or ; accept if ; reject if 0, 1. δ(s5,x) = s5,x,r,δ(s5, ) = sa,,l Theory of Computation p.10/?? Formalizing TM computation A configuration C1 yields a configuration C2 if the TM can legally go from C1 to C2 in a single computation step Formally: suppose a,b,c Γ, u,v Γ and qi,qj Q. 1. We say that ua qi bv yields uac qj v if δ(qi,b) = (qj,c,r); (machine moves rightward) 2. We say that ua qi bv yields u qj acv if δ(qi,b) = (qj,c,l); (machine moves leftward) Theory of Computation p.12/?? Example TM computation s0: if first symbol is 0 or 1, replace it by x, remember it as a; if it is #, goto s5; else reject; δ(s0, 0) = s1(0),x,r,δ(s0, 1) = s1(1),x,r,δ(s0, #) = s5,x,r s1(a): move right until #; if no # before, reject; δ(s1(a), 0) = s1(a), 0,R,δ(s1(a), 1) = s1(a), 1,R,δ(s1(a), #) = s2(a), #,R s2(a): move right until 0 or 1; if the current symbol is the same as a, then replace it by x; else reject; δ(s2(a),x) = s2(a),x,r,δ(s2(0), 0) = s3,x,l,δ(s2(1), 1) = s3,x,l ; Theory of Computation p.9/?? Configuration A configuration C of M is a tuple C = u,q,v, where q Q, uv Γ is the tape content and the head is pointing to the first symbol of v. Configurations are used to formalize machine computation and therefore are represented by special symbols. Tape contains only following the last symbol of v. Theory of Computation p.11/??

Example 2 M2 is a Turing machine that decides A = {0 2n n 0}. some elementary M2="On input string w 1. Sweep left to right across the tape, crossing off every other 0; if the number of 0 is odd, reject; 2. If in stage 1 the tape contained a signle 0, accept. 3. Return the head to the left end of the tape. 4. Go to stage 1. Theory of Computation p.14/?? Special configurations If the input of M is w and initial state is q0 then q0 w is the start configuration. ua qacceptbv is called accepting configuration. ua qrejectbv is called rejecting configuration. ua qcv, where δ(q, c) is undefined, is also called rejecting configuration. Accepting and rejecting configurations are also called halting configurations Theory of Computation p.16/?? Head at one input end Given M = (Q, Σ, Γ,δ,q0,qaccpt,qreject) For the left end: the configuration qi bv yields qj cv if the transition is left moving, i.e., δ(qi, b) = (qj, c, L) the configuration qi bv yields c qj v for the right moving transition, i.e., δ(qi, b) = (qj, c, R) For the right-hand end: the configuration ua qi is equivalent to ua qi because we assume that blanks follow the part of the tape represented in configuration. Hence we can handle this case as the previous Theory of Computation p.13/?? Example 2 1. Sweep left to right across the tape, crossing off every other 0; if the number of 0 is odd, reject; (a) Mark the first 0 by A: δ(q1, 0) = q2, A, R (b) Cross off the next 0 after A: δ(q2, 0) = q3, x, R (c) Pass 0 at odd position; cross off 0 at even position. δ(q3, 0) = q4, 0, R, δ(q4, 0) = q3, x, R, (d) x is invisible to {q2, q3, q4}: δ(q, x) = q, x, R for q {q2, q3, q4}. (e) If the number of 0 is odd, reject: (δ(q4, ) = qr,, R ) 2. If in stage 1 the tape contained a signle 0, accept: δ(q2, ) = qa,, R 3. Return the head to the left end of the tape: δ(q3, ) = q5,, L, δ(q5, a) = q5, a, L for a {0, x}. 4. Go to stage 1 (b): δ(q5, A) = q2, A, R. Theory of Computation p.15/??

Language of M L(M) = {w Σ M accepts w} Turing-recognizable language: A language L is Turing-recognizable if there is a Turing machine M that recognizes it. Theory of Computation p.18/?? Fail to accept TM fails to accept w by entering qreject and thus rejecting, or by looping Sometimes it is difficult to distinguish a machine that fail to accept from one that merely takes long-time to halt. Theory of Computation p.20/?? Accepting an input w A Turing machine M accepts the input w if a sequence of configurations C1,C2,...,Cn exists such that: 1. C1 is the start configuration, C1 = (ǫ,q0,w) 2. Each Ci yields Ci+1,i = 1, 2,...,n 1 3. Cn is an accepting configuration. Theory of Computation p.17/?? Note When we start a TM on an input w three cases can happen: 1. TM may accept w 2. TM may reject w 3. TM may loop indefinitely, i.e., TM does not halt. Note: looping does not mean that machine repeats the same steps over and over again; looping may entail any simple or complex behavior that never leads to a halting state. Question: is this real? I.e., can you indicate a computation that takes infinite many steps without repetition? Theory of Computation p.19/??

Turing-decidability A decider that recognizes some language is also said to decide that language A language is called Turing-decidable or simply decidable if some TM decides it. Theory of Computation p.22/?? Higher Level Descriptions We can give a formal description of a particular TM by specifying each of its seven components Defining δ can become cumbersome. To avoid this we use higher level descriptions which are precise enough for the purpose of understanding We want be sure that every higher level description is actually just a short hand for its formal counterpart. Theory of Computation p.24/?? Decider A TM that halts on all inputs is called a decider. Theory of Computation p.21/?? Note Any regular language is Turing-decidable. Any context-free language is Turing-decidable. Every decidable language is Turing-recognizable (a language is Turing-recognizable if it is recognized by a TM). Certain Turing-recognizable languages are not decidable (to be decidable means to be recognized by a TM which halts on all inputs) Theory of Computation p.23/??

Analyzing M3 In stage 1 M3 operates as a finite automaton; no writing is necessary as the head moves from left to right: 1. δ(q0, ) = (qa,, R), δ(q0, b) = (q4, b, R) 2. δ(q0, a) = (q1, A, R),δ(q1, b) = (q2, b, R), δ(q1, ) = (qa,, R) 3. δ(q2, b) = (q2, b, R), δ(q2, c) = (q3, c, R) 4. δ(q3, c) = (q3, c, R) 5. δ(q4, b) = (q4, b, R), δ(q4, ) = (qa,, R), Theory of Computation p.26/?? Stage 3 cross a δ(q5,a) = (q6,,r) δ(q6,a) = (q7,a,r) δ(q6,b) = (q8,b,l), δ(q8, ) = (q7,e,r) δ(q7,a) = (q7,a,r), δ(q7,b) = (q7,b,r), δ(q7,b) = (q9,b,r) δ(q9,b) = (q9,b,r), δ(q9,c) = (q9,c,r), δ(q9,c) = (q10,c,l) Theory of Computation p.28/?? Example 3 M3 is a Turing machine that performs some elementary arithmetic. It decides the language C = {a i b j c k i j = k,i,j,k 0} M3="On input string w 1. Scan the input from left to right to be sure that it is a member of a b c ; reject if it is not; accept if it is ǫ, a + or b +. 2. Set the head pointing at the first a on the tape 3. Cross off an a and scan to the right until a b occurs. Shuttle between the b s and c s crossing off one of each until all b s are gone 4. Restores the crossed off b s and repeat stage 2 if there is another a to cross off. If all a s are crossed off, check on whether all c s are crossed off. If yes accept, otherwise reject." Theory of Computation p.25/?? Stage 2 finding the first a δ(q3, ) = (q5,,l) δ(q5,x) = (q5,x,l) for x {a,b,c} Theory of Computation p.27/??

Example 4 M4 = (Q, Σ, Γ,δ,qs,qa,qr) is the TM that solves the element distinctness problem M4 works by comparing x1 with x2,...,xk, then by comparing x2 with x3,...,xk, and so on Theory of Computation p.30/?? Marking tape symbols In stage two the machine places a mark above a symbol, # in this case. In the actual implementation the machine has two different symbols, # and # in the tape alphabet Σ Thus, when machine places a mark above symbol x it actually write the marked symbol of x at that location Removing the mark means write the symbol at the location where the marked symbol was. Assumption: all symbols of the tape alphabet have marked versions too Theory of Computation p.32/?? Element distinctness problem Given a list of strings over {0, 1} separated by #, determine if all strings are different. A TM that solves this problem accepts the language E = {#x1#x2#...#xk xi {0, 1}, xi xj for i j} Theory of Computation p.29/?? Informal description M4="On input w: 1. Place a mark on top of the leftmost tape symbol. If that symbol was a blank, accept. If that symbol was a # continue with the next stage. Otherwise reject. 2. Scan right to the next # and place a second mark on top of it. If no # is encountered before a blank symbol, only xk was present, so accept 3. By zig-zagging, compare the two strings to the right and to the left of the marked #. If they are equal, reject 4. Move the rightmost of the two marks to the next # symbol to the right. If no # symbol is encountered before a blank symbol, move the leftmost mark to the next # to its right and the rightmost mark to the # after that. This time if no # is available for the rightmost mark, all strings have been compared, so accept. 5. Go to stage 3" Theory of Computation p.31/??

Standardizing our model Question: What is the right level of detail to give when describing a Turing machine algorithm? Note: This is a common question asked especially when preparing solutions to various problems such as exercises and problems given in assignments and exams during the process of learning Theory of Computation Theory of Computation p.34/?? Equivalence of TMs To show that two models of TM are equivalent we need to show that we can simulate one by another. Theory of Computation p.36/?? High level operations of TMs Compare if two strings are the same or not. Compute the addtion, substraction, multiplication, division, power, log, etc. of numbers in unary form. Shift a string right (or left). Maintain a base-b counter. Theory of Computation p.33/?? Answer The three possibilities are: 1. Formal description: spells out in full all 7 components of a Turing machine. This is the lowest, most detailed level of description. 2. Implementation description: use English prose to describe the way Turing machine moves its head and the way it stores data on its tape. No details of state transitions are given 3. High-level description: use English prose to describe the algorithm, ignoring the implementation model. No need to mention how machine manages its head and tape. Theory of Computation p.35/??

Multitape Turing Machines A multitape TM is like a standard TM with several tapes Each tape has its own head for reading/writing Initially the input is on tape 1 and other tapes are blank Transition function allow for reading, writing, and moving the heads on all tapes simultaneously, i.e., δ : Q Γ k Q Γ k {L,R} k, where k is the number of tapes. δ(qi,a1,...,ak) = (qj,b1,...,bk,l,r,...,l) means that if the machine is in state qi and heads 1 though k are reading symbols a1 through ak the machine goes to state qj, writes b1 through bk on tapes 1 through k, respectively, and moves each head to the left or right as specified. Theory of Computation p.38/?? Multi-tape TM: An Example Let L = {0 a 1 b 2 c c = logab,a > 1,b > 0}. A three-tape TM: the input tape, the second tape containing x and the third tape containing k = 0, 1...,, where x = a k+1 : M = On w 1. Check if w 00 + 1 + 2 ; if not, Reject; 2. Copy all 0 s on the input tape to tape 2; 3. If number of 0 s on tape 2 exceeds number of 1 s on the input tape, go to step 6. 4. Multiple 0 s on tape 2 by number of zeros on the input tape and keep the result on tape 2. 5. Add a symbol 2, to tape 3; got to step 3. 6. If number of 2 s on tape 3 is the same as number of 2 s on the input tape, Accept; otherwise Reject. Theory of Computation p.40/?? Variants of Turing Machine Transition function of a standard TM in our definition forces the head to move to the left or right after each step. Let us vary the type of transition function permitted. Suppose that we allow the head to stay put, i.e.; δ : Q Γ Q Γ {L,R,S} S transition can be represented by two standard transitions: one that move to the left followed by one that moves to the right. Since we can convert a TM which stay put into one that doesn t have this facility, the extension does not increase its power. Theory of Computation p.37/?? Multi-tape TM: An Example Let L = {0 a 1 b 2 c c = logab,a > 1,b > 0}. Note that a c b < a c+1. We may use a three-tape TM: the input tape, the second tape containing x and the third tape containing k, where x = a k+1, based on the following algorithm: x = a; k = 0; while (x <= b) { x = x*a; k = k+1; } return k; Theory of Computation p.39/??

Simulating M with S Assume that M has k tapes S simulates the effect of k tapes by storing their information on its single tape S uses a new symbol # as a delimiter to separate the contents of different tapes S keeps track of the location of the heads by marking with a the symbols where the heads would be. Theory of Computation p.42/?? General Construction S = "On input w = a1a2...an 1. Put S(tape) in the format that represents M(tapes): S(tape) = # a1...an#...# # 2. Scan the tape from the first # (which represent the left end) to the (k + 1)-st # (which represent the right-hand end) to determine the symbols under the virtual heads. Then S makes the second pass over the tape to update it according to the way M s transition function dictates. 3. If at any time S moves one of the virtual heads to the right of # it means that M has moved on the corresponding tape onto the unread blank portion of that tape. So, S writes a on this tape cell and shifts the tape contents from this cell until the rightmost #, one unit to the right. Then it continues to simulates as before". Theory of Computation p.44/?? Theorem 3.13 Every multitape Turing machine has an equivalent single tape Turing machine. Proof: We show how to convert a multitape TM M into a single tape TM S. The key idea is to show how to simulate M with S. Theory of Computation p.41/?? Example simulation Figure 1 shows how to represent a machine with 3 tapes by a machine with one tape. M 0 1 0 1 0... b a... b a... S # 0 1 0 1 0 # b a # b a #... Figure 1: Multitape machine simulation Theory of Computation p.43/??

Nondeterministic TM A NTM is defined in the expected way: at any point in a computation the machine may proceed according to several possibilities Formally, δ : Q Γ P(Q Γ {L,R}) Computation performed by a NTM is a tree whose branches correspond to different possibilities for the machine If some branch of the computation tree leads to the accept state, the machine accepts the input Theory of Computation p.46/?? More on NTM simulation N s computation on an input w is a tree, N(w). Each branch of N(w) represents one of the branches of the nondeterminism Each node of N(w) is a configuration of N. The root of N(w) is the start configuration Note: D searches N(w) for an accepting configuration Theory of Computation p.48/?? Corollary 3.15 A language is Turing recognizable iff some multitape Turing machine recognizes it Proof: if: a Turing recognizable language is recognized by an ordinary Turing machine, which is a special case of a multitape Turing machine. only if: follows from the equivalence of a Turing multitape machine M with the Turing machine S that simulates it. That is, if L is recognized by M then L is also recognized by S Theory of Computation p.45/?? Theorem 3.16 Every nondeterministic Turing machine, NTM, has an equivalent deterministic Turing machine, DTM. Proof idea: show that we can simulate a NTM N with DTM, D. Note: in this simulation D tries all possible branches of N s computation. If D ever finds the accept state on one of these branches then it accepts. Otherwise D simulation will not terminate Theory of Computation p.47/??

A better idea Design D to explore the tree by using a breadth-first search This strategy explores all branches at the same depth before going to explore any branch at the next depth. Hence, this method guarantees that D will visit every node of N(w) until it encounters an accepting configuration Theory of Computation p.50/?? Deterministic simulation of NTM D input tape 0 0 1 0... simulation tape x x # 1 x... address tape 1 2 3 3 2 3 1 2 1 1 3... Figure 2: Deterministic TM D simulating N Theory of Computation p.52/?? A tempting bad idea Design D to explore N(w) by a depth-first search A depth-first search goes all the way down on one branch before backing up to explore next branch. Hence, D could go forever down on an infinite branch and miss an accepting configuration on an other branch Theory of Computation p.49/?? Formal proof D has three tapes: 1. Tape 1 always contains the input (and the code of N) and is never altered. 2. Tape 2 (called simulation tape) maintains a copy of the N s tape on some branch of its nondeterministic computation 3. Tape 3 (called address tape) keeps track of D s location in N s nondeterministic computation tree Theory of Computation p.51/??

Note Each symbol in a node address tells us which choice to make next when simulating a step in one branch in N s nondeterministic computation Sometimes a symbol may not correspond to any choice if too few choices are available for a configuration. In that case the address is invalid and doesn t correspond to any node Tape 3 contains a string over Σb which represents a branch of N s computation from the root to the node addressed by that string, unless the address is invalid. The empty string ǫ is the address of the root. Theory of Computation p.54/?? Corollary 3.18 A language is Turing-recognizable iff some nondeterministic TM recognizes it. Proof: if: any deterministic TM is automatically an nondeterministic TM only if: follow from the fact that any NTM can be simulated by a DTM Theory of Computation p.56/?? Address tape Every node in N(w) can have at most b children, where b is the size of the largest set of possible choices given by N s transition function Hence, to every node we assign an address that is a string in the alphabet Σb = {1, 2,...,b}. Example: we assign the address 231 to the node reached by starting at the root, going to its second child and then going to that node s third child and then going to that node s first child Theory of Computation p.53/?? The description of D 1. Initially tape 1 contains w and tape 2 and 3 are empty 2. Copy tape 1 over tape 2 3. Use tape 2 to simulate N with input w on one branch of its nondeterministic computation. Before each step of N, consult the next symbol on tape 3 to determine which choice to make among those allowed by N s transition function If no more symbols remain on tape 3 or if this nondeterministic choice is invalid, abort this branch by going to stage 4. If a rejecting configuration is reached go to stage 4; if an accepting configuration is encountered, accept the input 4. Replace the string on tape 3 with the next string as if it is a counter and go to stage 2. Theory of Computation p.55/??

Enumerators An enumerator is a variant of a TM with an attached printer (or an output tape) The enumerator uses the printer as an output device to print strings Every time the TM wants to add a string to the list of recognized strings it sends it to the printer Note: Some people use the term recursively enumerable language for languages recognized by enumerators Theory of Computation p.58/?? Theorem 3.21 A language is Turing-recognizable iff some enumerator enumerates it Proof: if: if we have an enumerator E that enumerates a language A then a TM M recognizes A. M works as follows: M = "On input w: 1. Run E. Every time E outputs a string x, compare it with w. 2. If w = x, M accept; else go to 1. Clearly M accepts those strings that appear on E s list. Theory of Computation p.60/?? Corollary 3.19 A language is decidable iff some NTM decides it. Theory of Computation p.57/?? Computation of an Enumerator An enumerator starts with a blank input tape If the enumerator does not halt it may print an infinite list of strings The language recognized by the enumerator is the collection of strings that it eventually prints out. Note: an enumerator may generate the strings of the language it recognizes in any order, possibly with repetitions. Theory of Computation p.59/??

Another Proof only if: If M recognizes a language A, we can construct an enumerator E for A. For that consider s1,s2..., the list of all possible strings in Σ, where Σ is the alphabet of M. Given a pair of integers i,j, define Next( i,j ) = if (i = 1) then j + 1, 1 else i 1,j + 1. E = " 1. Let i, j = 1, 1. 2. Simulate M on sj at most i steps. 3. If M accepts sj with exactly i steps, prints out sj. 4. i, j = Next( i, j ), go to 2. Note: no string prints out more than once. Theory of Computation p.62/?? Algorithms Informally speaking an algorithm is a collection of simple instructions for carrying out a task. In everyday life algorithms are called procedures or recipes. Algorithms abound in contemporary mathematics. Theory of Computation p.64/?? Proof, continuation only if: If M recognizes a language A, we can construct an enumerator E for A. For that consider s1,s2..., the list of all possible strings in Σ, where Σ is the alphabet of M. E = " 1. Let i = 1. 2. For j = 1 to i, simulate M on sj at most i steps. 3. If M accepts sj with i steps or less, prints out sj. 4. i = i + 1, go to 2. Note: a string may print out multiple times. Theory of Computation p.61/?? Equivalence with other models There are many other models of general purpose computation. Example: recursive functions, normal algorithms, semi-thue systems, λ-calculus, etc. Some of these models are very much like Turing machines; other are quite different All share the essential feature of a TM: unrestricted access to unlimited memory All these models turn out to be equivalent in computation power with TM Theory of Computation p.63/??

Church-Turing Thesis Other formal definitions of algorithms have been provided by: Kleene using recursive functions, Markov using rewriting (derivation) rules with a grammar called normal algorithms. Essentially all these formal concepts of algorithm are equivalent among them and are equivalent with Turing Machines. Church-Turing Thesis: Every computing device can be simulated by a Turing machine. Theory of Computation p.66/?? Encoding and Decoding Objects Our notation for encoding an object O into its string representation is O. If we have several objects O1, O2,..., Ok we denote their encoding into a string by O1,O2,...,Ok. Encoding itself can be done in many ways. It doesn t matter which encoding we pick because a Turing machine can always translate one encoding into another. A (part of) Turing machine may be programmed to decode the input representation so that it can be interpreted the way we intend. Theory of Computation p.68/?? Algorithm as a Turing Machine Alonzo Church and Alan Turing in 1936 came with formal definitions for the concept of algorithm. Church used a notational system called λ-calculus to define algorithms. Turing used his Turing Machines" to define algorithms. These two definitions were shown to be equivalent. Theory of Computation p.65/?? Formal Definition Definition: an algorthm is a decider TM in the standard representation. The input to a Turing machine is always a string. If we want an object, other than a string as input, we must first represent that object as a string. Strings can easily represent polynomials, graphs, grammars, automata, and any combination of these objects. Theory of Computation p.67/??

A TM deciding A M = On input G, the encoding of G 1. Select the first node of G and mark it. 2. Repeat the following stage until no new nodes are marked. 3. For each node in G, mark it if it is attached by an edge to a node that is already marked. 4. Scan all the nodes of G to determine whether they all are marked. If they are accept; otherwise reject." Theory of Computation p.70/?? Graph encoding, G The encoding G of a graph as a string is a list of nodes followed by a list of edges. Each node is a decimal number, and each edge is a pair of decimal numbers that represent the nodes that edge. connects Example encoding: the graph in Figure 3 is encoded by the string: G = (1, 2, 3)((1, 2), (2, 3), (3, 1), (1, 4)). Theory of Computation p.72/?? Example TM Let A be the language consisting of all strings representing undirected graphs that are connected. Recall:a graph is connected if every node can be reached from every other node. Notation: A = { G G is a connected undirected graph}. Theory of Computation p.69/?? Implementation details Consider the graph: 4 1 3 2 Figure 3: A connected graph Theory of Computation p.71/??

Checking the encoding When M receives the input G it first checks to determine that the input is a proper encoding of some graph: 1. Scan the tape to be sure that there are two lists and that they are in proper form. 2. The first list should be a list of distinct decimal numbers; the second list should be a list of pairs of decimal numbers. 3. The list of decimal numbers should contain no repetitions. 4. Every node on the second list should appear in the first list too. Note: element distinctness problem can be used to formate the lists and to implement the checks above. Theory of Computation p.73/??