Welcome to CSE131b: Compiler Construction

Transcription

1 Welcome to CSE131b: Compiler Construction Lingjia Tang pic from:

2 Course Information What are compilers? Why do we learn about them? History of compilers Structure of compilers A bit info on course projects

3 Course Staff Instructor: Lingjia Tang (2108) TA: Xinxin Jing Tutors: Haronid Moncivais Miller and more

4

5 Dragon Book

6 Grading Polices Project Final Midterm 35% 45% 20%

7 Grading Polices Project Final Midterm Extra credits: 35% 45% Class participation Piazza participation Projects/exam extra credits 20%

8 Prerequisites CSE 70 / CSE 110 CSE 100 CSE 105 CSE 130

9 What is a compiler?

10 Compiler Compiler

11 Compiler program in source language Compiler

12 Compiler program in source language Compiler program in target language

13 Compiler program in source language Compiler program in target language Error message

14 Compiler Input program in source language Compiler program in target language Error message Output

15 Compiler Input program in source language Compiler program in target language Translates Error message Output

16 Compiler Input program in source language Compiler program in target language Translates Error message Output Typically lower the level of abstraction of the program

17 Compiler Input program in source language Compiler program in target language Translates Error message Output Typically lower the level of abstraction of the program High-level programming language -> machine code (C/C++ -> X86, etc)

18 Compiler Input program in source language Compiler program in target language Translates Error message Output Typically lower the level of abstraction of the program High-level programming language -> machine code (C/C++ -> X86, etc) We expect the program produced by the compiler to be better, (faster, consumes less memory, etc) than the original program

19 Compiler Input program in source language Compiler program in target language Error message Output

20 Compiler Input program in source language Compiler program in target language Error message Output Interpreter

21 Compiler Input program in source language Compiler program in target language Error message Output Interpreter Interpreter

22 Compiler Input program in source language Compiler program in target language Error message Output Interpreter Program Input Interpreter

23 Compiler Input program in source language Compiler program in target language Error message Output Interpreter Program Input Interpreter output

24 Compiler Input program in source language Compiler program in target language Static: before runtime Error message Output Interpreter Program Input Interpreter output

25 Compiler Input program in source language Compiler program in target language Static: before runtime Error message Output Interpreter Program Input Interpreter Dynamic: during runtime output

26 Compiler Input program in source language Compiler program in target language Static: before runtime Error message Output Interpreter Program Input Interpreter Dynamic: during runtime output Examples: python, shell, javascript, PHP

27 Hybrid Example: Java program in source language Compiler intermediate program Input output Virtual Machine

28 Hybrid Example: Java program in source language Compiler intermediate program Interpreter Input Just-in-time compiler native machine code output Garbage Collection Virtual Machine

29 Hybrid Example: Java program in source language Compiler intermediate program Static Interpreter Input Just-in-time compiler native machine code output Garbage Collection Virtual Machine

30 Hybrid Example: Java program in source language Compiler intermediate program Static Interpreter Input Just-in-time compiler native machine code output Garbage Collection Virtual Machine Runtime

31 Hybrid Example: Java Sacrifice efficiency for portability, safety and other dynamic features program in source language Compiler intermediate program Static Interpreter Input Just-in-time compiler native machine code output Garbage Collection Virtual Machine Runtime

32 Why Learning Compiler? Build awesome, complex software Theory meets practice remember DFA, CFG in CSE105? Understand how SW interacts with HW Understand program language designs and features

33 Why Learning Compiler? cont. My code runs faster than your code... consumes less power consumes less memory more reliable..

34 Why Learning Compiler? cont. Who use compilers? everyone! Who develop compilers? many many companies...

35 Why Learning Compiler? cont. Who use compilers? everyone! Who develop compilers? many many companies...

36 Why Learning Compiler? cont. Who use compilers? everyone! Who develop compilers? many many companies...

37 Why Learning Compiler? cont. Who use compilers? everyone! program in PHP Who develop compilers? many many companies... program in C++

38 Why Learning Compiler? cont. Who use compilers? everyone! program in PHP Who develop compilers? many many companies... program in C++

39 Goal of this course For you to become compiler NINJA!

40 History of Compiler Machine Language Assembly programming too time consuming

41 History of Compiler Machine Language Assembly programming too time consuming High-level language

42 pics from wikipedia

43 Grace Hopper pics from wikipedia

44 Grace Hopper conceptualized the idea of machineindependent programming languages COBOL - (1959) "Nobody believed that," she said. "I had a running compiler and nobody would touch it. They told me computers could only do arithmetic. pics from wikipedia

45 Grace Hopper conceptualized the idea of machineindependent programming languages COBOL - (1959) "Nobody believed that," she said. "I had a running compiler and nobody would touch it. They told me computers could only do arithmetic. John Backus Won ACM Turing Award for profound, influential, and lasting contributions to the design of practical high-level programming systems, notably through his work on FORTRAN" pics from wikipedia

46 saman amarasinghe s slide

47 Compilers: map high-level abstract language to assembly language saman amarasinghe s slide

48 Compilers: map high-level abstract language to assembly language Simple mapping of a program to assembly language produces inefficient execution Higher the level of abstraction, more inefficiency If not efficient, high-level abstractions are useless saman amarasinghe s slide

49 Compilers: map high-level abstract language to assembly language Simple mapping of a program to assembly language produces inefficient execution Higher the level of abstraction, more inefficiency If not efficient, high-level abstractions are useless Compilers need to: provide a high level abstraction with performance of giving low-level instruction bridge the efficiency gap b/t high-level PL and low-level processor/isas saman amarasinghe s slide

50 The Structure of a Modern Compiler Source Code Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization Machine Code

51 The Structure of a Modern Compiler Source Code Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization Front end Machine Code

52 The Structure of a Modern Compiler Source Code Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Back end Code Generation Optimization Machine Code

53 while (y < z) { int x = a + b; y += x; } Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization

54 while (y < z) { int x = a + b; y += x; } Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization Lexical analysis (Scanning): Identify logic pieces of the description.

55 while (y < z) { int x = a + b; y += x; } T_While T_LeftParen T_Identifier y T_Less T_Identifier z T_RightParen T_OpenBrace T_Int T_Identifier x T_Assign T_Identifier a T_Plus T_Identifier b T_Semicolon T_Identifier y T_PlusAssign T_Identifier x T_Semicolon T_CloseBrace Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization Lexical analysis (Scanning): Group sequence of characters into lexemes smallest meaningful entity in a language (keywords, identifiers, constants)

56 while (y < z) { int x = a + b; y += x; } T_While T_LeftParen T_Identifier y T_Less T_Identifier z T_RightParen T_OpenBrace T_Int T_Identifier x T_Assign T_Identifier a T_Plus T_Identifier b T_Semicolon T_Identifier y T_PlusAssign T_Identifier x T_Semicolon T_CloseBrace Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization Syntax analysis (Parsing): Identify how those pieces relate to each other

57 while (y < z) { int x = a + b; y += x; } While Sequence Lexical Analysis Syntax Analysis Semantic Analysis < = = IR Generation IR Optimization y z x + y + Code Generation Optimization a b y x Syntax analysis (Parsing): Convert a linear structure sequence of tokens to a hierarchical tree-like structure - abstract syntax tree (AST)

58 Syntax Analyzer (Parser) int * foo(i, j, k)) int i; int j; { for(i=0; i j) { fi(i>j) return j; } Not a keyword Extra parentheses Not an expression Missing increment Saman Amarasinghe MIT Fall 1998

59 while (y < z) { int x = a + b; y += x; } While Sequence Lexical Analysis Syntax Analysis Semantic Analysis < = = IR Generation IR Optimization y z x + y + Code Generation Optimization a b y x Semantic Analysis: Identify the meaning of the overall structure

60 while (y < z) { int x = a + b; y += x; } While void Lexical Analysis Syntax Analysis Sequence void Semantic Analysis < bool = int = int IR Generation IR Optimization y int z int x + int int y + int int Code Generation Optimization a b y x int int int int Semantic Analysis: Rules of the language are checked (variable declaration, type checking)

61 Semantic Analyzer int * foo(i, j, k) int i; int j; { int x; x = x + j + N; return j; Type not declared Mismatched return type Uninitialized variable used } Undeclared variable Saman Amarasinghe MIT Fall 1998

62 while (y < z) { int x = a + b; y += x; } While void Lexical Analysis Syntax Analysis Sequence void Semantic Analysis < bool = int = int IR Generation IR Optimization y int z int x + int int y + int int Code Generation Optimization a b y x int int int int Intermediate Representation (IR) Generation: Generate intermediate code

63 while (y < z) { int x = a + b; y += x; } Loop: x = a + b y = x + y _t1 = y < z if _t1 goto Loop Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization IR Generation: Makes it easy to port compiler to other architectures (e.g. X86 to MIPS) Enables optimizations that are not machine specific

64 while (y < z) { int x = a + b; y += x; } Loop: x = a + b y = x + y _t1 = y < z if _t1 goto Loop Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization IR Optimization: Optimize intermediate code (machine-independent)

65 while (y < z) { int x = a + b; y += x; } x = a + b Loop: y = x + y _t1 = y < z if _t1 goto Loop Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization IR Optimization: Optimize intermediate code (machine-independent)

66 while (y < z) { int x = a + b; y += x; } x = a + b Loop: y = x + y _t1 = y < z if _t1 goto Loop Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization Gode Generation: Intermediate code is translated into native code

67 while (y < z) { int x = a + b; y += x; } add $1, $2, $3 Loop: add $4, $1, $4 slt $6, $1, $5 beq $6, loop Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization Gode Generation: Intermediate code is translated into native code

68 while (y < z) { int x = a + b; y += x; } add $1, $2, $3 Loop: add $4, $1, $4 slt $6, $1, $5 beq $6, loop Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization Gode Optimization: machine dependent optimization (register allocation, instruction selection, peephole, etc)

69 while (y < z) { int x = a + b; y += x; } add $1, $2, $3 Loop: add $4, $1, $4 blt $1, $5, loop Lexical Analysis Syntax Analysis Semantic Analysis IR Generation IR Optimization Code Generation Optimization Gode Optimization: machine dependent optimization (register allocation, instruction selection, peephole, etc)

70 Modern Compilers Lexical Analysis Syntax Analysis Matured Frontend Heavy Backend many passes of optimization Semantic Analysis IR Generation IR Optimization Code Generation Optimization

71 Compiler Optimization Frances E. Allen first woman to win Turing Award Introduced many of the abstractions, algorithms, and implementations that laid the groundwork for automatic program optimization technology

72 Architecture of GCC(GNU Compiler Collection) Architecture of gcc Source Code AST GENERIC High GIMPLE IRs many optimization passes here SSA Low GIMPLE RTL Machine Code

73 Architecture of GCC(GNU Compiler Collection) Architecture of gcc Source Code AST FrontEnd supports: C (gcc), C++ (g++), Objective- C, Objective-C++, Fortran (gfortran), Java (gcj), Ada (GNAT), and Go (gccgo) IRs many optimization passes here GENERIC High GIMPLE SSA Low GIMPLE RTL Machine code: X86, ARM, Alpha, MIPS, SPARC, PowerPC, etc Machine Code

74 Architecture of GCC(GNU Compiler Collection) Architecture of gcc Source Code AST FrontEnd supports: C (gcc), C++ (g++), Objective- C, Objective-C++, Fortran (gfortran), Java (gcj), Ada (GNAT), and Go (gccgo) IRs many optimization passes here GENERIC High GIMPLE SSA Low GIMPLE RTL Jeanne Ferrante et. al Machine code: X86, ARM, Alpha, MIPS, SPARC, PowerPC, etc Machine Code

75

76 Architecture of LLVM LLVM (Low Level Virtual Machine) developed in UIUC (2000) language-agnostic design

77 This course covers Lexical Analysis Syntax Analysis Semantic Analysis IR Generation Midterm IR Optimization Code Generation Optimization

78 The Course Project Compiler: Decaf -> MIPS have a working compiler by the end of the quarter will be able to run your Decaf programs! Source Language: Decaf Custom programming language: similar to Java or C++ (simplified feature set) Objected-oriented, inheritance, Strong type Target language: MIPS RISC ISA Implementation: C++

79 Programming Assignments Source Code Lexical Analysis Syntax Analysis P1 P2 10% 10% ~1 week 1.5 week Decaf Semantic Analysis P3 10% 3 weeks IR Generation P4 15% 4 weeks IR Optimization Code Generation Optimization MIPS Machine Code

80 2 person group find your partner by the end of this week Group members get the same grade Honor code: Discussion among groups is encouraged But implement the solution on your own Discussion Session?