ECS 154B Computer Architecture II Spring 2009

Transcription

1 ECS 154B Computer Architecture II Spring 2009 Pipelining Datapath and Control Partially adapted from slides by Mary Jane Irwin, Penn State And Kurtis Kredo, UCD

2 Pipelined CPU Break execution into five stages IM Reg DM Reg Corresponds to the five instruction cycles Fetch from instruction memory (IM) Decode and fetch registers (Reg) Execute the operation in the Access data memory (DM) Write result back to register (Reg) 2

3 State Registers How do we store values across pipeline stages? Multi-cycle MIPS introduced state registers IR, MDR, B, A introduced Sufficient for a pipelined CPU? PC Address Memory Data (Instr. or Data) Write Data IR MDR Addr 1 Register Addr 2 File Write Addr Write Data Data 1 Data 2 A B Out 3

4 Pipelined State Registers Each must maintain its own state Any information needed by a later stage must be passed along Consider PC + 4 4

5 Pipelined State Registers Each instruction must maintain its own state Any information needed by a later stage must be passed along Consider PC + 4 Computed during Fetch stage (why?) Needed by Execute stage (why?) 5

6 Pipelined State Registers More registers necessary for a pipelined CPU IF/ID ID/EX EX/MEM Add PC 4 Instruction Memory Address Addr 1 Register Addr 2 Data 1 File Write Addr Write Data Data 2 Shift left 2 Add Address Write Data Data Memory Data MEM/WB Sign 16 Extend 32 6

7 Load Word Example (Fetch) IF/ID ID/EX EX/MEM Add PC 4 Instruction Memory Address Addr 1 Register Addr 2 Data 1 File Write Addr Write Data Data 2 Shift left 2 Add Address Write Data Data Memory Data MEM/WB Sign 16 Extend 32 7

8 Load Word Example (Decode) IF/ID ID/EX EX/MEM Add PC 4 Instruction Memory Address Addr 1 Register Addr 2 Data 1 File Write Addr Write Data Data 2 Shift left 2 Add Address Write Data Data Memory Data MEM/WB Sign 16 Extend 32 8

9 Load Word Example (Execute) IF/ID ID/EX EX/MEM Add PC 4 Instruction Memory Address Addr 1 Register Addr 2 Data 1 File Write Addr Write Data Data 2 Shift left 2 Add Address Write Data Data Memory Data MEM/WB Sign 16 Extend 32 9

10 Load Word Example (Memory) IF/ID ID/EX EX/MEM Add PC 4 Instruction Memory Address Addr 1 Register Addr 2 Data 1 File Write Addr Write Data Data 2 Shift left 2 Add Address Write Data Data Memory Data MEM/WB Sign 16 Extend 32 10

11 Load Word Example (Write Back) IF/ID ID/EX EX/MEM Add PC 4 Instruction Memory Address Addr 1 Register Addr 2 Data 1 File Write Addr Write Data Data 2 Shift left 2 Add Address Write Data Data Memory Data MEM/WB Sign 16 Extend 32 11

12 Load Word Example (Write Back) All required values must pass through registers IF/ID ID/EX EX/MEM Add PC 4 Instruction Memory Address Addr 1 Register Addr 2 Data 1 File Write Addr Write Data Data 2 Shift left 2 Add Address Write Data Data Memory Data MEM/WB Sign 16 Extend 32 12

13 Pipelined Instructions With the multi-cycle CPU, instructions could take a different number of cycles to complete Can we do this with a pipelined CPU? R-type sw Jump 13

14 Pipelined Instructions IF/ID ID/EX EX/MEM Add PC 4 Instruction Memory Address Addr 1 Register Addr 2 Data 1 File Write Addr Write Data Data 2 Shift left 2 Add Address Write Data Data Memory Data MEM/WB Sign 16 Extend 32 14

15 Pipeline Control What about control signals? Different for each Required at Where does the control unit go? 15

16 Pipeline Control What about control signals? Different for each instruction Required at different stages Where does the control unit go? 16

17 Pipeline Control Pass control signals using the state registers No need to pass after they are used Control IF/ID ID/EX EX/MEM MEM/WB 17

18 Pipeline Control Signals Execute signals Memory access signals Write back signals 18

19 Pipeline Control Signals Execute signals RegDst Op[1..0] Src Branch Memory access signals Mem MemWrite Write back signals RegWrite MemtoReg 19

20 The Pipelined CPU So Far PCSrc ID/EX EX/MEM IF/ID Control MEM/WB PC 4 Address IM Add RegWrite Addr 1 Addr 2 Data 1 Register File Write Addr Write Data Data 2 Shift left 2 Src Add Branch Address Write Data DM Data MemtoReg Sign Extend Cntrl Op MemWrite Mem RegDst 20

21 Data Hazard Review Caused when data is needed before it is ready before write: Result of previous instruction needed by later instruction Load use: Value in data memory needed by later instruction IM Reg DM Reg IM Reg DM Reg IM Reg DM Reg 21

22 After Write Hazard Solution Stalling always an option Forwarding data improves CPI over stalling add $4, $5, $6 IM Reg DM Reg add $8, $4, $6 IM Reg DM Reg add $10, $9, $4 IM Reg DM Reg 22

23 Data Forwarding Take the result from the point that it exists in any of the pipeline state registers and forward it to the that need it that cycle For functional unit: the inputs can come from any pipeline register rather than just from ID/EX by adding the inputs of the connecting the in or to either (or both) of the EX s stage inputs adding the proper to control the new muxes Other functional units may need similar forwarding logic With forwarding, the CPU can achieve a CPI of 1 even in the presence of data dependencies 23

24 Data Forwarding Take the result from the earliest point that it exists in any of the pipeline state registers and forward it to the functional units (e.g., the ) that need it that cycle For functional unit: the inputs can come from any pipeline register rather than just from ID/EX by adding multiplexors to the inputs of the connecting the Rd write data in EX/MEM or MEM/WB to either (or both) of the EX s stage Rs and Rt mux inputs adding the proper control hardware to control the new muxes Other functional units may need similar forwarding logic With forwarding, the CPU can achieve a CPI of 1 even in the presence of data dependencies 24

25 Data Forwarding Conditions Only forward when state changes Forwarding unnecessary in other cases Forward if either source register needs it 25

26 Data Forwarding Conditions Only forward when state changes Use RegWrite control signal Don t forward if destination is $0 Forward if previous destination current source Forwarding unnecessary in other cases Forward if either source register needs it 26

27 EX/MEM Forwarding Register value needed by next instruction Calculated by this clock cycle Needed as input to on next clock cycle add $4, $5, $6 IM Reg DM Reg add $8, $4, $7 or add $8, $7, $4 IM Reg DM Reg 27

28 EX/MEM Forwarding ID/EX EX/MEM MEM/WB R[Rs] R[Rt] MemWrite RegWrite MemtoReg Immediate Cntrl Rd Rt RegDst 28

29 EX/MEM Forwarding R[Rs] ID/EX EX/MEM MEM/WB RegWrite R[Rt] MemWrite MemtoReg Immediate Cntrl Rd Rt Rs RegDst Forward Unit 29

30 MEM/WB Forwarding Register value needed two instructions later Calculated by this clock cycle Needed as input to in two clock cycles add $4, $5, $6 IM Reg DM Reg Unrelated Instruction IM Reg DM Reg add $8, $4, $7 or add $8, $7, $4 IM Reg DM Reg 30

31 MEM/WB Forwarding R[Rs] ID/EX EX/MEM MEM/WB RegWrite R[Rt] MemWrite MemtoReg Immediate Cntrl Rd Rt Rs RegDst Forward Unit 31

32 MEM/WB Forwarding R[Rs] ID/EX EX/MEM MEM/WB RegWrite R[Rt] MemWrite MemtoReg Immediate Cntrl Rd Rt Rs RegDst Forward Unit 32

33 Forwarding Complication Forward unit must forward most recent value It may appear necessary to do MEM/WB and EX/MEM forwarding simultaneously Only do EX/MEM forwarding this cycle Do EX/MEM forwarding again next cycle add $4, $5, $6 IM Reg DM Reg add $4, $4, $13 IM Reg DM Reg add $8, $4, $7 IM Reg DM Reg 33

34 Complete Input Forwarding R[Rs] R[Rt] ID/EX EX/MEM MemWrite MEM/WB RegWrite MemtoReg Immediate Cntrl Rd Rt Rs RegDst Forward Unit 34

35 Register Definition How can we specify a particular signal? Each state register has a copy May vary across stages Reference the register that contains the value RegWrite value in EX/MEM state register EX/MEM.RegWrite RegWrite value in MEM/WB state register MEM/WB.RegWrite 35

36 Forwarding Conditions We want to forward when Previous instruction updates state Previous destination used as current source Previous destination not $0 Data Hazard code add $4, $5, $6 sub $8, $4, $9 How do we do this in hardware? 36

37 Forwarding Unit R[Rs] R[Rt] ID/EX EX/MEM MemWrite MEM/WB RegWrite MemtoReg Immediate Cntrl Rd Rt Rs RegDst Forward Unit 37

38 Forwarding Unit Details EX/MEM.RegWrite Forward EX/MEM.RegisterRd[4] ID/EX.RegisterRs[4] EX/MEM.RegisterRd[0] ID/EX.RegisterRs[0] EX/MEM.RegisterRd[4] 0 EX/MEM.RegisterRd[0] 0 38

39 Forwarding Unit Details EX/MEM.RegWrite Forward EX/MEM.RegisterRd[4] ID/EX.RegisterRs[4] EX/MEM.RegisterRd[0] ID/EX.RegisterRs[0] EX/MEM.RegisterRd = ID/EX.RegisterRs EX/MEM.RegisterRd[4] 0 EX/MEM.RegisterRd[0] 0 EX/MEM.RegisterRd 0 39

40 Other Forwarding Possible Forwarding to Data Memory add $4, $5, $6 IM Reg DM Reg sw $4, 40($7) IM Reg DM Reg Data memory to data memory copy lw $4, 16($7) IM Reg DM Reg sw $4, 40($7) IM Reg DM Reg 40

41 Forwarding to Memory What happens here? add $5, $6, $7 sw $5, 8($10) Forwarding must occur, but not through 41

42 Forwarding to Memory ID/EX EX/MEM MEM/WB R[Rs] MemWrite RegWrite R[Rt] MemtoReg Immediate Cntrl Rd Rt Rs Forward Unit 42

43 Forwarding to Memory ID/EX EX/MEM MEM/WB R[Rs] MemWrite RegWrite R[Rt] MemtoReg Immediate Cntrl Rd Rt Rs Forward Unit 43