Modelling Communica/on So1ware Execu/on via Tracing. Stein Kris/ansen

Size: px

Start display at page:

Download "Modelling Communica/on So1ware Execu/on via Tracing. Stein Kris/ansen"

Roderick Horn
5 years ago
Views:

1 Modlling Communica/on So1war Excu/on via Tracing Stin Kris/ansn 1

2 Outlin Rsarch Ara My PhD- Work Mo/va/on Ovrviw of my work Rsults Possibl mastr thsis aras

3 Rsarch Ara Simula'on Ntworking My Thsis Opra'ng Systms

4 Ntwork Simula/on Computr systms ar o1n vry complx How to tst and valuat? Solu/on: ntwork simula/on Ntwork Simulator:!t 4

5 Ntwork Simula/on Ntwork simula/on Impact of communica/on so1war xcu/on ignord Can this always b ignord?!t = 0 Ntwork Simulator:!t Ral World:!t " 0!t 5

6 Nw and mrging ntworks Htrognous sts of dvics In all sizs (many vry, vry small!) And thus rsourc constraind!

7 Ntwork Simula/on Ntwork simula/on Tst: Impact of communica/on so1war xcu/on ignord Can this always b ignord? Surrounding concrt walls S (vido sndr) (vido stram) (monitor) (N900) M (vido stram) F R (vido rcivr)!t = 0 Ntwork Simulator:!t Ral World: Throughput < 3.7 Mbps WiFi- routr: 15Mbps! ms. alrady at 2 Mbps Wifi- Routr: a fw millisconds!!t " 0!t 7

8 Ntwork Simula/on Ntwork simula/on Tst: Impact of communica/on so1war xcu/on ignord Can this always b ignord? Surrounding concrt walls S (vido sndr) (vido stram) (monitor) (N900) M (vido stram) F R (vido rcivr)!t = 0 Ntwork Simulator:!t Ral World: Throughput < 3.7 Mbps WiFi- routr: 15Mbps! ms. alrady at 2 Mbps Wifi- Routr: a fw millisconds! Answr: No!!t " 0!t 8

9 Problm How do w mak ntwork simulators account for th xcu/on of communica/on so1war?!t = 0 Ntwork Simulator:?!t " 0 Ntwork Simulator:!t!t

10 Cor Ida So1war Simula/on Drivr Collct Data Obsrvd Bhaviour Modl in Ntwork Simulator!t Packts Packts Traffic gnrator/sink Prdict Prformanc 10

11 5- Stp Approach So1war Excu/on Drivr Instruc/ons Bhaviour to simulat Packts Packts Way too dtaild! Not scalabl Not asily undrstandabl Not asily modifiabl Traffic gnrator/sink 11

12 Simplifica/on So1war Drivr Excu/on Trac Rduc/on Captur important vnts: Quuing Synchroniza/on Loops Intrac/ons with HW Instrumnta/on Analysis Tracing 12

13 Capturing Chang in Bhaviour So1war Drivr Instrumnta/on Excu/on Trac Tracing Rduc/on Analysis On bhaviour Bhaviour affctd by input data,.g.,: Packt siz, typ, Rou/ng tabl siz, Bus stat, - > Many bhaviours! Exampl: void ftchfromnic(packt *pkt) { if(siz(pkt) > 500) { DMATranfrNIC(pkt); condi/on_wait(dma); } ls { DMATranfrNIC (pkt); whil(!dma_don) {}; } } 13

14 Capturing Chang in Bhaviour So1war Excu/on Trac Rduc/on Modl Drivr if < 500 > 500 Instrumnta/on Tracing Analysis Modl Cra/on void ftchfromnic(packt *pkt) { if(siz(pkt) > 500) { DMATranfrNIC(pkt); condi/on_wait(dma); } ls { DMATranfrNIC (pkt); whil(!dma_don) {}; } } 14

15 Capturing Impact of Mul/- Thrading So1war Excu/on Trac Rduc/on Modl Drivr Instrumnta/on Analysis Ovrall prformanc affctd by mul/- thrading Workload Schduling policy Synchroniza/on Tracing Modl Cra/on 15

16 Simula/on So1war Excu/on Trac Rduc/on Modl Simulator CPU CPU Drivr Thrads Modl Modl Modl Schdulr Simulator Instrumnta/on Analysis Simula/on Tracing Modl Cra/on Modls xcutd in simulatd thrads 16

17 Simula/on Simulator CPU CPU!t " 0 Ntwork Simulator: Thrads Modl Modl Modl Schdulr Simulator!t 17

18 Googl Nxus On: Instrumnta/on Instrumnta/on: Drivrs NIC DMA Ntworking sub- systm, including 10 tracpoints Th rst of krnl 58 tracpoints Work schduling Task schdulr and synchroniza/on primi/vs Intrrupts NIC Drivr 17 tracpoints NIC, and drivr TX quus (4), rciv and transmit srvics and loops (8), srvic contxt (5) Paralll xcu'on (DMA, ): 6 Tracpoints 18

Googl Nxus On: Final Modls 1 1 4 x 7 6 4 4 6 1 1 (+4) (+9) 2-300.

19 Googl Nxus On: Final Modls x (+4) (+9) instruc/ons (+13) about 100 statmnts 1 4 1

20 Googl Nxus On: Ky Rsult 10 Forwarding Dlay (ms) Squnc Numbr of Packt

21 Possibl Mastr Thss Focus on programming: Extnd tracing framwork for mul/- cor dvics Visualiza/on Focus on modlling: Addi/onal protocols on th GN1 Th N900 Snsors with TinyOS, Con/ki, So1war basd routrs Focus on xprimnta/on: Mdium- to larg- scal xprimnts Rplicat publishd xprimnts and compar rsults

22 Thank you for your Asn/on! Qus/ons? ( or contact m for mor informa/on!)

23 Cor Ida So1war Drivr Excu/on Trac Rduc/on Instrumnta/on Analysis Bhaviour affctd by xcu/on contxt,.g.,: Important Packt siz, typ, vnts: Rou/ng tabl siz, Quuing Synchroniza/on Bus stat, Loops Tracing Intrac/ons with HW Impact of Contxt 23

24 Cor Ida Modl Excu'on Environmnt CPU CPU Thrads Modl C Modl B Modl A Exis/ng Protocol Modls C B A Schdulr Simulator Extndd Nod Instrumnta/on Analysis Simula/on Tracing Modl Cra/on Prdictd prformanc 24

25 Cor Ida So1war Drivr Excu/on Trac Instrumnta/on Tracing 25

26 Cor Ida So1war Excu/on Rduc/on Modl Simula/on Drivr Instruc/ons!t!t Instrumnta/on Analysis Simula/on Tracing Modl Cra/on Prdictd prformanc 26

27 Cor Ida So1war Excu/on Rduc/on Modl Simula/on Drivr Instruc/ons!t!t Instrumnta/on Analysis Simula/on Tracing Modl Cra/on Prdictd prformanc 27

28 Cor Ida So1war Excu/on Rduc/on Modl Simula/on Drivr Instruc/ons!t!t Instrumnta/on Analysis Simula/on Tracing Modl Cra/on Prdictd prformanc 28

29 Cor Ida So1war Excu/on Rduc/on Modl Simula/on Drivr Instruc/ons!t!t Instrumnta/on Analysis Simula/on Tracing Modl Cra/on Prdictd prformanc 29

30 Rason Important Evnts Rquird Evnts Spara/ng srvics Class 1: SRVStart, SRVStop CTXSwitch HIRQStart, HIRQStop CPU procssing Class 2: CPU cycls (and/or hardwar prformanc countrs) Intrac/ons with task schdulr Class 3: Awak Slp Synch Work schduling in thrads and intrrupts Class 4: SRVStart, SRVStop LoopStart, LoopRstart, LoopStop Enquu, Dquu Paralll procssing Class 5: PEUStart HIRQStart Synch Excu/on contxt Class 6: CondRad/Writ Dquu SRVEntry 30

31 Exampl Instrumnta/on uint dhdsdio_sndfromq(dhd_bus_t *bus, uint maxframs, bool rxdon) { void *pkt; uint32 intstatus = 0; uint rtris = 0; int rt = 0, prc_out; uint cnt = 0; uint dataln; uint8 tx_prc_map; dhd_pub_t *dhd = bus- >dhd; sdpcmd_rgs_t *rgs = bus- >rgs; DHD_TRACE(("%s: Entr\n", FUNCTION )); trac_spxt_quucondi'on(rxdon, PKTQ_NIC, PKTQ_NIC); tx_prc_map = ~bus- >flowcontrol; trac_spxt_loopstart(maxframs, 0, PKTQ_BCM4329_TXQ, PKTQ_BCM4329_TXQ); /* Snd frams un/l th limit or som othr vnt */ for (cnt = 0; (cnt < maxframs) && DATAOK(bus); cnt++) { dhd_os_sdlock_txq(bus- >dhd); trac_spxt_looprstart(); if ((pkt = pktq_mdq(&bus- >txq, tx_prc_map, &prc_out)) == NULL) { dhd_os_sdunlock_txq(bus- >dhd); brak; } trac_spxt_pktquu(((struct sk_buff *) pkt)- >data, PKTQ_BCM4329_TXQ, 0, QUEUE_DEQUEUE); dhd_os_sdunlock_txq(bus- >dhd); dataln = PKTLEN(bus- >dhd- >osh, pkt) - SDPCM_HDRLEN; So1war Drivr #ifndf SDTEST rt = dhdsdio_txpkt(bus, pkt, SDPCM_DATA_CHANNEL, TRUE); #ls rt = dhdsdio_txpkt(bus, pkt, (bus- >xt_loop? SDPCM_TEST_CHANNEL : SDPCM_DATA_CHANNEL), TRUE); #ndif } if (rt) bus- >dhd- >tx_rrors++; ls bus- >dhd- >dstats.tx_byts += dataln; /* In poll mod, nd to chck for othr vnts */ if (!bus- >intr && cnt) { /* Chck dvic status, signal pnding intrrupt */ R_SDREG(intstatus, &rgs- >intstatus, rtris); bus- >f2txdata++; if (bcmsdh_rgfail(bus- >sdh)) { brak; } if (intstatus & bus- >hos/ntmask) bus- >ipnd = TRUE; } trac_spxt_loopstop(); /* Dflow- control stack if ndd */ if (dhd_doflow && dhd- >up && (dhd- >busstat == DHD_BUS_DATA) && dhd- >txoff && (pktq_ln(&bus- >txq) < FCLOW)) dhd_txflowcontrol(dhd, 0, OFF); } rturn cnt;

32 Googl Nxus On: Instrumnta/on Instrumnta/on: Drivrs NIC DMA Ntworking sub- systm, including 10 tracpoints Th rst of krnl 58 tracpoints Work schduling Task schdulr and synchroniza/on primi/vs Intrrupts NIC Drivr 17 tracpoints NIC, and drivr TX quus (4), rciv and transmit srvics and loops (8), srvic contxt (5) Paralll xcu'on (DMA, ): 6 Tracpoints 32

33 Rsul/ng Trac Fil QUEUECOND dhdsdio_dpc+0x98 STATECOND dhdsdio_dpc+0xa90 SRVENTRY dhdsdio_sndfromq dhdsdio_dpc+0xc8c QUEUECOND dhdsdio_sndfromq+0x94 LOOPSTART dhdsdio_sndfromq+0x134 LOOPRSTART dhdsdio_sndfromq+0x1c4 PKTQUEUE c05 0 dhdsdio_sndfromq+0x27c TEMPSYNCH d854dc8c mmc_wait_for_rq+0x44 PEUSTART msmsdcc_start_command+0x10c QUEUECOND msm_dmov_nquu_cmd_xt+0x0 WAITCOMPL d854dc8c mmc_wait_for_rq+0x140 SLEEP schdul_/mout+0x24 CTXSW SRVENTRY irq_ntr irq_ntr+0x58 HIRQENTRY QUEUECOND msm_datamovr_irq_handlr+0x45c HIRQEXIT SRVEXIT irq_ntr irq_xit+0x0 SRVENTRY irq_ntr irq_ntr+0x58 HIRQENTRY COMPL d854dc8c mmc_wait_don+0x14 HIRQEXIT SRVEXIT irq_ntr irq_xit+0x0 CTXSW TEMPSYNCH d854dc8c mmc_wait_for_rq+0x44 PEUSTART msmsdcc_start_command+0x10c SRVENTRY irq_ntr irq_ntr+0x58 HIRQENTRY HIRQEXIT SRVEXIT irq_ntr irq_xit+0x0 SRVENTRY irq_ntr irq_ntr+0x58 HIRQENTRY COMPL d854dc8c mmc_wait_don+0x14 HIRQEXIT SRVEXIT irq_ntr irq_xit+0x0 WAITCOMPL d854dc8c mmc_wait_for_rq+0x140 PKTQUEUE dhdsdio_txpkt.clon.11+0x4d0 LOOPRSTART dhdsdio_sndfromq+0x1c4 LOOPSTOP dhdsdio_sndfromq+0x450 SRVEXIT dhdsdio_sndfromq dhdsdio_dpc+0xc8c SRVEXIT dhd_bus_dpc dhd_dpc_thrad+0x10c QUEUECOND dhd_dpc_thrad+0x168 SRVEXIT dhd_dpc_thrad dhd_dpc_thrad+0x214

34 Rsul/ng Rduc/on QUEUECOND dhdsdio_dpc+0x98 STATECOND dhdsdio_dpc+0xa90 SRVENTRY dhdsdio_sndfromq dhdsdio_dpc+0xc8c QUEUECOND dhdsdio_sndfromq+0x94 LOOPSTART dhdsdio_sndfromq+0x134 LOOPRSTART dhdsdio_sndfromq+0x1c4 PKTQUEUE c05 0 dhdsdio_sndfromq+0x27c TEMPSYNCH d854dc8c mmc_wait_for_rq+0x44 PEUSTART msmsdcc_start_command+0x10c QUEUECOND msm_dmov_nquu_cmd_xt+0x0 WAITCOMPL d854dc8c mmc_wait_for_rq+0x140 SLEEP schdul_/mout+0x24 CTXSW SRVENTRY irq_ntr irq_ntr+0x58 HIRQENTRY QUEUECOND msm_datamovr_irq_handlr+0x45c HIRQEXIT SRVEXIT irq_ntr irq_xit+0x0 SRVENTRY irq_ntr irq_ntr+0x58 HIRQENTRY COMPL d854dc8c mmc_wait_don+0x14 HIRQEXIT SRVEXIT irq_ntr irq_xit+0x0 CTXSW TEMPSYNCH d854dc8c mmc_wait_for_rq+0x44 PEUSTART msmsdcc_start_command+0x10c SRVENTRY irq_ntr irq_ntr+0x58 HIRQENTRY HIRQEXIT SRVEXIT irq_ntr irq_xit+0x0 SRVENTRY irq_ntr irq_ntr+0x58 HIRQENTRY COMPL d854dc8c mmc_wait_don+0x14 HIRQEXIT SRVEXIT irq_ntr irq_xit+0x0 WAITCOMPL d854dc8c mmc_wait_for_rq+0x140 PKTQUEUE dhdsdio_txpkt.clon.11+0x4d0 LOOPRSTART dhdsdio_sndfromq+0x1c4 LOOPSTOP dhdsdio_sndfromq+0x450 SRVEXIT dhdsdio_sndfromq dhdsdio_dpc+0xc8c SRVEXIT dhd_bus_dpc dhd_dpc_thrad+0x10c QUEUECOND dhd_dpc_thrad+0x168 SRVEXIT dhd_dpc_thrad dhd_dpc_thrad+0x214 Dvic fil NAME l RESOURCES cycls normal FRACTION 100% dhdsdio_dpc+0xc8c START PROCESS dhdsdio_sndfromq+0x94 QUEUECOND NICrx mpty PROCESS dhdsdio_sndfromq+0x134 LOOP m 0 drvtx drvtx 20 dhdsdio_dpc+0xc8c STOP NAME m RESOURCES cycls normal FRACTION 49% dhdsdio_sndfromq+0x134 LOOPSTART PROCESS dhdsdio_sndfromq+0x27c DEQUEUE PKTQUEUE 44 0 PROCESS mmc_wait_for_rq+0x44 TEMPSYNCH HIRQ- 24, m PROCESS msmsdcc_start_command+0x10c PEUSTART HIRQ PROCESS mmc_wait_for_rq+0x140 WAITCOMPL (TEMP) PROCESS dhdsdio_txpkt.clon.11+0x4d0 ENQUEUE PKTQUEUE NICtx dhdsdio_sndfromq+0x1c4 RESTART

35 Rsul/ng Excu/on Modl Dvic fil NAME l RESOURCES cycls normal FRACTION 100% dhdsdio_dpc+0xc8c START PROCESS dhdsdio_sndfromq+0x94 QUEUECOND NICrx mpty PROCESS dhdsdio_sndfromq+0x134 LOOP m 0 drvtx drvtx 20 dhdsdio_dpc+0xc8c STOP rturn NAME m RESOURCES cycls normal FRACTION 49% dhdsdio_sndfromq+0x134 LOOPSTART PROCESS dhdsdio_sndfromq+0x27c DEQUEUE PKTQUEUE 44 0 PROCESS mmc_wait_for_rq+0x44 TEMPSYNCH HIRQ- 24, m PROCESS msmsdcc_start_command+0x10c PEUSTART HIRQ PROCESS mmc_wait_for_rq+0x140 WAITCOMPL (TEMP) PROCESS dhdsdio_txpkt.clon.11+0x4d0 ENQUEUE PKTQUEUE NICtx dhdsdio_sndfromq+0x1c4 RESTART rturn

36 Extnsion of Simulator Simula/on: Excut modls in thrads and intrrupts Uss schdulr simulator Synchroniz with xis/ng protocol modls rturn rturn Excu'on Environmnt CPU CPU Thrads Modl C Modl B Modl A Schdulr Simulator Exis/ng Protocol Modls C B A Extndd Nod

37 5- Stp Approach So1war Drivr Excu/on Instruc/ons Packts Packts Traffic gnrator/sink 37

38 Cor Ida So1war Drivr Excu/on Instruc/ons Modl in Ntwork Simulator Simula/on!t Bhaviour Way too dtaild! Not scalabl Not asily undrstandabl Not asily modifiabl Prdict Prformanc 38

39 5- Stp Appraoch to Simplify Modls Stp 1: Instrumnta'on Instrumntd Cod Stp 2: Tracing Trac Stp 3: Analysis Par/al Modls Stp 4: Modl Cra'on Excutabl Modl Stp 5: Simula'on Prdictd Prformanc

40 Stp 1: Instrumnta/on So1war Drivr Instrumnta/on Captur important vnts: Quuing Synchroniza/on Loops Intrac/ons with HW 40

41 Stp 1: Instrumnta/on So1war Drivr Exampl: pkt = pktq_mdq(&bus- >txq, tx_prc_map, &prc_out); Instrumnta/on Captur important vnts: Quuing Synchroniza/on Loops Intrac/ons with HW 41

42 Stp 2: Trac So1war Drivr Excu/on Trac Instrumnta/on Tracing

43 Stp 2: Trac So1war Excu/on Trac Exampl: Drivr PKTQUEUE SYNCH !T= " = 3144 Instrumnta/on Tracing 43

44 Stp 2: Trac So1war Excu/on Trac Exampl: Drivr PKTQUEUE SYNCH !T= " = 3144 Instrumnta/on Small varia/ons in consumd cycls Non- dtrminis/c ffcts,.g., mmory caching Tracing 44

Stp 3: Analys So1war Excu/on Trac Rduc/on Exampl: Drivr DEQUEUE PKTQUEUE PROCESS 3013 98 SYNCH PROCESS 993 21 Instrumnta/on Analysis Small varia/ons in Important vnts:

45 Stp 3: Analys So1war Excu/on Trac Rduc/on Exampl: Drivr DEQUEUE PKTQUEUE PROCESS SYNCH PROCESS Instrumnta/on Analysis Small varia/ons in Important vnts: Quuing Synchroniza/on Loops Intrac/ons with HW Impact of Contxt Tracing consumd cycls Non- dtrminis/c ffcts,.g., mmory caching Collct many tracs and calculat sta/s/cs 45

46 Stp 3: Analys So1war Drivr Excu/on Trac Rduc/on Exampl: void ftchfromnic(packt *pkt) { trac_smxt_pktchar(*pkt); if(siz(pkt) > 500) { DMATranfrNIC(pkt); condi/on_wait(dma); } ls { DMATranfrNIC (pkt); whil(!dma_don) {}; } } Instrumnta/on Analysis Bhaviour affctd by xcu/on contxt,.g.,: Captur important Packt siz, typ, vnts: Rou/ng tabl siz, Quuing Bus stat, Synchroniza/on Tracing Modl Cra/on Loops Captur vnts for whn Intrac/ons with HW and how bhaviour Impact of contxt changs 46

47 Stp 4: Crat Modls Ovrall prformanc affctd by mul/- thrading Workload Schduling policy Synchroniza/on Modl Instrumnta/on Analysis Tracing Modl Cra/on 47

48 Ovrall prformanc affctd by mutli- thrading Workload Schduling policy Synchroniza/on Simula/on: Excut modls in thrads and intrrupts Uss schdulr simulator Stp 5: Simulat Modl Simula'on Environmnt CPU CPU Thrads Modl Modl Modl Schdulr Simulator Instrumnta/on Analysis Simula/on Tracing Modl Cra/on Prdictd prformanc 48

49 Instrumnta/on So1war Drivr Exampl: pkt = pktq_mdq(&bus- >txq, tx_prc_map, &prc_out); trac(pkt, DRIVER_TXQ, QUEUE_DEQUEUE); Instrumnta/on Captur important vnts: Quuing Synchroniza/on Loops Intrac/ons with HW Stor vnt in tracfil 49

50 Capturing Chang in Bhaviour So1war Drivr Excu/on Trac Rduc/on On bhaviour Bhaviour affctd by input data,.g.,: Packt siz, typ, Rou/ng tabl siz, Bus stat, = Many bhaviours! Exampl: Instrumnta/on Captur important vnts: Quuing Synchroniza/on Loops Intrac/ons with HW Impact of Contxt Tracing Analysis void ftchfromnic(packt *pkt) { trac(siz(pkt)); if(siz(pkt) > 500) { DMATranfrNIC(pkt); condi/on_wait(dma); } ls { DMATranfrNIC (pkt); whil(!dma_don) {}; } } 50

TCP Congestion Control. Congestion Avoidance

TCP Congestion Control. Congestion Avoidance TCP Congstion Control TCP sourcs chang th snding rat by modifying th window siz: Window = min {Advrtisd window, Congstion Window} Rcivr Transmittr ( cwnd ) In othr words, snd at th rat of th slowst componnt: