Heterogeneous Computing Architecture. Adaptive Systems Laboratory

Transcription

1 1 Heterogeneous Computing Architecture m d s Mitsuhiro Nakamura Achraf Ben Ahmed Maiko Tanaka

2 Contents 2 CPU Period Background Single core Multi core Heterogeneous Multi core Heterogeneous Computing Type Problem Heterogeneous System Architecture(HSA)

3 Contents 3 CPU Period Background Single core Multi core Heterogeneous Multi core Heterogeneous Computing Type Problem Heterogeneous System Architecture(HSA)

4 Moore s law 4 source:

5 Moore s law 5 Multi Single source:

6 Contents 6 CPU Period Background Single core Multi core Heterogeneous Multi core Heterogeneous Computing Type Problem Heterogeneous System Architecture(HSA)

7 Single 7 One core in one package data Age: 1971 ~ 2003 (Intel 4004) (Pemtium M) Clock rate: 740kHz ~ 2.26GHz FLOPS: 7.6G(Pemtium4) Price: $56(Pemtium4)

8 Single Performance increase Clock rate Segmentalized pipeline 8 F E WB F E WB F E WB IPC(Instruction per cycle) Superscalar F E WB F E WB F E WB F D E M W F D E M W F D E M W F E WB F E WB F E WB F E WB F E WB F E WB

9 Single Performance limit 9 Performance increase Complexity Area Power consumption Cost

10 Contents 10 CPU Period Background Single core Multi core Heterogeneous Multi core Heterogeneous Computing Type Problem Heterogeneous System Architecture(HSA)

11 Multi 11 The same cores in one package (Homogeneous) data data Age: 2006 ~ ( Duo) Clock rate: 1.66GHz ~ 3.6GHz FLOPS: 26.64G(2 Duo) 53.28G( i7 Nehalem) 384G( i7 Haswell) Price: $48(2 Duo) ~ $282( i7 Haswell) ~

12 Multi Performance increase TLP(Thread-Level Parallelism) 12 data data data data data data Simple core(pollack s Rule)

13 Multi Performance limit 13 Same core Difficult different operations Sequence parallel

14 Contents 14 CPU Period Background Single core Multi core Heterogeneous Multi core Heterogeneous Computing Type Problem Heterogeneous System Architecture(HSA)

15 Heterogeneous multi core 15 Different cores in one package data data Age: 2006 ~ (Cell Broadband Engine) Clock rate: Various(3.7GHz + 720MHz) FLOPS: 200G ~ Price: $129 A (CPU) B (GPU,etc)

16 Heterogeneous Performance increase 16 Single thread + Multi thread(simd) + General processing (Control OS) Data processing (Stream) Optimization each core

17 Heterogeneous Example 17 Cell Broadband Engine in PS3 commons/e/e0/cell-processor.jpg

18 Heterogeneous Example 18 AMD APU(Accelerated Processing Unit) in PS4

19 Heterogeneous Example 19 Fast CPU + slow CPU CPU + FPGA CPU + Photonic CPU + Matrix processor Kazuki Kobayashi, Matrix Multiplication for Hierarchical Memory Interface on Array Processor, P5

20 CPU Architecture Trends 20

21 Contents 21 CPU Period Background Single core Multi core Heterogeneous Multi core Heterogeneous Computing Type Problem Heterogeneous System Architecture(HSA)

22 Heterogeneous Computing 22

23 Type 23 OpenCL Device CPU, GPU, Cell processor, DSP Area Parallel computing OpenGL GPU 2D, 3D CUDA GPU(NVIDIA) Parallel computing

24 Problem 24 Different Programs Memory spaces C/C++, Jave CUDA, OpenCL

25 Problem 25 U_without_HSA.svg/720px-HSA_%E2%80%93_using_the_GPU_without_HSA.svg.png

26 Contents 26 CPU Period Background Single core Multi core Heterogeneous Multi core Heterogeneous Computing Type Problem Heterogeneous System Architecture(HSA)

27 HSA 27 Framework to simplify GPU computing H/W: Share memory spaces(huma) S/W: The same programming language

28 HSA 28 Framework to simplify GPU computing H/W: Share memory spaces _graphics_card.svg/320px-hsa-enabled_virtual_memory_with_distinct_graphics_card.svg.png

29 HSA 29 Framework to simplify GPU computing H/W: Share memory spaces GPU_with_HSA.svg/720px-HSA_%E2%80%93_using_the_GPU_with_HSA.svg.png

30 HSA 30 Framework to simplify GPU computing S/W: The same programming language

31 BOLT 31

32 Language comparison 32

33 Contents 33 CPU Period Background Single core Multi core Heterogeneous Multi core Heterogeneous Computing Type Problem Heterogeneous System Architecture(HSA)

34 Summary 34 CPU Architecture trends Single Multi Heterogeneous Heterogeneous computing OpenCL HAS BOLT

35 Reference 35 What is Heterogeneous System Architecture? ヘテロジニアスマルチコア -Wikipedia 3%83%8B%E3%82%A2%E3%82%B9%E3%83%9E%E3%83%AB%E3%83%81%E3%82 %B3%E3%82%A2 CPU+GPU のヘテロジニアス構成を簡易化を目指す -HSA を巡る ARM の思惑と動向 新時代到来! ヘテロジニアス コンピューティング最新動向 前編 (1/4) 新時代到来! ヘテロジニアス コンピューティング最新動向 後編 (1/3) 決定的となったヘテロジニアスマルチコアへの潮流