Paul Cockshott and Kenneth Renfrew. SIMD Programming. Manual for Linux. and Windows. Springer

Transcription

1 Paul Cockshott and Kenneth Renfrew SIMD Programming Manual for Linux and Windows Springer

2 List of Tables List of Figures List of Algorithms Introduction xvii xix xxiii xxv I SIMD Programming 1 Paul Cockshott 1 Computer Speed, Program Speed Clocks Width Instruction Speed Overhead Instructions Algorithm Complexity 8 2 SIMD Instruction-sets The SIMD Model The MMX Register Architecture MMX Data-types DNow! Cache Handling Cache Line Length and Prefetching Streaming SIMD Cache Optimisation The Motorola Altivec Architecture 22 3 SIMD Prograrnming in Assembler and C Vectorising C Compilers Dead for Loop Elimination Loop Unrolling Direct Use of Assembler Code The Example Program Use of Assembler Intrinsics 27 V

3 vi 3.4 Use of C++ Classes Use of the Nasm Assembler General Instruction Syntax Operand Forms Directives Linking and Object File Formats Summing a Vector Coordinate Transformations Using 3DNow! Coordinate Transformations Using SSE Instructions 44 4 Intel SIMD Instructions v Types shrl saturate Instructions ADDPS ADDSS ANDNPS ANDPS CMPPS CMPSS COMISS CVTPI2PS CVTPS2PI CVTTPS2PI CVTSI2SS CVTSS2SI CVTTSS2SI DIVPD DIVPS DIVSD DIVSS EMMS FXRSTOR FXSAVE MASKMOVQ MAXPD MAXPS MAXSD MAXSS MINPD MINPS MINSD MINSS MOVAPSJoad MOVAPS_store MOVDJoad 62

4 vii MOVD-store MOVDJoad-sse MOVD_store_sse MOVHLPS MOVHPSioad MOVHPS-store MOVLHPS MOVLPSJoad MOVLPS-store MOVMSKPS MOVNTPS MOVNTQ MOVQJoad MOVQ_store MOVSSJoad MOVSS_store MOVUPSJoad MOVUPS_store MULPD MULPS MULSD MULSS ORPS PACKSSDW PACKSSWB PACKUSWB PADDB PADDB_sse PADDW PADDW.sse PADDD PADDD_sse PADDQ PADDQ-Sse PADDSB PADDSB.sse PADDUSB PADDUSB-sse PAND PAND.sse PANDN PANDN_sse PAVGB PAVGB_sse PAVGW PAVGW-Sse PCMPEQB PCMPEQB_sse 77

5 .' viii PCMPEQW PCMPEQW-sse PCMPEQD PCMPEQDjsse PCMPGTB PCMPGTB-sse PCMPGTW PCMPGTW.sse PCMPGTD PCMPGTD.sse PEXTRW PEXTRW-sse PINSRW PMADDWD PMAXSW PMAXUB PMINSW PMINUB PMOVMSKB PMULHUW PMULHW PMULLW POR PREFETCHNTA PREFETCHT PREFETCHTO PSADBW PSHUFD PSHUFW PSxxf PSUBx PSUBSx PSUBUSx PSWAPD PUNPCKHBW PUNPCKLBW PUNPCKHWD PUNPCKLWD PUNPCKHDQ PUNPCKLDQ PXOR RCPPS RCPSS RSQRTPS RSQRTSS SFENCE SQRTPS SQRTSS 95

6 ix SUBPS SUBSS UNPCKHPS UNPCLPS XORPS DNOW Instructions FEMMS PF2ID PFACC PFADD PFCMPEQ PFCMPGT PFCMPGE PFMAX PFMIN PFMUL PFNACC PFPNACC PFRCP PFRCPIT PFSUB PFSUBR PI2FD PI2FW PREFETCH 105 II SIMD Programming Languages 107 Paul Cockshott 116, 6 Another Approach: Data Parallel Languages Operations on Whole Arrays Array Slicing Ill Conditional Operations Reduction Operations Data Reorganisation Design Goals Target Machines Backward Compatibility Expressive Power Run-time Efficiency Basics of Vector Pascal Formating Rules Alphabet 121

7 x Reserved Words and Identifiers Character Case Spaces and Comments Semicolons Base Types Booleans Integer Numbers Real Numbers Characters and Strings Variables and Constants Declaration Order Constant Declarations Variable Declarations Assignment Predefined Types Expressions and Operators Arithmetic Operations on Boolean Values Equality Operators Ordered Comparison Matrix and Vector Operations Array Declarations Matrix and Vector Arithmetic Array Input/Output Array Slices Vector and Matrix Products Inner Product of Vectors Dot Product of Non-real Typed Vectors Matrix to Vector Product Data-flow Hazards Matrix to Matrix Multiplication Typography of Vector Pascal Programs Algorithmic Features of Vector Pascal Conditional Evaluation Functions User-defined Functions Procedures Procedure ReadAndValidate Function H Function Log Branching Two-way Branches Multi-way Branches Unbounded Iteration While Repeat 160

8 xi 8.5 Bounded Iteration For to For Downto Goto User-defined Types Scalar Types SUCC and PRED ORD Input/Output of Scalars Representation Sub-range Types Representation Dimensioned Numbers Arithmetic on Dimensioned Numbers Handling Different Units of Measurement Records Pointers Pointer Idioms Freeing Storage Set Types Set Literals Operations on Sets String Types Input and Output File Types Binary Files Text Files Operating System Files Output Binary File Output Text File Output Generic Array Output Input Generic Array Input Binary File Input Text File Input File Predicates Random Access to Files Seek filepos Untyped i/o Error Conditions Permutations and Polymorphism Array Reorganisation An Example 200

9 xii Array Shifts Element Permutation Efficiency Considerations Dynamic Arrays Schematic Arrays Polymorphic Functions Multiple Uses of Parametric Units Function dategt 206 III Programming Examples 209 Paul Cockshott 12 Advanced Set Programming Use of Sets to Find Prime Numbers Set Implementation Ordered Sets openfiles loadset Sets of Records Retrieval Operations Use of Sets in Text Indexing Constructing an Indexing Program dirlist: A Program for Traversing a Directory Tree intodir bloomfilter hashword setfilter testfilter The Main Program to Index Files processfile A Retrieval Program Parallel Image Processing Declaring an Image Data Type Brightness and Contrast Adjustment Efficiency in Image Code Image Filtering Blurring Sharpening Comparing Implementations genconv dup prev 241 pm doedges freestore 242

10 xiii 13.5 Digital Half-toning Parallel Half-tone errordifuse Image Resizing Horizontal Resize Horizontal Interpolation Interpolate Vertically Displaying Images demoimg An Example Image Display.. Program The Unit BMP Procedure initbmpheader Procedure storebmpfile Function loadbmpfile Procedure adjustcontrast Procedure pconv Procedure convp Pattern Recognition and Image Compression Principles of Image Compression Data Compression in General Image Compression Vector Quantisation of Images Data Structures encode The K Means Algorithm Vector Quantisation of Colour Images D Graphics Mesh Representation linedemo: An Illustration of 3D Projection demo3d: Main Procedure of linedemo Viewing Matrices SDL Initialisation Create a Rotation Matrix Calculate x mod D Projection Entry Point to Line Drawing Bresenham Line Drawing Procedure Performance 292 IV VIPER 293 Ken Renfrew 16 Introduction to VIPER Rationale The Literate Programming Tool The Mathematical Syntax Converter 296

11 xiv 16.2 A System Overview Which VIPER to Download? System Dependencies Installing Files Setting Up the Compiler Setting Up the System Setting System Dependencies Personal Set-up Dynamic Compiler Options VIPER Option Buttons Moving VIPER Programming with VIPER Single Files Projects Embedding MjjX in Vector Pascal Compiling Files in VIPER Compiling Single Files Compiling Projects Running Programs in VIPER Making VPT$C VPl jx Options VPMath ETeK in VIPER HTML in VIPER Writing Code to Generate Good VPTeX Use of Special Comments Use of Margin Comments Use of Ordinary Pascal Comments Levels of Detail Within Documentation Mathematical Translation: Motivation and Guidelines L#TeX Packages 313 Appendix A Compiler Porting Tools 315 A.1 Dependencies 315 A.2 Compiler Structure 316 A.2.1 Vectorisation 317 A.2.2 Porting Strategy 320 A.3 ILCG 321 A.4 Supported Types 321 A.4.1 Data Formats 321 A.4.2 Typed Formats 322 A.4.3 ref Types 322 A.5 Supported Operations 322 A.5.1 TypeCasts 322 A.5.2 Arithmetic 322 A.5.3 Memory 322

12 xv A.5.4 Assignment 323 A.5.5 Dereferencing 323 A.6 Machine Description 323 A.6.1 Registers 323 A.6.2 Register Sets 324 A. 6.3 Register Arrays 324 A.6.4 Register Stacks 324 A.6.5 Instruction Formats 325 A.7 Grammar of ILCG 325 A.8 ILCG Grammar 326 A.8.1 Helpers 326 A.8.2 Tokens 327 A.8.3 Non-terminal Symbols 329 Appendix B Software Download 335 Appendix C Using the Command Line Compiler 337 C.l Invoking the Compiler 337 C.l.l Environment Variable 337 C.1.2 Compiler Options 337 C.1.3 Dependencies 338 C.2 Calling Conventions 338 C.3 Array Representation 341 C.3.1 Range Checking 341 References 343 Index 345