Meeting of the Technical Steering Committee (TSC) Board

Transcription

1 Meeting of the Technical Steering Committee (TSC) Board Tuesday, July 31 th :00am ET

2 Meeting Logistics United States : +1 (646) Meeting ID:

3 Antitrust Policy Notice Linux Foundation meetings involve participation by industry competitors, and it is the intention of the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Examples of types of actions that are prohibited at Linux Foundation meetings and in connection with Linux Foundation activities are described in the Linux Foundation Antitrust Policy available at If you have questions about these matters, please contact your company counsel, or if you are a member of the Linux Foundation, feel free to contact Andrew Updegrove of the firm of Gesmer Updegrove LLP, which provides legal counsel to the Linux Foundation. 3

4 Agenda TSC : - project lead finalization No TSC meeting next week: MUG Follow up from previous meetings: SC 18 BoF submission: updated submission completed Hyperion research study is live Updated build system config for aarch64 ARM HPC compilers Availability of SLE 15 Continued discussion on modulefile conventions 4

5 Build system addition for aarch64 There is a Works on ARM project that provides CI/CD infrastructure to community projects hosted at Packet Applied to request a build resource for OpenHPC ( ter/issues/90) - we were kindly granted a ThunderX2 node to support our build infrastructure - have setup OBS on this host and tied it to our central OBS server - have enough cores with this box to support parallel builds (currently set at make j 3) Example build time reductions: - trilinos-openmpi build: previous build time of hours latest build time on TX2: 4.19hours 5

6 ArmHPC compilers ingested for build system Latest ARM HPC compilers have been ingested for use within our OBS system (v18.3) arm-compilers-devel package has also been landed on branch similar in spirt to intel-compilers-devel which makes compiler modules available in ohpc environment - slight difference in that the arm hpc compilers ship with working modulefiles, so we don t create them dynamically - instead, the arm-compilers-devel package scans for local installations and setups up MODULEPATH accordingly so the modulefiles are visible $ module load arm $ module avail /opt/arm/modulefiles Generic-AArch64/RHEL/7/arm-hpc-compiler-18.3/armpl/ Generic-AArch64/RHEL/7/arm-hpc-compiler/18.3 (L) Generic-AArch64/RHEL/7/gcc/7.1.0 (L) Generic-AArch64/RHEL/7/suites/arm-compiler-for-hpc/ /opt/ohpc/pub/modulefiles EasyBuild/3.6.1 charliecloud/0.2.4 gnu7/7.3.0 ohpc singularity/2.5.1 arm/compat (L) clustershell/1.8 hwloc/ pmix/2.1.1 valgrind/ autotools cmake/ llvm5/5.0.1 prun/1.2 6

7 Availability of SLE /book_sle_upgrade/data/sec_upgrade-paths_methods.html SLE 15 has been released Presumably, we d want to update to support at some point; it is accessible thru build.opensuse.org (which we use for underlying SUSE OS packages) There is an upgrade process from SLE12 to SLE15, but it requires an offline approach Discussion: - do we want go towards SLE15 right away, wait? - comparatively limited use of SLE12 to date, do we drop SLE12 if going to SLE15 - how to introduce: new repo for SLE15 in 1.3 branch? introduce with 1.4 release? 7

8 Modulefile conventions (cont. from last time) A question spurred by PR has come up on GitHub regarding conventions for exposing header files for compilation ( Recall that we have endeavored to provide a consistent set of environment variables for use by end users to highlight the top level installation path, path to provided binaries, path to provide libraries, and path to development headers, respectively. As an example for HDF5: HDF5_DIR -> /opt/ohpc/pub/libs/gnu7/hdf5/ HDF5_BIN -> /opt/ohpc/pub/libs/gnu7/hdf5/1.10.2/bin HDF5_LIB -> /opt/ohpc/pub/libs/gnu7/hdf5/1.10.2/lib HDF5_INC -> /opt/ohpc/pub/libs/gnu7/hdf5/1.10.2/include Have explored a bit with Cyrus some of the possible options we talked about last time Feel strongly that we should not alter the environment variable approach many folks have accustomed to - gives them total control - fully transparent - users can work around conflicts if upstream releases have namespace conflict Consider three follow-up options: - do nothing (but perhaps remove our INCLUDE variable setting) - we augment all of our modulefiles to optionally set CPATH,LIBRARY_PATH conditional on env variable setting - leverage Lmod hook infrastructure and ohpc conventions to enable these setting via global config modification 8

9 Modulefile conventions (cont. from last time) Possible option #2: Tweak each modulefile with extra check to decide whether to also set CPATH/LIBRARY_PATH Example using openblas: } if { [info exists ::env(ohpc_mod_set_cpath)] } { prepend-path CPATH /opt/ohpc/pub/libs/gnu7/openblas/0.2.20/include prepend-path LIBRARY_PATH /opt/ohpc/pub/libs/gnu7/openblas/0.2.20/lib Standard compilation remains: $ module load openblas $ gcc cblas_dgemm.c -I$OPENBLAS_INC -L$OPENBLAS_LIB -lopenblas Can optionally enable additional CPATH/LIBRARY_PATH settings $ export OHPC_MOD_SET_CPATH=1 $ module load openblas $ echo $CPATH $ /opt/ohpc/pub/libs/gnu7/openblas/0.2.20/include $ gcc cblas_dgemm.c -lopenblas Pretty straightforward, but does touch all relevant modulefiles 9

10 Modulefile conventions (cont. from last time) Possible option #3: Leverage lmod global hook capabilities (e.g. for module load) Requires addition to sitewide config file, SitePackage.lua (which we install with RPM) to add a function hook Example addition: function ohpc_cpath(t) local modfile = io.open(t.fn,"r") local includedir="" local libdir="" -- if (os.getenv("(ohpc_mod_set_cpath") == "1" ) then for line in modfile:lines() do includedir=string.match(line,"^setenv%s*%w*_inc%s*(%s*)") if includedir ~= nil then prepend_path("cpath",includedir) end -- end end end hook.register("load",ohpc_cpath) libdir=string.match(line,"^setenv%s*%w*_lib%s*(%s*)") if libdir ~= nil then prepend_path("library_path",libdir) end This code would get executed for each module load and could optionally set CPATH/LIBRARY_PATH using our FOO_INC and FOO_LIB conventions. Not clear lmod cleans up the same way using load hooks 10