Solaris 10. DI Gerald Hartl. Account Manager for Education and Research. Sun Microsystems GesmbH Wienerbergstrasse 3/VII A Wien

Transcription

1 Solaris 10 DI Gerald Hartl Account Manager for Education and Research Sun Microsystems GesmbH Wienerbergstrasse 3/VII A Wien

2 Agenda Short Solaris 10 Overview Introduction to Solaris Internals Memory File System Q&A

3 Short Solaris 10 Overview

4 Solaris Sun Microsystems Inc SunOS 1.0 FFS from 4.2 BSD

5 Solaris 10 Innovations Overview Highest Availability with Predictive Self Healing Extreme Performance Optimal Monitoring with DTrace... and over 600 projecets Secure and Effective Consolidation with Solaris Containern Maximum Security based on Trusted Solaris

6 Solaris 10 Same Ideas about Consolidation Memory PCI-E I/O L2 Cache 134GB/s Interconnect Core #1 Core #2 Core #3 Core #4 Core #5 Core #6 Core #7 Core #8 Container 1: Web-Server Container 2: App-Server Container 3: Database

7 Container and Ultra/OpenSPARC T1 Blade Shelf on a Chip Network consolidation on chip > Higher performance (chip bandwidth) Container can be assigned to cores > Optimize Resource utilization Sandbox for application Memory PCI-E I/O L2 Cache 134GB/s Interconnect Core #1 Core #2 Core #3 Core #4 Core #5 Core #6 Core #7 Core #8 Container 1: Web-Server Container 2: App-Server Container 3: Database

8 OS Virtualisation Trends Hardware Consolidation OS Consolidation Hardware Partitions Virtual Machines OS Virtualisation Resource Management Dynamic System Domains More OS instances > More administratin required Strong seperation Higher costs (HW or license) VMware Solaris Container (Zones + SRM) Only one OS instance > Simple administration Less seperation (HW) More flexibility Solaris Resource Manager (SRM) Stronger Seperation More Flexibility

9 ZFS: The Ultimate Filesystem Extreme reliability > No data without checksums > Selfhealing datastore Simple administration > Single line instead of scripts > Includes Volume Manager Highest capacity > 128bit filesystem High performance Add ons modules available

10 The ZFS Idea Volume Manager and Filesystem > Reduce complexity > Simple administration > Increase resource utilization Server Innovative architecture > No filesystem check required ZFS1 ZFS2 ZFS3 ZFS4 > Mirroring, Snapshot, RAID-Z, compression,... ZFS Storage Pool Solaris 10U3 c0t0d0 c0t0d1 c0t2d0

11 Example Filesystem /home/ann /home/bob /home/sue c0t0d0 RAID1 c0t1d0

12 In the Past # format... (long interactive session omitted) # metadb -a -f disk1:slice0 disk2:slice0 # metainit d disk1:slice1 d10: Concat/Stripe is setup # metainit d disk2:slice1 d11: Concat/Stripe is setup # metainit d20 -m d10 d20: Mirror is setup # metattach d20 d11 d20: submirror d11 is attached # metainit d disk1:slice2 d12: Concat/Stripe is setup # metainit d disk2:slice2 d13: Concat/Stripe is setup # metainit d21 -m d12 d21: Mirror is setup # metattach d21 d13 d21: submirror d13 is attached # metainit d disk1:slice3 d14: Concat/Stripe is setup # metainit d disk2:slice3 d15: Concat/Stripe is setup # metainit d22 -m d14 d22: Mirror is setup # metattach d22 d15 d22: submirror d15 is attached # newfs /dev/md/rdsk/d20 newfs: construct a new file system /dev/md/rdsk/d20: (y/n)? y... (many pages of 'superblock backup' output omitted) # mount /dev/md/dsk/d20 /export/home/ann # vi /etc/vfstab... while in 'vi', type this exactly: /dev/md/dsk/d20 /dev/md/rdsk/d20 /export/home/ann ufs 2 yes - # newfs /dev/md/rdsk/d21 newfs: construct a new file system /dev/md/rdsk/d21: (y/n)? y... (many pages of 'superblock backup' output omitted) # mount /dev/md/dsk/d21 /export/home/ann # vi /etc/vfstab... while in 'vi', type this exactly: /dev/md/dsk/d21 /dev/md/rdsk/d21 /export/home/bob ufs 2 yes - # newfs /dev/md/rdsk/d22 newfs: construct a new file system /dev/md/rdsk/d22: (y/n)? y... (many pages of 'superblock backup' output omitted) # mount /dev/md/dsk/d22 /export/home/sue # vi /etc/vfstab... while in 'vi', type this exactly: /dev/md/dsk/d22 /dev/md/rdsk/d22 /export/home/sue ufs 2 yes - # format... (long interactive session omitted) # metattach d12 disk3:slice1 d12: component is attached # metattach d13 disk4:slice1 d13: component is attached # metattach d21 # growfs -M /export/home/bob /dev/md/rdsk/d21 /dev/md/rdsk/d21:... (many pages of 'superblock backup' output omitted)

13 With ZFS Create a storage pool named home # zpool create home mirror c0t0d0 c0t1d0 Create a filesysteme for ann, bob and sue # zfs create home/ann # zfs create home/bob # zfs create home/sue Add new disk to pool # zpool add home mirror c1t0d0 c1t1d0

14

15 Introduction to Solaris Internals

16 Solaris Kernel Architecture Source: Solaris Internals, page 15

17 Solaris Kernel Architecture System call interface Process execution and scheduling Memory management Resource management File systems I/O bus and device management Kernel facilities (clock, timers,...) Networking Source: Solaris Internals, page 15

18 Global Thread Priorities Lightweight Process (LWP) The kernel visible execution context for a user thread Source: Solaris Internals, page 18

19 Global Thread Priorities Source: Solaris Internals, page 22

20 Solaris Resource Management Source: Solaris Internals, page 35

21 Zones in Solaris Source: Solaris Internals, page 36

22 Components of a Process Source: Solaris Internals, page 44

23 Core Process Components usr/src/uts/common/sys/proc.h Address space Credentials (UID, GID) Process links CPU utilization Signals Threads Microstate accounting User area (uarea) Procfs Resource management Source: Solaris Internals, page 44

24 Process Structures Source: Solaris Internals, page 55

25 Thread States usr/src/uts/common/sys/thread.h Source: Solaris Internals, page 157

26 Processor Abstractions Source: Solaris Internals, page 162

27 Processor Abstractions CPU partitions Processor sets Resource pools Locality groups (lgroups, MPO) Solaris 9, Memory Placement Optimization Source: Solaris Internals, page 162

28 Memory

29 Virtual to Physical Memory Management Source: Solaris Internals, page 449

30 Solaris Virtual Memory Layers Source: Solaris Internals, page 445

31 Virtual Address Spaces Executable text binary, read only with execute permissions Executable data mapped read/write/private Heap space memory allocated by malloc() Process stack anonymous memory and is mapped read/write Source: Solaris Internals, page 457

32 Virtual Address Spaces Source: Solaris Internals, page 457

33 Address Space Layout - UltraSPARC Source: Solaris Internals, page 459

34 Address Space Layout - x86 & x64 Source: Solaris Internals, page 459

35 The Stack Solaris Version Maximum Heap Size Notes Solaris x86 32bit mode 2GBytes by default Boot option kernel base can be moved to allow larger process address space Solaris x64 64bit mode 16EBytes Virtually unlimited SPARC 64bit mode 16TBytes on UltraSPARC I/II 16EBytes Virtually unlimited Source: Solaris Internals, page 462

36 Memory Mapped Files Source: Solaris Internals, page 463

37 Tracing the VM System sol10#./vm.d <pid> sol10# more vm.d :::BEGIN { start = timestamp; } syscall::: /$target == pid/ { trace((timestamp - start) / 1000); } ::add_physmem:, ::sptcreate:,... ::sptdestroy:, ::va_to_pfn: /$target == pid/ { trace((timestamp - start) / 1000); } Source: Solaris Internals, page 466

38 Tracing the VM System 0 => munmap > as_unmap > as_findseg <- as_findseg > segvn_unmap > segvn_lockop <- segvn_lockop > hat_unload_callback > page_get_pagesize <- page_get_pagesize > hat_page_setattr <- hat_page_setattr > free_vp_pages > page_share_cnt > hat_page_getshare <- hat_page_getshare <- page_share_cnt <- free_vp_pages <- hat_unload_callback > seg_free > as_removeseg <- as_removeseg > segvn_free Source: Solaris Internals, page 466

39 Virtual Address Space Management Source: Solaris Internals, page 467

40 Virtual Address Space Management The address space subsystem manages the following > Duplication of address spaces, for fork() > Destruction of address spaces, for exit() > Creation of new segments within an address space > Removal of segments from an address space > Setting and amangement of page protection for an address space > Page fault routing for an address space > Page locking and advice for an address space > Management of watchpoints for an address space Source: Solaris Internals, page 467

41 Page Faults in Address Spaces Source: Solaris Internals, page 473

42 Segment Drivers Source: Solaris Internals, page 476

43 The vnode Segment seg_vn Executable text Executable data Heap and stack (anonymous memory) Shared libraries Mapped files Source: Solaris Internals, page 481

44 The vnode Segment seg_vn Source: Solaris Internals, page 481

45 Anonymous Memory Source: Solaris Internals, page 485

46 Virtual Memory Watchpoints Source: Solaris Internals, page 492

47 File System

48 File System Framework Source: Solaris Internals, page 657

49 Process Level File Abstractions Source: Solaris Internals, page 658

50 Virtual File System (vfs) Interface Source: Solaris Internals, page 675

51 The mount Method Source: Solaris Internals, page 681

52 The Mounted vfs List Source: Solaris Internals, page 684

53 The vnode Source: Solaris Internals, page 685

54 The Life Cycle of a vnode Source: Solaris Internals, page 696

55 File System I/O Source: Solaris Internals, page 707

56 read() and write() System Calls Source: Solaris Internals, page 709

57 Source Solaris Internals: Solaris 10 and OpenSolaris Kernel Architecture, Second Edition By Richard McDougall, Jim Mauro Publisher: Prentice Hall Pub Date: July 10, 2006 Print ISBN-10: Print ISBN-13: Pages: 1072

58 > FREE AND UNLIMITED ACCESS TO SUN PROFESSIONAL COURSES > GET 60% DISCOUNT ON PROFESSIONAL CERTIFICATIONS FROM PROMTERICS Do not get yourself nuts... WE MAKE IT EASY FOR YOU! REGISTER TODAY AT:

59 Solaris 10 Q&A DI Gerald Hartl Account Manager for Education and Research Sun Microsystems GesmbH Wienerbergstrasse 3/VII A Wien