Solaris 10. DI Gerald Hartl. Account Manager for Education and Research. Sun Microsystems GesmbH Wienerbergstrasse 3/VII A Wien

Transcription

1 Solaris 10 DI Gerald Hartl Account Manager for Education and Research Sun Microsystems GesmbH Wienerbergstrasse 3/VII A Wien

2 Agenda Short Solaris 10 Overview Introduction to Solaris Internals Memory Q&A

3 Short Solaris 10 Overview

4 Solaris Sun Microsystems Inc SunOS 1.0 FFS from 4.2 BSD

5 Solaris 10 Innovations Overview Extreme Performance Highest Availability with Predictive Self Healing Optimal Monitoring with DTrace Secure and Effective Consolidation with Solaris Containern... and over 600 projecets Maximum Security based on Trusted Solaris

6 Solaris 10 Same Ideas about Consolidation Memory PCI-E I/O L2 Cache 134GB/s Interconnect Core #1 Core #2 Core #3 Core #4 Core #5 Core #6 Core #7 Core #8 Container 1: Web-Server Container 2: App-Server Container 3: Database

7 Container and Ultra/OpenSPARC T1 Blade Shelf on a Chip Network consolidation on chip > Higher performance (chip bandwidth) Container can be assigned to cores > Optimize Resource utilization Sandbox for application Memory PCI-E I/O L2 Cache 134GB/s Interconnect Core #1 Core #2 Core #3 Core #4 Core #5 Core #6 Core #7 Core #8 Container 1: Web-Server Container 2: App-Server Container 3: Database

8 OS Virtualisation Trends Hardware Consolidation OS Consolidation Hardware Partitions Virtual Machines OS Virtualisation Resource Management Dynamic System Domains More OS instances > More administratin required Strong seperation Higher costs (HW or license) VMware Solaris Container (Zones + SRM) Only one OS instance > Simple administration Less seperation (HW) More flexibility Solaris Resource Manager (SRM) Stronger Seperation More Flexibility

9 ZFS: The Ultimate Filesystem Extreme reliability > No data without checksums > Selfhealing datastore Simple administration > Single line instead of scripts > Includes Volume Manager Highest capacity > 128bit filesystem High performance Add ons modules available

10 The ZFS Idea Volume Manager and Filesystem > Reduce complexity > Simple administration > Increase resource utilization Server Innovative architecture > No filesystem check required ZFS1 ZFS2 ZFS3 ZFS4 > Mirroring, Snapshot, RAID-Z, compression,... ZFS Storage Pool Solaris 10U3 c0t0d0 c0t0d1 c0t2d0

11 Example Filesystem /home/ann /home/bob /home/sue c0t0d0 RAID1 c0t1d0

12 In the Past # format... (long interactive session omitted) # metadb -a -f disk1:slice0 disk2:slice0 # metainit d disk1:slice1 d10: Concat/Stripe is setup # metainit d disk2:slice1 d11: Concat/Stripe is setup # metainit d20 -m d10 d20: Mirror is setup # metattach d20 d11 d20: submirror d11 is attached # metainit d disk1:slice2 d12: Concat/Stripe is setup # metainit d disk2:slice2 d13: Concat/Stripe is setup # metainit d21 -m d12 d21: Mirror is setup # metattach d21 d13 d21: submirror d13 is attached # metainit d disk1:slice3 d14: Concat/Stripe is setup # metainit d disk2:slice3 d15: Concat/Stripe is setup # metainit d22 -m d14 d22: Mirror is setup # metattach d22 d15 d22: submirror d15 is attached # newfs /dev/md/rdsk/d20 newfs: construct a new file system /dev/md/rdsk/d20: (y/n)? y... (many pages of 'superblock backup' output omitted) # mount /dev/md/dsk/d20 /export/home/ann # vi /etc/vfstab... while in 'vi', type this exactly: /dev/md/dsk/d20 /dev/md/rdsk/d20 /export/home/ann ufs 2 yes - # newfs /dev/md/rdsk/d21 newfs: construct a new file system /dev/md/rdsk/d21: (y/n)? y... (many pages of 'superblock backup' output omitted) # mount /dev/md/dsk/d21 /export/home/ann # vi /etc/vfstab... while in 'vi', type this exactly: /dev/md/dsk/d21 /dev/md/rdsk/d21 /export/home/bob ufs 2 yes - # newfs /dev/md/rdsk/d22 newfs: construct a new file system /dev/md/rdsk/d22: (y/n)? y... (many pages of 'superblock backup' output omitted) # mount /dev/md/dsk/d22 /export/home/sue # vi /etc/vfstab... while in 'vi', type this exactly: /dev/md/dsk/d22 /dev/md/rdsk/d22 /export/home/sue ufs 2 yes - # format... (long interactive session omitted) # metattach d12 disk3:slice1 d12: component is attached # metattach d13 disk4:slice1 d13: component is attached # metattach d21 # growfs -M /export/home/bob /dev/md/rdsk/d21 /dev/md/rdsk/d21:... (many pages of 'superblock backup' output omitted)

13 With ZFS Create a storage pool named home # zpool create home mirror c0t0d0 c0t1d0 Create a filesysteme for ann, bob and sue # zfs create home/ann # zfs create home/bob # zfs create home/sue Add new disk to pool # zpool add home mirror c1t0d0 c1t1d0

14

15 Introduction to Solaris Internals

16 Solaris Kernel Architecture Source: Solaris Internals, page 15

17 Solaris Kernel Architecture System call interface Process execution and scheduling Memory management Resource management File systems I/O bus and device management Kernel facilities (clock, timers,...) Networking Source: Solaris Internals, page 15

18 Global Thread Priorities Source: Solaris Internals, page 22

19 Solaris Resource Management Source: Solaris Internals, page 35

20 Zones in Solaris Source: Solaris Internals, page 36

21 Memory

22 Virtual to Physical Memory Management Source: Solaris Internals, page 449

23 Solaris Virtual Memory Layers Source: Solaris Internals, page 445

24 Virtual Address Spaces Executable text binary, read only with execute permissions Executable data mapped read/write/private Heap space memory allocated by malloc() Process stack anonymous memory and is mapped read/write Source: Solaris Internals, page 457

25 Virtual Address Spaces Source: Solaris Internals, page 457

26 Address Space Layout - UltraSPARC Source: Solaris Internals, page 459

27 Address Space Layout - x86 & x64 Source: Solaris Internals, page 459

28 The Stack Solaris Version Maximum Heap Size Notes Solaris x86 32bit mode 2GBytes by default Boot option kernel base can be moved to allow larger process address space Solaris x64 64bit mode 16EBytes Virtually unlimited SPARC 64bit mode 16TBytes on UltraSPARC I/II 16EBytes Virtually unlimited Source: Solaris Internals, page 462

29 Memory Mapped Files Source: Solaris Internals, page 463

30 Tracing the VM System sol10#./vm.d <pid> sol10# more vm.d :::BEGIN { start = timestamp; } syscall::: /$target == pid/ { trace((timestamp - start) / 1000); } ::add_physmem:, ::sptcreate:,... ::sptdestroy:, ::va_to_pfn: /$target == pid/ { trace((timestamp - start) / 1000); } Source: Solaris Internals, page 466

31 Tracing the VM System 0 => munmap > as_unmap > as_findseg <- as_findseg > segvn_unmap > segvn_lockop <- segvn_lockop > hat_unload_callback > page_get_pagesize <- page_get_pagesize > hat_page_setattr <- hat_page_setattr > free_vp_pages > page_share_cnt > hat_page_getshare <- hat_page_getshare <- page_share_cnt <- free_vp_pages <- hat_unload_callback > seg_free > as_removeseg <- as_removeseg > segvn_free Source: Solaris Internals, page 466

32 Virtual Address Space Management Source: Solaris Internals, page 467

33 Virtual Address Space Management The address space subsystem manages the following > Duplication of address spaces, for fork() > Destruction of address spaces, for exit() > Creation of new segments within an address space > Removal of segments from an address space > Setting and mangement of page protection for an address space > Page fault routing for an address space > Page locking and advice for an address space > Management of watchpoints for an address space Source: Solaris Internals, page 467

34 Page Faults in Address Spaces Source: Solaris Internals, page 473

35 Segment Drivers Source: Solaris Internals, page 476

36 The vnode Segment seg_vn Executable text Executable data Heap and stack (anonymous memory) Shared libraries Mapped files Source: Solaris Internals, page 481

37 The vnode Segment seg_vn Source: Solaris Internals, page 481

38 Anonymous Memory Source: Solaris Internals, page 485

39 Virtual Memory Watchpoints Source: Solaris Internals, page 492

40 Source Solaris Internals: Solaris 10 and OpenSolaris Kernel Architecture, Second Edition By Richard McDougall, Jim Mauro Publisher: Prentice Hall Pub Date: July 10, 2006 Print ISBN-10: Print ISBN-13: Pages: 1072

41 > FREE AND UNLIMITED ACCESS TO SUN PROFESSIONAL COURSES > GET 60% DISCOUNT ON PROFESSIONAL CERTIFICATIONS FROM PROMTERICS Do not get yourself nuts... WE MAKE IT EASY FOR YOU! REGISTER TODAY AT: Contact:

42 OPEN SUN > SUNTM CAMPUS AMBASSADOR Job Description Sun is looking for graduate or senior level students with a strong background in software development/programming to work part time to: - Lead the Sun open source developer community on your campus - Run Sun Technology demo sessions on your campus - Promote Sun training events on your campus - Promote Sun's open source platforms and development tools to professors and researchers The Sun Campus Ambassador must have a strong background in software development/programming. The Campus Ambassador must have excellent communication skills and should be comfortable serving as a public speaker. In addition, the Campus Ambassador must be self-motivated, highly organized and be able to work independently. Familiarity with NetBeans, Sun Studio and/or the Solaris Operating System are desirable. Please send your application via to ful_austria@sun.com opensparc Sun Confidential: Internal Only opensolaris

43 Solaris 10 Q&A DI Gerald Hartl Account Manager for Education and Research Sun Microsystems GesmbH Wienerbergstrasse 3/VII A Wien