Taking Advantage of the SAS System on the Windows Platform

Transcription

1 Taking Advantage of the SAS System on the Windows Platform 09:45 Friday Gary Mehler, SAS Institute

2 Introduction! Current state of the Windows platform! Current state of PC hardware! Current state of SAS operation on Windows! GUI update! Server features! Future directions

3 Windows 2000 Overview! Basic information! Improvements! New features

4 Windows 2000 now Available! Windows 2000 shipped on Feb 17, 2000! Many new features! New versions!! New capabilities! More complexity!! More reliability! It s been a long time coming!

5 Windows 2000 is:! An improved server platform! An improved laptop operating system! More reliable and scalable! Available for Intel-compatible processors only! about 35M lines of code! about a $1B development project for Microsoft

6 Windows 2000 Server Family Value 8-way SMP 8 GB RAM (EMA) 2 node clustering Load balancing Up to 32-way SMP Up to 64GB memory 4 node clustering WinSock Direct (SAN) Purchased w/hw Not available yet 4-way SMP 4 GB RAM IIS CPU & bandwidth throttling Functionality and Capacity

7 Can be Complicated to Deploy! Server Deployment Planning Guide available! 1206 pages of material! Well-documented (!)! Planning Overview (157 pages)! Network prerequisites (98 pages)! Active Directory Infrastructure (210 pages)! Installation (163 pages)! Advanced Management (146 pages)! Client Deployment (196 pages)

8 SAS V8 status on Windows 2000! Testing NT5, Windows 2000 for a long time! 8e tested with Windows 2000! Goal: run well on Windows 2000! Present: SAS 8e is Windows 2000 Ready, supported! Future: be logo certifiable for Windows 2000

9 Windows 2000 Improvements over NT 4! Filesystem! Clustering! Usability! Security! Manageability! Reliability! Performance

10 Filesystem Improvements! Dynamic disks!! Encrypting Filesystem! Automatic decryption based on Userid! Quota support! Reparse Points (symlinks)! Hierarchical Storage Management!! Offline caching

11 Encrypting Filesystem! Easy to safeguard data

12 Offline Caching! Enables off-line program/data access! Can be used for user data and app settings! Generalizes Work Offline mode from apps like MS Outlook, web browsers!! Automatic caching for programs can simplify laptop software installation!! SAS client install can even be used for off-line use

13 Offline Caching on the Server

14 Offline Caching on the Client

15 Failover Clustering! Failover is the evolution of Wolfpack! Up to four-node clusters supported! Spare can have multiple identities! We re studying failover configurations now! QUESTION: What application needs do you want to meet with fail-over clustering?

16 Failover Clustering

17 Usability Improvements! OnNow/ACPI (standby/low power modes)!! Multiple Monitor support! Plug and Play! Multilanguage-ready!! Auto complete!! Enhanced My Documents folder (My Pictures too)! Documents and Settings! Personalized Menus! New My Network Places Folder

18 Security Improvements! Public Key Infrastructure! Run as (SU)! Kerberos Authentication! Encrypting file system

19 Manageability Improvements! Offline file caching! Microsoft Management Console! Windows Installer! Task scheduler! Group Policy! Terminal Services admin mode! Remote console abilities built-in

20 Microsoft Management Console (MMC)! Consistent user-interface for administrative functions! Easy-to-find administrator tools! Snap-ins can build on existing functionality! Being explored for SAS administrative needs! QUESTION: What are your top SAS-related administrative issues?

21 MMC for Computer and Application Management

22 Increased Reliability Microsoft spent $162M on reliability focus! Fewer Crashes! System File Protection These are good things for large-scale applications like The SAS System

23 Performance Improvements! Microsoft says Windows 2000 Professional is:! 39% faster than Windows 95! 30% faster than Windows 98! 24% faster than NT4 Workstation! Windows 2000 Server! HP says 8 way comparable to UNIX 12 way, but 30% cheaper

24 New Features in Windows 2000! Active Directory! Enterprise Memory Architecture! Integrated Terminal Services! Network Load Balancing! System File Protection! Dynamic Disk support

25 Active Directory Basics! Based on LDAP! Basic information storage structure! Printers! Filesystem shares! User attributes! Application-specific data! Application server resources

26 SAS LDAP Current Use! (Some of this seen in Opening Session)! MQSeries, MSMQ messaging! Publish/Subscribe info storage! Real-time DW data distribution! LDAP used via SAS Call statements and SCL interface

27 Enterprise Memory Architecture! Based on PAE mode of Intel Xeon chips! NT s memory manager grows to 36-bits (64GB)! Available on Advanced, DataCenter Server! Replaces ESMA support in V8 SAS! Automatic support in Windows kernel!! Collections of apps can use >4GB memory via Windows Virtual Memory Manager! QUESTION: What are your high-memory needs for SAS processing?

28 DataCenter Server and high RAM

29 More on DataCenter Server!Six large SAS jobs!1.2gb RAM used by each!total user memory use: close to 8GB

30 Terminal Services Built In! No more Terminal Server Edition! Built into basic OS for the first time! Administrative mode for limited use! Tuned multi-user mode available too! Available on all server versions.!! Works well with EMA and SMP! QUESTION: How do you plan to utilize Terminal Services and when?

31 Terminal Services for Remote Administration

32 Network Load Balancing! Distributes TCP/IP connections! Also called Scale Out! Compared with Scale Up (meaning SMP)!! Can be used with most apps!! Works well in web-server scenarios! Basis for Microsoft s highest scalability TPC/C numbers! Testing with SAS 8.1! QUESTION: What are your load-balancing clustering needs?

33 NLB (Scalability Clustering) TCP/IP clients, Such as SAS/CONNECT TCP/IP servers, Such as SAS/CONNECT

34 Windows 2000 Client Benefits Windows 2000 Professional:! Great for laptops!! More stable than Windows 98! Power management, plug and play! Encrypting filesystem! Data synchronization built in

35 Windows 2000 Summary! Lots of advances!! Many ways SAS applications can benefit! Lots of options to consider! Can be difficult to deploy! Do you have a deployment plan?

36 Hardware Advances! Faster CPUs!! 1 GHz recently achieved by AMD and Intel! Xeon processors up to 700 MHz! More throughput! Faster bus speeds (133MHz is better)! More processors! 8-way Profusion systems available! Itaniums on the way

37 Faster CPUs (the simple view)

38 Faster CPUs (our view) (0.18µ Pentium III)

39 Faster CPUs Coming this Year! Willamette processors over 1.5 GHz! More optimization opportunities!! Faster floating point math?!! Much faster bus speeds?! Intel and SAS already working on this

40 8-way Profusion Systems

41 Profusion for High Throughput! SAS Institute is testing heavily on this platform! Do these numbers look e-ready?

42 Benefits of 8-way Systems! Higher throughput limits! High memory capacity (16GB currently)! Single administration cost for lots of performance! Can support high-end I/O subsystems! See a demonstration at the Compaq booth in the demo area

43 What s New in the SAS System?! Logo Certification status! SAS System Viewer Improvements! SAS GUI Enhancements! Enhanced (Syntax) Editor! Server Operation Improvements

44 Windows 98/NT Logo Certification! Version 8 of the SAS System is Designed for Windows 98 and Windows NT! A trend of logo certification since 6.11! Windows 95: ! Windows 95/NT: V7! Windows 98/NT: V8

45 The Logo means that SAS V8 is:! Tested and reliable! Provides the best user experience in:! Installation! Uninstallation! User Interface and Windows shell integration! Supports UNC and long filenames! Supports OLE/COM and drag/drop

46 Terminal Server Compatibility! Version 8 of the SAS System is Terminal Server Compatible! Independently tested by Veritest Corp. for! Functionality! Performance! Scalability! Reliability

47 Terminal Server Testing means:! Installs correctly in administrative install mode! Pre-checks for installation privileges required! Recognizes Terminal Server bandwidth issues! Disables display of SAS System splash screen! Single installation used by all users! Independent SASUSER, SASWORK areas used! Program area is read-only

48 Terminal Server performance! Tested for comparable performance on T.S. as compared with typical client PC! Tested in 15-user load with continuous activity for 20 hours! No crashes! No memory leaks! No change in system stability

49 Speaking of Terminal Server! Many installation scenarios are possible with SAS products! Do you know how your products are installed?! Do you know how licenses for SAS products work on NT servers and non-server PCs?! Confused? Let s talk if you have questions.

50 SAS System Viewer update! Supports full column manipulation! Supports column reordering (drag/drop)! Supports column hiding/showing! Column chooser dialog! Supports column freezing! Reads transport files! Still a great way to review/print.log files! QUESTION: Does the SAS System Viewer meet your needs?

51 SAS Viewer Column Chooser

52 SAS Viewer Column Manipulation

53 Server Improvements! Throughput improvements! Performance update! Terminal Server support! NT Service support! Operation on NT clusters

54 Throughput Improvements! Scatter/Gather I/O! Enterprise Server Memory Architecture! Asynchronous I/O! In Memory Files! MP Connect

55 Scatter/Gather I/O! Scatter Read and Gather Write! On NT, Windows 2000 only! Option SGIO enables it! Unbuffered, asynchronous I/O! Bypasses the NT file cache! Good for very large (> 527MB) files! Since file cache bypassed, can preserve cache state for other I/O needs! Since file cache bypassed, repeated use of other small files may be optimal

56 More on Scatter/Gather I/O! V8 implementation supports partial reads! NT kernel thread continues reading in background! NT kernel can also process write requests in background! Asynchronous operation beneficial with SMP! Very good for large-memory systems

57 ESMA for Very Large Memory! Enterprise Server Memory Architecture! Uses 36-bit address mode of Intel Xeon! PSE-36! Access memory over 4GB on NT 4! Can cache library contents for fast access! Can cache WORK library for faster sorts! Goal: eliminate slow disk access

58 ESMA modes! Option MEMLIB! WORK is placed in ESMA memory! LIBNAME E. MEMLIB;! Specific library placed in ESMA memory! Option MEMCACHE! Cache libraries through ESMA memory! Data is accessed through a large cache

59 ESMA Caveats! All that memory is expensive! In memory cache or write-back mode?! Only supported on NT 4 (not Windows 2000)! System Requirements! Windows NT Enterprise Edition! Pentium II or Pentium III Xeon processors! PSE-36 Driver from Intel! QUESTION: Do you have need for ESMA support?

60 Asynchronous I/O! Used with ASYNCHIO (or NOSYNCHIO)! Allows SAS tasks to execute while I/O is pending with the operating system! Good for SAS/SHARE servers! Available on all V8 platforms

61 In Memory Files! New in 8.1 on all platforms! Opens data set and loads into memory! Speeds access to frequently-used data! Data is read once and held across PROC and Datastep boundaries! Great for SAS/SHARE servers

62 More on In Memory Files! Used with SASFILE statement:! SASFILE lib.member OPEN;! Open file and allocate memory! SASFILE lib.member LOAD;! Open, allocate, and read! SASFILE lib.member CLOSE;! Close file, free memory

63 MP CONNECT! Multi-processing with SAS! Exploit SMP machines! Pretty interesting on 8-way servers! Works with RSUBMIT local autosignon! Uses new WAIT option on RSUBMIT! New statement: WAITFOR for rendezvous! Available on all platforms

64 MP Connect use: SMP Sorts options autosignon=yes; rsubmit task1 wait=no sascmd= sas ; proc sort data=s2 by var1; run; endrsubmit; rsubmit task2 wait=no sascmd= sas ; proc sort data=s1 by var1; run; endrsubmit; waitfor _all_ task1 task2;

65 Other Performance Improvements! More assemblerization of key routines! Support from Intel tuning labs! Pentium III Support (KNI)! Prefetching data before actual use! Wider data movement through processor! Willamette improvements coming next

66 NT Service Overview! SAS running as a true NT service! Autostart jobs at machine boot time! Auto-restart on job failure (Windows 2000)! Specify logon info per job! Remotely monitor service operation! Easy-to-use configuration utility! Events logged to System Event Log! QUESTION: What types of operations do you want to run as services?

67 SAS Service Configuration Utility

68 Service Configuration Options

69 Windows 2000 Service Recovery

70 SAS Operation on NT Clusters! Investigating failover operation! Testing load-balancing operation! Looking for customer input on usage scenarios! QUESTIONS:! Which products are most important to you?! Are both type of clusters equally important?

71 Sample Load Balanced Cluster! Two nodes act as SAS/CONNECT servers! TCP/IP communications required! Network Load Balancing configured on nodes! A new cloud IP address is created! SAS/CONNECT clients use the cloud address! RSUBMIT jobs are launched on both nodes, depending on incoming IP address

72 Futures! New logo certification options! Windows Me! 64-bit Windows! Future 32-bit processors! Future SAS directions on Windows

73 Windows 2000 Logo! Desktop Applications! Server Applications! Various SAS products exploring logo possibilities

74 Windows 2000 Logo requirements! Active Directory use! Windows installer use for desktop apps! Accessibility! Power management awareness! Group Policies! Support cluster service (Advanced, DataCenter)

75 Windows 2000 is NOT Me! Millennium Edition is successor to Windows 98! To ship very soon! Still a consumer-based system! Windows 2000 is the new business platform! More stable and scalable! Includes System File Protection! Should merge with NT codebase next time

76 64-bit Windows 2000! Windows 2000 is already 64-bit ready! We ve been working with Intel and Microsoft for a while on this! One of the first public showings is here at SeUGI!! Will be ready by Intel Itanium launch! Itanium systems will have many advantages over current 32-bit PC processors

77 32-bit vs. 64-bit Windows?! 32-bit Windows will continue to exist for a long time! Future 32-bit PCs will have interesting performance improvements too! Customer choice: cost vs. scalability and performance

78 Itanium Benefits!! Much faster floating point math! 32-bit Intel systems are typically constrained by their floating point math performance!! Higher memory scalability! Terabytes!!! Higher overall throughput! Instruction parallelization! Lots of other tricks too

79 64-bit Scalability Differences Architectural Component 64-bit Windows bit Windows 2000 Virtual Memory 16 TB 4 GB Paging file size 512 TB 16 TB Hyperspace 8 GB 4 MB Paged pool 128 GB 470 MB Non-paged pool 128 GB 256 MB System cache 1 TB 1 GB System Page Table 128 GB 660 MB

80 SAS System on Itanium! V8 now running on 64-bit Windows! QUESTION: What are your needs for 64-bit computing on Windows?! Would you like to be a pilot site for SAS/Windows 64 testing?! Hardware vendors are interested

81 For more information:

82 Summary! e-requirements can be met on the back end! Windows 2000 helps in some ways! Faster 32-bit processors help a lot! Upcoming 64-bit systems can help later! SAS System improvements make more e- possible! Scalability! Throughput improvements! Administration! Tell me what you need next

83 Thank you! Any questions?