Please be active and interact

Transcription

1 sas.com/fans #SASNordicFANS Please be active and interact While your waiting for the webinar to begin, please test the Questions function: Write suggestion for future webinar topics During the presentation: Write questions Comments Give feedback And we will try to answer them during the webinar

2 sas.com/fans #SASNordicFANS Please be active and interact While your waiting for the webinar to begin, please test the Questions function: Write suggestion for future webinar topics During the presentation: Write questions Comments Give feedback And we will try to answer them during the webinar

3 #SASNordicUsers Date Title 9 jan SAS Viya- Innovate With Analytics 10 jan SAS Visual Statistics & SAS Visual Data Mining and Machine Learning 11 jan SAS Viya and Open source 12 jan SAS Viya - SAS Visual Analytics jan SAS Viya Community, share and care * 15 jan SAS Viya - SAS Econometrics 23 jan What s new on the SAS Platform 24 jan Visual Text Analytics- Get maximum value from your unstructured data 30 jan Whats new in SAS Visual Analytics sas.com/fans

4 sas.com/fans #SASNordicUsers SAS Viya and Open source Presented by Christopher Broxe

5 Nordic Hack in SAS Viya competition for partners Smarter Together in association with

6 Christopher Broxe Speaker Christopher Broxe is based in Sweden. He has worked in the analytics industries for the last 20 years. Between Christopher managed the Text analytics area of SAS globally within the Global Technology Practice, and worked extensively with customers from around the globe and in various industries. The last years he s been managing sales of Enterprise Search solutions and most lately working at the Swedish Social Insurance agency in areas regarding fraud, artificial Intelligence, text analytics and Big Data. In his spare time, Christopher enjoys travel, good wine and languages. He s particularly fond of Italy and everything Italian. Right now Christopher is handling Government fraud in the EMEA region. Topic of the day SAS Viya and Open source

7 SAS Viya Integration with Open Source

8 SAS Viya MULTIPLE INTERFACES, ONE CODE BASE Visual Interfaces GUI user Programming Interfaces SAS Coder Open Source Coder API Interfaces Developer

9 SAS Viya and Python Access to SAS Viya from Python Integration of SAS Analytics in Python code Jupyter Notebook support Issue tracking and collaboration in development through GitHub project + +

10 Github Github is very commonly used by the open source community and has more than 14 million users and 35 million repositories making it the largest host of source code in the world. SAS creates and manages repositories on GitHub and shares projects with a broader community.

11 SAS Viya and R Access to SAS Viya from R Integration of SAS Analytics in R code R Studio and Jupyter Notebook support Issue tracking and collaboration in development through GitHub project

12 Jupyter Notebook The Jupyter notebook is a web application that allows you to create and share documents that contain live code, equations, visualizations and explanatory text. The notebook supports over 40 languages including SAS and Python.

13 SWAT SAS Scripting Wrapper for Analytics Transfer (SWAT) packages are open source interfaces to CAS SWAT allows users to load data into memory and apply CAS actions to transform, summarize, model and score the data. SWAT allows user to integrate CAS actions with open source programs on the client side to further post process CAS result tables.

14 What Does SWAT Do in a Nutshell SAS Scripting Wrapper for Analytics Transfer (SWAT) packages are open source interfaces to CAS Python coders can have access to the SAS Cloud Analytic Services (CAS) engine (the centre piece of the SAS Viya framework) You can load and analyse large data sets using processing power of CAS engine (either on a physical server or on cloud) and execute workflows of CAS analytic actions from Python on the client side. The SWAT package mimics much of the API of the Pandas package so that using CAS feels familiar to Pandas users. Install client components from GitHub #pip install

15 What is needed for Python integration? SAS Python Client Interface for Viya SMP + Scripting Wrapper Analytics Transfer MPP +

16 How does Python Integration work? Cloud Analytic Services (CAS) In-Memory Engine UAA UAA UAA Data Source Mgmt Folders etc. Microservices BI GUIs CAS Mgmt Log Analytics GUIs Data Mgmt GUIs Query Gen Env Mgr Model Mgmt Audit

17 How Can I Get It? Two Ways R CMD INSTALL R CMD INSTALL r-swat-x.x.x-platform.tar.gz Within R # Make sure prerequisites are installed install.packages('httr') install.packages('jsonlite') install.packages(' repos=null, type='file') *Use R or later

18 What Does SWAT Do? An Example proc print data = hmeq (obs = 10); run; Workers APIs Controller df = s.castable( hmeq ) df.head(10) Translated Action [table.fetch] table.name = hmeq from = 1 to = 10 df <- defcastable(s, hmeq ) head(df, 10)

19 Open Cloud Analytic Services Workers Controller SAS Viya Programming DnnTrain / table={name = 'iris_with_folds' where = '_fold_ ne 19'} modelweights = {name='dl1_weights', replace=true} target = "species" hiddens = {10, 10} acts={'tanh', 'tanh'} sgdopts = {minibatchsize=5, learningrate=0.1, maxepochs=10}; s.dnntrain(table = { name : 'iris_with_folds where : '_fold_ ne 19 }, modelweights = { name : 'dl1_weights', replace : True} target = "species" hiddens = [10, 10], acts=['tanh', tanh'] sgdopts = { minibatchsize : 5, learningrate : 0.1, maxepochs : 10} ) s:dnntrain{table = {name='iris_with_folds where='_fold_ ne 19 }, modelweights = {name='dl1_weights', replace=true} target = "species" hiddens = {10, 10}, acts={'tanh', tanh'} sgdopts = {minibatchsize=5, learningrate=0.1, maxepochs=10}}

20 What does SWAT do? Invokes CAS actions using Python syntax Converts CAS results to native Python objects(dataframes,dictionaries, etc) Integration with Jupyter / Ipython Notebook Pandas DataFrame style access to CAS tables SAS Githubrepository (SWAT download) Model Titanic Survival using Python and CAS aspg3&docsettarget=n0c8k27l2vkwlin196w5qptqsjqx.htm&locale=enopen

21 How to import SWAT? # ipython In[1]: import swat In[2]: conn = swat.cas(host, port, userid, password)

22 How to call CAS Actions? In[3]: stat = conn.serverstatus() In[4]: user = conn.userinfo() In[5]: conn.help()

23 Loading Data In[6]: out = conn.loadtable(path=' ', caslib=' ') path= file path, database table, ESP, etc. caslib= configured CAS data connector

24 Exploring Data Actions that take a CAS table as input can be called directly on the CASTable object. In[7]: tbl.summary() In[8]: tbl.freq(inputs='attrition')

25

26 Training Analytical Models In[9]:tbl.logistic( target='attrition', ) inputs=['gender', 'MaritalStatus', 'AccountAge'], nominals = ['Gender', 'MaritalStatus']

27 Automated Autotuning with Python Action: tunegradientboosttree Parameters: Number of trees Learning rate Sampling rate Variables to consider at each split L1/L2 regularization parameters

28 Scoring Analytical Models forestmodel = s.castable("forestmodel") titanic3part.forestscore( modeltable=forestmodel, copyvars=["_partind_", "survived"], casout={"name":"forestscored", "replace":true}, vote='prob' )

29 Data Step The runcode CAS action executes Data step code. In[10]: conn.runcode(code=''' data cars_temp; set cars; sqrt_msrp = sqrt(msrp); MPG_avg = (MPG_city + MPG_highway) / 2; run; ''')

30 What are the Benefits? Data Scientists use tools they are familiar with IT have governance and lineage over the data and models Easy scalability beyond your PC memory Access to SAS fault-tolerant, in-memory analytics server Streamlined deployment and model management Improved productivity and efficiency intelligence Improved time to

31 Q&A

32 Date Title 9 jan SAS Viya- Innovate With Analytics 10 jan SAS Visual Statistics & SAS Visual Data Mining and Machine Learning 11 jan SAS Viya and Open source 12 jan SAS Viya - SAS Visual Analytics jan SAS Viya Community, share and care * 15 jan SAS Viya - SAS Econometrics 23 jan What s new on the SAS Platform 24 jan Visual Text Analytics- Get maximum value from your unstructured data 30 jan Whats new in SAS Visual Analytics sas.com/fans

33 sas.com/fans

34 sas.com/fans Our Newsletter

35 sas.com/fans End of Webinar Please use 2 minutes on the survey It s important for us! Thanks for attending this Free Webinar, hosted by #SASNordicUsers