Reza Rad. Power Query and M Beyond Limits

Transcription

1 Reza Rad Power Query and M Beyond Limits

2 Thanks to our Event Sponsors

3 PASS Summit 2018 Registration Offer Continue the learning. Save $150 USD Register for PASS Summit and as a participant in SQLSaturday #769 you can save $150 USD off your conference registration price. To access your exclusive discount, use code* SSDISE1ZJ when you register and your savings will calculate at time of registration. *Unique discount code cannot be applied retroactively and cannot be combined with any other offers Don t let the learning stop. Access over 200 hours of expert training. Register for PASS Summit and as a participants in SQLSaturday #769 get a special bonus free streaming access to all of the PASS Summit 2017 content. That is over 200 hours of educational content you can start watching now. To gain your free access to stream last year s session content, enter code* SSDISE1ZJ when you register. Within 48 hours of registering, you will receive an from PASS with details on how to redeem your free streaming access. G R O U P R E F E R R A L D I S C O U N T C O D E PASS Summit is the largest conference for technical professionals who leverage the Microsoft Data Platform. Get the skills and community connections you need to advance your company and career.

4 Reza Rad Consultant, Trainer RADACAD DW/BI Consultant, Mentor, Trainer, Speaker Microsoft Data Platform MVP Author of SQL Server and BI books Author of Power BI from Rookie to Rock Star book Power BI Trainer for thousands of Developers Microsoft Certified Trainer Microsoft Certified Professional Co-Leader of NZ BI User Group rezaradf

5 Steps To Data Insight Data Preparation Data Modeling Data Visualization

6 Building Block; Keystone Data Preparation is the very first step in Data Insight Good Data Preparation => Useful Insight Bad Data Preparation => Lots of Re-Work

7 Data Preparation Getting Data from Multiple Sources Data Cleansing Data Transformation Preparing Data for Modeling

8 Data Preparation Tool For Data Analyst: Power Query Power Query for Power BI Power Query for Excel

9

10 Comes with Different Shapes and Sizes Excel 2016 Power BI Excel 2013, 2010

11 How to Get it? Power BI Desktop Built-in for Excel 2016 Free Add-in download for Excel 2013, and 2010

12 Wide Range of Data Sources Supported

13 Data Transformations on GUI

14 Combine Append Similar to SQL UNION ALL

15 Combine Merge

16 Join

17 Merge Types Similar to SQL Join Types

18 Group By

19 Power Query Formula Language:

20 What is M? Everything that Happens on GUI works with a Code Behind Code Behind is a Functional Language: M

21 More about Formula Language M is much more powerful than Power Query GUI; Not all functionalities of M implemented through GUI. If you want to be Professional In Power Query; You should be Expert in M M is a functional language

22 M Syntax let x=1 in x

23 Structure of M

24 M is Case Sensitive

25 Three Base Structures in M Table List Record

26 Robust Built-in Functions Table Functions Date Functions #shared keyword Table Functions Table.AddColumn Table.RemoveColumns Table.ReorderColumns Table.SelectColumns Table.ReplaceValue Table.Sort Table.AddIndexColumn Table.FillDown

27 Custom Functions Re-use your code Reduce redundancy Increase consistency

28 Lambda Expression (x) => x+1 Input Parameters => Function Body (x,y) => x+y

29 Parameters Parameters (optional, required)

30 Multi-Line Functions Cascade let/in clause

31 Generators List can be generated List.Dates(<start date>,<occurrence>,<duration>) Generates List of Dates from <start date> to.. It can be used as Loop structure

32 Error Handling Control of Execution when error happens Sending proper error messages Preventing failure with messages for troubleshooting

33 Date Dimension with Power

34 Date Dimension

35 Features Configurable via table in Excel Sheet Fiscal Columns Public Holidays Fetched Live

36 How it works Generators; to build the base structure EACH; to apply transformations on each item in list Date/Text Functions OData Table Functions Date Functions

37 Public Holidays NZ/other_file_formats.php

38 Agenda Combining Datasets Grouping Data Power Query Formula Language: M Generators, Custom Functions Date Dimension with Power Query

39 References to Study More Power BI from Rookie to Rock Star book: FREE Power Query Formula Categories online Help: HA aspx Slides and demos of this session: Power BI Self-Paced Training Course/Videos:

40 Thanks to our Event Sponsors