An Empirical Characterization of IFTTT

Transcription

1 An Empirical Characterization of IFTTT Ecosystem, Usage, and Performance Xianghang Mi, Feng Qian, Ying Zhang, XiaoFeng Wang Indiana University Bloomington, Facebook Research 1

2 Outline 2

3 What is IFTTT IFTTT User Define, Run and Publish IF This Then That Workflows Called Applets Service Provider Configure and Publish Services Consisting of Triggers and Actions 3

4 What is IFTTT: Applets 4

5 Why IFTTT 5

6 How IFTTT Works Set up an Applet Request Trigger Events Return Trigger Events Sync Request Trigger Events Status Return New Trigger Events Send Action Request Return Action Result Sync Status 6

7 How IFTTT Works 7

8 How IFTTT Evolves: Methodology Crawl We crawled IFTTT every week for its services and applets between Nov 2016 and May 2017 Dataset Overall, we crawled 200G data and we have open sourced it on our project website. Measure Service categories and distribution, IoT usage, applet properties. 8

9 How IFTTT Evolves: Statistics Aspect Sep 2015 Apr 2017 Services Triggers Actions Applets 224K 320K Applet Contributors 106K 135K Adoptions 12 millions 24 millions 9

10 How IFTTT Performs: Applet Selection A1 A2 A3 Wemo Switch is turned on Turn on Wemo Switch is turned on Add line to Gmail gets a Blink Hue Light Google Spreadsheet Hue Light A4 Gmail gets new attach Save to Google Drive A5 Amazon Alexa gets a voice CMD Turn off Hue Light A6 Amazon Alexa gets a voice CMD Turn on Wemo Switch A7 Amazon Alexa plays a song Add line to Google Spreadsheet 10

11 How IFTTT Performs: End2End Latency 6. Turn on Hue 5. Turn on Hue 4. Turn on Hue Hue Light Hue Hub 7. Hue is turned on Home Router Test Controller 1. Turn on Wemo Wemo Switch 2. Sync to Server 3. Sync to IFTTT 11

12 How IFTTT Performs: End2End Latency CDF A 1 to A 4 A 5 to A 7 Each applet is tested 50 times at different hours of a 3- day period T2A Latency (s) A1- A4 show large and highly variable latency. 25 th : 58s, 50 th : 84s, 75 th : 122s A5- A7 involve Amazon Alexa whose applet execution seem to be specially customized. 12

13 How IFTTT Performs: Identify Bottlenecks Who incurs the high latency? Hue Light 6. Turn on Hue Hue Hub 5. Turn on Hue 4. Turn on Hue 7. Hue is turned on Home Router 1. Turn on Wemo 2. Sync to Server 3. Sync to IFTTT Test Controller Wemo Switch 13

14 How It Performs: Identify Bottlenecks E2: Replace Both Trigger and E1: Replace Trigger Service Action Services Hue Light 6. Turn on Hue Hue Hub 5.2 Turn on Hue Our Action Server 4. Turn on Hue 7. Hue is turned on Test Controller Home Router 1. Turn on Wemo 3. Sync to IFTTT Wemo Switch Our Proxy 2.1 Sync to Proxy 5.1 Turn on Hue 2.2 Sync to Server Our Trigger Server 14

15 How It Performs: Identify Bottlenecks Low polling frequency of Redo E1: Replace the latency Trigger experiment Service IFTTT leads to high latency Hue Light 6. Turn on Hue Hue Hub 5.2 Turn on Hue Clock: 83.0s Our Action Server 4. Turn on Hue Clock: 82.1s 7. Hue is turned on Clock: 83.8s Home Router Our Proxy 5.1 Turn on Hue Clock: 83.0s 2.2 Sync to Server Clock: 0.16s 2.1 Sync to Proxy Clock: 0s Clock: 0.04s Our Trigger 1. Turn on Wemo 3. IFTTT poll events Server Clock: 81.1s Test Controller Wemo Switch 15

16 Discussion: Performance Low Polling Low polling frequency is not suitable for time- sensitive workflows. High Polling High polling frequency will add untenable pressure to the server side. High Polling Adoptions: 24 millions, Frequency: 20/min Polls/Day: billions 16

17 Discussion: Performance Push Intuitively works, requires various service providers to support subscription Edge Computing Deploy workflow engines in edging or local environment: security issues We need a more Efficient and Responsive Solution

18 Discussion: Security Least Privilege Least Privilege rule is broken. IFTTT requires max privileges for each service. Binding Privilege authorization is not binding to specific applets and is valid even if no applets require it. We need a more Secure Solution

19 Discussion: Intelligence Infinite Loop Trigger T1 Action A1 Trigger T2 Action A1 Trigger Action Action Burst when arrives, blink hue light We need a Smarter Solution

20 Data Release Applets Services 7 Snapshots, each per month across Nov 2016 to May Source Code Performance testbed, self- implemented IFTTT service, measurement scripts, data crawling scripts.

21 Q&A