Contracts: Practical Contribution Incentives for P2P Live Streaming

Transcription

1 Contracts: Practical Contribution Incentives for P2P Live Streaming Michael Piatek, Arvind Krishnamurthy, Arun Venkataramani, Richard Yang, David Zhang, Alexander Jaffe U. of Washington, U. of Massachusetts, Yale, PPLive

2 Live streaming with PPLive P2P distribution Over 20 million active users worldwide Current design offers no reward for capacity contributions How to provide contribution incentives? Michael Piatek NSDI 0 2

3 Overview. Challenges for live streaming incentives 2. Contracts design 3. Evaluating PPLive with Contracts Michael Piatek NSDI 0 3

4 PPLive design S

5 PPLive design 2 S

6 PPLive design 2 3 S

7 PPLive design 2 3 S

8 PPLive design 2 3 S

9 PPLive design S

10 PPLive design S

11 PPLive design S

12 PPLive design S

13 PPLive design S

14 PPLive design S 2

15 PPLive design S 2

16 PPLive design S 2

17 PPLive design S 2

18 PPLive design S

19 PPLive design S Wire-level protocol very similar to BitTorrent

20 Can we apply tit-for-tat? Bilateral reciprocation: Contribute to peers that contributed to you Challenges for live streaming: Capacity heterogeneity Limited trading opportunities No compelling reward Michael Piatek NSDI 0 4

21 Capacity heterogeneity Top 0% of users contribute 58% of total capacity Michael Piatek NSDI 0 5

22 Capacity heterogeneity Top 0% of users contribute 58% of total capacity Capacity All users watching at max possible quality utilization Supported users Michael Piatek NSDI 0 5

23 Capacity heterogeneity Top 0% of users contribute 58% of total capacity With balanced exchange: Capacity utilization Maximizing quality excludes 86% of users Supporting 95% of clients wastes 85% of capacity Supported users Michael Piatek NSDI 0 6

24 Imbalanced exchange? Is relaxing balance sufficient? Reciprocation depends on trading opportunities But, live streams swarm over few blocks Clients near the source: block monopoly Distant clients: perpetual trade imbalance Outcome: few trading opportunities Michael Piatek NSDI 0 7

25 Transfer opportunities Data availability from a snapshot of client buffer states Michael Piatek NSDI 0 8

26 Transfer opportunities Reciprocation most common with similar distance to the source Data availability from a snapshot of client buffer states Michael Piatek NSDI 0 9

27 Transfer opportunities Most transfers are between peers with a large imbalance of blocks to send Data availability from a snapshot of client buffer states Michael Piatek NSDI 0 20

28 Rewarding contribution For bulk data: Increase contribution rate increase download rate Live streaming: inelastic All users download at the stream rate How to create a compelling reward? Michael Piatek NSDI 0 2

29 Overview. Challenges for live streaming incentives 2. Contracts design 3. Evaluating PPLive with Contracts Michael Piatek NSDI 0 22

30 Contracts design overview Global evaluation contract rather than bilateral reciprocation Recognizes globally effective contributions Reward contributions with robustness by optimizing the overlay topology If the system becomes capacity constrained, contributors fail last Michael Piatek NSDI 0 23

31 Evaluating contributions Goals:. Contribute capacity As in any P2P system, contributions required 2. Choose effective peers Live streaming has playback deadlines Prioritize peers that replicate data quickly Michael Piatek NSDI 0 24

32 Tracking contributions Cryptographic receipts attest to the contributions of peers Data Receipts Presented to other peers to demonstrate contributions 2 Michael Piatek NSDI 0 25

33 Tracking contributions E Cryptographic receipts attest to the contributions of peers Data Receipts Presented to other peers to demonstrate contributions (From to E, for example) 2 Michael Piatek NSDI 0 25

34 Tracking effectiveness Gossip receipts in a one hop neighborhood E Allows E to compute: Effectiveness of peers ( ) Contributions of peers of peers ( 2 ) Clients prioritize effective peers Data 3 Receipts Michael Piatek NSDI 0 26

35 Evolving the topology Compute contributions of distant peers using forwarded receipts Preferentially connect to highest capacity peers Prune unproductive peers High capacity peers: percolate towards the source Low capacity peers: pushed to mesh periphery Michael Piatek NSDI 0 27

36 Evolving the topology Compute contributions of distant peers using forwarded receipts Preferentially connect to highest capacity peers Because failures cascade, proximity to the source Prune unproductive peers improves quality of service High capacity peers: percolate towards the source Low capacity peers: pushed to mesh periphery Michael Piatek NSDI 0 28

37 Collusion defenses Limit identity creation at PPLive coordinator Weight contributions by diversity of network addresses Flow integrity check Incoming data rate cannot exceed stream rate Outgoing data rate cannot exceed capacity Michael Piatek NSDI 0 29

38 Overview. Challenges for live streaming incentives 2. Contracts design 3. Evaluating PPLive with Contracts Michael Piatek NSDI 0 30

39 Evaluation overview This talk Contracts improves performance Contracts strengthens contribution incentives Paper Computational and network overhead Comparison with FlightPath [OSDI 08] Topology convergence Over-provisioning and loss-rate Michael Piatek NSDI 0 3

40 Experimental setup Modified PPLive to support Contracts and rate-based tit-for-tat Synthetic broadcast on 00 Emulab machines Churn from clients joining at 0 second intervals, remaining for 20 minutes, repeating for 2 hours Capacities from measured distribution of over 90,000 PPLive users Michael Piatek NSDI 0 32

41 PPLive performance Stream rate chosen to induce capacity constraints Michael Piatek NSDI 0 33

42 PPLive performance 28% of peers receive 90% of blocks by the deadline Stream rate chosen to induce capacity constraints Michael Piatek NSDI 0 33

43 PPLive performance Only 3% of users with loss-free playback Stream rate chosen to induce capacity constraints Michael Piatek NSDI 0 33

44 PPLive + tit-for-tat Tit-for-tat reduces performance for live streaming Michael Piatek NSDI 0 34

45 PPLive + tit-for-tat High capacity users close to the source Distant peers cannot obtain enough data to trade, regardless of capacity Tit-for-tat reduces performance for live streaming Michael Piatek NSDI 0 34

46 PPLive + Contracts Contracts substantially improves performance Michael Piatek NSDI 0 35

47 PPLive + Contracts Loss-free playback 4 unmodified PPLive Contracts substantially improves performance Michael Piatek NSDI 0 35

48 Incentives Contracts strengthens contribution incentives Michael Piatek NSDI 0 36

49 Incentives Tit-for-tat reward increases slowly, varies widely Michael Piatek NSDI 0 37

50 Incentives Contracts strengthens contribution incentives Michael Piatek NSDI 0 38

51 Conclusions Live streaming exhibits new challenges for fostering P2P contribution incentives Contracts improves performance and incentives Evaluation contract rather than bilateral exchange Restructure topology to reward contributions with quality of service Michael Piatek NSDI 0 39