BeOng on AI: Sergiu Sanielevici sergiu@psc.edu The 1st Interna8onal Workshop on the US and China Collabora8on in Experience and Best Prac8ce in Supercompu8ng PEARC17 New Orleans July 10, 2017
Un8l now, milestones in ar8ficial intelligence (AI) have focused on situa8ons where informa8on is complete, such as chess and Go. Poker is a representa-ve benchmark for real-world applica-ons requiring decision-making with incomplete and misleading informa-on and adversaries who ac-ve revise their strategies. From January 11-30, 2017, Libratus, an AI developed at Carnegie Mellon University (CMU) and running on Bridges, competed against four of the top human players in heads-up no-limit Texas Hold em poker. 2
AI for Strategic Reasoning: Bea-ng Top Pros in Heads-Up No-Limit Texas Hold em Poker Tuomas Sandholm, Carnegie Mellon University Imperfect-info games require different algorithms, but apply to important classes of real-world problems: Nego8a8on Strategic pricing Medical treatment planning Auc8ons Military alloca8on problems Heads-up no-limit Texas hold em is the main benchmark for imperfect-info games 10 161 situa8ons Libratus is first program to beat top humans Beat 4 top pros playing 120,000 hands over 20 days Libratus won decisively: 147 mbb/hand (99.98% sta?s?cal significance) Prof. Tuomas Sandholm watching one of the world s best players compete against Libratus. Libratus improved upon previous best algorithms by incorpora8ng real-8me improvements in its strategy. 3
4
The best AI's ability to do strategic reasoning with imperfect information has now surpassed that of the best humans. Professor Tuomas Sandholm, Carnegie Mellon University Bridges made this breakthrough possible through 19 million core-hours of compu8ng and data storage for the 2.6 PB knowledge base that Libratus generated. 5
20 Storage Building Blocks, implemen8ng the parallel Pylon storage system (10 PB usable) 4 HPE Integrity Superdome X (12 TB) compute nodes each with 2 gateway nodes 4 MDS nodes 2 front-end nodes 2 boot nodes 8 management nodes 6 core Intel OPA edge switches: fully interconnected, 2 links per switch Intel OPA cables 42 HPE ProLiant DL580 (3 TB) compute nodes 12 HPE ProLiant DL380 database nodes 6 HPE ProLiant DL360 web server nodes 20 leaf Intel OPA edge switches Purpose-built Intel Omni-Path Architecture topology for data-intensive HPC Libratus ran on 16,800 cores during the Pi7sburgh event, increasing its data to 2.6PB. For clarity, these outlines 800 HPE Apollo 2000 (128 GB) are representa-ve, not indica-ng specific nodes, and the extensive use of Omni-Path is not outlined. 6 compute nodes 32 RSM nodes, each with 2 NVIDIA Tesla P100 GPUs Bridges Virtual Tour: 16 RSM nodes, each with 2 NVIDIA Tesla K80 GPUs hlps://www.psc.edu/bvt
Libratus returned in April as Lengpudashi, or cold poker master, to challenge Team Dragon, led by WSOP winner Alan Yue Du. Unlike the PiJsburgh research event, the event in Hainan was for real money. Lengpudashi vs. Team Dragon Compu8ng resources for this AI exhibi8on were provided through PSC s corporate affiliates program. Prof. Sandholm confers with Kai-Fu Lee, CMU alumni and head of Sinova8on Ventures, a Chinese venture capital firm. 7
The AI system, called Lengpudashi, won a landslide victory and $290,000 ( 230,000) in the five-day compe88on. BBC News hlp://www.bbc.com/news/technology-39564836 8
9
Thank You Ques8ons? 10