Deploying a distributed application with OpenStack

Transcription

1 Deplying a distributed applicatin with OpenStack In this lab yu will perfrm tw exercises. Each exercise (task) specifies ne r mre deliverables t prduce. Cllect all the deliverables in ne single cmpressed dcument (D). Lab deliverables: Submit yur lab reprt t the Mdle space f the curse. Lab due date : See due date n the mdle web site 1

2 Intrductin This lab aims t deply a distributed applicatin n an OpenStack infrastructure (hepiaclud: lsds.hesge.ch/hepiaclud). The applicatin cllects and stre data frm several sensrs installed in a given building. Sensrs are used t measure temperature, humidity, brightness and physical presence. Figure 1 shws the lcatin f the sensrs in varius rms f hepia building. Figure 1: Lcatins f sensrs in 4 th and 5 th flrs f hepia building The system is cmpsed f fur layers (figure 2): 1. Sensr layer: it includes multi-functin sensrs that measure temperature, humidity, brightness and presence. Each sensr is cnnected (paired) t ne f the three Raspberries (pi1, pi2, pi3 in Figure 1): ne Raspberry Pi n the furth flr and tw Raspberries are n the fifth flr. 2. Raspberry Pi layer: Raspberries are used t cllect data received frm multiple sensrs. Each Raspberry Pi implements a REST server that stres the data received frm the sensrs cnnected t it. 3. Clud Layer: this layer is used t cllect data received frm the raspberries and stre them in a database. A REST Client is used t retrieve data frm the raspberries REST servers while a REST server is used t allw secured access t the data. 4. End user app. layer: This layer retrieves data frm the Clud layer (by means f the REST Server) and uses them fr the specific needs f end users applicatins. 2

3 Figure 2 : System architecture We can als view the system as a set f instances. Each f them belngs t ne f the fur fllwing types f instances: Raspberry instances: They crrespnd t the raspberry layer. A raspberry instance is a REST server, which cllects data frm paired sensrs. This lab des nt deal with the raspberry instances. RESTClient instances: They are deplyed in the clud (clud layer), and are respnsible f: cllecting data frm Raspberry instances, string data n the MngDB instances. MngDB Server instances: They are deplyed in the clud (clud layer). These instances are used t manage a MngDB database. RESTServer instances: They are deplyed in the clud (clud layer). These instances retrieve data frm MngDB instances and prvide them t any end user applicatin The gal f this lab is t: deply n the hepiaclud infrastructure: ne MngDB Server instance, ne RESTServer instance and, ne RESTClient instance, visualise data stred in the MngDB database. The binaries f RESTServer and RESTClient instances are available n the mdle site f the curse. 3

4 Exercise 1: Using hepiaclud prtal t deply the system (manual deplyment) The gal f this exercise is t create the three instances MngDB instance, RESTServer instance, RESTClient instance by using the web interface prtal f hepiaclud (hrizn). Hw t create instances? Read this URL t understand hw t create and cnnect t instances n hepiaclud: Creatin f a MngDB instance Image: Ubuntu Type: m1.small Access yur instance by ssh and install MngDB: sud apt-get install mngdb-server Cnfiguratin: Change the /etc/mngdb.cnf cnfiguratin file in rder t allw the database listen n the netwrk : change «bind_ip = » by «bind_ip = » rebt the machine: sud rebt T check whether the database listens n the netwrk: sud netstat --listen -a -p Create a snapsht f yur instance s as yu can use it later withut any reinstallatin and/r cnfiguratin. Creatin f a RESTClient instance Create an m1.small instance using the image Ubuntu When the instance is created, access it by ssh and fllw these instructins: 1. sud apt-get install pythn-pip 2. sud pip install pymng 3. cpy the pythn REST client prgram: wget URL «lcatin f the restclient.py file» r use scp cmmand 4. Execute the prgram: pythn restclient.py IP MngDB instance & where IP MngDB instance is the address f the MngDB instance D nt frget that the MngDB database needs t be reached n these prts: and Create a snapsht f yur instance s as yu can use it later withut any reinstallatin and/r cnfiguratin. Creatin f a RESTServer instance Create an m1.small instance using the image Ubuntu This distributin includes pythn Versin 2.7.x. When the instance is created, access it by ssh and fllw this instructins: 1. sud apt-get install pythn-pip 2. sud pip install pymng 4

5 3. sud pip install flask 4. cpy the pythn REST server prgram: wget «lcatin f the restserver.py file» r use scp cmmand 5. Execute the prgram: pythn restserver.py MngDB Instance IP & The REST server listens n prt Create a snapsht f yur instance s as yu can use it later withut any reinstallatin and/r cnfiguratin. Hw t check that the system is peratinal? T check that data are crrectly stred in the MngDB database, submit a http request t the REST server. Data cllected frm respberries are accessed using these three URLs: where IP is the IP address f the RESTSever instance. We assume here that IP is a public address. In hepiaclud, flating IP addresse are nn-public. In this case, we must use curl cmmand: curl where IP is the flating pint f the RESTServer instance. The curl cmmand must be executed within hepiaclud. Deliverables (see due date n the mdle web site) In yur lab reprt: 1. In yur hepiaclud accunt, mve t Instances tab, create a screensht f the three instances yu have created, and insert it in yur dcument. 2. Add a screensht f the data retrieved frm ne f the three raspberries (Figure 3). Specify in yur dcument: a. The URL yu have used t cllect data b. the date and time (date, hur, minute) f the http request yu made t get this data. Figure 3: data retrieved frm MngDB At the end f the sessin, d nt frget de delete yur instances. Exercise 2: Using OpenStack API t deply the system (autmatic deplyment) The aim f this exercise is t develp a Linux script which autmatically deplys the whle system. VMs are created by using OpenStack cmmands. 5

6 Hw t install and use OpenStack API? Fllw these instructins, n an Ubuntu machine (yu can create a dedicated instance n hepiaclud), t install OpenStack API: Nva/penstack cmmands can be viewed by typing nva help. See nva help COMMAND fr help n a specific cmmand. The script t develp is assumed t execute these peratins: 1. creates ne MngDB instance, 2. creates ne RESTClient instance and launch the prgram client.py, 3. creates ne RESTServer instance and launch the prgram server.py, 4. deletes the VMs when the user presses A (Abrd) Fr pints 1, 2 and 3, use snapshts already created in Exercise 1. Deliverable (see due date n the mdle web site) 1. Linux script 2. Dcumentatin describing hw t cnfigure OpenStack credentials and hw t execute the script Guidelines t develp the script f exercise 2 1. Hw t create penstack instances with nva/penstack cmmands? Yu shuld use nva bt cmmand. Fr further details, read this URL: 2. Hw t test if the created instances are actives? Yu shuld use nva list t visualize created instances. T select active instances, use grep cmmand. wc cmmand can be used in rder t retrieve the number f active instances (number f lines cntaining the prefix f created instances and ACTIVE string) 3. Hw t extract the IPs f the active instances? The fllwing cmmand extracts IPs f the created instances: nva list grep -w instance_name awk ' { print $XX } ' cut -d = -f 2 Where instance_name is the name f the instance. 4. Hw t detect if an active instance can be reached Use nc cmmand (netcat): nc IP prt Where IP is the address f the instance. In ur cntext, prt = 22 (ssh prt) Exercise 3: Using Swift (bject strage) t stre data The purpse f this exercise is t expand the REST Server prgram s that it can stre sensrs data in a swift bject strage. The current versin f REST Server supprts three rutes: 1. /getlastsensrvalue/<string:pi_id>/<int:sensr_id>. This rute retrieves all data cming frm sensr_id, cnnected t pi_id raspberry. 2. /getlastsensrsvalues/<string:cntrller>. This rute retrieves all data cllected by pi_id raspberry. 3. /getsensrvaluesinlasthurs/<string:pi_id>/<int:sensr_id>/<int:hurs>. This rute retrieves all data f sensr_id. This sensr is cnnected t pi_id raspberry. 6

7 Add a new rute: /getsensrvaluesbetweendates/<string:pi_id>/<int:sensr_id>/<string:date1>/<string:date2> This rute is assumed t create a swift cntainer and write in it a swift bject. The swift bject cntains data retrieved frm sensr_id, cnnected t pi_id, between date1 and date2. In this exercise we will use the pythn swiftclient: 7