Group 2 Mga Crystals Usability Tst Rport Rport Writtn By Katrina Ellis Tam Mmbrs Usr Exprinc Consultants Katrina Ellis Zhitao Qiu HU4628 Julia Wiss Sarah Ingold Jams Staplton CS4760 Kris Gauthir (Android) Scott Ringwlski (Databas) Austin Nlson Austin Brown Karl Brogrn Sam Sltzr-Johnston
Introduction Th purpos of th application is to rplac a papr and pncil mthod for tracking masurmnts of crystals. This application can stor, sav and xport multipl rsarch sits, sampl aras and crystals masurmnts. On of th main faturs of this application is that it is abl to calculat th avrag siz of th 10 largst crystals. This masurmnt givs gologists information about th ara whr th crystals ar forming. Th purpos of th tsting is to idntify programming bugs and xamin th as of us and work flow of th Mgacrystals application. Th dvlopmnt tam is intrstd in any programming rrors that might intrrupt th work flow and rsult in lost data. Th scintist, Bill Hurt, is intrstd in an application that is asy to us, and is saf from data loss. To assss th usability of th Mgacrystals application w conductd a usability tst. For this tst w askd participants to answr qustions about thmslvs, about th comfort with tchnology and as of us qustions about th application. Participants wr givn scnarios about th tasks, prformd th task and thn answrd qustions about prforming ach task. Th goals for th usability tst wr that (1) tim on task would b lss than 5 minuts, (2) th tst will b compltd in 25 minuts, and (3) 100% of usrs can succssfully complt th tasks. Som concrns for th usability tst wr to chck that th workflow was stramlind. To assss th workflow w masurd th tim on task and task attmpts. W wantd to know if th usr could complt th task and masurd th numbr of rrors and if th participant was abl to rcovr from th rror. Additionally masurmnts wr on th as of us and as of navigation in th application. Th procdur followd for usability tsting includd th participant (1) rading and signing th informd consnt, (2) answring dmographic qustions, (3) complting th pr-tst qustionnair, (3) listning to scnarios, prforming tasks, and complting post-task
qustionnairs, (4) complting th post-tst qustionnair, and (5) bing dbrifd about timing of tasks. Tst Plans Quantitativ masurmnt list 1) 2) 3) 4) 5) 6) Actual Tim to complt ach task Numbr of participants complting tasks within allocatd tim Numbr of participants complting tasks with xtra tim Numbr of tims ach participant uss hlp mnu Numbr of problms ncountrd, so that nd hlp from coordinators Numbr of unsuccssful rtris to solv on rror or problm and th lngth of tim if rsolvd. Qualitativ masurmnt list and potntial obsrvations of participant Usr frustration - Excssiv clicking - Sighing - Hard tapping - Rporting of rrors - Facial xprssions - Vrbal commnts whn thy think out loud - Spontanous vrbal xprssions - Miscllanous activitis (strtching, wanting braks, tc.) Bug Rport Form S# Dat: BUG ID# Bug Nam Originator Bug Location Bug Dscription
Obsrvational Rport Form Task Scnario 1: Add nw sit and sampl ara Scnario 2: Entr, viw and rport crystals Scnario 3: Edit, Dlt and Photo Scnario 4: Hlp and/or xport Total Tim Obsrvations on Task Commnts
Wlcom Statmnt SAY: Thank you for agring to participat in our rsarch. Bfor w bgin, w will xplain th informd consnt. DO: Hand thm informd consnt form. Informd Consnt SAY: Thank you for agring to participat. W would just lik to inform you of a fw things bfor you bgin tsting. -This xprimnt is dsignd to tst th usfulnss and usability of an application dsignd by our group. W ar tsting th usability of this dsign and not your prformanc. This tsting is part of a group projct and is for cours crdit. -Thr ar no known risks to participating in this rsarch. -You can stop at any tim without pnalty. -Your data will b anonymous in that your nam will not b matchd with your data and only composit data from multipl participants will b rportd. -If you hav any qustions about this tsting, plas contact our cours instructor Dr. Robrt Pastl or MTU s Institutional Rviw Board. -By signing this documnt you ar acknowldging that you know your rights, you ar ovr 18 and you agr to participat in our rsarch. -If at any point during th xprimnt, you hav ANY qustions, plas do not hsitat to ask. DO: Participant signs consnt form. Facilitator collcts th consnt form.
Computr Usr Intrfac Usability Tsting You ar bing invitd to participat in a rsarch study to dtrmin th usfulnss and usability of computr usr intrfacs. This study is bing conductd by Dr. Robrt Pastl of Michigan Tchnological Univrsity Computr Scinc Dpartmnt and studnts in Dr. Pastl's Human-Computr Intraction (HCI) courss. Th studnts ar prforming th usability tsts as part of thir projct and to fulfill th HCI cours rquirmnts. Thr ar no known risks if you dcid to participat in this rsarch study. Thr ar no costs to you for participating in th study. Th information you provid and tasks that you will prform will dtrmin th usfulnss and usability of usr intrfacs. Th qustionnairs and th tasks should tak lss than an hour to complt. Th information collctd may not bnfit you dirctly, but th information larnd in this study should provid mor gnral bnfits. Th qustionnairs and tst ar anonymous. Do not writ your nam on th survy. No on will b abl to idntify you or your answrs, and no on will know whthr or not you participatd in th study xcpt for th instructor of th class that is giving you crdit for participating. Should th data b publishd, no individual information will b disclosd. Your participation in this study is voluntary. By complting th qustionnairs and prforming th tasks, you ar voluntarily agring to participat. You ar fr to dclin to answr any particular qustion you do not wish to answr or not to prform a task for any rason. If you hav any qustions about th study, plas contact Dr. Robrt Pastl, Assistant Profssor, Computr Scinc Dpartmnt, Michigan Tchnological Univrsity, Houghton, MI 49931. Th MTU Institutional Rviw Board has rviwd my rqust to conduct this projct. If you hav any concrns about your rights in this study, plas contact Joann Polzin of th MTU-IRB at 906-487-2902 or mail jpolzin@mtu.du. Participant Signatur Dat
Practicing think aloud SAY: Bfor you bgin w would lik you to practic a think aloud task. Dmographic Qustionnair SAY: First, w would lik you to fill out som gnral information about yourslf. DO: Hand thm th dmographic qustionnair. Dmographic Qustionnair S# 1. What is your currnt ag (in yars)? yars 2. What is your biological sx? (Plas circl on) Mal Fmal 3. What is your yar in school basd on crdits? (Plas circl on) Frshman Sophomor Junior 4. What is your dclard major? Snior 5+
Pr-tst Qustionnair SAY: Bfor w start th main task, w would lik you to answr som gnral qustions about tchnology. DO: Hand thm th pr-tst qustionnair. Collct th qustionnair whn thy ar don. Pr-tst Qustionnair S# 1. How many yars hav you usd a smart phon? yars Plas indicat your lvl of agrmnt to th following statmnts: Strongly Disagr (1) 2. I am vry intrstd in th tsting of this android application. 3. Tchnology is usful. 4. I am comfortabl using nw tchnology. Disagr (2) Nutra l (3) Agr (4) Strongly Agr (5)
Introduction to th tasks SAY: Thank you for agring to participat in our rsarch. Today you will b a gologist studying crystals nar undrground magma. Your job is to input masurmnts for 15 crystals on a mobil phon application. Your tst sit today is Clarviw and your sampl ara is NorthWst. DO: Point to th sign postd. This dpnds on if th hlp mnu is functioning: SAY: This application has a hlp mnu. Plas accss th hlp mnu whnvr you nd assistanc or fl fr to ask qustions.
Scnario 1: Add a nw sit add a nw sampl SAY: Nxt w will start th actual tasks. I will rad you a scnario and you will prform tasks on th mobil application on th smart phon dvic. Aftr you prform th task, you will b askd som qustions about prforming th task. DO: Hand thm th smartphon. SAY: You hav arrivd at th rsarch sit Clarviw. You would lik to ntr your sit nam in th application bfor you bgin taking masurmnts. You st down your supply bag and gt out your mobil phon. Plas add a nw sit and nam it Clarviw. SAY: Aftr ntring th rsarch sit, you want to focus in on th Northwst ara of th 10ft2rsarch sit. Bfor taking masurmnts you would lik to spcify th sampl ara whr you ar taking masurmnt. Plas add a nw sampl ara and nam it Northwst. Chck to mak sur that Clarviw appars in th sit listing and Northwst appars in th sampl ara listing. SAY: Plas add and nam both th sit and sampl ara on th smartphon application. Plas tll us whn you start and stop. As a rmindr, plas think aloud whil prforming th task and lt us know if you ncountr any rrors. DO: Rcord obsrvations, tim using a stopwatch and kp track of bugs. SAY: Now that you hav compltd th task, w would lik to ask you som qustions about prforming th task. DO: Hand thm th Add a nw sit and sampl ara post-task qustionnair. Collct th qustionnair whn thy ar don. Tst Goals for th scnario - Add a nw sit in lss than 5 minuts Add a nw sampl ara in lss than 5 minuts Usr succssful at complting th task Task list - Add a nw sit Nam th sit Clarviw Viw sit listing with Clarviw Add a nw sampl ara Nam th sampl ara NorthWst Viw sit listing with NorthWst
Add a Nw Sit and Sampl Ara Post Task Qustionnair S# Rat how asy or difficult it was Extrmly Difficult (1) Somwha t Difficult (2) Nutra l (3) Somwha t Easy (4) Extrmly Easy (5) 1. to add a sit. 2. to ntr th sit nam. 3. to add a sampl ara. 4. to ntr th sampl ara nam. 5. to viw th sit listing. 6. navigat th application to prform th tasks. Plas indicat your lvl of agrmnt to th following statmnts: Strongly Disagr (1) Disagr (2) Nutra l (3) Agr (4) Strongly Agr (5) 7. I am satisfid with th amount of tim that it took to complt th tasks. 8. I was satisfid with th hlp/tutorial information to complt th tasks. 9. How many tims did you attmpt to complt th task bfor you wr succssful? (Plas answr with a numrical rspons.g., 3) tims 10. Did you ncountr any rror whil prforming th task? (Plas circl on) no ys 10a. If ys, how many rrors did you ncountr? (Plas answr with a numbr) rrors 10b. If ys, how asy was it Extrmly Somwha Nutra Somwha Extrmly for you to rcovr from rrors? Difficult t Difficult l t Easy Easy (Plas circl a numbr) (1) (2) (3) (4) (5) 11. Plas add any additional commnts
Scnario 2: Entr 15 crystals, viw crystal listing and viw avrag. SAY: Aftr ntring th sit nam and th sampl ara nam, you ar rady to start masuring crystals. In this sampl ara you find 15 crystals. Plas ntr th following crystals into th application. DO: Hand thm List of Crystal Masurmnts SAY: Aftr you hav ntrd th crystal masurmnts, chck to mak sur that all 15 crystals appar in th crystal listing. SAY: On of th main faturs of this application is th calculation of th avrag siz of th 10 largst crystals. This masurmnt hlps gologists dtrmin faturs of th sampl ara. Plas find th avrag of th 10 largst crystals. SAY: To summariz, ntr th crystals, viw th crystal listing, and viw th avrag of th 10 largst crystals. Plas tll us whn you start and stop. As a rmindr, plas think aloud whil prforming th task and lt us know if you ncountr any rrors. DO: Rcord obsrvations, tim using a stopwatch and kp track of bugs. SAY: Now that you hav compltd th task, w would lik to ask you som qustions about prforming th task. DO: Hand thm th Entr, viw and rport post-task qustionnair. Collct th qustionnair whn thy ar don. Tst Goals for th scnario - Entr 15 crystals in lss than 15 minuts Viw and rport top 10 crystal avrag in lss than 5 minuts Usr succssful at complting th task Task list - Add 15 crystal masurmnts Viw listing of 15 crystals Viw and rport top 10 crystal avrag Tst St-up Dtails Nd to giv thm a list of all th crystals for thm to ntr into th application\
15 Mgacrystals at Northwst sampl ara of Clarviw sit Crystal Shap 1st Fild (mm) 2nd Fild (mm) #1 Triangl 4 2 #2 Trapzoid 3 5 #3 Rctangl 8 1 #4 Triangl 5 2 #5 Trapzoid 7 3 #6 Rctangl 4 6 #7 Triangl 5 5 #8 Trapzoid 3 7 #9 Rctangl 4 4 #10 Triangl 1 2 #11 Trapzoid 8 10 #12 Rctangl 4 3 #13 Triangl 3 4 #14 Trapzoid 4 8 #15 Rctangl 2 6 3rd Fild (mm) 2 9 8 4 2
Entr and Viw and Rport Post Task Qustionnair mm2 1. What is th avrag ara of th top 10 crystals? Rat how asy or difficult it was Extrmly Difficult (1) S# Somwha t Difficult (2) Nutra l (3) Somwha t Easy (4) Extrmly Easy (5) 2. ntr th crystal shap. 3. to ntr th crystal masurmnts. 4. viw th 15 crystals in th crystal listing. 5. to find th avrag of th top 10 crystal masurmnts. 6. navigat th application to prform th tasks. Plas indicat your lvl of agrmnt to th following statmnts: Strongly Disagr (1) Disagr (2) Nutra l (3) Agr (4) Strongly Agr (5) 7. I am satisfid with th amount of tim that it took to complt th tasks. 8. I was satisfid with th hlp/tutorial information to complt th tasks. 9. How many tims did you attmpt to complt th task bfor you wr succssful? (Plas answr with a numrical rspons.g., 3) tims 10. Did you ncountr any rror whil prforming th task? (Plas circl on) ys no 10a. If ys, how many rrors did you ncountr? (Plas answr with a numbr) rrors 10b. If ys, how asy was it Extrmly Somwha Nutra Somwha Extrmly for you to rcovr from rrors? Difficult t Difficult l t Easy Easy (Plas circl a numbr) (1) (2) (3) (4) (5) 11. Plas add any additional commnts
Scnario 3: Export data and Accss Hlp Mnu SAY: Now that you hav ntrd all th crystals for th day, plas xport th data to a.csv fil (or mail). Additionally, if you hav not accssd th hlp mnu, plas find th hlp mnu ithr bfor or aftr xporting th data. Plas tll us whn you start and stop. As a rmindr, plas think aloud whil prforming th task and lt us know if you ncountr any rrors. DO: Rcord obsrvations, tim using a stopwatch and kp track of bugs. SAY: Now that you hav compltd th task, w would lik to ask you som qustions about prforming th task. DO: Hand thm th Export Data and Accss Hlp Mnu post-task qustionnair. Collct th qustionnair whn thy ar don. Tst Goals for th scnario - Export data to.csv or mail Usr succssful at complting th task Task list - Export data Export Data and Accss th Hlp Mnu Post Task Qustionnair S# Rat how asy or difficult it was Extrmly Difficult (1) Somwha t Difficult (2) Nutra l (3) Somwha t Easy (4) Extrmly Easy (5) 1. to xport th data. 2. to accss th hlp mnu. 3. navigat th application to prform th task. Plas indicat your lvl of agrmnt to th following statmnts: Strongly Disagr Disagr Nutra Agr Strongly l Agr (1) (2) (3) (4) (5) 4. I am satisfid with th amount of tim that it took to complt th task. 5. I was satisfid with th hlp/tutorial information to complt th task. 6. I flt comfortabl whn I was xporting th data. 7. How many tims did you attmpt to complt th task bfor you wr succssful? (Plas answr with a numrical rspons.g., 3) tims
8. Did you ncountr any rror whil prforming th task? (Plas circl on) ys no 8a. If ys, how many rrors did you ncountr? (Plas answr with a numbr) rrors 8b. If ys, how asy was it for Extrmly Somwha Nutra Somwha Extrmly you to rcovr from rrors? Difficult t Difficult l t Easy Easy (Plas circl a numbr) (1) (2) (3) (4) (5) 9. Plas add any additional commnts
Post-Tst Qustionnair SAY: Now you hav compltd th tasks, w would lik to ask you som gnral qustions about th tasks you prformd. DO: Hand thm th post-tst qustionnair. Collct th qustionnair whn thy ar don. Post Tst Qustionnair S# Plas indicat your lvl of agrmnt to th following statmnts: Strongly Disagr (1) Disagr (2) Nutra l (3) Agr (4) Strongly Agr (5) 1. Ovrall, this android application was asy to prform th task. 2. I njoy using this android application. 3. I would us this android application again. 4. I fl this App is rliabl as a data loggr and calculator for crystals. 5. What task did you find th most difficult to do? What othr tasks wr difficult? 6. What tasks wr asy to complt? 7. Would you rcommnd this App to a frind or othr gographic scintist? (Plas circl on) YES NO 8. What suggstion do you hav for us to improv or mak it asir to us?
Dbrifing Statmnt SAY: Thank you for participating in our rsarch. During th tasks your prformanc was timd. This is not a masur of your ability but a masur of th usability of our app. W did not inform you of th timing so as to not influnc th think aloud procdur. W xpct to finaliz our application for fild us. If you hav any qustions about this rsarch, plas contact Dr. Robrt Pastl.
Rsults Dmographic Information Four participants compltd th usability tst for th Mgacrystals application. Th avrag ag of participants was 19.75 yar old with a rang of ags from 19 to 20 yars old. All of th participants wr mal and in thir first fw yars of collg courss. Th majority of participants in this rsarch ar pursuing dgrs in computr scinc or softwar nginring. This suggsts that th participants ar comfortabl with tchnology. All participants wr tratd within th thical guidlins as outlind by th APA and this rsarch was approvd by Michigan Tchnological Univrsity s Institutional Rviw Board. Pr-tst Qustionnair Rsults Participants rportd that thy had an avrag of 3.875 yars of xprinc using a smart phon with a rang from 1.5 to 5 yars. On a Likrt scal of 1 to 5 with 1 bing strongly disagr and 5 bing strongly agr, participants wr intrstd in tsting th smart phon application (4.25 avrag), comfortabl with tchnology (4.75 avrag) and blivd tchnology is usful (5 avrag). Ovrall th participants hav som collg ducation, ar pursing dgrs in tchnology rlatd filds, hav xprinc with tchnology and bliv that tchnology is usful. Scnario Spcific Data Scnario 1: Add rsarch sit and sampl ara For th first scnario, participants wr to add a sit nam and a sampl ara nam and viw both of ths nams in thir rspctiv listings. Aftr complting th tasks, participants answrd qustions about using th app to prform th task. S Figur 1 for avrag difficulty
for ach of th tasks. Figur 1. Avrag difficulty ratings for tasks with th Mgacrystal application on a Likrt scal with 1 bing xtrmly difficult and 5 bing xtrmly asy. Participants ratd adding a rsarch sit and a sampl ara as somwhat asy and navigating through th task was somwhat asy (s Figur 2 for avrag Likrt scal ratings of
as of navigation pr scnario). Participants compltd this task in an avrag of 2 minuts and 37 sconds. Participants wr satisfid with th amount of tim it took to complt th tasks and wr satisfid with th hlp information (s Figur 3 and 4 for satisfaction with tim on task and satisfaction with th hlp mnu rspctivly). Figur 2. Avrag difficulty ratings for navigation to complt tasks with th Mgacrystal application on a Likrt scal with 1 bing xtrmly difficult and 5 bing xtrmly asy. Thr wr fw attmpts ndd to complt th task with an avrag of 2.25 attmpts. Two participants ncountrd aras such as nding a photo to continu or th application crashing whn adding crystals. Participants did not that it was somwhat unclar as to whthr thy ndd to add a dscription whn adding th rsarch sit and th sampl ara. Also, som participants wr unabl to add a sampl ara without including a photo. This may not b an issu with mor xprincd usrs.
Figur 3. Avrag satisfaction ratings for tim on task for ach task with th Mgacrystal application on a Likrt scal with 1 bing strongly disagr and 5 bing strongly agr. Figur 4. Avrag satisfaction ratings for th hlp information for th Mgacrystal application on a Likrt scal with 1 bing strongly disagr and 5 bing strongly agr. Scnario 2: Entr, Viw and Rport Crystal Masurmnts For th scond scnario, participants wr to add 15 crystals to th crystal listing, viw th crystals in th crystal listing, and rport th avrag of th 10 largst crystals. Aftr
complting th tasks, participants answrd qustions about using th app to prform th task. Participants ratd ntring, viwing and rporting crystals as somwhat asy and navigating through th task as somwhat asy. Participants compltd this task in an avrag of 3 minuts and 43 sconds. Participants wr satisfid with th amount of tim it took to complt th tasks and wr satisfid with th hlp information. Thr wr fw attmpts ndd to complt th task with an avrag of 2.8 attmpts. Th majority of participants ncountrd rrors on this task. Th application crashd aftr ntring mor than on crystal. Aftr this was fixd, participants wr unabl to dit or dlt whn thy mad a mistak. Th numbr of crystals in a sampl ara dos not updat and th application dos not calculat th avrag of th 10 largst crystals. Ths changs nd to b mad bfor th final application can function according to th prototyp. Scnario 3: Export Data and Accss Hlp Mnu For th third scnario, participants wr to xport th data and accss th hlp mnu. Aftr complting th tasks, participants answrd qustions about using th app to prform th task. Participants ratd xporting th data and accssing th hlp mnu as somwhat asy. Participants compltd this task in an avrag of 2 minuts and 25 sconds. Participants wr satisfid with th amount of tim it took to complt th tasks and wr satisfid with th hlp information. Thr wr fw attmpts ndd to complt th task with an avrag of 2.75 attmpts. No participants ncountrd rrors on this task. Th majority of th tim spnt on this task was finding whr th option to xport th data was locatd within th application. With xprincd usrs this may not b a problm.
Post-tst Qustionnair Rsults Aftr participants compltd th scnarios and th post-task qustionnairs. Thy wr askd to complt a post-tst qustionnair about thir gnral commnts on th application. Participants answrd Likrt scal qustions and opn ndd qustions. S Figur 5 for participants avrag ratings on th application ovrall. Figur 5. Avrag satisfaction ratings on th Mgacrystal application ovrall on a Likrt scal with 1 bing strongly disagr and 5 bing strongly agr. What task did you find th most difficult? Th majority of usrs said that xporting th data was th most difficult. Usrs also xprssd that adding a rsarch sit and sampl ara was difficult at first. Also, thy said that thy wr unabl to dit or dlt crystals and that th avrag of th 10 largst crystals was not working. What tasks wr asy to complt? Participants xprssd that most of th tasks wr asy to complt onc th usr was
comfortabl with th intrfac. This suggsts that usrs that hav xprinc with smartphons still nd tim to larn how to us th application. Th participants suggstd that th app was asy to larn with littl tim ndd. What suggstions do you hav for us to improv or mak th application asir to us? Hav som automatic faturs. Whn going to add a fild automatically bring up kypads for words. Capitaliz first words automatically. Mayb add bttr looking fl buttons. Othr than that, th app was vry straight-forward. Options should b mor dscriptiv. Th tabs should hav bttr graphics as it was hard to undrstand at first. Add in a tutorial. Prhaps visually mak th thing sm mor full (tak it as you will).
Conclusions and Rcommndations This application is for us in scintific obsrvation. This application nds to b abl to add and viw rsarch sits, sampl aras and crystal masurmnts. Additionally, this application nds to b abl to calculat th avrag of th 10 largst crystals and xport th data to a.csv fil and hav th option of mailing th data. Th main usability goals of this application ar as of us and workflow, minimal tim on task, and as of rcovry from rrors. Ovrall, th usrs xprssd that it was asy to prform th tasks on th application, it was asy to navigat th application, that th application was asy to larn, and that thy wr satisfid with th amount of tim that it took to complt th tasks. Howvr, thr wr som problms with th application. Th application was not abl to updat th numbr of crystals in a sampl ara or calculat th avrag of th 10 largst crystals. Ths two faturs of th application nd to b implmntd bfor th application can b usabl in th fild. Rcommndations for th application ar to implmnt th calculation of th 10 largst crystals and th updating of th crystals in th crystal listing. For th faturs that work, this application is asy to us, asy to navigat, and asy to larn. Th dsign of th application affords usability. This application will b usabl in th fild whn it can prform all th tasks that wr suggstd for th prototyp by th scintist, Bill Hirt.
Appndix A: Undrgraduat Attndanc to Usability Tsting Monday 12pm Humanitis Jams S. Computr Scinc Austin B. Graduat Consultants Katrina Knny Wdnsday 12pm Humanitis Julia Jams Computr Scinc Kris Austin Karl Scott Austin Sam Graduat Consultants Knny Katrina Friday (12pm-2pm; 3pm-4pm) Humanitis Julia (1st on) Jams (all four) Computr Scinc Scott (all four) Karl (1st on) Austin B (first 3) Graduat Consultants Katrina Knny (1st and last)
Appndix B: Bug Rport Forms I was not awar that th bug rport forms wr supposd to b in th final rport until I rad th information on th wbpag during th final tsting. Th computr scinc studnts in th group did kp track of th bugs that happnd in th application. Thy trid to giv m th bug rports aftr th tsting but I thought that thy wr supposd to kp thm to fix th bugs in th application. Thr wr multipl bugs that wr workd out through th tsting procss. I hav askd th computr scinc studnts to ithr giv m th bug rports in prson, scan and mail or typ up th rports. I hav not hard back from th computr scinc studnts and I do not hav any bug rport forms to attach to my final rport. Bugs that I notd: - Monday Application crashd whn adding multipl crystals. - Wdnsday Application rquird pictur bfor adding sampl ara. - Friday Application was not abl to calculat crystals or dit/dlt crystals.