Engineering for Testability

Size: px

Start display at page:

Download "Engineering for Testability"

Karen Ford
6 years ago
Views:

1 Session Developer Tools #WWDC17 Engineering for Testability 414 Brian Croom, Xcode Engineer Greg Tracy, Xcode Engineer 2017 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple.

2 Engineering for Testability Testable app code Scalable test code

3 Engineering for Testability Testable app code Scalable test code

4 Engineering for Testability Testable app code Scalable test code

5 Testable App Code

6 Structure of a Unit Test

7 Structure of a Unit Test func testarraysorting() { let input = [1, 7, 6, 3, 10] let output = input.sorted() XCTAssertEqual(output, [1, 3, 6, 7, 10])

8 Structure of a Unit Test func testarraysorting() { let input = [1, 7, 6, 3, 10] let output = input.sorted() XCTAssertEqual(output, [1, 3, 6, 7, 10]) input

9 Structure of a Unit Test func testarraysorting() { let input = [1, 7, 6, 3, 10] let output = input.sorted() XCTAssertEqual(output, [1, 3, 6, 7, 10]) input Array.sorted

10 Structure of a Unit Test func testarraysorting() { let input = [1, 7, 6, 3, 10] let output = input.sorted() XCTAssertEqual(output, [1, 3, 6, 7, 10]) input Array.sorted output

11 Structure of a Unit Test input Array.sorted output

12 Structure of a Unit Test Prepare input input Array.sorted output

13 Structure of a Unit Test Prepare input Run the code being tested input Array.sorted output

14 Structure of a Unit Test Prepare input Run the code being tested Verify output input Array.sorted output

15 Characteristics of Testable Code

16 Characteristics of Testable Code Control over inputs

17 Characteristics of Testable Code Control over inputs Visibility into outputs

18 Characteristics of Testable Code Control over inputs Visibility into outputs No hidden state

19 Testability Techniques Protocols and parameterization Separating logic and effects

20 Protocols and Parameterization

21 Document Preview View Edit Open

22 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

23 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

24 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

25 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

26 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

27 Document Preview View Edit Open

28 Document Preview Document Editor App View Edit Open

29 func testopensdocumenturlwhenbuttonistapped() {

30 func testopensdocumenturlwhenbuttonistapped() { let controller = UIStoryboard(name: "Main", bundle: nil).instantiateviewcontroller(withidentifier: "Preview") as! PreviewViewController

31 func testopensdocumenturlwhenbuttonistapped() { let controller = UIStoryboard(name: "Main", bundle: nil).instantiateviewcontroller(withidentifier: "Preview") as! PreviewViewController controller.loadviewifneeded()

32 func testopensdocumenturlwhenbuttonistapped() { let controller = UIStoryboard(name: "Main", bundle: nil).instantiateviewcontroller(withidentifier: "Preview") as! PreviewViewController controller.loadviewifneeded() controller.segmentedcontrol.selectedsegmentindex = 1

33 func testopensdocumenturlwhenbuttonistapped() { let controller = UIStoryboard(name: "Main", bundle: nil).instantiateviewcontroller(withidentifier: "Preview") as! PreviewViewController controller.loadviewifneeded() controller.segmentedcontrol.selectedsegmentindex = 1 controller.document = Document(identifier: "TheID")

34 func testopensdocumenturlwhenbuttonistapped() { let controller = UIStoryboard(name: "Main", bundle: nil).instantiateviewcontroller(withidentifier: "Preview") as! PreviewViewController controller.loadviewifneeded() controller.segmentedcontrol.selectedsegmentindex = 1 controller.document = Document(identifier: TheID") controller.opentapped(controller.button)

35 func testopensdocumenturlwhenbuttonistapped() { let controller = UIStoryboard(name: "Main", bundle: nil).instantiateviewcontroller(withidentifier: "Preview") as! PreviewViewController controller.loadviewifneeded() controller.segmentedcontrol.selectedsegmentindex = 1 controller.document = Document(identifier: TheID") controller.opentapped(controller.button) //???

36 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

37 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

38 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

39 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

40 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

41 @IBAction func opentapped(_ sender: Any) { let mode: String switch segmentedcontrol.selectedsegmentindex { case 0: mode = "view" case 1: mode = "edit" default: fatalerror("impossible case") let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(mode)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

42 class DocumentOpener { enum OpenMode: String { case view case edit func open(_ document: Document, mode: OpenMode) { let modestring = mode.rawvalue let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(modestring)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

43 class DocumentOpener { enum OpenMode: String { case view case edit func open(_ document: Document, mode: OpenMode) { let modestring = mode.rawvalue let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(modestring)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

44 class DocumentOpener { enum OpenMode: String { case view case edit func open(_ document: Document, mode: OpenMode) { let modestring = mode.rawvalue let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(modestring)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

45 class DocumentOpener { enum OpenMode: String { case view case edit func open(_ document: Document, mode: OpenMode) { let modestring = mode.rawvalue let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(modestring)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

46 class DocumentOpener { enum OpenMode: String { case view case edit func open(_ document: Document, mode: OpenMode) { let modestring = mode.rawvalue let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(modestring)")! if UIApplication.shared.canOpenURL(url) { UIApplication.shared.open(url, options: [:], completionhandler: nil) else { handleurlerror()

47 class DocumentOpener { let application: UIApplication init(application: UIApplication) { self.application = application /* */

48 class DocumentOpener { let application: UIApplication init(application: UIApplication = UIApplication.shared) { self.application = application /* */

49 class DocumentOpener { /* */ func open(_ document: Document, mode: OpenMode) { let modestring = mode.rawvalue let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(modestring)")! if application.canopenurl(url) { application.open(url, options: [:], completionhandler: nil) else { handleurlerror()

50 class DocumentOpener { /* */ func open(_ document: Document, mode: OpenMode) { let modestring = mode.rawvalue let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(modestring)")! if application.canopenurl(url) { application.open(url, options: [:], completionhandler: nil) else { handleurlerror()

51 func testdocumentopenerwhenitcanopen() { let app = /*??? */ let opener = DocumentOpener(application: app)

52 protocol URLOpening {

53 protocol URLOpening { func canopenurl(_ url: URL) -> Bool func open(_ url: URL, options: [String: Any], completionhandler: ((Bool) -> Void)?)

54 protocol URLOpening { func canopenurl(_ url: URL) -> Bool func open(_ url: URL, options: [String: Any], completionhandler: ((Bool) -> Void)?) extension UIApplication: URLOpening {

55 protocol URLOpening { func canopenurl(_ url: URL) -> Bool func open(_ url: URL, options: [String: Any], completionhandler: ((Bool) -> Void)?) extension UIApplication: URLOpening { // Nothing needed here!

56 class DocumentOpener { let application: UIApplication init(application: UIApplication = UIApplication.shared) { self.application = application /* */

57 class DocumentOpener { let urlopener: URLOpening init(urlopener: URLOpening = UIApplication.shared) { self.urlopener = urlopener /* */

58 class DocumentOpener { func open(_ document: Document, mode: OpenMode) { let modestring = mode.rawvalue let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(modestring)")! if application.canopenurl(url) { application.open(url, options: [:], completionhandler: nil) else { handleurlerror()

59 class DocumentOpener { func open(_ document: Document, mode: OpenMode) { let modestring = mode.rawvalue let url = URL(string: "myappscheme://open?id=\(document.identifier)&mode=\(modestring)")! if urlopener.canopenurl(url) { urlopener.open(url, options: [:], completionhandler: nil) else { handleurlerror()

61 class MockURLOpener: URLOpening {

62 class MockURLOpener: URLOpening { func canopenurl(_ url: URL) -> Bool { func open(_ url: URL, options: [String: Any], completionhandler: ((Bool) -> Void)?) {

63 class MockURLOpener: URLOpening { var canopen = false func canopenurl(_ url: URL) -> Bool { return canopen func open(_ url: URL, options: [String: Any], completionhandler: ((Bool) -> Void)?) {

64 class MockURLOpener: URLOpening { var canopen = false var openedurl: URL? func canopenurl(_ url: URL) -> Bool { return canopen func open(_ url: URL, options: [String: Any], completionhandler: ((Bool) -> Void)?) { openedurl = url

65 func testdocumentopenerwhenitcanopen() {

66 func testdocumentopenerwhenitcanopen() { let urlopener = MockURLOpener() urlopener.canopen = true

67 func testdocumentopenerwhenitcanopen() { let urlopener = MockURLOpener() urlopener.canopen = true let documentopener = DocumentOpener(urlOpener: urlopener)

68 func testdocumentopenerwhenitcanopen() { let urlopener = MockURLOpener() urlopener.canopen = true let documentopener = DocumentOpener(urlOpener: urlopener) documentopener.open(document(identifier: "TheID"), mode:.edit)

69 func testdocumentopenerwhenitcanopen() { let urlopener = MockURLOpener() urlopener.canopen = true let documentopener = DocumentOpener(urlOpener: urlopener) documentopener.open(document(identifier: "TheID"), mode:.edit) XCTAssertEqual(urlOpener.openedURL, URL(string: "myappscheme://open?id=theid&mode=edit"))

70 func testdocumentopenerwhenitcanopen() { let urlopener = MockURLOpener() urlopener.canopen = true let documentopener = DocumentOpener(urlOpener: urlopener) documentopener.open(document(identifier: "TheID"), mode:.edit) XCTAssertEqual(urlOpener.openedURL, URL(string: "myappscheme://open?id=theid&mode=edit"))

71 Protocols and Parameterization

72 Protocols and Parameterization Reduce references to shared instances

73 Protocols and Parameterization Reduce references to shared instances Accept parameterized input

74 Protocols and Parameterization Reduce references to shared instances Accept parameterized input Introduce a protocol

75 Protocols and Parameterization Reduce references to shared instances Accept parameterized input Introduce a protocol Create a testing implementation

76 Separating Logic and Effects

77 class OnDiskCache {

78 class OnDiskCache { struct Item { let path: String let age: TimeInterval let size: Int var currentitems: Set<Item> { /* */ /* */

79 class OnDiskCache { struct Item { let path: String let age: TimeInterval let size: Int var currentitems: Set<Item> { /* */ /* */

80 class OnDiskCache { /* */ func cleancache(maxsize: Int) throws {

81 class OnDiskCache { /* */ func cleancache(maxsize: Int) throws { let sorteditems = self.currentitems.sorted { $0.age < $1.age

82 class OnDiskCache { /* */ func cleancache(maxsize: Int) throws { let sorteditems = self.currentitems.sorted { $0.age < $1.age var cumulativesize = 0 for item in sorteditems {

83 class OnDiskCache { /* */ func cleancache(maxsize: Int) throws { let sorteditems = self.currentitems.sorted { $0.age < $1.age var cumulativesize = 0 for item in sorteditems { cumulativesize += item.size

84 class OnDiskCache { /* */ func cleancache(maxsize: Int) throws { let sorteditems = self.currentitems.sorted { $0.age < $1.age var cumulativesize = 0 for item in sorteditems { cumulativesize += item.size if cumulativesize > maxsize { try FileManager.default.removeItem(atPath: item.path)

85 class OnDiskCache { /* */ func cleancache(maxsize: Int) throws { let sorteditems = self.currentitems.sorted { $0.age < $1.age var cumulativesize = 0 for item in sorteditems { cumulativesize += item.size if cumulativesize > maxsize { try FileManager.default.removeItem(atPath: item.path)

86 Inputs and Outputs maxsize cleancache

87 Inputs and Outputs maxsize cleancache currentitems

88 Inputs and Outputs maxsize cleancache

89 Inputs and Outputs maxsize cleancache

90 Inputs and Outputs maxsize cleancache TestFileManager TestFileManager

91 Inputs and Outputs cleancache

92 Inputs and Outputs cleancache CleanupPolicy

93 protocol CleanupPolicy {

94 protocol CleanupPolicy { func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item>

95 protocol CleanupPolicy { func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> class OnDiskCache { func cleancache(maxsize: Int) throws { /* */

96 struct MaxSizeCleanupPolicy: CleanupPolicy {

97 struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int

98 struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> {

99 struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> { var itemstoremove = Set<OnDiskCache.Item>() var cumulativesize = 0 return itemstoremove

100 struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> { var itemstoremove = Set<OnDiskCache.Item>() var cumulativesize = 0 let sorteditems = items.sorted { $0.age < $1.age for item in sorteditems { return itemstoremove

101 struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> { var itemstoremove = Set<OnDiskCache.Item>() var cumulativesize = 0 let sorteditems = allitems.sorted { $0.age < $1.age for item in sorteditems { cumulativesize += item.size return itemstoremove

102 struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> { var itemstoremove = Set<OnDiskCache.Item>() var cumulativesize = 0 let sorteditems = allitems.sorted { $0.age < $1.age for item in sorteditems { cumulativesize += item.size if cumulativesize > maxsize { itemstoremove.insert(item) return itemstoremove

103 struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> { var itemstoremove = Set<OnDiskCache.Item>() var cumulativesize = 0 let sorteditems = allitems.sorted { $0.age < $1.age for item in sorteditems { cumulativesize += item.size if cumulativesize > maxsize { itemstoremove.insert(item) return itemstoremove

104 struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> { var itemstoremove = Set<OnDiskCache.Item>() var cumulativesize = 0 let sorteditems = allitems.sorted { $0.age < $1.age for item in sorteditems { cumulativesize += item.size if cumulativesize > maxsize { itemstoremove.insert(item) return itemstoremove

struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> { var itemstoremove = Set<OnDiskCache.

105 struct MaxSizeCleanupPolicy: CleanupPolicy { let maxsize: Int func itemstoremove(from items: Set<OnDiskCache.Item>) -> Set<OnDiskCache.Item> { var itemstoremove = Set<OnDiskCache.Item>() var cumulativesize = 0 let sorteditems = allitems.sorted { $0.age < $1.age for item in sorteditems { cumulativesize += item.size if cumulativesize > maxsize { itemstoremove.insert(item) return itemstoremove

106 Inputs and Outputs maxsize items CleanupPolicy Set<OnDiskCache.Item>

107 func testmaxsizecleanuppolicy() {

108 func testmaxsizecleanuppolicy() { let inputitems = Set([ OnDiskCache.Item(path: "/item1", age: 5, size: 7), OnDiskCache.Item(path: "/item2", age: 3, size: 2), OnDiskCache.Item(path: "/item3", age: 9, size: 9) ])

109 func testmaxsizecleanuppolicy() { let inputitems = Set([ OnDiskCache.Item(path: "/item1", age: 5, size: 7), OnDiskCache.Item(path: "/item2", age: 3, size: 2), OnDiskCache.Item(path: "/item3", age: 9, size: 9) ]) let outputitems = MaxSizeCleanupPolicy(maxSize: 10).itemsToRemove(from: inputitems)

110 func testmaxsizecleanuppolicy() { let inputitems = Set([ OnDiskCache.Item(path: "/item1", age: 5, size: 7), OnDiskCache.Item(path: "/item2", age: 3, size: 2), OnDiskCache.Item(path: "/item3", age: 9, size: 9) ]) let outputitems = MaxSizeCleanupPolicy(maxSize: 10).itemsToRemove(from: inputitems) XCTAssertEqual(outputItems, [OnDiskCache.Item(path: "/item3", age: 9, size: 9)])

111 class OnDiskCache { /* */ func cleancache(policy: CleanupPolicy) throws { let itemstoremove = policy.itemstoremove(from: self.currentitems) for item in itemstoremove { try FileManager.default.removeItem(atPath: item.path)

112 class OnDiskCache { /* */ func cleancache(policy: CleanupPolicy) throws { let itemstoremove = policy.itemstoremove(from: self.currentitems) for item in itemstoremove { try FileManager.default.removeItem(atPath: item.path)

113 class OnDiskCache { /* */ func cleancache(policy: CleanupPolicy) throws { let itemstoremove = policy.itemstoremove(from: self.currentitems) for item in itemstoremove { try FileManager.default.removeItem(atPath: item.path)

114 Separating Logic and Effects

115 Separating Logic and Effects Extract algorithms

116 Separating Logic and Effects Extract algorithms Functional style with value types

117 Separating Logic and Effects Extract algorithms Functional style with value types Thin layer on top to execute effects

118 Testability Techniques Protocols and parameterization Separating logic and effects

119 Scalable Test Code Greg Tracy, Xcode Engineer

120

121 Balance between UI and unit tests

122 Balance between UI and unit tests Code to help UI tests scale

123 Balance between UI and unit tests Code to help UI tests scale Quality of test code

124 Striking the right balance between UI and unit tests

125 Testing Pyramid

126 UI Tests

127 Unit Tests

128 Testing Pyramid UI Unit

129 Testing Pyramid UI Integration Unit

130 Testing Pyramid UI Unit

131 Higher Lower Testing Pyramid Maintenance UI Maintenance Unit

132 Higher Lower Testing Pyramid Maintenance UI Maintenance Unit

133 Balance between UI and Unit Tests

134 Balance between UI and Unit Tests Unit tests great for testing small, hard-to-reach code paths

135 Balance between UI and Unit Tests Unit tests great for testing small, hard-to-reach code paths UI tests are better at testing integration of larger pieces

136 Writing code to help UI tests scale

137 Code to Help UI Tests Scale

138 Code to Help UI Tests Scale Abstracting UI element queries

139 Code to Help UI Tests Scale Abstracting UI element queries Creating objects and utility functions

140 Code to Help UI Tests Scale Abstracting UI element queries Creating objects and utility functions Utilizing keyboard shortcuts

141 Code to Help UI Tests Scale Abstracting UI element queries Creating objects and utility functions Utilizing keyboard shortcuts

142 app.buttons["blue"].tap() app.buttons["red"].tap() app.buttons["yellow"].tap() app.buttons["green"].tap() app.buttons["purple"].tap() app.buttons["orange"].tap() app.buttons["pink"].tap()

143 app.buttons["blue"].tap() app.buttons["red"].tap() app.buttons["yellow"].tap() app.buttons["green"].tap() app.buttons["purple"].tap() app.buttons["orange"].tap() app.buttons["pink"].tap()

144 func tapbutton(_ color: String) { app.buttons[color].tap() app.buttons["blue"].tap() app.buttons["red"].tap() app.buttons["yellow"].tap() app.buttons["green"].tap() app.buttons["purple"].tap() app.buttons["orange"].tap() app.buttons["pink"].tap()

145 func tapbutton(_ color: String) { app.buttons[color].tap() tapbutton("blue") tapbutton("red") tapbutton("yellow") tapbutton("green") tapbutton("purple") tapbutton("orange") tapbutton("pink")

146 tapbutton("blue") tapbutton("red") tapbutton("yellow") tapbutton("green") tapbutton("purple") tapbutton("orange") tapbutton("pink")

147 let colors = ["blue", "red", "yellow", "green", "purple", "orange", "pink"] for color in colors { tapbutton(color)

148 Abstracting UI Element Queries

149 Abstracting UI Element Queries Store parts of queries in a variable

150 Abstracting UI Element Queries Store parts of queries in a variable Wrap complex queries in utility methods

151 Abstracting UI Element Queries Store parts of queries in a variable Wrap complex queries in utility methods Reduces noise and clutter in UI test

152 Code to Help UI Tests Scale Abstracting UI element queries Creating objects and utility functions Utilizing keyboard shortcuts

153 Code to Help UI Tests Scale Abstracting UI element queries Creating objects and utility functions Utilizing keyboard shortcuts

154 func testgamewithdifficultybeginnerandsoundoff() { app.navigationbars["game.gameview"].buttons["settings"].tap() app.buttons["difficulty"].tap() app.buttons["beginner"].tap() app.navigationbars.buttons["back"].tap() app.buttons["sound"].tap() app.buttons["off"].tap() app.navigationbars.buttons["back"].tap() app.navigationbars.buttons["back"].tap() // test code

155 func testgamewithdifficultybeginnerandsoundoff() { app.navigationbars["game.gameview"].buttons["settings"].tap() app.buttons["difficulty"].tap() app.buttons["beginner"].tap() app.navigationbars.buttons["back"].tap() app.buttons["sound"].tap() app.buttons["off"].tap() app.navigationbars.buttons["back"].tap() app.navigationbars.buttons["back"].tap() // test code

156 func testgamewithdifficultybeginnerandsoundoff() { app.navigationbars["game.gameview"].buttons["settings"].tap() app.buttons["difficulty"].tap() app.buttons["beginner"].tap() app.navigationbars.buttons["back"].tap() app.buttons["sound"].tap() app.buttons["off"].tap() app.navigationbars.buttons["back"].tap() app.navigationbars.buttons["back"].tap() // test code

157 func testgamewithdifficultybeginnerandsoundoff() { app.navigationbars["game.gameview"].buttons["settings"].tap() app.buttons["difficulty"].tap() app.buttons["beginner"].tap() app.navigationbars.buttons["back"].tap() app.buttons["sound"].tap() app.buttons["off"].tap() app.navigationbars.buttons["back"].tap() app.navigationbars.buttons["back"].tap() // test code

158 func setdifficulty(_ difficulty: String) { app.buttons["difficulty"].tap() app.buttons[difficulty].tap() app.navigationbars.buttons["back"].tap()

159 func setdifficulty(_ difficulty: String) { app.buttons["difficulty"].tap() app.buttons[difficulty].tap() app.navigationbars.buttons["back"].tap() func setsound(_ sound: String) { app.buttons["sound"].tap() app.buttons[sound].tap() app.navigationbars.buttons["back"].tap()

160 func setdifficulty(_ difficulty: String) { // code func setsound(_ sound: String) { // code

161 enum Difficulty { case beginner case intermediate case veteran enum Sound { case on case off func setdifficulty(_ difficulty: String) { // code func setsound(_ sound: String) { // code

162 enum Difficulty { case beginner case intermediate case veteran enum Sound { case on case off func setdifficulty(_ difficulty: Difficulty) { // code func setsound(_ sound: Sound) { // code

163 func testgamewithdifficultybeginnerandsoundoff() { app.navigationbars["game.gameview"].buttons["settings"].tap() app.buttons["difficulty"].tap() app.buttons["beginner"].tap() app.navigationbars.buttons["back"].tap() app.buttons["sound"].tap() app.buttons["off"].tap() app.navigationbars.buttons["back"].tap() app.navigationbars.buttons["back"].tap() // test code

164 func testgamewithdifficultybeginnerandsoundoff() { app.navigationbars["game.gameview"].buttons["settings"].tap() setdifficulty(.beginner) setsound(.off) app.navigationbars.buttons["back"].tap() // test code

165 func testgamewithdifficultybeginnerandsoundoff() { app.navigationbars["game.gameview"].buttons["settings"].tap() setdifficulty(.beginner) setsound(.off) app.navigationbars.buttons["back"].tap() // test code

166 class GameApp: XCUIApplication {

167 class GameApp: XCUIApplication { enum Difficulty { /* cases */ enum Sound { /* cases */

168 class GameApp: XCUIApplication { enum Difficulty { /* cases */ enum Sound { /* cases */ func setdifficulty(_ difficulty: Difficulty) { /* code */ func setsound(_ sound: Sound) { /* code */

169 class GameApp: XCUIApplication { enum Difficulty { /* cases */ enum Sound { /* cases */ func setdifficulty(_ difficulty: Difficulty) { /* code */ func setsound(_ sound: Sound) { /* code */ func configuresettings(difficulty: Difficulty, sound: Sound) {

170 class GameApp: XCUIApplication { enum Difficulty { /* cases */ enum Sound { /* cases */ func setdifficulty(_ difficulty: Difficulty) { /* code */ func setsound(_ sound: Sound) { /* code */ func configuresettings(difficulty: Difficulty, sound: Sound) { app.navigationbars["game.gameview"].buttons["settings"].tap() setdifficulty(difficulty) setsound(sound) app.navigationbars.buttons["back"].tap()

171 func testgamewithdifficultybeginnerandsoundoff() { app.navigationbars["game.gameview"].buttons["settings"].tap() setdifficulty(.beginner) setsound(.off) app.navigationbars.buttons["back"].tap() // test code

172 func testgamewithdifficultybeginnerandsoundoff() { GameApp().configureSettings(difficulty:.beginner, sound:.off) // test code

173 Creating Objects and Utility Functions

174 Creating Objects and Utility Functions Encapsulate common testing workflows

175 Creating Objects and Utility Functions Encapsulate common testing workflows Cross-platform code sharing

176 Creating Objects and Utility Functions Encapsulate common testing workflows Cross-platform code sharing Improves maintainability

177 class GameApp: XCUIApplication { NEW enum Difficulty { /* cases */ enum Sound { /* cases */ func setdifficulty(_ difficulty: Difficulty) { /* code */ func setsound(_ sound: Sound) { /* code */ func configuresettings(difficulty: Difficulty, sound: Sound) { app.navigationbars["game.gameview"].buttons["settings"].tap() setdifficulty(difficulty) setsound(sound) app.navigationbars.buttons["back"].tap()

178 class GameApp: XCUIApplication { NEW enum Difficulty { /* cases */ enum Sound { /* cases */ func setdifficulty(_ difficulty: Difficulty) { /* code */ func setsound(_ sound: Sound) { /* code */ func configuresettings(difficulty: Difficulty, sound: Sound) { XCTContext.runActivity(named: Configure Settings: \(difficulty), \(sound) ) { _ in app.navigationbars["game.gameview"].buttons["settings"].tap() setdifficulty(difficulty) setsound(sound) app.navigationbars.buttons[ Back"].tap()

179 func testgamewithdifficultybeginnerandsoundoff() { NEW GameApp().configureSettings(difficulty:.beginner, sound:.off) // test code

180 func testgamewithdifficultybeginnerandsoundoff() { NEW GameApp().configureSettings(difficulty:.beginner, sound:.off) // test code

181 func testgamewithdifficultybeginnerandsoundoff() { NEW GameApp().configureSettings(difficulty:.beginner, sound:.off) // test code

182 func testgamewithdifficultybeginnerandsoundoff() { NEW GameApp().configureSettings(difficulty:.beginner, sound:.off) // test code What s New in Testing WWDC 2017

183 Code to Help UI Tests Scale Abstracting UI element queries Creating objects and utility functions Utilizing keyboard shortcuts

184 Code to Help UI Tests Scale Abstracting UI element queries Creating objects and utility functions Utilizing keyboard shortcuts

185

186

187 let menubarsquery = app.menubars menubarsquery.menubaritems["format"].click() menubarsquery.menuitems["font"].click() menubarsquery.menuitems["show Colors"].click()

188 let menubarsquery = app.menubars menubarsquery.menubaritems["format"].click() menubarsquery.menuitems["font"].click() menubarsquery.menuitems["show Colors"].click()

189 let menubarsquery = app.menubars menubarsquery.menubaritems["format"].click() menubarsquery.menuitems["font"].click() menubarsquery.menuitems["show Colors"].click()

190 let menubarsquery = app.menubars menubarsquery.menubaritems["format"].click() menubarsquery.menuitems["font"].click() menubarsquery.menuitems["show Colors"].click()

191 let menubarsquery = app.menubars menubarsquery.menubaritems["format"].click() menubarsquery.menuitems["font"].click() menubarsquery.menuitems["show Colors"].click()

192 app.typekey("c", modifierflags:[.command,.shift])

193 func showcolors() { app.typekey("c", modifierflags:[.command,.shift])

194 func testchangecolor() { let menubarsquery = app.menubars menubarsquery.menubaritems["format"].click() menubarsquery.menuitems["font"].click() menubarsquery.menuitems["show Colors"].click() // test code

195 func testchangecolor() { showcolors() // test code

196 Keyboard Shortcuts for UI Tests

197 Keyboard Shortcuts for UI Tests Avoid working through menu bar for macos

198 Keyboard Shortcuts for UI Tests Avoid working through menu bar for macos Make code more compact

199 Treat your test code with the same amount of care as your app code

200 Quality of Test Code

201 Quality of Test Code Important to consider even though it isn't shipping

202 Quality of Test Code Important to consider even though it isn't shipping Test code should support the evolution of your app

203 Quality of Test Code Important to consider even though it isn't shipping Test code should support the evolution of your app Coding principles in app code also apply to test code

204 Code reviews for test code, not code reviews with test code

205 Quality of Test Code App Code Test Code

206 Quality of Test Code Test App Code

207 Quality of Test Code

208 Quality of Test Code Code

209 More Information

210 Related Sessions What s New in Testing WWDC 2017 Advanced Testing and Continuous Integration WWDC 2016 UI Testing in Xcode WWDC 2015 Testing in Xcode 6 WWDC 2014

211 Labs Xcode Open Hours Technology Lab K Friday 1:50PM 4:00PM

212

Using and Extending the Xcode Source Editor

Developer Tools #WWDC16 Using and Extending the Xcode Source Editor Session 414 Mike Swingler Xcode Infrastructure and Editors Chris Hanson Xcode Infrastructure and Editors 2016 Apple Inc. All rights reserved.