What s new in Transaction Perspective (TxP) 10 and KITE 4.0

Transcription

1 What s new in Transaction Perspective (TxP) 10 and KITE 4.0 What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 1 of 17

2 Table of Contents What s new in Transaction Perspective (TxP) 10 and KITE Overview of changes in TxP 10 and KITE Firefox real browser monitoring... 4 Why Firefox?... 4 What can I do with Firefox in TxP 10 and KITE 4.0?... 4 Which version of Firefox?... 4 How do I get started with Firefox monitoring?... 5 Enhanced screenshot functionality in MyKeynote and KITE... 6 Capture of the entire page on error... 6 Entire page, all of the time, in KITE... 6 Auto-fit as a thumbnail or view at 100% scale... 6 Example of auto-fit and 100% scale: large Amazon.com page... 7 Graphical summary data in KITE... 8 Comparing results from two measurements in KITE... 9 Comparison as displayed in the Transaction Performance Summary: Comparison as displayed in the Transaction Performance Details: Pane Sync in KITE Multiple item clipboard in KITE Viewing the Clipboard Copying multiple items onto the Clipboard Renaming Clipboard items Selecting a Clipboard item to paste Best practices for ensuring accuracy when using existing scripts for Firefox measurements FAQ s How do I confirm my existing scripts are ready for Firefox Monitoring? How to do I provision a measurement to use Firefox rather than IE? How do I see which browser (IE or Firefox) a measurement is using? Why are my old desktop or quick-launch shortcuts to KITE no longer working? Do I need to re-create my saved layouts? What features are not supported when running Firefox with TxP 10? Where is IE Script in KITE? (renamed DOM Script supported by both IE and Firefox) What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 2 of 17

3 Overview of changes in TxP 10 and KITE 4.0 This release adds Firefox to Transaction Perspective s real browser family. Now you can monitor performance from any location on the Keynote Global Network using either Internet Explorer or Firefox. We have also upgraded our screen capture capability to capture the entire page, including portions of the page which would normally be off screen. KITE has been enhanced to provide a graphical summary of performance data, to allow comparisons of any two measurement runs and to support the creation of and maintenance of ever more sophisticated scripts through interface improvements and a multiple-item clipboard. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 3 of 17

4 Firefox real browser monitoring Why Firefox? Keynote chose to add Firefox to TxP because Firefox users now represent a significant portion of visitor traffic to many sites. You will notice significant differences in the way Firefox downloads content. Equally important, you will benefit from the 24x7 watchful eye of Keynote monitoring to detect any Firefox-specific issues with your web properties just as soon as they arise. What can I do with Firefox in TxP 10 and KITE 4.0? Transaction Perspective (TxP) 10 and KITE 4.0 both feature the ability to execute existing or new TxP scripts in Firefox, capturing the behavior of your site as it is viewed with a real Firefox browser. You record, provision and observe results using the same familiar tools and benefit from the same commitment to accuracy behind over a decade of Transaction Perspective releases. Which version of Firefox? To ensure consistency, Keynote chose a standardized Firefox 3.6 browser to deploy on the Keynote Global Network and in KITE. Think of this standardized browser as a plain vanilla Firefox install without any add-ins or user customization. KITE 4.0 installs and maintains its own copy of Firefox separate from any version of Firefox you may be already running on your desktop. This frees you to use whatever Firefox version and add-ins you wish for day-to-day browsing, while still being able to test your scripts from within KITE with the same standardized configuration that runs on the Global Network. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 4 of 17

5 How do I get started with Firefox monitoring? We designed TxP 10 to make it as easy as possible for you to add Firefox monitoring to your existing measurements. In most cases, an existing TxP script which runs on IE today can be provisioned to run on Firefox with no modification. Just follow these three simple steps: 1. Follow your current procedure to provision a new measurement in Keynote Service Center (KSC). 2. Upload your existing script. 3. Select Firefox with the new Browser Type radio button. That s it! What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 5 of 17

6 Enhanced screenshot functionality in MyKeynote and KITE Capture of the entire page on error TxP 10 now captures the entire page upon error, not just the portion visible on screen. Another name for the visible-onscreen area is above the fold, a term borrowed from the newspaper industry. Before we explain where entire page captures appear and where above the fold captures appear, here is a quick visual comparison of the portions of the screen captured using each technique: When a screenshot is taken by our agent on error, the screenshot will now be taken of the entire page. This is true for both our Content Waterfall on Error (CWoE) and Web Content Trending (WCT) options. For transactions with Web Content Trending (WCT) enabled, TxP 10 will capture the above the fold snapshots for pages leading up to the error and then switch to an entire screen snapshot for the error page. Entire page, all of the time, in KITE In KITE 4.0, all screens are always captured using the new full-page technology (error or not). Note: To get the most value out of the full-page screenshots, you may wish to drag the snapshot tab from its default location lower left to a larger pane on the right. To learn more about moving tabs and panes in KITE, visit the Working with View Panes topic in online help. Auto-fit as a thumbnail or view at 100% scale As in KITE 3.0, KITE 4.0 gives you the option of fitting the snapshot within the Page Snapshot pane as a thumbnail, or viewing the page at full resolution. When at full resolution, you can either grab the page with your mouse or slide the scrollbars to explore any portion of the page in detail. To toggle between auto-fit and 100% scale, simply click the Snapshot Auto Fit arrows at the top of the Page Snapshot pane: What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 6 of 17

7 Example of auto-fit and 100% scale: large Amazon.com page Here is what a large Amazon.com page looks like with auto-fit on the left and 100% scale on the right: What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 7 of 17

8 Graphical summary data in KITE At a glance, you can see now see which are the heavy or slow pages in a transaction. Graphical bars have been added to the Transaction Performance Summary for times, element counts and download sizes. Timing information bars appear in blue and size/count bars appear in green. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 8 of 17

9 Comparing results from two measurements in KITE From time to time, you may wish to compare two runs of a script. This is particularly useful when comparing a run with IE and a run with Firefox. KITE 4.0 s new comparison feature allows you to choose any two runs of the same script and see comparisons in the Transaction Performance Summary and Transaction Performance Detail. This feature allows you to compare any two measurement runs, regardless of browser type. You may compare runs in the same browser before or after optimizations, for instance. Simply right-click a row in the Measurement Repository view and choose Select for Comparison in Performance Detail. The baseline row will be colored differently (grey by default, but customizable in KITE s UI settings). Initially, the row you selected will be both baseline and currently selected. Simply select any other row to compare that row to. Your baseline for comparison will remain selected and displayed with a distinctive color until you clear the selection. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 9 of 17

10 Comparison as displayed in the Transaction Performance Summary: Note that the baseline row (the one chosen to Select for Comparison in Performance Detail ) appears in the distinct color and the currently selected row appears in white. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 10 of 17

11 Comparison as displayed in the Transaction Performance Details: In this case, the grey lines, chosen as the baseline for comparison, are from Firefox and the white lines are from IE. You can see how Firefox downloaded more elements in parallel and completed the page much sooner. This default view shows the two measurements interleaved based on the order that elements are downloaded. You may wish to experiment by sorting with other criteria to observe the patterns which emerge. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 11 of 17

12 Pane Sync in KITE Now all panes are kept in sync as you explore your script or its results. When you click on an action in one pane, all other panes will scroll to bring that same action into view. For example, when you select Action 2 in the Transaction Summary, all of the following will scroll to show that same action: Script Viewer, Transaction Events Log, Transaction Performance Details, and Snapshot. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 12 of 17

13 Multiple item clipboard in KITE When editing complex scripts, and particularly when making similar changes to multiple scripts, many users have asked for multiple copy/paste buffers to work with. The new multiple item clipboard feature delivers just that. Clipboard is particularly useful for grabbing several pieces of a script and then pasting them into one or more other similar scripts. Viewing the Clipboard To view the clipboard, choose the View menu and then choose Open Views > Clipboard View Copying multiple items onto the Clipboard Each time you copy an item from the script, it is placed on a separate line in the Clipboard. An item can be an entire action or an individual element in an action. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 13 of 17

14 Renaming Clipboard items Items may be renamed to make them more meaningful and easy to remember for later by right-clicking and choosing rename. Renaming only impacts the label on the clipboard; it has no impact upon the contents of the item when pasted. Selecting a Clipboard item to paste Once you have two or more items in the clipboard, you simply click one to select it before choosing Paste and that item will paste at the current insertion point. You can also tidy up the clipboard by deleting one entry or all entries: Best practices for ensuring accuracy when using existing scripts for Firefox measurements At Keynote, we are pretty particular about accuracy and precision. To ensure that your existing scripts deliver the most accurate possible measurements under Firefox, we recommend you follow the best practice for playing scripts with Firefox in KITE 4.0 before provisioning them. Briefly put, you should play the script in both Internet Explorer and Firefox in KITE 4.0 and compare the results. Since the browsers treat completion events with slight differences, you may want to tune completion events and/or make other minor enhancements to your script. Here are the steps to follow: 1. Download KITE 4.0 or allow KITE 3.0 to update to KITE 4.0. a. Download KITE 4.0 from kite.keynote.com b. Or, launch KITE 3.0 and click Check Now in the KITE Update section of the Options ribbon to force an immediate update of KITE. 2. Open your existing TxP script and click Play in Firefox What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 14 of 17

15 3. After playback in KITE, examine your results locally. a. Did the script play to completion without any errors? If so, great. If not, determine if browser-specific page content may be the cause, or if your script uses a feature not supported under Firefox (see FAQ below in this document). While you should be able to use the same script for Internet Explorer or Firefox in most cases, our design allows you to make make browser-specfic changes if needed. b. If you have complex pages where page completions are determined by document counts or browser ready-states, do you notice any pages where Firefox captured more data than Internet Explorer? If so, you may want to switch to HTTP messages or DOM completion events to align the measurements. Note: Firefox does not support document count or browser ready-state completion events and so KITE and TxP 10 agents on the Keynote Global Network will automatically translate these into HTTP Inactivity 1000 msec during playback. If your page has network activity which occurs after IE would have reported download cycles or ready-state, you may want to explore use of a more precise completion event such as the HTTP Messages Message (Named) or DOM WaitFor completion event types. 4. Provision your measurement on Keynote Service Center (KSC). a. Follow the same steps you use today to provision a TxP script. b. When you get to the Configure screen in Keynote Service Center, look for the new Browser Type radio button between Agent Group and Measurement Interval, and set it to Firefox : Note: if the Agent Group you have selected is not 100% TxP 10 agents, the Browser Type radio button for Firefox will not appear. This is most likely to happen with Private Agent populations that have not yet been upgraded. That s it! Watch for the new browser-type suffix in your measurement listings in MyKeynote. In the place of (TxP) You will see either (TxP-FF) or (TxP-IE) after your measurement alias to indicate not only which product, but which browser is performing the measurements. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 15 of 17

16 FAQ s How do I confirm my existing scripts are ready for Firefox Monitoring? - TxP 10 has been designed to run most of your scripts with NO modification. To confirm that your script runs successfully with no modifications, you should play it with Firefox in KITE If the script runs successfully, you should still double-check to be sure that your completion events are delivering the desired results. o Under Firefox, Document Complete (browser ready state) is interpreted as HTTP Messages - Inactivity 1000msec by the agent. This is due to Firefox not providing browser ready state to the agent. In many cases, use of HTTP Messages Inactivity will achieve the same result as document completes In other cases you may find that the boundaries between actions and idle states or between two actions differ significantly. If this is true for your script, you will want to change the completion event from Document Complete to a DOM or HTTP Messages type Message (Named). See the following resources for more information about DOM or HTTP Messages completion events: o Video: DOM WaitFor: Use the WaitFor completion event to look for a specific DOM o element to be changed. Video: HTTP Messages: Configure HTTP Messages to help with dynamic page completion events. Community thread: TxP Completion Events - DOM Pattern Match Community thread: TxP Completion Events - DOM Pattern MISMATCH Community thread: How to use Script completion event? Community thread: TxP Completion Events - HTTP Messages - Named o o o o - If the script does not run successfully, check to see if your script uses any of the following, which are not supported for Firefox use in TxP 10: o Flash/Silverlight navigation using Screen Sensing Technology o Advanced Scripting Pre Transaction Before Action After Action Step o Custom Components How to do I provision a measurement to use Firefox rather than IE? 1. See FAQ above, How can I make sure that my existing scripts work on Firefox? 2. Follow the typical steps for provisioning a new script, up to the Configure screen. 3. Notice the new Browser Type radio buttons between Agent Group and Measurement Interval 4. If the agent group you have selected has been 100% upgraded to TxP 10 or higher, then the Browser Type radio buttons will allow IE and Firefox choices. 5. Choose the Firefox radio button. 6. Complete the remaining typical provisioning steps. How do I see which browser (IE or Firefox) a measurement is using? Once provisioned, you can determine which browser is running a particular measurement in two ways: 1. The measurement name in MyKeynote will show either (TxP-IE) or (TxP-FF): IE = Internet Explorer, FF = Firefox. 2. Edit the measurement in Keynote Service Center (KSC) and notice the setting of the Browser Type radio buttons. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 16 of 17

17 Why are my old desktop or quick-launch shortcuts to KITE no longer working? Because KITE now installs in a folder named Recorder instead of Recorder 8, old shortcuts to KITE saved on your desktop may no longer work. Simply delete or edit them, removing the space and number 8 from the file path. Do I need to re-create my saved layouts? KITE 4.0 comes with updated Simple, Default and Advanced saved layouts which make the clipboard pane and browser type column visible. Due to these new features, any custom layouts previously saved using Options, Layout, Save must be re-created. What features are not supported when running Firefox with TxP 10? - Flash/Silverlight navigation using Screen Sensing Technology - Advanced Scripting o Pre Transaction o Before Action o After Action o Step - Custom Components Note: Firefox does support custom scripting that interacts directly with the DOM of the browser. See below. Where is IE Script in KITE? (renamed DOM Script supported by both IE and Firefox) Both IE and Firefox support custom JavaScript which interacts directly with the DOM of the browser. This type of script was previously called IE Script or Internet Explorer Script but has been renamed DOM Script for TxP 10. To add a DOM Script, simply right-click within an action and choose Add DOM Script. What s new in TxP 10 and KITE 4.0 October 6, 2010 Page 17 of 17