SERVICE PROVIDER HANDBOOK BT PERFORMANCE TESTER

Transcription

1 SERVICE PROVIDER HANDBOOK BT PERFORMANCE TESTER BT Performance Tester Service Provider Handbook AUTHOR: BT WHOLESALE DATE: 28/11/2006 Page 1 of 29

2 CONTENTS Page 1 INTRODUCTION 3 2 THROUGHPUT MEASUREMENT 4 3 OVERVIEW 5 4 USING THE BT PERFORMANCE TESTER Accessing the Performance Tester Enter Telephone Number End User Domain Validation Performance Test in progress Performance Tester Results 11 5 TEST RESULT INTERPRETATION 21 6 BEST PRACTICE 22 7 OBTAINING HELP 23 8 PERFORMANCE TESTER ERRORS Incorrect telephone number Validation Errors System busy errors 26 9 GLOSSARY DOCUMENT HISTORY 29 Page 2 of 29

3 1 INTRODUCTION The BT Performance Tester has been specifically developed as a performance measurement tool for use by consumers of all BT Wholesale BT IPstream products. A performance test provides the throughput measurement of a BT Wholesale delivered end user s connection through the BT Wholesale and Communication Provider s (CP) networks. The tool is straightforward to use and can be accessed directly from the internet, however it will only be accessible by BT IPstream customers. End Users using Virtual Private Networking (VPN) will not be able to use BT Performance Tester for throughput testing due to the Address Proxy function, which is almost always present in a corporate intranet environment. There are many factors that can influence poor performance in a corporate intranet environment therefore initiating a Performance Test may not reflect the true performance of the end users broadband service. It is the Service Provider s responsibility to ensure that a performance related fault has been assessed as genuine by using their own or BT Wholesale supplied tools. Your End User can assist in this diagnosis by conducting a test using the BT Performance Tester. Because there are many factors that could influence performance of a broadband service, the BT Performance Tester can be used to establish whether its performance is consistent. To do this your End User may need to carry out a number of tests - preferably at different times of the day as there will be times when performance is affected by Peak Periods - this is normal for BT IPstream services. The results of each test will be recorded so that they can be used to assist with any resulting fault investigation. Page 3 of 29

4 2 THROUGHPUT MEASUREMENT There is an important relationship to understand between the line rate synchronisation, the overheads of the IP protocol that carries the end user data and the throughput that an end user receives. The DSL synchronization or Line Rate (which is set between the end user CPE and the local exchange DSLAM) will always be greater than the IP throughput a DSL can achieve. IP throughput is affected by numerous factors because of the protocol overheads that carry the end users traffic data, time of day and Communication Providers product management. This overhead varies depending on the line rate synchronisation speeds but is typically in a range between 1000kbps and 200kbps less than the line rate. So an 8Mbps line has a 7Mbps IP throughput and a 500Kbps line rate has an IP throughput of 300kbps. Therefore, you should note that the line rate is a known factor and the performance tester result that measures throughput will vary depending on those factors that influence throughput. The BRAS profiles on BT Wholesale network are set to align with calculated IP throughputs for different line rates. The BRAS limits the amount of IP data sent down a line to ensure that BT do not try and transmit more IP data than the line rate can support, as doing so will mean data being discarded in an uncontrolled manner. This uncontrolled discard can cause applications to resend the data, effectively reducing the amount of data (and thus throughput) than can be achieved. The BRAS profile is always greater than the IP throughput on any line. Factors that can potentially influence throughput are; the End User Customer Premises Equipment (CPE), internal telephone wiring, local environmental issues such as electrical interfaces (generally referred to as Repetitive Electrical Impulse Noise - R.E.I.N), b wireless networks which can only at best support 5.9 Mbps IP throughput (less in noisier environments) and utilisation on the network including the communication provider s network, the Internet and the service being accessed. It is important to understand that tests must be carried out from a PC directly connected to the DSL line to be tested at a time when no other IP traffic is being generated by the End User or PC s attached to a home/office network, if other IP traffic is being generated then it will affect the Performance Tester results. Page 4 of 29

5 3 OVERVIEW Using the BT Performance Tester to test a broadband service is a fairly simple process and should take no longer than 2-3 minutes. End Users will access the performance tester by typing the URL on an internet browser. Please note the following important points: The end user must not point their Internet Browser away from the test screen or start any other download activity on their computer whilst the tests are in progress, as this will invalidate their test results. If during any stage of the test process your end user is presented with a screen that does not correspond with the test process (described in the following subsections), please refer to the Performance Tester Errors section of this document for further details. The results of your End User s tests are also available to you via the WOOSH One Shot Check. The Fault Report code must be set to slow speed, EU Performance Problem, or QoS Performance Problem, depending on the service. The following sub-sections guide you through the Performance Tester testing process. Page 5 of 29

6 4 USING THE BT PERFORMANCE TESTER 4.1 Accessing the Performance Tester Your End User will be presented with following performance tester screen upon accessing performance tester URL ( Page 6 of 29

7 4.2 Enter Telephone Number Your End User must enter their telephone number in full (including area code) and click Go ; following screen will be presented. Page 7 of 29

8 4.3 End User Domain Validation Your End User may be presented with the following screen. If they are they should enter their login User Name and Domain as requested e.g. and press Go. Note: This screen may not appear for their service in which case they will be automatically directed to the next step. Page 8 of 29

9 4.4 Performance Test in progress This screen indicates that the performance test is in progress and will look different depending on the service your End User has. One of the following screens will be presented. Screen 1 - displayed for BT IPstream fixed services including SDSL services Screen 2 - displayed for BT IPstream Best Effort services Page 9 of 29

10 Note: In the above diagram it shows that a BT IPstream Best Effort service test in progress, a pair of bars at the top of the screen indicates the type of service being tested and progress. Screen 3 - displayed for BT IPstream Assured Rate services Page 10 of 29

11 4.5 Performance Tester Results Test results will be presented on successful test completion. Screen displayed for BT IPstream fixed services including SDSL results Page 11 of 29

12 Screen displayed for BT IPstream Best Effort services Explanation of results DSL Upstream connection rate is 500 Kbps. This is the upstream DSL line rate, and is the same rate that will be shown on the EU CPE or its associated software. DSL Downstream connection rate is 1000 Kbps. This is the End User downstream DSL line rate, and is the same rate as shown on the EU CPE. This is the maximum raw data that can be transported across your line. Your actual throughput will always be less than this rate and this is due to overheads taken up by the higher layer protocols, retransmissions etc. and this is normal. The EU IP profile rate is 500 Kbps This is the IP rate set on the BT Wholesale BRAS that the End User is connected to. The EU IP profile rate will be less than the DSL downstream connection rate due to the overheads of the IP service and this is normal. The Actual EU IP throughput is 459 Kbps. This is the actual rate achieved during the Performance Test. This rate will never reach the IP profile rate and this again is normal. Page 12 of 29

13 NB: You can place your mouse cursor over the help question marks indicated in the above screen shot for explanations. An example screen is shown below - Page 13 of 29

14 If you have subscribed to BT IPstream Max as well as Assured rate service, the Performance Tester will test both sessions i.e. QoS and Best Effort. If a QoS session is active at the time of testing then PT will use the already configured QoS session and Best Effort session for testing. However, if the QoS session is not active at the time of testing then the PT will first test the Best Effort session and then create QoS session for testing. After test completion, the original configuration will be restored. The results page will show both, the QoS test results and the Best Effort test results. NOTE: If a QoS session is already configured prior to testing then the Best Effort session bandwidth will be only the remainder of connection capacity less the QoS session bandwidth. Screen displayed for BT IPstream Assured Rate services Page 14 of 29

15 Screen displayed for BT IPstream Best Effort services. Test1 is completed however you need to take next test i.e. Test2. Screen displayed for BT IPstream Assured Rate services. Test1 is completed however you need to take next test i.e. Test2. If further performance tests are required to be conducted for your service, you need to click Go button as shown in above screen shots. The Performance Tester will automatically direct you to the next test i.e. Test2 where the following screen will be presented to you Page 15 of 29

16 Screen displayed if additional tests are required. Note: If Test2 is not needed for your network type, you will be automatically directed to the Test3. In such a case, please follow Test3 instructions given in this handbook. You need to logout and re-login using the login ID as explained in the above screen shot. If you are not sure how to do this, please contact your ISP for assistance. After re-login, please press Go. While Performance Tester is conducting further tests on your broadband service one of the three screens (depending on type of broadband service you are testing) as shown in section 4.4 will be presented to you. Page 16 of 29

17 The following test results will be presented on successful test completion: Screen displayed for BT IPstream Best Effort services test completed. Screen displayed for BT IPstream Assured Rate services test completed. Page 17 of 29

18 Screen displayed for BT IPstream Best Effort services Test2 is completed however you need to take third and final test i.e. Test3. Screen displayed for BT IPstream Assured Rate services Test2 is completed however you need to take third and final test i.e. Test3. Page 18 of 29

19 If further performance tests are required to be conducted for your service, the Performance Tester will automatically direct you to the next test i.e. Test3. The following screen will be presented to you After re-login, please press Go. While the Performance Tester is conducting further tests on your broadband service one of the three screens (depending on type of broadband service you are testing) as shown in section 4.4 will be presented to you. Page 19 of 29

20 The following test results screens will be presented on successful test completion. Screen displayed for BT IPstream Best Effort services test completed. Screen displayed for BT IPstream Assured Rate services test completed. Page 20 of 29

21 5 TEST RESULT INTERPRETATION As the tests carried out by the BT Performance Tester covers the BT Wholesale network, the Service Provider s network and the Internet, the results can be influenced by a number of factors. These include: Time of Day BT Wholesale network utilisation Service Provider network utilisation The use of a VPN or corporate network End User wiring End User equipment Use of wireless networking using IEEE b (up to 11 Mbps) Local Environment issues (such as Random Electrical Impulse Noise - R.E.I.N) Traffic being generated at the time the test was carried out. Page 21 of 29

22 6 BEST PRACTICE BT Wholesale advises that all throughput related complaints from End Users should be investigated primarily by using the BT Performance Tester. Your End Users should be advised to conduct tests using BT Performance Tester first and then contacting you if they think they have a throughput related fault. When investigating a throughput related complaint, consideration should be made with regards to the volume of End User IP traffic through BT s broadband platform, the number of End User across your own network, bandwidth of your own network and traffic congestion It is suggested that you should educate your End Users on what the expected performance of the product should be and whether a fault exists or not. Page 22 of 29

23 7 OBTAINING HELP Click on the on screen help buttons for further information on using the BT Performance Tester. Further help is available from the SP helpdesk on Page 23 of 29

24 8 PERFORMANCE TESTER ERRORS 8.1 Incorrect telephone number If the telephone number has not been entered in the correct format, the BT Performance Tester will display the following error to your End User. To clear this message your End User will need to click the OK button on the error screen (shown below). The BT Performance Tester will redirect them to the screen where they need to re-enter their telephone number in the correct format e.g If your End User has entered your telephone number incorrectly the BT Performance Tester will display following error message to them. To clear this message your End User will need to click the OK button on the error screen (shown below). The BT Performance Tester will redirect them to the screen where they need to re-enter their correct telephone number. If your End User has not entered an area code for your telephone number, the BT Performance Tester displays following error message. To clear this message your End User will need to click the OK button on the error screen (shown below). The BT Performance Tester will redirect them to the screen where they need to re-enter their correct telephone number, including the area code. Page 24 of 29

25 8.2 Validation Errors If your End User enters an inappropriate or incorrect login details the BT Performance Tester will display the following error messages. Your End User must check their login details and try again to continue performance testing. Page 25 of 29

26 If the BT Performance Tester is not able to identify your End User s broadband service from the telephone number they entered the following error screens will be displayed. Your End User should recheck their telephone number, STD code, format etc. and retry. If the same error or any other error is displayed, your End User should contact you and/or take appropriate action as per the text displayed in the error screen. 8.3 System busy errors End Users may occasionally experience times when the BT Performance Tester is busy. If this happens, please ask them to retry again after about 5 minutes. If the same error, or any other errors mentioned in this section, are repeated after 3 successive retries of about 5 minute intervals, please ask them to contact you for further assistance. Page 26 of 29

27 Page 27 of 29

28 9 GLOSSARY Acronym BBIP EU IP BRAS SP CP PT VPN Expansions Broadband IP service identifier End User Internet Protocol Broadband Remote Access Server Service Provider Communications Provider Performance Tester Virtual Private Network Page 28 of 29

29 10 DOCUMENT HISTORY Issue Date Notes 1 September 2006 First issue of BT Performance Tester 2 November 2006 Inclusion of Advanced Services tests Page 29 of 29