P 2 I S A 0 1 8 PISA 2018 COMPUTER-BASED SCHOOL QUESTIONNAIRE: PRINCIPAL S MANUAL Doc.: CY7_CBA_ScQPrincipalManual.docx Produced by ETS, Core A Contractor
TABLE OF CONTENTS Part 1 Introduction Introduction Page 3 Part 2 Logging in to the Online Questionnaire Accessing Questionnaires Page 3-4 Part 3 Selecting a Language Overview Page 4 Part 4 Understanding the Questionnaire Screen Overview of a Screen Page 5-6 Scroll Page 7 Part 5 Answering the Questionnaire Completing questionnaires Page 7-8 Part 6 Finishing the Questionnaires Complete the Questionnaire Page 9 Part 7 Troubleshooting Authentication and Notifications Page 10-12 2
PART 1 - INTRODUCTION This document describes how to complete the PISA 2018 Online School Questionnaire. It provides an overview of the global interface as well as guidance on answering the different types of questions. The questionnaire software is compatible with the following Web Browsers: Firefox v22.0 or later Internet Explorer v9.0 or later Chrome v40.0 or later Safari v6.0 or later Full tests were performed with Firefox 45.0, Internet Explorer 11.0 and Chrome 50.0. It is strongly recommended that the latest version of Firefox be used when working on the Online Questionnaires. The questionnaire software has been tested using Windows (v7.0 or later) and MacOS X (v. 10.9 or later). It may work with previous Operating System versions, but these are not officially supported. PART 2 LOGGING IN TO THE ONLINE QUESTIONNAIRE Using your Web Browser, you may access the following URL: (http://pisa.ets.org/schoolquestionnaire). The following screen will appear: On this screen, use the credentials that were provided to you by Macao-PISA Center. The login has four parts (3 digits 2 digits 2 digits 3 digits). The password should have a total of 8 digits. Once this has been entered, click the Login button to begin the questionnaire. 3
Please note: Opening a questionnaire in multiple web browser tabs will cause conflicts. If the questionnaire is open and active in one tab, and then if the same questionnaire is opened in a different tab, the user will receive a message requesting that they log out: PART 3 SELECTING A LANGUAGE If Macao-PISA Center has more than one language for administration, a select language screen will appear: Click on the language you would like for answering your questionnaire. A confirmation message will be prompted to confirm your choice: Please Note: Once you select a language for the Questionnaire, you cannot go back and change it. Please be careful to select the right language before validating your choice. 4
PART 4 UNDERSTANDING THE QUESTIONNAIRE SCREEN All questionnaire screens have the following parts: 6 7 4 8 5 1 9 2 3 Part 1 displays the questions as well as the instructions and response items. Part 2 allows the respondent to reset all of their responses and the values he or she has entered. Part 3 contains the Back and Forward buttons, which can be used to navigate through the questionnaire interface. Each time one of these buttons is clicked, the data is saved (A small may appear on your screen to indicate this action). Please note: Use only these buttons and not the back and forward buttons on your web browser to navigate the questionnaire. Part 4 contains the Help feature. This button will only be present if there is information entered under the help section of that particular screen. Otherwise, the icon will not be seen. Part 5 allows the respondent to log out of the questionnaire. You may do this at any time and complete it later. When this button is clicked, the date on the current screen is saved. When you log in again, the questionnaire opens where you left off. Please note: If you 5
close the web browser by clicking the close button ( ), situated on the top right corner of the screen of the browser, the data on the current page will not be saved. Part 6 is the progress bar, and shows the user how far into the questionnaire they are at any given point. Please note: when routings are encountered and cause you to jump forward and skip a number of questions, this progress bar can sometimes move very quickly. Part 7 is called List of Items, and is a tool to navigate through the questionnaire regarding screens that were already visited. The beginning of each question as well as the Question ID is shown in this window and to indicate the status of a screen. The list of items tab includes a lot of additional information. For instance, items that appear in grey show that they have not been visited yet, and therefore users may not be able to go to these questions. Items appearing in black have been visited, but may not have been fully answered yet. A question has only been fully completed once a green check mark appears in the box next to the question. The presence of a red dot next to any of these questions shows that there is a possible error somewhere in the answer. Part 8 opens a pop-up window which allows you to download either a PDF version of the questionnaire and the principal s manual. By default, the principals manual will only be available once countries have sent it to Core A, and it has been individually integrated. Part 9 indicates the unique Question (screen) ID for the current screen. This will be present on each screen page. 6
As some questions may be larger than what your screen size can display, please do not forget to click on the scroll bar to see the rest of the question and the Back and Forward buttons. PART 5 ANSWERING THE QUESTIONNAIRE Each screen has the following information: 1 2 7
Part 1: This presents the question and the instruction. Depending on the question, the instruction may appear before the question. Part 2: This part provides the answers. - Many of the questions will ask you to select one answer, or several. - Some questions ask you to select an answer in a drop-down menu: - Some questions ask you to enter a number (or text) in one (or several) boxes: - Some questions ask you to answer by moving a slider: - To answer, you need to click and drag the slider to a location on the scale. The bar will fill up to the selected location, and the number you selected will be shown above the slider: Please note: You must move the slider to a number to answer the question, even if you want to select zero as your answer. If you leave the slider in its original position, the question will not be marked as answered. - For some questions, if you enter a number out of range or do not answer all required parts of the question, you will see an error message: You can click on Ok to return to the question and complete or correct your answer. You can click on Skip the check to move to the next question. Please note: If you click Skip the check, this question will be shown in red if you click on List of Items. 8
PART 6 FINISHING THE QUESTIONNAIRES At the end of each questionnaire, a thank you screen appears: After reviewing your answers, it is important that you click on the Forward button to complete the questionnaire. Otherwise, your questionnaire will be considered open and not completed. 9
PART 7 TROUBLESHOOTING 1. If the authentication phase does not complete successfully, you will receive the following message on the Log-In page: In instances such as these, you should verify that your CAPS LOCK key is not on. Then, you should carefully type the login and password, and attempt to connect again. If this issue continues and you are not able to access your PISA Profile, please contact Macao-PISA Center. 2. If at any point a certain questionnaire is not yet available when you attempt to access it, a screen will be displayed indicating this: 10
If your questionnaire is not displayed in the language you selected, please log out and contact Macao-PISA Center. 3. If you answer some questions and your answers do not appear anymore (either when you click on Back or when you select a question in the List of Items window), please log out and describe your problem to Macao-PISA Center. 4. The question is designed to allow only one user with the same account to connect at the same time. If another user is already connected with your account, the following message is displayed: This message may be displayed if you are working on your questionnaire on one computer (for instance, in your office) and then continue later on a different computer (for instance, at home). If you are sure that you are the only user to use this account, please click on continue. Otherwise, please contact Macao-PISA Center to verify if your login is the right one. If you click on continue, the other user will get a message when trying to click on the Back or Forward buttons indicating that he or she is unable to continue working on the questionnaire due to another user being connected to the account: 5. If you have troubles after logging in, while going through the questionnaire, there could be a problem with the Internet connection or with the questionnaire servers. When this happens you may see a blank screen, or the questionnaire may appear to freeze or not respond to your clicks. If this happens, you can try the following to correct the problem: a. First try to refresh the page. You can do this by pressing the Control+R keys on Windows or Command+R keys on Mac OS X. Or you can click the refresh button of the web browser ( ). 11
b. If that does not work, you should try closing and restarting your web browser. Make sure that all of your browser windows are closed. Then open your web browser and connect again to the PISA Questionnaire login page. You will need to login to the questionnaire again. You should then be returned to the last question you were working on. c. If this fails, you should check to see if there are problems connecting to other web sites. Try opening other web pages to see if they respond. If not, there may be a problem with your Internet connection. You should check with your network provider to see if they are able to resolve the problem. d. If your network connection is working and other web sites are available, yet you still are not able to connect to the PISA questionnaire, there may be a problem elsewhere on the Internet between you and the PISA web server. If possible, you should wait a while and try again. If the problem persists an hour later, please notify Macao-PISA center. e. If you are able to connect to the PISA questionnaire, but for some reason you cannot proceed through the questions, clearing your web browser cache may correct the problem. The method for doing this depends on which web browser you are using. You can consult http://www.refreshyourcache.com. f. If you have a different web browser (such as Google Chrome, Firefox, Safari or Internet Explorer), you should try using that browser to see if the issues persist. If so, then the issue is likely with the Internet connection or the PISA web server. If this corrects the problem, though, you can complete the questionnaire using this alternate web server. g. If all attempts to correct the problem fail, you should notify Macao-PISA Center for further troubleshooting. Please provide the following information when reporting your problem: The web browser type and version you are using Your Internet (IP) address. You can determine this at http://www.whatsmyip.org/. The date and time when the problem occurred. A description of the problem, with as much information as possible, including what you were doing on the browser and questionnaire when the problem first occurred. If possible, a screenshot of the problem would be very helpful. If you have a technical question that this manual does not answer, please contact Macao-PISA Center as your participation is very important. Thank You For Your Participation! 12