Reviewing an Interview

To review an interview, select the questions that are to be included in the review (go to Selecting Questions to be Included in the Review Session for more information). Note that if no questions are specifically selected on the Session page then all interview questions are included in the review.

To open the Review page and start the review do one of the following:

• When you are browsing the Sessions list - choose Review from the Options drop-down menu.
• When you are browsing the Session page > Review tab - click the blue Review button in the upper-right corner of the page, or choose the Review tab.
• When you are browsing the Overview of the completed interview - click the Reopen Review link.

The Review page opens with all the questions that are selected for review.

Review

The Review window allows you to review the interview questions included in the current review session. The reviewing process involves reading the questions, checking the responses provided, and correcting the responses when necessary. You can play back a recorded question to recreate the way it was recorded (see below). The grid on the Review page provides the question text and selected response options - all the information necessary for a supervisor to check and correct the responses. Questions normally fill row in the grid. If the question is open-text, the response is provided in the form of free text. Some question types, for example 3D grids, are expanded so they occupy two or more grid rows depending on the number of response options in the question. In this case reviewing is performed separately for each response option.

Figure 1 - Example of the Review window showing a session with two interviews completed

The Review window contains the following information

• The Review page header - this contains a link to the Sessions List Page (go to Viewing the List of Review Sessions for more information), and beside this a drop-down control which allows you to open any of the recent sessions in the Session Overview page (go to Session Overview Page for more information). The header also displays the session name and the status indicator.
• The Overview and Review tabs - the Overview tab opens the current session in the Session Overview page (go to Session Overview Page for more information), and you are currently working with the Review tab - the Session Review page.
• The Questions link towards the upper-right corner of the page takes you to the Selected Questions page (go to Selecting Questions to be Included in the Review Session for more information). Here you can add or remove questions from the list of selected.
• The review progress bar. In the picture above this bar shows that one interview of the three selected is reviewed - the first section of the bar is highlighted in green and the text below the progress bar says: "1 completed". The counter above the bar says the user is currently looking at the second interview: "2 of 3", and the second section of the progress bar is highlighted in dark grey, indicating the second interview in the review sequence is currently being reviewed.
• The "Done for now" link allows you to leave the review session before you have completed reviewing all the interviews. You can click this link at any time before you finish reviewing. This action does not assign the "Completed" status to the session, it simply allows the user to leave without changing the current session status (go to Session Status Indicators for more information). This action takes you to the Sessions list.
• The Next/Previous and Complete buttons are shown to the right of the review progress bar. While you review the first interview in the sequence, only the Next button is available. When you move to the next interview both the Previous and Next buttons are visible, and when you reach the last question the Next button changes to the Complete button. Press Complete to finish the current review and assign the interview the Completed status.

Note that you can click on the segments in the progress bar to navigate to the corresponding interview record although this is only possible for records that have already been reviewed - you cannot move past records that have not yet been reviewed.

• The grid header in the picture above shows that the Interview with ID 8 is first in the review sequence and the grid currently displays responses collected in the course of Interview ID 8. The grid header also contains a drop-down control which allows you to change the current language used in the question texts and response options.
• Check the "Not reviewed" box to add a bookmark signaling that this interview was not reviewed and might need further attention. When checked this option also triggers a warning displayed below the progress bar and highlights the corresponding interview section on the progress bar in orange.

Figure 2 - Not reviewed warning shown in the review grid

Click the warning to expand it and display the relevant interview ID as a hyperlink. You can then click the interview ID and be redirected to the corresponding interview.

When the flagged interview is finally reviewed you can remove the bookmark by clearing the Not reviewed box. All highlighting will then also be removed .

Performing a Review

When the review session opens in the Review window work begins with the interview displayed in the review grid. Move to another interview by clicking the Next and Previous buttons. Information about a question is presented in the Questions column. The Response value column shows the response value that is stored in the database at the moment the review session is started.

If this question type allows you to edit the response value, the cell will contain an action icon for resetting the edited response value back to its original value. A playback icon is also available to start playback of the recording related to the question.

Figure 3 - Response value showing the original response value and action icons

Playing Back a Question

Click the Playback icon to start playback of the recorded interview. This plays back audio and video tracks if they were recorded at the time the question was answered by the respondent (go to Live Call Monitoring, Recordings and Playback for more information). This functionality is only available for surveys with the "Enable whole interview screen recording" and "Enable whole interview audio recording" options enabled in the Forsta Professional Authoring module (go to Live Call Monitoring, Recordings and Playback for more information). Playback of the recorded interview starts with the response you are currently editing. After the part of the interview containing video and audio corresponding to this response finishes, the playback is stopped. The CATI Supervisor player window stays open and waits for user action. You can either close the player window at this point or click the Play button in the player to proceed to the recording of the next question. When the end of the recording is reached, playback stops and the CATI Supervisor Player window closes automatically. An indication of the number of recorded versions of the response is displayed next to the Play button in the Response value cell .

The Reset icon appears in the Response Value cell after the response value is edited. Before a response value is edited the Reset icon is hidden. Click Reset to reset the response value to the first corrected value that was entered in the Corrected value cell.

Note that the reset icon may be used to undo any changes applied in the Reviewer at any stage of the review process.

1. If a response requires correction, click a cell in the "Corrected value" column. If this question type allows correction of the current response value, the cell in the "Corrected value" column will display action icons - a pen icon and a bin icon:



Figure 4 - Corrected value cell containing action icons

2. The Response value cell may appear empty if no response was entered or if the question was skipped during the interview. To introduce a correction for an open text response click in the Corrected value cell when it displays either some text or a pen icon . The current text in the Response value column is copied automatically into the Corrected value cell. When the Corrected Value column contains text, the pen icon is hidden although you can still edit the text by simply clicking in this cell.
3. Click the trashcan icon to delete contents of the Corrected Value cell. The system asks you for confirmation. The original response value will be shown with strikethrough applied to show that it has been deleted from the survey data. This action can be reversed using the reset button if needed.



Figure 5 - Warning message displayed upon attempt to delete a corrected response value

Choose Yes to proceed with deletion. The cell is cleared and the trashcan icon disappears.

4. You can add comments whilst reviewing (these comments will not be written to the survey data). To do this, click the Comment icon to the right of the Corrected response cell. The Add comment dialog opens.



Figure 6 - Adding comment to a question

Type your comment into the dialog and click Add. The comment is stored and it will become visible when a user hovers a mouse over the Comment icon, which changes to after a comment is added. When the mouse is hovered over this icon, a pop-up is displayed containing the entered comment text .

5. When you are through reviewing the current interview, proceed to the next by pressing the Next button . The grid is refreshed and the response values for the next interview questions are displayed.
6. When you finish reviewing the final interview in the current review session, click the Complete button . This assigns the Completed status to the current session and takes you to the Session Overview page where you can view all the information related to the current session and browse the review log (go to Session Overview Page for more information).
7. You can also complete a review session at any point (go to Completing an Unfinished Session for more information).

Any session which is assigned the Completed status can be reopened for reviewing at any moment later (go to Reopening a Completed Review Session for more information).