Appendix G

Testing Results




Below is a table containing each of the tests carried out on the system, with re results of each test:

GUI Tests

Test
Input
Expected Output
Actual Output
OK?
Check that the GUI loads and all the buttons are visible with readable text
Load application
Single window appears with 9 buttons visible, each with readable text
Single window appears with 9 buttons visible, each with readable text
Yes
Check that the input focus is on the first button when the application loads
Load application
When window appears the first button has the input focus
When window appears the first button has the input focus
Yes
Check that the user can move input focus between the buttons in sequence using the tab and shift tab keys
From menu, press tab 9 times, then hold down shift and press tab 9 times
Input focus moves forwards between each of the buttons in turn, then backwards between each in turn
Input focus moves forwards between each of the buttons in turn, then backwards between each in turn
Yes
Check that the user can activate each button either by clicking on it, giving it the focus and pressing space, or by pressing the shortcut key
From the menu try activating each button in each of the ways specified
The application does the things indicated on the buttons when each is activated
The application does the things indicated on the buttons when each is activated
Yes
Check that the user can exit the application in each of the ways indicated
From the menu, try clicking on the close icon in the top right, clicking on exit from the menu, and pressing escape from the menu
The application displays an are you sure message, then if confirmed, it exits
The application displays an are you sure message, then if confirmed, it exits
Yes
Check that the colours in the application for the window background and the buttons are as set in the windows control panel
Change the colours specified in control panel for window background and buttons
The background of the application’s window and buttons change to those specified in control panel
The background of the application’s window and buttons change to those specified in control panel
Yes
Check that when the window is re-sized, the buttons also change size relative to the size of the window
Re-size the application’s window
The buttons and headings on the page change relative to the new window size
The buttons and headings on the page change relative to the new window size
Yes
Check that the menus can be browsed correctly using the mouse or keyboard
Click on the relevant buttons to move up and down within the menu hierarchy
When a category is clicked, the pages or sub-categories for that category are displayed. When back is clicked, the user is taken one step back up the hierarchy
When a category is clicked, the pages or sub-categories for that category are displayed. When back is clicked, the user is taken one step back up the hierarchy
Yes
Check that the settings window is displayed correctly
Click on “Change Settings” from the main menu.
A new window appears titled “Options” containing all the options that can be set by the user
A new window appears titled “Options” containing all the options that can be set by the user
Yes
Check that the controls on the options menu can be traversed using tab and shift-tab
Press tab 15 times from within the options screen, then hold shift and press tab 15 times
Input focus moves between each control in the window in order, then back through each control in reverse order
Input focus moves between each control in the window in order, then back through each control in reverse order
Yes
Check that pressing the Enter key in the options screen saves the options and closes the window
Press Enter from within the options screen
The window closes and the options are saved
The window closes and the options are saved
Yes
Check that clicking on OK in the options screen saves the settings and closes the window, and clicking on cancel closes the window without saving the settings
Change an option in the options screen then click cancel.
Go back into options, change the option again then click OK
When cancel is clicked, the options window closes without saving the changes. When OK is clicked the window is closed, but the changes are saved
When cancel is clicked, the options window closes without saving the changes. When OK is clicked the window is closed, but the changes are saved
Yes
Check that a status screen is visible during download, and it is updated to show progress
Click “Get News Now” from the main menu
A status window appears, and text appears to show what the system is doing
A status window appears, and text appears to show what the system is doing. Some problems encountered in certain installations of windows NT due to different font sizes
Partially
Check that the cancel button in the status window always has the focus, and can be pressed at any time
Click “Get News Now” from the main menu. Click on cancel or press space
A status window appears. When cancel is pressed the window disappears (possibly after a short delay)
A status window appears. When cancel is pressed the window disappears (possibly after a short delay)
Yes

Download/Parse Tests

Test
Input
Expected Output
Actual Output
OK?
Check that if “attempt to autodial modem” is selected in the settings, the modem is automatically dialled
Select “autodial modem” in options. Click “Get News Now”
The status window appears, the modem is dialled, the pages are downloaded
In most windows 98 systems the status window appears, the modem is dialled, the pages are downloaded. In windows NT systems the modem is not dialled
Partially
Check that the category database can be downloaded
Click on “Get New Categories Now” from the menu
The category database is downloaded from the UMIST server, and any new pages are be instantly accessible from the menu
The category database is downloaded from the UMIST server, and any new pages are be instantly accessible from the menu
Yes
Check that the system is able to make a connection to the Internet and download pages
Choose at least one page to download from the menu, then click on “Get News Now”
The status window appears, and the page(s) specified are downloaded
The status window appears, and the page(s) specified are downloaded
Yes
Check that the system only downloads the pages from three sites at once
Choose at least four pages to download from the menu, then click on “Get News Now”
The status window appears, and the pages from the first three sites are downloaded. When one site has finished the system begins downloading the pages of the fourth selected site, and so on until download is complete
The status window appears, and the pages from the first three sites are downloaded. When one site has finished the system begins downloading the pages of the fourth selected site, and so on until download is complete
Yes
Check that the pages that have been chosen are all downloaded
Choose some pages from the menu, then click on “Get News Now”
A status window appears showing that each of the pages specified is being downloaded, along with the sub-pages where appropriate
A status window appears showing that each of the pages specified is being downloaded, along with the sub-pages where appropriate
Yes
Check that all the table formatting options are applied correctly to the page
Set up some page formatting options in the page database for a page, select that page for download, begin the download, then choose to view the newspaper
The section of the newspaper for the page that you have set table formatting options for is formatted in the way specified in the page database
The section of the newspaper for the page that you have set table formatting options for is formatted in the way specified in the page database
Yes
Check that the ignored sections within a page work correctly
Set up some ignored sections in the page database for a page, select that page for download, begin the download, then choose to view the newspaper
The section of the newspaper for the page that you have set ignored sections for has the correct sections missing as specified in the page database
The section of the newspaper for the page that you have set ignored sections for has the correct sections missing as specified in the page database
Yes
Check that if an error occurs during the downloading of a page, a description of the error is included in the newspaper
Include an invalid URL in the page database and select it for download. Initiate the download, then view the compiled newspaper
The section of the newspaper referring to the page with the invalid URL displays an error message instead of the normal text of the page
The section of the newspaper referring to the page with the invalid URL displays an error message instead of the normal text of the page
Yes

Newspaper Tests

Test
Input
Expected Output
Actual Output
OK?
Check that the compiled newspaper is accessible from the main menu
Click on “View Compiled News File” from the main menu
The default web browser is loaded, and the contents page is displayed
The default web browser is loaded, and the contents page is displayed
Yes
Check that all the pages selected for download are listed on the contents page
Click on “View Compiled News File” from the main menu
The contents page that appears shows each of the chosen pages, listed alphabetically according to their categories
The contents page that appears shows each of the chosen pages, listed alphabetically according to their categories
Yes
Check that the font size of the newspaper is that chosen in the options screen
Change the font size from the options screen. Download the newspaper again and open it in the default browser
The font size in the newspaper is different, and is now the newly specified size
The font size in the newspaper is different, and is now the newly specified size
Yes
Check that each of the chosen pages has been downloaded, and can be accessed from the menu of the newspaper
Click on “View Compiled News File” from the main menu. Click each of the links to the downloaded pages
Each of the parsed downloaded pages are displayed
Each of the parsed downloaded pages are displayed
Yes
Check that each of the sub pages of a selected site are downloaded where appropriate
Click on “View Compiled News File” from the main menu. Click one of the links to a downloaded page. Click on each of the links to sub pages
Each of the parsed sub pages of the main page are displayed
Each of the parsed sub pages of the main page are displayed
Yes