Chapter 4. Running and Verifying the Base Test Cases

This chapter explains how to run the base test cases. Use this information in the following sequence:

  1. Record your configuration from the PCM HDW icon.

  2. Select and run the base tests from the PCM TEST icon.

  3. Run individual base tests, as required.

  4. Create the results diskette.

  5. Rerun any failed or missing tests as individual tests. See Chapter 8, "PCM Base Test Case Details" for information about the individual tests. Also, additional information is available from the PCM WEB site TIPS page.

  6. Update the results diskette.

  7. Continue to LAN testing. See Chapter 5, "Running and Verifying the Network Test Cases".

  8. See Chapter 7, "Collecting and Submitting Test Results" for information about submitting test results.

Recording and Verifying Your Configuration

You must supply information about the system configuration being tested for either server or client compatibility. You can fill in this information after you run all the test cases. To record the information, do the following steps:

  1. Double-click on the PCM KIT folder on the Desktop and then double-click on PCM HDW.

  2. Click on Update System Information and complete each of the hardware information panels.

  3. Click on Continue to display subsequent panels.

  4. When complete, click on Save and Exit.

The hardware information is saved in c:\pcmlogs\machine.txt. If you need to change the information, rerun PCM HDW.

Selecting Base Test Cases

You run the base test cases at the additional server or at client 1. The base test GUI lets you select the tests you need to run. Several tests, however, might require initiation from the command line due to hardware configuration limitations. The instructions below take you through the steps for running the tests in the most automated sequence.

If your system fails any test, you can run each test individually by following the directions in Chapter 8, "PCM Base Test Case Details".

In the PCM KIT folder, double-click on the PCM TEST icon. The Test Selection & Control window is displayed.


Figure 4. The Base Test GUI

Always run the selectable tests from this GUI, unless you are rerunning an individual test after a failure.

Click on Help if you need more information about the selection choices.

Click on Run to start running the selected the tests.

Click on Exit to leave the program without running any test cases.

The GUI lets you select the tests to run, and whether to run tests requiring user input first or last. Select First or Last to indicate when, within the testing, you want to run the test cases requiring user input. These tests run quickly, you should run them first.

A suggested sequence is:

  1. Select and run the acceptance test cases, FVT test cases, the multimedia cases, and, if applicable to your system, PCMCIA and SMP. The acceptance and FVT tests require user input and run quickly. The multimedia test takes longer and requires user input at the completion of PCM_REXX.

  2. When these tests are complete, use the GUI again to start the stress test, which takes a long time and requires no user input.

  3. If your shipped system supports speech, run the speech test. The speech test must be run individually. See "Speech Recognition (SPEECH)" for instructions.

  4. If your shipped system supports Advanced Power Management, run the APM test. The APM test must be run individually. See "Advanced Power Management Test (APM)" or "Advanced Power Management Test (APM) for Desktop Systems" for instructions.

Attention: Do not use the keyboard or the mouse while the tests are running. Wait until control is returned to you before opening or closing windows. After the tests requiring user input have completed, ignore other windows that seem to request input.

The system reboots between several of the tests. This is normal behaviour.

Running the Base Tests

This section tells what you need to run the tests, what you see on the screen, and how to respond when prompted for input. The section assumes you selected FIRST for the test cases requiring user input.

The tests are grouped by category. Each category may consist of several tests, started automatically when you select that category.

Acceptance Tests

Requirement

Required on all systems

User Input

Watch screen and respond at end of this sequence:

  1. The initial test runs in the Logical Screen Group-1 window, and then the screen starts flashing multiple colors and characters.

  2. Wait five minutes while the screen flashes, and then press Q to end the flashing.

  3. No other user input is required.

Duration

About 30 minutes for both the user input and automated tests.

Log file

Enter type d:\batch\pcmaccpt.sum to check the log file.

Detailed description

See Chapter 8, "PCM Base Test Case Details" for details.

Stress Tests

Requirement

Required on all systems

Supplies required

One blank diskette

User Input

If prompted, insert the diskette in drive a: and press Enter.

Duration

About 6 hours. You can run this test last and leave the system unattended until it completes.

Log file

Enter type d:\logm1\pcmmed01.sum to check the log file.

Detailed description

See "Stress Test (PCMMED01)" for details.

FVT Tests

Requirement

Required on all systems

Information required

  • Diskette size used by drive a:, 3.5" or 5.25"

  • Physical drive number of any local drive

  • Logical drive letter of any local drive

Supplies required

One blank diskette

User Input

Insert diskette when requested, check printer output.

  1. Enlarge the window to see the questions on the screen.

  2. Do not respond until prompted.

  3. When prompted, follow the instructions on the screen to enter the keystrokes as requested.

Duration

About 1 hour

Log file

Enter type d:\logf\fvtsect2.sum to check the log file.

Detailed description

See "FORMAT Utility Test (FORMAT)" for details.

Multimedia Tests

The multimedia tests are divided into individual tests for the various types of multimedia available.

Requirement

Required on all systems shipped with either a sound card or a CD-ROM drive.

If you added a CD-ROM drive to the system, or used a CD-ROM drive connected to the parallel port to install OS/2, you must still install multimedia and run the multimedia PCM_CD test case, even if the CD-ROM drive is not part of the shipped configuration.

Note:

The CDROM support cannot be removed from the Multimedia Configuration if OS/2 was installed from a CDROM drive. Once support is installed it cannot be removed by updates to config.sys or through selective un-install.

 

Test selection

Use the following table to select the specific tests required:

Table 1. Selecting Multimedia Tests

Your system supports

Test to select

Required

VGA video, resolution less than 1024 × 768 × 256

PCM_VGA

Select this or PCM_SVGA

SVGA video, resolution at least 1024 × 768 × 256

PCM_SVGA

Select this or PCM_VGA

Always

PCM_FLC

Yes

Always

PCM_REXX

Yes

Regular CD-ROM drive

PCM_CD

Yes

     
 

User input

None required

Supplies required

Music CD (not a software CD)

User Input

Yes, the PCM_REXX test requires user input to close windows when it completes.

Duration

About 2 hours for all tests

Log files

Each multimedia test has its own log file in the d:\results\mmepcm\svtraw directory.

Detailed description

See "OS/2 Multimedia Tests" for details.

PCMCIA Tests

Requirement

Required on all systems shipped with PCMCIA support

Information required

For each slot, the drive letter, and the type of PCMCIA card used in that slot.

User Input

None

Note:

Some systems do not reboot with PCMCIA cards installed, or might leave the cards unusable they are installed while the system is rebooted. If this occurs with the system being tested, run PCMCIA tests from an OS/2 command line. See the directions in "PCMCIA".

 

Duration

About 15 to 30 minutes depending on the storage capacity of the cards used.

Log file

The log files are in the d:\pcmcia directory.

Detailed description

See "PCMCIA" for details.

SMP Tests

Select this test only if the shipped system supports multiple processors, and Convenience Package for OS/2 Warp Server for e-business or OS/2 Warp Server for e-business

Requirement

Required for systems with Convenience Package for OS/2 Warp Server for e-business or OS/2 Warp Server for e-business software

User input

None

Duration

About five minutes

Log file

The log files are in the d:\smp directory.

Detailed description

See "SMP Verification Test" for details.

JFS Tests

Select this test only for OS/2 Warp Server for e-business

Requirement

Required for systems with OS/2 Warp Server for e-business software

User input

None

Duration

About 30 minutes

Log file

The logfile is in d:\jfstest\jfstest.log.

Detailed description

See "OS/2 Journaled File System Test (PCMJFS)" for details.