Enhanced Results Analysis coming in January 2008
TestMaker test scenarios generate a lot of useful data. TestMaker 5.0 introduced standard charts to visualize the data into actionable knowledge, including the Scalability Index, Transaction Distribution Charts, and Resource Monitor Charts. TestMaker 5.0 also introduces a result log archiving system and a Performance Comparison Utility to generate charts to compare results between operations of test scenarios.
TestMaker 5.2 will introduce new results analysis functions:
1) Transaction logs will include the "step" times for the operations within a
2) A new charting function will summarize logged results data in new and flexible ways.
TestMaker 5 creates a lot of data that can be put into a chart. Here are the base data series:
- Test Scenario (name)
- Test Node (name)
- Concurrent User levels (CRs)
- Data Index (Message size)
- Transaction (Use Case)
- Sequence name
- Step (run) name
- Pass/Fail status
I put together a new presentation to introduce you to the Enhanced Results Analysis functions. Download the presentation at http://downloads.pushtotest.com/tm5/PushToTest_ResultsAnalysis_20071220.pdf
-Frank


