Test Management 4.0: Reduce Risk by Understanding the Impact of Change

By Ido Sarig

Ido PhotoBig day today, we just announced the release of our latest version of Wind River Test Management, WRTM 4.0, the culmination of several years of hard work – kudos to our engineering team!

In the coming weeks, I will be covering many of the new features of WRTM 4.0 in detail in a series of separate posts, but today I wanted to give you an overview of some of the new things you can look forward to.

I’ll start by sharing a quote from Wind River customer GE Healthcare on how Test Management is helping their business — a real testament to the value that Test Management delivers.

"Wind River Test Management has tremendously helped us improve the productivity of our firmware testing team, significantly reducing the overall development cycle time. And although we already had more than 20 tools as part of our test and development process, test plans and test results were still mostly paper based.  Wind River Test Management easily integrates with our existing solutions, such as HP Quality Center, to provide a complete automated regression testing suite running tests remotely on the target and collecting valuable metrics for tracking test progress and software quality. GE Healthcare operates on a ‘zero defects’ policy and Wind River helps ensure that this policy is met much faster than before."

This new release represents a major milestone for us, and applies our patented Sensorpoint technology to enable block-level code coverage on shipping binaries, giving you the same level of white-box visibility that would normally require static code instrumentation. But unlike static code instrumentation, which comes with a huge performance penalty and a much increased memory footprint – Sensorpoint-based block level coverage has virtually no performance impact nor memory bloat. With this more granular level of visibility, WRTM reduces the risk of critical bugs slipping through in untested code and showing up in the field.   Such defects can damage your brand and create costly product recalls. The block-level coverage capability is an on-demand feature that can be enabled and disabled for specific binary modules and test runs.

Our unique Test Suite Generator (TSG) enables you to run an optimized subset of your tests, comprised of the minimum number of test cases required to thoroughly test the full impact of a change in the code. For WRTM 4.0, we’ve enhanced the TSG to produce test suites based on the status of defects; the results of previous runs; the mapping of test cases to specific requirements and even to produce the maximum code coverage for a given time constraint, using an enhanced version of an algorithm for solving the so called “knapsack problem.”

One of our main goals with this release was to ensure that Test Management seamlessly integrates with existing application development lifecycle solutions such as requirement management and defect tracking. By augmenting rather than replacing existing development infrastructures, WRTM delivers a complete, end-to-end testing solution that provides traceability from requirements to test case to executed code and to associated defects, satisfying the needs of various regularity standards and auditing requirements.

Out of the box, Test management comes with pre-built support for common tools such as IBM RQM, DOORS, Clearquest and HP Quality Center, and you can easily customize Test Management to make it a part of your existing workflow using its full-featured command line interface.

There are additional capabilities to highlight in this release as well, such as test case versioning, a full reservation system for our Virtual Lab Manager and test packages for BSP validation and security, to name a few.  Stay tuned as I will be covering these in detail in upcoming posts.