TEST-GUIDE

...connects test execution and management

TEST-GUIDE symbolizes networked test processes, detailed analyses and centrally managed results. Releases can be reliably planned and test execution jobs can be optimally distributed. But not just that. TEST-GUIDE is a tool that connects test managers and test analysts, software developers and administrators. Each of them can be informed about the test progress at any time, anywhere, and can be actively involved in the processes. With the common goal of speeding up the release. After all, if all the requirements for a new vehicle function are met at the end of a release cycle, then the next step can be started with a clear conscience – the delivery of the fully tested software version. Each single step towards this goal is more than significant. Succeeding requires a function-based Continuous Testing workflow that answers the basic questions:

  • What do we need? – A comprehensive test case coverage.
  • How do we proceed? – The test cases are started via the test execution.
  • Who does it? – Available resources are determined through monitoring.
  • How is it progressing? – The comprehensive test report management shows the results.
  • Do we have everything? – The Release overview ensures that the tests are processed completely.
Show content

Coverages as a strategy

Make your plan work! With TEST-GUIDE, the detailed planning of test case coverage becomes a digital workflow. Associated requirements, conditions, variants and results are transparent and can be traceable at all times. Release by release. Gaps in test execution and traceability? Never again.

The crux of any release or sub-release is the question: Have all the necessary and planned test cases been executed? Coverages help answer this question. They instantly indicate the level of test case coverage for specific requirements, parameter ranges, or variants. A quick, trained look is often all that is needed to correctly evaluate the test results in the graphs and tables.

Coverages are defined using coverage filters. These filters define the boundary conditions for the test scope of a requirement, for example, the vehicle variant or engine class which is to be tested. Only the test executions that meet the defined filter conditions are sufficient, are monitored and included in the analysis.

Coverages can be created individually for each requirement. For this purpose, prefabricated examples are already available that can be modified for the respective filter definitions and make it easy to start. In addition, the underlying XML structure makes it easy to generate completely custom scripts for coverage filters. Filters can be imported to TEST-GUIDE from files and ALM systems (e.g., Polarion, HP-ALM, Octane), as well as automated via the REST API, e.g., for Continuous Integration solutions.

Key facts:

  • Coverages for each test level: Requirement tools, test scopes per integration level, variants, parameter ranges, ...
  • Matrix view: Display of all possible combinations – everything is compared with everything else, is good for identifying gaps
  • Scope view: Graphical representation of the test result distribution for a selected coverage filter with a lot of configuration freedom
  • Predefined coverages (test case coverages) for quick start
  • Support for Automotive Spice (ASPICE) with regard to traceability
Show content

Highly scaled test execution

All the indicators point to Continuous Testing. And TEST-GUIDE has long been ready for it. As soon as test jobs are in the pipeline, they are also brought for execution. Optimally distributed and fully automated – both on test benches and in the cloud. You manage the process and maintain the appropriate playbooks for the test jobs.

Essentially, it's about distributing a test job to the right test bench. Sounds simple at first. However, if thousands of test jobs need to be distributed simultaneously, automatically and continuously to scalable test resources, then full power is required. It is good that TEST-GUIDE is following the right strategy here.

TEST-GUIDE automates the execution of tests so that they are executed not only on suitably configured test benches, but also in the order of their prioritization. Added to this is the optimal use of the available test resources so that idling does not occur.

The ResourceAdapter is responsible for the latter. A software that is configured on the test benches and continuously sends information about vital data, configurations and test case execu tions to the central TEST-GUIDE server. This enables the test execution to decide in real time the test bench on which the next test job can be executed. In addition, the ResourceAdapter ensures that the test bench is prepared for the test. It checks out repositories, copies data back and forth, and clarifies other additional dependencies – all based on the description in the playbook.

Playbooks can be created in ECU-TEST and uploaded directly to TEST-GUIDE via the integrated interface. Direct creation in TEST-GUIDE is also possible. The workspace to be used – including test cases, parameterization of global constants, test bench configuration, and the cleanup after execution – is defined in it. Playbooks thus make the process of automated test job distribution to physical and virtual test benches even more convenient. That is, already when creating the test-suite. Continuous Testing? Done.

Key facts:

  • Parallelization and distribution with TEST-GUIDE
  • To all test benches – HiL and Cloud (MiL, SiL)
  • Integration of source code management tools, such as Gitlab, Bitbucket or GitHub
Show content

Monitoring for optimal utilization

Speeding up in idle mode doesn't get anyone anywhere. Knowing when and which test resources are available is TEST-GUIDE's strength that is unparalled. With integrated monitoring, the vital data, test executions and also configurations of each connected test bench can be accessed in real time. We rely on constant heartbeats – without any rhythmic disturbances.

Especially with many test executions, it is extremely important to keep an eye on the test resources. The time on the test bench is too valuable to waste it without being used. Availability, utilization, disk storage capacity, configurations, ongoing test executions – all need to be maximized.
That's why we have deliberately added a little extra. Or more precisely, a small add-on: the ResourceAdapter. It is an agent that allows such a comprehensive monitoring of test resources. Once installed, it continuously sends all information from the test bench PCs to the central TEST-GUIDE server via the monitoring API. There, this data is combined and can be accessed in real time – in different view options, depending on your interests.

With these comprehensive details about the connected test resources, it is easy to determine which test bench is ready for the next test execution, for example in a Continous Integration environment. Or even the performance and duration during the last executions.

Key facts:

  • Identification of System-under-Test performance deficiencies, critical situations and borderline cases
  • Large-scale simulations on widely distributed computers
  • Utilization improvements of test benches using simple analysis
Show content

Test report management – for that extra bit of overview

Real-time results. Statistics, test schedules and test reports at a glance. Test report management is the core of TEST-GUIDE. Here, the test executions are compared, viewed and analyzed from all possible perspectives. Here we go into detail. And if most of it is green, then the release is not far away.

Normally, it is extremely time-consuming to manage, view and analyze test reports, i.e., the results of innumerable test executions. Not with TEST-GUIDE. The tool centralizes the results in a database and helps to restrict the relevant test reports for a release using many different filter and analysis options.

The test reports are automatically imported from ECU-TEST. However, it is also easy to import for user-specific test tools thanks to the standardized ASAM-ATX interface. As soon as the test reports are available in TEST-GUIDE, the test runs can be analyzed in a targeted manner. In addition to test schedules and test statistics, comprehensive time and event-based filter options are available for this purpose.

Compare test runs and regression tests, trace test steps, identify trends, assess defects or create overview diagrams. The result filter is the first choice here. It is the multi-functional tool when details matter. Set filter properties to design custom visual dashboards that display test results specifically as needed. The team also benefits from this. Because each filter can be subscribed, exported or shared via email.

The comprehensive review function provides a lot more extra. It can be used to record notes for failed test runs, perform re-evaluations or even create defect tickets. The latter is easily possible via the integrated link to ticket systems, such as Jira, Redmine, HP ALM.net or Octane. Various export options (PDF, Excel, test management tools, ATX documents and full backups) are also available to share or save any form of result reports. For continuous flow of information at any time and from anywhere – both from the workplace and on the move via mobile devices.

Key facts:

  • Web-based technology for use regardless of the platform
  • Worldwide collaborative use at any time from anywhere
  • Open interfaces for integrating third-party tools (CI/CD)
  • Customized Continuous Testing solution via REST API interface
  • Upload test reports in ATX format
Show content

Release overview – ready, steady, go

Stay organized from start to finish. This is true for every release. Regardless of whether it's individual iterations or major milestones. Once you board the release train, it takes you step by step to success. Only the final result counts. Because the goal is achieved only when all the requirements for a test are met. Success drives us.

The release encompasses all test procedures just like a set of brackets. Connects the beginning and the end. Compares actual status with target status. Helps to make decisions. Even the decision of whether a release can be closed. This happens when the initially defined test scope has been successfully implemented. The workflow for a release is almost always the same. Create > Monitor > Detect irregularities > Upgrade > Add if necessary > Check > Close. The difference is in the creation. This is because a release can be created in advance or afterwards.

If the release is based on tests that have already been executed, then relevant test reports are filtered via the results filter and assigned to a release. However, a release is often created before executing the first test case, i.e., during the planning phase. Then a defined coverage filter with a certain scope of requirements becomes the basis. All test reports that meet these requirements are automatically assigned to the corresponding release. For as long as it takes until the release is closed.

Once a release is ready, success is measured in terms of tests passed and advanced coverage. The release overview keeps you optimally informed about the status – both graphically and in tabular form. In addition, it is easy to navigate from here to any release-relevant section of TEST-GUIDE with a single click. Practical! Especially when there are several releases to organize at the same time. If the release was closed successfully, the results can be exported in different formats (ALM systems, e.g., Polarion or Octane, Excel, PDF).

Key facts:

  • Automated release logging through defined coverages
  • Upload test reports in ATX format
  • Starting point for the complete backup phase
  • Complete release

Latest Releases

Did you already know? Our TEST-GUIDE developers publish a release every 2 weeks. So, there are new features coming regularly.

Go to the changelog.

Love at first sight?

Contact

You are nearly as enthusiastic about TEST-GUIDE as we are? Then please contact our sales team. We will make you an unbeatable offer.

You cannot quite understand why we make such a fuss about this tool? Call us. We will take all the time it needs to explain it to you.

Workshops

You want to understand better how you can use the tool for your purposes? Call us and we will explain our workshop options to you.

Data sheet (PDF)

Condensed facts can be found in our product data sheet.