ECU-TEST

... Updates older versions

ECU-TEST 2020.4

Virtual Testing – Testing in co-simulation and virtual ECU environments

Use-Cases

  • ECU-TEST as a member in a co-simulation environment, which acts as the timing master

ECU-TEST Neuerungen 2020.4

  • Testing of virtual ECUs with direct access and indirect access via 3rd party tools

ECU-TEST Neuerungen 2020.4

Virtual Testing – New continuous simulation mode

New continuous simulation mode

  1. Test cases run in simulation time
  2. Platform acting as time source and simulation control
  3. Reporting of both simulation and real time

ECU-TEST Neuerungen 2020.4

Virtual Testing – Extended support for CarMaker for virtual testing
  • Reset of parameters after simulation stop
  • Manipulation of signals over a defined period
  • New continuous simulation mode for testing in simulation time
  • Support of physical units in trace analysis

ECU-TEST Neuerungen 2020.4

Virtual Testing – Extended support for FMI
  • Stimulation of signals and parameters
  • Reset of signals and parameters
  • New continuous simulation mode for testing in simulation time
  • Support for 32-Bit-FMUs

ECU-TEST Neuerungen 2020.4

Virtual Testing – Extended support for FEP
  1. Support for FEP Metamodell 2
  2. Demultiplexing of FEP-VU ObjectStates and VehicleAppearance

ECU-TEST Neuerungen 2020.4

Virtual Testing – Headless test runner and tool server for Linux (test version)

Linux compatible Tools

  • Multimedia
  • FEP
  • ADTF
  • VTD
  • SSH
  • User ToolAdapter
  1. Tool server for Linux
  2. REST-API for controlling ECU-TEST under Linux

ECU-TEST Neuerungen 2020.4

Diagnostics add-on: Convenient testing of complex values
  1. Access complex return values of DID, RoutineCtrl and IoCtrl directly within the read test step
  2. Autocompletion for sub elements and structures

ECU-TEST Neuerungen 2020.4

Ethernet for a wide range of applications: IPv6 and Socket Adaptor
  1. AUTOSAR PDUs via Socket Adaptor
  2. Full IPv6 support
  3. AUTOSAR SOME/IP with optional structural elements
  4. Recording, analysis, and replay of PCAPNG

ECU-TEST Neuerungen 2020.4

New and updated tools and standards

Updated and new formats

  • BLF-Traces for LIN and Raw Ethernet Analyses
  • ASC: Performance Improvement
  • PCAPNG

New Standards

  • AUTOSAR-PDUs via Socket Adaptor

Updated Tools

  • ATI VISION 6
  • FEP 2.7.1
  • NI LabView 2020
  • NI VeriStand 2020
  • OPAL RTLAB 2020.2
  • Vires VTD 2019/2020
  • VW ODIS 12.2
Central mapping of analyses

Motivation

  • Analysis can be dependent upon variations in test object and test environment

„Solving this with parameterized generic analyses quickly gets very hard to maintain“

  • Separation of roles and domain responsibilities can require separation of stimulation and analysis

New Feature “assign analyses to stimulations by global mapping“

Workflow

  1. Teststep Request analysis defines label
  2. Assign analysis packages via global mapping

ECU-TEST Neuerungen 2020.4


Test step “request analysis”

  • Defines a label (e.g. „CheckVelocity“)
  • Acts as a placeholder for analysis
  • Analysis results can be integrated into test case report
  • Can be used to run analyses conditionally (e.g. within If-Then-Else Test step)
  • “Request analysis” steps and actual analyses are linked within project reports and support quick jump via context menu

ECU-TEST Neuerungen 2020.4


Package property “Stimulation package”

  • Stimulation packages make their recordings available to associated analysis packages
  • Stimulation packages are treated accordingly when inserted into a project
  • Also read- and writeable via Object-API
  1. Workspace filter for searching stimulation packages

ECU-TEST Neuerungen 2020.4


  1. Automatically created placeholders for every requested analysis
  2. Assigning actual analysis package to these placeholders can be done locally via drag and drop from workspace explorer

ECU-TEST Neuerungen 2020.4]


  1. Check project feature also shows requested analyses with no currently assigned analysis package
  2. For currently unassinged by requestes analyses global mapping items can be generated

ECU-TEST Neuerungen 2020.4]


  1. Assigning analysis packages via Drag & Drop to global mapping
  2. Analysis mappings can also be drag into stimulation packages to create „request analysis“ test steps

ECU-TEST Neuerungen 2020.4


  1. Create new global mappings via Drag & Drop to mapping editor

ECU-TEST Neuerungen 2020.4

Generators for analyses – Parameter set generator for batch analysis of many traces at once
  1. Generates a parameter set for every trace in the specified directory
  2. Generator source code is provided and can be enhanced or adapted to fit custom use cases

ECU-TEST Neuerungen 2020.4

Generators for analyses – Reference test package generator for trace comparison

Generator for flexible and simple generation of signal comparison test cases such as reference or back to back tests

  • Generation of packages or parameter sets
  • Configurable signal association
  • Individual signal comparison terms
  • Configurable with GUI or as code

ECU-TEST Neuerungen 2020.4

Workflows – Test case specification and test case implementation

In ECU-TEST test case specifications can be edited and saved as “specification packages”: New package property “Specification”

ECU-TEST Neuerungen 2020.4

Implementation packages can be derived from a specification package:

ECU-TEST Neuerungen 2020.4

Implementation packages are linked to their specification package:

ECU-TEST Neuerungen 2020.4

A comparison of both packages, e.g. to detect changes in specification compared to the implementation, is possible:

ECU-TEST Neuerungen 2020.4

Test execution platform with ECU-TEST and TEST-GUIDE

Test execution playbook overview

1) Preparation and implementation with ECU-TEST

  • Project structuring: setup, tests, teardown
  • Upload project as playbook to TEST-GUIDE

2) Parallelization and distribution with TEST-GUIDE

  • Convert playbooks to one or more test execution jobs
  • Distribute test execution orders to suitable, free test benches

3) Execution with ECU-TEST

  • Execute test execution orders with ECU-TEST via the TEST-GUIDE ResourceAdapter
  • The new ECU-TEST REST-API allows automated execution

ECU-TEST Neuerungen 2020.4

Prepare playbook in ECU-TEST

Conventions

  • Setup steps are executed before the first test
  • Teardown steps are executed after all tests
  • The tests are independent of each other and can be distributed and executed in any order

Workspace

  • Stored in the source code management system: Git URL, Git Revision (commit hash)

ECU-TEST Neuerungen 2020.4

Distributed test execution

TEST-GUIDE can distribute test execution orders to a variety of physical and virtual test benches

ECU-TEST Neuerungen 2020.4

TEST-GUIDE report upload outsourced to save time

Basic approach: Simply outsource ECU-TEST report uploads to TEST-GUIDE so that ECU-TEST can continue testing immediately!

In ECU-TEST uploadThroughResourceAdapter must be configured.

TEST-GUIDE ResourceAdapter takes over.

Done. Time saved.

ECU-TEST Neuerungen 2020.4

Details: https://www.test-guide.info/changelog/#_version_1_84_2_released_2020_09_30

ECU-TEST 2020.3

Integration Smartphone

ECU-TEST News 2020.3 picture #01

  1. Various gestures (tap, swipe) and device interactions
  2. Capturing screenshots as images and video for further analysis
  3. Support for iOS and Android
  4. Platform, device and app settings can be set in TBC
New modules for video analysis – New Numpy trace step templates

ECU-TEST News 2020.3 picture #02

CalculateBrightness

  • Calculation of a brightness signal
  • Mask support

FindImage

  • Calculation of a logical signal ContainsImage
  • Calculation of an object-value signal for API interaction with match objects
  • Mask support

ReportFrameAtStartTrigger

  • Add frames of a video at the start trigger of a parent trigger block to the report
  • Optional input of a frame offset, e.g. to document the frame before the start trigger
  • Optionally highlight the matches found by FindImage or a parameterized mask in the report

Numpy Trace step template ReduceVideo

  • Acceleration of subsequent analysis steps
  • Reduction of resolution
  • Conversion to grayscale video
  • Reduction of the frame rate (downsampling)

New API method FindImageByFeatures

  • Use feature detection to find partial images in the frames of a video
  • Independent of size, rotation, color or perspective

Create masks and reference images easily from videos

Diagnostic Log and Trace

ECU-TEST News 2020.3 picture #03

  1. Make any internal data (e.g. frames) from the ECU available for test case and analysis
  2. Example use case: Logging of the hardware load during the test

ECU-TEST News 2020.3 picture #04

  1. ECU-TEST records in the same *.dlt file format
  2. Single DLT message
  • AUTOSAR standardized interface for logging and tracing of ECUs
  • Support of verbose mode (non-verbose with Fibex already since ECU-TEST 2020.1)
  • Solution incorporating the GENIVI DLT Viewer
Diagnostic Log and Trace (DLT) – Verbose

ECU-TEST News 2020.3 picture #05

  1. Specification in the test configuration gives access via object-value signals
  2. Reuse of the filter files from the DLT viewer
  3. API access to various attributes, such as applicationId or arguments

ECU-TEST News 2020.3 picture #06

  1. Identical data object in the Trace Analysis
  2. Offline analysis of DLT and PCAP recordings
AD/ADAS – Central scenario management and simulation workflow

ECU-TEST News 2020.3 picture #07


ECU-TEST News 2020.3 picture #08

  1. Storage of scenarios and attributes in the TEST-GUIDE artifact management
  2. Filtering and downloading the scenarios in ECU-TEST
  3. Direct simulation in VTD and CarMaker

ECU-TEST News 2020.3 picture #09

  1. Migration help for the switch to the new tool category "Environment Simulation”

Motivation

  • Scenario database + test automation workflow in ECU-TEST
  • Enables methodical development of specific features for environment simulation

Supported Tools

  • VTD
  • CarMaker
New reporting for parameterized stimulation packages

ECU-TEST News 2020.3 picture #10

  1. Generic stimulation, parameters
  2. Analyses to check requirements or calculate KPIs
  3. Independent reports for each run of an analysis package including return values
Virtual Testing and SiL – Native FMI support
  • Simulation and test environment for Functional Mock-up Units (FMU) without further proprietary tool dependency
  • Read, write, record and analyze FMU parameters and signals

ECU-TEST News 2020.3 picture #11

New and updated tools and standards

Diagnostics add-on

UDS-Service $2F "Input/Output Control by Identifier“

  • Services "Return control to ECU", "Reset to default", "Freeze current state" and "Short term adjustment“ can be used as special DIDs
  • Access via job InputOutputControlByIdentifier as well

Further Highlights

  • CANdela Diagnostic Data (*.cdd) can be used as diagnostic description
  • Support for ODX ECU variants

ECU-TEST News 2020.3 picture #12

New and updated tools, standards and formats

New tools

  • Appium
  • FMI

New formats

  • DLT
  • FLAC
  • MTS
  • WAV

New standards

  • CANdela Diagnostic Data (CDD) 6.5 bis 9.1
  • FMI 1.0 und 2.0
  • Probe Logging Protocol (PLP) for Ethernet
  • AUTOSAR DLT verbose Mode

Updated tools

  • dSPACE Release 2020-A
  • ETAS INCA 7.3.1
  • ETAS LABCAR 5.4.10
  • FEP 2.7.1
  • IPG CarMaker 9
  • Lauterbach TRACE32 R.2019.09
  • Softing DTS 9
  • Vector CANape 18SP2
  • Vector CANoe 13
  • VW ODIS 11

Updated standards

  • ASAM XIL STI/STZ 2.1 und 2.2
Usability – Extensions around stimulation

Features:

  • Support of STI files in versions 2.1 and 2.2
  • Segments can easily be converted into a value table
  • Freely placeable cursor

Usability

  • STI and STZ files can be opened directly from the editor
  • Height and width of individual signal panels configurable
  • All signals can be clearly displayed on a common time axis

ECU-TEST News 2020.3 picture #13

  1. Freely placeable cursor to read concrete data points from the signal
  2. Performance improvements
Usability – Work faster and more comfortable with ECU-TEST
  • External Python editor also for UserPyModules
  • Easier signal assignment in plot
  • Configurable signal identifiers in the trace step signal export
  • Performance optimization of the trace analysis, especially with many trigger ranges and large number of time stamps of the used signals

ECU-TEST News 2020.3 picture #14

  1. Move analogous to blocks: Strg + Shift + ↑
  2. Assign multiple analysis packages to another stimulation via drag-and-drop
Outlook 2020.4 – Traceability of ECU-TEST packages

Enables:

  • Search for suitable implementation depending on context (DUT, test environment) using attributes
  • Fast navigation between Packages
  • Better handling of specification changes (Diff)

ECU-TEST News 2020.3 picture #15

Outlook 2020.4 – Distributed test execution for ECU-TEST

ECU-TEST News 2020.3 picture #16

Outlook 2020.4 – Distributed test execution on Linux and Docker

ECU-TEST News 2020.3 picture #17

ECU-TEST 2020.2

Comprehensive support for interactive testing

Name of the calculation step as meaningful information

ECU-TEST Neuerungen 2020.2 Bild #01a

Images can be included in the block test step

ECU-TEST Neuerungen 2020.2 Bild #01b

Easy control of complex structures for service-based access in test cases

ECU-TEST Neuerungen 2020.2 Bild #02

1.) Access to services

  • Reading events
  • Executing methods
  • Read method return values and parameters

2.) Loose coupling to the service description

  • Resolving dependencies at runtime
  • Tolerant handling of type changes
  • Access to substructures
  • Data assignment with default values

3.) Events and methods as mapping variables (local and global)

4.) NumPy-based structure variable incl.

  • NumPy syntax
  • NumPy API
  • Code completion
Request analyses from the test case to ensure completeness and incorporate results
  • Objective: To refer from the test case to analyses that are modularly located in an Analysis Package.
  • Greatest possible flexibility: Linking is based on a user-defined label.
  • Use description to specify new analysis in the requesting test step.
  • Links in the Report enable fast navigation between requesting test step and implemented analysis.
  • Conditional analyses: Test step within IfDef block for handling of different variants

ECU-TEST Neuerungen 2020.2 Bild #02a

  • Select an Analysis Packages implementation for all requested analyses in the project
  • Enable role separation and separate implementation from specification
  • Also in sub Packages: Modular assembly of stimulation and e.g. documentation of contained subcycles for subsequent analyses
  • Replace the analysis implementation without modifying the test case Package.

ECU-TEST Neuerungen 2020.2 Bild #02b

  • 1.) Ensure completeness
  • 2.) Test case with Request analysis
  • 3.) Requested analysis
  • 4.) Configuration fully possible via the Object API
Further improvements in analysis topics

Performance optimizations

  • Processing of stimulus files (*.sti)
  • Further standard templates implemented in NumPy

ECU-TEST Neuerungen 2020.2 Bild #03a

Signal recording improvements

  • Synchronization now only supported here (extensive migration support Help → Migration help → Trace synchronization)
  • Validation of the recording configuration better configurable
  • Improved usability
    • Move/delete according to multiple selections
    • Arrangement of signals and groups

ECU-TEST Neuerungen 2020.2 Bild #03b

Stimulus test step: Dynamic parameterization

Efficient and flexible stimulation of test variables, among others, in Simulink, ControlDesk, CANoe, Generic XIL and more

ECU-TEST Neuerungen 2020.2 Bild #04a
ECU-TEST Neuerungen 2020.2 Bild #04b

FEP: New features for convenient automation
  • For a better error analysis the FEP Incidents are logged via ECU-TEST
  • Support for writing Boolean properties
  • Properties can now be set via property file
  • Properties that represent a node are displayed as leaf nodes and can be written over the model tree
  • In the "Read/Write" step, the "Physical/Text" representations are automatically selected

ECU-TEST Neuerungen 2020.2 Bild #05

New tool adapter: GNU Debugger (GDB)

The generic open source debugger can now be automated with ECU-TEST.

https://www.gnu.org/software/gdb/

Scope of functions

  • Local or remote via SSH
  • For Windows and Linux
  • Jobs to set/query breakpoints
  • Job to query whether system is running or stopping at breakpoint
  • Jobs for stepping (on the same level + step-out)
  • Jobs to query the call stack
New and updated tools and standards

New tools

  • GNU Debugger
  • HMS IXXAT Rest bus simulation

Updated Tools

  • AVL PUMA 1.5 und 2.0 64 Bit
  • dSPACE ModelDesk 2019-B
  • MAGNA Telemotive BluePiraT 4.2.2.24
  • NI VeriStand 2019

Workflows

PTC Integrity: Import of test case attributes to support the test case implementation

Test case import from Integrity to ECU-TEST:

  • Import of test case attributes enabled

Export of results from ECU-TEST to Integrity:

  • Upload of attachments possible
  • Setting the TestSession status after upload

ECU-TEST Neuerungen 2020.2 Bild #6aECU-TEST Neuerungen 2020.2 Bild #6b

Custom Verdicts
  • 1) Interactive test execution allows specific custom verdicts
  • 2) Custom verdicts are automatically transferred to TEST-GUIDE übernommen

ECU-TEST Neuerungen 2020.2 Bild #7

Signal-Viewer integration: AutoSPY with signal context

ECU-TEST Neuerungen 2020.2 Bild #8

  • 1) Complete list of all trace analysis signals grouped by episodes
  • 2) Fast display and hide
  • 3) Initial state determined by selected step of Trace Analysis

ECU-TEST 2020.1

More flexible and simple configuration of signal recordings

New possibilities for signal-recording control

  • New default: simultaneously start recording of all sources in a single test step
  • Also works for newly created recording groups afterwards
  • Automatic signal recordings can now be configured to skip the pre- and postcondition part of a test case

ECU-TEST News 2020.1 picture #01

Automatically record all relevant signals

  • Arbitrary signals (bus/model/…) that are used anywhere in a test case can automatically be added to signal recordings
  • Even signals that are only used within a nested subpackage can be marked for automatic signal recording

ECU-TEST News 2020.1 picture #02

New signal group "Assign automatically“

  • Makes test cases transportable, even if fundamental matters like the source of certain signals change completely
  • Records signals always from the right source, based on the current mapping
  • Signals can be used in trace analysis completely independent of their source

ECU-TEST News 2020.1 picture #03

Infotainment Testing: Better image analysis and text recognition

New image sources

ECU-TEST News 2020.1 picture #04a

Improved image analysis

ECU-TEST News 2020.1 picture #04b

improved text recognition

ECU-TEST News 2020.1 picture #04c

MiL testing with MATLAB® and Simulink®

Convenient integration in Simulink®-context menu

Create ECU-TEST mappings directly from within Simulink via context menu:

  • Block in-ports and out-ports
  • Block and mask parameter
  • Easily select signals (individually or with multi select)

ECU-TEST News 2020.1 picture #05a

High-performance test-suite runs

Run all test cases of a project in a combined run:

  • Test harnes and model configuration is performed for all test cases at once
  • Running multiple test cases without need of recompilation

ECU-TEST News 2020.1 picture #05b

Usability: Create test cases easier and faster

EasyInsert

ECU-TEST News 2020.1 picture #06a

Signal-stimulation test step

ECU-TEST News 2020.1 picture #06b

  • Expand test cases by level of indention
  • Convenient access to all help topics: Search from within ECU-TEST
  • Signal-recording trace step: better usability

    ECU-TEST Neuerungen 2020.1 Bild #06c

New: Support for MotionDesk

ECU-TEST News 2020.1 picture #07

  • Test automation for the dSPACE tool chain through MotionDesk
  • Start and control auf MotionDesk through these test steps:
    • DownloadScene
    • StartAnimation
    • StopAnimation
    • ReadParameter
    • WriteParameter
    • StartSensorSimConnections
    • StopSensorSimConnections
Optimized analysis possibilities with CarMaker

ECU-TEST News 2020.1 picture #08

FEP: Monitoring the system status

ECU-TEST News 2020.1 picture #09

Diagnostic Log and Trace - DLT: Simple recording control and API connection
  • Simple recording control for PCAP
  • Generating DLT tests

ECU-TEST News 2020.1 picture #10

Updated support for tools and standards

New tools

  • dSPACE MotionDesk
  • MORPHEE: integrated via ASAM ACI

Updated tools

  • ControlDesk 2019-B
  • E-SYS 3.35.1
  • FEP SDK 2.4.1
  • IXXAT-RBS: ACT-Release V5
  • OCTANE 12.60.60
  • RT-LAB 2019.3

Standards

  • Ethernet: SOME/IP TP support
  • PassThru SAE J2534-2-2019 and the proprietary GMW17753
  • Many special cases for Classic and Adaptive AUTOSAR
  • Ethernet IPv6 signals in Trace Analysis

Workflows

Recording Analysis in TEST-GUIDE

Gain the best from your test data!

  • Find known bugs or anomalies in existing measured data
  • Execute additional or modified test cases and evaluate already existing measured data
  • Compute statistics, metrics or KPIs based on already existing measured data
  • Increase test coverage and quality step by step without adapting the system or procedure of testing
  • Become faster and more independent by decoupling test execution and evaluation of measured data
  • Reuse suitable data independent of their original purpose or test stage (for example HiL, SiL or vehicle)

ECU-TEST News 2020.1 picture #11

Enhanced AutoSPY-viewer integration
  • Support of as3trace files within the Trace Analysis
  • Usability enhancements (show and hide signals, signal style adjusted, zoom factor, …)
  • 1-click integration of viewer for as3trace in TEST-GUIDE

ECU-TEST News 2020.1 picture #12

Simple generation of a project based on a workspace filter

ECU-TEST News 2020.1 picture #13