Smart Cockpit Test Automation
Cockpit software iterates quickly and interaction forms are diverse, making manual regression costly and hard to keep consistent. With the in-house ZD TAP automated testing platform at its core, ZD uses image recognition, speech recognition and robotic arms to replace manual operation, automating cockpit function, performance and interaction testing.
Challenges Customers Face
For automated testing to truly replace manual work, it must hold up on all three levels: seeing, tapping and hearing.
Regression volume too large to cover with manpower
Cockpit function items keep growing with each version, and every version must be verified again. Purely manual execution consumes person-days and easily produces inconsistent results due to fatigue and subjective judgement.
Too many device and system combinations
Multiple screens, phone-to-head-unit connectivity, native Android, HarmonyOS and iOS coexist, each with different control methods, so test scripts often need separate adaptation for every combination.
Subjective items are hard to quantify objectively
Voice wake-up rate, audio distortion and screen stutter are perceptual metrics; manual judgement lacks consistency and is hard to turn into comparable test data.
Platform Composition and Test Closed Loop
ZD TAP connects downward to benches and devices under test and upward to the test management platform, with ZD Code providing the script development environment in between.
One platform covering everything from test cases to reports
ZD TAP is built on the in-house bus simulation interface card ZD Box 2i, the network conversion interface ZD Converter and the ZD Datalogger bus data logger series, working with in-house software to complete functional, performance and interaction simulation testing of the cockpit system.
The ZD Code integrated development environment combines code writing, analysis, compilation and debugging for test cases, and can call ZD TAP's software and hardware interfaces efficiently; it supports JavaScript and Python syntax, lowering the learning curve for test teams developing scripts.
ZD Test Server is a B/S-architecture test management platform responsible for managing benches, test cases, plans, reports and defects, supporting remote case execution over the web, scheduling of multiple test servers and multi-dimensional statistics views.
Core Capabilities
Breaking human senses and operating actions down into programmatically implementable steps is the key to cockpit automation.
Image and Text Recognition
Screen capture devices and cameras replace human eyes to capture images, image recognition technology judges interface states, and character training models complete text recognition.
Voice and Audio Testing
TTS simulates multiple languages, dialects and voice ranges to issue voice commands; combined with speech recognition and voiceprint recognition, it completes dedicated testing of head-unit audio and voice interaction.
Multiple Control Options
Compatible with robotic arms, Android ADB, bus signals and other control methods, so the right approach can be chosen for each test scenario to operate multiple screens.
Multi-Device and Multi-System Compatibility
Supports native Android, HarmonyOS, Xiaomi and various other Android models as well as the iOS platform, and also automates multiple types of head-unit systems such as Linux and Android.
Signal Simulation and Diagnostics
Supports bus definition files such as DBC and ARXML as signal databases to simulate controller background signals and control signals, and implements ECU closed-loop testing based on the UDS diagnostic protocol.
Data and Media Synchronization
Graphical signal display with synchronized playback of video, audio and bus data; multiple video sources can receive several cockpit and phone screens at the same time for human-machine interaction verification.
Solution Composition
Platform software decides how to test, bench hardware decides where to test, and the two are combined and configured according to project scale.
Capability Scope
← Swipe left or right to view the full content →
| Item | Content | |
|---|---|---|
| Script languages | JavaScript, Python, with script editor and graphical interface support | |
| Signal database | Bus definition files such as DBC and ARXML | |
| Diagnostic protocol | Based on the UDS standard diagnostic protocol, supporting ECU closed-loop testing | |
| Control modes | Multiple control options including robotic arms, Android ADB and bus signals | |
| Video and audio | Supports multiple video sources such as LVDS video capture cards, cameras and USB serial system screenshots; for audio, supports TTS multi-language output plus speech and voiceprint recognition | |
| Management platform | B/S architecture supporting bench, test case, plan, report and defect management, with GitLab / JIRA / Jenkins integration | |
| Bench Form Factor | Mobile test bench, desktop test bench, desktop network test bench, suitcase-style portable test bench | |
Delivery Process and Deliverables
Test Preparation
Break down function items and parse test specifications, completing hardware resource allocation and interface analysis.
Environment Setup
Set up the bench and the software and hardware environment, configuring communication parameters and the test interface.
Test Case Development
Develop black-box, white-box and automated test cases, and establish test suites and execution plans.
Automated execution
Distribute and execute according to plan, covering smoke testing, interface testing and regression testing.
Summary and Accumulation
Produce test reports and BUG tracking records, capturing test know-how and specification manuals.
- Test plan and test cases: delivered according to the customer's template and owned by the customer
- Automated scripts: reusable test scripts and operating instructions
- Test report: output by stage, including execution statistics and an issue list
- Platform deployment: deployment and configuration of ZD TAP and ZD Test Server
- Custom development: report template customization, secondary-development API packaging and statistics dashboard customization
- Training and services: script development training, platform usage training and after-sales support
Our Strengths
01A Complete Closed Loop from Test Cases to Reports
ZD TAP and ZD Test Server cover test case design, script development, execution scheduling, report statistics and defect tracking, so there is no need to stitch a process together from multiple tools.
02Replaces Human Senses and Actions
It replaces not only repetitive clicks but also human eyes and ears through image and speech recognition, and completes physical touch via robotic arms, covering test scenarios closer to real-world use.
03Integration with Third-Party Systems
Supports integration with the customer's existing code version management, defect management and CI/CD systems, improving collaboration between test and R&D teams.
04Benches Combinable on Demand
Offers mobile, desktop, network and portable bench forms; can be delivered as a full cabinet solution or deployed on the customer's existing benches.
FAQ
Which cockpit functions can automated testing cover?
Do we need to write the test scripts ourselves?
What about interfaces that cannot be controlled via ADB or the bus?
Can the test data be connected to our existing platform?
Need to introduce automated testing to your cockpit project?
Tell us the system under test and the functional scope, and we can recommend a platform configuration, bench form and test case coverage.