is our territory and the de facto industry standard
What we are accustomed to from our smartphones, now also shapes our
expectations towards the functionality and user friendliness of other
devices and systems which we utilize in our everyday routines. This also
applies to cars. So, it is hard to accept why we should lower our
standards when it comes to controlling navigation, infotainment and
connected car services in comparison to the operation of a tablet or
smart phone. We have developed a testing procedure in order to benchmark vehicles in the areas of infotainment, navigation, connectivity and user experience. In this process, we are focusing on user experience.
Today we assess the connectivity and user experience of modern vehicles with our new methodology.
Taking vehicle testing to the next level
Our tests clearly indicate a gap between the users‘ expectations and the current status quo. As our testers know the technological potential, they can assess in their reviews how a realistic improvement might look like.
We have more than 20 years of expertise in the automotive industry, based on multiple consulting projects – covering process and quality management, the administration of large-scale projects reaching up to technological and strategic projects. The spectrum spans from consulting over the development of digital services and business models including the selection of suitable technologies reaching all the way to user-centric development with process. The goal is to ensure highest quality standards in technology, digital services and user experience. In doing so, we always take a cross-industry approach, thinking our projects end-to-end. Therefore, our automotive consultants cooperate closely with our telecommunications experts. Our customers work on a variety of issues in the area of connected cars.
We have developed 25 task-related tests, which we have devided into six categories:
- Voice operation
The latter category comprises functions such as breakdown management, digital keys and private car sharing. In addition, we have defined two object-related tests, in order to test and assess the touchpoints InCar HMI as well as OEM apps according to their user experience and presentation.
The assessment of connected services relies on a two-stage testing procedure. First, pre-defined use cases (tasks) are performed independently by the professionals. Then, the holistic usability as well as the visual aesthetics of the connect app and the vehicle‘s HMI are rated (object-oriented testing). In order to prepare themselves for the testing, the experts make themselves familiar with the innovations of the manufacturer-specific connected car services – for example via the manufacturers web page. In the first part of the testing procedure, the experts execute the pre-defined use cases. In order to have a reference value for the assessment of each use case, the professional identify and rate reference systems beforehand. After each use case, the tester answers a so-called After Scenario Questionnaire (ASQ). In the second part of the procedure, the object-oriented test, the expert rates the overall usability and visualization of the connected car app and the vehicle‘s HMI based on the forms UMUX (Usability Metrics for User Experience) and VisAWI-S (Visual Aesthetics of Websites Inventory). The rating of all three questionnaires is based on a seven-stage Likert scale, out of which the average assessment of all four experts is calculated. Next, the UX score for each category is determined from the averages of all the use cases of this category. And finally the overall use case is calculated. It thus represents the average of all tested categories.
- Buzz Topics