1

A Supervised Learning Concept for Reducing
User Interaction in Passenger Cars
Marius Stärk, Damian Backes, Christian Kehl
Institute for Automotive Engineering (ika)
RWTH Aachen University

C

Abstract—In this article an automation system for humanmachine-interfaces (HMI) for setpoint adjustment using supervised learning is presented. We use HMIs of multi-modal
thermal conditioning systems in passenger cars as example
for a complex setpoint selection system. The goal is the
reduction of interaction complexity up to full automation.
The approach is not limited to climate control applications
but can be extended to other setpoint-based HMIs.

I. Introduction
Driver distraction is one of the leading causes of fatal and
non-fatal car accidents today [1][2]. Meanwhile, the amount
and complexity of infotainment products in vehicles increases,
primarily driven by customer demand [3]. Therefore, to reduce
distraction, HMI complexity needs to be decreased despite
increasing complexity. We will further investigate this using
multi-modal thermal conditioning systems (MM-HVAC, multimodal heating ventilation and air conditioning) as an example.
MM-HVAC systems using thermal radiation, thermal conduction and convection can be designed to be highly energy-efficient,
which is especially important for increasing the range of electric
cars [4].
Conventional heating systems require large amounts of energy
and reduce the maximum travel range of electrified vehicles.
Vehicles equipped with combustion engines take this energy from
the waste heat of the engine, which is impossible for electric
vehicles due to their efficiency of converting electric to kinetic
energy and the lower system temperature range. In electric
vehicles, heat pumps and thermal radiators are required [5][6].
An additional benefit of non-convection-based climate systems
is also the reduction of noise as shown in [6] and [7].
Typical HVAC HMIs for convection-based systems have
increase/decrease-buttons or knobs for setting system setpoints
like target temperature [Figure 1, Figure 2, Figure 3]. While
MM-HVAC systems offer great ways for improving conditioning
efficiency and thermal comfort, they have a lot of possible
setpoints (e.g. one for every individual radiator and heat panel)
and this inherent complexity requires more driver interaction
compared to convection-based systems. The result of interfacing
a MM-HVAC system with a typical setpoint-centric HMI is the
driver being unable to take full advantage of the ability of the
system to increase comfort and efficiency but simultaneously
increasing distraction.

B

Fig. 2: The “CLIMAtronic” HVAC HMI for a 2008-2012 Golf VI.,
(A) Cabin and Seat Temperature Setpoint Driver, (B) Cabin and
Seat Temperature Setpoint Passenger, (C) Ventilation Setpoint.

System
Environment
and
Vehicle Interior

Control
Variables
Current
Values

Sensor Data (Interior
Temperature, Exterior
Temperature, etc.)
User Selection

Climate Control
(vehicle-specific)

Setpoints

Fig. 3: Data flow of conventional climate control systems used
in current production vehicles. The user adjusts setpoints for
certain control parameters. The control unit then drives the
thermal actuators to reach the desired state.

To abstract from the complexity of MM-HVAC systems we
propose a self-learning automation system [Figure 4]. It requires
profound knowledge about the driver and his/her individual
perception of thermal comfort. The system acquires this knowledge during operation using supervised online learning. In the
following, we will present the concept using a feed-forward neural
network as internal representation of the automation system
but other machine learning approaches might be reasonable
as well. It can be envisioned as a user-preference estimator
which automatically changes the setpoints of a standard vehicle
HVAC-system. The concept will be presented with respect to
MM-HVAC systems in the following chapter.

System Environment
and
Vehicle Interior
Control Variables

arXiv:1711.04518v1 [cs.SY] 13 Nov 2017

A

Current Values

Sensor Data (Interior
Temperature, Exterior
Temperature, etc.)

Preference Estimation
(user-specific)

User Selection
Manual Setpoint
Climate Control
(vehicle-specific)

Setpoints

Fig. 4: Self-Learning climate control concept. The system from
Figure 3 is here augmented by a machine-learning-based user
preference estimation unit.
A

B

Fig. 1: The “CLIMAtronic” HVAC HMI for a 1999 Volkswagen
Golf IV., (A) Ventilation Setpoint, (B) Cabin Temperature
Setpoint.

II. General Idea and Practical Application in
MM-HVAC System Automation
We define the automation unit as having a varying number of
inputs x̄ providing environment data (e.g. “cabin temperature”,
“cabin humidity”, etc.) and outputs ȳ for every setpoint of a

2

control unit (e.g. “target temperature” is the main setpoint
for a traditional HVAC control unit). In the beginning, the
automation unit is untrained and does not know how to derive
appropriate setpoints ȳ from x̄, the environment data. The
user adjusts them manually according to his/her preferences.
In order to prevent strong setpoint deviation for an untrained
network, a new user can choose from a set of pretrained networks
based on common thermal perception of various user types.
The automation unit then collects momentary snapshots in
intervals of the manually adjusted setpoints ȳ and corresponding
environment data x̄ to grow its training data set. This growing
training data set is used to train the automation unit in the
background using machine learning techniques. If after training a
certain loss threshold for a setpoint ȳ(i) is reached, a proposition
is made to the user to hand over control of that setpoint to the
automation unit. In an ideal scenario, after a certain amount
of training, all setpoints can be automated. The system has
learned the preferences of the user.
Input
layer x̄

Hidden
layers

environment
temperature
environment
humidity
..
.
environment
variable

Update
Training Data
Compute Target
Setpoints
Current target
matches new
target

Automatic Setpoint
Selection enabled
Automatic
Setpoint
Selection

Manual Setpoint
Selection enabled
Manual
Setpoint
Selection

Current target
doesn’t match
new target
Training Data
Acquisition

Train Network
(if applicable)

Set new
Target Setpoints

Output
layer ȳ
target
temperature 1
target
temperature 2
..
.

Fig. 6: Activity diagram showing the setpoint regulation, training
data aquisition and neural network training

target
humidity
target
variable

Fig. 5: Simplfied User Preference Estimator showing possible
input and output values of the neural network
Consider the following example: a user is generally satisfied
with how the automation system works initially. However, he/she
regards the average target temperature as too high. Therefore,
he/she adjusts the target temperature using the HMI manually
to her own preference. The system now trains the internal
parameters that depend on the target temperature output (i.e.
in Figure 5 arrows pointing directly or indirectly over multiple
nodes to the target temperature node) using the user setpoint
as optimal output value. After a while the system has learned
that this user prefers lower temperatures. The user disables
the exposure of the target temperature to the HMI, leaving its
control to the automation system. Figure 6 shows the different
tasks of the training and automation process.
Different machine learning methods might be possible to
realize the automation concept. In the following, we will describe
in more detail the necessary processes for the realization of such
a system using a feed-forward neural net, taking only momentary
environment values into account.

dynamics associated with climate control we expect average
sample rates around 0.1 Hz. This means 360 data points for
one hour of driving.
Some samples should be set aside for validation. The validation data set can be used to assess the quality of the automation
and from this derive suggestions for the user, e.g. suggestions to
change the parameters exposed to the HMI to prevent overfitting
or acquire more training data for other parameters.
Data samples that lie chronologically next to a change of user
settings should be invalidated to avoid ambiguous data, see
Figure 7. We call this the sampling dead time Tdead . A sample
can be added to the training data set as soon as Tdead /2 has
passed. Good values for Tdead have to be detemined empirically.
Regular Training

Dead Time

Regular Training

Tdead

A. Training Data Acquisition
For the MM-HVAC automation, data collection is a tradeoff between variety and quantity of data. Collecting many
data points in rapid succession means that environment data
and user settings will probably not have changed much from
sample to sample, possibly leading to overfitting during training.
A dynamic collection method like "acquire new sample if
environment value changed by X percent" or "acquire new sample
if euclidean distance of sample in parameter space to all other
samples greater X" could prove to be useful. Because of the slow

0

1

2

t

User Interaction

Fig. 7: Data Acquisition - sampling dead time is necessary to
avoid generation of invalid training data due to setpoint changes
by the user.

3

B. Training Process
The continuously growing training data set is used to train
the neural network using backpropagation. This happens during
regular operation of the vehicle. Firstly, to adapt as soon as
possible to changes of user preferences. Secondly, because power
supply cannot be guaranteed when the car is not operated. After
each training phase the resulting network is swapped with the
current one. To avoid race conditions in the involved software
processes, this needs to be synchronized using appropriate
concurrency primitives.
C. Technical Realization

one vehicle. Using the same user profile for multiple users
will lead to unusable training data. To store the data on a
mobile device unique to every user, e.g. a smartphone would
therefore be an optimal solution. This ensures data integrity
and enables portability. A user will be able switch vehicles while
preserving the advantages of a user-adapted climate control
system. Automatic user indentification is possible through
bluetooth connection callbacks. A cloud based solution storing
user specific data on a server might be sufficient as well but it
would very likely compromise a cross-manufacturer usage. If
the system is used without a trained driver model, in case of
a new user or in the abscence of a mobile device, a pretrained
driver model stored on the automation unit is used.

In the following, we will describe our current plans of realizing
this concept as a prototype for further studies.
For the automation unit an additional computer running
Automotive Grade Linux as operating system will be installed in
a test vehicle. The computer will be connected to a touchscreen
display showing the system state and providing the user interface.
Since the goal of this concept is the reduction of user interface
interactions during operation, a lot of effort will be related
to user interface development. The HVAC sample application
shipped with AGL [Figure 9] serves as a design reference and
will be the starting point for the user interface development.
The computer must be able to read data from the sensors and
control the HVAC system using the vehicle bus (e.g. CAN), run
the automation system as well as train it. The installed hardware
doesn’t need to be a high-end computer with GPU, FPGA
or a dedicated AI processor because the automation system
is assumed to be much less complex than systems for highdimensional machine learning problems like object recognition in
images and data sets are going to be relatively small. Therefore,
an embedded device like a Raspberry Pi should be sufficient.

Thermal
Controlller

Sensors

Environmental
Data

ermp ty,
Te midi
t
rge Hu
Ta re,
atu c
.et

Fig. 9: Automotive Grade Linux - Standard HVAC Example
Application [http://docs.automotivelinux.org]

System State
Automation Unit

GUI
Manual
Setpoints

User Preferences
and Settings
Synchronization

Mobile Device

User Input

User Feedback
and Settings

State Display

User

Fig. 8: Data Flow diagramm of the automation unit and relevant
vehicle components
To show that the automation system can be implemented
without major changes to already existing software and hardware
components, standard vehicle thermal controllers, sensors and
actuators are used.
After the automation unit is successfully trained the user
preferences need to be stored to memory for later retrieval. If
the data is stored on the automation unit itself the settings
will be limited to one vehicle and the user must actively select
his or her personal profile when having multiple drivers for

The communication between vehicle computer and the smartphone storing the thermal preference data of the user is realized
through a bluetooth conncection. The user can change system
settings and give feedback via a smartphone app or the installed
touchscreen.
III. Summary and Prospects
We introduced a concept to decrease HMI complexity and
increase energy efficiency and thermal comfort of HVAC systems.
The intended reduction of HMI complexity is realized through
an intelligent user preference estimator anticipating target
setpoints of the vehicle system normally set by the user. The user
preference estimator is based on a feed-forward neural network
which saves user preferences in its internal representation and is
used to compute target setpoints. The neural network is trained
by manual target setpoints selected by the user in the past.
The trained networks and other settings are stored on a mobile
device. Automatic bluetooth interfacing provides a seamless
user experience.

4

While the concept is mostly relevant in the context of electric
vehicles and multi-modal thermal conditioning systems using
MM-HVAC systems, it is adaptable to conventional HVAC
systems and cars with combustion engines as well. Reducing
driver distraction for other vehicle systems e.g. infotainment
systems or cruise control, might be possible too. Adopting the
concept to these domains could lead to significant increases in
driving safety.
References
[1] T. A Dingus et al. The 100-car naturalistic driving study,
Phase II-results of the 100-car field experiment. 2006.
[2] Sheila G Klauer et al. “Distracted driving and risk of road
crashes among novice and experienced drivers”. In: New
England journal of medicine 370.1 (2014), pp. 54–59.
[3] V. Johanning and R. Mildner. “Car IT kompakt”. In:
(2015).
[4] J. Gissing et al. “Kühlsystementwicklung und Wärmemanagement für PlugIn-Hybridfahrzeuge”. In: Forschungsvereinigung Antriebstechnik e.V., Frankfurt, Germany, Final
Rep. FVA 635 (2012).
[5] T. Yuksel and J. J Michalek. “Effects of regional temperature on electric vehicle efficiency, range, and emissions in
the United States”. In: Environmental science & technology
49.6 (2015), pp. 3974–3980.
[6] M. Pingel et al. “Textile Applications for Air-Conditioning
of the Vehicle’s Interior”. In: 24th Aachen Colloquium Automobile and Engine Technology 2015 (2015), pp. 429–441.
[7] T. Lichius et al. “Akustische und thermische Komfortuntersuchung innovativer Heizsysteme”. In: ATZ - Automobiltechnische Zeitschrift (2015), pp. 286–296.

