abstract: The 7th Symposium on Educational Advances in Artificial Intelligence (EAAI'17, co-chaired by Sven Koenig and Eric Eaton) launched the EAAI New and Future AI Educator Program to support the training of early-career university faculty, secondary school faculty, and future educators (PhD candidates or postdocs who intend a career in academia). As part of the program, awardees were asked to address one of the following "blue sky" questions:
  .
  1.  How could/should Artificial Intelligence (AI) courses incorporate ethics into the curriculum?
  .
  2.  How could we teach AI topics at an early undergraduate or a secondary school level?
  .
  3.  AI has the potential for broad impact to numerous disciplines. How could we make AI education more interdisciplinary, specifically to benefit non-engineering fields?
  .
  This paper is a collection of their responses, intended to help motivate discussion around these issues in AI education.
author: Eric Eaton
Univ. of Pennsylvania
firstname.lastname@example.com
Sven Koenig
U. Southern California
email@example.com
Claudia Schulz
Imperial College London
email@example.com
Francesco Maurelli
Jacobs University Bremen
firstname.lastname@example.com
John Lee
Antioch Univ.
firstname.lastname@example.com
Joshua Eckroth
Stetson Univ.
email@example.com
Mark Crowley
Univ. Waterloo
email@example.com
Richard G. Freedman
U. Massachusetts Amherst
email@example.com
Rogelio E. Cardona-Rivera
North Carolina State U.
email@example.com
Tiago Machado
New York Univ.
firstname.lastname@example.com Tom Williams
Tufts Univ.
firstname.lastname@example.com
title: Blue Sky Ideas in Artificial Intelligence Education
  from the EAAI 2017 New and Future AI Educator Program

# Bridging Across Disciplines

**Claudia Schulz** (Imperial College London)

The application of AI methods to problems such as legal decision making, language translation, or gene analysis often requires the cooperation of AI experts and subject specialists, e.g., lawyers, translators, or biologists. Their ability to communicate on a common ground is a crucial factor determining the success of the project. It is thus beneficial if both parties have a basic understanding of the subject as well as of AI methods, even before the start of a project.

Universities provide a unique opportunity to both teach students becoming AI experts some subject knowledge (e.g., biology or law) and ensure that students in non-computing subjects have a basic understanding of AI techniques. A naïve approach for achieving such interdisciplinary learning is that AI students take some first-year subject courses, and subject students some introductory AI courses. Even though this approach is easy to implement, it may not achieve the intended interdisciplinary learning benefits since the courses are not tailored towards students of a different discipline (even first-year courses often provide a detailed introduction to a specific topic instead of surveying a whole field).

We here discuss two approaches based on *peer-learning*, which provide a more beneficial interdisciplinary learning environment. They share the idea that AI and subject students learn together by teaching each other.

In the *seminar-style approach*, AI students give seminars to subject students (and vice versa). These seminars may, for example, provide an overview of AI techniques or review applications of AI methods in subject areas. This approach does not only benefit the attending subject students, who acquire knowledge tailored particularly to them, but also provides valuable experience to the AI student giving the seminar in explaining AI topics to the lay audience. There is clearly a lot of variability concerning the exact setup of these seminars: they can be given by a single PhD student or by a group of undergraduates, and the attendees' background can be a mixture of subjects or a single subject (in which case the seminar will cover topics and examples related to this particular subject).

In contrast to the seminar-style approach, where the speaker teaches the audience, the *project-based approach* promises mutual teaching and learning, both in terms of knowledge and skills. In this setting, an AI student and a subject student work together on a project trying to solve a problem in the subject student's area by applying AI techniques. At the start, the subject student explains subject-specific background to the AI student, whereas the AI student teaches the subject student about possible AI techniques to be used, thus creating a mutual teaching and learning environment. During the project, students will also acquire the invaluable skills of working in an interdisciplinary team. Again, there are different setups for such projects: The problem(s) to be solved can be given by faculty or be the students' own ideas, and the project can be part of a course or an extra-curricular "ideas/start-up lab".

# Student-Centric Discovery

**Francesco Maurelli** (Jacobs University Bremen)

Most approaches in university teaching are based on frontal lectures, sometimes with specific lab activities and specific homeworks. The course is divided in specific modules which are explained sequentially.

I would be interested in analysing the feasibility (and try that with a real course) of a more student-centric approach, inspired by the pedagogical Montessori method (Montessori and George 1964). Although the main focus of the method has always been on children, some of those elements have been incorporated with success in secondary-school and early-undergraduate levels.

Working with an equipped lab is fundamental for this approach. Then I would imagine that each student (or maybe each group of students) could freely decide the direction of the course, based on discovery and on what they are interested in. I have recently started a cooperation with Prof. Federico Gobbo at the University of Amsterdam, to analyse the portability of some key elements of the Montessori method into AI education of young adults (so, the target group of this call).

From one side, I am interested to see how the Montessori method applied at a later age group than usual could help the students in their personal and professional development. I strongly believe that independence and the ability of thinking, reasoning, and making informed choices are key elements of the lives of active and engaged human beings, part of the society. A teaching approach which values independent thinking seems therefore a very interesting and potentially fruitful approach, albeit maybe difficult at times.

From the other side, looking for new engaging methods of teaching AI and robotics might result in students approaching the subject with curiosity and willingness, not just because it is in the study plan. This in turn might result in more people engaged in AI and Robotics, and in more passion towards the subject. It might be perceived not just as one of many lectures, but a feel of "ownership" might push for a deeper understanding of specific subjects rather than usual frontal lectures.

Challenges in this approach would be ensuring that each student (or each group of students) progress and explore the subject within some boundaries. Also, evaluation is a very delicate subject. In the original Montessori approach there is no grading for children, but it is something usually necessary in undergraduate courses. Establishing a fair grading system is something necessary, though it might be hard to compare different approaches and different paths that each student would undertake.

Montessori, M.; and George, A.E. 1964. *The Montessori method.* New York: Schocken Books.

Dohrmann, K.R.; Nishida, T.K.; Gartner, A.; Lipsky, D.K.; and Grimm, K.J. 2007. High school outcomes for students in a public Montessori program. *Journal of Research in Childhood Education* 22(2): 205–217.

# AI in K-12 Education

**John Lee** (Antioch University)

I believe that we are fundamentally overlooking the development of important concepts in K-12 education. Both in non-arithmetic skill building as well as unique perspectives on ourselves.

One of the major over-arching themes in K-12 education is the development of humanity. Early cultures tell us about our society and the origins government. Zoology tells us not only about the animal kingdom, but also what it means to be human. Mathematics teaches us about fundamental truths and beauty. Astronomy teaches us our place in the cosmos and inspires us to reach beyond our own limitations.

AI can also teach us about what it means to be human. It can teach us what humanity looks like when taken to different extremes and thus develop within ourselves a deeper understanding of each other and our differences. It can easily demonstrate the truth and beauty of mathematics and how it can be used to develop models of knowledge and behavior. Each one of these models can then provide us with a unique perspective into our own cognition, psychology and the perspective of our existence.

A solid foundation in mathematics will start with movement, which will flow from real object manipulation to imagination to abstract cognition. This is introduced with early arithmetic. However, there is no similar early introduction of non-arithmetic cognition such as logic, search, iteration (folding), etc... that are vital for all kinds of engineering and programming. Such professions are shown to be deeply imaginative from mentally stepping through a program's execution to predicting the voltage levels across a circuit diagram. Early introduction of agent-based models through games and puzzles could provide this foundation as well as begin to introduce concepts for later exploration such as search, string-replacement-iteration, planning, machine learning, etc.

What this solid foundation of movement and imagination provides is a deeper understanding of and greater passion for mathematics. By the time we get to techniques such as multiple-column multiplication or long division we are beginning to learn procedures. This is what will make or break the love of mathematics. Those that truly learn what is behind the procedure and can see it in their imagination will do well, those that learn to blindly follow the procedure will not.

By the time we get to the upper grades, so much of engineering and sciences are taught procedurally. It is a crucial time to emphasize the importance of true-understanding, but class sizes, time constraints and material creep will make this difficult. How much easier would it be if there is a number of early grades experiences that begin to magically resonate with what is being taught.

I hope to explore the earliest introduction of core AI concepts in a concrete way to develop technical imagination skills, get us to think about how we think and finding new confidences in ourselves as we explore what it means to be human.

# The Role of Ethics in AI Education

**Joshua Eckroth** (Stetson University)

In CS education, and AI education in particular, ethics is too often treated as a side concern, addressed in isolation from more typical topics. We view ethics as a cross-cutting concern that helps inform AI students, researchers, and practitioners how to be good scientists and engineers. Here, we examine five topics that are typically included in an AI curriculum and their respective ethical dimensions.

*(1) Search and planning*:  AI systems that are deployed into real-world settings will be expected to perform accurately and reliably. Consider a search procedure, marketed as "Astar," that does not always find an optimal path due to a non-admissible heuristic. Or consider a planning system that does not account for the "frame problem," makes a wrong assumption about the state of the world, and fails to observe before acting. These examples illustrate unquantified risk resulting from inappropriate algorithmic decisions.

*(2) Knowledge representation (KR) and reasoning*:  A KR schema is a surrogate for real-world entities (Davis, et al. 1993), and rarely attempts to model all of their complexities. For example, discretizing the range of human relationships into friends, married, or "it's complicated" introduces ethical questions about whether and what kind of inferences can be accurately drawn. Yet, high fidelity representations and inferential expediency remain in constant tension.

*(3) Probabilistic reasoning*:  While probabilistic knowledge helps avoid making strict claims when knowledge is insufficient, probabilistic reasoning rarely yields certain inferences. Instead, some kind of decision theory must be consulted, which brings ethical questions about estimating risk and utility.

*(4) Machine learning (ML)*:  Learned models can be difficult to trust due to their complexity. In this sense, interpretable models like decision trees are less risky than less-interpretable models like neural networks. In either case, trust can be enhanced with holdout and cross validation techniques. ML is more than "picking the technique that gives highest accuracy." We should know that the technique is best suited to the task at hand, and be able to justify that decision.

*(5) Robotics*:  Once equipped with actuators, robots enter the ethical dimension. Failing to send a "stop motor" command due to software flaws may result in disastrous consequences. Machine/human control handoff (Klein et al. 2004), sometimes realized as a big red button, is a moment of vulnerability that can be mitigated with better status reporting and situation awareness. These issues go beyond typical robot building challenges.

We have shown that ethics should be addressed throughout the AI curriculum. The need for ethics arises from the need to be sure we are building systems that are appropriate for real-world situations and usable by people who depend on their accurate and reliable functioning.

Davis, R.; Shrobe, H.; and Szolovits, P. 1993. What is a knowledge representation? *AI Magazine* 14(1): 17–33.

Klein, G.; et al. 2004. Ten challenges for making automation a team player in joint human-agent activity. *IEEE Int Sys* 19(6): 91–95.

# AI Education through Real-World Problems

**Mark Crowley** (University of Waterloo)

It is increasingly essential that practitioners of AI and ML focus on building verifiable tools with solution bounds or guaranteed optimality. One of my aims for AI/ML students is to give them the skills to build algorithms and analytical tools for providing verifiable guarantees and quality bounds on classification, prediction, and optimization problems.

The usual approach in a maturing field such as AI/ML would be to establish engineering standards for tools and methodologies that provide verifiable quality bounds and guarantees. Yet, the development of relevant tools are still an emerging research pursuit. Witness the extensive interest in the probability bounded results of Bayesian Optimization, the expanding application of PAC learning algorithms, or the wide usage of Gaussian processes to represent uncertainty and guide efficient sampling.

There is a growing application of AI/ML algorithms to safety critical domains such as automated driving, medical decision making and analysis and financial management. Also critical is the growth of computational sustainability: application of AI/ML methods to natural resource domains, wildlife management, energy management, socioeconomic planning and climate modelling. These domains all involve huge societal investments and impacts. Planning is often over a long horizon so what are acceptable risks and uncertainties in short term problems can expand over time into huge errors which undermine results.

Teaching students about these problems and the tools to address them will have an immediate impact on the world. In AI education we need to develop a new nucleus of an engineering discipline for AI/ML that provides students the framework to navigate the ever-expanding set of computational tools for solving complex problems.

This is an education ethics issue as well. If we are turning out students with the answers to the world's problems, they need to know how to justify those answers in a rigorous way. This is often not the primary focus of AI/ML research or education. Many students who study AI/ML will continue straight on to industry rather than further research, so they will need to know the best algorithms to apply to different classification, prediction, optimization problems. However, to be AI engineers will in a way will require students to know more theory than a fully applied program which teaches use of existing methods. They need to know enough about the underlying probabilistic model, the sample complexity and the relationship of prior, latent, and observed variables in order to understand how reliable the results of their models are. Students also need a strong grounding in classical as well as Bayesian statistics so that they can make the right methodological choices for the given situation and do more than simply showing a histogram or ROC curve for their problem to justify their performance.

So, I feel the future of AI/ML education, especially at the undergraduate and master's level, is increasingly going to be focused on making AI into a true engineering discipline where requirements, guarantees, and design are as critical as reducing raw error rates of a classifier.

# Making AI Concepts More Accessible

**Richard G. Freedman** (Univ. of Massachusetts Amherst)

While it may be unreasonable to expect early undergraduate and secondary school students to code AI algorithms, it is possible for them to visualize and experience these algorithms firsthand. Developing an understanding of AI through these perspectives may even facilitate abstract thinking and problem solving when learning computer science and programming later. Although taught later in the CS curriculum after students are comfortable with computational thinking, many topics in AI can be explained conceptually using only high school mathematics. However, the manner in which these concepts are taught needs to be less traditional.

Based on the average student's present-day lifestyle involving personal mobile devices and almost limitless access to media, most students are used to constantly interacting with others and/or engaging in entertainment. This nearly contradicts the traditional lecture style for presenting material impersonally at the front of the room using chalkboards or slides. Instead, students today are accustomed to short spurts of watching and then lots of time doing, which goes hand-in-hand with some elements of team-based learning. In particular, an instructor should only briefly introduce a topic and related activity. Then, the students may explore the activity in groups in order to experience the concept on their own, interacting with each other to understand what happens. For example, A\* search can be performed with a map and deck of cards; each card covers a city and students write the ruler distance (Euclidean heuristic) on each card as it is added to the frontier. The visited cities' cards are stacked in a deck to visualize the visited sequence.

By focusing on the algorithms' processes rather than the specific implementation, younger students without computational experience, higher-level mathematics, and programming skills can participate. The early focus of AI was to emulate human intelligence, and these students can relate to that by wondering, "how would I solve this problem?" These are questions they can discuss with each other and the instructor while performing the activities. In particular, the instructor can now make her time with students more personal by visiting groups to discuss and give tips based on their progress. Groups can also interact with each other afterwards to compare results.

Just as important as the interaction in the classroom, time outside of class can be vital to learning. Besides homework assignments that review concepts, students spend time on the internet watching videos and listening to music. Educational content can be provided in such entertaining forms. Alongside the classic television series *Bill Nye the Science Guy*, on-line streaming services such as YouTube have channels devoted to fun, short videos teaching mathematics (Vihart) and science (Veritasium, VSauce). While such a channel does not seem to exist for AI outside of Michael Littman's music videos, it is possible to present real-world examples and perform the activities above to create one. Then younger students are exposed to AI topics at any time in formats that they are more ready to digest, using high school-level knowledge without focusing on the code.

# Rethinking the AI Ethics Education Context

**Rogelio E. Cardona-Rivera** (North Carolina State U.)

Ethics, the moral principles that govern a person's or group's behavior, cannot be incorporated into a curriculum around AI without a systematic revision of the surrounding context within which AI takes place. We must go beyond just talking about ethics in the classroom; we need to put ethics into practice. I offer three recommendations for doing so, drawn from how ethics are treated within engineering and the social sciences.

Firstly, the Association for the Advancement of AI (AAAI) should institute an association-wide code of ethics. This recommendation is inspired by ethics codes in engineering, which include concern for the public good as a constituent part. For instance, the code of ethics of the National Society of Professional Engineers (2007) contains seven fundamental canons, the first of which is: "Engineers, in the fulfillment of their professional duties, shall hold paramount the safety, health and welfare of the public." An association-wide code of ethics would formally recognize our impact in and the responsibility that we owe to our society.

Secondly, research funding applications that deal with AI should be required to assess risks to society. This recommendation is inspired by similar requirements by Institutional Review Boards (IRB) within the social sciences (e.g., U.S. Dept. of Health and Human Services 2009). Whenever researchers conduct studies that deal with human participants, they are asked by an IRB to assess sources of potential risk; AI research applications should do the same. Importantly, these risk assessments should consider threats beyond immediate physical harm; e.g., the development of new analytical tools for understanding large amounts of data may inadvertently make it easier to reconstruct personally identifiable information, which constitutes a threat to anonymity, and which may disadvantage vulnerable populations.

Thirdly, students in AI project-based courses should be required, as part of the class' deliverables, to submit documents that assess the impact to society (in the context of the proposed AAAI code of ethics, and which should include an IRB-like risk assessment). Ideally, AAAI would serve as a facilitator of this kind of assessment, by providing a library of case studies and expert testimonies that can guide students in examining the broader implications of their work.

Incorporating ethics into a curriculum is more than a one-shot affair. It requires a systematic revision of the surrounding context within which AI exists, in terms of how we talk about it (first recommendation), how we fund efforts in it (second recommendation), and how it is put into practice (third recommendation). By leveraging existing models on ethics from engineering and the social sciences, we will be better equipped to offer concrete recommendations to ensure that ethics aren't an afterthought, but are integral to the development of AI.

National Society of Professional Engineers. 2007. *Code of ethics for engineers*. Technical Report 1102.

U.S. Department of Health and Human Services. 2009. 45 CFR 46.111: *Criteria for IRB approval of research*. Technical report.

# Lifelong Kindergarten for AI

**Tiago Machado** (New York University)

To meet the expectations of young generations (who are highly exposed to games and other virtual interactions) regarding an introductory AI course, our purpose is to design a course based on the principles of the Lifelong Kindergarten (LK) (Resnick, M. 2007) and the Zone of Proximal Development (ZPD) as fields for dialogue (Meira and Lerman. 2001). From the former, we follow the principles of imagine, create, share and reflect. From the latter, we follow the idea of using it as a way to improve class communication with and among students.

We plan to create a 12-week course (2-hour class) in a level suitable for secondary school students with previous experience in programming languages. As video games are an attractive media to our audience, the course will use the General Video Game Framework (GVG-AI) (Perez-Liebana et al. 2016), which allows developers to implement algorithms to play famous arcade games. The course will have three stages: 1) Introduction to the GVG-AI, 2) Search Algorithms and 3) Supervised Learning Algorithms.

The first stage (Introduction to GVG-AI) explains how to work with the framework. It guides the students through a set of simple examples, followed by simple assignments, like creating an agent that plays the games by choosing random actions. The second and the third stages present the same structure: in the first week, the instructor explains the algorithms. Afterward, the students will have three weeks to implement the algorithm assigned to their group plus a class presentation. During these weeks the course will work in a blending class format. The students will have total access to videos, books, software, and the instructor to study and learn how to implement the algorithms in the GVG-AI framework.

It will be required that the presentation should not be a traditional one (i.e., students presenting slides and speaking about what they did). Fun and play with the content should be encouraged. As well as taking extra care about actually teaching to others how they can obtain the same results.

This way the students will be more active by imagining and creating their solutions. During the presentations, we will exercise more the share and reflect principles of the LK. The students will be encouraged to ask questions and share (all the resources they used to learn and implement, including the resulting code) their solutions with the class.

Throughout the course, instructors should be aware of students' progress. They should create social network or email channels to connect with students both in- and outside class. In this way we exercise, in both physical and virtual situations, the ZPD function of an intersubjective space via activities in which participants teach and learn from each other.

Meira, L.; and Lerman, S. 2001. *The zone of proximal development as a symbolic space.* South Bank University.

Perez-Liebana, D.; et al. 2016. The 2014 general video game playing competition. *IEEE Trans. Comp. Intel. and AI in Games* 8(3).

Resnick, M. 2007. All I really need to know (about creative thinking) I learned (by studying how children learn) in kindergarten. *ACM SIGCHI Conf. on Creativity & Cognition* (C&C '07).

# Training Students in AI Ethics

**Tom Williams** (Tufts University)

After completing a course in AI, it is generally assumed that a student will be able to (1) characterize the task environment of a new problem, including the performance measure which should be optimized in that environment, and (2) identify the design tradeoffs between different algorithms for solving that problem. Unfortunately, students are rarely taught to consider the ethical facets of task environments that should be taken into account when deciding on performance measures and considering design tradeoffs, leading to blind spots for ethical failures in algorithm design.

In order to remove this blind spot, I believe that educators should strive to achieve the following learning objective: Students should be able to identify circumstances in which a tradeoff must be made with respect to task performance and ethical performance (especially with an eye towards verifiability), and be able to argue why a particular choice of algorithm strikes an appropriate balance between task performance and ethical performance.

One way to fulfill this objective could be to train students to evaluate proposed AI solutions by asking the following:

*Consequentialism:*   (1) Is it possible that a decision made within this problem domain could harm another agent? (2) If so, can you guarantee that the proposed approach will find the solution that does the least harm (or harm below some justifiable threshold)? (3) If the answer to 2 is no, is there any other known AI solution for which the answer is yes? (4) If the answer to 3 is yes, what is the justification for the use of the proposed algorithm? If the answer to 3 is no, what is the justification for solving this problem computationally?

*Deontology:*   (1) Is it possible that a decision made within this problem domain could violate a legal statute or moral norm? (2) If so, can you guarantee that the proposed approach will find a solution that results in the fewest rule violations (or violations below some justifiable threshold)?  Same as above.

*Virtue Ethics:*   (1) Is it possible that a decision made within this problem domain could be legal, and avoid explicit harm, yet fail to align with human virtues? (2) If so, can you guarantee that the proposed approach will find a solution that results in optimally virtuous behavior (or achieves a level of virtue that is above some justifiable threshold)?  Same as above.

The purpose of using this framework is to force students to "think like an ethicist" when designing or choosing between AI solutions: even though ethical concerns often present moral dilemmas to which there is no single obviously correct solution, students should get used to analyzing proposed solutions in order to identify possible ethical problems, identify what types of AI solutions make it difficult to verify or quantify ethical performance, and convincingly argue for or against a potential solution on ethical grounds.

# Acknowledgements

The EAAI'17 New and Future AI Educator Program is partly supported by NSF Grant \#1650295 and funding from the Artificial Intelligence Journal.


abstract: In the clinical routine, short axis (SA) cine cardiac MR (CMR) image stacks are acquired during multiple subsequent breath-holds. If the patient cannot consistently hold the breath at the same position, the acquired image stack will be affected by inter-slice respiratory motion and will not correctly represent the cardiac volume, introducing potential errors in the following analyses and visualisations. We propose an approach to automatically correct inter-slice respiratory motion in SA CMR image stacks. Our approach makes use of probabilistic segmentation maps (PSMs) of the left ventricular (LV) cavity generated with decision forests. PSMs are generated for each slice of the SA stack and rigidly registered in-plane to a target PSM. If long axis (LA) images are available, PSMs are generated for them and combined to create the target PSM; if not, the target PSM is produced from the same stack using a 3D model trained from motion-free stacks. The proposed approach was tested on a dataset of SA stacks acquired from 24 healthy subjects (for which anatomical 3D cardiac images were also available as reference) and compared to two techniques which use LA intensity images and LA segmentations as targets, respectively. The results show the accuracy and robustness of the proposed approach in motion compensation.
author: Giacomo Tarroni; Ozan Oktay; Matthew Sinclair; Wenjia Bai; Andreas Schuh; Hideaki Suzuki; Antonio de Marvao; Declan O'Regan; Stuart Cook; Daniel Rueckert
bibliography: bibliography.bib
title: A Comprehensive Approach for Learning-based Fully-Automated Inter-slice Motion Correction for Short-Axis Cine Cardiac MR Image Stacks

# Introduction

Cardiovascular magnetic resonance (CMR) imaging is the reference technique regarding several applications for the anatomical and functional assessment of the heart . While fast SSFP sequences allow the direct acquisition of an anatomical 3D image (A3D) of the whole heart, they are usually limited by either relatively poor image quality or low temporal resolution, making them often unsuitable for accurate functional assessment. The most common CMR sequence currently used in the clinical practice is still the short axis (SA) SSFP cine, consisting of 10-14 parallel slices and 20-30 frames per cardiac cycle. SA cine stacks are generated during multiple breath-holds (i.e. 1-3 slices acquired per each breath-hold). Although the subjects are instructed to hold their breath at the same breath-hold position, in practice the heart location can vary considerably. If the differences between the breath-hold positions are large, the acquired image stack will be affected by inter-slice motion and not correctly represent the cardiac volume, introducing potential errors in the following analyses and visualisations.

**Related Work.** Several approaches for SA stack motion correction (MC) have been proposed in the literature. Among the techniques that make use of routinely acquired CMR images, Lotjonen et al. proposed to perform in-plane rigid registration of each SA slice to LA images, used as target. Sinclair et al. implemented a similar approach using LV segmentations (obtained using a fully-convolutional neural network, FCN) instead of the actual images. A very similar technique was also developed by Yang et al. , which also included a shape model to better retrieve the actual motion of the myocardium throughout the cardiac cycle. An alternative approach, which has the advantage of being applicable even if LA images are not available, consists in implicitly incorporating correct representations of the heart into a model trained from motion-free stacks, and in using it to perform motion correction. For instance, Oktay et al. proposed to associate each SA slice with a set of probabilistic edge maps (PEMs) outlining the myocardial contours in the same slice as well as in the adjacent one, and to then perform rigid registration between the obtained PEMs.

**Contributions.** In this paper, we propose a comprehensive approach to automatically correct inter-slice respiratory motion in SA CMR image stacks. Our approach makes use of probabilistic segmentation maps (PSMs) of the left ventricular (LV) cavity generated with hybrid decision forests. PSMs are generated for each slice of the SA stack and rigidly registered in-plane to a target PSM. The main contributions of the paper are the following:

-   The proposed approach includes two different techniques: if LA images are available, PSMs are generated from them and combined to create the target PSM. If not, the target PSM is produced from the same stack using a 3D model trained from motion-free stacks;

-   If LA images are available, the hybrid forests estimate from them at once both PSMs and landmarks locations for the apex and the mitral valve, which are used to restrict motion correction to the slices of the SA stack between them, thus limiting potential spurious results especially in the basal region;

-   The proposed approach was tested on a dataset acquired from 24 healthy subjects (for which anatomical 3D cardiac images were also available as reference) and compared to two techniques which use LA intensity images and LA segmentations (generated using FCNs) as targets, respectively. Testing was also performed after training the techniques on a different dataset to assess their generalisation properties.

# Methods

**Hybrid Decision Forests.** A decision tree consists in the combination of split and leaf nodes arranged in a tree-like structure . Decision trees route a sample $\bm{x} \in \mathcal{X}$ (in our case an image patch) by recursively branching left or right at each split node $j$ until a leaf node $k$ is reached. Each leaf node is associated with a posterior distribution $p(y|\bm{x})$ for the output variable $y \in \mathcal{Y}$. Each split node $j$ is associated with a binary split function $h(\bm{x},\bm{\theta}_j) \in \{0,1\}$, defined by the set of parameters $\bm{\theta}_j$. During training, at each node the goal is to find the set of parameters $\bm{\theta}_j$ which maximizes a previously defined *information gain* $I_j$, that is usually defined as $I_j = H(S_j) - \sum_{i \in \{0,1\}} \nicefrac{|S_j^i|}{|S_j|}\cdot H(S_j^i)$, where $S_j$, $S_j^0$ and $S_j^1$ are respectively the training set arriving at node $j$, leaving the node to the left and to the right. $H(S)$ is the entropy of the training set, whose construction depends on the task at hand (e.g. classification, regression). Different types of nodes (maximizing different information gains) can be interleaved within a single tree structure, thus called hybrid. In the present technique structured classification nodes (aiming at the generation of a PSM of the LV cavity) and regression nodes (aiming at landmark localisation) are combined . During testing, the posterior distributions of the different trees are combined using an ensemble model.

Structured classification nodes associate to each image patch $\bm{x}$ a label $\bm{y} \in \mathcal{Y}$ consisting of a segmentation of the LV cavity within $\bm{x}$. Structured labels at each split node can be clustered into two subgroups depending on some similarity measure between them following a two-step procedure . First, $\mathcal{Y}$ is mapped to an intermediate space $\mathcal{Z}$ by means of the function $\Pi: \mathcal{Y} \rightarrow \mathcal{Z}$ where the distance between labels can be computed. Then, PCA is applied to the vectors $\bm{z}$ to map the associated labels $\bm{y}$ into a binary set of labels $c \in \mathcal{C}$ $= \{0,1\}$: this is achieved by applying a binary quantization to the principal component of each $\bm{z}$ vector. Finally, the Shannon entropy $H_{SC}(S) = - \sum_{c \in \mathcal{C}} p(c)log\big(p(c)\big)$ can be adopted, with $p(c)$ indicating the empirical distribution extracted from training set at the each node. Differently from , in which edge maps were generated, to estimate segmentation maps we adopted the mapping $$\Pi: \bm{z} = [\bm{y}(j_1)=\bm{y}(j_2)=0] \oplus [\bm{y}(j_1)=\bm{y}(j_2)=1] \qquad \forall j_1 \neq j_2,
\label{eq_discretize_psm}$$

where $j_1$ and $j_2$ are indices spanning every pixel in $\bm{y}$. This mapping encodes for each pair of pixels in $\bm{y}$ whether they are both equal to 0 and whether they are both equal to 1, allowing the correct clustering of the labels at each node based on their similarity. At testing time, each sample patch of the test image is sent down each tree of the forest, and the segmentation maps stored at each selected leaf node are averaged producing a smooth segmentation map (PSM) of the LV cavity. The values in the PSM are proportional to the certainty in LV cavity detection, and can be used to assess the reliability of the prediction.

Regression nodes associate to each image patch $\bm{x}$ a label $\mathcal{D} = (\bm{d}^1, \bm{d}^2, \dotsc, \bm{d}^L)$, where $\bm{d}^l$ represents for each of the $L$ landmarks (LMs) the $N$-dimensional displacement vector from the patch centre to the landmark location . The information gain used for regression nodes minimizes the determinant of the full covariance matrix $|\Lambda(S)|$ defined by the landmark displacement vectors: $H_{R}(S) = \frac{1}{2} log\big((2\pi e)^d|\Lambda(S)|$. The regression information is stored at each leaf node $k$ using a parametric model following a $N\cdot L$-dimensional multivariate normal distribution with $\overline{\bm{d}_k^l}$ and $\Sigma_k^l$ mean and covariance matrices, respectively. At testing time, for each landmark, Hough vote maps are generated by summing up the regression posterior distributions obtained from each tree for each patch . Finally, the locations of the landmarks are determined by identifying the pixel with the highest value on each of the $L$ Hough vote maps.

For training, the extracted features are multi-resolution image intensity, histogram of gradients (HoG) and gradient magnitude, exactly as in . The described hybrid random forest approach is used to build several models: three for LA images (extracting at once PSMs and landmarks for the apex and the mitral valve) and two for the SA stacks (extracting 2D and 3D PSMs, respectively). These models are then used to perform motion correction with two different possible pipelines, depending on the availability of LA images.

**Motion Correction with LA PSMs (MC LA PSMs).** This method relies on 2D SA PSMs generated from the motion-corrupted stack and on LA PSMs (together with landmarks), which are used as target (see Fig. ). First, LA PSMs are rigidly registered (by 3D translation only, using normalized cross-correlation, NCC, as similarity metric) to the SA PSM stack to compensate for potential motion between different acquisitions. Then, for each slice of the SA PSM stack, the three registered LA PSMs are resampled and combined into a single image (referred to as LA PSM combined) containing the sections of the LA PSMs with respect to a specific slice. Finally, in-plane rigid registration (by translation only, using NCC) is performed between each SA PSM slice and the associated LA PSM combined, and the estimated translation is applied to the SA slice, thus performing the correction. These two steps (LA PSMs registration to the SA PSMs stack, and slice-by-slice SA PSMs registration to LA PSMs combined) are iterated until the maximum translation estimated within the stack is less than two pixels, which usually happens within the first 4 iterations. While this iterative registration scheme is similar to previously published ones , a major novelty is that not all the slices of the SA stack actually undergo motion correction: a slice is corrected only if a) its peak PSM value is above a threshold $T_m$ and b) it lies between the median apex and median mitral valve points (defined as medians of the landmark sets identified on the LA images). This allows the exclusion of slices outside the LV or with unreliable LV cavity detection.

**Motion Correction with 3D SA PSMs (MC 3D PSMs).** This method relies only on the information extracted from the motion-corrupted SA stack: 2D SA PSMs and a 3D SA PSM, which is used as target (see Fig. ). While the models presented so far are trained using 2D patches $\bm{x}$ and labels $\bm{y}$, the 3D SA PSM one is trained using 3D patches encompassing 5 slices in the z direction. Training is performed on a set of high-resolution A3D images (inherently motion-free) with accompanying 3D segmentations, setting the patch thickness equal to that of 5 SA slices combined. This forces the model to learn representations of motion-free stacks. At testing, the model is applied to the SA stack (after an up-sampling step in the z direction to mimic the resolution of A3D images), generating a virtually motion-free 3D PSM which are used as a target for slice-by-slice in-plane registration (by translation only) of the 2D PSMs. The estimated translations are applied to the SA slices, thus performing the correction.

# Experiments and Results

**Image Acquisition.** Two distinct CMR image datasets (obtained with different scanners, cardiac array coils and acquisition parameters) were used to test the proposed approach. The first dataset consists of 350 full CMR scans (including also A3D images) of healthy subjects, while the second one consists of 500 scans from the UK Biobank[^1]. Only end-diastolic frames were considered.

**Performance Evaluation.** Both datasets were annotated (either manually or automatically with subsequent manual corrections) to provide LV cavity segmentations for SA stacks, LA and A3D images as well as landmarks positions for the LA images alone. Two experiments were devised. For experiment A, 24 scans from the first dataset were extracted based on presence of visually-detected inter-slice motion and used as testing, while training was performed on the remaining scans of the same dataset. For this experiment, the proposed approach (with its two methods) was tested against an intensity-based technique (MC LA Int.) which iteratively registers SA slices to LA images (using normalized mutual information as similarity metric), essentially as in . For experiment B, testing was performed on the same 24 scans of experiment A, but training was performed on the whole second dataset. In this case, the proposed approach (using only MC LA PSMs) was tested against a technique (MC LA SEGs) which iteratively registers SA "hard" segmentations to LA segmentations generated with FCNs (trained on images randomly extracted from the same database), essentially as in . To compare the accuracy of the implemented techniques, in both experiments the corrective translations estimated for each slice were applied to the provided SA segmentations. Then, the segmentation of the A3D images, considered as reference, were rigidly registered to the initial SA segmentation stack as well as to the those produced by each technique. Slice-by-slice in-plane registration was performed between reference and initial segmentation stack to identify motion corrupted slices, and those with more than 3 mm of misalignment were selected, for a total of 74. The evaluation of the accuracy of the implemented techniques was performed on these slices computing mean absolute distances (MAD), Hausdorff distances (HD) and Dice coefficients (DSC) between the LV cavity reference contours and before or after motion correction. The average slice-by-slice relative improvements for each of these metrics were also computed, as well as the percentage of improved values (where 100% would ideally mean that all of the corrupted slices improved their alignment). Of note, in experiment B, the testing set underwent histogram normalisation to match the intensity distributions of the training set.

**Implementation Details.** For training, standard data augmentation was implemented (random rescaling following a normal distribution with mean 1 and std 0.1, random rotation following a normal distribution with mean 0and std 30). Image patch size was 48$\times$`<!-- -->`{=html}48 px for LA models and 32$\times$`<!-- -->`{=html}32 px for SA ones, segmentation label size 16$\times$`<!-- -->`{=html}16 px, number of samples 4$\cdot10^6$, number of trees 8. Finally, the threshold $T_m$ was set to 0.4 (on a scale from 0 to 1).

|  |  |  |  |  |  |  |  |
|---:|:--:|:--:|:--:|:--:|:--:|:--:|:--:|
| **Motion Correction** | **MAD** |  | **HD** |  | **DSC** |  | **Ratio of** |
|  | Mean | Mean | Mean | Mean | Mean | Mean | **improved** |
|  | \(mm\) | Impr. | \(mm\) | Impr. | (a.u.) | Impr. | **slices** |
| **Experiment A** |  |  |  |  |  |  |  |
| None | 3.1 |  | 6.9 |  | 0.83 |  |  |
| MC LA Int. | 2.7 | 14% | 6.2 | 12% | 0.85 | 2% | 77% |
| MC 3D PSMs | 2.6 | 19% | 6.0 | 15% | 0.86 | 2% | 80% |
| MC LA PSMs | **1.9** | **38%** | **4.9** | **29%** | **0.89** | **7%** | **92%** |
| **Experiment B** |  |  |  |  |  |  |  |
| MC LA SEGs | 2.3 | 23% | 5.7 | 16% | 0.88 | **7%** | 88% |
| MC LA PSMs | **2.1** | **33%** | **5.2** | **26%** | **0.89** | 6% | **91%** |

Error metrics for experiments A (top) and experiment B (bottom). The proposed techniques are underlined.

**Results.** Approximate time to perform motion correction of one SA stack on a 6-core CPU is 25s for MC 3D PSMs and 36s for MC LA PSMs. The results for both experiment A and B are reported in Table and displayed for two cases in Fig. . Experiment A assesses the accuracy of the proposed approach in the scenario of training and testing performed in the same dataset. The results show that the the intensity-based method performs worse than the others, and that MC 3D PSMs obtains lower errors even without using LA images. MC LA PSMs is clearly the best method within this batch and is able to improve most (92%) of the motion-corrupted slices. The fact that this method outperforms MC 3D PSMs was expected: while MC 3D PSMs can produce a smoothly aligned stack, more robustly than an intensity-based approach, it does not have any strong target for the realignment and relies only on the implicit model for the LV shape learned from the training set. Experiment B evaluates the accuracy of MC LA PSMs against a state-of-the-art approach like MC LA SEGs in a realistic scenario where motion correction has to be performed on a dataset completely different from the one used for training. Remarkably, MC LA PSMs produces results very similar to the ones obtained when trained on the same dataset. As expected given the similitudes between the two techniques, MC LA SEGs and MC LA PSMs perform similarly (no statistically significant differences were highlighted using a paired t-test). However, MC LA PSMs produces better mean results due to a higher robustness in the basal slices (see Fig. , right side): in fact, hard segmentation techniques have no safety mechanism to refrain from aligning slices in the basal region (usually beyond the actual basal slice) for which the FCN has produced spurious segmentations. On the contrary, the proposed approach has two: the check on the peak probability of the PSM and the comparison with the identified landmarks. As a result, the obtained motion correction tends to be more robust to this effect (see again Fig. , right side).

# Conclusion

A comprehensive approach for fully-automated inter-slice motion correction for SA stacks has been presented. This approach relies on the generation of probabilistic segmentation maps of the LV cavity to drive slice-by-slice in-plane registration. It is able to handle cases in which no LA images are provided with a higher accuracy than common intensity-based methods that exploit them. When LA images are instead available, the proposed approach achieves results on par with methods based on hard segmentations while producing fewer outliers thanks to the simultaneous identification of landmarks to constrain the correction.

### Acknowledgments.

This research has been conducted using the UK Biobank Resource under Application Number 18545. The first author benefited from a Marie Sklodowska-Curie Fellowship.

[^1]: http://www.ukbiobank.ac.uk/.


abstract: With the high frequency of highway accidents, studying how to use connected automated vehicle (CAV) to improve traffic efficiency and safety will become an important issue. In order to investigate how CAV can use the connected information for decision making, this study proposed a natural lane changing decision model for CAV to adapt the mixed traffic flow based on extreme value theory. Firstly, on the bias of the mixed vehicle behavior analysis, the acceleration, deceleration, and randomization rules of the cellular automata model of mixed traffic flow in two lanes are developed. Secondly,the maximum value of CAV's lane change probability at each distance by extreme value distribution are modeled. Finally, a numerical simulation is conducted to analyze the trajectory-velocity diagram of mixed traffic flow, average travel time and average speed under different penetration rates of CAV. The result shows that our model can avoid the traffic risk well and significantly improve traffic efficiency and safety.
author:
;
;
;
title: A Natural Lane Changing Decision Model For Mixed Traffic Flow Based On Extreme Value Theory
  [^1]

# INTRODUCTION

## Overview

The last decade has witnessed the evolution and advanced of new technologies for Intelligent Transportation Systems (ITS). The most technologies are deployed as part of Information Technologies systems aiming to improve road safety, driver comfort, transport efficiency and conduct to refinements in secondary effects at environmental level as well as in energy management. Among them The emergence of connected and automated vehicle (CAV) has given a unique opportunity to improve mobility through vehicle-to-vehicle (V2V) and vehicle to-infrastructure (V2I) communications. CAV can collect environmental information about local traffic, weather and infrastructure using different technologies such as cameras, lasers, sensors, radar, etc. The collected information is then shared between the individual groups of vehicles through V2V or V2I communications to facilitate efficient driving. On the other hand, the same collected data may be processed by roadside units(RSU) and communicated to different CAV either directly or via a public network to improve traffic management. However, relevant reports show that the penetration rate of CAV on the road can only reach $24.8\%$ in 2045, indicating that with the current high utilization of human-driven vehicles (HDV), CAV and HDV will coexist on the road in the long term, and the future traffic flow will be randomly mixed, which is also called mixed traffic environment. This gives rise to a significant challenge for avoiding accidents of CAV in a limited length of highway. When risky situations such as accidents, weather and road conditions or specific events occur. Messages of this nature about them will be broadcast towards CAV currently using a road network about emerging situations that could have potential impact on the traffic condition. The information is propagated upstream from the location of a specific situation (accident, work zones, slippery road, adverse weather conditions, etc.) with the support of technology infrastructure.

Our paper proposes a natural lane changing decision model for CAV to adapt the mixed traffic flow based on extreme value theory. Specifically, the motion decisions of the CAV act as constraints and guidance to the other CAV and HDV. It will increase the average speed as to avoid traffic jam, and decrease the average time and distance in the risk zone. And there is a growing interest in the application of extreme value theory(EVT) in the recent literature. It provides a single dimension to identify crashes that can well fit in the hierarchy of safety pyramid. Due to this unique feature of EVT, this study adopts EVT to establishing mandatory lane-changing and speed guidance process for CAV, which is called 'natural'.

## Related Works

A review of literature indicate that mixed traffic flow modeling can be classified into numerical simulation-based studies and cellular automata-based studies. This section covers some representative studies related to cellular automata-based studies in the ensuing paragraphs.

As an important tool of microscopic traffic flow simulation, cellular automata (CA) can simulate complex traffic phenomena based on some simple rules. Nagel and Schrekenberg proposed the classic NS model. With the development of CAV technology and the high efficiency of CA model in computer operations. In addition, as alluded above, the popularization of CAV will take a long time, so the impact of it can only be analyzed through simulation. Some scholars have gradually studied the mixed traffic flow based on CA in the intelligent transportation system. These studies involve traffic flow characteristics (including single-lane and multi-lane), intersection traffic control, traffic safety issues, and public transportation.

On the issue of traffic efficiency. For example, Zhao et al respectively proposed the CE-NS model and the CI-NS model. The CI-NS model considered the communication between CAV. The results showed that CAV can significantly optimize the traffic flow at intersections only when the number of CAV exceeds a certain percentage;Jiang et al proposes a cellular automata model of mixed traffic flow considering the driving behavior of the platoon of CAV. The penetration rate of CAV and the maximum platoon size increase can improve the road capacity.

On the issue of traffic safety. For example, Chain and Wong compared CA and surrogate safety assessment models (SSAM) in terms of safety assessment. They showed that CA model can replicate realistic conflicts at signalized intersection. Marzoug et al propose a two-lane cellular automata model that explains the relationship between traffic-related parameters and likelihood of accidents at a signalized intersection. The model results illustrated that the traffic at the intersection is more dangerous adopting asymmetric lane-changing rules than symmetric ones.

The contribution of this study is twofold. In Fig.1.First, by modeling and simulation of traffic accidents at highway using cellular automata, this study explains how Impact of traffic accidents on the upstream of the road varies in a mixed traffic environment as a function of time and different CAV penetration rate. Second, as one of the first studies on the application of Extreme Value Theory for decision-making of CAV in a mixed traffic environment, this study provides valuable insights into traffic risk when accidents for a connected environment are occured which can better guide mixed traffic flow, thus reducing the severity of traffic congestion caused by traffic accidents. Such findings will help us to better understand the impact of a mixed traffic environment on diverse vehicles and suggest natural decision for a group of CAV who facing traffic risks.

# METHODOLOGY

## Cellular automaton model of mixed traffic flow

The CA model can simulate complex traffic phenomena based on some simple rules. For the characteristics of the mixed traffic which mainly contains HDV and CAV, corresponding rules are developed respectively. Finally, the CA model of mixed traffic flow is obtained. To distinguish different car-following and lane-changing modes, let ${{\alpha }_{n}}$ and ${{\beta }_{n}}$ are $0-1$ variable used to judge whether the type of the vehicle n is HDV and CAV, respectively. $${{\alpha }_{n}}=\left\{ \begin{array}{*{35}{l}}
    1,\textnormal{ if the type of the vehicle }n\textnormal{ is HDV }  \\
    0,\textnormal{ else },  \\
\end{array} \right.\eqno{(1)}$$ $${{\beta }_{n}}=\left\{ \begin{array}{*{35}{l}}
    1,\textnormal{ if the type of the vehicle }n\textnormal{ is CAV }  \\
    0,\textnormal{ else }  \\
\end{array} \right.\eqno{(2)}$$ $$\alpha_n+\beta_n=1\eqno{(3)}$$

When the driving behavior of the leading vehicle changes, the HDV needs time to perceive, recognize and judge the change in the driving state of the leading vehicle before taking measures; this time is called reaction time $\tau$ in this study. Besides, the vehicle may produce random deceleration because of uncertain factors such as the driver's mentality. The CAV uses the on-board sensing system or V2V/V2I technologies to obtain the status information of the leader. Therefore, it can quickly capture the change of the leader's behavior and take corresponding measures. The reaction time is the processing time of the on-board sensing system, which is shorter than that of the HDV.

Hence, before proceeding with the design of the CA model rules, it is necessary to introduce the concept of safety distance, which is extended from the Gipps model. It is the minimum distance that the follower does not collide with the leader vehicle when the leader vehicle brakes suddenly. The safety distance of the vehicle defined in this way can ensure that the vehicle is safe in all cases. According to Newton's second law, we know that the safe distance between adjacent vehicles in mixed traffic flow can be determined by $$d_{n}^{safe}={{v}_{n}}(t)\left( {{\alpha }_{n}}{{\tau }^{\textnormal{HDV}}}+{{\beta }_{n}}{{\tau }^{\textnormal{CAV}}} \right)$$ $$+\left( {{\alpha }_{n}}+{{\beta }_{n}} \right)\left( \frac{{{v}_{n}}{{(t)}^{2}}-{{v}_{n-1}}{{(t)}^{2}}}{2B} \right)\eqno{(4)}$$

where $d_{n}^{safe}$ is the safe distance between the vehicle $n$ and vehicle $n-1$. $v_n(t)$ is the speed of the vehicle $n$ at time $t$ (m/s). $\tau^{\mathrm{HDV}}$ and $\tau^{\mathrm{CAV}}$ are the reaction time (s) of the HDV and the CAV, respectively. $B$ is the maximum deceleration of the vehicle. Then based on the safe distance of vehicles with different type, the acceleration, deceleration, randomization, and position update rules of the CA model of mixed traffic flow are proposed as follows.

\(a\) Acceleration

For HDV and CAV, when the distance$d_n$between vehicle$n$and its leading vehicle$n-1$is greater than the safety distance $d_{n}^{safe}$, vehicle$n$will accelerate due to the pursuit of higher speed. To meet the rationality of simulation acceleration, the speed of vehicle$n$at the next time step is the minimum of $v_n(t)+\alpha_n \Delta t, V_{\max }$, and $d_n / \Delta t$. $v_n(t+\Delta t)=\left(\alpha_n+\beta_n\right) \min \left(v_n(t)+a \Delta t, V_{\max }, d_n / \Delta t\right)$ $d_n=x_{n-1}(t)-x_n(t)-l_{n-1}$, where $\Delta t$ is the time step.${{v}_{n}}(t+\Delta t)$ is the speed of vehicle $\mathrm{n}$ at time $t+\Delta t.a$ is the acceleration of the vehicle ${{V}_{\max }}$ is the maximum speed of the vehicle ${{d}_{n}}$ is the distance between vehicle $n$ and vehicle $n-1$. $v_{n-1}(t+\Delta t)$ is the speed of vehicle $n-1$ at time $t+\Delta t$. $d_{n}^{safe}$is the safe distance of vehicle $n$, which can be obtained by Eq. (4). $x_{n-1}(t)$ is the position of vehicle $n-1$ at time $t.{{x}_{n}}(t)$ is the position of vehicle $n$ at time $t$. $l_{n-1}$ is the length of vehicle $n-1$.

\(b\) Deceleration

When the distance dn between the vehicle $n$ and the vehicle $n-1$ is less than or equal to the safe distance $d_{n}^{safe}$. the vehicle will decelerate to ensure driving safety. Therefore, the speed of vehicle $n$ at the next moment is $v_{n-1}(t+\Delta t)$. The form of the deceleration rule is $${{v}_{n}}(t+\Delta t)=\left( {{\alpha }_{n}}+{{\beta }_{n}} \right)\min \left( {{v}_{n}}(t),{{d}_{n}}/\Delta t \right)\eqno{(5)}$$

\(c\) Randomization

For better simulation of HDV, random slowing probability $p_{slow}^{{}}$is introduced in this study, and the vehicle will be slowed down according to the random probability. The random deceleration state of the vehicle is the same in the same reaction time and all HDV in each simulation step will make this determination. Since there is no instability in the CAV, it is specified that there is no randomization process. The randomization rule for HDV is obtained by the equation $${{v}_{n}}(t+\Delta t)=\max \left( {{v}_{n}}(t)-b\Delta t,0 \right)\eqno{(6)}$$ where $b$ is the random deceleration of the vehicle.$p_{slow }$is the randomization probability.

\(d\) Lane-changing

Drivers are always changing lanes to maintain the maximum speed possible or to avoid some accidents. Usually, lane change rules can be symmetrical or asymmetrical rules related to vehicles or lanes. The symmetric rules consider both lanes and all vehicles equally. and in addition, lane change is allowed only when certain safety conditions are satisfied. This paper uses symmetric rules which they can change the lane if they satisfied the lane-changing rules. All steps are applied to all vehicles including CAV and HDV in parallel manner. Here, vehicles can change the lane according to the following symmetric rules (with respect to the vehicles kinds as well as with respect to the lanes): $$\left\{ \begin{array}{*{35}{l}}
         rand\le p_{lane-change}^{HDV/CAV}\\
        \\
         gap_{\inf ront}^{current}\left( t \right)<{{v}_{n}}\left( t \right)+a\Delta t\\
        \\
         gap_{\inf ront}^{other}\left( t \right)>gap_{\inf ront}^{current}\left( t \right)\\
        \\
         v_{n-1}^{other}\left( t \right)<g_{back}^{other}\left( t \right)\textnormal{ }\\

\end{array} \right.     \eqno{(7)}$$ Where: $gap_{\inf ront}^{current}\left( t \right)$ and $gap_{\inf ront}^{other}\left( t \right)$ are the gap in front in the current lane (left or right) and the other lane at the step t, respectively. $g_{back}^{other}\left( t \right)$ is the back gap in the other lane (left or right) at the step t. $v_{n-1}^{other}\left( t \right)$ is the maximum velocity of the vehicle behind in the other lane at the step t. $rand\le p_{lane-change}^{HDV/CAV}$ is the lane-changing probability of HDV and CAV. If the above lane-changing rules are satisfied, then the vehicle can change the lane.

(e)Position update

After the next time step's speed and lane is updated, the position of the vehicle is updated $$x_n(t+\Delta t)=x_n(t)+v_n(t+\Delta t) \cdot \Delta t\eqno{(8)}$$

## EVT models for CAV lane changing decision

With the pioneering work of Tarko et al, EVT paved its way in traffic safety analysis about two decades ago. With some preliminary analysis on estimating crash risk using traffic conflicts, the efficacy of EVT was confirmed in that study. Several attempts have been made in recent years to obtain real trajectory data in a connected environment and assess safety.

The synthesis of the literature suggests that majority of the studies employed EVT to estimate crash risk probability. The application of EVT seems to be most relevant in this case because of its capability of estimating crash risk without using historical crash records.

However, the real-time application factor is missing in the existing EVT model, which serves as the primary tool for studying the probability of extreme events and is able to adequately represent the extreme variability of random variables. Only through real-time application can we gain insight into the risky behavior of traffic subjects and reduce such risks, thus improving the behavioral reliability and safety of these vehicles, futhermore, and helping to improve our understanding of the relationship between traffic environment and traffic safety. These issues motivate the study in this paper.

When a CAV is driving on a highway where it has been informed of an accident ahead, the traffic risk will increase with proximity to the accident site, but may not be linearly approximated. Therefore, in order to adapt natural driving behavior, the risk-distance relationship can be estimated to determine when the CAV should make a lane change to induce the HDV, to ensure maximum safety and efficiency, and may to avoid traffic congestion or even secondary accidents due to accidents.To this end, Generalised Pareto distribution is applied because of its upper tail that deals with extreme values. More specifically, consider the maximum $M_n=\max \left(X_1, X_2, \cdots, X_n\right)$ . Among them, we define $X$ as the maximum value of CAV lane change probability $p_{lane-change}^{CAV}$ at different distances from the accident site. For example, at 1km from the accident site, the possibility that CAV can bear the maximum risk (lane change avoidance) in the face of accidents ahead is ${{X}_{1000}}$. And this definition is made because the closer the distance to the accident site, the greater the corresponding traffic risk (vehicle driving safety, traffic congestion, etc.), which can also be characterized as an increasingly extreme and less probable event, because as a CAV it has the ability to obtain a large amount of information, for example, it is basically impossible for a CAV to slow down urgently at 100m before the accident and then change lanes to avoid the accident, the probability is very small. Then if a sequence of constants $a_n>0$ and $b_n>0$ exists, then ${Pr}\left[\frac{\left(M_n-b_n\right)}{a_n \leq z}\right] \rightarrow G(z)$ as $n \rightarrow \infty$ for a nondegenerate distribution function $G$ , then $G$ belongs to the Generalised Extreme Value family, where the distributional function is $$G(z)=\exp \left\{-\left[1+\xi\left(\frac{z-\mu}{\sigma}\right)\right]^{-1 / \xi}\right\}\eqno{(9)}$$ defined on $z: 1+\xi\left[\frac{z-\mu}{\sigma}\right]>0$, as shown in Fig. 2, where, $-\infty<\mu<\infty$ indicates the location parameter, $\sigma>0$ denotes the scale parameter, and $\xi$ represents the shape of a Generalised Extreme Value distribution. As a result of assuming that the parent distribution ${Pr}\left[\frac{\left(M_n-b_n\right)}{a_n \leq z}\right] \rightarrow G(z)$ is known, the distribution of lane change probablity would also be know,then we can use the $rand\le p_{lane-change}^{CAV}$ to make CAV perform lane change.

```latex
\begin{figure*}[h]\centering
    %\framebox{\parbox{3in}{figure1.tif}}
    \begin{tabular}{ccc}
        \includegraphics[width=6cm]{penetration0.eps} &    \includegraphics[width=6cm]{penetration20.eps}  &    \includegraphics[width=6cm]{penetration40.eps}      \\
        (a) 0\% & (b) 20\% & (c) 40\%\\
        \includegraphics[width=6cm]{penetration60.eps} &    \includegraphics[width=6cm]{penetration80.eps}   &    \includegraphics[width=6cm]{penetration100.eps}     \\
        (d)60\% & (e) 80\% & (f) 100\%\\
    \end{tabular}
    \caption{Trajectory-velocity diagram of mixed traffic flow}
    \label{figurelabel}
\end{figure*}
```
```latex
\scalebox{1}{
        {\begin{tabular}{cc}

                \hline
                Parameter&Value\\
                \hline
                $\xi$&1\\
                $\mu$&0\\
                $\sigma$&1\\
                $Vmax$&$330 cells/step$($33 m/s$)\\
                $a$&$30 cells/step^2$ ($3 m/s^2$)\\
                $b$&$30 cells/step^2$ ($3 m/s^2$)\\
                Road Length&$10^5 cells(10km)$\\
                Accident Site&$9\times10^4 cells(9km)$\\
                Vehicle Length&50 $cells(5m)$\\
                Step Length&3000 steps\\
                Timestep&0.1s\\
                $p_{slow}$&0.2\\
                $p_{lane-change}^{HDV}$&0.07\\
                ${{\tau }^{\textnormal{HDV}}}$&20 steps(2s)\\
                ${{\tau }^{\textnormal{CAV}}}$&6 steps(0.6s)\\
                Penetration rates&0-100\%\\
                \hline
    \end{tabular}}}
```

# SIMULATION&RESULTS

In this paper, a mixed traffic environment on a two-lane highway is constructed using numerical simulation, and the usability of the proposed CAV natural lane changing decision model is verified based on this simulation environment. In the numerical simulation, the lane consists of $10^5$ cells, each cell length is 0.1 m, so the road length is L=10km. The traffic accident occurs in the right lane at 10km, where it is impassable, and the vehicle needs to change lanes in advance to avoid the accident when it is observed, where the observation distance of HDV is 1km according to the forward-looking effect, that is, HDV can observe the traffic accident in front of it at 9km. The HDV can observe the traffic accident in front of it at 9km, and then prepare to start the next operation. The simulation time step is set to 0.1 s, and the total step length is 3000. the last 1000 steps are recorded to investigate the traffic flow characteristics. The simulation uses the periodic boundary. In the initial state, the vehicles are uniformly distributed on the road and the speed is generated randomly. The vehicle length is 50 cells (5 m). The speed limit is Vmax=330 cells/step (the general speed limit of Chinese highways is 120 km/h). The general acceleration, random deceleration and maximum deceleration of the vehicles are a=$30 cells/step^2$ ($3 m/s^2$), b=30 cells/step1 ($3 m/s^2$) and b=$50 cells/step^2$ ($5 m/s^2$), respectively, and the randomization probability of HDV is set to 0.2. In the simulation, the response times of HDV and CAV are set to 20 steps (2 s) and 6 steps (0.6 s).The values of parameters in the numerical simulation are shown in Table 1. In order to study the influence of the penetration rate of CAVs on the characteristics of mixed traffic flow, the penetration rates are set to 0%, 20%, 40%, 60%, 80% and 100%.

## Trajectory-velocity Diagram Analysis

Figure 3 shows the speed and trajectory of vehicles on two lanes with different CAV penetration rates at a traffic density of 50 vehicles/km, where the darker color indicates lower speed, which means greater traffic congestion. From Fig. 3(a)-(f), it can be seen that as the penetration rate increases, the congestion area on the two lanes becomes smaller, the distance of congestion propagation becomes shorter, the impact area is smaller, and the congestion in the right lane where the accident occurs will be relieved. As shown in Figure 3(a), when the penetration rate of CAV is 0%, the congestion due to the traffic accident in the right lane propagates to almost the whole road section, causing a substantial traffic efficiency reduction. As shown in Figure 3(f), when the penetration of CAV is 100%, traffic congestion exists only in the accident area of the right lane, and there is no traffic congestion in other areas. The main reason is that the CAV decision of applying extreme value distribution proposed in this paper still has a very small number of CAVs to make speed reduction and lane change only before 10 KM (where the accident occurred), thus causing traffic congestion, and the rest of CAV can all adjust quickly during the driving process and then drive at the highest speed.

```latex
\scalebox{0.8}{\begin{tabular}{|c|ccc|}

                \hline
                \textbf{Penetration Rates} & \textbf{\textit{Vehicle Type}}& \textbf{\textit{Average Travel Time(s)}}& \textbf{\textit{Average Speed(m/s)}} \\
                \hline

                &CAV&0&0\\

                0\%&HDV&395.223&25.486\\
                &ALL&395.223&25.486\\

                \hline

                &CAV&365.580&27.196\\

                20\%&HDV&376.451&26.399\\
                &ALL&374.277&26.559\\

                \hline

                &CAV&355.080&27.992\\

                40\%&HDV&367.267&27.127\\
                &ALL&362.392&27.473\\

                \hline

                &CAV&346.958&28.787\\

                60\%&HDV&348.738&28.719\\
                &ALL&347.670&28.760\\

                \hline

                &CAV&338.439&29.485\\

                80\%&HDV&349.145&28.578\\
                &ALL&340.580&29.303\\
                \hline
                &CAV&330.346&30.148\\

                100\%&HDV&0&0\\
                &ALL&330.346&30.148\\
                \hline
\end{tabular}}
```

## Traffic Efficiency Analysis

In this paper, the average travel time and average speed of vehicles with different CAV penetration rates are calculated for a traffic density of 50 vehicles/km, and the results are shown in Table 2. Table 2 shows that as the penetration rate keeps increasing, the average travel time of all vehicles keeps getting shorter and the average speed keeps increasing. Among them, CAV and HDV also lead to shorter average travel time and higher average speed as the CAV penetration rate increases, mainly because all vehicles form a more stable flow state under the influence of the CAV decision method in this paper, which continuously reduces the impact of congestion propagation caused by traffic accidents. As can be seen from the table, when the penetration rate is 100%, the average travel time is reduced by 16.42% and the average speed is increased by 18.29% compared with the pure HDV. When the penetration rate is 60%, the average travel time of CAV is reduced by 12.21% and the average speed is increased by 12.95% compared to pure HDV. the average travel time of HDV is reduced by 11.76% and the average speed is increased by 12.69% compared to pure HDV. Combined with the above analysis, the following conclusions can be drawn: the large-scale application of CAV can effectively reduce traffic congestion, increase the efficiency of traffic and improve the driving experience of HDV.

# CONCLUSIONS

This study proposed a natural lane changing decision model for CAV to adapt the mixed traffic flow based on extreme value theory. We designed to model the maximum value of CAV's lane change probability at each distance by extreme value distribution, and evaluated our method by setting different CAV penetration rates in a mixed traffic environment. The results showed that the model can better improve the average travel time and average vehicle speed, and CAV can also improve the travel efficiency of HDV. This work only considered the CAV lane change rule setting through a fixed extreme value distribution. In the future, a more realistic extreme value distribution will be obtained by fitting the natural driving dataset. Futhermore, It is not enough to model the lane change probability as an extreme value distribution only, we will continue to explore the application of extreme value theory in the CAV decision making process to improve the operational safety and efficiency of the mixed traffic environment.

[^1]: \*This work was supported by Supported by the Fundamental Research Funds for the Central Universities(2023YJS130), The National Natural Science Foundation of China (52272328) and Beijing Municipal Natural Science Foundation (L211022).