abstract: Person search aims to simultaneously localize and identify a query person from uncropped images. To achieve this goal, state-of-the-art models typically add a re-id branch upon two-stage detectors like Faster R-CNN. Owing to the ROI-Align operation, this pipeline yields promising accuracy as re-id features are explicitly aligned with the corresponding object regions, but in the meantime, it introduces high computational overhead due to dense object anchors. In this work, we present an anchor-free approach to efficiently tackling this challenging task, by introducing the following dedicated designs. *First*, we select an anchor-free detector (i.e., FCOS) as the prototype of our framework. Due to the lack of dense object anchors, it exhibits significantly higher efficiency compared with existing person search models. *Second*, when directly accommodating this anchor-free detector for person search, there exist several misalignment issues in different levels (i.e., scale, region, and task). To address these issues, we propose an aligned feature aggregation module to generate more discriminative and robust feature embeddings. Accordingly, we name our framework as Feature-Aligned Person Search Network (AlignPS). *Third*, by investigating the advantages of both anchor-based and anchor-free models, we further augment AlignPS with an ROI-Align head, which significantly improves the robustness of re-id features while still keeping our model highly efficient. Our framework not only achieves state-of-the-art or competitive performance on two challenging person search benchmarks, but can be also extended to other challenging searching tasks such as animal search. All the source codes, data, and trained models are available at:  https://github.com/daodaofr/alignps.
author: Yichao Yan, Jinpeng Li, Jie Qin, Peng Zheng, Shengcai Liao, Xiaokang Yang
bibliography: egbib.bib
date: Received: date / Accepted: date
title: Efficient Person Search: An Anchor-Free Approach

# Introduction

Person search  aims to localize and identify a target person from a gallery of realistic, uncropped scene images, and it has recently emerged as a practical task with real-world applications, e.g., video surveillance. Two fundamental computer vision tasks, i.e., pedestrian detection  and person re-identification (re-id) , need to be addressed to tackle this task. Both detection and re-id are very challenging tasks and have received tremendous attention in the past decade. In person search, we need to not only address the challenges (e.g., occlusions, pose/viewpoint variations, and background clutter) of the two individual tasks, but also pursue a unified and optimized framework to simultaneously perform detection and re-id.

Previous person search frameworks can be generally divided into two categories. The first line of works  can be summarized as *two-step* approaches, which attempt to deal with detection and re-id separately. As shown in Fig. , multiple persons are first localized with off-the-shelf detection models, and then cropped out and fed to re-id networks to extract feature representations. Although two-step models can obtain satisfactory results, the disentangled treatment of the two tasks is time- and resource-consuming. In contrast, the second category  provides a *one-step* solution that unifies detection and re-id in an end-to-end manner. As shown in Fig. , one-step models first apply an ROI-Align layer to aggregate features in the detected bounding boxes. The features are then shared by detection and re-id; with an additional re-id loss, the simultaneous optimization of the two tasks becomes feasible. Since these models adopt two-stage detectors like Faster R-CNN , we refer to them as *one-step two-stage* models. However, these methods inevitably inherit the limitations of two-stage detectors, e.g., high computational complexity caused by dense anchors, and high sensitivity to the hyperparameters including the size, aspect ratio and number of anchor boxes, etc.

Compared with two-stage detectors, anchor-free models exhibit unique advantages (e.g., simpler structure and higher speed), and have been actively studied in recent years . Inspired by this, an open question is naturally thrown at us - *Is it possible to develop an anchor-free framework for person search?* Our answer is yes. However, this is a non-trivial task due to the following three misalignment issues. **1)** Many anchor-free models learn multi-scale features using feature pyramid networks (FPNs) to achieve scale invariance for object detection. However, this introduces the misalignment issue for re-id (i.e., scale misalignment), as a query person needs to be compared with all the people of various scales in the gallery set, while the re-id features would be inconsistently taken from different FPN levels. **2)** In the absence of operations like ROI-Align, anchor-free models cannot align the features for re-id and detection according to a specific region. Therefore, re-id embeddings must be directly learned from feature maps without explicit region alignment, which brings additional challenges as re-id features are sensitive to the foreground regions . **3)** Person search can be intuitively formulated as a multi-task learning framework with detection and re-id as its sub-tasks. However, there exist conflicts between the objectives of these two tasks, i.e., pedestrian detection tries to learn features that are commonly shared by all the people, while re-id tries to extract unique features for individual persons. Hence, we need to find a better tradeoff/alignment between the two tasks.

In this work, we present an anchor-free framework for efficient person search, which we name the Feature-Aligned Person Search Network (**AlignPS**). Our model employs the typical architecture of an anchor-free detection model (i.e., FCOS ), which allows our framework to be more efficient than prior person search models. To address the above-mentioned challenges, we design an aligned feature aggregation (AFA) module to make our model focus more on the re-id subtask. Specifically, AFA reshapes some building blocks of FPN to overcome the issues of region and scale misalignment in re-id feature learning. For example, we exploit deformable convolution to make the re-id embeddings adaptively aligned with the foreground regions. In the meantime, we design a feature fusion scheme to better aggregate features from different FPN levels, which makes the re-id features more robust to scale variations. We also optimize the training procedures of re-id and detection to place more emphasis on generating robust re-id embeddings (as shown in Fig. ). These simple yet effective designs successfully transform a classic anchor-free detector into a powerful and efficient person search framework, and allow the proposed model to outperform its anchor-based competitors. Moreover, we find that although the proposed AlignPS framework implicitly aligns re-id features with the corresponding regions, there inevitably exists a gap between the adapted regions and the foreground bounding boxes. As observed in previous works , re-id features are sensitive to the context outside the foreground regions. Inspired by the learning scheme in two-stage models (as shown in Fig. ), we further augment AlignPS with an ROI-Align head, to explicitly extract more robust re-id features corresponding to the foreground regions. We name this variant as **ROI-AlignPS**, as shown in Fig. . These explicitly aligned re-id features can be viewed as complements to the implicitly aligned features from AlignPS, and these two kinds of features are fused to yield even better re-id representations. More importantly, the ROI-Align head only receives the output bounding boxes from AlignPS during inference, avoiding computing dense region proposals. Therefore, ROI-AlignPS still inherits the high efficiency from AlignPS.

In summary, our main contributions include:

-   We propose the first *anchor-free* framework (AlignPS) for efficient person search, which will significantly foster future research in this direction.

-   We design an AFA module that simultaneously addresses the issues of scale, region, and task misalignment to successfully accommodate an anchor-free detector for the task of person search.

-   We further propose a novel model variant (ROI-AlignPS) by augmenting AlignPS with an ROI-Align head, which complements the implicitly aligned re-id features. With mutual learning strategy, this variant further improves the performance while remaining highly efficient.

-   As an anchor-free framework, our model surprisingly achieves state-of-the-art or competitive performance on two challenging person search benchmarks, while running at a higher speed.

-   Our framework can be naturally extended to handle other object search tasks, such as animal and object search. We evaluate our framework on a Chinese dolphin benchmarks, and the results demonstrate that our framework consistently outperforms prior arts.

Part of this work has been published in . In this paper, we make the following major extensions: **1)** We augment AlignPS with an ROI-Align head, which explicitly aligns the foreground regions with their re-id features. This architecture variant notably improves the performance, while keeping the framework efficient. **2)** We investigate a mutual feature learning strategy, which allows the explicitly and implicitly aligned re-id features to promote each other during training. We find these strategies yield more robust re-id representations. **3)** We provide more thorough ablation studies and component analysis on both CUHK-SYSU and PRW , and present more qualitative results. These analyses further illustrate the effectiveness of the proposed framework. **4)** We further extend our frameowrk from person search to animal search tasks, and provide comparative results with prior arts.

# Related Work

**Pedestrian Detection**. Pedestrian or object detection can be considered as a preliminary task of person search. Current deep learning-based detectors are generally categorized into one-stage and two-stage models, according to whether they employ a region proposal network (RPN) to generate object proposals. Alternatively, object detectors can also be categorized into anchor-based and anchor-free detectors, depending on whether they utilize anchor boxes to associate objects. One of the most representative two-stage anchor-based detectors is Faster R-CNN , which has been extended into numerous variants . Notably, some one-stage detectors  also work with anchor boxes. Compared with the above models, one-stage anchor-free detectors  have been attracting more and more attention recently due to their simple structures and efficient implementations. In this work, we develop our person search framework based on an one-stage anchor-free detector, thus making the whole framework simpler and faster.

**Person Re-identification**. Person re-id is also closely related to person search, aiming to learn identity embeddings from cropped person images. Traditional methods employed various handcrafted features  before the renaissance of deep learning. However, to pursue better performance, current re-id models are mostly based on deep learning. Some models employ structure/part information in the human body or add additionl constraint to learn more robust representations , while others focus on learning better distance metrics . As person re-id usually lacks large-scale training data, data augmentation  also becomes popular for tackling this task. Compared with detection which aims to learn common features of pedestrians, re-id needs to focus more on fine-grained details and unique features of each identity. Therefore, we propose to follow the "re-id first" principle to raise the priority of the re-id task, resulting in more discriminative identity embeddings.

**Person Search**. Existing person search frameworks can be divided into two-step and one-step models. Two-step models first perform pedestrian detection and subsequently crop the detected people for re-id. Zheng et al. introduced the pioneering two-step framework for person search and evaluated the combinations of different detectors and re-id models. Since then, several models  have followed this pipeline. In , Xiao et al. proposed the first one-step person search framework based on Faster R-CNN. Specifically, a joint framework enabling end-to-end training of detection and re-id was proposed by stacking a re-id embedding layer after the detection features and proposing the Online Instance Matching (OIM) loss. So far, a number of improvements  have been made based on this framework. In general, two-step models may achieve better performance, while one-step models have the advantages of simplicity and efficiency. However, there is still room for improving one-step methods due to the aforementioned shortcomings of the two-stage anchor-based detectors they usually adopt. In this work, we introduce an anchor-free model to further improve the simplicity and efficiency of one-step models, without any sacrifice in accuracy.

**Mutual Learning**. Hinton et al. firstly introduced knowledge distillation in neural networks in 2015. Since then, it has been widely employed in various computer vision tasks to improve the capability of neural networks, e.g., image recognition , object detection , image segmentation , etc. In person search, several recent work have also adopted this approach. For example, QEEPS  and IGPN  employ the query person to find the most similar proposals in the RPN, which reduces the number of proposals and enhances the efficiency. In BiNet  and DKD , the features from cropped pedestrians are utilized to distill the re-id features in person search network, such that the robustness of the re-id features are improved. In this work, we design two feature learning branches in ROI-AlignPS. Instead of employing the query person or the cropped image, we investigate a mutual feature promotion strategy to improve the discriminative capability of the aggregated features.

# Feature-Aligned Person Search Networks

In this section, we introduce the proposed anchor-free frameworks (i.e., AlignPS and ROI-AlignPS) for person search. First, we give an overview of the network architecture. Second, the proposed AFA module is elaborated with the aim of mitigating different levels of misalignment issues when transforming an anchor-free detector into a superior person search framework. Then, we present the designed loss function to obtain more discriminative features for person search. Finally, we present ROI-AlignPS, a model variant which further improves the performance of AlignPS.

## Framework Overview

The basic framework of the proposed AlignPS is based on FCOS , one of the most popular one-stage anchor-free object detectors. Differently, we adhere to the "re-id first" principle to put emphasis on learning robust feature embeddings for the re-id subtask, which is crucial for enhancing the overall performance of person search.

As illustrated in Fig. , our model simultaneously localizes multiple people in the image and learns re-id embeddings for them. Specifically, an AFA module is developed to aggregate features from multi-level feature maps in the backbone network. To learn re-id embeddings, which is the key of our method, we directly take the flattened features from the output feature maps of AFA as the final embeddings, without any extra embedding layers. For detection, we employ the detection head from FCOS which is good enough for the detection subtask. The detection head consists of two branches, both of which contain four 3$\times$`<!-- -->`{=html}3 *conv* layers. In the meantime, the first branch predicts regression offsets and centerness scores, while the second makes foreground/background classification. Finally, each location on the output feature map of AFA will be associated with a bounding box with classification and centerness scores, as well as a re-id feature embedding.

## Aligned Feature Aggregation

Following FPN , we make use of different levels of feature maps to learn detection and re-id features. As the key of our framework, the proposed AFA performs three levels of alignment, beyond the original FPN, to make the output re-id features more discriminative.

**Scale Alignment**. As shown in Fig. , the original FCOS model employs different levels of features to detect objects of different sizes. This significantly improves the detection performance since the overlapped ambiguous samples will be assigned to different layers. For the re-id task, however, the multi-level prediction could cause feature misalignment between different scales. In other words, when matching a person of different scales, re-id features are inconsistently taken from different levels of FPN, thus preventing the re-id features from being robust to scale variations. Furthermore, the people in the gallery set are of various scales, which could eventually make the multi-level model fail to find correct matches for the query person. Therefore, in our framework, we only make predictions based on a single layer of AFA, which explicitly addresses the feature misalignment caused by scale variations. Specifically, we employ the $\{C_3, C_4, C_5\}$ feature maps from the ResNet-50 backbone, and AFA sequentially outputs $\{P_5, P_4, P_3\}$, with strides of 32, 16, and 8, respectively. , our framework only generates features from $\{P_3\}$, which is the largest output feature map, for both the detection and re-id subtasks, and $\{P_6, P_7\}$ are no longer generated as in the original FPN. Although this design may slightly influence the detection performance, we will show in Sec.  that it achieves a good trade-off between the detection and re-id subtasks, which adapts well to the person search task.

**Region Alignment**. On the output feature map of AFA, each location perceives the information from the whole input image based on a large receptive field. Due to the lack of the ROI-Align operation as in Faster R-CNN, it is difficult for our anchor-free framework to learn more accurate features within the pedestrian bounding boxes, and thus leading to the issue of region misalignment. The re-id subtask is even more sensitive to this issue as background features could greatly impact the discriminative capability of the learned features. In AlignPS, we address this issue from three perspectives. *First*, we replace the 1$\times$`<!-- -->`{=html}1 *conv* layers in the lateral connections with 3$\times$`<!-- -->`{=html}3 *deformable conv* layers. As the original lateral connections are designed to reduce the channels of feature maps, a 1$\times$`<!-- -->`{=html}1 *conv* is enough. In our design, moreover, the 3$\times$`<!-- -->`{=html}3 *deformable conv* enables the network to adaptively adjust the receptive field on the input feature maps, thus implicitly fulfilling region alignment. *Second*, we replace the "sum" operation in the top-down pathway with a "concatenation" operation, which can better aggregate multi-level features. *Third*, we again replace the 3$\times$`<!-- -->`{=html}3 *conv* with a 3$\times$`<!-- -->`{=html}3 *deformable conv* for the output layer of FPN, which further aligns the multi-level features to finally generate a more accurate feature map. The above three designs work seamlessly to address the region misalignment issue, and we notice that these simple designs are extremely effective when accommodating the basic anchor-free model for our person search task.

**Task Alignment**. Existing person search frameworks typically treat pedestrian detection as the primary task, i.e., re-id embeddings are just generated by stacking an additional layer after the detection features. A recent work  investigated a parallel structure by employing independent heads for the two tasks to achieve robust multiple object tracking results. In our task of person search, we find the inferior re-id features largely hinder the overall performance. Therefore, we opt for a different principle to align these two tasks by treating re-id as our primary task. Specifically, the output features of AFA are directly supervised with a re-id loss (which will be introduced in the following subsection), and then fed to the detection head. This "re-id first" design is based on two considerations. *First*, the detection subtask has been relatively well addressed by existing person search frameworks, which directly inherit the advantages from existing powerful detection frameworks. Therefore, learning discriminative re-id embeddings is our primary concern. As we discussed, re-id performance is more sensitive to region misalignment in an anchor-free framework. Therefore, it is desirable for the person search framework to be inclined towards the re-id subtask. We also show in our experiments that this design significantly improves the discriminative capability of the re-id embeddings, while having negligible impact on detection. *Second*, compared with "detection first" and parallel structures, the proposed "re-id first" structure does not require an extra layer to generate re-id embeddings, and is thus more efficient.

## Triplet-Aided Online Instance Matching Loss

Although OIM effectively employs both labeled and unlabeled identities, we still observe two limitations. First, the distances are only computed between the input features and the features stored in the lookup table and circular queue, while no comparisons are made between the input features. Second, the log-likelihood loss term does not give an explicit distance metric between feature pairs.

To improve OIM, we propose a specifically designed triplet loss. For each person in the input images, we employ the center sampling strategy as in . As shown in Fig. , for each person, a set of features located around the person center are considered as positive samples. The objective is to pull the feature vectors from the same person close, and push the vectors from different people away. Meanwhile, the features from the labeled persons should be close to the corresponding features stored in the LUT, and away from the other features in the LUT.

More specifically, suppose we sample $S$ vectors from one person; we get $X_m = \{x_{m,1},..., x_{m,S}, v_m\}$ and $X_n=\{x_{n,1},..., {\color{red}{x_{n,S}}}, v_n\}$ as the candidate feature sets for the persons with identity labels $m$ and $n$, respectively, where $x_{i,j}$ denotes the $j$-th feature of person $i$, and $v_i$ is the $i$-th feature in the LUT. Given $X_m$ and $X_n$, positive pairs can be sampled within each set, while negative pairs are sampled between the two sets. The triplet loss can be calculated as: $$\mathcal{L}_{\text{tri}} = \sum_{\text{pos,~neg}}[M + D_{\text{pos}} - D_{\text{neg}}],$$ where $M$ denotes the distance margin, and $D_{\text{pos}}$ and $D_{\text{neg}}$ denote the Euclidean distances between the positive pair and the negative pair, respectively. Finally, the Triplet-aided OIM (TOIM) loss is the summation of these two terms: $$\mathcal{L}_{\text{TOIM}} = \mathcal{L}_{\text{tri}}+\mathcal{L}_{\text{OIM}}.$$

## AlignPS Augmented with Explicit Region Alignment

**ROI-AlignPS**. Although the proposed AFA module implicitly addresses the region misalignment issue with deformable convolution, it is still desirable to investigate the explicitly aligned learning schemes, e.g., cropping pedestrians for re-id learning  and the ROI-Align operation in Faster R-CNN . However, learning based on the cropped pedestrians inevitably transfers the whole framework into a two-step model, which significantly downgrades the efficiency. In the meantime, the dense region proposals in Faster R-CNN also make it inefficient during inference. To address these issues, we propose a novel variant, which we name ROI-AlignPS, by augmenting our efficient anchor-free framework with an explicit region alignment module.

In the training phase, two parallel branches are simultaneously trained with implicit and explicit region alignment, respectively. As shown in Fig. , the bottom branch is the original AlignPS model, while the top branch follows the architecture of NAE , which includes a RPN and ROI-Align operation to output the re-id features of a certain region. Both branches share the ResNet-50 backbone from *res1* to *res4* layers, while having separate *res5* layers. In the test phase, as illustrated in Fig , the bottom AlignPS branch first outputs bounding boxes and re-id features. Then, the processed bounding boxes are fed to the top branch to extract explicitly aligned re-id features corresponding to each person. Finally, the re-id features from these two branches are combined to generate a more robust representation.

Although ROI-AlignPS contains an anchor-free branch and an anchor-based branch, the dense anchors in Faster R-CNN are only involved in the training stage. During inference, RPN is discarded and only a small number of detected bounding boxes are processed with ROI-Align. In this way, ROI-AlignPS can still remain highly efficient during the inference stage. Moreover, the explicit and implicit region alignment strategies are complementary to each other. Specifically, the ROI-Align branch extracts re-id features based on bounding boxes, while AlignPS dynamically adapts to certain regions. Meanwhile, the performance of both methods may be influenced by occlusions and backgrounds. Therefore, combining these two kinds of features intuitively reduces such impacts, and the effectiveness of this design is validated in Sec .

**Branch-Level Mutual Learning**. Prior works  found that feature interaction and knowledge distillation can benefit feature learning in neural networks. In our case, it would be desirable if the prediction of the two branches can reach a better consensus. To fullfile this, we investige a mutual information maximization strategy.

Mutual information is defined to measure the dependency between two random variables $X$ and $Y$: $$\mathcal{I}(X,Y) = \int_{X}\int_{Y}p(x,y) {\rm log}\frac{p(x,y)}{p(x)p(y)}dxdy,$$ where $p(x,y)$ is the joint probability density function, $p(x)$ and $p(y)$ are the marginal probability density functions of $X$ and $Y$, respectively. As demonstrated in prior works , mutual information is able to depict the mutual dependence between $X$ and $Y$, no matter how nonlinear the dependence is. Thus, mutual information is more flexible than the measurement of correlation. In this work, random variables $X$ and $Y$ represent the re-id features from the two branches in ROI-AlignPS, respectively. We aim to maximize the mutual information between $X$ and $Y$, such that the overall representation will focus on the identity information. As it is non-trivial to directly calculate the mutual information, we employ a neural estimator  to maximize the lower bound of the mutual information. Specifically, $$\mathcal{I}_{\Theta}(X,Y)  =  \sup_{\theta\in\Theta} \mathbb{E}_{\mathbb{P}_{{X}{Y}}}[T_\theta] - \log(\mathbb{E}_{\mathbb{P}_{{X}\otimes{Y}}}[e^{T_\theta}]),$$ where $\mathbb{P}_{{X}{Y}}$ is the joint distribution and $\mathbb{P}_{{X}\otimes{Y}}$ represents the marginal distribution, $T_{\theta}$ is a neural network parameterized by $\theta \in \Theta$. To maximize $\mathcal{I}_{\Theta}(X,Y)$, we minimize its negative value: $$\mathcal{L}_{mi} = -\mathcal{I}_{\Theta}(X,Y).$$

**Discussions**. A recent work, SeqNet , proposes a sequential architecture based on Faster R-CNN, which first predicts the detection results, and then extracts re-id features with an additional ROI-Align branch. Although ROI-AlignPS shares certain spirits with SeqNet, there exist several significant differences. (1) The motivation of SeqNet is to improve the quality of proposals, such that the re-id features could be better learned. In ROI-AlignPS, rather than considering the detection issue, the ROI-Align branch serves as an explicitly aligned re-id feature extractor, to complement the features from the AlignPS branch. (2) Despite the strong performance, SeqNet relies on a post graph matching technique. In contrast, the re-id features in ROI-AlignPS could be mutually promoted and the ensemble results are highly discriminative without post-processing. (3) In the inference stage, ROI-AlignPS still runs in an anchor-free way. Consequently, our framework is more efficient than SeqNet. The comparative results between ROI-AlignPS and SeqNet can be found in Sec. .

# Experiments

## Datasets and Settings

**CUHK-SYSU**  is a large-scale person search dataset which contains 18,184 images, with 8,432 different identities and 96,143 annotated bounding boxes. The images come from two kinds of data sources (i.e., real street snaps and movies/TV), covering diverse scenes and including variations of viewpoints, lighting, resolutions, and occlusions. We utilize the standard training/test split, where the training set contains 5,532 identities and 11,206 images, and the test set contains 2,900 query persons and 6,978 images. This dataset also defines a set of protocols with gallery sizes ranging from 50 to 4,000. We report the results using the default gallery size of 100 unless otherwise specified.

**PRW**  was captured using six static cameras in a university campus. All the images are extracted from the surveillance videos, which consist of 11,816 video frames in total. Person identities and bounding boxes are manually annotated, resulting in 932 labeled persons with 43,110 bounding boxes. The dataset is split into a training set of 5,704 images with 482 different identities, and a test set of 2,057 query persons and 6,112 images. Results are reported based on this split.

**PICWD**[^1] is a large-scale dataset collected for Chinese white dolphin detection and re-id. The images are collected from Qinzhou and Shantou, covering different environment conditions, including illumination, occlusion, reflection of sea surface, etc. We select 48,273 images, with 158 identities and 52,570 bounding boxes localizing the dorsal fins for white-dolphin search. Specifically, the whole dataset is divided into train/test parts, where the training set contains 100 identities and 36,825 images, and the test set contains 58 identities and 11,448 images.

**Evaluation Metric**. We employ the mean average precision (mAP) and top-1 accuracy to evaluate the performance for person and animal search. We also employ recall and average precision (AP) to measure the detection performance.

## Implementation Details

We employ ResNet-50  pretrained on ImageNet  as the backbone. We set the batch size to 4, and adopt the stochastic gradient descent (SGD) optimizer with weight decay of 0.0005. The initial learning rate is set to 0.001 and is reduced by a factor of 10 at epoch 16 and 22, with a total of 24 epochs. We use a warmup strategy for 300 steps. We employ a multi-scale training strategy, where the longer side of the image is randomly resized from 667 to 2000 during training, while zero padding is utilized to fit the images with different resolutions. For inference, we rescale the test images to a fixed size of 1500$\times$`<!-- -->`{=html}900. Following , we add a focal loss  to the original OIM loss. All the experiments are implemented based on PyTorch  and MMDetection , with an NVIDIA Tesla V100 GPU. It takes around 38 and 24 hours for ROI-AlignPS to finish training on CUHK-SYSU and PRW, respectively.

## Analysis of AlignPS

**Baseline**. As shown in Fig. , each of the alignment strategies brings notable improvements to the baseline, and combining all of them yields 23% and 26.1% improvements in mAP on CUHK-SYSU and PRW, respectively.

Comparative results on CUHK-SYSU and PRW by employing different levels of features. P3, P4, and P5 are the feature maps with strides of 8, 16, and 32, respectively.

height 1pt

Detection
Re-id

2-5
Recall
AP
mAP
top-1

P3
90.3
81.2
93.1
93.4

P4
87.5
78.7
92.7
93.1

P5
79.0
71.7
89.3
89.5

P3, P4
90.4
80.5
91.1
91.6

P3, P4, P5
90.9
80.4
90.0
90.5

Detection
Re-id

2-5
Recall
AP
mAP
top-1

P3
94.8
92.9
45.9
81.9

P4
93.4
91.8
41.4
77.5

P5
85.7
83.7
25.3
57.4

P3, P4
94.7
92.9
40.8
77.1

P3, P4, P5
95.4
93.5
39.5
74.3

**Scale Alignment**. To evaluate the effects of scale alignment, we employ feature maps from different levels of AFA and report the results in Table . Specifically, we evaluate the features from $P_3$, $P_4$, and $P_5$ with strides of 8, 16, and 32, respectively. As can be observed, features from the largest scale $P_3$ yield the best performance on both CUHK-SYSU and PRW, due to the fact that they absorb different levels of features from AFA, providing richer information for detection and re-id. Similar to FCOS, we also evaluate the performance by assigning people of different scales to different feature levels. We set the size ranges for {$P_3, P_4\}$ as \[0, 128\] and \[128, $\infty$\], while the prediction ranges for {$P_3, P_4, P_5\}$ are \[0, 128\], \[128, 256\], and \[256, $\infty$\], respectively. We can see that these dividing strategies only achieve slightly better detection results w.r.t. the recall rate. However, the dividing strategy brings back the scale misalignment issue to person re-id, resulting in worse performance compared with single-scale features. Also note that this issue is not well addressed with the multi-scale training strategy. All the above results demonstrate the necessity and effectiveness of the proposed scale alignment strategy.

Comparative results on CUHK-SYSU and PRW by employing different components in AFA for region alignment. "dconv" stands for deformable convolution.

height 1pt

Lateral

Output
Feature
CUHK-SYSU
PRW

4-7  dconv
dconv
concat
mAP
top-1
mAP
top-1

83.4
83.7
27.4
62.3

✓

90.6
90.8
39.4
74.7

✓

91.4
91.9
40.6
77.0

✓
84.0
84.1
29.1
62.4

✓
✓

91.8
92.2
42.8
80.1

✓

✓
90.7
91.0
39.6
75.3

✓
✓
92.0
92.5
40.7
77.5

✓
✓
✓
93.1
93.4
45.9
81.9

``\color{red}{
\begin{tabular}{p{1cm}<{\centering}|p{0.8cm}<{\centering}p{0.6cm}<{\centering}|p{0.8cm}<{\centering}p{0.8cm}<{\centering}|p{0.8cm}<{\centering}p{0.8cm}<{\centering}}
\hline%
    \noalign {\ifnum 0=`}\fi \hrule height 1pt
    \futurelet \reserved@a \@xhline

\rowcolor{mygray}
Dconv              & FLOPS               & Time              & \multicolumn{2}{c}{CUHK-SYSU}     & \multicolumn{2}{|c}{PRW}                   \\ \cline{4-7}
\rowcolor{mygray}
                 & (G)                 & (ms)               & mAP                  & \multicolumn{1}{c}{top-1} & \multicolumn{1}{|c}{mAP}                  & \multicolumn{1}{c}{top-1} \\
\hline \hline
 w/o & 298  & 57 & 84.0 & 84.1              & 29.1       & 62.4            \\
w/ & 308  & 61 & 93.1 & 93.4        &45.9   &   81.9             \\
\hline
\end{tabular}
}``{=latex}

**Region Alignment**. We conduct experiments with different combinations of lateral deformable conv, output deformable conv and feature concatenation, and analyze how different region alignment components influence the overall performance. The results are reported in Table . Without all these modules, the framework only achieves 83.4% and 27.4% in mAP on CUHK-SYSU, and PRW, respectively, which is 9.7% and 18.5% lower than the full model. The individual components of lateral deformable conv and output deformable conv improve the model by $\sim$`<!-- -->`{=html}7% and $\sim$`<!-- -->`{=html}8% on CUHK-SYSU, respectively. Feature concatenation also brings $\sim$`<!-- -->`{=html}1% improvements. By combining two of the three components, we observe consistent improvements. Finally, employing all the three modules yields 93.1% in mAP and 93.4% in top-1 accuracy on CUHK-SYSU, significantly boosting the performance. On PRW, we also observe consistent improvement by introducing these strategies. These ablation studies thoroughly demonstrate the effectiveness of region alignment.

To further illustrate how the deformable convolutions work in our framework, we visualize the learned offsets of the deformable filters in Fig. . We observe that the proposed framework is capable of learning adaptive receptive field according to the layout of the human body, and is robust to occlusion, crowding, and scale/illumination variations. We also observe that the lateral deformable conv in $C_3$ learns tighter offsets around the body center, while the offsets in the $C_4$ layer cover larger regions, which makes the two layers complementary to each other.

Comparative results on CUHK-SYSU and PRW with different training structures.

height 1pt

Detection
Re-id

2-5
Recall
AP
mAP
top-1

T1
87.5
79.0
80.3
79.2

T2
89.1
78.6
77.1
75.9

T3
90.1
81.4
80.7
80.2

AlignPS
90.3
81.2
93.1
93.4

Detection
Re-id

2-5
Recall
AP
mAP
top-1

T1
94.3
92.5
35.5
67.4

T2
96.9
92.8
31.8
64.3

T3
94.5
92.6
35.8
69.1

AlignPS
94.8
92.9
45.9
81.9

**Task Alignment**. Since person search aims to simultaneously address detection and re-id subtasks in a single framework, it is important to understand how different configurations of the two subtasks influence the overall task and which subtask should be paid more attention to. To this end, we design several structures to compare different training options (as shown in Fig. ), the performance of which is summarized in Table . As can be observed, the structures of $T_1$ and $T_2$, where re-id features are shared with the regression and classification heads, respectively, yield significantly lower performance in re-id compared with our design. This indicates that the detection task takes advantage of the shared heads. As for $T_3$ where re-id and detection have independent feature heads, it achieves slightly better performance compared with $T_1$ and $T_2$, but still remarkably underperforms our design. These results indicate that our "re-id first" structure achieves the best task alignment among all these designs.

``\color{red}{
\begin{tabular}{p{2.1cm}|p{1.1cm}<{\centering}p{1.1cm}<{\centering}|p{1.1cm}<{\centering}p{1.1cm}<{\centering}}
\hline%
    \noalign {\ifnum 0=`}\fi \hrule height 1pt
    \futurelet \reserved@a \@xhline

\rowcolor{mygray}
  & \multicolumn{2}{c|}{CUHK-SYSU} & \multicolumn{2}{c}{PRW}   \\ \cline{2-5}
\rowcolor{mygray}
\multirow{-2}{*}{Center Radius}  & mAP & top-1  & mAP  & top-1  \\  \hline \hline
1  & 93.0  &  \textbf{93.5}      & 45.2  & 80.3   \\
1.5 (default)
   & \textbf{93.1}     & 93.4      & \textbf{45.9}   & \textbf{81.9}   \\
2  & 92.8  &  93.3     & 45.3  & 80.4   \\
3 & 92.7  &  93.1      & 45.6  & 81.4   \\
5 & 92.1  & 92.9       & 45.3   & 81.0  \\
8 & 92.0   & 92.6 & 45.1  & 80.9\\
box size
   & 91.3    & 92.0     & 42.5 & 79.4  \\
\hline
\end{tabular}
}``{=latex}

Comparative results on CUHK-SYSU and PRW with different loss functions.

height 1pt

CUHK-SYSU

mAP
top-1
Δ mAP
Δ top-1

OIM
92.4
92.9
-
-

TOIM w/o LUT
92.8
93.2
+0.4
+0.3

TOIM w/ LUT
93.1
93.4
+0.7
+0.5

PRW

mAP
top-1
Δ mAP
Δ top-1

OIM
45.7
81.8
-
-

TOIM w/o LUT
45.8
81.8
+0.1
+0

TOIM w/ LUT
45.9
81.9
+0.2
+0.1

Comparative results on CUHK-SYSU and PRW with different deformable conv layers in the backbone model.

height 1pt

CUHK-SYSU

Deformable conv
mAP
top-1

ResNet-50
none
93.1
93.4

ResNet-50
res3
93.5
93.9

ResNet-50
res3 & res4
93.5
94.0

ResNet-50
res3 & res4 & res5
94.0
94.5

PRW

Deformable conv
mAP
top-1

ResNet-50
none
45.9
81.9

ResNet-50
res3
45.8
81.9

ResNet-50
res3 & res4
45.9
82.1

ResNet-50
res3 & res4 & res5
46.1
82.1

**TOIM Loss**. We evaluate the performance of our framework when adopting different loss functions and report the results in Table . We find that directly employing a triplet loss brings slight improvement. When employing the items in the LUT, the TOIM improves the mAP and top-1 accuracy on CUHK-SYSU by 0.7% and 0.5%, respectively. These two terms also slightly improve the performance on PRW. This indicates that it is beneficial to consider the relations between the input features and the features stored in the LUT.

**Deformable Conv in the Backbone.** As shown in Table , inserting deformable convolutions into the backbone network has positive effects on our framework. However, the contribution of the deformable conv layers in the backbone network is less significant than the deformable conv layers in our AFA module, e.g., with all the res3 & res4 & res5 deformable conv layers, only $\sim$`<!-- -->`{=html}1% and 0.2% improvements are observed on CUHK-SYSU and PRW, respectively. These results indicate that the proposed AFA works as the key module for successful feature alignment.

## Analysis of ROI-AlignPS

We analyze the effectiveness of ROI-AlignPS by answering the following questions.

Comparative results with different structures. ROI-Align* denotes the model trained without re-id feature in the AlignPS branch, i.e., AlignPS concentrates on the detection task while ROI-Align focuses on re-id. This also yields an efficient anchor-free framework with fair performance.

height 1pt

  Separate

CUHK-SYSU
PRW
Inference

2-5  Training
mAP
top-1
mAP
top-1
Time

ROI-Align
92.0
92.3
43.1
80.7
83

AlignPS
93.1
93.4
45.9
81.9
61

Concatenation
93.0
93.6
44.5
81.3
144

  Joint Training
CUHK-SYSU
PRW
Inference

2-5  w/o RPN
mAP
top-1
mAP
top-1
Time

ROI-Align
90.4
91.3
43.9
81.5
75

AlignPS
93.2
92.8
44.9
80.0
61

Concatenation
94.3
94.8
48.6
83.2
75

ROI-Align*

93.4
93.8
47.5
84.5
75

  Joint Training
CUHK-SYSU
PRW
Inference

2-5  w/ RPN
mAP
top-1
mAP
top-1
Time

ROI-Align
93.3
93.9
47.8
83.3
75

AlignPS
94.0
94.1
46.4
81.2
61

Concatenation
95.0
95.3
50.3
84.3
75

**Is the ROI-Align branch necessary?** In ROI-AlignPS, the ROI-Align branch extracts the explicitly aligned re-id features, complementary to the implicitly aligned features in the AlignPS branch. To evaluate the effectiveness of this design, we test each branch under different settings. (1) *Separate Training/Test*, i.e., two person search models are separately trained and evaluated. During inference, we also concatenate the features from the ROI-Align model (with RPN) and the AlignPS model. (2) *Joint Training w/o RPN*, where the ROI-Align branch and the AlignPS branch are jointly trained, and both the training and test pipelines follow the structure in Fig. , i.e., no RPN is employed during training and inference. (3) *Joint Training w/ RPN*, which denotes the proposed ROI-AlignPS framework, where the training pipeline follows Fig. , and the test pipeline follows Fig. . In this case, RPN is only employed in the ROI-Align branch during training. As shown in Table , although the separately trained models both obtain promising results, directly concatenating their re-id features does not yield better performance, which may be because the detection results of the two models are not perfectly aligned. In our joint training setting, in contrast, the branch-level features are well aligned. When the ROI-Align branch is trained without RPN, although the performance of each branch is similar to the separately trained models, the concatenated re-id features are notably improved by 1.3% and 4.1% w.r.t. mAP on CUHK-SYSU and PRW, respectively. Moreover, when the ROI-Align branch is trained with RPN, the performance of this branch is further improved, which in turn yields enhanced performance by concatenating the re-id features. These results not only indicate that the jointly training pipeline can better regularize features in the shared layers (i.e., res1-4), but also validate the effectiveness and necessity of the ROI-Align branch, which is complementary to AlignPS.

**How does the ROI-Align branch influence the efficiency?** In ROI-AlignPS, the ROI-Align branch inevitably brings additional computational overhead. As shown in Table , in the inference stage, it takes 75 milliseconds (ms) to process an image with both AlignPS and ROI-Align, in comparison to 61 ms for AlignPS only. However, this is still less than the Faster R-CNN based ROI-Align model (83 ms), because our model does not require dense region proposals during inference. Therefore, ROI-AlignPS achieves significant performance improvement and remains highly efficient.

Comparative results on CUHK-SYSU and PRW with mutual learning loss function.

height 1pt

CUHK-SYSU
PRW

2-5
mAP
top-1
mAP
top-1

None
95.0
95.3
50.3
84.3

ℒmi
95.4
96.0
51.6
84.4

Comparison with state-of-the-art methods. The upper block lists the results of one-step models, while the lower block shows the results of two-step methods.

height 1pt

CUHK-SYSU
PRW

3-6
mAP
top-1
mAP
top-1

OIM
75.5
78.7
21.3
49.4

IAN
76.3
80.1
23.0
61.9

NPSM
77.9
81.2
24.2
53.1

RCAA
79.3
81.3
-
-

CTXG
84.1
86.5
33.4
73.6

QEEPS
88.9
89.1
37.1
76.7

HOIM
89.7
90.8
39.8
80.4

BINet
90.0
90.7
45.3
81.7

NAE
91.5
92.4
43.3
80.9

NAE+
92.1
92.9
44.0
81.1

PGA
92.3
94.7
44.2
85.2

DKD
93.1
94.2
50.5
87.1

SeqNet
93.8
94.6
46.7
83.4

SeqNet+CBGM
94.8
95.7
47.6
87.6

AlignPS
93.1
93.4
45.9
81.9

${{\color{red}{(128)}}}$
94.5
95.2
50.7
84.0

ROI-AlignPS(256)
95.4
96.0
51.6
84.4

DPM+IDE
-
-
20.5
48.3

CNN+MGTS
83.3
83.9
32.8
72.1

CNN+CLSA
87.2
88.5
38.7
65.0

FPN+RDLR
93.0
94.2
42.9
70.2

IGPN
90.3
91.4
47.2
87.0

OR
92.3
93.8
52.3
71.5

TCTS
93.9
95.1
46.8
87.5

**Are the mutual learning strategies effective?**

## Comparison to State-of-the-Art Methods

We compare our framework with state-of-the-art one-step models and two-step models .

Comparison with state-of-the-art methods on PICWD and  dataset.

height 1pt

PICWD

2-5
mAP
top-1
mAP
top-1

DC-I-Net
-
-
48.5
51.0

NAE
41.3
65.1
45.3
47.6

NAE+
42.6
66.5
46.9
48.7

SeqNet
44.7
68.2
51.2
53.4

AlignPS
47.3
70.1
51.8
53.7

ROI-AlignPS(128)
48.8
70.5
54.0
56.6

ROI-AlignPS(256)
49.5
71.3
54.6
57.3

**Results on CUHK-SYSU**. Note that SeqNet requires a graph matching strategy as post-processing to achieve its best performance, while ROI-AlignPS does not need such a process. We also observe from the table that our model outperforms all the two-step models, even though they employ two separate models for detection and re-id. In contrast, our model allows joint inference with a very simple structure, whilst running at a higher speed.

We visualize the results of AlignPS and ROI-AlignPS w.r.t. mAP with various gallery sizes and compare our model with both one-step and two-step models. Fig.  illustrates the detailed results, where ROI-AlignPS outperforms all the models by notable margins, in terms of all the gallery sizes.

**Results on PRW**. PRW contains less training data; therefore, all the models achieve worse performance on this dataset. Nevertheless, as can be observed from Table , ROI-AlignPS still outperforms all the one-step models in terms of mAP. We notice that DKD , PGA , IGPN , and TCTS achieve higher top-1 accuracy on PRW. These methods also seek to address the feature misalignment issue, but they either resort to feature distillation from the cropped instances , or apply attention mechanisms . Differently, our model efficiently addresses this issue with the proposed AFA module.

**Results on PICWD **. As PICWD and Webtatto only annotates the small dorsal fin and the tattoo area, it is more challenging to locate and identify the Chinese dolphins and tattoos. By comparing our framework with DC-I-Net , NAE  and SeqNet  in Table , we obeserve that both AlignPS and ROI-AlignPS consistently achieve higher performance, which makes it a more general framework for animal and object search.

Runtime comparison of different models. Both AlignPS and ROI-AlignPS are anchor-free during inference.

height 1pt

Methods

Train Anchor
Test Anchor
GPU
Time (ms)

PGA
✓
✓
Titan X
356

DKD
✓
✓
1080 Ti
124

OIM
✓
✓
V100
118

NAE+
✓
✓
V100
98

NAE
✓
✓
V100
83

SeqNet
✓
✓
V100
86

AlignPS
×
×
V100
61

ROI-AlignPS
✓
×
V100
75

``\color{red}{
\begin{tabular}{p{1.5cm}<{\centering}p{1.1cm}<{\centering}p{1.3cm}<{\centering}p{1.cm}<{\centering}p{1.5cm}<{\centering}}
\hline%
    \noalign {\ifnum 0=`}\fi \hrule height 1pt
    \futurelet \reserved@a \@xhline

\rowcolor{mygray}
Query Number &IGPN~\cite{DBLP:conf/cvpr/DongZST20}   &QEEPS~\cite{DBLP:conf/cvpr/MunjalATG19} &AlignPS &ROI-AlignPS\\  \hline \hline
1  & 6s &30s  &7s & 8s \\
10  & 60s &300s  &8s & 9s \\
100  & 600s &3000s  &14s & 17s \\
1000 & 6000s &30000s  &77s & 93s
\\\hline
\end{tabular}
}``{=latex}

**Efficiency Comparison**. Since different methods are evaluated with different GPUs, it is difficult to conduct a fair comparison of the efficiency among all the models. Here, we compare our method with OIM[^2] , NAE/NAE+  and SeqNet  on the same Tesla V100 GPU. All the test images are resized to 1500$\times$`<!-- -->`{=html}900 before being fed to the networks. As shown in Table , our anchor-free AlignPS only takes 61 ms to process an image, which is 27% and 38% faster than NAE and NAE+, respectively. Meanwhile, ROI-AlignPS also runs faster than prior state-of-the-art models . This is because our models are anchor-free during inference, validating the advantage of the proposed framework.

**Qualitative Results**. Some qualitative results on person search are illustrated in Fig. , while the animal and tattoo search results are illustrated in Fig. . We observe that AlignPS and ROI-AlignPS are more robust in handling occlusions, scale and viewpoint variations, where OIM, NAE, and SeqNet fail. Some failure cases can be observed in distinguishing very tiny objects or the objects that share similar appearances, we will further work towards this direction in our future work.

# Conclusion and Future Work

In this paper, we propose an anchor-free approach to efficiently tackling the task of person search, by developing a framework based on an anchor-free detector. We design the aligned feature aggregation module to effectively address the scale, region, and task misalignment issues when accommodating the detector for the person search task. Furthermore, we propose to augment our anchor-free model with an ROI-Align branch, which additionally takes advantage of the anchor-based models. Extensive experiments on person search, animal search, and object search demonstrate that the proposed framework not only outperforms existing person search methods but also runs at a higher speed.

[^1]: <https://github.com/PICWD/PICWD>

[^2]: We test the PyTorch implementation at <https://github.com/serend1p1ty/person_search>.


abstract: Although the role of lateral gene transfer is well recognized in the evolution of bacteria, it is generally assumed that it has had less influence among eukaryotes. To explore this hypothesis we compare the dynamics of genome evolution in two groups of organisms: Cyanobacteria and Fungi. Ancestral genomes are inferred in both clades using two types of methods. First, $Count$, a gene tree unaware method that models gene duplications, gains and losses to explain the observed numbers of genes present in a genome. Second, ALE, a more recent gene tree-aware method that reconciles gene trees with a species tree using a model of gene duplication, loss, and transfer. We compare their merits and their ability to quantify the role of transfers, and assess the impact of taxonomic sampling on their inferences. We present what we believe is compelling evidence that gene transfer plays a significant role in the evolution of Fungi.
author: Gergely J. Szöllősi$^1$, Adrián Arellano Davín$^2$, Eric Tannier$^{2,3}$,
Vincent Daubin$^{2,4}$, Bastien Boussau$^{2,4}$
bibliography: biblio.bib
title: Genome-scale phylogenetic analysis finds extensive gene transfer among Fungi

Bastien Boussau, Laboratoire de Biométrie et Biologie Evolutive, Centre National de la Recherche Scientifique, Unité Mixte de Recherche 5558, Université Lyon 1, F-69622 Villeurbanne, France; Université de Lyon, F-69000 Lyon, France; E-mail: firstname.lastname@example.com

# Introduction

Reconstructing genome evolution and ancestral genomes is instrumental to understanding the diversification of life on Earth. Doing so requires harnessing the information available in complete genome sequences, which is best achieved in a statistical framework. Integrative methods to reconstruct the evolution of genomes and thus ancestral genomes are now able to model particular histories of genes inside a general history of genomes and can integrate many different types of events. They integrate sequence-level events such as substitutions, gene-level events such as duplications (D), losses (L), and exchanges of genes between genomes, modeled by lateral gene transfers (hereafter transfers, T), as well as genome-level events such as speciations (S). This inclusiveness enables them to handle diverse groups of organisms, each with their idiosyncratic way of evolving. It therefore becomes possible to apply a single method to groups from different domains of life, and compare their modes of evolution.

Reconstructing ancestral genomes requires *a minima* two types of data: extant genomes with homology relationships between genome fragments, and a tree along which these genomes are supposed to have evolved. A species tree modeling vertical descent is indispensable, because without it, we cannot differentiate vertical inheritance from lateral transfer, and little can be learned about the processes of genome evolution.

Using a common species tree does not mean that we assume that all homologous fragments have had the exact same history. Instead, the history of each individual homologous fragment is reconstructed, with its own succession of duplications, losses and transfers. For species that have diverged a long time ago, only the protein coding portion of the genomes is analyzed, and individual histories are reconstructed for each gene family. These gene histories are subsequently analyzed together to gain insight into genome evolution, and infer large-scale patterns of gene duplications, losses, or transfers. Both steps, first gene tree reconstruction and second aggregation of gene histories into coherent patterns, necessitate thoughtful methodologies to overcome possible sources of errors and uncertainties.

## Reconstruction of gene histories

Gene sequences are often too short to contain sufficient information for accurate and robust reconstruction of the history of a gene family; worse, even when this information is present, models of sequence evolution may fail to capture it correctly. In general, a gene family's history cannot be reliably inferred, nor interpreted in terms of gene-level events from the set of sequences alone . Using additional information coming from the species tree is a way to improve gene tree quality (Fig. ). This is the approach taken by "Gene tree-aware approaches". Alternatively, it is possible to entirely do away with the sequences and avoid gene tree reconstruction: the gene tree unaware "Gene content approach" considers only gene presence/absence patterns, or numbers of genes per species.

### Gene content approaches

Gene content approaches work with data in the form of either presence/absence of a gene family inside a given genome, or numbers of genes of a gene family inside a given genome (Fig. ). In both cases, parsimony approaches or probabilistic models have been used to reconstruct the evolution of gene families along a species phylogeny.

Among parsimony methods, one can choose between Wagner and Dollo parsimony. Choosing Dollo parsimony amounts to making a strong assumption about the pattern of gene family evolution, as it means that a gene family can be gained only once, on a single branch of the species phylogeny. In short, this means that gene transfers are forbidden. Wagner parsimony can be more moderate in its assumptions, but still requires that costs be defined for all types of events involved in gene family evolution, *i.e.* duplications, transfers, losses. There is no objective way to set these costs, and users often try a range of costs, eyeball the results, and choose the costs that produce the evolutionary scenarios that seem most reasonable . The most systematic approaches use ancestral genome sizes to pick costs that generate ancestral genomes that are neither too big nor too small, but still lack a proper statistical framework .

Probabilistic approaches either rely on an *ad hoc* adaptation of substitution models used to describe sequence evolution , or rely on a birth-death model that includes rates of gene duplication, transfer, and loss . They can include corrections for unobserved data, *i.e.* gene families that are present in none of the sampled species but that were present in ancestral species . These approaches do not require arbitrary choices of costs: instead rates are estimated from the data. Different models can then be tested against each other, for instance to test whether there is significant support for the presence of gene transfer in the data. These tests rely on the well-known machinery for model testing, and include likelihood ratio tests, Akaike or Bayesian Information Criterion, or Bayes factors if inference is performed in a Bayesian setting.

Whether they are analyzed by parsimony or probabilistic approaches, gene content data are limited in their ability to detect events of gene family evolution. Even the approaches that use the numbers of genes and not just their pattern of presence/absence will make mistakes that approaches based on the consideration of gene tree topologies could avoid, if the gene trees are accurately reconstructed (see middle graph in Fig. ).

### Gene tree-aware approaches

Most gene families share parts of their histories, *i.e.* have been inherited together from ancestors to descendants during parts of their history (Fig. ). If we can reconstruct the parts of their histories where genes have co-evolved, then jointly reconstructing gene histories can be very helpful, because more information is available to reconstruct each gene history. In cases where there is no gene transfer, then all genes share a common pattern of descent along the species tree. When genes can be transferred, they may share only part of their history with other gene families.

Gene tree-aware approaches were first used to deal with incomplete lineage sorting (ILS) through the multispecies coalescent . In that framework, all gene families have evolved within the boundaries of the species history, and heterogeneities among gene histories originate from population-level sorting of alleles only. More recently, similar models have been proposed to deal with other processes of genome evolution, namely gene duplication, transfer, and loss (DTL). For an in-depth review, please see . With these models, gene families can have a wider array of histories, and can differ drastically from the species tree. Invariably, whether they deal with ILS or DTL events, gene tree-species tree models have been found to produce gene trees that are more accurate than competing approaches. This is expected: as more information is used to reconstruct gene trees, stochastic error should diminish.

Much like gene content approaches, gene tree-aware approaches can be based on probabilistic models that include parameters for DTL events , or on parsimonious models, in which case DTL events are associated with costs . Gene tree-species tree approaches however are computationally challenging. Interpreting a gene tree in the light of a species tree by placing events of gene duplication, transfer and loss, a process called *reconciling* a gene tree, is not difficult provided rates or costs of events are provided. Things get more complicated when the gene tree is not assumed to be known, and needs to be reconstructed. Naturally, if the species tree itself also needs to be reconstructed, then the task becomes extremely difficult; however in the rest of this article we will assume the species tree is known without uncertainty.

Methods to reconstruct gene trees using gene tree-aware approaches can use tree exploration heuristics similar to those found in commonly-used programs for phylogenetic tree reconstruction , as in Phyldog or in DLRS . These approaches however tend to be slow, which motivated other approaches based on the consideration of a set of candidate gene trees obtained using faster approaches that do not consider a species tree. These approaches include TreefixDTL , ALE and TERA . The latter two approaches are extensions of an idea initially proposed in and formalized in and are particularly fast and accurate. They are based on the "amalgamation" idea. Based on a sample of gene trees, amalgamation is a dynamic programming algorithm that allows the exhaustive exploration of a large space of gene trees. In fact, based on a limited set of gene trees, amalgamation allows considering a much larger space of gene trees, because it can piece together clades from several trees at a time to generate new trees, not present in the initial sample of gene trees. This technique is found to improve on competing approaches in both speed and accuracy.

Probabilistic gene tree-aware approaches can also be used to date trees. In such cases, gene tree-aware models often reconstruct ultrametric gene trees, a model describing the rate of sequence evolution needs to be used, and an ultrametric species tree whose nodes are anchored in time is required . Although these models contain additional parameters that need to be estimated, and are therefore computationally more complex to handle, they provide the ability to date events of gene family evolution along with the ability to estimate rates of events. Rates of events can then be compared across clades, although Fig.  is here to remind us that taxonomic sampling can have a non-trivial impact on the rates of reconstructed events. Another set of approaches avoids modelling the rate of sequence evolution and yet anchors events in time . These approaches use a rooted ultrametric species tree in which nodes are ordered relative to each other, and mandate that transfers occur only between contemporaneous lineages. Gene trees however do not need to be ultrametric, which makes it possible to avoid using a model describing the rate of sequence evolution. Whether they use models describing the rate of sequence evolution or not, models that use ultrametric species trees are more realistic than models in which the nodes of the species tree are not ordered, because they include the constraint that only contemporaneous lineages can exchange genes; however, this constraint comes at a high computational cost.

### The impact of incomplete taxonomic sampling

No matter how complex our models of genome evolution, our inferences depend on the sampling of our data set (Fig. ). Although progress in sequencing methods is moving at a fast pace, and genome sequences keep accumulating in databases, we will always be missing a clade or species that will prevent our data sets from being complete. It is unclear how such missing data impacts our inferences. Fig.  shows that missing species can lead to incorrectly interpret transfer events as duplication events, both for gene content and gene tree-aware approaches, but the magnitude of this effect is unknown. Worse, if our sampling of a clade misses a group of species with idiosyncratic characteristics (e.g. larger genomes, larger rates of gene transfer...), then our estimate of the parameters of genome evolution for this group will be biased. In the hope of achieving an unbiased estimate of genome evolution, it is important to try to quantify the bias imposed by incomplete taxonomic sampling.

### Comparing gene tree-aware and unaware approaches

Although reconstructing genome evolution is a widely pursued endeavour, there have been few assessments of the inference methods used to reconstruct gene histories along the species tree. In this article we compare gene-content approaches with gene tree-aware approaches by using publicly-available software on two well-known clades in the tree of life. We use a state-of-the-art probabilistic gene-content approach, $Count$  , and a probabilistic gene tree-aware approach, $ALEml\_undated$  (available at https://github.com/ssolo/ALE), adapted to handle undated species trees. We address the impact of incomplete taxonomic sampling by performing rarefaction studies, whereby species are pruned from our species trees and DTL rates are compared across samples. Our primary aim is to focus on the inferences of the two methods and explain their differences in the light of their strengths and shortcomings. In the process, we will contrast genome evolution in Cyanobacteria and Fungi.

## Genome evolution in Fungi and Cyanobacteria

Fungi and Cyanobacteria *a priori* differ in the way their genomes have evolved. For instance Fungi undergo whole genome duplications, whereas such events have not been reported in Cyanobacteria. While gene transfer has been claimed to occur in both Cyanobacteria and Fungi, it is unclear how frequent this process has been in these two clades. Another question of interest concerns highways of gene transfers, *i.e.* pairs of branches or clades that appear to have undergone a high amount of gene transfers. While several highways of gene transfers have been claimed to exist in Bacteria, including in Cyanobacteria , it is unknown whether there are highways of gene transfers in Fungi as well.

Both Cyanobacteria and Fungi have been the focus of several studies addressing genome evolution, because they display a wide variety in cell types and genome sizes, and because they have had an important environmental impact throughout their history. In the context of this article, these clades constitute excellent case studies to assess the behaviour of gene content and gene tree-aware approaches because of their wide diversity in genome size, along with the fact that different evolutionary dynamics are expected in Eukaryotes and Bacteria.

### Genome evolution in Fungi

Fungi are characterized by two life forms: one, yeast-like, is unicellular. The other is multicellular and includes fungi with macroscopic fruiting bodies as well as filamentous fungi. In this study, we focus on the clade Dikarya, a subkingdom of fungi that account for roughly 98% of described species. This clade is composed of two well-characterized phyla, Basidiomycota and Ascomycota. We use the genome sequences included in the HOGENOM database . These two clades display a wide variety in genome sizes (from 5,200 to 10,000 protein coding genes, approximately), and have a phylogeny that can be unambiguously rooted between Basidiomycota and Ascomycota. Studies of genome evolution in these clades have focused for instance on the impact of whole genome duplications , on the evolution of the yeast (unicellular) form , or on the evolution of pathways for the decomposition of plant material . Recently, there have been reports of noticeable amounts of gene transfers in Fungi . In particular several examples indicate that the *Aspergillus* genome has been "sculpted by gene transfer". This is consistent with reports that lateral gene transfers have been important throughout eukaryotic evolution .

### Genome evolution in Cyanobacteria

Cyanobacteria contain both unicellular organisms as well as organisms with two cell types, or that organize in filaments, which makes them unique among Prokaryotes for their ability to leave a recognizable trace in the fossil record . They display a wide range in genome size (from 1,200 to 4,500 protein coding genes, approximately), and have had a lasting impact on the Earth with the release of massive amounts of oxygen in the atmosphere billions of years ago . From a phylogenomics perspective cyanobacterial genomes share a relatively large core genome that allows the reconstruction of a well supported species phylogeny despite the antiquity of the phylum. Cyanobacteria have also served as a model system for investigating horizontal gene transfer , and have been reported to display highways of gene transfers .

# Methods

## Data set construction

### Fungi

First, we selected all the species belonging to Fungi in the HOGENOM6 database, yielding 32 species. We retrieved the protein sequences clustered into homologous gene families (21701 families, discarding the very large families HOG100000000, HOG200000000 or HOG300000000, for which no alignment is available in the database). We discarded 8662 families containing only 2 or 1 genes from Fungi. Gene trees were constructed for 1791 families containing only three genes (triplets), for which a single topology is possible. We aligned all families with 4 sequences or more using MUSCLE with default parameters and selected reliably aligned sites using GBLOCKS . The parameters employed were "minimum number of sequences for a conserved position" b1 = 50, "minimum number of sequences for a flank position" b2 = 50 and "allowed gap positions" b5 = a (all). To estimate computing time per family, we measured the time PhyloBayes took to compute 10 trees based on each alignment. We discarded the decile of the slowest families. For each remaining alignment we ran 2 chains using PhyloBayes, calculating 5500 gene trees (discarding the first 500 as burn-in), using the LG model of evolution . In the end we were able to compute at least one chain for 9596 gene families. Combined with the 1791 triplets, our data set contains in total 11387 gene families, totaling 135346 genes, while 24327 genes were discarded during our selection process (not counting the three HOGENOM families without alignments).

Given that the tree of Fungi is still unresolved with Microsporidia branching in an undefined place, we decided to use a smaller dataset, comprising the clade of Dikarya (28 species). This has the advantage that this clade can be easily rooted between Ascomycota and Basidiomycota. We pruned the gene trees removing from them two species of Microsporidia as well as *Allomyces macrogynus* and *Spizellomyces punctatus*, which belong to other basal clades of Fungi. In total, we used 11295 gene families. The gene trees are well resolved with an average posterior support of 0.97 (median=1).

Due to the uncertain position of *Aspergillus nidulans*, we relied on two species trees: one reconstructed from a concatenate, and one drawn from the literature. For our first tree, which we call tree A, we used a concatenate of 529 near universal single-copy gene family alignments (25 or more species represented out of 28). In total the alignment contained 221 127 amino-acid sites including 24 514 without missing data. Both PhyML using the LG model of evolution and a Gamma distribution to account for rate variation and Phylobayes using the CAT model with Poisson exchangeabilities recovered the same topology. We rooted the species tree between Ascomycota and Basidiomycota. The resulting phylogeny identifies the major clades, Pezizomycotina, which groups *Neurospora crassa* and *Aspergillus* fungi, and Saccharomycotina, which notably groups *Yarrowia lipolytica*, *Candida* species, and *Saccharomyces*. Our phylogeny is in agreement with the phylogenies of , but in their study the position of *Aspergillus nidulans* changes depending on the method: a concatenate based on 153 universal genes places it next to *Aspergillus fumigatus*, as we do, but supertree methods find it at the base of the *Aspergillus* clade. To account for these discrepancies, we reconstructed a second species tree where *Aspergillus nidulans* is at the base of the *Aspergillus* clade. We call this tree B, and estimated its branch lengths using PhyML with the same model as above. Tree A and Tree B can be found in the supplementary material.

### Cyanobacteria

We selected all the species belonging to Cyanobacteria in the HOGENOM6 database, yielding 40 species. We reconstructed an unrooted species phylogeny using PhyML using the LG model of evolution and a gamma distribution to account for rate variation from a concatenate of 470 near universal single-copy gene family alignments (38 or more species represented out of 40). In total the alignment contained 126 180 amino-acid sites including 67 646 without missing data. The resulting tree agreed with our genome-scale reconstruction and other previous phylogenomic results (see discussion in , available in the supplementary material). We rooted the species tree according to . For 7415 gene families with 3 or more genes we employed the alignment procedure and sampling procedure described above. The gene trees are well resolved with an average posterior support of 0.96 (median=1).

## Inference methods

### $Count$

$Count$ is a software package for performing studies in gene family evolution. It can perform ancestral genome reconstruction by posterior probabilities in a phylogenetic birth-and-death model . Rates were optimized using a Gain-loss-duplication model, with default parameters and allowing different gain-loss and duplication-loss rates for different branches. One hundred rounds of optimization were computed.

### $ALEml\_undated$

$ALEml\_undated$ implements a probabilistic approach to exhaustively explore all reconciled gene trees that can be amalgamated as a combination of clades observed in a sample of gene trees in the context of different species tree-gene tree reconciliation models, in particular the model described in , which allows for the duplication, transfer and loss of genes. ALE can be used to efficiently approximate the sum of the joint likelihood over amalgamations and to find the reconciled gene tree that maximizes the joint likelihood among all such trees or sample the space of possible reconciliations. Here, we use two reconciliation methods, a simplified Duplication, Transfer and Loss (DTL) approach that does not consider the temporal information from the species tree, and a version of this model that only allows Duplication and Loss (DL). These methods are available as part of the open-source ALE project ( https://github.com/ssolo/ALE ).

## Analyses

Highways were identified between pairs of species that exchange large numbers of genes. The number of genes exchanged was averaged over 100 reconciliations drawn from $ALEml\_undated$using the program ALEsample, and summed across all gene families in our datasets.

Synteny information was extracted from gene positions in the genomes. Pairwise comparisons of genomes between species were performed. Synteny was found to be conserved if a gene had as a neighbor a gene whose ortholog was also its own ortholog's neighbor. For simplicity, only gene families with one gene per species were considered in the synteny analyses. For a given pairwise comparison, a gene was declared as non-transferred if, along the path between two species, no transfer event had affected the gene of each species, and declared as transferred otherwise.

# Results

## General patterns of genome evolution

Fig.  and show the reconstruction of genome evolution across Fungi and Cyanobacteria, respectively, using both $Count$ and $ALEml\_undated$. Although $Count$  and $ALEml\_undated$  differ in their input data and in the types of events they can detect, their inferences are qualitatively similar, finding comparable genome size dynamics, and proportions of events on branches.

In both Cyanobacteria and Fungi, with both methods, a clade with large genomes (multicellular *Aspergillus* clade of molds and the clade including freshwater and multicellular cyanobacteria such as *Nostoc* and *Cyanothece*) and a clade with smaller genomes (unicellular clade of yeasts including *Saccharomyces* and *Candida* and unicellular planktonic cyanobacteria including *Prochlorococcus* and *Synechococcus*) can be observed.

In Fungi, the clade with large genomes (fungi from the multicellular *Aspergillus* clade of molds) shows a large portion of gene transfers on several of its branches, whereas gene transfers appear much less prevalent in the clade with small genomes (containing the unicellular yeasts). This result confirms earlier reports based on smaller data sets of larger amounts of gene transfers in the *Aspergillus* clade than in the yeast clade . Several branches show an excess of gene duplications compared to gene transfers. Although a whole genome duplication (WGD) occurred in the ancestor of *Saccharomyces cerevisiae* and *Candida glabrata* , both models fail to pick an increased amount of gene duplications on the relevant branch. They recover an increased amount of duplications on the branch leading to *Saccharomyces cerevisiae* alone, possibly because *Candida glabrata* has lost a large number of genes, which, in the absence of synteny (which was used by to detect the WGD), may have erased a large part of the signal supporting the whole genome duplication. The ancestor of all Dikarya is predicted to have a very small genome, which is likely the consequence of our unbalanced taxonomic sampling, with only 3 Ascomycota. Due to this design, families present only in 2 Ascomycota have been discarded from our data set, and therefore cannot be inferred at the root.

In Cyanobacteria, both the clades with large and small genomes appear to have similar genome dynamics, with more gene transfers than gene duplications. The ancestor of Cyanobacteria is predicted to have intermediate genome content in between that of the clade with small genomes (containing *Prochlorococcus* species) and that of the clade with larger genomes.

## Gene tree-aware approaches are more sensitive than gene content approaches

By design, gene tree-aware approaches can detect more events than gene-content approaches (Fig. ). Consistently, $ALEml\_undated$ finds significantly more transfers than $Count$, with $ALEml\_undated$  finding an average of $0.16$ and $0.07$ transfers per gene in respectively Cyanobacteria and Fungi, in contrast to $Count$, which finds $0.14$ and $0.06$. It is difficult to determine how many of the additional transfers are due to $ALEml\_undated$ finding true transfer events that $Count$  failed to detect and how many result from errors in reconstructed gene trees. Simulations do indicate that ALE recovers an unbiased estimate of the number of transfers , and in the case of Cyanobacteria reduces the number of inferred transfers by approximately two-thirds compared to gene trees reconstructed without the species tree (by PhyML). Furthermore, Fig. A shows that for cyanobacterial famillies represented in $8$ or fewer genomes the $ALEml\_undated$ and $Count$ estimates closely agree. Regardless of potential overestimation of the number of transfers, Fig. A also highlights that the number of transfer events per gene family is more-or-less homogeneous with respect to the number of species represented in the gene family for $ALEml\_undated$, but systematically decreases for $Count$ as more complete taxonomic distributions are approached. We see no biological reason why e.g. families with a complete taxonomic distribution would undergo much fewer transfers compared to families with slightly incomplete taxonomic sampling. Instead, we believe this effect results from a shortcoming of gene tree unaware methods, such as $Count$, whereby they are not able to infer transfer among families with complete taxonomic distribution, and progressively lose signal as complete taxonomic distribution is approached.

## Duplication and loss methods systematically overestimate ancestral gene content

The effect of gene transfers on gene phylogenies can be mimicked by a combination of gene duplications and losses. Therefore gene duplications and losses may be sufficient to account for genome dynamics in our two clades, and it is legitimate to ask about the need to incorporate transfers. As shown in Fig. B comparison of the gene content of extant genomes and reconstructions based on gene-tree aware reconstruction that considers transfer (DTL) shows that these methods reconstruct ancestral gene contents that are similar to those observed for extant genomes. In stark contrast, gene-tree aware reconstructions that only account for duplications and losses, but do not consider transfer (DL), infer systematically more genes to have been present in ancestral genomes than in extant ones. The largest ancestral genomes are inferred by DL methods in the common ancestors of clades where DTL methods predict the most transfers: the deepest node in the *Aspergillus* genus has ancestral gene contents of 14244 genes according to the DL estimate, in comparison to 8238 genes for the DTL based estimate. The extant gene content in the genus in our sample is between 7797 (Aspergillus fumigatus A1163) and 8891 (*Aspergillus terreus*).

## Rates of transfers are similar in Fungi and Cyanobacteria

Rates of transfer in Fungi and in Cyanobacteria appear to be very similar, as shown by the $ALEml\_undated$ inferences (Figure A). This finding does not come from differences in the age of the clades as we compare ratios of numbers of events, which controls for age. It does not appear to come from incomplete sampling either, as Figure B shows that predictions based on subsampling the species in each data set still converge to similar ratios of numbers of events for Fungi and Cyanobacteria. To extrapolate the $T/(T+D)$ values we fit an *ad hoc* curve that reaches saturation exponentially starting from an initial value for $0$ species. Using all subsampled replicates a least-squares Marquardt-Levenberg algorithm yielded the similar asymptotic values of $T/(T+D)$, with $0.8\pm 0.1$ (Fungi assuming tree A), $0.7\pm 0.03$ (Fungi assuming tree B) and $0.74\pm 0.01$ in Cyanobacteria. The same procedure for $L/(T+D+L)$ produced the slightly higher asymptotic value for Fungi of $0.582 \pm 0.01$ for tree A and $0.595 \pm 0.01$ for tree B, compared to $0.52 \pm 0.01$ compared to Cyanobacteria.

These genome-wide inferences confirm earlier reports based on manual analyses of smaller data sets that significant numbers of transfers occurred in Fungi, in particular in the *Aspergillus* clade . Overall, these data show that genomes in Prokaryotes and Eukaryotes are not undergoing fundamentally different dynamics. We consider that additional analyses of data sets for different clades of both Prokaryotes and Eukaryotes, using gene tree-aware approaches as in this work, would provide a more fine-grained, quantitative view of the dynamics of genome evolution across the entire tree of life.

## There are highways of gene transfer in Fungi

One feature of genome evolution in Prokaryotes that has received considerable attention is the concept of highways of gene transfers . According to this model, some pairs of species or clades have exchanged large numbers of genes throughout their history, possibly because of a shared ecological niche. $ALEml\_undated$  inferences provide us with an opportunity to look for such highways in Cyanobacteria and Fungi. Fig.  shows the distribution of the number of transfers per pairs of branches of the species tree in both Cyanobacteria and Fungi. Both distributions show a long tail, with many transfers occurring between branches that otherwise have exchanged little genetic material. However, some pairs of branches show very high numbers of gene transfer events. The heterogeneity is strongest in Fungi, where some pairs of branches are predicted to have undergone more than 150 gene transfers, or even 300 transfers on tree B (Fig. ). These transfers do not seem to be due to hybridization, as most of them are not replacement transfers, whereby a gene in a species is replaced by another gene coming from another species (the median branch-wise fraction of gene transfers that are compensated by loss on the same branch, *i.e.* replacement transfers, is 31% for Fungi on tree A , 34% on tree B and 49% for Cyanobacteria). For the same reason, these transfers cannot be misinterpreted events of incomplete lineage sorting. In fact, among genes that have only one ortholog per species, genes that have undergone a gene transfer tend to change position on the chromosome more often than genes that have not undergone a gene transfer (see Fig. , right, for the *Aspergillus* clade). The pairs of branches with the largest numbers of transfers belong to the *Aspergillus* clade, in agreement with the overall larger amount of transfers detected in this clade and in agreement with previous reports . The species involved in the largest number of transfers in either tree A or tree B is *Aspergillus nidulans*, precisely the species whose position is contentious. This suggests that lateral gene transfers in Fungi may be significant enough to make reconstruction of the species phylogeny difficult. Although deeper sampling could change the numbers of gene transfers found on each pair of branches, for instance by breaking branches involved in a highway, it seems unlikely that the conclusion that there are branch pairs or group of branches exchanging large numbers of genes in Fungi would change.

## Genes tend to be transferred together

The distribution of transferred genes along chromosomes appears to be consistent with the transfer of chromosomal segments that can include more than one gene. Counting only transfers to the terminal branches, transferred genes appear preferentially next to another transferred gene: on average, 4.7 times more often in Fungi (on tree A, 6.1 times more often on tree B), and 5.3 times more often in Cyanobacteria. Given that genes transferred on terminal branches make up a minority of the genomes, this means that transfers tend to affect blocks of several genes at a time.

## $ALEml\_undated$reconstructs accurate gene trees

In , we found using realistic simulations that amalgamation of gene trees using a DTL model produced accurate gene trees: the number of duplications and transfers needed to reconcile our reconstructed trees was statistically indistinguishable from the corresponding number of events needed to reconcile the "real" trees that had been used to simulate gene alignments. In the present study, empirical results also show that gene trees reconstructed by $ALEml\_undated$are accurate. First, the fact that the reconstructions of ancestral genome sizes based on our reconciled gene trees are not significantly different from extant genome sizes suggests that our gene trees do not contain large numbers of incorrect bipartitions. Second, the overrepresentation of transferred genes in tandem cannot be explained by random errors in gene trees, but shows that *bona fide* information can be retrieved from gene trees reconstructed by $ALEml\_undated$.

# Conclusion

Our genome-scale phylogenetic analysis of genome evolution in Cyanobacteria and Fungi shows that Fungi exhibit similar rates of transfers as Cyanobacteria, and display apparent highways of gene transfers. Whether these highways of gene transfers correspond to shared ecological niches or to particular mechanisms to incorporate foreign DNA remains to be investigated. In both clades, gene transfers appear to occur in blocks, not just one gene at a time. Further investigation of those transferred blocks of genes may prove useful for functional annotation, as co-transferred genes may be functionally related.

This study also allows the comparative study of different methodologies for reconstructing genome evolution. We show that the recent developments provide a framework adapted to different domains of life, and that gene tree-aware methods show more precision in the quantification of gene transfers.

Our results suggest that further analyses of data sets for other clades of Prokaryotes and Eukaryotes, using gene tree-aware approaches , will provide a more fine-grained, quantitative view of the dynamics of genome evolution across the tree of life.

# Acknowledgments

Data will be available on DataDryad upon acceptance. This project was supported by the French Agence Nationale de la Recherche (ANR) through Grant ANR-10-BINF-01-01 "Ancestrome". GJSz was supported by the FP7-PEOPLE-CIG grant "GENESTORY".