author: Guanwen Zeng; Daqing Li; Shengmin Guo; Liang Gao; Ziyou Gao; H. Eugene Stanley; Shlomo Havlin
bibliography: References.bib
title: Switch between critical percolation modes in city traffic dynamics

ritical phenomena of complex networks ranging from biology to engineering have attracted much attention . Studies on percolation , epidemic spreading , the Ising model etc. have uncovered the state transition process of different complex systems. As a typical dynamic complex system, traffic is frequently observed to have transitions between free flow and congestion states , where the critical transition point marks the possible balance between traffic supply and demand . With the rising traffic demand during urban agglomeration, the inescapable congestion will cost not only huge economic losses but also, generate pollutions and even psychological stress from road rage. Accordingly, many models have been applied to analyze the dynamic properties of traffic systems at macro or micro levels.

Different transition processes can be characterized by a unified approach if they have the same critical exponents, a characterization called "universality class" . These critical exponents determine the system behavior near the critical point of transition, which may help us to understand the system robustness and design a resilient system . For a given instance, urban traffic is organized as a network of local flows, which will become disintegrated under increasing perturbations. The system behavior near the critical point of this disintegration process determines the global operating efficiency of urban traffic and also, the possible mitigation strategies above the transition point. This urges us to explore the transition type of urban traffic, especially the unique way of its disintegration.

Instead of a 1D highway, urban traffic is the result of 2D spatial organization of functional roads, which can be described as a percolation process. The giant component of traffic percolation spanning over the whole-city traffic network will disintegrate into small clusters when only considering functional roads above a critical velocity threshold. Since a percolation transition can be characterized by critical exponents, a fundamental question can be raised: whether the percolation disintegration of city traffic during different traffic periods, such as rush hours and nonrush hours, belongs to the same or different universality classes. While previous studies have focused on effects of static network topology on critical exponents, the critical percolation behaviors of dynamic traffic network, to the best of our knowledge, have not been studied. The answer to the above question can help us to better understand the relation between formation and dissipation of traffic congestion. As we show here, our results indicate that the two modes are found to belong to different universality classes characterized by different critical exponents.

# Results

The traffic network is considered reliable only when it can convey flows to their destination within a reasonable time. In this sense, congested roads in the network become dysfunctional, and a dynamic network composed of only noncongested roads is available for the driver. The structure of this dynamic network is changing with time, which determines the drivers' travel time and the whole-network performance. From a starting node, the reachable area (or a distance) for a driver is always constant within a given time for a static network, while this is not the case for a traffic dynamic network . Our dataset covers the road network of the Beijing central area, which contains more than 50,000 roads as network links and around 27,000 intersections as network nodes. The velocity dataset covers real-time velocity records of road segments in October 2015, including a representative holiday period in China, the National Day (from October 1 to October 7). Velocity (kilometers per hour) is recorded by GPS devices in floating cars (e.g., taxies and private cars), with resolution of 1 min. We demonstrate in Fig. the reachable area as a function of travel time starting from a typical node near the city center. As time increases, the driver can visit larger areas until reaching the whole network. Between workday and holiday, the reachable area changes significantly for a given travel time. For example, in a holiday shown in Fig. *A*, the driver can reach within 15 min an average distance of around 11 km, and this reachable area will be extended to over 600 km$^2$ (a radius of over 25 km) in 30 min. However, for rush hours during a working day, heavy traffic slows down the velocities and significantly reduces the possible area that one can visit in the same duration (Fig. *B*). One can see from Fig. *C* that the reachable area fraction (indicated by the number of reachable nodes divided by the total number of nodes in the road network) will undergo a major decrease at a rush hour instance on a working day compared with the same time on a holiday. Similar results are shown in Fig. *D*, for the dynamic traffic network during the holiday, drivers can visit a much farther distance in the functional network with higher velocities and less traffic than on workdays.

Evolution of the dynamic traffic network influences not only the travel efficiency but also, the robustness of this functional network. For holiday, this dynamic network has few link losses (which are below the typical velocity of about 40 km/h) and is close to the original (structural) road network due to the free traffic (Fig. *A*). For rush hours during workdays, highways and other roads become congested due to intensified demand. The large amount of congestion disintegrates the whole dynamic traffic network into isolated functional clusters (connected roads with high speed) (Fig. *B*). As shown in Fig. *C*, the number of isolated functional clusters is increasing during rush hours on both workdays and days off; however, the network is significantly more fragmented on workdays during rush hours, with a much larger number of clusters.

To further investigate the differences in the dynamic organization of the traffic network in the two phases (i.e., rush hours and nonrush hours), we perform a percolation analysis (by calculating the size of the giant component) by deleting the roads with velocity (relative to the maximum velocity) (*SI Appendix*) below *q* from the original road network. In this way, the giant percolation cluster decreases as we increase *q*. The giant component in Fig. *D* shows a phase transition with increasing *q* and becomes fragmented at a critical point (*SI Appendix*, Fig. S1 has more examples). Note that the giant component is decreasing lower and much faster at a morning rush hour instance (8:00 AM) during a workday than during a holiday. This has been further supported with good statistics (*SI Appendix*, Fig. S2) that the giant component during days off and workdays has different distribution at rush hours, raising the possibility of two percolation modes for traffic.

Next, we calculate the size distribution of finite clusters of free flows near the critical threshold for the different periods. Fig. *A* and Fig. *B* demonstrates on the workdays the variation of size distribution of finite clusters in the percolation during rush hours and nonrush hours, respectively. At criticality, it is suggested that the size distribution of finite clusters follows a power law :

$$\begin{aligned}
n_s \sim s^{-\tau} \numberthis \label{eqn:powerlaw}
\end{aligned}$$

Here *s* is the cluster size, $n_s$ is the ratio between the number of *s*-size clusters and the total number of clusters, and $\tau$ is the corresponding critical percolation exponent. This power law feature can also be seen in day off results in Fig. *C*. As seen in Fig. *A* and Fig. *B*, above the threshold (i.e. $q_c$(*t*)+0.1, $q_c$(*t*)+0.2), only small clusters composed of high-speed links exist, and the size distribution seems to decay faster than a power law. The change from a power law at criticality to a stronger decay when further from criticality is a sign of $q_c$(*t*) being a critical point . As *q* approaches to the critical threshold $q_c$(*t*), a large cluster (i.e., the giant component) appears, representing the global traffic flow in the traffic network. The same happens when *q* decreases below $q_c$(*t*) (i.e. $q_c$(*t*)-0.1, $q_c$(*t*)-0.2), the scale of the giant component increases, since more finite clusters are merged into the giant component. Accordingly, the number of finite clusters decreases, leading to a more skewed tail in the size distribution. This behavior further supports the critical percolation hypothesis of traffic flows.

Focusing on the traffic percolation behavior at criticality, we find that the critical exponent of cluster size distribution (denoted by $\tau$) during rush hours on workdays is in general smaller than that during nonrush hours, with values of about 2.07 and 2.33, respectively. However, this difference of critical behavior during different periods does not appear in days off as seen in Fig. *C*. Moreover, the critical exponent during nonrush hours on working days is almost the same as that during days off. These results, therefore, indicate that two modes of percolation critical behaviors exist, suggesting different universality classes for different periods.

Furthermore, we calculate the specific critical exponents of each period for 29 d in 2015 as shown in Fig. *D*. We can see systematic differences in $\tau$ between rush hours on working days and other time periods. Note that, although October 10 was a Saturday, but the exponent $\tau$ is like on a working day. This can be understood by the fact that this specific Saturday was indeed a workday according to the day off compensation policy. It is interesting to note that our results for $\tau$ are generally with values between the theoretical results of high dimension (2.50; e.g., small world or Erdős-Rényi networks) and lattice percolation (2.05; e.g., 2D regular lattice), respectively . During rush hours on working days, the critical exponents are much smaller compared with during other periods, with the value of $\tau$ closer to the limiting case of lattices; on the contrary, during nonrush hours, the values of $\tau$ are significantly and systematically higher. Moreover, some values of $\tau$ during the national holidays are approaching the mean field limit. We show (*SI Appendix*, Fig. S3) that similar findings with different exponents between rush hours and nonrush hours also appear in another large city, Shenzhen. All of these results suggest that the dynamics of city traffic is running at different modes between high-dimensional (mean field) percolation and 2D lattice percolation. Therefore, our results suggest that the value of $\tau$ in real data can be used to classify different traffic modes, which should be managed through different strategies. For cities with only a few highways, like Jinan, we observe (*SI Appendix*, Fig. S5) only the type of percolation transition close to the 2D case.

Thus, the following question can be naturally raised: why do the critical properties behave differently at different periods, although the network structural topology of the roads is the same? A hint to answer the question can come from the knowledge that, for spatially embedded networks , the appearance of long-range connections can alter the critical percolation exponents. We suggest here that, for transportation systems, the highways during nonrush hours or days off play the role of effective long-range connections in the traffic network from a dynamic perspective. The highways normally connect distant places and are designed for higher velocities. For a driver, during nonrush hours and days off (in contrast to rush hours), it is usually faster to reach a distant place by highways rather than by other roads. Thus, a plausible hypothesis for the different modes is that, during days off or nonrush hours on working days, there exist more effective long-range connections (high-speed highways) that relax the spatial 2D constraints of the original system. During these periods, the traffic system approaches the traits of small world networks, which behave like a high-dimensional (mean field) system. However, with heavy traffic congestion during rush hours on working days, the highways become congested and are effectively removed from original system.

To test and demonstrate our assumption, we select the highways of the road network and register their speed during rush hours on workdays and days off. Indeed, we find that the number of highways with high velocities (faster than 70 km/h) is indeed significantly different during the two periods as shown in Fig. *A* and Fig. *B*. During days off, fraction of high-speed highways are found larger in Fig. *C* and effectively form long-range connections, which do not exist during workdays (shown in *SI Appendix*, Fig. S4). We also test our hypothesis by exploring the influence of long-range connections in a lattice percolation model. For that, we apply a link-rewiring model of a 2D small world network and study its critical properties. The model network is a lattice with a given fraction *f* of rewired long-range connections, consistent with the fact that the total number of links is kept constant in a city traffic network during different periods. At every step, we randomly choose a node and disconnect one of its links; then, we rewire it to a random node in the whole 2D network. This process continues until the fraction *f* of rewiring links meets the given value.

After constructing the model network, we analyze its percolation properties. The results are shown in Fig. *D*. It suggests that the value of $\tau$ increases with the increasing fraction of rewired links. We can see that the values of $\tau$ are basically changing from 2.05 to 2.50, corresponding to the universality classes of lattice percolation and mean field, respectively. Moreover, $\tau$ changes rapidly as the fraction *f* increases toward 0.2. The larger fraction of links rewired in the lattice, the more similar the network is to the ER network . Therefore, our model results support the hypothesis that, during rush hours on workdays, the dynamic percolation of city traffic has a stronger tendency toward 2D lattice percolation, since it is nearly under a zero fraction of long-range connections. Systems with high fractions of long-range connections can exhibit pronounced dynamic effects, which will not occur in systems with short-range interactions only. The existence of long-range connections can result in quasistationary states with slow relaxation toward steady states in driven dynamics . As seen here (Fig. *D*) a small fraction of long-range connection can affect the critical percolation exponents, resulting in changes of the system university class . In analogy, for example, studies have been conducted on the behavior of the Ising model in a small world network , and they find that the introduction of long-range connections (reflected by rewiring probability *f* of network links) results in changing the system universality class from a pure low-dimensional system for $f = 0$ to mean-field like region for $f > 0$. For city traffic systems, this change is self-organized with the variant high-speed roads that represent effective long-range connections (results are in *SI Appendix*, Fig. S6), leading to the mode switching. Thus, by adjusting effective high-speed connections, one may change the system to the desired universality class of city traffic (like during nonrush hours or days off). Note that our results here are obtained for percolation, neglecting the correlation presence in the congestion scenario of real traffic. However, it is suggested that several percolation critical exponents, including exponent $\tau$ of cluster size distribution, almost do not change with the introduction of correlations.

## Conclusion

While the growth of urbanization is expected to strain urban infrastructure across all transportation modes, different smart city frameworks have been proposed to combat this challenge. One of the core tasks for city resurgence is to build a resilient transportation system that can adapt to various perturbations and recover from major congestions efficiently. On this task, one fundamental question is how urban traffic will break when approaching its critical point. City traffic is generally a spatial–temporal system , hence, it is essential to focus not only on the static structure of a road network but also, on the dynamic organization of traffic in which demand changes from time to time and place to place during a day. Here, we study the percolation transition classification of city traffic dynamics using high-resolution real-time traffic data. By analyzing the cluster size distribution of city traffic, we find that the disintegration transition of urban traffic can be characterized by two sets of percolation critical exponents. During workday rush hours, the critical percolation exponent is close to that of 2D lattice percolation, while during other periods, it is closer to the high-dimensional small world systems.

Our findings suggest that a key point affecting the critical exponent of traffic dynamics is the fraction of the effective long-range connections represented by the connected roads of high speed. Thus, with the aid of dynamic traffic management methods, it may be possible to shift the system to the desired critical universality class by adjusting the amount of effective long-range connections. For demonstration, if appropriate actions can keep the fraction of effective long-range connections above 0.1, we may expect percolation critical exponents to be around 2.4, which represents a universality class of significantly better and more smoothly fragmented global traffic. While the effective long-range connections are the products of structural urban highways, their management also requires much effort on the design of corresponding management strategy along with signal control or road pricing . In this sense, our study may be useful for modeling and designing traffic resilience in the realization of the smart city. Furthermore, our approach is general and can be applied to other critical infrastructures that are aiming to transfer flow of different types.


abstract: Machine learning (ML) and Deep Learning (DL) tasks primarily depend on data. Most of the ML and DL applications involve supervised learning which requires labelled data. In the initial phases of ML realm lack of data used to be a problem, now we are in a new era of big data. The supervised ML algorithms require data to be labelled and of good quality. labelling tasks may require a large amount of money and time investment. Data labelling may require a skilled person who may charge high for this task, consider the case of the medical field or the data is in bulk that may require a lot of people assigned to label it. Amount of data that is well enough for training needs to be known, money and time can not be wasted to label the whole data. This paper mainly aims to propose a strategy that helps in labelling the data along with oracle in real-time. With balancing "on" model contribution for labelling is 89 and 81.1 for furniture type and intel scene image data sets respectively. Further with balancing being kept "off" model contribution is found to be 83.47 and 78.71 for furniture type and flower data sets respectively.
author:
;
;
title: Active learning with binary models for real time data labelling

# Introduction

In the field of Convolutional neural networks (CNN), we have seen many new kinds of research and advancements related to model architectures and mathematical explanations behind them. It is mostly been statistical and less methodological. Our main aim is to use existing architectures and achieve efficiency in labelling tasks. A problem that we want to solve is labelling unlabelled data and train models with as least number of data samples as possible to save the training time.
Attempts have been made to build such a methodology to reduce the efforts required for training ML, DL models with the least number of data samples, which directly means a reduction in time and cost required for the task. Three main pillars in our attempt are pre-existing well trained models, selective sampling based active learning algorithms, and most important of all individualized binary models for classification (one verse all).

## Pretrained models

Convolutional neural networks can be broken down into two stages, the convolutional network stage with filters which learns to recognize the shapes in the image, and the classifier stage which is responsible for classification tasks based on the features extracted by the convolutional stage. The first stage of the network requires adjusting its filter weights to learn feature extraction and to tune those filter weights need data. The first hurdle is solved by using the pre-trained feature extractor layers which are open source available on the Tensorflow hub. A model can be easily selected which is relevant to the task. This is also known as transfer learning. Taking the pretrained model's weights saves a lot of data samples required for training.

## Active learning

Active learning is a subset of machine learning in which the model suggests the most relevant data points from the dataset. The aim is in place of passive model learning there can be model involvement to select these samples from the dataset. There has been a lot of statistical research in this field. There are different ways to get these desired samples with least confident sampling, marginal sampling, entropy sampling. This is a significant part of methodology because we do not want random samples to be thrown in model training, important samples selection can be done using favorable strategy. The model's inference suggests us the relevant samples it requires.

## One versus all

A single model can be used to do a multi-class classification task, although the real issue a single model faces is class imbalance. When there is skewness in data there comes the issue of overfitting, in this case, it is more reliable to go for individualized binary models. The steps are simple, every single class will have a binary model associated with it, which learns to classify objects that belong to a particular class versus the other classes. The binary models seem to be more helpful in the application we want to build rather than a single model.

# Related works

Related works can be split into two parts. The first one is work-related to active learning and the second one is work-related to binary classification. Let us have a look at active learning-based works.

Pioneer significant work started with the proposal of a pool-based active learning model having an incremental decision tree as the basic structure . The proposed method in helped in the removal of ambiguity in the unsampled pool. The best accuracy is found out to be 92.50. Performance of active learning the framework gets affected due to an imbalance in class distribution. A detailed discussion on factors affecting active learning and the reason for imbalanced data affecting the performance of active learning was made in . The hierarchical clustering method is used. The basic classifier used is a weighted extreme learning model and further proposed architecture is deduced out of this and named as Active online weighted extreme learning model (AOW-ELM). Detailed running time and performance comparisons were made for 32 binary class data sets with varieties of imbalance ratios and the proposed AOW-ELM was found to be better than many of pre-existing state-of-the-art model for active learning .
Arabic NADA news data was labelled using active learning and an accuracy of 99 percent was obtained when just 17.8 percentage of samples were trained, active learning was proposed with Jaccard similarity classifier . Active learning found its way to the classification of visual imperfections in the industry through . In reference three different methods were proposed, first one is auto labelling enhanced active learning (ALEAL) which was found to be cost-efficient and was working based on deep convolution neural networks, followed by diverse cost-efficient query strategies (DCEQS), followed with attention-based similarity measurement network (ASMN), ALEAL was used to reduce the human intervention during labelling, DCEQS helps in the selection of samples with high performance and further ASMN is used to determine the similarity between labelled and unlabelled samples. A deep supervised U-Net-based active learning framework was proposed for weak and strong labelers in biomedical image segmentation, further models performance was evaluated using the Internet of medical things (IMOT) .

Binary classification has got its significance in a wide range of areas. Text classification method with binary classifier enabled with difference frequency method was proposed and F1 score was found to be improving from 88.12 percent to 91.96 . Performance of binary tree-based support vector machine (SVM) architecture on simple training data sets were evaluated and it was found that binary classifier initially separates the most efficiently distributed class from the whole distribution and thus performs better. SVM based on a binary tree was seen performing better due to its ability to construct tree according to the distribution of data set . Cancer images with metastatic conditions were classified using binary classifiers with Resnet architecture, further results from the model were found to perform better than that of vgg16 and vgg19 based networks . The main thing was scan detection of digital pathology being converted into a problem of binary classification. From the above-mentioned papers, one thing can be concluded, binary classifiers gives extensive performance over a wide range of areas, and their applications.
One versus all (OVA) problem in multi-class classification is always seen to be performing better. The problem of best suitable kernel selection for one versus all classification was taken and solved with the help of a set of error bounds which was minimized for various conditions . These kernels were then imposed on top of specialized SVM classifiers. Further, the multi-class classification problem was solved with a decision tree-based one versus all classifiers . An OVA-based decision tree was trained on 20 data streams and was seen performing better than preexisting models. Weight updating and training were found to be faster and the accuracy of classification was also higher. Models performance was theoretically and empirically proved. Merits of OVA classifiers such as high accuracy, getting adopted to new class labels found in between the class were discussed in detail . Demerits of OVA are, not being able to handle concept change, classification accuracy gets affected by the data set having an imbalanced class label. Hence in this paper, we try to solve these problems by proposing a most efficient algorithm based on active learning with pre-trained models and buffer.

# Datasets and preprocessing

The datasets considered in this experimental setup are flowers dataset, car damage or not damage dataset, mask-No-mask dataset, yoga-pose dataset, car-logos dataset, furniture type dataset, intel seg dataset. The images were reshaped as 244x244 and normalized between 0 and 1, before sending to the feature extractor layer.

# Methodological reasoning

Fig. 1 shows the flow diagram for the proposed method. Various blocks included in the figure need to be elaborate with reasoning, like the use of one versus all, selective sampling method, buffer strategy in the algorithm. The reasons are as follows,

-   A single large model with an softmax layer at end with neurons equal to classes is initialized, new classes can not be included easily in between the labelling task. The model will have to be built again with new weights and we will lose all the training. To avoid this binary models are used. Even when the user demands a new class in between, a new binary model can be easily built for particular class without affecting the old classes and their parameters.

-   User can not always be constrained to label classes on equal counts. which is necessary to avoid overfitting in the single model scenario. Whereas binary models are proven to be more resistant towards imbalance.

-   Active learning helps in the selection of important data for the model, further it assumes the data to be balanced and equally distributed across the classes. Different approach is used to select the important samples. In this strategy, buffer is being added. Buffer accumulates incorrect predictions by the model and their correct labels by the user. Once the buffer is full, samples are sorted in increasing order of their incorrect confidence across the classes. Idea is to pick samples that strategy predicted with higher confidence and are incorrect. Then train the models with these samples, this is penalizing with most incorrect attempts by the model. In the experiment top 10 samples from each available class in the buffer are picked.

-   A single difficult class may affect all others in single model architecture. In binary mode, all models are independent of each other. Hence cost functions of each classes are independent and do not affect across the classes.

-   Since the binary models are independent, while training these models can be trained in parallel. In this experiment it is sequential.

## Methodology flow

-   Random 30 images are labelled by the user.

-   Each unique label builds a new binary model for that specific class as and when detected. The model is a simple TensorFlow hub feature extractor layer followed by a dense layer of 50 neurons and ends with a single neuron with sigmoid activation, optimizer used is sgd. The underlying feature extractor used here is MobileNet-V3-large.

-   The data is sent for training each model. Before sending the data for training for a particular model, data is processed to change the labels as positive or negative samples.

-   Models are trained with standard configuration, batch size of 10 with epochs of 20.

-   Bulk edits stage - next 30 sample's labels are predicted by models based on a model whose inference confidence is maximum.

-   User can correct the wrong predictions by model and accept all remaining. These incorrect predictions are stored in a buffer along with the correct labels by the user.

-   Constant check is made for mistake greater than 15 per iteration among 30 samples or the buffer size is full. Buffer size taken here is the number of classes x 20.

-   In case buffer size is full, use active selection to select important samples for training the models from the buffer. The samples from each class are separated and among each class, we select the top 10 samples.

-   In case a batch makes greater than 15 mistakes, go to the initial stage of labelling random 30 samples.

-   Else continue bulk edit stage of next 30 samples labelled by models.

Balancing strategy is an experimental parameter that allows having data augmentation before data goes into each model's training, balancing positive and negative samples which is the most probable scenario to happen in binary models strategy. Augmentation techniques included herein general acts like flipping horizontally or vertically, stretching, etc. Sorting is another experimental parameter used in a buffer while training them according to their confidence which can be high to low or low to high.

# Results

Table and Table show simulation results related to some general datasets taken from the kaggle website. The table shows the size of data considered after cleaning, the number of classes in that dataset. Models contribution is the portion of data correctly labelled by models. Time taken is an important parameter since it needs to be realtime, it is represented in minutes, training time is a subset of time taken for the full script. Time taken for script also includes time taken for inference before labelling by models. Buffer sorting is high to low. Table shows the results when balancing is kept off and Table shows the result with balancing kept on. Results show improvement in the outcomes when balancing strategy is used and it also doesn't affect the overall time taken as such compared to when balancing is kept off.
Given figures are the results for outcomes for classification of images into damaged car or not damaged car with balancing strategy on. Fig. 2. shows model contribution versus the number of iterations for . Across the iterations, the user and model are to label a batch of 30 samples together. The value at a particular iteration tells you the number of samples correctly labelled by the models. Fig. 3. shows the time taken for training versus the training number. Throughout the task, there are two possibilities of training to happen, either the model predictions are incorrect for more than half of a particular batch size or the buffer is full. These time values can be high because of a larger count of classes resulting in a higher count of individual models. The training in experiments happens sequentially, this is the reason behind some simulations taking more time in training. Due to the independence of the models, with a special setup, these models can also be trained parallel and time can be saved. Fig. 4 is more intuitive way to understand the effectiveness of the method, blue is the amount correctly labelled by the models and orange is the labelling done by the user.

| **Dataset** | **No of. samples** | **classes** | **Model contribution** | **Time taken for training(mins)** | **Time taken for full script(mins)** |
|:---|:---|:---|:---|:---|:---|
| Flower | 2253 | 5 | 78.71 | 1.8 | 13 |
| Car damage | 1655 | 2 | 76 | 0.6 | 4 |
| Furniture type | 3625 | 5 | 83.47 | 1.5 | 20 |
| Mask-No mask | 892 | 2 | 45 | 0.6 | 2.1 |
| Yoga pose | 790 | 5 | 60.25 | 1.6 | 5.4 |
| Car logos | 2024 | 8 | 55 | 5.1 | 20 |
| Intel scene image | 8159 | 6 | 75.85 | 4.6 | 57 |

Comparison with Balancing off

| **Dataset** | **No of. samples** | **classes** | **Model contribution** | **Time taken for training(mins)** | **Time taken for full script(mins)** |
|:---|:---|:---|:---|:---|:---|
| Flower | 2253 | 5 | 79.2 | 1.3 | 9.9 |
| Car damage | 1655 | 2 | 75.81 | 0.48 | 3 |
| Furniture type | 3625 | 5 | 89 | 1.2 | 15 |
| Mask-No mask | 892 | 2 | 50 | 0.55 | 1.7 |
| Yoga pose | 790 | 5 | 64.8 | 1 | 3.7 |
| Car logos | 2024 | 8 | 54.52 | 5.14 | 16 |
| Intel scene image | 8159 | 6 | 81.1 | 5 | 42.3 |

Comparison with balancing on

# Conclusion

The strategy is tested on datasets from kaggle with labels provided for running simulation script, to understand the way it helps across segments. The method appears to be helping in most of the scenarios, even in the worst-case model accounted for 50 percent of help which is the same as a person doing double the capability. The number of times the model is trained and the overall time taken is the major thing to look at, considering the help model gives in real time.
Major advantages of the proposed method are,

-   These binary models generated across labelling tasks can be saved and used on the future dataset or can act as a baseline for the search of a new model on which users want to train using this labelled data.

-   User can easily add extra class in between of labelling task without disturbing previous models learning since the models are independent they can easily be generated.

-   Data skewness shows less effect on individualized binary models and hence the user is not a constraint in labelling the data in equal amounts for each class, to cover up an imbalance in binary models balancing strategies can also be added as per need.

-   Selection strategy among all samples in buffer helps in saving the time taken for training models. Selective sampling helps in including only important samples that can lead to better learning and with reduced training time rather than sending all the data for training.

The base feature extractor used in this experiment is MobileNet-V3-large, the outcome of the experiment was majorly based on these features extracted. Hence as the future scope of this experimentation, the efforts will be to find a way to rank among various feature vectors in real time while the user labels to select the best-suited model that can yield a higher contribution.