abstract:
  .
  Artificial intelligence (AI) has evolved considerably in the last few years. While applications of AI is now becoming more common in fields like retail and marketing, application of AI in solving problems related to developing countries is still an emerging topic. Specially, AI applications in resource-poor settings remains relatively nascent. There is a huge scope of AI being used in such settings. For example, researchers have started exploring AI applications to reduce poverty and deliver a broad range of critical public services. However, despite many promising use cases, there are many dataset related challenges that one has to overcome in such projects. These challenges often take the form of missing data, incorrectly collected data and improperly labeled variables, among other factors. As a result, we can often end up using data that is not representative of the problem we are trying to solve. In this case study, we explore the challenges of using such an open dataset from India, to predict an important health outcome. We highlight how the use of AI without proper understanding of reporting metrics can lead to erroneous conclusions.
author: Anusua Trivedi$^{*}$, **Sumit Mukherjee$^{*}$,** **Edmund Tse$^{*}$,** **Anne Ewing,** **Juan Lavista Ferres**
Microsoft, Redmond, USA.
$^{*}$ These authors contributed equally.
title: Risks of Using Non-verified Open Data: A case study on using Machine Learning techniques for predicting Pregnancy Outcomes in India

# Introduction

An estimated 2.6 million still births and 2.7 million neo-natal deaths occur globally each year \[8\]. A disproportionate percentage (approximately 99%) of these deaths occur in low-income and middle-income developing countries \[9\]. India accounts for approximately 19 births/1,000 population (2017 est.) and 39.1 deaths/1,000 live births (2017 est.)\[16\]. While India has made laudable progress in reducing overall child mortality over the past 25 years, similar reductions in neonatal mortality have lagged. As a result, India fell short of the Millennium Development Goal 4 of a two-thirds reduction in under-five mortality from 1990 to 2015 \[10\]. Previous research on evidence-based approaches to reducing infant mortality have included efforts to increase access to preventive and curative antenatal, perinatal and postnatal care \[11\]. Pregnancy outcomes is a strong indicator of such cares \[12\]. Unfortunately there is a big divide between the developed and developing world on this pregnancy outcome. This is not because of a lack of clarity in defining a pregnancy outcome, but because of an inherent weakness in the health information and recording systems \[17\]. According to Indian Council of Medical Research (ICMR) \[13\], data on health and demographics in India is plagued by incomplete information, overestimation, and over-reporting that lead to hindrance in policy planning. The National Data Quality Forum (NDQF) \[14\], formulated by ICMR's National Institute for Medical Statistics (ICMR - NIMS), in partnership with Population Council has identified gaps in data compilation. The NDQF attempted to identify issues in data quality, and found several factors effecting the data quality:

-   lack of comparability

-   poor usability of national level data sources

-   discordance between system and survey level estimates

-   increased questionnaire length

-   capturing wrong subsections for questions in questionnaire

-   questions on socially restricted conversation topics

-   age-reporting errors

-   non-response and intentional skipping of questions

-   under reporting due to subjective question interpretation

-   incompleteness of data

All these factors translate to poor data quality. For our case study we explore open reporting data sources in India and try to show how use of AI without understanding these reporting can lead to wrong estimates. unexplored in our experiment.

# Data

#### Pregnancy Outcome Data

For calculating pregnancy outcomes in India, we started exploring two major data sources: Open Government Data (OGD) platform \[2\] and Kaggle \[3\]. OGD is a platform for supporting Open Data initiative of Government of India. The portal is used by Govt. of India to publish datasets, documents, services, tools and applications collected for public use. It intends to increase transparency in the functioning of Government and also open avenues for many more innovative uses of Government Data to give different perspective. The base Open Government Data Platform India is a joint initiative of Government of India and US Government. Kaggle is a crowd-sourced platform to attract, nurture, train and challenge data scientists from all around the world to solve data science, machine learning and predictive analytics problems. Kaggle enables data scientists and other developers to engage in running machine learning contests, write and share code, and to host datasets. Kaggle users have shared over one thousand datasets and is the number one go-to place for AI practitioners to look for data \[4\]. For our case study we looked at the Annual Health Survey (AHS) on Woman Health for 9 states in India \[5\]. Specifically, we focused on the *Woman* dataset and *WPS* dataset in \[5\]. The *Woman* dataset is also represented in Kaggle \[6\] with acknowledgement to the source being OGD Platform. The data curator of the Kaggle pregnancy outcome dataset states - "These nine states, which account for about 48 percent of the total population, 59 percent of Births, 70 percent of Infant Deaths, 75 percent of Under 5 Deaths and 62 percent of Maternal Deaths in the country, are the high focus States in view of their relatively higher fertility and mortality". These numbers did not make any sense to us, so we started to explore this dataset further.

#### Data Gap Analysis

We came across the AHS questionnaire form used by the Census Office in India \[7\]. This questionnaire was used to collect the pregnancy outcome dataset in \[5\]. Further exploration of this questionnaire form showed us some interesting facts which helped us identify some data gaps.

Figure  shows a snapshot of the AHS questionnaire for the state of Rajasthan in India. In Figure , if the answer to the Question 7 is *Yes*, that answer leads to Question 8, and if the answer to the question 7 is *No*, that answer leads to Question 9. But this is not correctly represented in the *Woman* dataset being used by Kaggle in \[6\]. In \[6\], the Question 8 data is completely missing. So the *pregnancy outcome* column in Kaggle dataset \[6\] comprises of just binary pregnancy outcome labels coming from Question 7 (*Yes*, *No*), instead of 4 pregnancy outcome labels coming from Question 8 (*Live Birth*, *Still Birth*, *Induced Abortion*, *Spontaneous Abortion*). The *pregnancy outcome* column in the *WPS* dataset on the other hand comprises of 4 pregnancy outcome labels coming from Question 8 (*Live Birth*, *Still Birth*, *Induced Abortion*, *Spontaneous Abortion*). This data gap leads us to believe that the *Woman* dataset should not be used to train AI models for pregnancy outcome prediction. That makes the Kaggle dataset in \[6\] unfit for training such a model. We should rather be using *WPS* dataset to train AI models for pregnancy outcome prediction. To evaluate our hypothesis, we run some experiments on both *Woman* and *WPS* dataset. unexplored in our experiment.

# Experiment

To demonstrate the problems with using incorrect labels, we sought to demonstrate how models trained with the incorrect and correct labels are different from each other. To this end, we first sought to identify usable features from each dataset. The *Women* dataset had 202 features, while *WPS* had 355 features. The features in the *Woman* dataset were a sub-set of those in the *WPS* dataset. Furthermore, the *WPS* dataset is supposed to only contain individuals who responded *Yes* to the *pregnancy-outcome* question. To keep the models comparable, we only consider the features that are available in both datasets. We further down the features to discard all features that were not related to social, economic, health or demographic indicators e.g. all *id* related fields were discarded. Since most confounding features which captured birth outcome information (e.g. *is-receive-birth-certification*, *baby-checkup-after birth-in-days* etc.). Since the outcome variable for the *WPS* dataset was not a binary variable we converted it into a binary survival prediction problem by treating *Live birth surviving* as one category and everything else as the *Non-surviving* category. For both datasets, we discarded entries for which the outcome variable was null. As a further step in the data cleaning process, we discarded all features that had over 10 percent entries as null. We noticed an extremely high number of null entries in both datasets as can be seen in Figure a, which highlights a significant problem in the data collection process. We further proceeded to one-hot-encode all categorical variables present in the datasets. Having performed the data cleaning/processing, we split each processed dataset into a 2:1 training/test split. At this stage both datasets have the same features and we train separate logistic regression models on both training sets using the scikit-learn python package. We then evaluate the learned models on: i) the test set corresponding to their training set, ii) the test set corresponding to the other dataset (Figure b). We see a large drop in precision/recall/accuracy for the model trained on the *Woman* dataset and tested on the *WPS* dataset in comparison to the model trained on the *WPS* dataset. Moreover, the model trained on the *Woman* performs extremely well on the test data for *Woman*. Despite the extremely good performance on many of the metrics, this model is actually prediction whether or not the woman was pregnant based on the available feature information and not what the outcome of the pregnancy was. This model was in fact a rather poorly performing model for the task of predicting pregnancy outcomes compared to a model actually trained to predict pregnancy outcomes. This highlights a one of the major issues with using such datasets, which is the lack of clarity in naming convention which can lead to misinterpretation of features and outcomes. While a long term solution to this problem is adoption of clear and consistent naming conventions for variables, a shorter term solution is for users of such datasets to rigorously explore the data dictionaries and survey forms. It must be noted that there may have been many other types of reporting errors which were unexplored in our experiment.

# Discussion

Due to the complicated textual nature of the AHS questionnaire, we end up capturing wrong subsections for questions in questionnaire for our case study. By taking steps to simplify current AHS forms and making sure to correctly transition to online data, we will have a much more comprehensive data set to draw meaningful conclusions from. By doing so, we can ensure that we are applying AI in a more efficient manner to predict pregnancy outcomes. Despite the highlighted issues in the data collection and processing of such datasets from developing countries, there is still a lot of value in analyzing such datasets. While this is beyond the scope of this paper, the *WPS* dataset, once appropriately processed, could be used to build an accurate pregnancy outcome prediction model. In our simple experiment, we already saw decent recall and accuracy for the model trained and tested on *WPS*. Such a model, along with analysis of the important predictors would help identify women whose pregnancies are at risk as well as the socio-economic or healthcare factors that are leading to adverse pregnancy outcome in such developing nations. unexplored in our experiment.

# References

\[1\] WHO, UNICEF, UNFPA. Maternal mortality in 2000: Estimates developed by WHO, UNICEF, UNFPA. Geneva: WHO, 2003

\[2\] Open Data Government Platform India: https://data.gov.in

\[3\] Kaggle: https://www.kaggle.com

\[4\] Kaggle Getting Started: https://www.kaggle.com/getting-started/44916

\[5\] Annual Health Survey - Woman Schedule: https://data.gov.in/catalog/annual-health-survey-woman-schedule

\[6\] Kaggle Predict Outcome of Pregnancy: https://www.kaggle.com/rajanand/ahs-woman-1

\[7\] Ministry of Home Affairs, Government of India:
http://www.censusindia.gov.in/vital_statistics/AHSBulletins/Factsheets.html

\[8\] UNICEF Data: monitoring the situation of children and women:
http://data.unicef.org/child-mortality/neonatal.html

\[9\] World Health Organization (WHO). The partnership for maternal, newborn and child health.
http://www.who.int/pmnch/media/press_materials/fs/fs_newborndealth_illness/en/

\[10\] NIMS, ICMR and UNICEF. Infant and child mortality in india: levels, trends and determinants. New Delhi, India: NIMS, ICMR and UNICEF 2012. http://unicef.in/CkEditor/ck_Uploaded_Images/img_1365.pdf

\[11\] Koblinsky M , Matthews Z , Hussein J , et al . Lancet maternal survival series steering group. Going to scale with professional skilled care. Lancet 2006;368:1377–86.

\[12\] Strehlow MC , Newberry JA , Bills CB , et al . Characteristics and outcomes of women using emergency medical services for third-trimester pregnancy-related problems in India: a prospective observational study. BMJ Open 2016;6:7.doi:10.1136/bmjopen-2016-011459

\[13\] Indian Council of Medical Research: https://www.icmr.nic.in/

\[14\] National Data Quality Forum: https://www.insightsonindia.com/2019/07/26/national-data-quality-forum-ndqf/

\[15\] National Institute for Medical Statistics: http://nims-icmr.nic.in/NIMS/index.jsp

\[16\] India Demographics Profile 2018: https://www.indexmundi.com/india/demographics_profile.html

\[17\] The Challenges Confronting Public Hospitals in India, Their Origins, and Possible Solutions:
https://www.hindawi.com/journals/aph/2014/898502/


abstract: The Einstein field equation as an equation of state of a thermodynamical system of spacetime is reconsidered in the present Letter. We argue that a consistent interpretation leads us to identify scalar curvature and cosmological constant terms representing the bulk viscosity of the spacetime fluid. Since Einstein equation itself corresponds to a near-equilibrium state in this interpretation invoking $f(R)$ gravity for nonequilibrium thermodynamics is not required. A logically consistent generalization to include the effect of so called 'tidal forces' due to the Riemann curvature is presented. A new equation of state for higher curvature gravity is derived and its physical interpretation is discussed.
author: S. C. Tiwari
Institute of Natural Philosophy
c/o 1 Kusum Kutir Mahamanapuri,Varanasi 221005, India
title: Viscous Spacetime Fluid and Higher Curvature Gravity

Higher curvature Lagrangians have been discussed as logically possible constructions for gravitation since long , however current interest in such theories is inspired by various shades of quantum gravity/effective field theory . Amongst them $f(R)$ gravity, where $f$ is a nonlinear function of the scalar curvature $R$, is considered as an attractive model to explain the observed cosmic acceleration phase . The conflict of the metric formulation of $f(R)$ gravity with the solar system observations has been claimed to get resolved in the Palatini formalism , however it has been argued that this theory results in the appreciable deviations from the microphysics (e.g. electron-electron scattering experiments), and violation of the equivalence principle . It may be asked: Is there an alternative approach to higher curvature gravity?

Departing from the variational principle approach, recently a thermodynamical derivation of the $f(R)$ gravity has been proposed generalizing the previous derivation of the Einstein field equation . Thermodynamics of spacetime in is motivated by the black hole thermodynamics: it is assumed that similar to the black hole entropy formula a universal entropy density $\alpha$ per unit horizon area for all local Rindler horizons could be defined, and the Clausius relation $T dS=\delta Q$ of equilibrium thermodynamics holds for all local horizons. Here the heat flow across the horizon $\delta Q$ is defined to be the boost energy of the matter and $T$ is the Unruh temperature. Jacobson then argues that since entropy is interpreted as horizon area the Clausius relation would be satisfied provided the spacetime curvature in the presence of matter is such that the Einstein field equation holds. In this approach is applied to the assumed entropy density proportional to $f(R)$, and it is found that local energy conservation entails entropy production term, and hence nonequilibrium thermodynamics of spacetime. Further the higher curvature equation of state obtained is shown to be identical with the field equation derived from the $f(R)$ Lagrangian.

Obviously rederivation of the known field equations by itself is not of much significance unless new insights are gained. Unfortunately the paradigm of field theory has overshadowed this promising thermodynamic approach in . Moreover we have shown that covariant divergence law for the matter stress tensor is satisfied in a conformally related spacetime, $\tilde{g}_{\mu\nu} =f(R) g_{\mu\nu}$ with no need to postulate bulk viscosity production term as is done by Eling et al in , and therefore the issue of nonequilibrium thermodynamics becomes trivial. Note that this result is independent of the unimodular perspective suggested in .

In this Letter spacetime as a thermodynamical system in the spirit of Jacobson's approach is considered with the two-fold aim: 1) to gain new insights into the nature of spacetime assumed to be some kind of fluid at large scale, and 2) to motivate nonequilibrium thermodynamics in the case considered in and generalize it to include the effect of the so called 'tidal force' caused by the Riemann curvature of spacetime and derive a new higher curvature equation of state.

First we argue that a consistent equation of state interpretation of the Einstein field equation demands a careful reanalysis of the local equilibrium condition: the $\Phi$ term in Eq.(6) below while easily interpreted in the field theoretic setting, seems to require a different meaning since local energy conservation is assumed to be a form of first law of thermodynamics . This term in the Einstein field equation in the absence of matter stress tensor is suggested to represent a dissipative contribution to the stress tensor of vacuum. Analogous to the bulk viscosity for the dissipative fluid , $\Phi$ term, therefore signifies viscous spacetime, and the Einstein equation already corresponds to a quasi-equilibrium system.

Next we recall Bondi's argument noted in that the essence of observable gravitation is that relative acceleration varies at each spacetime point. It would mean that even the assumption of local thermodynamic equilibrium for local Rindler horizons would, in principle, fail. However the gravitation is so weak that the correction due to Riemann curvature is proposed to be incorporated retaining key elements of the Jacobson's approach in the following. The notion of local Rindler horizon is used to define heat flow and entropy change in . The equivalence principle enables locally flat spacetime at each spacetime point, and for an infinitesimal 2-surface element through the point one can assume vanishing shear and expansion to the past (or inside) of the plane. The past horizon, the local Rindler horizon is assumed instantaneously stationary. This idea helps in introducing an approximate local boost Killing vector field which can be related with the horizon tangent vector and affine parameter along the null geodesic. Now instead of employing the Jacobi deviation equation for relative acceleration, we assume that the imprint of the tidal force is carried by the congruence of the null geodesics via a correction term dependent on the Riemann curvature. Both nonuniform temperature and viscosity lead to dissipation; since we do not know how to define these quantities here instead of the entropy change we calculate change in the thermodynamic potential $F=S T$. Heat flow and change in the horizon area are calculated for local Rindler horizons to lowest order in the affine parameter as is done in . A correction term proportional to the Riemann curvature is introduced in the change $\delta F$. Equating $\delta Q$ and $\delta F$, and imposing covariant divergence law for matter stress tensor finally give the desired equation of state. The Letter concludes with a brief discussion on the physical interpretation and prospects of this equation.

Briefly the main ideas of are as follows. The black hole formula, namely the proportionality between entropy and the horizon area, is assumed to hold for all local Rindler horizons at each spacetime point of the manifold M. Causal horizon at a point p is specified by a space-like 2-surface B, and the boundary of the past of B comprises of the congruences of null geodesics. Assuming vanishing shear and expansion at p the past horizon of B is called local Rindler horizon. The energy flux across the horizon is used for heat energy, and calculated in terms of the boost energy of matter: define an approximate boost Killing vector field $\chi^\mu$ future pointing on the causal horizon, and related with the horizon tangent vector $k^\mu$ and affine parameter $\lambda$ by $\chi^\mu=-a \lambda k^\mu$. The heat flux to the past of B is given by $$\delta Q=\int T_{\mu\nu} \chi^\mu d\Sigma^\nu$$ The integral is taken over a small region of pencil of generators of the inside past horizon terminating at p. If area element is $dA$ then $d\Sigma ^\nu=k^\nu d\lambda dA$, and Eq.(1) becomes $$\delta Q=-a \int T_{\mu\nu} k^\mu k^\nu \lambda d\lambda dA$$ Change in the horizon area is given in terms of the expansion of the congruence of null geodesics generating the horizon $\delta A=\int \theta d\lambda dA$. The expansion of the null geodesics generating the horizon is given by the Raychaudhuri equation $$\frac {d\theta}{d\lambda}=-\frac{\theta^2}{2}-\sigma_{\mu\nu}\sigma^{\mu\nu}-R_{\mu\nu}k^\mu k^\nu$$ Assuming vanishing shear and neglecting $\theta ^2$ term we get the solution $$\theta=-\lambda R_{\mu\nu} k^\mu k^\nu$$ Assuming universal entropy density $\alpha$ per unit horizon area it is straightforward to calculate the entropy change $$\delta S=-\alpha \int R_{\mu\nu} k^\mu k^\nu \lambda d\lambda dA$$ The condition that the Clausius relation is satisfied for all null vectors $k^\mu$ , and making use of the Unruh temperature $\hbar a/2\pi$ gives $$R_{\mu\nu} + \Phi g_{\mu\nu}=(2\pi /\hbar\alpha) T_{\mu\nu}$$ The unknown function $\Phi$ is determined using the covariant divergence law for the stress tensor and contracted Bianchi identity; Einstein equation with a cosmological constant (CC) $\Lambda$ is obtained. Here Newton's gravitational constant is identified as $G=1/4\hbar\alpha$, and the function $\Phi$ is obtained to be $$\Phi =-\frac{R}{2} +\Lambda$$

In the light of thermodynamic derivation a logically consistent physical interpretation of the equation of state is proposed here. In the Clausius relation integrands of (2) and (5) have been equated for all null vectors to obtain Eq.(6). Since $T_{\mu\nu}$ is the matter stress tensor, from the integral form itself it is logical to infer that $R_{\mu\nu}$ is proportional to the stress of assumed spacetime fluid. What does $\Phi$ term represent? In the derivation $\Phi$ term is needed to satisfy the first law of thermodynamics (in the form of local energy conservation), and hence it should correspond to an additional stress tensor for a dissipative process in Eq.(6). Noting its formal similarity with the bulk viscosity stress tensor for an isotropic fluid proportional to the tensor $\delta _{ij}$, see Eq.(8.4.42) in it seems reasonable to identify $\Phi$ term in Eq.(6) as bulk viscosity tensor of the spacetime. Deeper insight is gained analysing the CC term. Setting matter stress tensor zero and assuming a vanishing CC the Ricci flat spacetime becomes indistinguishable from $G_{\mu\nu}=R_{\mu\nu}-\frac{R}{2} g_{\mu\nu}=0$ as $R=0$. Thus vacuum Einstein equation with vanishing CC could be interpreted as an equation of state of a perfect fluid. The presence of matter is suggested to cause a dissipative process leading to a nonvanishing scalar curvature, i.e. a bulk viscosity to the spacetime; geometrically scalar curvature arises via the contracted Bianchi identity so that the Einstein tensor satisfies the covariant divergence law. Here $R$ has been given a thermodynamic significance.

What is the physical significance of $\Lambda$ ? In the light of its appearance in combination with $R$ in (7) this would correspond to the bulk viscosity treating the whole $\Phi$ term as the bulk viscosity stress tensor of the spacetime. Thus empty spacetime with nonvanishing CC would be like a viscous spacetime fluid. In Jacobson's approach the thermal behavior of quantum vacuum in flat spacetime is an important ingredient. The time translation symmetry in Rindler wedge corresponds to the boost symmetry of the Minkowskian spacetime; quantum vacuum in Minkowskian spacetime as observed in the uniformly accelerating frame acquires thermal properties of a thermal bath of real particles with the Unruh temperature . Assuming that quantum vacuum fluctuations would be significant only at Planck length scales a universal entropy per unit horizon area and Unruh temperature have been assumed in . This is a reasonable assumption, however in the light of thermodynamic derivation it may be asked: Does there exist averaged out observable effect of vacuum fluctuations? There is an interesting phenomenon in quantum optics : atomic motion in light radiation in the so called optical molasses bears resemblance with that of a particle in a viscous fluid. Analogous to this, envisaging gravitational molasses having origin in quantum fluctuations in the spacetime bulk viscosity associated with CC could be attributed to this effect. Another possibility is, following suggestions in the literature, to treat CC as the energy density of quantum vacuum fluctuations, $\Lambda = 8 \pi G {V_0} /{c^4}$ where $V_0$ is the vacuum expectation value. In this case, nonzero CC would cause dissipative process similar to matter energy and constant scalar curvature would determine the bulk viscosity of spacetime. We emphasize that both CC and quantum vacuum possess rather speculative character in general relativity, and the microscopic nature of the spacetime is unknown to us, hence the preceding discussion though quite plausible, also remains speculative.

The question of bulk viscosity for the Einstein equation is also discussed in ; the expected bulk viscosity of $3\hbar \alpha/4\pi$ is obtained from the $f(R)$ equation in the Einstein frame. Authors argue it to be incorrect, and note the ambiguity of sign. However negative bulk viscosity could be related with the acausal teleological boundary conditions for the black hole . The stretched-horizon formalism developed in gives useful insights on black hole physics; in particular, energy and momentum conservation laws for the membrane resemble with those of viscous fluid. The present interpretation that the Einstein equation represents a viscous spacetime fluid could be viewed as a generalization, albeit a radical one, of the membrane paradigm of .

Thermodynamic derivation of the Einstein equation based on arbitrary spacelike 2-surfaces has been recently established . It is, therefore, reasonable to assert that the preceding physical interpretation is of general validity. Clearly viscosity term implies that the system is not in thermodynamic equilibrium; moreover higher curvature, e.g. $f(R)$ gravity, is not needed to motivate nonequilibrium thermodynamics. The present interpretation however does offer an effective procedure to include the effect of Riemann curvature as a correction to viscous stress tensor. Returning to the fluid analogy, in general the dissipative coupling coefficient $\eta_{ijkl}$ is a fourth rank viscosity tensor , and has symmetry of indices similar to curvature tensor $R_{\mu\nu\alpha\beta}$. Assuming that the correction due to the Riemann curvature is proportional to $R_{\mu\sigma\nu\rho}$ the product with the Ricci tensor keeping in mind the symmetry of the indices would be $R^{\sigma\rho} R_{\mu\sigma\nu\rho}$. Thus we construct the simplest form of $\delta F$ $$\delta F=-\frac {\alpha\hbar a}{2\pi} \int [R_{\mu\nu}+\beta(R^{\sigma\rho} R_{\mu\sigma\nu\rho}
-\frac {R}{2} R_{\mu\nu})] k^\mu k^\nu \lambda d\lambda dA$$ The last term in the square brackett in the integrand corresponds to the viscosity as identified above in Eq.(7) for the scalar curvature. This also makes the application of covariant divergence law unambiguous. Using Clausius relation and equating the integrands of (8) and (2) for all null vectors we get $$R_{\mu\nu}+\beta(R^{\sigma\rho} R_{\mu\sigma\nu\rho}-\frac {R}{2} R_{\mu\nu}) +\Psi g_{\mu\nu}
=\frac {2\pi}{\hbar \alpha} T_{\mu\nu}$$ The unknown function $\Psi$ is determined taking the covariant divergence of (9) and using the Bianchi identity and vanishing divergence of matter stress tensor. Use is made of following relations $$(R_{\mu\sigma\nu\rho} R^{\sigma\rho})^{: \mu}=(\frac {1}{4} R_{\sigma\rho}R^{\sigma\rho}
-\frac {1}{2} R_{:\alpha}^{~:\alpha})_{,\nu} +\frac {1}{2}(R_{;\mu\nu})^{:\mu}$$

$$(RR_{\mu\nu})^{:\mu} = (R_{;\mu\nu})^{:\mu} + (\frac {R^2}{4} - R_{:\alpha}^{~:\alpha})_{,\nu}$$ The expression for $\Psi$ is finally obtained to be $$\Psi = -\frac {R}{2} + \frac {\beta R^2}{8} - \frac {\beta R^{\sigma\rho} R_{\sigma\rho}}{4}$$ Substituting $\Psi$ in (9) we get the desired higher curvature equation of state $$G_{\mu\nu} - \frac {\beta R}{2} (R_{\mu\nu} - \frac {R}{4} g_{\mu\nu}) +\beta R^{\sigma\rho}
(R_{\mu\sigma\nu\rho} - \frac {R_{\sigma\rho}}{4} g_{\mu\nu})= \frac {2\pi}{\hbar \alpha} T_{\mu\nu}$$ Perusal of the higher curvature field equations in the literature shows that Eq.(13) is a new result. This equation has some remarkable properties: 1) The arbitrary constant $\beta$ could be adjusted to keep intact the established physical tests of the Einstein equation since the higher curvature effect appears as a correction to $G_{\mu\nu}$. 2) The trace of (13) leads to the same result as that of pure general relativity. Note also that the first two terms are same as the ones in $R^2$ gravity in the Palatini formalism which would make it to be in agreement with some of the results of that theory. However the third term is a new addition. And 3) In contrast to the higher curvature field equations obtained from the action principle which are fourth order derivative equations, Eq.(13) is a second order derivative equation similar to that one obtains in the Palatini version where the action is varied taking metric and affine connection as independent variables. These characteristics strongly suggest viability of Eq.(13) as higher curvature gravity theory.

It is well known that the question of gravitational energy in general relativity is quite complex , and even more so in higher curvature gravities . An interesting consequence of (13) is that in the empty spacetime it reduces to $$R_{\mu\nu} + \beta R^{\sigma\rho}(R_{\mu\sigma\nu\rho} - \frac {R_{\sigma\rho}}{4} g_{\mu\nu})
= 0$$ What is the physical significance of the second term in Eq.(14)? In analogy with the traceless stress tensor of electromagnetic field it is plausible to identify this term to represent stress tensor of gravity radiation loss. Bondi presented a lucid discussion on the inductive and wave transfer of gravitational energy in general relativity, and considered axially-symmetric vacuum solution of Weyl and Levi-Civita for this purpose. Since the vacuum defined by Eq.(14) has different nature, it would be interesting to delineate inductive and wave energy transfers in this case.

The problem of entropy production for $f(R)$ gravity has been extensively discussed in . What would be the entropy production in the present case? There is another interesting question: Could one derive Eq.(13) in the action formalism? We propose to investigate Palatini formalism for the action used by Deser and Tekin elsewhere since the main theme of the present work is thermodynamic approach to the spacetime.

In conclusion, we have argued that Einstein equation in thermodynamic approach represents a viscous spacetime fluid, and derived a new equation of state for higher curvature corrections.

I thank Prof. S. Deser for helpful correspondence, and Prof. Rong-Gen Cai for drawing my attention to . Library facility of Banaras Hindu University is acknowledged.


abstract: Semantic segmentation is challenging as it requires both object-level information and pixel-level accuracy. Recently, FCN-based systems gained great improvement in this area. Unlike classification networks, combining features of different layers plays an important role in these dense prediction models, as these features contains information of different levels. A number of models have been proposed to show how to use these features. However, what is the best architecture to make use of features of different layers is still a question. In this paper, we propose a module, called mixed context network, and show that our presented system outperforms most existing semantic segmentation systems by making use of this module.
author:
;
;
bibliography: IEEEabrv.bib; ../bib/paper.bib
title: Mixed context networks for semantic segmentation

# Introduction

Semantic segmentation is a classic problem in computer vision. It is challenging as it requires both object-level information and pixel-level accuracy, especially when there is a large variation in sizes of objects.
Recently, methods based Fully Convolutional Networks (FCN) significantly improve the performance in many datasets. FCNs are usually transformed from pre-trained classification networks (e.g., VGG-16, Resnet), by making use of ${1\times1}$ convolutional layers to replace fully-connected layers. The simplest FCN (e.g., FCN-32s) generate coarse score map. To gain fine predictions, one strategy is to combine fine predictions, which generated from early layers, like FCN-8s . shows that FCN-8s can be seemed as an efficient implementation of linear prediction using the hypercolumn features, which are extracted from multiple layers of the network.
However, further studies show that the linear predictor on hypercolumn features might not be a good choice. uses a stage-wise refinement module to combine features from multiple layers. shows that a MLP defined on hypercolumn features lead to better results than linear prediction.
On the other hand, the dilated convolution, also called atrous convolution, plays an important role in dense prediction systems. The dilated convolution enlarges the receptive field without loss of resolution of prediction. FCN-based models are able to benefit from it, and generate fine score maps without combining features from multiple layers. Furthermore, DilatedNet can arbitrarily enlarge the receptive field by adjusting the sampling rates of dilated convolutions. Such systems usually gain more accurate predictions as more context information is considered.
Dilated convolution enlarges the receptive field without loss of resolution of prediction. But keeping the resolution does not mean keeping detailed information. Combining features from multiple dilated convolutions with different sampling rates should be meaningful for dense prediction. To combine these features, one strategy is extending the refinement module to all dilated convolutional layers with different sampling rates, but it is cost if many dilated convolutional layers are added like models in . Another strategy is use a module like atrous spatial pyramid pooling (ASPP) , which fuses features from multiple parallel dilated convolutional layers with different sampling rates. But the sampling rates are fixed in ASPP, and you maybe need to do some experiments to choose good rates. The third strategy is use hypercolumn features and sparse predictions like in , but it is not computational efficient when predicting.
In the paper, we propose a module called mixed context network, which mixes features of multiple dilated convolutions, and seems to have ability to learn to identify the most relevant scales. By using the mixed context network, our architecture produces competitive results in PASCAL VOC 2012 semantic segmentation challenge and MIT SceneParsing150 challenge.

# Related work

Many systems have been proposed to handling scale variability in semantic segmentation. One of the most common approaches is extracting score maps from multiple rescaled versions of the original image by making use of parallel CNN branches . uses skip connections to combine the predictions of fine layers and coarse layers. gains improvements on detection and segmentation tasks by Hypercolumns representation which could be generated by skip connections. attacks this problem by using atrous spatial pyramid pooling (ASPP), which is constructed by multiple parallel atrous convolutional layers with different sampling rates. studies the influence of both long and short skip connections, and finds that both of them are helpful to FCN-based method.

# Proposed method

We first introduce the overall architecture at this section. After that, we will discuss several options for the mixed context network module, and a memory-efficient refinement module called message passing network will be proposed at last.

## Overall Architecture

Given a FCN-based model, such as the DilatedNet proposed by , we consider effective ways to use the features from multiple layers. The DilatedNet can be divided into two parts. The bottom part is transformed from pre-trained classification networks, and the upper part is formed by a stack of dilated convolutions with different sampling rates. We deal with each part on its merits, as the two parts play different roles.
The structure of the bottom part usually stays the same with classification networks at least has two reasons. The first reason is that the segmentation models need to fine-tune from classification networks, as the pixel-level label annotations are expensive, and the data set is usually not big enough to train a deep model. The second reason is that the receptive fields of most classification networks are just the right size to segment most objects in normal size pictures.
Furthermore, a number of experiments have shown that enlarging the receptive fields of models leads to better results in most public datasets (e.g., PASCAL VOC). This is why the upper part is added, which usually formed by dilated convolutions. The receptive field could be arbitrarily enlarged by adjusting the sampling rates of dilated convolutions, but it is not easy to decide which rate is the best. On the other hand, it seems necessary to combine features from multiple dilated convolutional layers, as the dilated convolution leads to large variation in receptive field.
For the above reasons, we propose a model (Fig.) for dense prediction. We begin with casting classification convolutional networks to fully convolutional networks, and pick out several feature maps of FCN to be combined (one feature map per pooling layer). The feature maps from deeper layers, which encoding more high-level semantic information, are fused first, and fed into a module called mixed context network (MCN). The mixed context network mixes features of multiple dilated convolutions, and seems to have ability to learn to identify the most relevant scales. Then, refinement modules are stacked by making use of output feature map of MCN and feature maps from lower layers. At last, a module called message passing network is added to enforce spatial consistency across labels.
Compared with directly feeding the output score map of FCN into the context network , our system gains significantly improvements by using combination of feature maps. For models like FCN-32s , feature maps should be up-sampled to the same resolution before fused, but for models which remove pooling layers by making use of dilated convolutions , the up-sampling operator can be omitted. To avoid too many parameters, reducing the number of channels of feature maps before fed into MCN is recommendatory for most tasks.
Which feature maps of the FCN to pick up also has an impact on system performance. Our experiments have shown that, feature maps from deeper layers lead to better result. So, taking VGG-16 as an example, feature maps from conv2_2, conv3_3, conv4_3 and conv5_3 layers work better than feature maps from pool1, pool2, pool3 and pool4 layers.

## Mixed context networks

In this paper, we consider three architectures for combining features of multiple dilated convolutional layers, which are shown in Fig.. Follow the work of , kernel size of any dilated convolution in these models is set to 3, and we double the sampling rate layer by layer from bottom to top.
Skip connections are popular in dense prediction systems. Common skip connections just concatenate or fuse features from multiple layers of feedforward networks . We design two architectures by making use of common skip connections. Given a stack of dilated convolutions, the first architecture (Fig.2 (a)) just concatenate the input feature maps of the first dilated convolution and the output feature maps of the last dilated convolution. In contrast, the second architecture (Fig.2 (b)) concatenate the input feature map and output feature map of one dilated convolution, and feed the concatenated features to the next dilated convolution. The intermediate ${1\times1}$ convolutional layer are used to adjust the number of channels of feature maps.
Furthermore, we design the mixed context network, in which, we do not directly use common skip connections, but add a convolutional layer before the features are concatenated. In the mixed context network, multi-scale features are mixed stepwise, and the network is able to learn to put different weights to features of different scales.

## Message passing network

As FCNs produce separate predictions for each pixel, most systems enforce spatial consistency across labels by making use of dense-CRF . shows that the mean-field CRF inference can be reformulated as a recurrent neural network, and the integrated system can be trained end-to-end with the back-propagation algorithm.
However, the CRF-RNN is memory cost, especially when the class number is large, for example 150 in ADE20K. One can decrease the resolution of input patches to save memory, but it is not benefit for training of deep layers, which have large receptive fields. We attack this problem by making use of a memory-efficient module called message passing network (MPN), shown in Fig..
In each iteration of MPN, the number of channels of score map $S_{i}$ is first reduced from N to $N_{s}$, that $N_{s}$ is smaller than N. $S_{i}(i>0)$ is the output score map of last iteration, and $S_{0}$ is the input score map of MPN. The reduced score map is fed into a permutohedral convolutional layer, which performs high-dimension pairwise term. Compared to CRF-RNN, we drop the smooth pairwise term, and instead use a concatenation layer follows a ${3\times3}$ convolutional layer. The output score map $S_{i+1}$ is the sum of $S_{0}$ and the output feature maps of the ${3\times3}$ convolutional layer, which has exactly the same number of channels as score map $S_{0}$.

# Experiments

Our implementation is based on the Caffe library . We trained all models using Nesterov. Mini-batch size is set to 20 and momentum is set to 0.9. Training was performed with an initial learning rate of 0.01, and multiply it by 0.1 every 50K iterations.

|        models        | MeanIU |
|:--------------------:|:------:|
|      FCN_256CT       | 0.784  |
| FCN_256CT_long_skip  | 0.793  |
| FCN_256CT_short_skip | 0.790  |
|       FCN_MCN        | 0.806  |
|  FCN_MCN_long_skip   | 0.802  |

Results of Validation Set of PASCAL VOC 2012

## PASCAL VOC 2012

We test our models on the PASCAL VOC 2012 semantic segmentation benchmark, consisting of 20 foreground object classes and one background class. All our models are trained on augment Pascal dataset and Microsoft COCO dataset together. We use all images in training and validation sets with at least one object from the Pascal VOC 2012 categories except that from the Pascal VOC 2012 validation set. Objects of other categories were treated as background. We use the PASCAL VOC 2012 validation set to evaluate the improvements gained by the structural changes of networks.
Follow the work of , we first extend the context networks. In all of our experiments, we begin from FCN-32s, take the combination of the output feature maps from conv4_3, conv5_3 and fc7 as input feature maps of the remaining module. We keep the parameters of layers in FCN-32s fixed. The number of channels of feature maps from fc7, conv5_3, conv4_3 are 4096, 512, 256. Three added layers reduce the channels to 21 before they are confused. If the parameters of these three layers parameters are copied from FCN-8s, and keep unchanged, the model achieves 76.5% (meanIU) in Pascal VOC 2012 validation set. If these three layers are trained, we got 1 percent improvement. If concatenating the feature maps of these three layers, and the number of channels is up to 63, we got another 0.5 percent improvement.
Further experiments show that, with more number of channels of the input feature maps of MCN, the network tends to learn better, for it can capture more information. To alleviating over-fitting, we set the dimension to 256 in following experiments. The numbers of filters of dilated convolutional layers in context network are set to 256, 256, 512, 512, 1024 and 1024 from bottom to top. Here, we did not double the number of filters layer by layer as to avoid too many parameters. In our experiments, this model, referred as FCN_256CT, provide 0.5 percent improvement, achieves 78.4%. We use this model as the baseline in the following experiments.
Then, we consider four models. In the first model, we add a skip connection between the input and the output of the context network module of FCN_256CT, referred as FCN_256CT_long_skip (Fig.2 (a)). In the second model, we combine short connections and dilated convolutions in FCN_256CT, referred as FCN_256CT_short_skip (Fig.2 (b)). In the third model, we use mixed context network to replace the context network, referred as FCN_MCN. In the fourth model, a long skip connection between the input and the output of mixed context network is added, referred as FCN_MCN_long_skip. The result is shown in Table .
The mean IOU of FCN_MCN and FCN_MCN_long_skip are: 80.6% and 80.2%, shows that the feature maps from FCN provide no more useful information, combined with feature map from MCN. However, for the FCN_256CT, the additional skip connection brings 0.9% improvement. In PASCAL VOC 2012 test set, we achieve 0.814 using one FCN_MCN model with multi-scale input images.

|                models                 | MeanIU | PixelAcc |
|:-------------------------------------:|:------:|:--------:|
|              DilatedNet               | 0.3231 |  73.55%  |
|          Cascade-DilatedNet           | 0.3231 |  74.52%  |
|             FCN_MCN(ours)             | 0.3832 |  78.04%  |
|         FCN_MCN_REFINE(ours)          | 0.3880 |  78.05%  |
|       FCN_MCN_REFINE_MPN(ours)        | 0.4001 |  78.40%  |
| FCN_MCN_REFINE_MPN + multiscale(ours) | 0.4158 |  80.01%  |

Results of Validation Set of SceneParse150

## MIT SceneParsing150

The dataset of MIT SceneParsing150 contains 20k training images, 2000 validation images and 3352 testing images. There are totally 150 categories, contains 35 stuff classes and 115 discrete objects.
We augment the training images by randomly flipping and randomly scaling (from 0.5 to 1.5), and patches with size of ${448\times448}$ by randomly cutting are fed to the networks.
The FCN-32s is first fine-tuned from VGG-16 , then the MCN module is added to the end of the network as described at Fig.. When training FCN_MCN, all parameters of layers in FCN-32s are fixed except the fc7 layer. All parameters of new layers are trained and the learning rate of the additional layers multiplies 10. For the FCN_MCN_REFINE_MPN, we set the iteration number of MPN to 3. The results of validation set are shown in Table , and we achieve 0.53355 in the test set.

# Conclusion

In this paper, we introduce a module called mixed convolutional network, which can be added to any FCN models. The experiments show that it can provide better features to predict stuff, big objects and small objects all at once. Furthermore, a memory-efficient module called message passing network is proposed to enforce spatial consistency across labels.


I/333               URAT Parallax Catalog (UPC)                  (Finch+, 2016)
    ================================================================================
    The URAT Parallax Catalog (UPC).
       Finch C.T., Zacharias N.
       <URAT Parallax Catalog (2016)>
       =2016yCat.1333....0F
    ================================================================================
    ADC_Keywords: Surveys ; Positional data ; Parallaxes, trigonometric ;
                  Proper motions
    Keywords: parallaxes - solar neighborhood - stars:  distances -
              stars: statistics - surveys - astrometry - photometry

    Description:
        The URAT Parallax Catalog (UPC) consists of 112177 parallaxes. The
        catalog utilizes all Northern Hemisphere epoch data from the United
        States Naval Observatory (USNO) Robotic Astrometric Telescope (URAT).
        This data includes all individual exposures from April 2012 to June
        2015 giving a larger epoch baseline for determining parallaxes over
        the 2-year span of the First USNO Robotic Astrometric Telescope
        Catalog (URAT1) (Zacharias et al., 2015, Cat. I/329) published data.
        The URAT parallax pipeline is custom code that utilizes routines from
        (Jao, C.-W., 2004, PhD thesis Georgia Stat), the JPL DE405 ephemeris
        and Green's parallax factor (Green, R.M., 1985, Spherical Astronomy)
        for determining parallaxes from a weighted least-squares reduction.
        The relative parallaxes have been corrected to absolute by using the
        distance color relation described in (Finch et. al, 2014, Cat.
        J/AJ/148/119) to determine a mean distance of all UCAC4 reference
        stars (R=8-16 mag) used in the astrometric reductions.

        Presented here are all significant parallaxes from the URAT Northern
        Hemisphere epoch data comprising of 2 groups: a) URAT parallax results
        for stars with prior published parallax, and b) first time
        trigonometric parallaxes as obtained from URAT data of stars without
        prior published parallax. Note, more stringent selection criteria have
        been applied to the second group than the first in order to keep the
        rate of false detections low. For specific information about the
        astrometric reductions please see 'The First U.S. Naval Observatory
        Robotic Astrometric Telescope Catalog' published paper (Zacharias et
        al., 2015AJ....150..101Z, Cat. I/329).

        For complete details regarding the parallax pipeline please see
        'Parallax Results From URAT Epoch Data' (Finch and Zacharias, 2016,
        AJ, in press).

        This catalog gives all positions on the ICRS at Epoch J2014.0; it
        covers the magnitude range 6.56 to 16.93 in the URAT band-pass, with
        an average parallax precision of 4.3mas for stars having no known
        parallax and 10.8mas for stars matched to external parallax sources.
        This catalog covers the sky from about North of -12.75{deg}
        declination.

        This catalog was matched with the Hipparcos catalog, Yale Parallax
        Catalog, (Finch & Zacharias, 2016, AJ, in press), MEarth (Dittmann et.
        al., 2014ApJ...784....2M) and the SIMBAD database to obtain known
        parallax and star names. For stars matched to SIMBAD using the
        automated search feature, only the parallaxes are given so no
        information on the parallax errors or source for the parallax are
        reported for those stars in this catalog. A flag is included to show
        which catalog or database the URAT parallax was matched with. Only the
        data from the first catalog that was matched is reported here
        according to the following priority list. This means for example, if a
        star was matched with Hipparcos, that information was used while
        possible other catalog data are not listed here.

        --------------------------------------------------------
        # stars flg catalog
        --------------------------------------------------------
          53500   0 no catalog match
          55549   1 Hipparcos
            254   2 Yale Parallax Catalog
           1041   3 Finch and Zacharias 2016 (UPM NNNN-NNNN)
           1431   4 MEarth parallaxes
            402   5 SIMBAD Database (w/parallax)
        --------------------------------------------------------
         112177 total number stars in catalog
        --------------------------------------------------------

        Not all parallaxes from the URAT epoch data are included in this
        catalog. Only those data meeting the following criteria have been
        included. For the epoch data we only used data having a
        FWHM<=7.0pixel; amplitude between 500 and 30000ADU; sigma x,y
        <=90.0mas; number of observations >=20 and epoch span>=1.0 years. The
        limits imposed on individual image amplitude, image profile width
        (FWHM) and position fit errors (sigma) are set to not allow saturated
        stars, stars with too few photons or poorly determined positions to be
        used in the parallax solution. We present all URAT parallax solutions
        having a known parallax from an external data source regardless of the
        quality of the solution (srcflg=1-5). This was done for the user to
        better understand the limitations for determining parallaxes with the
        current URAT epoch data. For the remaining URAT parallaxes without a
        match to any published trigonometric parallax (srcflg=0) we only
        present a parallax solutions having:

           1) a parallax error <=10mas
           2) a parallax error <=1/4 the relative parallax
           3) epoch span >=1.5 years
           4) number of observations used >=30
           5) fit sigma<=1.4 (unit weight)
           6) average image elongation <1.1.
        All of these cuts have been implemented in an attempt to lower the
        number of possible erroneous parallax solutions entering our catalog.

        However, the URAT reduction process does not take provisions for close
        doubles (blended images) of arcsecond-level separations. Many of the
        parallaxes, particularly those with large mean elongation, large
        parallax error, large fit sigma and many rejected observations are
        possibly blended images leading to a higher chance of an erroneous
        parallax solutions. A visual inspection of all residual plots and real
        sky images would not be practical for the entire catalog. However, we
        have included information in the catalog to help the user to determine
        if a solution should be investigated further.

    File Summary:
    --------------------------------------------------------------------------------
     FileName      Lrecl  Records   Explanations
    --------------------------------------------------------------------------------
    ReadMe            80        .   This file
    upc.dat          167   112177   URAT Parallax Catalog
    --------------------------------------------------------------------------------

    See also:
           I/238  : Yale Trigonometric Parallaxes, Fourth Edition (van Altena+ 1995)
           I/239  : The Hipparcos and Tycho Catalogues (ESA 1997)
     J/AJ/148/119 : UCAC4 nearby star survey (Finch+, 2014)
           I/329  : URAT1 Catalog (Zacharias+ 2015)

    Byte-by-byte Description of file: upc.dat
    --------------------------------------------------------------------------------
       Bytes Format Units    Label     Explanations
    --------------------------------------------------------------------------------
       1-  6  I6    ---      UPC       URAT Parallax Catalog (UPC) number
       8- 18  F11.7 deg      RAdeg     Right ascension on ICRS, at Epoch J2014 (1)
      20- 30  F11.7 deg      DEdeg     Declination on ICRS, at Epoch J2014     (1)
      32- 61  A30   ---      Name      Identifier                              (2)
      63- 67  F5.2  mag      f.mag     URAT mean model fit magnitude           (3)
      69- 74  F6.1  mas      relpi     URAT relative parallax
      76- 78  F3.1  mas      picor     Parallax correction
          80  A1    ---      corflg    [0-2] Parallax correction flag          (4)
      82- 87  F6.1  mas      abspi     Absolute parallax
      89- 93  F5.1  mas    e_abspi     Error on absolute parallax
      95-101  F7.1  mas/yr   pmRA      Proper motion in right ascension
     103-107  F5.1  mas/yr e_pmRA      Error proper motion in right ascension
     109-115  F7.1  mas/yr   pmDE      Proper motion in Declination
     117-121  F5.1  mas/yr e_pmDE      Error proper motion in Declination
     123-125  I3    ---      ne        Total number of epochs available        (5)
     127-128  I2    ---      nr        Total number of epochs rejected         (5)
     130-133  F4.2  yr       Espan     Epoch span of data
     135-139  F5.3  ---      Elo       Average elongation of image             (6)
     141-145  F5.3  ---      fsig1     Fit sigma 1 (reduced chi-square)        (7)
     147-151  F5.1  mas      fsig2     Fit sigma 2 (mean error indiv.obs.)
         153  A1    ---      srcflg    [0-5] Source flag                       (8)
     155-161  F7.2  mas      srcpi     Parallax from external source           (9)
     163-167  F5.2  mas    e_srcpi     Parallax error from external source     (9)
    --------------------------------------------------------------------------------
    Note (1):  Positions are on the International Celestial Reference System
         (ICRS) as represented by the UCAC4 catalog. Mean observed positions
         are given at epoch J2014 (mean observed positions have been updated
         to J2014 using the proper motions from column ('pmRA', 'pmDE').

    Note (2): Identifier comes from the external source from which the URAT
         position was matched column ('srcflg').  For Mearth the LSPM North
         Catalog Designation is given. This is left blank if no identifier
         was found.

    Note (3):  This is the mean, observed magnitude in the 680-750 nm URAT
         bandpass, calibrated by APASS photometry. This bandpass is between
         R and I, thus further into the red than UCAC. Observations in
         non-photometric nights *are* included thus the URAT magnitudes need
         to be taken with caution.

    Note (4): The parallax correction flag is as follows:
         0 = correction from the photometric parallaxes of UCAC4 ref.stars
         1 = no correction so the mean of 1.3mas was used
         2 = large correction so the cut off of 3.9mas was used

    Note (5): the number of epochs available in the URAT epoch data (ne) and
         the number of epochs rejected (nr) during the fit solutions.

    Note (6): average image elongation from moment analysis, ratio of major
         to minor axis is given (1.0 = round)

    Note (7): The error of unit weight (reduced chi-square) of the parallax fit
         solution is given. Thus 1.0 means the scatter of the post-fit residuals
         match the expected observational errors and assigned weights.

    Note (8): The source flag gives the external source to which the URAT
         position was matched and where the information for columns 'srcpi'
         and e_srcpi are from.
           0 = no match to any of the following external catalogs found
           1 = matched to Hipparcos (Cat. I/239)
           2 = matched with The Yale Parallax Catalog
                (van Altena et al., 1995, Cat. I/238)
           3 = matched with (Finch & Zacharias, 2016, AJ, in press)
           4 = matched with MEarth parallaxes
                 (Dittmann et.  al., 2014ApJ...784....2M)
           5 = matched with SIMBAD database (http://simbad.u-strasbg.fr/simbad/)

    Note (9): Parallax and error from external source. Due to the
         limitations of the SIMBAD database automated search feature the
         parallax error or the source of the parallax is not given so for
         all srcflg = 5, the parallax error is reported as 0.0. For all
         srcflg = 0, meaning no match to an external catalog the parallax
         and error are reported as 0.0.
    --------------------------------------------------------------------------------

    Acknowledgements:
       Charlie Finch, charlie.finch(at)usno.navy.mil

    ================================================================================
    (End)                                      Patricia Vannier [CDS]    06-Apr-2016


abstract: As smart grids are getting popular and being widely implemented, preserving the privacy of consumers is becoming more substantial. Power generation and pricing in smart grids depends on the continuously gathered information from the consumers. However, having access to the data relevant to the electricity consumption of each individual consumer is in conflict with its privacy. One common approach for preserving privacy is to aggregate data of different consumers and to use their smart-meters for calculating the bills. But in this approach, malicious consumers who send erroneous data to take advantage or disrupt smart grid cannot be identified. In this paper, we propose a new statistical-based scheme for data gathering and billing in which the privacy of consumers is preserved, and at the same time, if any consumer with erroneous data can be detected. Our simulation results verify these matters.
author: Alireza Ahadipour, Mojtaba Mohammadi, and Alireza Keshavarz-Haddad [^1]
title: Statistical-Based Privacy-Preserving Scheme with Malicious Consumers Identification for Smart Grid

# Introduction

, the traditional power grids underwent an alteration to smart grids which leads to several benefits including enhanced reliability and resilience, higher intelligence and optimized control, decentralized operation, higher operational efficiency, more efficient demand management, better power quality, and fraud detection . The smart grid is envisaged to be the next generation of the traditional grid. In smart grid, the consumers minimize their expenses while providers maximize their revenue, hence, a win-win partnership can be achieved.

On the contrary to the traditional grids, there is a bidirectional information flow between suppliers and consumers in smart grids rather than a centralized unidirectional system. This feature enables the supplier to generate the electricity based on the demand; and at the same time, the supplier can define dynamic billing tariff, and regard to these tariffs that are sent to consumer periodically (e.g. every $15$ minutes), each consumer decides whether to decrease or increase its power consumption. Thus, electricity is consumed in a more efficient manner. In the other direction of information flow in smart grids, consumers declare their need for electricity or their power consumption; indeed, consumers send their momentary electricity usage to the suppliers. As a result, unlike traditional grids, in smart grids suppliers provide electricity based on the demands of consumers to avoid wasting power .

In order to provide two-way communication in smart grid, the consumers should be equipped with smart meters by which they can measure their usage and send/receive messages over communication links such as power-line, cable, fibre, or radio.

The classic approach for billing is to gather all power consumption information in a center, i.e., the consumers send their electricity usage to a server – which is responsible for gathering data – periodically by means of smart meters and then, the server dispatches the gathered information to a local or central database. The electricity bill for each consumer is calculated based on records of the consumers in the database. Criticism to this scheme is that the privacy is not preserved. As each individual consumer sends its usage, the pattern of its power consumption is apparent to the center; for instance, inhabitant's personal schedules, habits, religion, and so on .

Another trivial approach for billing is that the supplier sends time-varying tariffs periodically to the consumers and their smart-meters compute the electricity consumption price over a defined period (e.g. one month) based on the received tariffs. Eventually, at the end of each period, every consumer only sends its total billing amount to the supplier. In this case, the privacy of each consumer would be preserved; however, supplier cannot verify consumers' billing reports. Consequently, some malicious consumers would take advantage or distrust smart grid by sending incorrect information on their power usages. In this case, historical analysis of electricity usage reports would not be useful for identifying malicious users. For instance, if the power consumption pattern of a consumer alters over time, this consumer would be considered as a consumer who is declaring incorrect information; while a malicious consumer who ever sends artificial data cannot be easily identified .

According to the aforementioned scenarios, the main challenge in communications between consumers and suppliers is preserving the privacy of consumers while identifying any malicious consumer in the smart grid. To address this challenge, we propose a new scheme called statistical-based privacy preserving (SBPP). An earlier version of SBPP was presented in . Notably, the present work completes our previous paper and provides more technical details and adds some new ideas for data gathering and fraud detection.

The proposed scheme enables privacy preserving data gathering and detecting the malicious consumers possible at the same time. SBPP exhibits an efficient solution for privacy preserving in terms of computation complexity and communication overhead. The key idea in SBPP scheme is to combine usages of different consumers at local data aggregators (to preserve privacy) and also sending accurate usage of some randomly selected consumers to the supplier. Then the supplier uses the data of accurate usage of different consumers over random periods of time to detect malicious consumers. Simulation results verify that SBPP is reliable for detecting malicious consumers in different sabotaging scenarios.

The remainder of this paper is organized as follows: In Section , we briefly discuss related works. In Section , the system model is introduced. In Section , we describe our proposed statistical-based scheme for data gathering in smart grid. In section , the simulation results of the proposed scheme are presented. Finally, we conclude the paper in Section .

# Related Works

Recently, many researchers have paid attention to privacy-preserving solutions for smart grids. In this section, we briefly review some proposed schemes for privacy-preserved data gathering in smart grids.

In authors propose an algorithm for data collection with self-awareness protection. The paper considers some data aggregators and consumers in a smart grid where some of the respondents may not participate in contributing their personal data or submit erroneous data. To overcome this issue a self-awareness protocol is proposed to enhance trust of the respondents when sending their personal data to the data aggregators. In this scheme, all consumers collaborate with each other to preserve the privacy. They have hired an idea, which allows respondents to know protection level before the data submission process is initiated. The work is motivated by and . In , co-privacy (co-operative privacy) is introduced. Co-privacy claims that best solution to achieve privacy is to help other parties to achieve their privacy.

Many papers study self-oriented privacy protection methods. For example, introduces self-enforcing privacy (SEP) for e-polling. In SEP scheme, supplier allows the consumers to track their submitted data in order to protect their privacy. In this case, the consumers can accuse the supplier based on data they gathered during the collection process. Following this idea, a fair approach for accusation is presented in .

In , a respondent-defined privacy protection (RDPP) is introduced. It means that respondents are allowed to determine their required privacy protection level before delivering data to data collector. Unlike other methods in which data aggregators decide about the privacy protection level, in this scheme the consumers can freely define the privacy protection level.

There are also some other researches on privacy-preserving data collection. For instance, in authors design a balanced anonymity and traceability for outsourcing small-scale linear data aggregation (called BAT-LA) in smart grid. Anonymity means that consumers' identity should be kept secret and traceability means that imposter consumers should be traced. Here an important challenge is that many devices are not capable of handling required complicated computations. Hence, they have hired the idea of outsourcing computations with the help of public cloud. The paper utilizes elliptic curve cryptography and proxy re-encryption to make BAT-LA secure. BAT-LA is evaluated by comparing it with two other schemes, RVK , and LMO and it is shown that BAT-LA is more efficient in terms of confidentiality.

The papers and focus on outsourcing to clouds or distributed systems. For encryption process, it is important to use a secure key management scheme. The cryptographic technique ensures that no privacy sensitive information would be revealed. But, there is still the challenge of how to efficiently query encrypted multidimensional metering data stored in an untrusted heterogeneous distributed system environment. addresses this issue and introduces a high performance and privacy-preserving query (P2Q) scheme which provides confidentiality and privacy in a semi-trusted environment.

To obtain privacy of residential consumers, a scheme named APED is proposed in . The paper employs a pairwise private stream aggregation. The scheme achieves privacy preserving aggregation and also executes error detection when some nodes fail to function normally. DG-APED is an improved form of APED, suggested in . DG-APED propounds diverse grouping-based protocol with error detection. This research added differential privacy technique to APED. Moreover, DG-APED has an advantage of being efficient in terms of communication and computation overhead compared to APED.

In , the authors present a new kind of attack, which adversary extracts information about the presence or absence of a consumer to access the smart meter information. The attack is called human-factor-aware differential aggregation (HDA) and it is claimed that other proposed schemes cannot handle it. To solve this issue, the authors introduce two privacy-preserving schemes which can stand out against HDA attack by transmitting encrypted measurements to an aggregator in a way that aggregator cannot steal any information of human activities.

PDA is a privacy-preserving dual-functional aggregation scheme in which, every consumer disseminates only one data and then supplier computes two statistical averages (mean and variance) of all consumers . The paper shows by simulations that PDA possesses low computational complexity and communication overheads. In another work, the authors introduce privacy-preserving data aggregation with fault-tolerance called PDAFT . If PDAFT is implemented, a strong adversary is not able to gain any information, even in the case of compromising a few servers at the supplier. Like PDA, PDAFT has relatively high communication overhead and is tenacious against many security threats. In PDAFT scheme, if some consumers or servers fail, it can still work correctly.

DPAFT is another privacy-preserving data collection scheme which supports both differential privacy and fault tolerance at the same time. It is claimed that, DPAFT surpass other schemes in many aspects, such as storage cost, computation complexity, utility of differential privacy, robustness of fault tolerance, and the efficiency of consumer addition or removal . A new malfunctioning data aggregation scheme, named MuDA, is introduced in . The scheme is resistant to differential attacks and keeps consumers' information secret with an acceptable noise rate. PDAFT , DPAFT , and MuDA , shows nearly same characteristics with differences on their cryptographic methods . PDAFT employs homomorphic Paillier cryptosystem , while DPAFT and MUDA use Boneh-Goh-Nissim cryptosystem .

In authors present a secure power usage data aggregation method for smart grid where the supplier understands usage of each neighborhood and makes decision about energy distribution, while it has no idea of the individual electricity consumption of each consumer. This method is designed to barricade internal attacks and provide batch verification. Authors of found out that has the weakness of key leakage and the imposter can obtain the private key of consumer easily. It is proved that by using the protocol in , key leakage problem is solved and a better performance in terms of computational cost is achieved. Neglecting energy cost is the main disadvantage of this method.

In , a privacy-preserving protocol for smart grid is presented which outsources computations to cloud servers. In this protocol, the data is encrypted before outsourcing and consequently cloud can perform any computations without decryption. adopts perturbation techniques to preserve privacy and uses perturbation techniques and cryptosystems at the same time. It is designed in a way to be suitable for hardware-limited devices. Evaluations show that it is resilient to two types of attack: filtering attack, and true value attack.

Authors of explain how for privacy preserving an individual meter of a consumer can share its readings to multiple consumers, and how a consumer can receive meter readings from multiple meters. They propose a polynomial-based protocol for pricing. In a security protocol called TPS3 is introduced which uses Temporal Perturbation and Shamir's Secret Sharing (SSS) to guarantees privacy and reliability of consumers' data. In , data collector tries to preserve privacy by adding some random noise to its computation result. To overcome the problem of computation accuracy reduction, an approximation method is proposed in which leads to obtain a closed form of aggregator's decision problem. In , a slightly different scenario is considered in which a data aggregator collects data from consumers and then spreads data to supplier. The goal is to preserve consumers' data privacy. Anonymization might be an answer, but it has its own challenges. To achieve a tradeoff between privacy protection and data utility, interactions among three elements of scenario (consumers, data aggregator, and supplier) is modelled as a game and the Nash equilibria of the game is found.

In this paper we use the idea of aggregating data of different consumers for persevering the privacy of each individual consumer. The proposed SBPP scheme applies a simple statistical method for identifying the malicious consumers who send erroneous data to the aggregator in order to take advantage or disrupt smart grid. SBPP does not require any change on consumer side and communication infrastructure. It possesses very low computational overhead in aggregators and billing center in order to preserve privacy and detect malicious consumers. Therefore, SBPP is practical in the sense that it can be easily implemented on the existing infrastructure of smart grids.

# System Model

In this section, we present our system model. The essential elements of our proposed scheme include:

*Consumer:* those who consume energy in a power grid.

*Benign consumer:* a consumer who reported its power consumption correctly.

*Malicious consumer:* a consumer who reported its power consumption incorrectly due to some purposes such as fraud (power theft) or disruptive goals (power loss).

*Supplier:* an entity whose responsibility is to provide energy for power consumers in a region.

*Data aggregator:* a local facility whose liability is gathering the amount of power consumption information from consumers periodically and dispatching the gathered data to the supplier.

*Electricity leakage*: the difference between the actual amount of consumed energy and the sum of quantity reported by consumers as their power consumption.

We consider a power grid consisting of $M$ regions where each region comprises one data aggregator. Denote the number of consumers in the $j$'th region by $n_j$ for $j= 1, \ldots, M$. Assume that the consumers send their power consumption information measured by the smart meters to the local aggregators. The aggregators are responsible of gathering local data and sending some information regarding the usage of the consumers to the power supplier.

It is assumed that data aggregators are trusted. Indeed, no information leakage occurs at data aggregators, supposedly because after aggregation takes place, no raw information concerning power consumption of consumers would be at hand. Besides, we assume that communications among the above entities of smart grid are secured. This means that the submitted data by a consumer cannot be altered in the communication infrastructure, i.e., the erroneous data would be only generated by a consumer itself.

# Proposed Scheme

Although the accuracy of smart grids' performance is engaged with the correctness of data gathered from consumers, this data gathering should not violate the privacy of consumers. Here we propose a new privacy-preserving data gathering scheme with the purpose of informing the supplier of the instant power consumption. The proposed scheme provides the power usage information for the supplier while keeping the consumers' power consumption information private and more importantly, finds malicious consumers in the process. The proposed scheme possesses very low computational complexity and communication overhead on the smart grid in comparison with the existing methods.

## Data Gathering in SBPP

Here we present Statistical-Based Privacy-Preserving Scheme (SBPP) for data gathering in smart grids. SBPP gathers the information in the following steps:

1.  Consumers report their power consumption periodically to the local data aggregator.

2.  At each time period, the aggregator computes the total amount of power consumption based on the gathered data from the consumers. It also randomly selects the reported value of one the consumers.

3.  The aggregator sends the total power consumption value along with the name and reported value the selected consumer to the supplier.

4.  The supplier provides energy based on the reports of the aggregators and stores the reported values for randomly selected consumers.

Fig.  depicts how data gathering takes place.

Here it is assumed that data aggregators are trusted and the power consumption data is not at hand any more after being summed up by the data aggregators. Based on this assumption, instead of having access to power consumption data of each individual consumer at any period of time, a little portion of information is available about the power consumption of each consumer.

As an example, suppose there are $100$ consumers in a region with one data aggregator and let the period of data gathering be $15$ minutes. Without this data gathering algorithm mechanism, a consumer should send its power consumption information to the supplier $30*24*60/15=2880$ times in a month. By employing our scheme for data gathering, on average $2880/100=28.8$ values in regards to the power consumption of each consumer is available at the supplier in an analogous period of time. Although it may seem that having access to power consumption information of consumers is in contradiction with their privacy, availability of these information $28$ times a month on random periods would not reveal any data concerning their life style compared with approachability of these information $2880$ times within a month.

## Detecting Malicious Consumers

Malicious consumers pursue two distinct aims by sending erroneous data to suppliers. Either they declare their amount of power consumption lower than their real consumed power in order to pay less fee; or, they report their power consumption quantity much higher to impose more expenditure to the supplier.

In this paper, we get use of Pearson correlation coefficient of power consumption of consumers in order to find malicious consumers in each region who try to send erroneous data to the supplier.

Pearson correlation coefficient illustrates the statistical relationship between two variables and it is defined as follows: $$corr(x,y) =  \, \frac{cov(x,y)}{\sqrt{var(x) \cdot var(y)}}
\label{corr}$$ where $corr$ is a widely used alternative notation for the correlation coefficient and $cov$ means covariance.

Correlation coefficient possesses values in the range of $[-1,+1]$, where $+1$ and $-1$ indicate the strongest possible agreement and disagreement respectively.

In order to find malicious consumers, it is assumed that data aggregators are aware of the total amount of power consumed in each region. By comparing this amount with the aggregated quantity declared by consumers, the electricity leakage value (shortage) can be determined.

Having access to merely one quantity of power consumption information corresponding to a consumer does not suffice to distinguish if that consumer is benign or malicious. In other words, the more information we have regarding power consumption of each consumer, the better decision we can make about the sabotage of consumers. Thus, the scheme for finding malicious consumers can take place at the end of month or after a few months.

In order to detect malicious consumers, each data aggregator stores the identity (ID) of the randomly selected consumer, its reported power consumption ($r$), and the electricity leakage amount of power consumed in that region at every period ($l$). Then for each consumer, the data aggregator computes the correlation coefficient of its reported consumed energy and the leakage values of power consumption. The leakage quantity is defined as: $$l = c - r
%leakage = actual \; amount - reported \; amount
\label{leakage}$$ where $c$ and $r$ are the actual and reported power consumption values respectively.

It is straightforward to see that the correlation coefficient turns to $0$ for benign consumers, since the leakage value is statistically independent from the power consumption of a benign consumer. Now if the correlation coefficient turns to $+1$ for a consumer, this means that (according to ()) the consumer is reporting its power consumption less than its actual used power. On the other hand, if the correlation coefficient for a consumer turns to $-1$, it means that consumer is declaring its power consumption more than its usage due to some subversive goals. Thus, SBPP scheme is capable of not only detecting malicious consumers, but also comprehending if that consumer is declaring its amount of power consumption less or more than its actual quantity.

Next, we study the performance of SPBB for some scenarios based on the number of malicious consumers in each region and the behavior of attackers.

### Scenario I: Existence of at most one malicious consumer in each region

Suppose that there exists at most one malicious consumer in each region. According to the declared quantity of power consumption of consumers, three cases could be considered:

It should be stated that in all of the following formulas, all the variables are zero-mean. Indeed, the mean-value of all variables are subtracted from their real values. Throughout the paper, zero-mean vectors are depicted as $\bar{\textbf{x}}$.

***Case I:** Malicious consumer reports a portion/multiple of its actual usage:* In this case, the reported quantities by the malicious consumer would undoubtedly have correlation with leakage amounts. Consider an arbitrary consumer, and let vectors ($\textbf{\underline{r}}$) and ($\textbf{\underline{l}}$) be the zero-mean vectors containing reported values of that consumer and the corresponding electricity leakage amounts on those periods. Here, the correlation coefficient for each consumer would be written as: $$corr(\bar{\textbf{r}},\bar{\textbf{l}}) = \frac{\bar{\textbf{r}}^T \bar{\textbf{l}}}{\|\bar{\textbf{r}}\| \|\bar{\textbf{l}}\|} \\
\label{malcorr}$$

In this case, the malicious consumer reports a portion/multiple of its consumed energy, i.e., $r = \alpha c$, where $\alpha$ is a positive coefficient, $\alpha > 0$. Thus, by getting use of (), for a malicious consumer, the correlation coefficient in () would be as: $$\begin{aligned}
corr(\bar{\textbf{r}},\bar{\textbf{l}})
\nonumber
& =\frac{\bar{\textbf{r}}^T \bar{\textbf{l}}}{\|\bar{\textbf{r}}\| \|\bar{\textbf{l}}\|} \\
\nonumber
& = \frac{\alpha \bar{\textbf{c}}^T (1-\alpha) \bar{\textbf{c}}}{|\alpha| \|\bar{\textbf{c}}\| |1-\alpha| \|\bar{\textbf{c}}\|} \\
& = \frac{\alpha(1-\alpha)\|\bar{\textbf{c}}\|^2}{|\alpha||1-\alpha|\|\bar{\textbf{c}}\|^2} \\
\nonumber
& = \frac{\alpha(1-\alpha)}{|\alpha||1-\alpha|}
\label{case1}
\end{aligned}$$

As stated before, when the malicious consumer reports its power consumption less than its actual quantity, $0 < \alpha < 1$, the correlation coefficient turns to +1, and on the contrary, the correlation coefficient turns to -1 when the malicious consumer declares its consumed energy more than its actual usage, $\alpha > 1$.

***Case II:** Malicious consumer adds/subtracts a fixed quantity to/from its actual usage:* In this case, the reported quantity by the malicious consumer is independent from the leakage amount until the actual consumed energy lies below the fixed value ($\eta$) which is added/subtracted to/from the actual power usage. Indeed, as the reported consumed energy cannot be negative, the reported quantity and the corresponding electricity leakage for each period could be written as: $$\begin{aligned}
& r =
\begin{cases}
c-\eta & if \; c \geq \eta \\
0 & if \; c < \eta
\end{cases}\\
& l=
\begin{cases}
\eta & if \; c \geq \eta \\
c & if \; c < \eta
\end{cases}
\end{aligned}$$

While the actual consumed energy in each period is greater than the fixed threshold $\eta$, $c \geq \eta$, these terms become independent and thus, the malicious consumer cannot be detected. On the other hand, while the consumed power is less than the threshold, $c \leq \eta$, the malicious consumer would report its consumed energy zero and thus, the reported consumed power would be dependent to the leakage quantity. Consequently, by focusing on the measurements where $r$ is small, we can still detect the malicious consumer.

***Case III:** Malicious consumer adds/subtracts a random quantity to/from its actual usage:* Assume that the malicious consumer adds/subtracts a random value independent from its power consumption to/from its consumed energy such that none of its reported quantities turns to a non-negative value. In this case, although the declared amounts of power consumption are quite independent from the electricity leakage corresponding to them at each period, the proposed scheme is capable of detecting the malicious consumer as well. $$\begin{aligned}
corr(\bar{\textbf{r}},\bar{\textbf{l}})
\nonumber
& =\frac{\bar{\textbf{r}}^T \bar{\textbf{l}}}{\|\bar{\textbf{r}}\| \|\bar{\textbf{r}}\|} \\
\nonumber
& = \frac{(\bar{\textbf{c}} - \bar{\boldsymbol{\theta}})^T \bar{\boldsymbol{\theta}}}{\|\bar{\textbf{c}} - \bar{\boldsymbol{\theta}}\| \|\bar{\boldsymbol{\theta}}\|} \\
& = \frac{\bar{\textbf{c}}^T \bar{\boldsymbol{\theta}}}{\|\bar{\textbf{c}} - \bar{\boldsymbol{\theta}}\| \|\bar{\boldsymbol{\theta}}\|} -
\frac{\|\bar{\boldsymbol{\theta}}\|}{\|\bar{\textbf{c}} - \bar{\boldsymbol{\theta}}\|}
\label{case3}
\end{aligned}$$ where $\bar{\boldsymbol{\theta}}$ is a vector containing random values ($\theta$s) added/subtracted to/from the reported quantity. While $\bar{\textbf{c}}$ and $\bar{\boldsymbol{\theta}}$ are independent, the first term in () would be equal to zero and thus, the correlation coefficient corresponding to the malicious consumer turns to a negative quantity. As the correlation coefficient quantities corresponding to benign consumers revolve around $0$, the malicious consumer should take the smallest negative quantity amongst others.

### Scenario II: Existence of more than one malicious consumer in each region

Furthermore, it is possible that there are more than one malicious consumer in a region. In this case, although the correlation coefficient corresponding to these consumers would not be equal to , their correlation coefficient can be still distinguished from other consumers. As a result, it is needed that a threshold ($th$) must be defined where the absolute value of correlation coefficients fewer or more than the threshold indicate benign or malicious consumers respectively, as: $$\begin{aligned}
 \begin{cases}
malicious \; consumer, & if \;\;\, -1 \leq corr \leq -th \\
benign \; consumer, & if \; -th < corr < th \\
malicious \; consumer, & if \;\;\;\;\;\, th \leq corr \leq 1
\end{cases}
\label{Threshold}
\end{aligned}$$

It is apparent that for higher threshold value, fewer malicious consumers are detected and on the other hand, lower threshold value, more benign consumers are considered as malicious consumers. Thus, a question that arises here is that how a proper threshold be found? The analysis concerning the detection of several malicious consumers with small number of samples for each consumer, is out of scope of this paper, however, we briefly discuss the problem in the next section. In this paper, according to the setting of the problem, we set the threshold to a fixed value, namely, $0.5$.

As the proposed scheme is a statistical technique, it is probable that the correlation coefficient of a benign consumer lies out of its defined region depicted in (), or vice versa.

## Billing

Here we describe billing procedure in SBPP scheme. The accountability for billing is handled by data aggregators. As discussed in the last section, malicious consumers can be identified by analyzing the correlation coefficient of each consumer in the region. Malicious consumers' being detected, the sent data corresponding to other consumers are considered trustworthy and error free. Based on this assumption, the liability for billing can be assigned to data aggregators. In every period, consumers send their amount of consumed energy to data aggregators. Then, based on the received data from the consumers and the received tariffs from the supplier, the data aggregators compute the cost of consumed power for each consumer before data aggregation takes place. In each period, data aggregators calculate the cost of consumed power for each consumer and add the cost to the previously calculated cost for that consumer and by the end of month, a bill will be issued and sent to the supplier's accounting center. Note that the task of computing the bills can be assigned to the smart-meters as well.

Not only this scheme decreases the signalling overhead, but also the privacy of consumers will be protected. It is merely required that suppliers send tariffs periodically to data aggregators and to consumers simultaneously. Data aggregators compute the cost of consuming energy for every consumer and smart meters on the consumers' side adjust the power consumption based on the received tariffs, i.e., when the tariff increases, smart meters force dispensable devices to be turned off. In this case, no information leakage and thus no privacy invasion would occur.

# Simulation Results

In this section, we describe our simulation results for the proposed SBPP scheme. The results verify that SBPP scheme is capable of detecting malicious consumers who send bogus information concerning their power consumption.

Although in reality there exists a dependency between power consumption of consumers in every successive periods, in all simulations we consider a random power consumption for each consumer in each period, which is the worst case that could be considered. We show that our proposed method works properly in this case and thus could be applied in real world smart grid.

Here, the previously described scenarios are investigated.

## Case I: Malicious consumer multiplies its usage

In the following, all simulations are considered based on this assumption. Consider a region consisting of $100$ consumers and one data aggregator where data aggregation takes place every $15$ minutes. Assume that the consumer $\# 25$ is a malicious consumer. Two cases are studied; consumer $\# 25$ in scenario (i) reports one tenth ($0.1$) of its power consumption and in scenario (ii) it declares its power usage $10$ times more than its actual consumption. Fig.  (a) illustrates scenario (i) where the correlation coefficient of reported consumed energy and the leakage amounts of power consumption turns to $+1$ and Fig.  (b) depicts scenario (i) where the correlation coefficient turns to $-1$.

Note that henceforth, all the assumptions are analogous to that of Fig.  where consumer $\# 25$ is the malicious consumer unless mentioned otherwise.

Next, we assume that there are three malicious consumers: $\# 25$, $\# 50$, and $\# 75$. Consumers with IDs $\# 25$ and $\# 75$ declare their power consumption less than their actual consumption and consumer $\# 50$ reports its power consumption more than its actual consumed energy. By setting the threshold to $0.5$, consumers with absolute value of correlation coefficient greater than $0.5$, i.e. $|corr|\geq 0.5$, would be considered malicious, as depicted in Fig. .

As it can be seen from Fig. , fixed threshold will result in three cases: 1) only malicious consumers been detected (Fig.  (a)), 2) in addition to malicious consumers, some benign consumers found malicious (Fig.  (b)), and 3) a subset of malicious consumers been detected (Fig.  (c)).

As the proposed scheme is a statistical method, it is apparent that the more data be at hand, the more accurate the decision would be. Fig.  illustrates this matter. In Fig.  (a), one month is considered as the period of measurement. On the other hand, the period of one year is considered in Fig.  (b). In this case, the number of samples has increased $12$ times. As a result, as it can be seen from Fig.  (b), the correlation coefficient corresponding to benign consumers revolves more densely around zero and the correlation coefficient corresponding to the malicious consumer (consumer $\# 25$) lies far apart from others compared to Fig.  (a).

## Case II: Malicious consumer adds/subtracts a fixed quantity

Here we assume that the malicious consumers add/subtract the fixed quantity $\eta$ to/from the amount of consumed energy. This is independent from the actual usage of malicious consumer, detection of malicious consumer would be associated with those reported quantities that are equal to zero. This matter will result in the fact that detection of malicious consumers get more harder than the previous case, as illustrated in Fig. . More importantly, as it can be seen from Fig. , the correlation coefficient corresponding to the malicious consumer does not turn to $+1$.

It can be seen from Fig.  that the correlation coefficient corresponding to the malicious consumer is far close to that of benign consumers. As stated before, this matter would made detection of the malicious consumer tough. Fig.  illustrates this matter. As depicted in Fig. , the more samples we have corresponding to power consumption of consumers, the more accurate we are in detection of the malicious consumer. As it can be seen, by increasing the period of measurement, the probability of detecting the malicious consumer approaches to $1$, while for the period of one month this probability revolves around $0.5$.

In each iteration, the simulation is repeated $100$ times and the probability of correct detection of malicious consumer is calculated.

## Case III: Malicious consumer adds/subtracts a random quantity

In this section the simulation regarding the third scenario is brought where malicious consumer adds/subtracts a random quantity to its reported consumed energy. As mentioned before, according to (), the lowest negative quantity for the correlation coefficient expresses the malicious consumer, as depicted in Fig. . Note that assumptions are similar to that of Fig.  where consumer $\# 25$ is the malicious consumer unless mentioned otherwise.

The performance of our SBPP scheme in the three mentioned cases is evaluated in Table . Here, the simulation is repeated $1000$ times and the number of correct detections had been counted and finally the probability of correct detection had been calculated.

|          |                       |          |          |        |
|:---------|:---------------------:|:--------:|:--------:|:------:|
| 2-5      | Period of measurement |          |          |        |
|          |        1 month        | 3 months | 6 months | 1 year |
| Case I   |           1           |    1     |    1     |   1    |
| Case II  |         0.51          |   0.98   |    1     |   1    |
| Case III |         0.92          |    1     |    1     |   1    |

Probability of Correct Detection

# Conclusion

We presented a statistical-based approach for data gathering in smart grids which preserves the privacy of consumers in the grid. We investigated the capability of the proposed scheme in detecting malicious consumers who dispatch bogus data to suppliers for a specific purpose such as abating their cost or imposing expenditure on them (subversive goals). Furthermore, we showed that when there exists at most one malicious consumer in each data gathering region, that consumer can be definitely detected. We consider three distinct cases for sabotage goals and show that our proposed method works properly in all cases. However, when the number of malicious consumers in a region grow, our statistical method would detect some benign consumers as malicious, or some malicious consumers remain undetected.

We then presented an algorithm for billing which concede the liability of billing to data aggregators in each region. By doing this, not only the signalling overhead decreases significantly, but also billing occurs at a trusted entity where malicious consumers are distinguished from benign ones. Our simulation results verified these terms.

[^1]: Alireza Ahadipour, Mojtaba Mohammadi, and Alireza Keshavarz-Haddad are with the School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran. Email: {ahadipour.alireza, mojtaba.mohammadi, and email@example.com