abstract: We connect the configurational entropy of a liquid to the geometrical properties of its local energy landscape, using a high-temperature expansion. It is proposed that correlations between local structures arises from their overlap and, being geometrical in nature, can be usefully determined using the inherent structures of high temperature liquids. We show quantitatively how the high-temperature covariance of these local structural fluctuations arising from their geometrical overlap, combined with their energetic stability, control the decrease of entropy with decreasing energy. We apply this formalism to a family of Favoured Local Structure (FLS) lattice models with two low symmetry FLS's which are found to either crystallize or form a glass on cooling. The covariance, crystal energy and estimated freezing temperature are tested as possible predictors of glass-forming ability in the model system.
author: Pierre Ronceray; and Peter Harrowell
title:  From Liquid Structure to Configurational Entropy: Introducing Structural Covariance

#  Introduction

Why study liquid structure? The longstanding answer to this question is that structure is expected to provide a microscopic account of the experimentally measured properties of liquids. The theoretical treatment of these properties, *e.g.* the equation of state and the structure factor, are the goals that drove the development of liquid state theory through the 1960's and 70's . The structural information required for these tasks turned out to be modest. The scattering function only requires the distribution of pairwise separations and, if we can assume pairwise additive interaction potentials, so too does the equation of state . Closures of correlation function hierarchies have provided reasonable radial distribution functions (at least for single component atomic liquids) without explicit reference to the geometrical structure of the liquid . This bypassing of most of the liquid structure in the development of liquid theory is one of cornerstones of its successes. It does leave us, however, still casting around for a motivation to study the full many-body aspects of liquid structure.

A second reason for the study of liquid structure is related to the properties of deeply supercooled liquids. The slow relaxation of viscous liquids  and the rigidity of amorphous solids  arise as a consequence of the constraint that a configuration of the system exerts on the motion of its constituent particles at low temperature. This second goal of the study of liquid structure is, therefore, to uncover an intelligible rationale for the origin and persistence of these constraints. How structure might accomplish this goal is worth fleshing out. A structural description, here taken to mean a reduced description of a configuration in terms of some set of *local structures* – *e.g.* the coordination polyhedra – is just an exercise in descriptive geometry, with the choice of structural components left to the whim of the researcher. A geometrical analysis of a configuration of the system allows, for each of its constituent particles, to identify the specific local structure that characterizes its molecular neighbourhood among a dictionary of possible local environments. The utility of a particular structural description can be assessed by the information compression that it provides. The connection to physics arises because this information compression relies on the presence of geometrical constraints. A particular coordination polyhedron, for example, embodies a number of constraints between bond angles, numbers of nearest neighbours, topological connectivity, *etc.* It is these geometrical constraints that permit the information reduction in the first place. The hope that underlies this structural analysis is that these *geometrical* constraints on structure translate into *physical* constraints on particle positions. A well studied example of the fulfillment of this hope is a binary Lennard-Jones mixture introduced by Wahnström  for which the correlation between local icosahedral topology and slow relaxation has been well established . This *structure* $\rightarrow$ *constraint* program depends on the information reduction achieved by a given structural analysis. Too complex a liquid structure and the associated information compression is insufficient to result in any significant physical constraints. Many supercooled liquids exhibit structures best characterised by as a diverse range of local structures, all occurring with comparable but low frequency. In these cases, it is difficult to see how broadly diverse structure can be linked to the presence of physical constraint.

In this paper we concentrate on a third motivation for studying liquid structure, one whose utility does not depend on whether the liquid structure is simple or complex and that has received little attention in the literature. We explore how the liquid structure connects to the configurational entropy of the liquid and, hence, plays a crucial role in determining the stability of the liquid with respect to crystallization.

The concept of a configurational entropy plays a central role in the modern description of supercooled liquids . The proposal is that the rough energy landscape that characterizes a supercooled liquid can be usefully described in terms of local minima of the potential energy – the *inherent structures* of the system – and fluctuations around these minima. The total entropy of the liquid can thus be resolved into two parts – the first one, termed *configurational entropy*, associated with the choice of the inherent structure, and the second with the fluctuations of particles around these metastable configurations. Computationally, the configurational entropy has been defined explicitly as $S_c =
k_{B}\log N_\mathrm{is}$ where $N_\mathrm{is}$ is the number of distinct inherent structure . Calculations based on this definition of the configurational entropy have been carried out for binary Lennard-Jones mixtures , silica  along with other model liquids . Such calculations reveal that over a wide range of temperatures, the configurational entropy can be reasonably described as a quadratic function of the potential energy: $$S_c = S_{\infty}-\frac{1}{2K} (E-E_{\infty})^{2}
\label{eq:conf-sim}$$ The quantities $S_{\infty}$ and $E_\infty$ respectively correspond to the entropy and energy of inherent structures in the high temperature limit. This expression was shown to provide a good approximation of the configurational entropy for both a binary atomic mixture  and a model of silica . Sastry, Debenedetti and Stillinger  have demonstrated the existence of this high-temperature limit by showing that there exists a temperature, $T_{x}$, above which the average energy of inherent structures does not depend on the temperature of the initial liquid. The idea is that with sufficient thermal energy, the liquid energy lies above the "top" of the potential energy landscape and so is able to effectively sample all possible inherent structures. Referring to the empirical expression in Equation , the change of liquid's thermodynamic quantities upon cooling are then controlled by the quantity $K$, which determines the entropic cost of lowering the energy.

The aim of this article is to relate the thermodynamic properties of a liquid – and in particular the value of $K$ – to its microscopic structural origins. The liquid's local structural properties will be described macroscopically in terms of the frequencies of each type of local structure. Local structures couple directly to the energy of the system: indeed, not all local environments around a particle are equivalent from an energetic point of view. For a given Hamiltonian, some local structures are particularly stable, while others are disfavoured; the energies associated to local structures constitute the *local energy landscape* of the system. On cooling, the liquid energy will decrease, which implies that the frequencies of low-energy local structures will increase. On the other hand, this accumulation of stable local structures comes with an entropy cost: indeed, the structural frequencies constrain the associated size of the configuration space, and thus the configurational entropy. The geometrical properties of the local structures have a direct influence on this configurational entropy, and thus on the thermodynamic properties of the system.

In this article, we present an analysis of liquid structure that goes beyond mere description, and allows quantitative predictions that become exact at high temperature, while retaining relevant information at low temperature. We focus on the role of correlations between the frequencies of local structures arising from their geometrical overlap – the *structural covariances*. We show their crucial importance in connecting the local energy landscape – *i.e.* the energy of local structures – to the global energy landscape – characterized by the configurational entropy of the system. In Section , we present our theoretical framework in a general context of off-lattice liquids, establishing a relationship between liquid structure and configurational entropy. While we expect our predictions to hold in such cases, we have so far only tested them in the context of a class of lattice models of liquids inspired from our previous works, the Favoured Local Structures model with two stable local structures, as presented in Section . Our goals in this Section are to provide some measure of the validity of the high temperature approximation. Employing our structural covariance framework, we present new results concerning a version of the FLS lattice model that appears to capture important aspects of the problem of glass-forming ability.

# Local Liquid Structures and their Covariance

In this Section, we develop a theoretical relation between local structure and configurational entropy in an off-lattice liquid. There is some assumed degree of arbitrariness in the definition of local structures, as already discussed in the Introduction, and the precise definition and choice of local structural parameter is usually adapted to the specific needs of the study. A number of choices for these structural components have been considered in the literature – Voronoi polyhedra , Delaunay tessellations , common neighbours , bond ring statistics , bond orientation order  and tetrahedrality . One of the most common is the local coordination polyhedra  – similar to a Delaunay vertex except that the neighbours are defined by a cutoff separation rather than a geometric condition based on space-filling. The literature regarding these various choices has been summarised in a number of excellent reviews . The choice of structural components depends on the goal of the analysis and the expectation of the type of structure that might be found. Voronoi or Delaunay tilings address the question of how structure fills space. Common neighbour analysis represents a reduction to the smallest non-trivial set of structural components out of which distinct collective structures can be assembled. Tetrahedrality focuses on the structural significance of triangulation with respect to mechanical stability. It is important to remark that for all definitions of local structure, there is some degree of overlap between a local structure and its neighbours. For instance, Voronoi polyhedra share faces, while a particle contributes to the local coordination polyhedra of all its neighbours. This implies that the local structure at a point imposes geometrical constraints on the surrounding local structures. The overlap of coordination polyhedra was the basis of the geometrical construction used by Frank and Kasper in their classic papers on tetrahedral solids .

In the analysis presented below, we consider only the *inherent structures* of a liquid. These are the configurations associated with local minima of the potential energy. We assume that in such states, the environment of each particle is well characterized by its local structure, and that the total potential energy can be written as a sum of the energies of the individual local structures. This assumption implies that the system can be fully described in terms of its *local energy landscape*, *i.e.* the local energy associated with possible structural components. The coordination polyhedra about each particle (in concert with an assumed short range interaction) represents a good realization of these requirements and, for concreteness, we will select it as our definition for local structural components in the following.

## The Structure and Energy Vectors

Having chosen a definition of local structures, we can establish a dictionary of all possibilities for such local structures, which we assume to come in finite number. Implicit in this finite list of "possible" structures is that we can solve the non-trivial problem of identifying all dense local packings that avoid prohibitive overlap of particles. In what follows we shall assume that this problem can be addressed by simulation. An individual inherent structure of the liquid can be characterized by the frequency of each type of local structure. This introduces the *structure vector* $\vec{c}$ of a state of the system, where $c_i$ is the number concentration of particles characterized by the *i*th local structure in that state. This vector must obey $\sum_i c_i = 1$, as we assume to describe the full set of possible structures – or, at least, all structures that are likely to be observed in practice. The average structure vector $\langle\vec{c}\rangle$ over inherent structures for a given liquid corresponds to the typical data reported from structural studies of simulated liquids. The pioneering 1977 studies of Tanemura *et al.* , for example, consisted of reporting the average concentrations $\langle\vec{c}\rangle$ of Voronoi polyhedra in a soft sphere liquid.

Our key assumption, which should be valid as long as the interactions are short ranged, is that the sole data of structure concentrations, *i.e.* the structure vector $\vec{c}$, allows for a reasonable estimate of the energy of inherent structures. This means that the potential energy per particle of a given inherent structure of the system can be written simply as $$E = \vec{c}\cdot \vec{\epsilon}
\label{eq:energy}$$ where $\vec{\epsilon}$ is the *energy vector* characterizing the local energy landscape of the system, *i.e.* a site with local structure $i$ contributes with an energy $\epsilon_i$ to the Hamiltonian. A simple choice for a vector with elements $\epsilon_i$ corresponding to half the average energy of a particle at the center of the in the *i*th coordination polyhedron. Since both total energy and the $\epsilon_{i}$'s can be directly calculated, the accuracy of Eq.  can be tested for each specific system. Clearly this representation of the system is a simplification, as it does not include, for instance, the energy associated with distortions of local structures. From the point of view of Eq. , the total energy thus consists in a sum over all local structures, as previously used by Procaccia and coworkers  in a treatment of supercooled liquids based on the resolution of the structure into quasi-species. There is therefore no energetic coupling between neighbouring local structures: the interactions are mediated solely by the geometrical constraints arising from their overlap. This means that the identity of the coordination polyhedron of a particle will exercise a significant geometrical constraint on the possible coordination polyhedra of its neighbours. Such constraints have a purely geometrical origin, and are thus athermal.

##  Configurational Entropy in Structure Space

On cooling, the most stable local structures – those with low $\epsilon_i$'s – are expected to accumulate in the liquid. This energy decrease must be balanced against the associated loss of entropy incurred by the accumulation of the stable subset of local structures. In this Section, we relate this entropy cost to the geometrical properties of these stable local structures. We have shown recently that the accumulation of high-symmetry structures is entropically penalized, as compared with low-symmetry structures . We now go further and encompass correlations between structures in our description.

In the high temperature limit $T>T_x$ where the average energy of inherent structures become temperature-independent, it is natural to assume that their structure also reaches a limiting composition, which we denote by $\vec{c}_\infty = \langle  \vec{c}\rangle_{T=\infty}$. We are however unaware of any examination of this proposal and whether in fact, the temperature independence of the average inherent structure energy is indeed translated into a temperature independent set of high T inherent structure. A true high temperature structure, under a constraint of fixed density, should correspond to the structure of purely repulsive particles, a physical limit in which the purely entropic character of the correlations become explicit.

We now consider the space formed by the possible values of $\vec{c}$ for a macroscopic system. To each such structure vector we can associate a configurational entropy $$S_c(\vec{c})=\log\Omega(\vec{c})
\label{eq:entropy-structurespace}$$ where $\Omega(\vec{c})$ is the number of states of the liquid compatible with the macroscopic structural composition $\vec{c}$. By construction $S_c(\vec{c})$ is maximal at the infinite-temperature composition $\vec{c}_\infty$, and to second order in $\vec{c}-\vec{c}_\infty$ we can thus write: $$S_c(\vec{c})=S_{\infty}-\frac{1}{2} (\vec{c} - \vec{c}_\infty)^{T}\cdot \hat{C}^{-1} \cdot (\vec{c} - \vec{c}_\infty) + O(|\vec{c} - \vec{c}_\infty|^3)
\label{eq:entropy}$$ where $\hat{C}^{-1}$ is a positive definite matrix characteristic of the structure space of the liquid. This implies that the density of states in the structure space is approximated by a multi-dimensional Gaussian distribution, $$\Omega(\vec{c}) \approx \Omega _{\infty} \exp\left(-\frac{N}{2}(\vec{c} - \vec{c}_\infty)^{T} \cdot \hat{C}^{-1} \cdot (\vec{c} - \vec{c}_\infty)\right)
\label{eq:omega}$$ where $N$ is the number of particles in the system. The coefficients of the matrix $\hat{C}$ thus correspond to the high-temperature covariances of the local structure concentrations, *i.e.* $$\label{eq:C}
  C_{ij} = N\ \mathrm{Cov}_{T=\infty}(c_{i},c_{j}) % = N\ \av{ (c_i-c_{i,\infty})(c_j-c_{j,\infty}) }_{T=\infty}$$ In the infinite-temperature limit, structural correlations become short-ranged, and only the athermal constraints originating from the overlap of neighbouring structures are expected to contribute to the coefficients $C_{ij}$. While this property is exact in lattice models as considered in Section , it remains to be established in the case of off-lattice inherent structures.

## Thermodynamic Implications of Structural Covariance

The connection between the structure space and the more usual microcanonical ensemble configurational entropy $S_c(E)$ is obtained by using Eq. , and integrating over structural composition to get the density of states $\Omega(E)$ as a function of the energy per particle $E$: $$\label{eq:omega-E-interm}
  \Omega(E) = \int \delta( E - \vec{c} \cdot \vec{\epsilon} )  \ \Omega(\vec{c})\  \mathrm{d}\vec{c}$$ which, employing the Gaussian approximation for the density of states introduced in Eq. , yields: $$\label{eq:omega-E}
  \Omega(E) = \Omega_\infty \exp \left( \frac{(E-E_\infty)^2}{2 K}  \right)$$ where $$K = \vec{\epsilon}^{T} \cdot \hat{C} \cdot  \vec{\epsilon}\label{eq:K}$$ Note that the unit vector, $(1,\dots,1)$, is an eigenvector with zero eigenvalue of $\hat{C}$ (as departing from $\sum_i c_i = 1$ is impossible, *i.e.* it has an infinite entropy cost) so that a change of energy reference does not affect the value of $K$. Equation  leads us to recover the parabolic approximation for the microcanonical configurational entropy $$S_c(E)=S_{\infty}-\frac{(E-E_{\infty})^{2}}{2K}
\label{eq:micro}$$ which takes the same form as that already introduced in Eq.  to phenomenologically describe simulated liquids. Finally, using Eq.  we can also predict how the average structural composition of the liquid evolves when the energy is lowered: $$\langle \vec{c}\rangle(E) = \frac{1}{\Omega(E)} \int \ \vec{c}\ \  \delta( E - \vec{c} \cdot \vec{\epsilon} ) \  \Omega(\vec{c}) \ \mathrm{d}\vec{c}
  \label{eq:c-E-interm}$$ which yields: $$\langle \vec{c}\rangle(E) = \vec{c}_\infty + \frac{E-E_\infty}{K}\hat{C}\cdot \vec{\epsilon}
  \label{eq:c-E}$$ This shows that the evolution of the concentration of structure $i$ depends not only on its energy $\epsilon_i$, but also on the energy of other structures $j$ through the geometric coupling due to their overlap: $$\frac{\partial \langle c_i\rangle}{\partial E}  =  \frac{1}{K} \sum_j C_{ij} \  \epsilon_j
  \label{eq:dcdE}$$ In particular, this shows that the accumulation of a given local structure upon cooling is not equivalent to it being stable: some possibly unfavoured structures will tend to accumulate due to their geometrical affinity to other stable local structures.

Our framework thus provides an explicit connection between the local structural properties of a liquid and its thermodynamic properties. The main outcome of our reasoning is the analytic prediction of Eq.  for the quadratic coefficient $K$, which is the key quantity controlling the entropic cost of lowering the potential energy of the liquid. It combines the data of the local energy landscape – the energy vector $\vec{\epsilon}$, which can be straightforwardly computed from the set of local structures – with the geometrical properties of structures – the covariance matrix $\hat{C}$ encoding symmetry and overlap properties of local structures – to give a simple number that predicts the high-temperature properties of the system. Using these quantities, we are also able to predict, through Eq. , how the liquid's structure will change on cooling.

Note that the truncation of the expansion of the entropy to second order means that we only account for the correlations between pairs of local structures, and neglect correlations between three or more local structures. As an example of such higher order correlations neglected by this approximation, Cheng et al  have reported the existence of extended arrangements of local polyhedra such as rings of icosahedra. It would be in principle feasible to extend our framework to higher orders; however it would increase dramatically its complexity.

Central to our program is the calculation of the infinite-temperature structural covariance matrix $\hat{C}$, which encodes all pertinent information about geometrical interactions of pairs of structures. It could already be empirically obtained through Eq.  provided we have knowledge on the high-temperature inherent states statistics. However, we suggest that it could also be derived from first principles, using only the geometrical properties – symmetry and pair overlap – of the local structures. This program, which we have already carried on in the case of lattice liquids , would allow a quantitative approximation of the liquid configurational entropy in terms of purely local and geometrical properties of the liquid.

#  Applying the Structural Covariance Analysis to Lattice Spin Models

The application of the program outlined in the previous Section to a simulated liquid with continuous degrees of freedom has not yet been carried out. In its place, we present in this Section an application of the theory to a lattice model of liquids, the Favoured Local Structure (FLS) model. Our goal is to demonstrate the applicability of the structural covariance approach to computing the configurational entropy, and investigate the range of temperatures over which it provides physically relevant results. The idea of this discrete model is that it provides a finite set of local structures, over which we can choose explicitly an arbitrary local energy landscape. We start this Section by presenting a generalized version of the FLS model, and showing how to implement our structural covariance approach within this model. We finally extend this model to the case of multiple FLS, and show how our high-temperature covariance analysis provides precious information about the glass-forming ability of the liquid.

## The Favoured Local Structures Model

The Favoured Local Structure (FLS) model consists in two-state spins on a face-centered cubic (FCC) lattice, in which we explicitly define the Hamiltonian of the system in terms of a simple local energy landscape. Each site has $12$ neighbours and on each site we have a spin that is either up or down. Among the $2^{12} = 4096$ possible combinations for the spin values of these $12$ neighbours, we identify $218$ geometrically distinct local structures, which are not related by to one another by a rotation, as depicted in Figure . The principle of our model is to attribute an energy $\epsilon_i$ to each local structures $i$ of this set. Therefore, denoting $c_i$ the proportion of sites of a macroscopic system in this local structure, the average energy per site reads: $$\label{eq:E_FLS}
  E = \sum_{i=1}^{218} c_i \epsilon_i = \vec{c}\cdot \vec{\epsilon}$$ such that our model fulfills precisely the assumptions of Section , where the inherent structures of the liquid are now replaced by spin configurations of the model.

An instance of the FLS model thus corresponds to the choice of the energy vector $\vec{\epsilon}$ in the huge, 218-dimensional parameter space. Note that we can select these energies arbitrarily, without requiring that they derive from a pair potential. This convenient property allows us to study directly the influence of the geometry of local structures, without being concerned with finding fine-tuned interaction potentials that would favour these structures. Once this *local energy landscape* $\vec{\epsilon}$ is set, Eq.  fully defines the Hamiltonian of the system. We typically study this model numerically, employing the Metropolis algorithm in canonical ensemble simulations of a finite system of size $30^3$ lattice sites, with periodic boundary conditions. Note that we do not enforce conservation of the total spin.

The aim of this model is to gain insight on the influence of locally favoured geometries on the thermodynamic properties of the system. A full study of this gigantic parameter space would be both daunting and pointless; instead, we focus on reduced versions with only a few non-zero $\epsilon_i$'s. We have recently presented an extensive study  of the case of a single favoured local structure $i$, *i.e.* with $\epsilon_j = -\delta_{ij}$ where $\delta_{ij}$ is the discrete delta function. In that case, each site in the FLS has an energy $-1$, while all others have an energy $0$, and the differences between systems can be completely attributed to the geometrical properties of the FLS. In particular, we showed that low-symmetry local structures tend to stabilize better the liquid than high-symmetry ones. Indeed, their entropy cost is lower due the remaining uncertainty on the orientation of low-symmetry local structures.

The other key component to the liquid's stability with respect to crystallization is the ground state energy $E_o$, corresponding in this model to a dense packing of FLS's on the lattice. In our model, this energy ranges from $E_o = -1$ (for those FLS's which can tile the whole space, such as the all-up local structure) to $E_o=-0.25$, corresponding to a highly *frustrated* local order where only one site out of four, at most, can be in the FLS, i.e. geometrical constraints prevent the local energy minimum from extending to the whole space, and effected termed *geometrical frustration* . While the connection between FLS symmetry and ground state energy turns out to be complex, we have observed that *chiral* FLS's – *i.e.* local structures lacking a plane reflection symmetry – tend to be much more frustrated than achiral ones. As we will show here, we can use this property to generate glass-forming systems by combining several highly frustrated FLS's.

## Structural covariance analysis of the FLS model

We now apply the theoretical analysis presented in Section  to this model, for any choice of the local energy landscape $\vec{\epsilon}$. Again, we first consider the entropy in the structure space $S(\vec{c})$, which is a generic property of our model, independent of $\vec{\epsilon}$.

The infinite-temperature structural composition of the liquid is simply given by the symmetry properties of local structures: each local structure $i$ can fit at any lattice site in $g_i = s_i/\omega$ distinct orientations, where $\omega = 24$ is the size of the rotation group of the FCC lattice and $s_i$ is the cardinal of the rotation subgroup that leaves the structure unchanged. At infinite temperature, the spins are completely independent, and all $2^{12}$ local spin environments are equiprobable; hence $c_{i,\infty} = g_i/2^{12}$.

Expanding the entropy $S(\vec{c})$ around the infinite-temperature composition $\vec{c}_\infty$ as in Eq.  defines the infinite-temperature covariance matrix $\hat{C}$ of structural compositions in this model (Eq. ). This matrix is a purely geometrical property of the set of structures presented in Fig. . As discussed in the previous Section, this matrix provides a measure of the degree to which each possible pair of local structures act to constrain each other. The physical origin of this constraint is local, arising from the geometrical restrictions involved in the overlap of two coordination shells. In our model, this overlap consists in lattice sites being shared between adjacent local structures, as shown in Fig. . A complete enumeration of these local constraints allows us to compute exactly the covariance matrix $\hat{C}$, as detailed further in Ref. . The principle of this calculation is to consider, for each pair of neighbouring lattice sites such that the local structures overlap, the change in infinite-temperature probability of observing structure $i$ at one site knowing that structure $j$ is present at the other. If structures $i$ and $j$ are geometrically incompatible, this will be impossible and the probability will be zero, while if they are compatible the shared sites result in an enhanced probability.

In Figure , we present a graphical representation of the high temperature covariance matrix $\hat{C}$. We emphasize the fact that this matrix does not depend on a particular choice of the energies of the different structures (*i.e.* the choice of $\vec{\epsilon}$) as it is entirely determined by the geometrical constraints associated with overlapping coordination shells.

Combining the covariance matrix with the energy vector, we find again the quadratic approximation formula for the microcanonical entropy, $$S(E) = S_\infty - \frac{1}{2K}(E-E_\infty)^2
  \label{eq:S-repeated}$$ where the thermodynamic coefficient $K$ is given by Eq. . In the case of the single FLS model, with $\epsilon_j = -\delta_{ij}$, this coefficient becomes $$K=\vec{\epsilon}\cdot\hat{C}\cdot\vec{\epsilon} = C_{ii}
  \label{eq:K-FLS}$$ Thus only self-overlap of the FLS is important in this quadratic approximation, while all other local structures are spectator to the accumulation of order in the liquid. In spite of its simplicity, the version of the FLS model characterized by Eq.  has proven useful in understanding some of the factors that influence the temperature dependence of the liquid entropy .

Because in this model the total entropy equals the configurational entropy, Eq.  can be used to map our results to finite temperature properties through the formula $\partial S
/ \partial E = 1/T$. Our framework thus provides predictions for the temperature dependence of the entropy and energy of the system: $$\begin{aligned}
  E(T) &= E_{\infty}-K/T \label{eq:EK}\\
  S(T) &=  S_{\infty}-\frac{K}{2T^{2}} \label{eq:SK}
\end{aligned}$$ Similarly, adapting Eq.  yields $$\langle \vec{c}\rangle(T) = \vec{c}_\infty  -\frac{1}{T}\hat{C}\cdot \vec{\epsilon}
  \label{eq:c-T}$$ Equations - become exact in the high-temperature limit, as they correspond to an exact expansion up to $O(T^{-2})$. They thus provide a quantitative approximation for the liquid's thermodynamic properties and structural composition at finite temperature.

## Multiple FLS and Glass-Forming Ability

We now present a new variant of this model, which has the specificity to present glass-forming systems, and use our covariance formalism to study it.

Let us consider the more general – and perhaps more realistic – scenario in which a liquid can be characterized by multiple FLS's. We model this using our lattice model by attributing an energy $\epsilon_i = -1$ to a number of local structures (while, again, setting the remainder to zero energy) . The number of options for such liquids in the FLS model is huge – $47306$ possibilities for only two FLS's in the 3D FCC model – so we shall restrict ourselves here to constructing bi-FLS liquids from a specific subset of local structures, as depicted in Fig. . These structures have been chosen because, in the single FLS system, they have a high ground state energy above $-0.3$, meaning that at most $30\%$ of the lattice sites can host a FLS in a given configuration of the system. This high level of frustration results in a low equilibrium freezing temperature, as the crystalline groundstate is not very stable, and therefore leads to more interesting liquid physics. Besides, the structures of Fig.  are chosen to have either $5$ or $6$ up spins, such that no ferromagnetic alignment effect takes place: only the geometrical features of the selected structures are important.

We consider here bi-FLS systems in which two of these local structures are favoured with an energy $-1$, while all other structures have zero energy. Note that each of our nine selected local structures are chiral, *i.e.* they lack a reflection symmetry. We also include spin-inverted and mirror-symmetric cases for these structures, which have the same properties as the original FLSs, but different overlap properties with each other. This results in a pool of $126$ possible pairings of such chiral, high ground state energy systems, which we have investigated comprehensively using Monte-Carlo simulations.

### Scenarios for the low-temperature fate of the liquid

We can identify two distinct scenarios in the behaviour of these liquids on cooling: they either crystallize (Figure ), or continuously arrest into a disordered, glassy state (Figure ).

**Crystallization** (79 systems). In the majority of studied bi-FLS systems, the observed scenario is the crystallization of the system on cooling. An example of this behaviour in bi-FLS systems is illustrated in Fig. . On cooling, the energy decreases (Figure **a**) as FLS's accumulate (Figure **b**). Freezing is marked by an abrupt first order transition in these variables. This results in the end of the liquid branch in the $S(E)$ microcanonical plot (Figure **c**). Figure **d** shows the covariance sub-matrix characterizing geometrical interactions between the FLS's in the system. At temperatures below the freezing point, the system is in a low energy state with periodic arrangement of both spins (Figure **e**) and the FLS sites (Figure **f**). The results of the high temperature approximation for $E(T)$, the FLS concentrations and $S(E)$ are also plotted (dotted lines). We find that the approximation increasingly underestimates the concentration of FLS and the liquid entropy as the temperature and energy, respectively, decrease. This shortcoming of the high $T$ approximation is quite generic for the FLS model and suggests the non-trivial result that the inclusion of higher order correlations between local structures serves to *decrease* the entropy cost of the FLS.

**Glass Transition** (47 systems). In more than a third of cases, crystallization is avoided, and the slow cooling of the system down to zero temperature leaves us with a dynamically arrested disordered state. We refer to this outcome as a glass transition, and illustrate it with an example bi-FLS system in Figure . The system continuously accumulates the two FLS's with decreasing $T$. We note that the degeneracy of these two local structures breaks down as the arrested state is approached (see Figure **b**). The temperature dependence of the energy (Figure **a**) and the variation of the entropy with energy (Figure **c**) characterise a continuous transformation into the disordered structure. A small heat capacity peak is associated with this transition which, in preliminary calculations, does not exhibit any systematic increase with system size. The absence of a dependence on system size suggests that there are no long range correlations associated with the observed glass transition. Note that among the 126 systems we studied, a few are somewhat ambiguous, as they undergo continuous accumulation of FLS's yet exhibit structured patterns that could be crystalline.

### Structural covariance and low-$T$ fate of the liquid

In these bi-FLS systems with favoured local structures $i$ and $j$, the high-temperature expansion gives a simple form for the thermodynamic constant $K$ characterizing a system: $$\label{eq:K-biFLS}
K = C_{ii} + C_{jj} + 2 C_{ij}$$ The diagonal terms $C_{ii}$ and $C_{jj}$ characterize self-overlap of the local structures  . Structures that overlap well with themselves have larger $C_{ii}$ and accumulating them is less costly in entropy. Positive by construction, the diagonal terms are also dominated by the symmetry properties of the FLS's so that low-symmetry FLS's cost less entropy, and result in larger values of $K$.

The off-diagonal elements of the covariance matrix capture the entropic interactions between different FLS. For the examples presented in Figures  and , we present the physically relevant portion of the covariance matrices (Figures **d** and **d**). In the crystallizing example, we have $C_{ij} = 4.6\times 10^{-5}$, indicating that the two FLS's have positive overlap, the presence of one at a given site tends to increase the probability to find the other in its surroundings. In contrast, in the glass-forming example, we have $C_{ij} = -1.6\times
10^{-4}$, indicating an effective repulsion between local structure, the presence of one depletes the concentration of the other in the neighbourhood. This trend, $C_{ij}>0$ for crystallizers and $C_{ij}<0$ for glass formers, does not apply to every bi-FLS choice but, over our entire sample of 126 systems, is statistically significant. The average values of the off-diagonal covariance $C_{ij}$ for the crystallizers and the glass formers are, respectively, $$\begin{aligned}
\langle C_{ij} \rangle_\mathrm{crystal} = & +0.7\times 10^{-5} \pm 7\times 10^{-5} \\
\langle C_{ij} \rangle_\mathrm{glass} = & -3.5\times 10^{-5} \pm 1\times 10^{-4}
\end{aligned}$$ Glass-forming ability therefore correlates with poor overlap between structures and hence geometric repulsion, while crystallizers are in general characterized by a geometric attraction between FLS's. This effect is statistically significant, a two-tailed Student $t$-test on the value of $C_{ij}$ for the populations of glass-formers and crystallizers indicates a $p$-value of $p=0.007$. This correlation has however a rather low signal-to-noise ratio, as shown in Figure , where the distributions of the structural covariances overlap between the two populations. Although the correlation is weak, the fact that a discernable correlation exists is significant, as it supports our proposal that the high $T$ structural correlations contains information about the fate of the low $T$ liquid.

### The role of crystal groundstate energies

While we have established that the high $T$ covariance between FLS's contains information relevant to the low-temperature fate of a liquid, the weakness of the correlation indicates that higher order entropic interactions between FLS, missing from the high $T$ expression, are important. One accessible source of information on the organization of FLS at low $T$ is the crystal groundstate. This state represents the densest packing of the selected FLS on the FCC lattice. Establishing the crystal groundstates for 126 different Hamiltonians via structural searches is a substantial challenge. We have applied the lattice search algorithm described in ref. , an enumerative method encompassing all possible crystalline structures with crystal cell size $\mathcal{Z}\leq 64$ and complemented by large-scale Monte-Carlo simulations. Since the same overlap constraints in the bi-FLS models influence the groundstate energy and the high $T$ covariance $C_{ij}$ we would expect some correlation between the two quantities. We test this conjecture in Figure  where we plot the scatter of the pairs $(C_{ij},E_o)$ for all $126$ systems studied. We find a negative correlation between $E_o$ and $C_{ij}$, with Pearson correlation coefficient $r = -0.34$ and significance $p=10^{-4}$. Again, this correlation is rather weak, but significant. High-temperature covariances correspond to simple combinatorics that do not encompass the whole complexity of dense packing problems but they serve as useful indicators of whether FLS's will pack well or not.

$E_o$ also correlates with glass-forming ability. High ground state energies result in stabilization of the liquid with respect to crystallization and, therefore, in low the crystallization temperatures. This in turn increases the likelihood that the liquid will dynamically arrest before freezing. Averaging the ground state energies with crystallizing and glass-forming systems, we find: $$\begin{aligned}
  \langle E_o \rangle_\mathrm{crystal} = &   -0.355 \pm 0.04 \\
  \langle E_o \rangle_\mathrm{glass} = &  -0.327   \pm 0.02
\end{aligned}$$ *i.e.*, the former have significantly lower ground state energies than the latter. A Student $t$-test indicates a strong significance for this trend, with $p=10^{-6}$. We thus conclude that a possible mechanism explaining why geometric repulsion between favoured local structures correlates with glass-forming ability is through the high ground state energy it incurs.

### What determines whether a liquid will crystallize or form a glass?

The question of what factors influence the fate of the liquid is of central importance both for the development of new bulk metallic glasses  and in terms of understanding the fundamental question of the low temperature end of the liquid state. The kinetics of crystallization is obviously of central importance. The relationship between crystal nucleation and growth and the structural statistics of the liquid is a substantial problem that we leave for future work. Here we restrict ourselves to consider a key parameter of the crystallization kinetics: the equilibrium freezing temperature. The lower this temperature, the slower the relaxation of the system at the freezing point, and hence the higher the likelihood to miss crystallization and form a glass.

Previously , we derived an expression for the freezing temperature $T_f$ based on the high $T$ expression for the entropy, $$T_{f} =  \left({\frac{E_{\infty}-E_o}{2S_{\infty}}}\right) \left(1+\sqrt{1-\frac{2KS_{\infty}}{(E_{\infty}-E_o)^{2}}}\right)
\label{eq:tf}$$ Here $E_{\infty}$ and $S_{\infty}$ are the high $T$ limit of the energy and entropy per site, respectively. In Figure  we plot the cumulative distributions of this estimated value for $T_f$ for the glass forming and crystallizing bi-FLS models. While the two distributions still overlap, they appear to be better separated by $T_f$. Quantitatively, we find: $$\begin{aligned}
  \langle T_f \rangle_\mathrm{crystal} = &   0.49 \pm 0.05 \\
  \langle T_f \rangle_\mathrm{glass} = &  0.44   \pm 0.03
\end{aligned}$$ and the $p$-value is now $p=10^{-7}$, lower than for both $C_{ij}$ and $E_o$. By combining information of both the high $T$ structural correlations and the $T=0$ the groundstate energy $E_o$ into an estimated freezing temperature, we thus obtain a better predictor of the glass-forming ability of a system than by the covariance $C_{ij}$ alone. This result is consistent with the experimental observation  that a low freezing point is one of the best indicators of glass forming ability.

# Discussion

In this article, we have proposed a general framework for analysing the statistics of liquid structure and connecting explicitly these correlations to the configurational entropy of the liquid. We have argued that the fluctuation statistics of the high temperature liquid (or, equivalently, a version of the liquid with only repulsions retained) contain important information on the geometrical constraints of the liquid, even in the supercooled regime. This proposal runs counter to the current practice in computational studies of liquid structure to look in the lowest temperature liquids, an approach ideally suited to identify *what* structures are present but unhelpful in addressing *why* these structures are so favoured. We have addressed this *why* question with an explicit expression for the configurational entropy in terms of the statistics of the local structures, revealing in particular the importance of the covariance of the structural fluctuations. With our new approach to the analysis of liquid structure, we have thus presented in this article a first step towards a structural characterization of amorphous configurations that goes beyond merely descriptive approaches.

As a testing ground for our theory, we have considered a large sample of model liquids within our Favoured Local Structure lattice model. Here, each liquid we consider is characterised by two FLS's drawn from a selection of low-symmetry structures. A modest correlation between glass forming ability and the high $T$ covariance $C_{ij}$ serves both to support our claims for the relevance of the high temperature structural statistics. Beyond providing a glimpse on the mechanisms leading to a glass transition, we note that this model also gives us a reliable way to generate glass-forming systems in discrete lattice models without spatial heterogeneity or frozen disorder. Such a simple geometrical model may prove useful to address the challenges that remain in explaining the physics of the glass transition.

# Acknowledgements

**Acknowledgements** PH acknowledges the financial support of the Australian Research Council. PR is supported by "Initiative Doctorale Interdisciplinaire 2013" from IDEX Paris-Saclay.


abstract: Photoacoustic computed tomography (PACT) is a hybrid imaging modality, which combines the high optical contrast of pure optical imaging and the high penetration depth of ultrasound imaging. However, photoacoustic image dataset with good quality and large quantity is lacking. In this paper, we mainly talk about how to generate a practical photoacoustic dataset. Firstly, we extracted 389 3D vessel volumes from CT whole-lung scan database, and enhanced the blood vessel structures. Then for each 3D vessel volume, we embedded it into a three-layer cubic phantom to form a skin tissue model, which includes epidermis, dermis, and hypodermis. The vessel volume was placed randomly in dermis layer in 10 different ways. Thus, 3890 3D skin tissue phantoms were generated. Then we assigned optical properties for the four kinds of tissue types. Monte-Carlo optical simulations were deployed to obtain the optical fluence distribution. Then acoustic propagation simulations were deployed in k-Wave toolbox to obtain the photoacoustic initial pressure. Universal back-projection algorithm was used to reconstruct the photoacoustic images. This dataset could be used for deep learning-based photoacoustic image reconstruction, classification, registration, quantitative image analysis. This dataset could be accessesed on the website: <https://dx.doi.org/10.21227/h8hw-6a03>.
  .
  *Clinical relevance*— This paper mainly contributes to establish a giant 3D skin vascular phantom dataset which contains 3890 skin tissue models. This dataset could be used for deep learning-based blood oxygenation quantification and other tasks such as photoacoustic reconstruction and classification study.
author: Tengbo Lyu, Changchun Yang, Jiadong Zhang, Shanshan Guo, Feng Gao, and Fei Gao$^{*}$ [^1]
bibliography: strings.bib; refs.bib
title:  **Photoacoustic Digital Skin: Generation and Simulation of Human Skin Vascular for Quantitative Image Analysis**

# INTRODUCTION

Photoacoustic (PA) tomography (PAT) has been widely studied during the past two decades. PAT combines both the advantages of high optical contrast and deep ultrasound penetration depth, which makes it a good choice for quantitative imaging in deep tissue . There are two main PAT-based imaging modalities, which are photoacoustic computed tomography (PACT) and photoacoustic microscopy (PAM) . PACT reconstructs the target object image in a diffusive regime with the wide-field illumination, and then uses an ultrasound transducer array to detect the induced acoustic signals at multiple different locations. The geometrical shape of the transducer could be set as line, circular, spherical, or cylindrical shapes according to the 2D or 3D imaging setup. After obtaining the raw data of the PA signals, the next step is to reconstruct the original images using reconstruction algorithms such as commonly used delay and sum, time reversal, and universal back-projection algorithms. While PAM mainly images the object targets in a scanning manner using focused pulse light or a focused single-element ultrasound transducer, which provides higher spatial resolution with limited imaging depth. In 3D PA image reconstruction, the amplitude of a voxel in a PA image can be obtained by $${p_0}\left( {{\bf{x}},\lambda } \right) = {\mu _a}\left( {{\bf{x}},\lambda } \right)\Gamma \left( {\bf{x}} \right)\Phi \left( {{\bf{x}},\lambda ;{\mu _a},s,g} \right)$$ where ${p_0}$ is the PA initial pressure, ${\bf{x}}$ is the voxel's location within the sample, $\lambda$ is the optical wavelength, ${\mu _a}$ is the optical absorption coefficient, $g$ is the optical anisotropy factor,$\Gamma$ is the PA efficiency and $\Phi$ is the optical fluence.

Deep learning-based tasks such as image recognition, classification, registration, and reconstruction are data dependent, especially large-scale database . However, in PA image analysis, there is not enough large-scale image dataset released. What's more, 3D PA image dataset is also lacking. With this motivation in mind, in this paper, we built a giant 3D skin tissue phantom set, which includes 3890 phantoms. After assigning different optical properties for each tissue, we deployed optical and acoustic simulations under 16 wavelengths, which range from 750 nm to 900 nm with step of 10 nm. This giant 3D skin tissue model dataset as well as the optical and acoustic simulation images could be accessed on the website: <https://dx.doi.org/10.21227/h8hw-6a03>.

In the following several sections, we will cover how to generate the 3890 3D skin tissue phantoms in Section II, how Monte-Carlo based optical simulation is run in Section III and Section IV. A brief conclusion will be shown in Section V.

# 3D SKIN TISSUE PHANTOM GENERATION

Humans' skin tissue is composed of three layers, which are epidermis, dermis, and hypodermis layer, respectively. The main optical absorption in the epidermis layer is contributed by melanosomes. In the dermis layer, the main optical absorption is from blood. In the hypodermis layer, the main optical absorption is contributed by lipid and fat, where optical absorption by blood could be neglected . Based on these facts, we generate our 3D skin tissue phantoms by assigning three different layers to the number 1, 2, 3, which stands for the epidermis, dermis, and hypodermis layer, respectively (shown in Fig. 1).

The thickness along the Z direction of the epidermis layer is assigned by a random number ranging from 1 to 5 voxels. The thickness of the dermis layer is assigned by a random number ranging from 31 to 40 voxels. Since the total thickness of the 3D skin tissue model is set to 64 voxels, the thickness of the hypodermis layer is determined by subtracting the total thickness of the epidermis layer and dermis layer. The next step is to embed the blood vessel to the dermis layer.

Yang et al. generated the blood vessel volumes by randomly generating a few straight cylinders filled with blood . Although the number and direction of cylindrical blood vessel is different from each other in their work, it is still too far from the real scenarios. Therefore, in this work, we choose to segment a large number of human lung blood vessel volume from ELCAP Public Lung Image Database (<http://www.via.cornell.edu/lungdb.html>). This database currently consists of an image set including 50 patients' low-dose documented whole-lung 3D CT scans. The X direction and Y direction are both 512 voxels. While along the Z direction, the pixel size varies from 212 to 304 voxels. Since we only focus on the blood vessel structure and ignore the other physiological structures of the lungs, we need to firstly extract the blood vessel part. Thus, we preprocessed the whole-lung CT scan by enhancing the blood vessel using a 3D Frangi filter .

For every patient's scan, we segmented four blood vessel volumes from the left lung and the right lung, respectively. Thus, 400 smaller vessel volumes can be obtained. However, after we checked the 400 vessel volumes one by one, we found that some vessel volumes lack enough vessel structure. As a result, we deleted 11 vessel volumes from the 400 vessel volumes, leaving 389 vessel volumes embedded in the dermis layer. The size of each 3D vessel volume is 90, 90, and 30 voxels. Before generating the 3D skin tissue models, some image preprocessing was performed to remove disturbing noise-like structure (shown in Fig. 2). Then for every blood vessel volume, we randomly flipped them upside down, left and right to make our 3D skin tissue model dataset bigger. The random number was set to 10, so finally we got 3890 different blood vessel volumes. The number of the blood vessel was set to 4.

To reduce the running time of subsequent optical and acoustic simulations, the X-Y transversal surface of our dataset was set to 128 by 128 pixels. Thus, the size of the complete 3D skin tissue model is 128 by 128 by 64 voxels.

The last but very important step was to determine the optical absorption properties of epidermis, dermis, hypodermis and blood vessel. According to the work of Jacques et al , we calculated these optical absorption properties of the four tissue types. Specifically, the main optical properties of our 3D skin tissue model are optical absorption coefficients, reduced scattering coefficient, refractive index, and anisotropy, which could be represented respectively as ${\mu _a}$(cm$^{-1}$), ${\mu _s}$(cm$^{-1}$), $g$ and $n$.

```latex
\begin{table*}[h]\caption{Optical properties of the 3D skin tissue phantoms \cite{jacques2013optical}, \cite{bench2020towards}}
\begin{center}
\setlength{\tabcolsep}{6.6mm}{
\begin{tabular}{ccc}
\hline
Tissue type & Parameters & Values\\
\hline
 & Melanosome fraction ${C_M}$ & 1.3-6.3\%, 11-16\%, and 18-43\% for Caucasian, xanthoderma and pigmented skin\\
  & Optical absorption (cm$^{-1}$) & ${\mu _{ae}} = 6.6 \times {10^{11}}{C_M}{\lambda ^{ - 3.33}} + \left( {1 - {C_M}} \right)\left( {0.244 + 85.3{e^{ - \frac{{\lambda  - 154}}{{66.2}}}}} \right)$ \\
 Epidermis &Reduced scattering (cm$^{-1}$) & ${\mu _s} = 68.7{\left( {\frac{\lambda }{{500}}} \right)^{ - 1.16}}$ \\
 &Refractive index & A random number between 1.42 and 1.44 \\
 & Anisotropy & A random number between 0.8 and 0.95 \\
\hline
& Optical absorption (cm$^{-1}$) & ${\mu _{ab}} = {C_{Hb}}{\alpha _{Hb}} + {C_{Hb{O_2}}}{\alpha _{Hb{O_2}}}$ \\
Blood & Reduced scattering (cm$^{-1}$) & ${\mu _s} = 22{\left( {\frac{\lambda }{{500}}} \right)^{ - 0.66}}$ \\
& Refractive index & 1.36 \\
& Anisotropy & 0.994 \\
\hline
& Blood volume fraction ${C_B}$ & 0.2-7\% \\
& Optical absorption (cm$^{-1}$) & ${\mu _{ad}} = {C_B}{\mu _{ab}} + \left( {1 - {C_B}} \right)\left( {0.244 + 85.3{e^{ - \frac{{\lambda  - 154}}{{66.2}}}}} \right)$ \\
Dermis & Reduced scattering (cm$^{-1}$)) & ${\mu _s} = 45.3{\left( {\frac{\lambda }{{500}}} \right)^{ - 1.292}}$ \\
& Refractive index & $n = A + \frac{B}{{{\lambda ^2}}} + \frac{C}{{{\lambda ^4}}}$, $A = 1.3696$, $B = 3916.8$, $C = 2558.8$ \\
& Anisotropy & A random number between 0.8 and 0.95 \\
\hline
& Optical absorption (cm$^{-1}$) & ${\mu _{ah}} =  - \frac{1}{{600}}\lambda  + \frac{{143}}{{60}}$ \\
Hypodermis & Reduced scattering (cm$^{-1}$)) & ${\mu _s} =  - \frac{{11}}{{600}}\lambda  + \frac{{1687}}{{60}}$ \\
& Refractive index & 1.44 \\
& Anisotropy & 0.8\\
\hline
\end{tabular}}
\end{center}
\end{table*}
```

For epidermis layer, dermis layer, blood, and hypodermis layer, we assigned them the respective optical properties according to Table 1. Some formulas or random values were determined according to Ciaran Bench et al's work and Jacques et al's work .

Finally, 3890 different 3D skin tissue phantoms with specific optical properties were generated which are well prepared for the following optical and acoustic simulations.

# OPTICAL SIMULATION

After generating the 3D human skin dataset, the optical fluence simulation was deployed based on the 3D Monte Carlo method. Motivated by Tang's work , we use the MATLAB package MCXLAB released by Qianqian Fang to simulate the propagation path of the illuminated photons in the 3D skin tissue models.

A planar shape-like laser source pattern was designed to cover the whole surface of the epidermis. A billion photons were emitted for each optical simulation. The planar source was illuminated on the skin surface and the photons were absorbed by the four kinds of tissues which are epidermis, dermis, hypodermis, and blood vessel. According to Table 1, the optical fluence was computed and obtained. This simulation was run on a server with 4 GTX 1080Ti GPUs. It took us about 40 hours to simulate all these 3890 skin tissue models. We performed the optical absorption of the 3D skin tissue models at 16 different wavelengths from 750 nm to 900 nm with 10 nm interval. After about 26 days' running on the server, we got 16 different sets of optical fluence maps for each model. The size of each 3D skin tissue model's optical fluence map is about 3.4Mb. The optical fluence maps are shown in the first row of Fig. 4, where positions are chosen along the Z-axis which are voxel 10, 20, 30 with respect to the total thickness of 64 voxels.

# ACOUSTIC SIMULATION AND IMAGE RECONSTRUCTION

By multiplying the simulated optical fluence and optical absorption coefficient map, the initial acoustic pressure distribution can be obtained, which is used for the following acoustic simulation. The PA generation and acoustic propagation simulation in the 3D skin tissue models were run based on the k-Wave toolbox developed by Bradley Treeby et al . The simulation strategy in this work is to run the forward propagation process slice by slice, that is, for every 3D skin tissue model, we simulated the acoustic forward model and image reconstruction slice by slice. Then by stacking these reconstructed PA images together, we can obtain the reconstructed 3D PA initial pressure maps. The reconstruction method used here is universal back-projection proposed by Minghua Xu et al , which turns out to be faster and provide better reconstruction image quality than conventional time-reversal and delay-and-sum methods. The acoustic sensor array was set to be circular, and the number of the sensor position was 180 to cover the whole region of the skin tissue model. In other words, we did not use a direct 3D acoustic simulation which is time-consuming, instead, a 2D modality was adopted. In fact, the slice-by-slice simulation setup seems like a real-scenario cylindrical scan. Stacking these 64 slices back together is reasonable. In the second row of Fig. 4, we showed four samples out of 3890 3D skin tissue models, in which the positions are chosen along the Z-axis that are voxel 10, 20, 30 with respect to the total thickness of 64 voxels.

# CONCLUSIONS

In this paper, we basically and mainly talk about how to make a complex and real enough 3D skin vascular model to simulate the physical process of the PA effect. By embedding the CT lung vessels into some fixed-size cube shell, 3890 skin vascular tissue models were generated. And for every model, we assigned them a unique optical property according to the findings of the existing research. In the 3D Monte Carlo optical simulation section, we directly run the 3D program to obtain the optical fluence maps. In the acoustic propagation and image reconstruction section, we adopted a 2D strategy, which is run slice by slice and then stacked them together to obtain the 3D PA initial pressure distribution. It turns out that our 3D skin vascular model dataset is complex enough and close to the real scenario, which could be popularized. In the future, this dataset can be used for lots of research work in PAT, such as blood oxygen saturation quantification, PA image classification, registration and reconstruction.

# ACKNOWLEDGMENT

This research was funded by Start-up grant of ShanghaiTech University (F-0203-17-004), Natural Science Foundation of Shanghai (18ZR1425000), and National Natural Science Foundation of China (61805139). The authors declare no conflicts of interest.

[^1]: Tengbo Lyu, Changchun Yang, Jiadong Zhang, Shanshan Guo, Feng Gao and Fei Gao are with the Hybrid Imaging System Laboratory, Shanghai Engineering Research Center of Intelligent Vision and Imaging, School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China (\*corresponding author: firstname.lastname@example.com).