abstract: A new two-dimensional procedure for extrapolation of the values of matter, neutron, and proton radii obtained in no-core shell model (NCSM) calculations to infinite size of its basis is proposed. A relationship between the radii is used as an additional test. Together with the JISP16 potential, which is frequently used in NCSM calculations of the radii, the Daejeon 16 potential is applied for these purposes for the first time. Halo nucleus $^6$He is the object of studies. The small spread of radii values, successful testing using relationship between the values of these three radii, and reasonable agreement between the obtained results and experimental data as well as the results of other advanced ab initio calculations demonstrate the high efficiency of the developed approach and, therefore, good prospects for its application. The performed investigations and analysis of the results of other studies indicate that the halo of $^6$He has a large size – 0.7 $\div$ 0.8 fm.
author: D. M. Rodkin; Yu. M. Tchuvil'sky
date: 2024-09-30
title: Two-dimensional extrapolation procedure for ab initio study of nuclear size parameters and the properties of halo nucleus $^6$He

The matter and charge radii are basic observables characterizing atomic nuclei. Due to a variety of experimental techniques, the charge radii of stable and long-lived nuclei have been well studied. A slightly less favorable, but also quite satisfactory situation occurs for matter radii. For nuclei far from the stability band, the study of these quantities causes serious difficulties, which are gradually overcome with the development of methods for obtaining ever more intense beams of short-lived ions. The data obtained during such measurements are of great physical importance, since they provide information about the inhomogeneity of the distribution of protons and neutrons, the presence of "skin" or "halo" in nuclei. However, such experiments are still technically difficult and their results obtained for the same isotope often differ markedly from experiment to experiment. Therefore, the problem of theoretical description the size parameters (including neutron radii not available for direct measurements) of nuclei of the discussed type seems to be very topical. At the same time, it should be stressed that simplified approaches, such as the shell model with an inert core and, even more so, schemes that consider the core without taking into account its nucleon structure, encounter difficulties in describing long-range nucleon correlations, exchange effects, etc. and, therefore, give results of limited reliability. So, the use of ab initio approaches is one of few possible ways to solve this task.

An ab initio study of the size parameters of the lightest nucleon-stable neutron-rich $^6$He nucleus is the subject of this paper. Naturally, total binding energy of this system is also computed. The choice of this isotope is due to the fact that it is a good testing ground for the discussed studies. Indeed, first, its size characteristics have been fairly well studied experimentally. Second, the relatively small number of its constituent nucleons makes it possible to test a wide variety of high-precision theoretical methods on it. Third, this "canonical" example of the lightest halo nucleus turned out to be difficult to describe even within the framework of many ab initio schemes due to its large size and the great difference in neutron and charge radii (halo size $r_n-r_c$), unique for nuclei with A$\leq$`<!-- -->`{=html}10. The main motivation behind this choice is, obviously, that $^6$He nucleus is a very physically interesting (so-called Borromean) three-body ($\alpha$ +2n) system characterized by a large distribution radius of weakly bound neutrons.

The list of works devoted to the same subject is quite large. The most important of these are presented in Refs. which are based on wide diversity of ab initio schemes. Various Monte Carlo approaches , hyperspherical harmonics method , no-core configuration interaction (NCCI) calculations , coupled-cluster method , etc. are used in these works. Various versions of the no-core shell model (NCSM) play the most prominent role among these schemes. The NCSM and similar in structure NCCI calculations of matter and charge radii together with the binding energy ones are performed using realistic NN and NN + 3N interactions. The bases of the usual NCCI and NCSM are exploited, as well as symmetry-adapted SU(3)-based NCSM . NCSM with ($\alpha$+2n) continuum (NCSMC) also used to solve the mentioned above problem.

It should be emphasized that the problem of high-precision ab initio computation of the size parameters of nuclei is qualitatively different from the problem of calculation their binding energy. The main reason for this is that the sizes of nuclei are largely determined by long-range nucleon correlations. The consequence of that is, first, that it is hard task to achieve convergence of the results of calculating the radii of nuclei on a basis that is available to modern computers. This, in turn, forces one to use procedures for extrapolating the results to large dimensions of a basis. Approaches of such a kind in the calculations of $^6$He nucleus are presented in Refs. . However, there is a second problem along this way. In contrast to the regular tendency for the binding energy to change monotonically with increasing basis size, the convergence of nuclear radii is not monotonic. Because of this, approaches that include extrapolation procedures to an infinite basis also face difficulties.

The results obtained in the above works describe the experimental data with varying degrees of success (see the analysis below). However, the approaches developed in these works are still insufficient to answer the question of whether the source of the discrepancy between the theoretical results and experiment is the model of internucleon interaction or the inaccuracy of the calculation method itself. This is true even for the canonical $^6$He nucleus example. Therefore, the development of new methods for calculating the radii of nuclei and, in particular, for extrapolation of computed data obtained with an achievable basis cutoff parameter to infinity seems to be a vital issue.

In this paper we start from one of the most reliable and justified ab initio approaches, M-scheme of no-core shell model. Two different versions of NN-interaction together with Coulomb proton-proton interaction have been incorporated in the model Hamiltonian. The first of these two – JISP16-potential – has been built from nucleon scattering data using the $J$-matrix inverse scattering method . It has already been used to calculate the size parameters of $^6$He nucleus in Refs. , so in this paper it is exploited, in particular, to test other new elements of our approach.

An important novel of the current investigation is that the Daejeon16 potential is also applied for the NCSM computations of $^6$He nucleus radii as a model of NN-interaction. It is built using the N3LO limitation of Chiral Effective Field Theory softened via Similarity Renormalization Group (SRG) transformation . Both JISP16 and Daejeon16 versions of internucleon interaction are "global" i.e. designed to calculate all kinds of characteristics of nuclei with the masses $A \leq 16$. They were tested in the framework of large-scale computations of the total binding energies, nucleon and cluster binding energies, excitation energies, radii, moments of nuclear states and the reduced probabilities of electromagnetic transitions. These tests demonstrated that such characteristics are, in general, reproduced well. In some cases, the quality of describing these characteristics using the Daejeon16 interaction is somewhat better than that for JISP16 one.

The NCSM calculations were performed using the Bigstick code . In these computations the bases are limited by the values of the cut-off parameter ${\cal N}^*_{max} \leq 14$.

The central point of this work is a new two-dimensional procedure for extrapolating the calculated values of radii to an infinite basis. The object of extrapolation is the shape of the surface of values of one of the radii over the plane (${\cal N}^*_{max}$,$\hbar \omega$) and both these coordinates are contained in the extrapolation formula.

In this way the matter, neutron and proton radii as well as the size of the neutron halo of $^6$He isotope are computed. A comparative analysis of the obtained results, experimental data and results of other theoretical works is given.

Let us start the description of the experimental situation and the developed approach with the terminology. As in most modern works, point-nucleon RMS radii – parameters that characterize the distributions of all nucleons (nuclear matter) $r_m \equiv ({\bar r}^2_m)^{1/2}$, as well as neutrons $r_n$, and protons $r_p$ are considered. The last parameter is obtained from the measured charge radius $r_c$ using the expression presented in Ref. :

$$r^2_{p}= r^2_c-R^2_p-(N/Z)R^2_n-3\hbar^2c^2/4(M_pc^2)-r^2_{so}.
\label{rc}$$ Here $R^2_p$ and $R^2_n$ are the proton and neutron mean-square charge radii, $3\hbar^2c^2/4(M_pc^2)$ is a relativistic Darwin-Foldy correction, and $r^2_{so}$ is a spin-orbit nuclear charge-density correction. The following values are usually chosen: $R^2_n= - 0.1161$ fm$^2$, $3\hbar^2c^2/4(M_pc^2)$ = 0.033 fm$^2$, $r^2_{so}$ = 0.08 fm$^2$. The last estimate is valid for $^6$He only. For $R_p$ the Particle Data Group value is 0.877(7) fm. It is this quantity that is used when processing the measurement results to obtain point-proton nuclear radii. However, this value has been also precisely determined from the spectroscopy of muonic hydrogen . It turned out to be 0.84184(67) fm. Therefore, using these two values for $R_p$ two different values of $r_p$ can be obtained. Matter radius $r_m$ is deduced directly from differential cross sections of elastic proton scattering at high momentum transfer using Glauber multiple-scattering theory. Radius $r_n$ is unavailable for measurements and therefore is calculated using the expression $$Ar^2_m= Zr^2_p+Nr^2_n.
\label{rn}$$

As in other papers when studying the properties of systems with a neutron halo or skin, a measure of their thickness – the difference of point-nucleon sizes $r_h=r_n - r_p$ is used by us. In NCSM computations we use the universal approach, which makes it possible to calculate all three size parameters. After calculating the binding energy and wave function, we proceed for calculating matter, neutron and proton radii for point nucleons. The basic expressions of the formalism intended to describe these quantities are the following. In the shell model, the squared radius of a corresponding system is defined as

$$r^2_{m(n,p)} =  (1/N_A) \sum_{i} (\vec{r}_{m(n,p),i} - \vec{r}_{cm})^2,$$ where $\vec{r}_{cm} = (1/N_A) \sum_{i} \vec{r}_{m,i}$ Mean square radius takes the form

$$\begin{aligned}
{\bar r}^2_{m(n,p)} = - \frac{4}{N_A\cdot N_{A(N,Z)}} \langle \Psi_{A} | \sum_{i <j} \vec{r}_{m(n,p,i)} \vec{r}_{m,j} | \Psi_A{} \rangle\\ +\langle \Psi _{A}| r_{cm}^2 | \Psi _{A} \rangle + \frac{N_A - 2}{N_A\cdot N_{A(N,Z)}} \langle \Psi_{A} | \sum_{i} r^{2}_{m(n,p),i} | \Psi_A{} \rangle.
\end{aligned}$$ Here $N_{A(N,Z)}$ denotes the number of nucleons $A$ (or neutrons $N$, or protons $Z$) in the system,

$$\langle \Psi _{A}| r_{cm}^2 | \Psi _{A} \rangle = \frac{3 (\hbar c)^2}{2mc^2 \hbar \omega N_A},$$

$$\begin{aligned}
\langle \Psi _{A}| \sum_{i} \vec{r_i}^2 | \Psi _{A} \rangle = \frac{1}{\sqrt{2J+1}} \\
\sum_{k_a, k_b} OBTD(k_a, k_b, \lambda = 0) \langle k_a || r^2 || k_b \rangle,
\end{aligned}$$

and $$\begin{aligned}
\langle \Psi_{A} | \sum_{i < j} \vec{r}_{i} \vec{r}_{j} | \Psi_A{} \rangle = \frac{1}{\sqrt{2J +1}}
\displaystyle \sum_{k_a \le k_b, k_c \le k_d, J_0}\\
 \langle k_a k_b J_0 || \vec{r}_{1} \vec{r}_{2} || k_c k_d J_0 \rangle \cdot TBTD(k_a, k_b, k_c, k_d, J_0).
\end{aligned}$$

The one-body and two-body transition densities (OBTD) and (TBTD) included in these formulas are expressed in terms of the matrix elements of the products of fermion second quantization operators: $$OBTD(k_a, k_b, \lambda = 0) = \langle \Psi_{A} || [a^{+}_{k_a} \otimes \tilde{a}_{k_b}]^{\lambda = 0} || \Psi_{A} \rangle.$$

$$\begin{aligned}
TBTD(k_a, k_b, k_c, k_d, J_0) = \langle \Psi_{A} ||[ [a^{+}_{k_a} \otimes a^{+}_{k_b}]_{J_{0}} \otimes \\
[ \tilde{a}_{k_c} \otimes \tilde{a}_{k_d}]_{J_{0}} ]^{\lambda = 0} || \Psi_{A} \rangle.
\end{aligned}$$ where $\otimes$ is the sign of a tensor product of rank $J_0$ or $\lambda$.

The NCSM calculations of the radii are supplemented by the two-dimensional extrapolation procedure proposed by us. The results of calculations of these quantities for different values of $\hbar \omega$ and ${\cal N}^*_{max}$ are used as input data. To understand the reasoning behind this idea consider the surface formed by the values of any of the investigated radii over the plane (${\cal N}^*_{max}$,$\hbar \omega$). It is clear that for large values of $N^{*}_{max}$ this surface is a horizontal plane in a fairly wide range of values of $\hbar \omega$. As ${\cal N}^*_{max}$ decreases, the values of the radius increase for small $\hbar \omega$ and decrease for large $\hbar \omega$, which was noted in several previous works, in particular in Refs. and stressed by illustrations of the latter one. The wide horizontal part of the surface narrows and, in the range of maximal ${\cal N}^{*}_{max}$ values achievable for computer calculations, degenerates into an (approximately) horizontal line in some domain of values ${\cal N}^{*}_{max}$. The values of the radius on this line, it was proposed to consider as a value of the corresponding size parameter. It is so-called "crossover prescription". The value of $\hbar \omega$ at which the value of this parameter stabilizes is called crossover point. A detailed description of this concept can be found in Ref. . The results of our calculations with the JISP16 potential, naturally, give the same pattern as the results of the papers just cited, and, importantly, an analogous picture is observed for the Daejeon16 potential. The geometric image of the surface as a whole in this case is a tape twisted around this line as an axis. So, the idea is to determine trends in surface properties with increasing ${\cal N}^*_{max}$ using an extrapolation procedure basing on two-dimensional data with limited values of this parameter. We called this procedure twisted tape extrapolation (TTE). Within the framework of the TTE procedure, the following formula is proposed:

$$\begin{aligned}
r^2_{m(n,p)}({\cal N}^*_{max},\hbar \omega ) = r^2_{\infty,m(n,p)} + \\
P_k(\hbar \omega )\exp ( - \alpha \sqrt{{\cal N}^*_{max}}),
\label{extr}
\end{aligned}$$ where $P_k(x)$ – a polynomial of degree $k$ whose coefficients are fitting parameters, $r^2_{\infty,m(n,p)}$ is the extrapolation result – squared radius for infinite oscillator basis and $r^2_{m(n,p)}({\cal N}^*_{max},\hbar \omega )$ are theoretically obtained results for squared radii. Using in the expression () an exponential dependence with an index proportional to $[{\cal N}^*_{max}]^{1/2}$, we proceed according to the conclusions of Ref. . Factor of proportionality $\alpha$ is also a fitting parameter.

It should be noted that the interpolation procedure to determine the ranges of possible values of the radii $r_p$ and $r_m$ using two-dimensional (${\cal N}^*_{max}$,$\hbar \omega$) input data was presented in Ref. . Namely, the radii as functions of $\hbar \omega$ at fixed ${\cal N}^*_{max}$ values from the domain of approximate stability are computed by cubic one-dimensional interpolation of the calculated data points at different $\hbar \omega$. A more complicated two-dimensional-basing extrapolation procedure which includes the chi-square fit to the number of points at which the values of the point-proton radius were calculated for various ${\cal N}^*_{max}$ and $\hbar \omega$ is presented in Ref. . The object of the study was the $^6$Li nucleus. Some part of the calculations was carried out with the JISP16 potential. The weight of each point was determined by the difference in the values of the radius in neighboring ${\cal N}^*_{max}$ points.

The main novel of our procedure is that the interdependence of $r^2_{\infty}$ and $\hbar \omega$ is directly included in the extrapolation formula (). Another difference of our extrapolation procedure is a choice of the range of $\hbar \omega$ values which is fundamentally different from the one that is preferred in Ref. . It seems to us preferable to search in the vicinity to crossover point as it is done in work . At the same time, in our work, we used the same method for determining the weight of each point, as proposed in Ref. . For implementing the extrapolation procedure we have chosen chi-square fit method realized in TMinuit minimization package which is included in open-source ROOT CERN data analysis framework.

In this paper we present the results of the first test of TTE which is a rather general and, in our opinion, promising approach for studying observables that reflect long-range internuclear correlations in various nuclei. Therefore, here we limit ourselves to the simplest linearized version of the $\hbar \omega$-dependence of the surface shape, in which $\hbar \omega$-dependence is given by a first-order polynomial $P_1(\hbar \omega )$, and a relatively narrow mesh of calculated data. We have included in it only three values of ${\cal N}^*_{max}$ in which the crossover conditions take place: 10, 12, and 14. It is clear from our results and known from Refs. that as $N^{*}_{max}$ decreases, the values of the radii increase for small $\hbar \omega$ significantly faster than decrease for large $\hbar \omega$. To take that into account we have used non-uniform mesh with the points at: $\hbar \omega$ = 7.5; 8; 9; 10; 11; 12.5; 15; 17.5 MeV – for the JISP16 potential and at $\hbar \omega$ = 6; 7.5; 8; 9; 10; 11; 12.5; 15; 17.5 MeV – for the Daejeon16 potential. This is partly justified by the results obtained. The prospects for TTE lie, obviously, in the field of using polynomials of a higher degree $\hbar \omega$, a denser and wider mesh. This will require a large amount of computer time.

The results of NCSM calculations in which the JISP16 potential has been used are the following. Positions of the crossover points, values of the total binding energy (TBE) and the radii in these points are presented in Tab. I. It can be seen that these positions for the matter (as well as neutron) and point-proton radii differ noticeably. In view of this fact, the measure of violation of the relation () is important to estimate the reliability of these results. This measure is chosen to be $\Delta=1-[(Zr^2_p+Nr^2_n)/Ar^2_m]^{1/2}$. We call it violation factor. In the discussed case it is equal to 0.67 %.

TBEs $E_{tot}$ of $^6$He nucleus in these points are strongly underestimated compare to the experimental one. From a formalistic point of view, the system appears to be unbound with respect to the emission of two neutrons. When computing TBE, the optimal value of $\hbar \omega$ is 17.5 MeV with $E_{tot}$ = 28.47 MeV at this point, the system is bound, but the binding energy of neutrons is very small.

Approximate positions of the crossover points (MeV) and the values of: the total binding energy (MeV), the matter, neutron, and point-proton radii of 6He nucleus (fm) at this point at ${\cal N}^*_{max}$ = 14 for the JISP16 interaction.

System

nucl.
neutr.
prot.

ℏωco

10
10
12.5

Etot
26.41
26.41
27.86

r
2.334
2.550
1.797

In order to estimate stability of the results of extrapolation of size parameters, the domain of $\hbar \omega$ values has been varied. Namely, the procedure has been performed throughout the above presented range from 7.5 to 17.5 MeV, which is denoted as J0, as well as throughout the narrowed ranges 7.5 $\div$ 15 MeV (J1), 8 $\div$ 15 MeV (J2), and 9 $\div$ 17.5 MeV (J3). The final (optimal) result is the one that corresponds to the smallest value of $\chi^2$.

Extrapolation results for each of these ranges in case of the use of the JISP16 potential are presented in Fig. . The optimal values are marked with an arrow. The figure demonstrates high stability of the obtained radii. The final results for each of them and RMS deviations of other ones from the optimal are: $r_m = 2.342(7)$ fm, $r_n = 2.582(3)$ fm, and $r_p = 1.799(6)$ fm. The extrapolated quantities satisfy relation () much better than the ones estimated within the crossover prescription, violation factor $\Delta$ is equal to –0.36 % for them. This property and, especially, the small values of the standard deviation are, in our opinion, evidence of the high efficiency of the proposed extrapolation method, even in its minimal version.

The proposed procedure somewhat changes the value of $r_n$, and practically does not change the values of other size parameters obtained within the framework of stable crossover points prescription. The results obtained in our calculations, both estimated within the crossover prescription (see Tab. I) and extrapolated, are in rather good agreement with the results of Ref. , also obtained using the JISP16 interaction in different ways, but with up to 16 ${\cal N}^*_{max}$ values and based on the crossover prescription. The values $r_p =1.799 \div 1.810$ fm and $r_m =2.314 \div 2.327$ fm are presented in this paper.

Analogous computation results in which the Daejeon16 potential has been exploited are presented in Tab. II and Fig. . As for the JISP16 potential, in this case one can observe a difference in the position of the crossover points. The violation factor is significantly better being equal to –0.26 %. For $\hbar \omega$ = 8 MeV the binding energy of two neutrons is approximately equal to 0.5 MeV, and for $\hbar \omega$ = 10 MeV it is close to that measured experimentally. At $\hbar \omega$ = 12.5 MeV, the value of $E_{tot}$ reaches a maximum value of 29.31 MeV.

The same as in Tab. I for the Daejeon16 interaction.

System

nucl.
neutr.
prot.

ℏωco

8
8
10

Etot
28.83
28.83
29.26

r
2.416
2.630
1.880

The extrapolation procedure has been performed throughout the total range 6 $\div$ 17.5 MeV (D0) and the narrowed ranges 6 $\div$ 15 MeV (D1), 7.5 $\div$ 15 MeV (D2), and 7.5 $\div$ 12.5 MeV (D3). The optimal values have been chosen as described above. The obtained results are also stable. These values of the radii and the RMS-deviations are: $r_m = 2.430(6)$ fm, $r_n = 2.663(3)$ fm, and $r_p = 1.871(16)$ fm. In this case the violation factor $\Delta$ is very small, namely, equal to 0.09%.

The experimental data necessary for comparative analysis are presented in Tab. III. The neutron radius given together with the matter radius was calculated by the authors of the experiments using their own values of $r_m$, the values of point-proton radius from $^a$ or , and relation (). With reference to the table, it can be seen that the point-proton radius of $^6$He nucleus is extracted with a high degree of accuracy and the results of different research groups are in good agreement. It looks a little strange, but against the background of this good agreement between these data, two different versions of the proton radius $R_p$ introduce noticeable duality. The data concerning the matter radius also agree well. The error bars, however, are substantially higher in these measurements. The datum of Ref. somewhat fall out of the systematics, which has a particularly noticeable effect on the size of the halo.

A comparison of the radii obtained for the two versions of the internucleon interaction with each other and with the experimental data leads to the following conclusions. The radii calculated using the Daejeon16 and JISP16 potentials differ significantly and, considering RMS deviations, reliably. Daejeon16-based calculations result in larger values of the size parameters. The most likely reason is that the Daejeon16 interaction is softer than JISP16. A very unexpected result is almost complete coincidence of the size of the neutron halo $r_h$. Indeed, this value is equal to 0.792 and 0.783 fm in the discussed cases. In our opinion, this is not an artifact, but a real physical result, and an important one at that. This coincidence also holds for the results obtained via crossover prescription, $r_h$ is equal to 0.750 and 0.733 fm in this approach.

Experimental values of matter, neutron, and point-proton radii of 6He nucleus (fm), obtained using the radius of proton Rp from:  a and  b.

rm

2.33(4)
2.30(7)
2.44(7)
2.29(6)

rn
2.51(6)
2.47(10)
2.66(10)
2.45(9)

a
b

rp

1.925(12)
1.938(23)
1,953(22)
1.934(9)

For the Daejeon16 potential, the point-proton radius is slightly, but reliably less than the experimental value. For the JISP16 potential this underestimation is not small. Other theoretical papers also give a significant underestimation of the parameter under discussion: – 1.82 fm, – 1.78 fm and 1.82 fm, – 1.74 fm, 1.81 fm, and 1.84 fm (depending on the choice of interaction version). In the last example the values presented in the original paper for the charge radius $r_c$ have been recalculated by us according to formula () with $R_p$ value given from Ref. . These works also confirm the trend towards an increase in $r_p$ when using softer interaction options. The exception is part of the data presented in Ref. . As a result of NCSM calculations in the basis limited by ${\cal N}^*_{max}$=12 using potential from Ref. softened via the SRG procedure with parameter $\lambda_{SRG}$ =1.5 fm$^{-1}$ (for $\hbar \omega$ = 14 MeV basis) and 2.0 fm $^{-1}$ (for $\hbar \omega$ = 20 MeV basis) values 1.79 and 1.74 fm were obtained for the point-proton radius, respectively. At the same time in the NCSMC calculations carried out for the same input data, much larger values of the radius 1.85 and 1.87 fm were obtained, and the trend of their change turned out to be opposite. In the most advanced version of NCSMC, i.e. for the biggest model space the value 1.90(2) fm which is close to the experimental one was achieved.

The presented above values of the matter radius obtained in our calculations for both versions of the interaction lie in the range of values presented by different experimental groups. One can see good agreement between the values obtained in the calculations using JISP16 potential and the data from Refs. , as well as the value obtained in the calculations using the Daejeon16 potential and the datum from Ref. . The trend for a size parameter value to increase when using softer versions of the interaction remains valid for the matter radius. This parameter was also studied in work . The matter radius obtained in the NCSM calculations with the above presented input turned out to be equal to 2.25 and 2.15 fm for $\lambda_{SRG}$ =1.5 fm$^{-1}$ and 2.0 fm$^{-1}$, respectively. At the same time the NCSMC calculations performed in this work gave results of 2.37 and 2.41 fm, respectively, i.e. they sharply increase the values of the matter radius compared to NCSM calculations and reverse their dependence on the hardness of interaction. The computations within the most advanced version of NCSMC resulted in value $r_m = 2.46(2)$ fm.

It is important to ask which of the values of the matter radius obtained in experiments is confirmed in ab initio calculations: the larger one, 2.44(7) fm obtained in work , or the smaller ones, coinciding with good accuracy, (mean value is approximately equal to 2.31(6) fm) presented in Refs. . For several reasons, we, evidently, give preference the results obtained with the use of the Daejeon16 interaction. Compared to JISP16 one, this Hamiltonian is newer, provides faster convergence of TBEs of various nuclei. A lot of other nuclear observables are more reproductive by it. What about $^6$He example it results in correct binding energies of two neutrons in this isotope and yields better value of the point-proton radius. The extrapolated values of radii obtained with the use of it better satisfy relation (). Therefore, our study can be considered as a theoretical confirmation of the results of measurements of the matter radius presented in Ref. . The results of NCSMC calculations presented in Ref. are also in good agreement with these two values of the matter radius.

The same question concerning the size of neutron halo is, perhaps, even more intriguing. The measurements presented in Refs. resulted in well-consistent small values of $r_h$: 0.57, 0.53, and 0.51 fm. The result of paper is much greater – $r_h$ = 0.72 fm. The last value is in reasonable agreement with the results of calculations using the Daejeon16 potential, not only within the framework of the proposed extrapolation procedure, but also within the framework of the crossover prescription. It is noteworthy that this is also true for calculations using the JISP16 potential. An additional confirmation the discussed result may be found in the framework of the analysis of the results presented in Ref. . The value of neutron radius $r_n$= 2.70 fm obtained by us on the basis of the data of this work using formula () is, evidently, in good agreement with the data from Ref. and the results of our calculations. So, the computations performed in this work for two versions of the internucleon interaction, the results of advanced NCSMC computations from paper and the experimental data presented in Ref. give well-consistent large values of the size of the neutron halo of $^6$He nucleus $r_h$: 0.792, 0.783, 0.80, and 0.72 fm, i.e. about one and a half times larger than those presented in Refs. .

In conclusion let us list the basic points of the performed investigations.

I. A new two-dimensional procedure for extrapolation of the values of matter, neutron, and proton radii obtained in no-core shell model calculations, using various harmonic oscillator bases characterized by different parameters of ${\cal N}^*_{max}$ and $\hbar \omega$, to infinite basis size is proposed. The extrapolation formula contains both these parameters together.

II. In order to estimate stability of the results of extrapolation of size parameters, the domain of $\hbar \omega$ values has been varied. A relationship between the values of these three radii is used as an additional test.

III. The JISP16 and Daejeon16 internucleon interactions are used in NCSM computations of halo nucleus $^6$He. The latter one is involved to the calculations of radii for the first time.

IV. The small values of the RMS deviations together with successful testing using a relationship between the values of these three radii, and reasonable agreement between the obtained results and experimental data as well as the results of other advanced ab initio calculations demonstrate the high efficiency of the developed approach. This merits of it allows one, probably, in many cases to compare the quality of the description of the size parameters of nuclei by different Hamiltonians.

V. The results of computations of the size of $^6$He nucleus halo turns out to be the very stable and almost the same for the JISP16 and Daejeon16 potentials. The performed investigations and analysis of the results of other ab initio studies indicate that the halo of $^6$He has a large size – 0.7 $\div$ 0.8 fm. These results confirm the material radius measurement datum presented in Ref. .

VI. Based on the features of the geometry of surfaces of radii, the method as a whole was called twisted tape extrapolation. In our opinion, it looks rather general and promising approach for studying observables that reflect long-range internuclear correlations in various nuclei.

The study is supported by a grant from the Russian Science Foundation No. 22-22-00096, https://rscf.ru/en/project/22-22-00096/. We are grateful to A. M. Shirokov for providing the Daejeon16 NN-potential matrixes, as well as to C. W. Johnson for supporting our efforts to introduce code Bigstick for NCSM calculations.


abstract:
  **Background**: A crucial initial processing step for quantitative PET/CT analysis is segmentation of tumor lesions enabling accurate feature extraction, tumor characterization, oncologic staging and image-based therapy response assessment. Manual lesion segmentation is however associated with enormous effort and cost and is thus infeasible in clinical routine.
  **Goal**: The goal of this study was to report the performance of a deep neural network designed to automatically segment regions suspected for cancer in wholebody 18F-FDG PET/CT images in the context of the AutoPET challenge.
  **Method**: A cascaded approach was developed where a stacked ensemble of 3D UNET CNN processed the PET/CT images at a fixed 6mm resolution. A refiner network composed of residual layers enhanced the 6mm segmentation mask to the original resolution.
  **Results**: 930 cases were used to train the model. 50% were histologically proven cancer patient and 50% were healthy controls. We obtained a dice=0.68 on 84 stratified test cases. Manual and automatic Metabolic Tumor Volume (MTV) were highly correlated ($R^2=0.969$, $Slope=0.947$). Inference time was 89.7 seconds on average.
  **Conclusion**: The proposed algorithm accurately segmented regions suspicious for cancer in wholebody ${}^{18}F$-FDG PET/CT images.
author: Ludovic Sibille; Xinrui Zhan; Lei Xiang
bibliography: mybibliography.bib
title: Whole-body tumor segmentation of ${}^{18}F$-FDG PET/CT using a cascaded and ensembled convolutional neural networks

# Introduction

PET with fluorine 18 (18F) fluorodeoxyglucose (FDG) has a substantial impact on the diagnosis and clinical decisions of oncological diseases. 18F-FDG uptake highlights regions of high glucose metabolism that include both pathological and physiological processes. 18F-FDG-PET/CT adds value to the initial diagnosis, detection of recurrent tumor, and evaluation of response to therapy in lung cancer, lymphoma and melanoma.

FDG PET images are interpreted by experienced nuclear medicine readers that identify foci positive for FDG uptake that are suspicious for tumor. This classification of FDG positive foci is based on a qualitative analysis of the images and it is particularly challenging for malignant tumors with a low avidity, unusual tumor sites, with motion or attenuation artifacts, and the wide range of FDG uptake related to inflammation, infection, or physiologic glucose consumption .

A crucial initial processing step for quantitative PET/CT analysis is segmentation of tumor lesions enabling accurate feature extraction, tumor characterization, oncologic staging and image-based therapy response assessment. Manual lesion segmentation is however associated with enormous effort and cost and is thus infeasible in clinical routine.

This paper summarizes the approach used in the AutoPET challenge to segment suspicious lesions in wholebody FDG-PET/CT images.

# Material and methods

## Patients

The challenge cohort consists of patients with histologically proven malignant melanoma, lymphoma or lung cancer who were examined by FDG-PET/CT in two large medical centers (University Hospital Tübingen, Germany and University Hospital of the LMU in Munich, Germany). Two expert radiologists with 5 and 10 years of experience annotated the dataset using manual free-hand segmentation of identified lesions in axial slices.

In total, 900 patients were acquired in 1014 different studies. 50% of the patients were negative control patients. Refer to for additional information on the acquisition protocol. As can be seen in figure , a wide range of normal FDG uptakes were present such as brown fat, bone marrow, bowel, muscles, ureter and joints as well as within class variations. Similarly, patients with lesions showed large variations such as bulky, disseminated or low uptake patterns.

The dataset was split in 2 independent splits (development, test) at the patient level to avoid data leakage. The development dataset was further split in 15-fold cross-validation sets. Given the long tail distributions of the lesions, all the splits were stratified by overall lesion volume and number of lesions to minimize the model variance trained on different data slits.

## Data pre-processing

The data pre-processing aimed to mimic the ranges a radiologist would use to discriminate the various FDG uptakes and help the neural network disentangle the inputs. The PET SUV and CT volumes were processed as followed:

-   SUV: The PET SUV image was mapped from (0, 30) SUV to (0, 1) range. This captured most of the PET intensities

-   CT: The PET matched CT image mapped from (-150, 300) to (0, 1). This captured the most important patterns of the CT

-   CT_Soft: We used the range (-100, 100) to focus on the soft-tissue intensities

-   CT_Lung: Same logic with CT_Lung. Instead, the value ranged (-1000, -200) to capture the intensities of the lung tissues

-   SUV_hot: range is (2, 10) of the PET SUV to focus on the mid-range intensities of the lesions. This was useful for lesions with low uptake

## Data augmentation

We evaluated various data augmentation schemes and only the following ones lead to marked improvements on the validation splits:

-   Random axis flip for all three dimensions

-   Random affine transformation which included random rotations and isotropic scaling

-   PET only augmentation: random Gaussian blur, brightness, contrast and gamma transforms

The refiner network had an additional transformation that resampled the data using random spacing to make the refiner completely independent from the original input resolution.

## Model

At a high level, the proposed model approach can be decomposed in 2 modules: the first module had a large field of view to analyse at a coarse level global patterns and long range dependencies. The analyzed images were fixed in resolution and downsampled to 6mm to make the module resolution independent. The goal of the second module was to refine the coarse segmentation found by the first module using the original image (see figure )

The first module was composed of an ensemble of UNET like neural networks. UNET was modified to take as input 5x128x96x96 images. The channels were set to \[64, 96, 128, 156\] with a stride of 2 for each layer. Besides the change of channels, we also modified the middle block to have large kernels $9^3$ to encourage the detection of long range dependencies. Leaky ReLU was used as activation function and instance normalization as normalization layer. We employed deep supervision to train the UNET. 4 UNETs were trained on different splits of the development dataset and their outputs were linearly weighted to form the 6mm intermediate segmentation mask.

The refiner network took as input 5x64x64x64 images at original resolutions with the 6mm segmentation mask resampled to match the original image resolution. It was composed of a stem block with $9^3$ kernel followed by 4 x ($3^3$ convolution, leaky ReLU, instance norm) residual blocks with a final $3^3$ convolution to calculate the segmentation mask.

The models were trained to minimize the following loss: $$loss = dice\_loss + 0.5 * cross\_entropy\_loss + 2 * sensitivity\_loss$$

Each model (UNET, ensemble stacking, refiner) were trained separately. We used AdamW as optmizer with a learning rate of $1e-3$, weight decay of $1e-6$ and a decayed cosine warm restart scheduler (T=200 epochs, decay=0.9 for each period). Finally, gradient clipping was applied to stabilize the training.

We report dice, dice of cases with foreground segmentation ('foreground dice'), sensitivity, False positive (FP) volume (volume of incorrectly segmented uptake that did not overlap with true segmentation), False negative (FN) volume (volume of incorrectly segmented uptake that did not overlap with true segmentation), metabolic tumor volume (MTV) for the evaluation of our method.

## Post-processing

We tried to add sequence based models (RNN, LSTM & GRU) to reduce the false positive segmentations. The segmentation map outputed by the refiner network was relabelled using connected components. All features of the penultimate layer of the segmentation model belonging to the same connected components were averaged. In addition, high-order features were added (e.g., tumor volumes, SUV max, SUV std, position in volume, shape descriptors). Finally, a sequence model was used to re-classify the connected components. Intuitively, leveraging the segmentation as sequences may be easier to model long range dependencies and high order features may mimic features a radiologist may use. Unfortunately, results were very similar and for simplicity sake's, we removed it from our processing pipeline.

## Implementation

The method was developed using Python 3.9 and Pytorch 1.11 . Scripts for training and deployment are publicly available here:
<https://github.com/civodlu/AutoPET2022>

# Results

930 cases were used for the training of the models and 84 cases were held out for the final evaluation. Qualitatively, the model produced accurate segmentations. It understood the typical variations in appearance of normal uptakes such as hot organs (e.g., kidneys, bladder, brain, heart, ureter), brown fat, bone marrow, inflammation (e.g., bowel and joints), muscles. Similarly, the segmentations of lesions was accurate, all large lesions were segmented (see Figure ) and Table . Segmenting very small lesions or lesions with low FDG avidity was challenging.

For the various trained models, we found that combining a dice loss with cross-entropy loss lead to a more stable training of the models. Similarly, deep supervision and gradient clipping lead to improved training stability. The sensitivity loss encouraged the models to segment the smaller lesions but at the cost of additional false positives.

The whole pipeline took on average 89.7 seconds on a single V100 GPU per case, although no attempt were made to minimize inference speed.

Automatic and manually segmented metabolically tumor volumes were equivalent as shown in Figure

| Config | Dice | Dice Foreground | FN | FP | Sensitivity | MTV found | MTV | time (s) |
|:--:|:--:|:--:|:--:|:--:|:--:|:--:|:--:|:--:|
| M0 | 0.4819 | 0.6643 | **15.39** | 15.53 | **0.7426** | 558.6 | 485.4 | 4.94 |
| M1 | 0.4776 | 0.6583 | 21.63 | 15.52 | 0.7097 | 530.6 | 485.4 | 4.25 |
| M2 | 0.4709 | 0.6618 | 22.07 | 26.30 | 0.6939 | 525.0 | 485.4 | 4.06 |
| M3 | 0.5028 | 0.6658 | 26.33 | 12.51 | 0.7072 | 544.5 | 485.4 | 4.09 |
| Ensemble | **0.5049** | **0.6823** | 19.59 | **11.59** | 0.7255 | 536.3 | 485.4 | 8.91 |
| Full | 0.4942 | 0.6813 | 16.46 | 17.85 | 0.6446 | 413.2 | 485.4 | 89.7 |

Results of the models on the held out test split. 'Dice Foreground' represents the dice of the cases that have a segmentation. 'Dice' are the dice results on all the cases. Note that in the special case where a segmentation is found on a patient that has no segmentation, a dice of '0' is attributed to this case, which this is different from the challenge's dice calculation. If no segmentation is found on a case without segmentation, this case is discarded for the dice calculation (this differs again from the challenge which attributed '1' in this case explaining the differences in the leaderboard). 'FN' is the false negative volumes, 'FP' is the false positive volume, 'MTV' represents the average volume of the segmentations expressed in voxels.

Table shows that resulting dice were very similar for the models (M0-M3) trained on different splits. However, there were large variations in terms of False Negative (FN) and False Positive (FP) volumes as well as sensitivity despite an identical processing pipeline. The ensemble network had an improved 'dice' and 'dice foreground'. Finally, the refiner network was able to keep very similar performance characteristics while operating on the full scale image with FP and FN volumes adequately rebalanced.

# Conclusion

The proposed algorithm accurately segmented regions suspicious for cancer in wholebody FDG-PET/CT images.

# Appendix


abstract: On logarithmic paper some real algebraic curves look like smoothed broken lines. Moreover, the broken lines can be obtained as limits of those curves. The corresponding deformation can be viewed as a quantization, in which the broken line is a classical object and the curves are quantum. This generalizes to a new connection between algebraic geometry and the geometry of polyhedra, which is more straight-forward than the other known connections and gives a new insight into constructions used in the topology of real algebraic varieties.
address: Department of Mathematics, Uppsala University, Box 480, S-751 06 Uppsala, Sweden
author: Oleg Viro
title: Dequantization of Real Algebraic Geometry
  on Logarithmic Paper

# Graphs of polynomials on logarithmic paper

## How to visualize a real polynomial?

If you ever tried to draw the graph for a polynomial of degree greater than, say, 4 and consisting of at least 4 monomials, you are aware of the natural difficulties. The graph is too steep. Whatever scale you choose, either some important details do not fit into the picture or are too small. The usual recipes from Calculus do not address the problem, but suggest, instead, to find roots of the first two derivatives, which does not seem to be much easier than the original problem.

## Logarithmic paper

A physicist or engineer can give a more practical advice, based on their experience: *use (double) logarithmic paper.* This is a graph paper, called also *log paper*, with a non-uniform net of coordinate lines and logarithmic scales on both axes. On a log paper a point with coordinates $x$, $y$ is shown at the position with the usual, Cartesian coordinates equal to $\ln x$, $\ln y$. In other words, the transition to the log paper corresponds to the change of coordinates: $$\begin{cases} u=\ln x\\ v=\ln y.
\end{cases}$$ On a log paper the first quadrant is expanded homeomorphically to the whole plane, the line $x=1$ occupies the position of the axis of ordinates, the line $y=1$ occupies the position of the axis of abscissas, the unit square bounded by these lines and the coordinate axes occupies the whole third quadrant.

## A monomial on logarithmic paper

Let us try to follow the advice to use a log paper. Consider first the simplest special case: the graph of a monomial $ax^k$ (i. e., the curve defined by $y=ax^k$). We are forced to consider only positive $x,y$ and hence assume $a$ to be positive as well. Then $v=\ln y=\ln(ax^k)=k\ln x+\ln a=ku+\ln a=ku+b$, where we denote $\ln a$ by $b$. Now the curve which we want to draw is defined in the coordinates $u$ and $v$ by the equation $v=ku+b$. Everybody knows that this is the straight line with slope $k$ meeting the axis of ordinates (i.e., $v$-axis) at $(0,b)$.

## Few slightly more complicated polynomials

First, consider a line $y=1+x$. Then $$v=\ln y=\ln(1+x)=\ln(1+e^u).$$ See the left plot in Figure , where the graph of $v=\ln(1+e^u)$ is shown together with lines $v=0$ and $v=u$, which represent on the log paper the monomials $1$ and $x$ involved in our polynomial $1+x$. The graph of $v=\ln(1+e^u)$ looks like the broken line $v=\max\{0,u\}$ with a smoothed corner: it goes along and above of this broken line getting very close to it as $|u|$ grows. For $|u|>4$ the difference becomes beyond the resolution.

Here are two further examples: the quadratic polynomials $1+e^{\pm5}x+x^2$. Then $$v=\ln(1+e^{\pm5}x+x^2)=\ln(1+e^{u\pm5}+e^{2u}).$$ See the central and right plots in Figure . The graph of $v=\ln(1+e^{u\pm5}+e^{2u})$ looks like the broken line $v=\max\{0,u\pm5,2u\}$ with smoothed corners. It goes along and above of this broken line getting very close to it far from its corners. Notice that the lines $v=0$, $v=u\pm5$ and $v=2u$ represent on the logarithmic paper the monomials $1$, $e^{\pm5}x$ and $x^2$, respectively.

## A polynomial versus the maximum of its monomials

This suggests, for a polynomial $p(x)=a_nx^{n}
+a_{n-1}x^{n-1}+\dots+a_0$ with positive real coefficients $a_i=e^{b_i}$, to compare the graphs on log paper for $p$ and the maximum $M(p)(x)=\max\{a_nx^n,a_{n-1}x^{n-1},\dots,a_0\}$ of its monomials. Denote the graph on log paper of a function $f$ by $\Gamma_f$. With respect to the usual Cartesian coordinates, $\Gamma_p$ is the graph of $$L_p(u)=\ln\left (e^{nu+b_n}+e^{(n-1)u+b_{n-1}}+\dots+e^{b_0}\right )$$ and $\Gamma_{M(p)}$ is the graph of a piecewise linear convex function $$M_p(u)=\max\left\{nu+b_n, \ (n-1)u+b_{n-1},\   \dots\ ,\  b_0  \right\}.$$

Obviously, $M_p(u)\le L_p(u)\le M_p(u)+\ln(n+1)$. Hence $\Gamma_{p}$ is above $\Gamma_{M(p)}$, but below a copy of $\Gamma_{M(p)}$ shifted upwards by $\ln(n+1)$. The latter is in fact a rough estimate. It turns to equality only at $u$, where all linear functions, whose maximum is $M_p(u)$, are equal: $nu+b_n= (n-1)u+b_{n-1}=\dots=b_0$.

For a generic value of $u$, only one of these functions is equal to $M_p(u)$. Say $M_p(u)=ku+b_k$, while $M_p(u)>d+lu+b_l$ for some positive $d$ and each $l\ne k$. Then $$L_p(u)<M_p(u)+\ln(1+ne^{-d})<M_p(u)+e^{-d}n.$$

If for some value of $u$ the values of all of the functions $ku+b_k$ except two are smaller than $M_p(u)-d$, then $$L_p(u)<M_p(u)+\ln(2+(n-1)e^{-d})<M_p(u)+\ln2 +e^{-d}(n-1)/2.$$

Thus, on a logarithmic paper the graph of a generic polynomial with positive coefficients lies in a narrow strip along the brocken line which is the graph of the maximum of its monomials. The width of the strip is estimated by characteristics of the mutual position of the lines which are the graphs of the monomials. The less congested the configuration of these lines, the norrower this strip.

## Rescalings pushing the graph of a polynomial to a PL-graph

A natural way to make a configuration of lines less congested without changing its topology is to apply a dilation $(u,v)\mapsto(Cu,Cv)$ with a large $C>0$. In what follows it is more convenient to use instead of $C$ a parameter $h$ related to $C$ by $h=1/C$. In terms of $h$ the dilation acts by $(u,v)\mapsto (u/h,v/h)$. It maps the graph of $v=ku+b$ to the graph of $v=ku+b/h$. The parallel operation on monomials replaces $ax^{k}$ by $a^{1/h}x^{k}$.

Consider the corresponding family of polynomials: $p_{h}(x)=\sum_{k}a_k^{1/h}x^k$. On log paper, the graphs of its monomials are obtained by dilation with ratio $1/h$ from the graphs of the corresponding monomials of $p$. Hence $\Gamma_{M(p_{h})}$ is the image of $\Gamma_{M(p)}$ under the same dilation. However, $\Gamma_{p_{h}}$ is not the image of $\Gamma_p$. It still lies in a strip along $\Gamma_{M(p_{h})}$ and the strip is getting narrower as $h$ decreases, but at the corners of $\Gamma_{M(p_{h})}$ the width of the strip cannot become smaller than $\ln2$.

To keep the picture of our expanding configuration of lines (the graphs of monomials) independent on $h$, let us make an additional calibration of coordinates: set $u_h=hu=h\ln x$,$v_h=hv=h\ln y$. Denote by $\Gamma^h_f$ the graph of a function $y=f(x)$ in the plane with coordinates $u_h, v_h$.

Then $\Gamma^h_{M(p_{h})}$ does not depend on $h$. The additional scaling reduces the width of the strip along $\Gamma^h_{M(p_h)}$, where $\Gamma^h_{p_h}$ lies, forcing the width to tend to 0 as $h\to0$. Thus $\Gamma^h_{p_{h}}$ tends to $\Gamma^h_{M(p_h)}$ (in the $C^0$ sense) as $h\to0$.

# Quantization

## Maslov dequantization of positive real numbers

The rescaling formulas $u_h=h\ln x$, $v_h=h\ln y$ bring to mind formulas related to the Maslov dequantization of real numbers, see e.g. , . The core of the Maslov dequantization is a family of semirings $\left\{S_h\right\}_{h\in[0,\infty)}$ (recall that a semiring is a sort of ring, but without subtraction). As a set, each of $S_h$ is $\mathbb R$. The semiring operations $\oplus_h$ and $\odot_h$ in $S_h$ are defined as follows: $$\begin{aligned}
a\oplus_h b&=\begin{cases} h\ln(e^{a/h}+e^{b/h}),& \text{ if }h>0 \\
                            \max\{a,b\}, & \text{ if } h=0
\end{cases}\label{oplus}\\
a\odot_h b&= a+b\label{odot}
\end{aligned}$$ These operations depend continuously on $h$. For each $h>0$ the map $$D_h:\mathbb R_+\smallsetminus\{0\} \to S_h: x\mapsto h\ln x$$ is a semiring isomorphism of $\left\{\mathbb R_+\smallsetminus\{0\},+,\cdot\right\}$ onto $\left\{S_h,\oplus_h,\odot_h\right\}$, that is $$D_h(a+b)=D_h(a)\oplus_hD_h(b),\qquad
D_h(ab)=D_h(a)\odot_hD_h(b).$$ Thus $S_h$ with $h>0$ can be considered as a copy of $\mathbb R_+\smallsetminus\{0\}$ with the usual operations of addition and multiplication. On the other hand, $S_0$ is a copy of $\mathbb R$ where the operation of taking maximum is considered as an addition, and the usual addition, as a multiplication.

Applying the terminology of quantization to this deformation, we must call $S_0$ a classical object, and $S_h$ with $h\ne0$, quantum ones. The analogy with Quantum Mechanics motivated the following *correspondence principle* formulated by Litvinov and Maslov as follows:

*"There exists a (heuristic) correspondence, in the spirit of the correspondence principle in Quantum Mechanics, between important, useful and interesting constructions and results over the field of real (or complex) numbers (or the semiring of all nonnegative numbers) and similar constructions and results over idempotent semirings."*

This principle proved to be very fruitful in a number of situations, see , . According to the correspondence principle, the idempotent counterpart of a polynomial $p(x)=a_nx^{n}+a_{n-1}x^{n-1}+\dots+a_0$ is a convex PL-function $M_p(u)=\max\left\{nu+b_n, \ (n-1)u+b_{n-1},\
\dots\ ,\ b_0\right\}$. As we have seen above, $p$ and $M_p$ are related not only on an heuristic level. In Section we connected the graph $\Gamma_p$ of $p$ on logarithmic paper and the graph $\Gamma_{M(p)}$ of $M_p$ by a continuous family of graphs $\{\Gamma^h_{p_h}\}_{h\in(0,1)}$.

## Logarithmic paper as a graphical device for the Maslov dequantization

As we saw in Section , the graph of a polynomial $p(x)=\sum_ka_kx^k$ with positive real coefficients $a_k=e^{b_k}$ on log paper is the graph of function $\mathbb R\to\mathbb R$ defined by $v=\ln\left(\sum_ke^{ku+b_k}\right)$. Observe that $\ln\left(\sum_ke^{ku+b_k}\right)$ is the value in $S_1$ of the polynomial $\sum_kb_kx^k$ at $x=u$. Therefore we can identify the graph $\Gamma_p$ of $p(x)=\sum_ka_kx^k$ on log paper with the (Cartesian) graph of the polynomial $\sum_kb_kx^k$ on $S_1^2$.

Furthermore, $\Gamma^h_{p_h}$ is the graph of the function $\mathbb R\to\mathbb R$ defined by $$v=h\ln\left(\sum_ka_k^{1/h}e^{(ku)/h}\right)
=h\ln\left(\sum_ke^{(ku+b_k)/h} \right).$$ Observe, that the right hand side is the value in $S_h$ of the same polynomial $\sum_k b_kx^k$ at $u$. Therefore we can identify the graph $\Gamma^h_{p_h}$ of $p_h(x)=\sum_ka_k^{1/h}x^k$ on log paper with the (Cartesian) graph of $\sum_kb_kx^k$ on $S_h^2$.

At last, the graph of $\sum_k b_kx^k$ on $S_0^2$ is the the graph of $M_p$.

We see that the whole job of deforming $\Gamma_p$ to the graph of a piecewise linear convex function can be done by the Maslov dequantization: the deformation consists of the graphs of the same polynomial $\sum_kb_kx^k$ on $S_h^2$ for $h\in[0,1]$. The coefficients $b_k$ of this polynomial are logarithms of the coefficients of the original polynomial: $b_k=\ln a_k$. Since the map $x\mapsto\ln x:\mathbb R_+\smallsetminus 0\to
S_1$ was denoted above by $D_1$, we denote by $D_1 F$ the polynomial obtained from a polynomial $F$ with positive coefficients by replacing its coefficients with their logarithms. Thus $\sum_kb_kx^k=D_1p(x)$. Since $D_1$ is a semiring homomorphism, the graph $\Gamma_p$ of $p$ on log paper is the graph of $D_1p$ on $S_1^2$. The other graphs involved into the deformation are the graphs of the same polynomial $D_1p$ on $S_h^2$. They coincide with the graphs on log paper of the preimages $p_h$ of $D_1p$ under $D_h$. Indeed, $p_h(x)=\sum_ka_k^{1/h}x^k$ and $D_h^{-1}(b_k)=D_h^{-1}D_1(a_k)=e^{D_1(a_k)/h}=e^{(\ln
a_k)/h}=a_k^{1/h}$.

For a real polynomial $p(x)=\sum_ka_kx^k$ with positive coefficients, we shall call $p_h(x)=\sum_ka^{1/h}_kx^k$ with $h>0$ the *dequantizing family* of polynomials.

## Real algebraic geometry as quantized PL-geometry

The notion of polynomial is central in algebraic geometry. (I believe the subject of algebraic geometry would be better described by the name of *polynomial geometry*.) Since a polynomial over $\mathbb R$ is presented so explicitly as a quantization of a piecewise linear convex function, one may expect to find along this line explicit relations between other objects and phenomena of algebraic geometry over $\mathbb R$ and piecewise linear geometry. Indeed, in piecewise linear geometry the notion of piecewise linear convex function plays almost the same rôle as the notion of polynomial in algebraic geometry.

A representation of real algebraic geometry as a quantized PL-geometry may be rewarding in many ways. For example, in any quantization there are *classical objects*, i.e., objects which do not change much under the quantization. Objects of PL-geometry are easier to construct. If we knew conditions under which a PL object gives rise to a real algebraic object, which is classical with respect to the Maslov quantization, then we would have a simple way to construct real algebraic objects with controlled properties.

# Algebraic geometry on logarithmic paper

## Speak of real algebraic geometry only positively

Above in Section we discussed the drawing of graphs on a logarithmic paper only for a polynomial with positive coefficients. The graphs allowed us to see the behavior of the polynomials only at positive values of the argument. This was for a good reason: we used logarithms of coordinates. The Maslov dequantization deals only with positive numbers. Therefore each fragment of algebraic geometry that we want to dequantize must be reformulated first only in terms of positive numbers. This seems to be possible for everything belonging to real algebraic geometry.

## Visualizing roots of a polynomial on logarithmic paper

Above we could not encounter roots of polynomials, for a polynomial with *positive* coefficients has no *positive* roots. However if we really want to do algebraic geometry on log paper, we must figure out how to use graphs on log paper for visualizing roots (well, only *positive* roots) of an arbitrary real polynomial.

Any real polynomial $p(x)$ is a difference $p^+(x)-p^-(x)$ of polynomials with positive coefficients. We can reformulate the problem of finding the positive roots of $p$ as the problem of finding positive values of $x$ at which $p^+(x)=p^-(x)$. The graphs of $p^+$ and $p^-$ can be drawn on a log paper, where they are localized in the strips along broken lines, see Section above. For some polynomials this picture gives a decent information on the number and position of the positive roots.

The negative roots of $p(x)$ can be treated in the same way, since their absolute values are the positive roots of $p(-x)$.

## Plane algebraic curves on logarithmic paper

Now consider a real polynomial $p(x,y)=\sum_{k,l}a_{k,l}x^ky^l$ in two variables. Similarly to the case of polynomials in one variable, in the *logarithmic space* the graph of a monomial $ax^ky^l$ with $a>0$ is a plane $w=ku+lv+\ln a$, and the graph $\Gamma_p$ of a polynomial $p(x,y)$ with positive coefficients lies in a neighborhood of a convex piecewise linear surface, which is the graph $\Gamma_{M(p)}$ of the maximum $M(p)$ of the monomials. Furthermore, $p$ is included into a dequantizing family $p_h$ defined as $\sum_{k,l}a_{k,l}^{1/h}x^ky^l$ for $h>0$, cf. Section . The graph $\Gamma^h_{p_h}$ of $p_h$ in the logarithmic space with scaled coordinates $u_h=h\ln x$, $v_h=h\ln y$, $w_h=h\ln z$ coincides with the graph of the polynomial $D_1 p(x,y)=\sum_{k,l}\left(\ln a_{k,l}\right)x^ky^l$ in $S_h^3$. These graphs with $h\in(0,1]$ constitute a continuous deformation of $\Gamma_p=\Gamma^1_{p_1}$ to $\Gamma_{M(p)}$.

For a polynomial $p$ in two variables with arbitrary real coefficients, denote by $p^+$ the sum of its monomials with positive coefficients, and put $p^-=p^+-p$. Thus $p$ is canonically presented as a difference $p^+-p^-$ of two polynomials with positive coefficients. To obtain the curve defined on logarithmic paper by the equation $p(x,y)=0$, one can construct the graphs $\Gamma_{p^+}$ and $\Gamma_{p^-}$ for $p^+$ and $p^-$ in the logarithmic space, which are the surfaces defined in the usual Cartesian coordinates by $w=\ln\left (p^{\pm}(e^u,e^v)\right )$, and project the intersection $\Gamma_{p^+}\cap\Gamma_{p^-}$ to the plane of arguments.

For the first approximation of this curve, one may take the broken line, which is the projection of the intersection of the piecewise linear surfaces $\Gamma_{M(p^+)}$ and $\Gamma_{M(p^-)}$ corresponding to $p^+$ and $p^-$.

Of course, it may well happen that the broken line does not even resemble the curve. This happens to first approximations. However, it is very appealing to figure out circumstances under which the broken line is a good approximation, for a broken line seems to be much easier to deal with than an algebraic curve.

## Constructing algebraic curves, which are classical from our quantum point of view

Recall that in the logarithmic space the graph of $ax^ky^l$ is a plane $w=ku+lv+\ln a$. It has a normal vector $(k,l,-1)$ and intersects the vertical axis at $(0,0,\ln a)$. Thus if we want to construct a curve of a given degree $m$, we have to arrange planes whose normals are fixed: they are $(k,l,-1)$ with integers $k,l$, satisfying inequalities $0\le k,l,k+l\le m$. The only freedom is in moving them up and down.

Consider the pieces of these planes which do not lie under the others. They form a convex piecewise linear surface $U$, the graph of the maximum of the linear forms defining our planes. The combinatorial structure of faces in $U$ depends on the arrangement. Assume that at each vertex of $U$ exactly three of the planes meet. This is a genericity condition, which can be satisfied by small shifts of the planes.

Divide now the faces of $U$ arbitrarily into two classes. Denote the union of one of them by $U^+$, the union of the other by $U^-$. By genericity of the configuration, the common boundary of $U^+$ and $U^-$ is union of disjoint polygonal simple closed curves. It can be easily realized as the intersection of PL-surfaces $\Gamma_{M(p^+)}$ and $\Gamma_{M(p^-)}$ as above: take for $p^{\varepsilon}$ with $\varepsilon=\pm$ the sum of monomials corresponding to the planes of faces forming $U^{\varepsilon}$ and put $p=p^+-p^-$.

Consider now for $1\ge h\ge0$ the curve $C_h\subset S_h^3$ which is the intersection of the graphs in $S_h^3$ of the polynomials $D_1 p^+$ and $D_1p^-$. At $h=0$ this is the intersection of the convex PL-surfaces $\Gamma_{M(p^+)}$, $\Gamma_{M(p^-)}$. Due to the genericity condition above, this intersection is as transversal as one could wish: at all but a finite number of points the interior part of a face of one of them meets the interior part of a face of the other one, and at the rest of the points an edge of one of the surfaces intersects transversaly the interior of a face of the other surface.

When $h$ gets positive, the graphs are smoothed, their corners are rounded off. The same happens to their intersection curve. While the graphs are transveral, the intersection curve is deformed isotopically.

Take the curve corresponding to a value of $h$ such that the transversality is preserved between 0 and this value. The projection to $(u,v)$-plane of $C_h$ represents an algebraic curve of degree $m$ on the scaled logarithmic paper and it can be obtained by a small isotopy of the projection of $\partial U^+$ to the $(u,v)$-plane.

## Is this a patchworking?

A construction, which looks similar, has been known in the topology of real algebraic varieties for about 20 years as *patchworking,* or *Viro's method*. It has been used to construct real algebraic varieties with controlled topology and helped to solve a number of problems. For example, to classify up to isotopy non-singular real plane projective curves of degree 7 , and disprove the Ragsdale conjecture on the topology of plane curves formulated as early as in 1906. To the best of my knowledge, the patchworking has never been related to the Maslov quantization.

# Patchworking real algebraic curves

## The simplest patchworking

Here is a description of a simplified version of patchworking. The simplifications are of the following 3 kinds:

-   we restrict to the case of nonsingular planar curves,

-   we assume that all patches are trinomials, and

-   we consider only the part of the curve contained in the first quadrant (what happens in other quadrants is described soon after).

**Initial data.** Let $m$ be a positive integer (it will be the degree of the curve under construction) and $\Delta$ be the triangle in $\mathbb R^2$ with vertices $(0,0)$, $(m,0)$, $(0,m)$. Let $\tau$ be a *convex* triangulation of $\Delta$ with vertices having integer coordinates. The convexity of $\tau$ means that there exists a convex piecewise linear function $\nu:\Delta
\longrightarrow {\mathbb R_+}$ which is linear on each triangle of $\tau$ and is not linear on the union of any two triangles of $\tau$. Let the vertices of $\tau$ be equipped with signs. The sign (plus or minus) at the vertex with coordinates $(k,l)$ is denoted by $\sigma_{k,l}$.

**Construction of the piecewise linear curve.** If a triangle of the triangulation $\tau$ has vertices of different signs, draw a midline separating pluses from minuses. Denote by $L$ the union of these midlines. It is a collection of polygonal lines contained in $\Delta$. The pair $(\Delta, L)$ is called the *result of combinatorial patchworking.*

**Construction of polynomials.** Given initial data $m$, $\Delta$, $\tau$ and $\sigma_{k,l}$ as above and a positive convex function $\nu$ certifying, as above, that the triangulation $\tau$ is convex. Consider a one-parameter family of polynomials $$\label{bt}b_t(x,y)=\sum_{\text{\scriptsize$\begin{aligned}&{
\text{$(k,l)$  runs over}}\\ &\text{\;  vertices of
$\tau$}\end{aligned}$}}\sigma_{k,l}t^{\nu(k,l)}x^ky^l.$$ The polynomials $b_t$ are called the results of *polynomial patchworking.*

**Patchwork Theorem.**

*Let $m$, $\Delta$, $\tau$, $\sigma_{k,l}$ and $\nu$ be initial data as above. Denote by $b_t$ the polynomials obtained by the polynomial patchworking of these initial data, and by $L$ the PL-curve in $\Delta$ obtained from the same initial data by combinatorial patchworking.*

Then for all sufficiently small $t>0$ the polynomial $b_t$ defines in the first quadrant $\mathbb R^2_{++}=\{(x,y)\in\mathbb R^2\mid x,y>0\}$ a curve $a_t$ such that the pair $(\mathbb R^2_{++},\; a_t)$ is homeomorphic to the pair $(\operatorname{Int}\Delta,\;L\cap\operatorname{Int}\Delta)$.

## Patchwork in other quadrants

The Patchwork Theorem applied to $b_t(-x,y)$, $b_t(x,-y)$ and $b_t(-x,-y)$ gives a similar topological description of the curve defined in the other quadrants by $b_t$ with sufficiently small $t>0$. The results can be collected in the following natural combinatorial construction.

**Construction of the PL-curve.** Take copies $\Delta_{x} = s_x(\Delta)$, $\Delta_{y} = s_y(\Delta)$, $\Delta_{xy} = s(\Delta)$ of $\Delta$, where $s_x,\; s_y$ are reflections with respect to the coordinate axes and $s= s_x \circ s_y$. Denote by $A\Delta$ the square $\Delta\cup \Delta_x \cup \Delta_y \cup \Delta_{xy}$. Extend the triangulation $\tau$ to a symmetric triangulation of $A\Delta$, and the distribution of signs $\sigma_{i,j}$ to a distribution at the vertices of the extended triangulation by the following rule: $\sigma_{i,j}\sigma_{\varepsilon i,\delta j}\varepsilon^i\delta^j=1$, where $\varepsilon,\delta=\pm1$. In other words, passing from a vertex to its mirror image with respect to an axis we preserve its sign if the distance from the vertex to the axis is even, and change the sign if the distance is odd.

If a triangle of the triangulation of $A\Delta$ has vertices of different signs, select (as above) a midline separating pluses from minuses. Denote by $AL$ the union of the selected midlines. It is a collection of polygonal lines contained in $A\Delta$. The pair $(A\Delta, AL)$ is called the *result of affine combinatorial patchworking.* Glue by $s$ the sides of $A\Delta$. The resulting space $P\Delta$ is homeomorphic to the real projective plane $\mathbb RP^2$. Denote by $PL$ the image of $AL$ in $P\Delta$ and call the pair $(P\Delta,PL)$ the *result of projective combinatorial patchworking.*

**Addendum to the Patchwork Theorem.** *Under the assumptions of Patchwork Theorem above, for all sufficiently small $t>0$ there exist a homeomorphism $A\Delta\to\mathbb R^2$ mapping $AL$ onto the the affine curve defined by $b_t$ and a homeomorphism $P\Delta\to\mathbb RP^2$ mapping $PL$ onto the projective closure of this affine curve.*

## The Simplest Patchworking Coincides With Construction of Section

The polynomial $b_t$ defined by is presented as $b_t^+-b_t^-$, where $$b_t^{\varepsilon}(x,y)=\sum_{\text{\scriptsize$\begin{aligned}&{
\text{$(k,l)$  runs over the vertices}}\\ &\text{\quad of } \tau, \text{ at which $\sigma_{k,l}=\varepsilon$
}\end{aligned}$}}t^{\nu(k,l)}x^ky^l$$ Observe that polynomials $b_t^{\pm}$ comprise dequantizing families. Indeed, if we take $p(x,y)=\sum_{k,l}a_{k,l}x^ky^l$ with $a_{k,l}=e^{-\nu(k,l)}$, then for $h=-1/{\ln t}$ we obtain $$\begin{gathered}
p_h(x,y)=\sum_{k,l}a_{k,l}^{1/h}x^ky^l=\sum_{k,l}e^{-\nu(k,l)/h}x^ky^l=\\
\sum_{k,l}e^{\nu(k,l)\ln t}x^ky^l=\sum_{k,l}t^{\nu(k,l)}x^ky^l.
\end{gathered}$$ Patchwork Theorem deals with sufficiently small positive $t$, while $h$ in a dequantizing family of polynomials was a small positive number approaching 0. This is consistent with our setting $h=-1/\ln t$.

A monomial $a_{k,l}x^ky^l=e^{-\nu(k,l)}x^ky^l$ is presented in the logarithmic space by the graph of $w=ku+lv-\nu(k,l)$. Hence the graph of the maximum of linear forms corresponding to all monomials of $p^+$ and $p^-$ is defined by $$\label{Lt}
w=\max\{ku+lv-\nu(k,l)\;\mid\; (k,l) \text{ runs over vertices
of }\tau \}.$$ In we recognize the convex function conjugate to $\nu$. The graph of is a convex PL surface, whose natural stratification is dual to the triangulation $\tau$ of $\Delta$: the face which lies on the plane $w=ku+lv-\nu(k,l)$ corresponds to the vertex $(k,l)$ of $\tau$, two such faces meet at an edge in the graph of iff the corresponding vertices are connected with an edge of $\tau$, three faces meet at a vertex iff the corresponding vertices of $\tau$ belong to a triangle of $\tau$. In particular, we see that the configuration of planes satisfies the genericity condition of Section and planes $w=ku+lv-\nu(k,l)$ corresponding to all monomials of $b_t^{\pm}$ show up in the graph of as its faces.

Some of these faces correspond to monomials of $b_t^+$, the others to monomials of $b_t^-$. The edges which separate the faces of these two kinds constitute a broken line as in Section . These edges are dual to the edges of $\tau$ which intersect the result $L$ of the combinatorial patchworking.

Therefore the topology of the projection to the $(u,v)$-plane of the broken line coincides with the topology of $L$ in $\Delta$. 0◻

## Conclusion

We see that the quantum point of view (or its graphical log paper equivalent) gives a natural explanation to the simplest patchwork construction. The proofs become more conceptual and straight-forward. Of course, similar but slightly more involved quantum explanations can be given to all versions of patchwork.

Let me shortly mention other problems which can be attacked using similar arguments.

First of all, this is the Fewnomial Problem. Although A. G. Khovansky proved that basically all topological characteristics of a real algebraic variety can be estimated in terms of the number of monomials in the equations, the known estimates seem to be far weaker than conjectures. For varieties classical from the quantum point of view a strong estimates are obvious. It is very compelling to estimate how much the topology can be complicated by the quantizing deformations.

There seem to be deep relations between the dequantization of algebraic geometry considered above and the results of I. M. Gelfand, M. M. Kapranov and A. V. Zelevinsky on discriminants . In particular, some monomials in a discriminant are related to intersections of hyperplanes in the dequantized polynomial.

Complex algebraic geometry also deserves a dequantization. Especially relevant may be amoebas introduced in .


abstract: Postoperative wound complications are a significant cause of expense for hospitals, doctors, and patients. Hence, an effective method to diagnose the onset of wound complications is strongly desired. Algorithmically classifying wound images is a difficult task due to the variability in the appearance of wound sites. Convolutional neural networks (CNNs), a subgroup of artificial neural networks that have shown great promise in analyzing visual imagery, can be leveraged to categorize surgical wounds. We present a multi-label CNN ensemble, Deepwound, trained to classify wound images using only image pixels and corresponding labels as inputs. Our final computational model can accurately identify the presence of nine labels: drainage, fibrinous exudate, granulation tissue, surgical site infection, open wound, staples, steri strips, and sutures. Our model achieves receiver operating curve (ROC) area under curve (AUC) scores, sensitivity, specificity, and F1 scores superior to prior work in this area. Smartphones provide a means to deliver accessible wound care due to their increasing ubiquity. Paired with deep neural networks, they offer the capability to provide clinical insight to assist surgeons during postoperative care. We also present a mobile application frontend to Deepwound that assists patients in tracking their wound and surgical recovery from the comfort of their home.
author:
;
;
;
;
title: Deepwound: Automated Postoperative Wound Assessment and Surgical Site Surveillance through Convolutional Neural Networks

# Introduction

A critical issue in the healthcare industry, particularly in the United States, is the effective management of postoperative wounds. The World Health Organization estimates 359.5 million surgical operations were performed in 2012, displaying an increase of 38% over the preceding eight years . Surgeries expose patients to an array of possible afflictions in the surgical site. Surgical site infection (SSI) is an expensive healthcare-associated infection. The difference between the mean unadjusted costs for patients with and without SSI is approximately \$21,000 . Thus, individual SSIs have a significant financial impact on healthcare providers, patients and insurers. SSIs occur in 2-5 percent of patients undergoing inpatient surgery in the U.S., resulting in approximately 160,000 to 300,000 SSIs each year in the United States alone, as summarized by .

Currently, most wound findings are documented via visual assessment by surgeons. Patients revisit their surgeon a few days after the operation for this checkup. This takes up valuable time that a surgeon could use to help out other patients. Infections can also set in earlier and the delay until the checkup can exacerbate the issue. Moreover, there is a lack of quantification of surgical wounds. An automated analysis of a wound image can provide a complementary opinion and draw the attention of a surgeon to particular issues detected in a wound. Thus, a rapid and portable computer aided diagnosis (CAD) tool for wound assessment will greatly assist surgeons in determining the status of a wound in a timely manner.

Advances in software and hardware, in the form of powerful algorithms and computing units, have allowed for deep learning algorithms to solve a wide variety of tasks which were previously deemed difficult for computers to tackle. Challenging problems such as playing strategic games like Go and poker , and visual object recognition are now possible using modern compute environments. A type of artificial neural network, called a convolutional neural network (CNN), has demonstrated capabilities for highly accurate image classification after being trained on a large dataset of samples . In the past decade, research efforts have led to impressive results on medical tasks, such as automated skin lesion inspection and X-ray based pneumonia identification .

In this paper, we propose a novel approach to identifying the onset of wound ailments through the simple means of a picture. We introduce a CNN architecture, WoundNet, and train it with a HIPAA compliant dataset of wound images collected by patients and doctors using smartphones. Finally, we build a mobile application for the iOS software ecosystem that presents a user implementation of our CAD system. It includes clinically relevant features, such as the daily documentation of patient health and generation of wound assessments. The app enables patients to generate wound analysis reports and send them to the surgeon on a regular basis from a remote location, such as their home.

# Prior Work

While the applications of machine learning in healthcare are numerous, few have attempted to solve the problem of postoperative wound analysis and surgical site monitoring. We would like to summarize two key pieces of research that sought to build models similar to the one presented in this paper.

Wang et al. showcased a comprehensive pipeline for wound analysis, from wound segmentation to infection scoring and healing prediction . For binary infection classification, they obtained a F1 score of 0.348 and accuracy of 95.7% with a Kernel Support Vector Machine (SVM) trained on CNN generated features. Their dataset consisted of 2,700 images with 150 cases positive for SSI.

Another paper by Sanger et al. used classical machine learning to predict the onset of SSI in a wound. It is trained on baseline risk factors (BRF), such as pre-operative labs (e.g. blood tests), type of operation, and a multitude of other features . Their best classifier achieved a sensitivity of 0.8, specificity of 0.64, and receiver operating characteristic (ROC) area-under-curve (AUC) of 0.76. By computing the harmonic mean of their sensitivity and specificity, we determine that their F1 score is 0.71.

In our opinion, while the infection scoring model presented by Wang et al. does achieve an accuracy of 95.7%, we believe that this metric is insufficient due to the severe class imbalance in their dataset. Sensitivity, specificity, F1 score, and ROC curves are better metrics which address this issue. This work improves upon these metrics compared to the presentation by Wang et al. While Sanger et al. have built a predictive methodology based on BRF, our approach leverages pixel data from wound images. Thus, our research complements any analysis using BRF.

According to our literature search, no prior work in dressing identification and other ailments apart from SSIs have been modeled using computational techniques. Thus, we believe we have built the most robust and comprehensive wound classification algorithm up-to-date.

# Materials and Methods

## Data Collection and Description

Prior to this research, a dataset of 1,335 smartphone wound images was collected primarily from patients and surgeons at the Palo Alto VA Hospital and the Washington University Medical Center in St. Louis. The dataset also includes images from searching the internet to counteract class imbalance. All images were anonymized and cropped into identical squares.

Figure 1 shows a few examples of images from the dataset. As can be seen, images are very diverse and contain high variability. Images ranged from open wounds with infections to closed wounds with sutures. Table I shows the breakdown of the entire dataset.

| **Labels**         | **Positive** | **Negative** |
|:-------------------|:------------:|:------------:|
| Wound              |     615      |     720      |
| Infection (SSI)    |     355      |     980      |
| Granulation Tissue |     449      |     886      |
| Fibrinous Exudate  |     398      |     937      |
| Open Wound         |     631      |     704      |
| Drainage           |     448      |     887      |
| Steri Strips       |     129      |     1206     |
| Staples            |      98      |     1237     |
| Sutures            |     160      |     1175     |

Our smartphone-image wound dataset with 1,335 samples.

## Materials

Many tools went into the development of this research. Our CNNs were engineered using the Keras deep learning framework in the Python 3.7 programming language. The neural networks were trained on a Nvidia Tesla K80 GPU hosted by the Amazon Web Services Elastic Cloud Compute platform. The OpenCV computer vision library was used for histogram equalization and image inspection. Scikit-learn was leveraged for its variety of built-in metrics for model evaluation. The final model was deployed on a server using Flask.

A standard iOS development setup was used for the mobile application. The app was built using the Swift 4 programming language and Xcode integrated development environment.

Figure 2 below summarizes the four steps in the development of our model. We now cover each of these steps in detail.

In this section, we will cover the first three blocks of this pipeline. The "Model Testing and Analysis" block will be covered in the Results and Discussion section of this paper.

## Data Preprocessing

Figure 3 gives a summary of the data preprocessing steps. Once data is loaded into memory, images are resized to 224 by 224 pixels to fit the input of our CNN architecture. The input layer is 224 by 224 by 3 pixels, the final dimension accounting for the three-color channels. We then partition the dataset into training and validation sets. 80% of the data is used as the training data for our model and 20% is left for model evaluation and testing.

A critical component of the preprocessing stage is to compensate for vast differences in lighting and position found in smartphone images. To accommodate this, we apply contrast limited adaptive histogram equalization (CLAHE) to each image . Histogram equalization (HE) takes in a low contrast image and increases the contrast between the image's relative highs and lows to bring out subtle differences in shade and create a higher contrast image. CLAHE applies HE in individual 8x8 pixel tiles around the image. Contrast limiting is used to prevent noise from being amplified. We use a contrast limiting factor of 1. Finally, bilinear interpolation is applied to the image to remove artifacts in the borders.

## Model Generation

The second step in the development of our model is known as model generation and is shown in Figure 4. We take the preprocessed images and generate three slightly different CNNs using the WoundNet architecture. We also prepare it for transfer learning by initializing the CNNs on ImageNet weights.

Convolutional neural networks vastly outperform other current machine learning models for large scale image processing and classification. We make adjustments to a current state of the art CNN, VGG-16, to better suit our specific problem. The resulting configured model is known as WoundNet, illustrated in Figure 5. Three models were initialized using the VGG-16 CNN architecture . While we did try other deeper network architectures, we found them to overfit on the data almost immediately, unlike VGG-16. We believe that this is due to the combination of imbalance and small size of our dataset. For example, some deeper networks Rather than creating nine individual binary classifiers, we train each neural network to label images with all nine classes. This enables our model to find inter-label correlations through shared knowledge in the deep learning model.

We first remove the final output layer along with the two 4096-neuron fully connected (FC) layers prior to it. We append two smaller 1024-neuron FC layers, each with a dropout of 0.5, and an output layer with the sigmoid activation function. Dropout is a form of regularization that forces a chosen percentage of elements in a layer to not activate and thus reducing the overfitting of the model.

Our motivation for these changes are the following. Each wound image can be positive or negative for nine different classes in comparison to the ImageNet dataset in which every image only has a single label. Furthermore, the sigmoid function treats every class as a binary decision while softmax converts the weights of the neural network in the layer prior to the output to probabilities that add up to 1. We determined two 1024 element layers are the best choice to replace the FC layers to keep the model lightweight, faster to train, and reduce the computational complexity present in the original VGG-16 architecture.

## Model Training

After generating our models, we fine-tune them on our data. The entire process is outlined in Figure 6. Our training phase can be divided into four critical components: transfer learning, data augmentation, training specifics, and ensembling multiple models. We will now cover each of these pieces in depth.

### Transfer Learning

In practice, it is very difficult to train a CNN from end-to-end starting with randomly initialized weights. Furthermore, huge datasets with upwards of a million images are necessary to successfully train an accurate neural network from scratch. Too little data, such as our case, would cause a model to overfit.

We employ transfer learning , also known as fine tuning, to leverage pre-learned features from the ImageNet database. The original VGG-16 model was trained from end to end using approximately 1.3 million images (1000 object classes) from the 2014 ImageNet Large Scale Visual Recognition Challenge. We use the weights and layers from the original VGG-16 model as a starting point.

Transfer learning leverages the previously learned low level features (such as lines, edges and curves). Since these features are common for any image classification task, transfer learning requires less data to arrive at a satisfactory CNN. For optimum generalization and to prevent overfitting, we freeze each of the three WoundNet models at layer 6, 10, and 14, respectively. This prevents the low-level features from being washed away from training the CNNs on the training set of wound images.

### Data Augmentation

In order to make the most out of our training set, we utilize aggressive data augmentation prior to feeding images into the CNN. Data augmentation improves the generalization and performance of a deep neural network by copying images in the training set and performing a variety of random transformations on them. Each copy is randomly rotated from 0° to 360°, shifted by 10 pixels in any direction, zoomed into by a factor of 30%, and sheared by a factor of 20%. Copies are flipped vertically or horizontally with equal probability of 50%. The copied data is given the same labeling as its original and is added to the current training batch. Some images generated via data augmentation are shown in Figure 7.

### Training Specifics

Our CNNs are trained using the backpropagation algorithm with a batch size of 64. Backpropagation is an application of the chain rule of calculus to compute loss gradients for all weights in the network. Once an image is passed through the CNN during the training phase, the error is calculated using a loss function. That loss gradient is propagated backwards through the CNN, adjusting weights in the CNN. This way, the next time the CNN sees the same image, it will arrive at the correct outputs.

We use the binary cross-entropy loss function. Layers are first trained using the Adam optimizer for 30 epochs with a learning rate of 1e-3. We then continue to train the model using the Stochastic Gradient Descent (SGD) optimizer for gradient descent with a learning rate of 1e-4 for 50 epochs. SGD enables us to escape local minima of the loss function by using small, random movements. This process makes it easier for the CNN to find the global minimum of the loss function.

### Ensemble Multiple Models

We use the process of ensemble averaging to combine our three separate models into one. This approach is superior to generating only one classifier as the various errors among each model due to overfitting or underfitting will average out, resulting in higher overall scores. This ensemble is called Deepwound.

When a new image is fed into Deepwound, it is independently delegated to each member WoundNet CNN for classification. The results from each algorithm are consolidated into one result matrix through majority-voting for the presence or absence of each label.

# Mobile Application Pipeline

With a predicted 6.8 billion smartphones in the world by 2022 mobile health monitoring platforms can be leveraged to provide the right care at the right time. In this research, we have developed a comprehensive mobile application, Theia, as a way to deliver our Deepwound model to patients and providers. Screenshots from the final app are shown in Figure 8.

Theia is a proof-of-concept of how Deepwound can assist physicians and patients in postoperative wound surveillance. The first component of the app is the "Quick Test." Physicians or patients can quickly photograph a wound and generate a wound assessment. A wound assessment provides positive or negative values for each label affiliated with a wound.

The other component of the app is the ability for a patient to track wounds over a period of time. Every day, the patient receives a notification to complete a daily wound assessment, where he/she provides an image of the surgical site, their current weight, and rate their pain in that area. This data is accumulated over a period of 30 days. Furthermore, patients can track many different variables that can affect their wound recovery such as medicine intake, the changing of their wound dressing, weight, and pain level. All of this information is charted out over time and can be converted into a PDF that can be sent to physicians or family. Finally, we provide easy access for the patient to directly contact their surgeon through the app itself.

With permission from the patient, this app can also be used to collect wound images to add to our dataset. The enlarged dataset can be used to further improve our deep learning algorithms. As more patients and surgeons use the app, more image data can be collected. This newly accumulated data can be used to train our CNNs even further, leading to a virtuous cycle of improving accuracy.

Deepwound is used to classify every image the user takes. The image is stored securely within the app and anonymized when sent to the server for image processing and classification via a multipart HTTP request.

# Results and Discussion

We now present results for our computational model. We evaluate our CNN ensemble by calculating a variety of classification metrics (e.g accuracy, sensitivity, specificity, and F1 score), analyzing receiver operating characteristic curves, and generating saliency maps. This process is diagrammed in Figure 9.

## Classification Metrics

We use a few different metrics to evaluate the performance of the ensemble as a whole. We use accuracy, sensitivity, specificity, and F1 Score (see Equation 1, Equation 2, Equation 3, Equation 4). The latter three are more reliable metrics than accuracy for this paper as they take into account the real effectiveness of the model at discerning the presence and absence of a particular ailment. Table II displays all of our scores.

$$accuracy = \frac{all\;correct}{all\;samples} \label{eq}$$

$$sensitivity = \frac{true\;positive}{all\;positive}\label{eq}$$

$$specificity = \frac{true\;negative}{all\;negative}\label{eq}$$

$$F1\;score = 2 * \frac{sensitivity * specificity}{sensitivity + specificity}\label{eq}$$

| **Labels**         | **Accuracy** | **Sensitivity** | **Specificity** | **F1 Score** |
|:-------------------|:------------:|:---------------:|:---------------:|:------------:|
| Wound              |     0.82     |      0.93       |      0.75       |     0.83     |
| Infection (SSI)    |     0.84     |      0.70       |      0.70       |     0.70     |
| Granulation Tissue |     0.85     |      0.92       |      0.73       |     0.81     |
| Fibrinous Exudate  |     0.83     |      0.71       |      0.74       |     0.72     |
| Open Wound         |     0.83     |      0.96       |      0.75       |     0.84     |
| Drainage           |     0.72     |      0.98       |      0.55       |     0.70     |
| Steri Strips       |     0.97     |      0.88       |      0.82       |     0.85     |
| Staples            |     0.95     |      0.83       |      0.60       |     0.70     |
| Sutures            |     0.85     |      0.91       |      0.57       |     0.70     |

Reported classification metrics for the ensemble.

## Receiver Operating Characteristic and Area Under Curve

The area under the curve (AUC) of a receiver operating characteristic (ROC) curve is a useful metric in determining the performance of a binary classifier. ROC curves graphically represent the trade-off at every possible cutoff between sensitivity and specificity. Better classifiers have higher AUC values for their ROC curves while worse classifiers have lower AUC values. We chart ROC curves and calculate AUC values for each possible label for an image, as seen in Figure 10.

## Saliency Maps

When analyzing digital images using machine learning, it is important to understand why a certain classifier works. Saliency maps have been shown in the past as a way to visualize the inner workings of CNNs in the form of a heat map which highlights the features within the image that the classifier is focused on . We generate saliency maps from one of CNNs on a couple of images in the validation set to ensure that our classifiers are identifying the regions of interest for a particular label in an image (see Figure 11). We can confirm that the attention of the model is drawn to the correct regions in the images.

# Conclusions

In summary, our work describes a new machine learning based approach using CNNs to analyze an image of a wound and document its wellness. Our implementation achieves scores that improve upon prior work by Wang et al. and Sanger et al. for F1 score and ROC AUC.

We acknowledge that our data set size is small and has some imbalance. This is a common problem in medical research as the data needs to be gathered over a sustained period of time with health compliant processes. We overcome these hurdles through the use of aggressive data augmentation, transfer learning, and an ensemble of three CNNs.

Our approach for analysis and delivery with a smartphone is a unique contribution. It enables several key benefits: tracking a patient remotely, ease of communication with the medical team and an ability to detect the early onset of infection. Wide spread use of such means can also enable automated data collection and classification at a lower cost, which in turn can improve the machine learning algorithm to be improved through re-training with a larger data set. Our mobile app can also generate comprehensive wound reports that can be used for the purpose of billing insurers, thus saving surgeons time.

# Future Work

There are many ways to improve our algorithm. On a larger scale, it is necessary to gather more images for both training and testing. Creating a robust corpus of images will enable us to improve the performance of our method. More labeled images always lead to higher performances in the field of deep learning.

We would like to consider blur detection prior to analyzing our image. If the image is too blurry, we can send a message back to the user, requesting a clearer picture. There are many well-known techniques to accurately measure blur within an image.

We would also like to look into embedding our model into mobile devices directly without the need for a server. This will drastically increase speed for users and enable them to use the app in locations without access to the internet. Finally, we would like to extend our wound assessment framework by developing a computational model to track the healing of a wound using a time-series of images which can be collected using the current version of the mobile app.