abstract: Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is multi-dimensional. Simulations, however, often suffer from an inherent bias. Estimation of this bias may be poorly constrained not only because of data sparsity, but also because traditional predictive models fit only one type of observed outputs, such as scalars or images, instead of all available output data modalities, which might have been acquired and simulated at great cost. To break this limitation and open up the path for multi-modal calibration, we propose to combine a novel, transfer learning technique for suppressing the bias with recent developments in deep learning, which allow building predictive models with multi-modal outputs. First, we train an initial neural network model on simulated data to learn important correlations between different output modalities and between simulation inputs and outputs. Then, the model is partially retrained, or transfer learned, to fit the experiments; a method that has never been implemented in this type of architecture. Using fewer than 10 inertial confinement fusion experiments for training, transfer learning systematically improves the simulation predictions while a simple output calibration, which we design as a baseline, makes the predictions worse. We also offer extensive cross-validation with real and carefully designed synthetic data. The method described in this paper can be applied to a wide range of problems that require transferring knowledge from simulations to the domain of experiments.
address: $^1$ Lawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA 94550, USA
author: Bogdan Kustowski$^1$, Jim A Gaffney$^1$, Brian K Spears$^1$, Gemma J Anderson$^1$, Rushil Anirudh$^1$, Peer-Timo Bremer$^1$, Jayaraman J Thiagarajan$^1$, Michael K G Kruse$^1$, Ryan C Nora$^1$
bibliography: paper.bib
title: Suppressing simulation bias in multi-modal data using transfer learning

: Simulation, Calibration, Machine Learning, Transfer Learning, Inertial Confinement Fusion.

# Introduction

Building predictive models is a common task in a wide range of disciplines ranging from science, engineering, and medicine, through finance, management, and insurance. If sufficient data quantity is available, an accurate, data-driven predictive model can be estimated. In many applications, however, only a handful of data points is available to determine model parameters and such models usually do not generalize well. If these sparse data samples additionally come from a multi-dimensional design space, a purely data-driven approach becomes unrealistic.

Alternatively, data can be modeled in a deterministic way using insights about the data generating process. Designing a perfect model is typically not possible because of insufficient understanding of the data, approximations necessary to make the problem tractable, or limited computational resources. Consequently, even the best available simulation cannot accurately predict the data.

With these challenges in mind, it is natural to consider a hybrid approach, where the information from sparse data is combined with the knowledge built into the simulation. To enable the hybrid approach, expensive simulations are often approximated by fast-to-evaluate, differentiable, and mutable surrogates  , which can predict simulation outputs from a predefined range of simulation inputs. Predictions $y_{surr}=S(x)$ of the simulation-trained surrogate model $S$ from the known inputs $x$, differ from the experimental outputs $y_{obs}$ by a bias term $\delta$. Once the bias $\hat{\delta}$ has been estimated, the corrected predictions can be computed as:

$$\label{eq:bayesian}
y_{corr} = S(x) + \hat{\delta}(x).$$

A classic approach for finding the bias is Bayesian calibration , where the bias is estimated simultaneously with any uncertain model parameters, the latter being the main objective of the calibration. This method is, however, not designed to work with a small number of observations and with diverse types of outputs, such as time series, images, or videos. With the current trend for deploying more sensors and more types of sensors in many aspects of our life  and science   , as well as the advances in simulating such data    , there is a need to develop calibration methods that leverage all available data types. This is especially important when the observational data set is very sparse and more data types could break the non-uniqueness in the estimation.

Recently, an alternative approach for handling the simulation bias, called transfer learning, started gaining popularity. In principle, transfer learning is a general idea of leveraging the knowledge acquired in a source domain to improve a model that predicts data in a target domain. The method has been applied to various types of models including neural networks , , , Markov logic networks  and Gaussian processes . Researchers have started using this method to transfer the knowledge from the domain of simulations to the domain of real data   , such that Equation is replaced with

$$\label{eq:tl}
y_{corr} = S^{TL}(x, y_{obs}, S),$$

where $S^{TL}$ is a new, transfer learned, predictive model. In this formulation, the bias $\delta$ is not explicitly estimated, in contrast to Equation . Instead, a bias-corrected model $S^{TL}$ is computed from the inputs $x$ and observed outputs $y_{obs}$, as a modification of the simulation-trained model $S$. While  and have previously demonstrated that transfer learning calibration works for simple problems, where the observations consist of only scalar outputs, the real strength of this method, which has not been exploited so far, lies in the possibility of calibrating multi-modal data, thanks to recent advances in deep learning . One of the main contributions of this paper is including, for the first time, multi-modal output data to calibrate a simulation-trained surrogate using transfer learning. Incorporating multi-modal outputs cannot be achieved by simply replacing fully connected neural network layers with the convolutional ones; it requires a completely different and more complex model architecture, in which we have tested various transfer learning strategies for the first time.

To clarify the nomenclature, whenever we use the term "calibration" in this paper, we refer to designing a corrected surrogate model $S^{TL}$ to better predict the observed outputs. This is different from the Bayesian calibration, whose main goal is to infer unknown parameters of a computer model, from which the unchanged model $S$ predicts the observed outputs, while allowing for some bias correction. In Section , we will also discuss the "output calibration" - a mapping between simulation and experimental outputs, which neither modifies the inputs nor the predictive model of a simulation.

For the machine learning community, it is worth clarifying that the problem we are trying to solve is different than the domain adaptation in image classification problems. We apply transfer learning to a regression problem, where image data are the outputs, not the inputs of the model. It is possible to view it as an example of few-shot learning , where only few observations are available for training. In few-shot learning, it is common to apply simple data augmentation techniques to add certain invariances in the model, typically for only one data modality. We take a much more comprehensive approach to build an augmented dataset by simulating all data modalities in a physically consistent way. During few-shot training, it is also common to apply model regularization. Transfer learning can be thought of as a sophisticated regularization technique. We will demonstrate that, unlike a standard $L2$ regularization, transfer learning constrains the solution space yielding a model that generalizes well despite being trained on only a handful of observations. It should be also noted that, in contrast to purely machine learning publications, where cutting-edge methods are typically tested on freely available benchmark datasets, our task involves predicting very expensive, hence limited in quantity, experimental and simulated data, which limits our cross-validation options. From the machine learning perspective, the novelty of this paper is the application of transfer learning to a new type of the regression problem without the existing benchmark, using a non-standard architecture.

Regarding the specific application of transfer learning discussed in this paper, all real data have been acquired during inertial confinement fusion (ICF)    experiments at the National Ignition Facility (NIF) - the largest laser system in the world . During these experiments, which we also refer to as shots, the laser energy after being converted into X-rays, compresses a millimeter-scale target capsule. The capsule contains fuel consisting of two hydrogen isotopes: deuterium and tritium. Under extreme conditions caused by the compression, the nuclei of deuterium and tritium are fused into the nucleus of helium and a vast amount of energy is released. The goal of the experiments is to prove that ignition, where the released energy is larger than the energy provided by the laser, is possible in the laboratory setting. The successful demonstration would open up the path for building new types of nuclear reactors operating without heavy radioactive elements. Developing more accurate predictive models is crucial for predicting new ICF experiments before they are carried out, for optimizing designs of new experiments  , and for better understanding of the physics controlling the performance of each experiment.

The paper is organized as follows. In Section , we describe the ICF experimental and simulated data, including the inputs and multi-modal outputs. In Section , we first present the neural network architecture used to build the initial surrogate model of the simulations. Then, we discuss three different strategies of transfer learning in this architecture and select the preferred method. Presenting details of how these different strategies perform is beyond the scope of this paper. In Section , we first present the results of the successful application of transfer learning to one set of training and validation experiments. To demonstrate that these results are not serendipitous, we then carry out comprehensive cross-validation first using experimental, and then synthetic data. Finally, in Section we demonstrate that, unlike transfer learning, a linear calibration of the simulation outputs is not able to improve the predictions of the initial surrogate model.

Important contributions of this paper include:

$\bullet$

:   Designing a method to include multi-modal experimental output data in model calibration, which has been traditionally carried out using only scalar output data.

$\bullet$

:   Implementing transfer learning in a complex forward-model$<$-$>$autoencoder architecture for a regression problem and, with no methods available to compare it against, also designing a simple calibration method as a baseline for transfer learning.

$\bullet$

:   Despite the extremely sparse data and the lack of benchmark datasets with multi-modal outputs, carrying out a very comprehensive cross-validation, including exhaustive cross-validation with the experimental data, as well as designing a large synthetic dataset mimicking our experiments, and validating our transfer learning method on these data.

# Data

```latex
\begin{table*}
\caption{Experimental and simulation inputs $x$.}
  \label{table:inputs}
  \begin{center}
    \scriptsize {
      \begin{tabular}{|lllllllll|}
        \hline
        \textbf{Input parameter}          & \multicolumn{1}{|l|}{ID} & \multicolumn{3}{l|}{Min simulated} & \multicolumn{3}{l|}{Max simulated}\\ \hline
        {Scale}                            & \multicolumn{1}{|l|}{1} & \multicolumn{3}{l|}{0.8} &   \multicolumn{3}{l|}{1.6}\\
        {Drive asymmetry mode 1,0}         & \multicolumn{1}{|l|}{2} & \multicolumn{3}{l|}{0} &   \multicolumn{3}{l|}{1\%}\\
        {Drive asymmetry mode 2,0, time 1} & \multicolumn{1}{|l|}{3} & \multicolumn{3}{l|}{-6\%} &   \multicolumn{3}{l|}{0}\\
        {Drive asymmetry mode 2,0, time 2} & \multicolumn{1}{|l|}{4} & \multicolumn{3}{l|}{-6\%} &   \multicolumn{3}{l|}{6\%}\\
        {Drive trough adjustment}         & \multicolumn{1}{|l|}{5} & \multicolumn{3}{l|}{-0.2} &   \multicolumn{3}{l|}{0.5}\\
        {Drive power adjustment}          & \multicolumn{1}{|l|}{6} & \multicolumn{3}{l|}{-0.25} &   \multicolumn{3}{l|}{0.5}\\
        {Drive energy adjustment}         & \multicolumn{1}{|l|}{7} & \multicolumn{3}{l|}{-0.25} &   \multicolumn{3}{l|}{0.5}\\
        {Preheat}                          & \multicolumn{1}{|l|}{8} & \multicolumn{3}{l|}{0} &   \multicolumn{3}{l|}{50}\\
        {Dopant fraction}                  & \multicolumn{1}{|l|}{9} & \multicolumn{3}{l|}{0.1\%} &   \multicolumn{3}{l|}{0.35\%}\\ \hline
      \end{tabular}
    }
  \end{center}
\end{table*}
```

The multi-modal experimental data consists of 10 ICF shots acquired during a so-called "Bigfoot" campaign  at NIF. The nine input parameters, defining our design space, are listed in Table . Six of them represent how the laser energy, converted into the X-rays, compresses the target capsule. These parameters include the energy, power, as well as the geometrical asymmetry parameterized in terms of two spherical-harmonic modes at two different times. The remaining inputs are related to the hydrodynamic scaling, additional energy deposited in the fuel known as the preheat, and the fraction of the dopant in the outer portion of the capsule.

Within the scope of this paper, we consider the experimental inputs to be known, and of the same type as the simulated inputs. In reality, however, some of the experimental inputs listed in Table had to be statistically inferred using the method described in , which adds uncertainty to any predictions we make.

Using the 10 Bigfoot experiments, our objective is to build a model that can predict the outcome of future shots, assuming that the variations in the design of the old and future shots are captured by the nine input parameters. Given that the design space is nine-dimensional, a robust predictive model cannot be constructed from 10 experiments alone. To sample the design space more adequately, we used a database of over 92 thousand simulations of the target capsule. The simulations are deterministic, employ a two-dimensional radiation hydrodynamic code HYDRA , and took tens of millions of CPU hours   to complete.

| **Output names**        |     | Description         |     |     |     |
|:------------------------|:----|:--------------------|:----|:----|:----|
| ** Scalars**            | ID  |                     |     |     |     |
|  BT_GRH                 | 1   | Neutron bang time   |     |     |     |
|  BT_SPIDER              | 2   | X-ray bang time     |     |     |     |
|  DSR_AV                 | 3   | Downscattered ratio |     |     |     |
|  DT_TION_AV             | 4   | Temperature         |     |     |     |
|  P0_HGXD_090-078_TI     | 5   | Hot spot radius     |     |     |     |
|  DT_VEL_NTOF_161-056    | 6   | Velocity            |     |     |     |
|  LOG10_XRAY_YIELD_22KEV | 7   | X-ray emission      |     |     |     |
|  LOG10_DT_YIELD_AV      | 8   | Neutron yield       |     |     |     |
|  BW_GRH                 | 9   | Neutron burn width  |     |     |     |
|  BW_SPIDER              | 10  | X-ray burn width    |     |     |     |
| ** Images**             |     | X-ray image         |     |     |     |

Experimental and simulation outputs $y$.

The experimental and simulation outputs are listed in Table . The outputs include 10 scalar measurements describing how the target capsule responds to compression. These scalars include the time when the neutron and X-ray emission peaks (bang times), temperature, velocity, as well as the X-ray emission, and neutron yield - one of the most important ICF performance metrics. Each measured scalar has an associated error bar; these errors will be compared against prediction errors in Section . In addition to the scalars, each output sample contains one, 60-by-60-pixel, single-channel image of the intensity of the X-ray emission. The image captures the central part of the target capsule known as the hot spot.

Some processing and data selection has been applied to bring the experimental and simulated outputs into consistency but we recognize that the consistency is not perfect, especially for the images. There are multiple reasons contributing to this problem. First, half of our ICF shots had their X-ray images created using a different type of the imaging system than the other half.

Second, because each three-dimensional simulation would require on the order of one million CPU hours , our $\sim$`<!-- -->`{=html}92K simulations are only two-dimensional. Experimental variations in the unmodeled dimension are therefore visible in experimental images but not in the simulated images.

Third, running ensembles of ICF simulations and building surrogate models is fairly novel  and we attempt to predict experimental images pixel-by-pixel for a suite of shots for the very first time. Important pieces of information about the images that are crucial for our work are not always available. For example, although image intensity is physically related to some of the scalar outputs, at present, we have no way of relating the experimental image intensities to the simulations; hence we simply divided all image amplitudes by their means before building predictive models.

Given all the aforementioned challenges and the fact that we work with only 10 experiments, we hope to calibrate only the overall structure of the hot spot in the X-ray images.

# Method

Building our calibrated predictive model consists of two steps. First, an initial surrogate model is trained on simulated data, as described in Section . Then, the surrogate model is exposed to the experimental data and retrained, as described in Section .

## Initial model

To build the initial surrogate model, we closely follow the approach described in . Our goal is to build a surrogate model that predicts the ICF simulation outputs from the inputs residing within the ranges listed in Table . It is well known that, in the case of the ICF simulations, the mapping of the inputs $x$ to the outputs $y$ is nonlinear and that neural networks have been able to make more accurate predictions of the ICF outputs than simpler tree-based  or linear  models.

|                           |             |           |
|:--------------------------|:------------|:----------|
| **Output name**           | Autoencoder | Forward   |
|                           |             | model     |
|                           | $R^2$ for   | $R^2$ for |
|                           | $D(E(y))$   | $D(F(x))$ |
| ** Scalars**              |             |           |
|  BT_GRD                   | 1.000       | 0.998     |
|  BT_SPIDER                | 1.000       | 0.999     |
|  DRS_AV                   | 1.000       | 0.992     |
|  DT_TION_AV               | 0.999       | 0.974     |
|  P0_HGXD_090-078_TI       | 1.000       | 0.972     |
|  DT_VEL_NTOF-SPEC_161-056 | 1.000       | 0.983     |
|  LOG10_XRAY_YIELD_22KEV   | 1.000       | 0.988     |
|  LOG10_DT_YIELD_AV        | 1.000       | 0.990     |
|  BW_GRH                   | 1.000       | 0.881     |
|  BW_SPIDER                | 1.000       | 0.932     |
| ** Images**               | 1.000       | 0.997     |

The degree of correlation $R^2$ between the simulated outputs and predictions of the initial surrogate model for validation samples.

Predicting the outputs directly from the inputs might be possible, however,  advocate that physical relationships within data are better preserved if the outputs are first compressed by taking advantage of the correlations within the data. Since these correlations are not linear (with the exception of the two measurements of the bang time),  compress the outputs using a nonlinear method, a Wasserstein autoencoder . The autoencoder consists of two neural networks: an encoder $E$, which compresses the outputs $y$ into a set of latent variables $z$, and a decoder $D$, which reconstructs $y$ from $z$ (Figure ). The innermost layers of the encoder and decoder and fully connected, while the outer layers consist of convolutional layers for predicting images and a fully connected branch for predicting scalars. Because of the correlations within $y$, as well as a fairly simple structure of the X-ray image, 32 latent variables are sufficient to reconstruct all simulated outputs nearly perfectly, with the validation $R^2$ exceeding 0.999 (Table ). The standard coefficient of determination $R^2$ is used here to evaluate the the model predictions, where $R^2=1$ indicates a perfect correlation between the simulated and predicted outputs. For images, $R^2$ was calculated on a pixel-by-pixel basis.

Once the outputs have been compressed into a reduced set of latent variables, an inverse model $I$ and a forward model $F$ are trained to find the mapping between the inputs and the latent variables. The action of each of the four models is summarized in the following set of equations:

$$\label{eq:initial_model}
z = E(y), y = D(z), z = F(x), \ x = I(z).$$

The forward and inverse models are neural networks with fully-connected layers and special cyclic-consistency regularization developed in . For simplicity, Figure shows only the forward model; the inverse model plays an important role in the development of the initial model but not in transfer learning.

The validation $R^2$ for all scalar outputs predicted from the inputs by

$$\label{eq:forward}
y = S(x) = D(F(x))$$

is very high (Table ). This confirms that the number of training simulations is adequate for the nine-dimensional design space, and that the response surface is sufficiently smooth to be represented by $\sim$`<!-- -->`{=html}3.5 simulations per dimension.

## How to apply transfer learning in this new architecture?

Once the initial model has been trained on simulated data, we wish to retrain it to match the experimental data. In contrast to standard applications discussed in the machine learning literature, where transfer learned models merely classify images, our retrained model has a more challenging task of generating images and scalars as outputs. With only 10 experimental shots available, we expect our algorithm to suppress only a fairly simple, systematic bias of the simulations relative to the experiments. We also assume that the regularizing effect of the initial, simulation-trained model is sufficiently strong to enable robust refinement of thousands of weights in the neural network.

In the standard transfer learning procedure described in the literature , typically the last layer, or layers, within a single neural network get retrained to match the new data. Because our initial model is not a single neural network, it is not obvious which part of our system of networks needs to be retrained. Since there is no formal guidance in the literature for it, we implemented and tested three quite different strategies. Presenting numerical results of these tests would be worth a separate, method-oriented publication, and is beyond the scope of this paper. We now discuss, however, these three options since they make different assumptions about the simulation bias and imply a different role of transfer learning in removing it.

In the first option, shown in Figure , we retrained only the last layer of the forward model. This strategy has a clear interpretation. By keeping the autoencoded outputs fixed, we assumed that the latent representation of the outputs, derived from the simulations, is perfectly suitable for the experimental data. The simulation bias is therefore defined in this case as an incorrect position on the latent space, which can be corrected by the retraining of the forward model. This further implies that the bias is caused by the inadequacy of the simulation rather than the systematic discrepancy between simulated and experimental outputs that could be caused, for example, by the simulation post-processing procedure. Using this method, however, we were able to make only very small corrections without inflating the generalization error. This suggests that the correlations in the outputs extracted by the autoencoder from the simulation outputs are not exactly the same as the correlations in the experimental data.

To allow for corrections in the autoencoder, in the second option, we retrained the innermost layers in the encoder and in the decoder. This allowed for a good autoencoder reconstruction of the experimental outputs but it also made the autoencoder incompatible with the initial forward model, because the initial forward model predicts the outputs compressed by the initial autoencoder. We therefore subsequently retrained the last layer of the forward model as well. Once again, we found that only a small correction was possible without inflating the generalization error. This suggests that the bias exists not only in the correlations in the data extracted by the autoencoder but also in the forward model, which emulates the simulation. Furthermore, these biases cannot be corrected independently of each other. In order to correct them simultaneously, we tested the third option.

In the third option, we kept the encoder and forward model fixed and retrained only the innermost layer of the decoder. This fully connected layer is shared by all data modalities. Two subnetworks branch out from this innermost layer: a second fully connected layer for predicting the scalars, and a set of convolutional layers for predicting the image. Retraining of the decoder can therefore correct the imperfect correlations represented by the initial autoencoder. Because we retrain the innermost layer of the decoder, different data modalities are simultaneously affected by this change rather than being retrained independently of each other.

The third option gave us by far the best generalization error while making appreciably large corrections, and we will discuss only this option thereafter. The key step in the method is the retraining of the decoder. Relative to the training of the initial autoencoder, we added a standard L2 regularization of the model weights at a 5% level, decreased the number of training iterations from 200,000 to 100, and decreased the learning rate from 1e-4 to 3e-5. Such small number of iterations is sufficient because the initial model is already fully trained on simulations and it only needs to be slightly modified to reduce the bias. Using a small number of iterations also prevents overfitting to the sparse experimental data and catastrophic forgetting of what the model has learned from the simulations. The optimization objective in transfer learning can be written as

$$\begin{aligned}
    \min_{\bm{\theta}}  (\| \mathbf{y}_{img} - \mathbf{\hat{y}}_{img} \|_2^2 \
    + \gamma_{sca} \| \frac{\mathbf{y}_{sca} - \mathbf{\hat{y}}_{sca}}{\bm{\sigma}_{y_{sca}}} \|_2^2 \nonumber \\
    + \lambda_{reg} \| \bm{\theta} \|_2^2), \label{eq:objective}
\end{aligned}$$

where the weight $\gamma_{sca}$ controls how well the scalar outputs $\bm{y}_{sca}$ are matched relative to the image outputs $\bm{y}_{img}$, the hat symbol indicates model predictions, and $\lambda_{reg}$ controls the importance of the regularization imposed on the neural network weights $\bm{\theta}$.

In Section , we used only the L2 norm of the prediction error as the optimization metric but in Section , we divided the error for scalar outputs by the measurement error $\bm{\sigma}_{y_{sca}}$ thus using a $\chi^2$ to measure the goodness of fit. A standard min-max normalization was applied to $\bm{y_{sca}}$ before training but it was removed in the computation of the loss function whenever the prediction error was divided by $\bm{\sigma}_{y_{sca}}$. Pixel-wise measurement errors have not been estimated for images. Images were normalized by simply dividing intensities by the mean value of each image because, at this point, we have no way of relating the experimental and simulated image intensities in a reliable way, as mentioned in Section .

The number of gradient descent iterations, the learning rate, as well as the weights $\gamma_{sca}$ and $\lambda_{reg}$, were determined through cross-validation described in Section . Once the retrained decoder $D^{TL}$ has been computed, the predictions of the outputs are made by

$$\label{eq:tlpred}
y = S^{TL}(x) = D^{TL}(F(x)),$$

where $F$ is the simulation-trained forward model.

# Results

Our first test consists of randomly selecting seven ICF shots to retrain the initial model, while the remaining three shots are used to evaluate the generalization error. Figure compares the predictions of the initial (Equation ) and calibrated (Equation ) models against the observed values for the 10 scalar outputs. Scalars that experienced the largest correction are the two burn widths (BW). Calibration brought them to within the experimental error from the ground truth values for the majority of the shots. The initial predictions of both bang times (BT) are well correlated with the observations but are also systematically underestimated, which, in combination with the small observational error, lead to the large values of $\chi^2/N$. Calibration dramatically reduced this error. Large improvement is also observed for both YIELDs. For the remaining five scalars, the effect of calibration is less dramatic and requires more thorough validation.

Simultaneously with improving predictions of the scalar outputs, transfer learning improved predictions of the X-ray images (Figure ). Experimental images display a range of shapes from slightly prolate to very oblate hot spots. The initial model systematically predicted very prolate hot spots and calibration correctly modified the shapes to more round or slightly oblate. Transfer learning also preserved minor variations between the shots, such as the lower intensity in N171015, and the slightly prolate shape in N170109. Hot spots in N180128 and N180311 are elongated in the diagonal direction; a feature that was not modeled in our two-dimensional simulations, hence surrogate models cannot reconstruct it.

Predicting whether the hotspot is prolate or oblate is the main characteristic we expected to reconstruct in images. Although transfer learning improved the predicted shapes, there is not a lot of variability in the initial and calibrated model predictions. The capability of transfer learning to handle more diverse shapes will be further demonstrated in Section .

In summary, our model calibration has clearly improved the predictions of the initial model but validation with only three experiments could be serendipitous. In order to demonstrate that the improvement is systematic, we now turn to a more thorough cross-validation using experimental (Section ) and synthetic data (Section ).

## Cross-validation using experimental data

Comprehensive cross-validation is essential for understanding whether a model can systematically make accurate predictions. With only 10 experiments, we could consider the exhaustive cross-validation since there are only 120 possible splits into seven training samples and three validation samples. For practical reasons, we chose a slightly different strategy; we randomly split the data 500 times with replacement. We consider this approach to be approximately equivalent to the exhaustive cross-validation.

For each of the 500 train-test splits, we started with the same initial model, retrained it using seven experiments, and evaluated the validation error on the remaining three samples. In other words, we evaluated 500 different calibrated models. For each scalar output, we computed the $\chi^2/N$ metric after concatenating the three samples from all 500 splits. Since we divided the $\chi^2$ by the number of validation samples $N$, we can interpret the values smaller than one as an indication that the prediction error is smaller than the experimental error.

The cross-validation confirmed that the calibration systematically improves the predictions of the initial model (Figure ). The correction for both burn widths (BW), both bang times (BT), and DT_YIELD is large and the drop in $\chi^2/N$ varies between a factor of two and six for these four scalars. The remaining scalars show smaller changes. Overall, transfer learning improved the $\chi^2/N$ for eight out of ten scalars. Calibration did not generate poorly predicted outliers for any of the 500 splits confirming the robustness of the method.

In order to summarize the cross-validation results for images, we parameterized each image in terms of three numbers (Figure ). The first two parameters come from the Gauss-Laguerre , expansion: the (0, 0, COS) mode approximates the radius of the hot spot, and the (0, 2, COS) coefficient is positive for the oblate hots pots and negative for the prolate hot spots. The sign of this coefficient is opposite to the Legendre mode 2 - a standard characteristics in the ICF community. The third parameter is the maximum amplitude in the image.

Calibration systematically improved predictions for all three image parameters suppressing the bulk shift between the simulation and experiments. All 500 predictions are clearly better then the predictions of the initial surrogate model with the exception of radius predictions of four shots with the smallest radius. It is also remarkable that none of the three image parameters was included as a metric in the optimization; transfer learning minimizes a pixel-wise L2 norm of the images. We also need to keep in mind that, as discussed Section , the amplitudes are affected by dividing images by their mean values, which might have broken the physical consistency with the scalar outputs. These issues increase measurement uncertainties for the maximum amplitude as possibly also the radius, but we do not have quantitative estimates of these error bars.

## Designing synthetic data for additional cross-validation

After having completed the cross-validation using experimental data, we now turn to a more extensive cross-validation using synthetic experiments. With a thousand of validation samples available, we expect to better understand which aspects of the simulation bias can or cannot be corrected by transfer learning.

First, we need to decide how to generate the synthetic data to be representative of our problem. The authors of  generated the synthetic ICF experiments by modifying certain physics parameters in the simulation. Then, they transfer learned from the initial surrogate, trained on simulations with the nominal physics, to the domain of the "experiments" simulated by the perturbed physics. In that work, the authors run a very fast, but also very simplified, simulation  , which cannot model real ICF experiments. Repeating this procedure with two-dimensional HYDRA simulations, would require at least 100,000 CPU hours to generate 1,000 samples  and the process would likely need to be repeated multiple times to define reasonable physics perturbations. New simulations would also need additional quality assurance.

Motivated by these practical considerations, instead of running a new set of simulations, we generated the synthetic data by employing our uncalibrated surrogate model of the simulations to make predictions. First, in order to generate the nominal simulation data set, we fixed four of the nine inputs parameters to the values listed in Table . The other five input parameters were sampled randomly in the original ranges listed in Table . Having generated 92,000 inputs samples, we then predicted the outputs using the uncalibrated surrogate model and Equation . Then, to generate the synthetic experiments, we perturbed the values of the asymmetry and preheat parameters, kept them fixed, and repeated the procedure generating 1,000 "experiments". The preheat perturbation predominantly affects the scalars, while the asymmetry parameter perturbs the way X-rays compress the target capsule thereby strongly affecting X-ray images. Furthermore, we fixed the values of scale and dopant fraction to 1.0 and 0.28%, respectively, in both datasets. The experimental values of these two parameters vary in narrow ranges of 0.89-1.0 for the scale, and 0.21-0.28% for the dopant fraction (with the exception of one shot). The simulated ranges of 0.8-1.6 and 0.1-0.35%, respectively, are much wider and designed with the aim of making predictions rather than fitting experimental data. By suppressing variations in the scale parameter, we prevent transfer learning from calibrating against "experiments" at scales that are currently not attainable at NIF.

This procedure generated two lower-dimensional, and physically inconsistent data sets for transfer learning. We consider this approach to be nearly equivalent to running a new set of simulations since our surrogate model fits the simulations at the validation $R^2 > 0.932$ level for all but one outputs (Table ). We also recognize that the true simulation-experiment discrepancy could not be reproduced even if we run a new set of simulations with perturbed physics because the choice of the physics perturbation would be arbitrary. The main objective of our cross-validation, however, is to determine which parts of the bias can or cannot be corrected by retraining with only seven shots, and our synthetic data are adequate for this task.

|                                  |         |     |     |           |     |     |     |
|:---------------------------------|:--------|:----|:----|:----------|:----|:----|:----|
| **Input parameter**              | Nominal |     |     | Perturbed |     |     |     |
|                                  | model   |     |     | value     |     |     |     |
| Drive asymmetry mode 2,0, time 1 | 0%      |     |     | -5%       |     |     |     |
| Preheat                          | 5       |     |     | 20        |     |     |     |
| Scale                            | 1       |     |     | 1         |     |     |     |
| Dopant fraction                  | 0.28%   |     |     | 0.28%     |     |     |     |

Parameterization of the nominal and perturbed synthetic data used in cross-validation.

We now have the two five-dimensional data sets, one of which we treat as the actual simulations, and the other one as the "experiments". To fit the simulation dataset, we trained a new, initial surrogate model using exactly the same procedure as in the case of the original, nine-dimensional data set described in Section . Figure shows the results of transfer learning of this new surrogate model to match the "experiments" from the other five-dimensional data set. Using only seven "experiments" for retraining, calibration successfully removed the bulk shift of the simulations with respect to the "experiments". There are no outliers among the calibrated predictions: every one of the 1,000 validation samples has moved approximately as much as its neighbors. It is also worth noting that the transfer learning correction worked not only in the region between the training samples (green circles) but everywhere inside the sampled region, where we run simulations. This indicates some extrapolation capability of the transfer learning method.

Other than the bulk shift, the simulation-trained predictions show appreciable scatter indicating that the response of each scalar to the perturbations in the asymmetry and preheat is complex and also depends on other inputs. This scatter could potentially be reduced by transfer learning had we (i) used many more than seven "experiments" for retraining, (ii) retrained the entire decoder and forward model, and (iii) applied the same hyperparameters as those used during the initial surrogate training. Instead, to make our cross-validation relevant, in the calibration we employed an identical strategy as in transfer learning with real experiments: we used only seven "experiments", retrained only the innermost layer of the decoder, and used regularization and only 100 iterations in the optimization. With such limited data, model capacity, and the number of training iterations, it is not surprising that transfer learning did not reduce the scatter in the predictions.

Calibration results for the images are shown in Figure . In contrast to the real experiments, we now see more variability in both the ground truth and predicted hot spots. Calibration modified the simulated images towards more prolate shapes, consistently with the ground truth images. This shift was successfully applied to hot spots of all shapes: prolate, round, and oblate. However, not all calibrated images have a prolate shape; whenever the target image was oblate, the calibrated model correctly preserved the oblate shape of the hot spot.

To extend the analysis of the images to all 1,000 validation samples, once again, we parameterized each image in terms of the radius, shape, and maximum image amplitude (Figure ). As before, we see that transfer learning systematically modified images towards more prolate shapes. For example, the initial model prediction with (0, 2, COS) = 25, indicating an oblate shape, changed after the calibration to about , indicating a prolate shape, consistently with the target "experiment". Calibration of this mode was extremely successful lifting the $R^2$ metric from a negative value to 0.9. It is remarkable that using a pixel-wise L2 metric in the optimization, transfer learning was able to correct a non-pixel characteristics of an image with such great accuracy.

Systematic biases in the predictions of the radius and maximum image amplitude were also dramatically suppressed by the calibration, although the residual scatter appears to be slightly larger than in the scalar outputs. Reconstruction of the amplitudes may be hampered by the fact that we removed mean amplitudes from all images while image amplitudes are physically related to some scalars, as described in Section . To compensate for this inconsistency, transfer learning might have changed the radius as well.

Overall, cross-validation with the synthetic data confirmed that using just seven "experiments", it is possible to retrain the surrogate and remove the bulk shift between simulations and experiments for both scalar and image data.

# Designing simple calibration as a baseline for transfer learning

Once we have demonstrated that transfer learning systematically improves predictions of the simulation-trained model, it is natural to ask if a similar improvement could be achieved using a simpler calibration method. If the objective is to improve the predictions, do we really need to design a new surrogate model? Perhaps the correction in the outputs could be determined independently of the inputs.

Such an approach was successfully applied by to ICF experiments at the Omega laser facility at the University of Rochester. Our data, measured at NIF, however, are in many ways more challenging than the Omega data. Lasers at NIF have a lower repetition rate hence we have fewer shots available for the calibration. Predictions at NIF are also more difficult in that the high-resolution capsule simulation captures only a part of the experiment, and the inference of the unsimulated first part of the experiment adds uncertainty to the simulation inputs. There is no such uncertainty at Omega, where the lasers shine directly at the target capsule target. Finally, we attempt to calibrate multi-modal data, while calibrated only the scalars. Our results cannot therefore be easily compared against those described in . Subsequently to our work, an attempt to circumvent some of the aforementioned challenges has been made by calibrating scalar outputs from low-fidelity simulations that capture the entire NIF experiment . Expanding that workflow to multi-modal data could be a natural extension of that research but would require a significant effort.

In this paper, to formulate a baseline for transfer learning, we design a simple output calibration method:

$$\label{eq:linear}
y' _{EXP} = L (y'_{SIM}).$$

In this equation $L$ stands for a linear mapping between simulated and experimental outputs. Since we have fewer than 10 experiments available to determine $L$, we do not even consider a non-linear mapping. With so few training samples, we also cannot determine this mapping for raw outputs consisting of 10 scalars and 60x60 pixels; this would require determination of an overwhelming number of coefficients. Instead, equation incorporates $y'$: a compressed version of the outputs $y$ computed as:

$$\label{eq:compress}
y\prime = T(y),$$

with

$$\label{eq:compress2}
T = PCA_{all}  [PCA_{img}(y_{image}), y_{scalars}],$$

where $PCA$ stands for the matrix of coefficients determined by the principal component analysis, or, in other words, the first $k$ eigenvectors of the covariance matrix $yy^T$ with $k$ indicating the size of the representation after compression. Equation means that images are first compressed using $PCA_{img}$ to a small number of principal components. This prevents assigning unreasonably high weight to the images relative to scalars in the subsequent regression. Magnitudes of these components are also normalized to be in the same range as scalars. The final compression $PCA_{all}$ gives an option to further reduce the number of components as an attempt to ensure that the linear regression $L$ is not ill-conditioned. The operator $T$ is estimated from over 90,000 simulated outputs, and then applied to compress the experimental data as well. Coefficients of the linear mapping $L$ are determined by comparing the compressed seven training experiments $y'_{EXP}$ with the compressed predictions $y'_{SIM}$ of the simulation-trained surrogate.

We carried out extensive hyperparameter testing to find the optimal number of the $PCA_{all}$ components, $PCA_{img}$ components, the strength of the standard L2 regularization, and at which steps the normalization is beneficial. It turns out that using $PCA_{all}$ with fewer then 10 components does not allow us to calibrate even the training samples. In such case, the linear model simply does not have enough capacity to represent all outputs because there is not enough linear correlation between different outputs to allow efficient compression.

We obtained the best simple calibration results by compressing the images using four principal components and then concatenating them with the ten scalars without further compression $PCA_{all}$. The simple calibration model is, however, expected to generalize less well than the transfer learned model for two reasons. First, the transformation $L$ is linear, while transfer learning can capture nonlinear transformations. Second, unlike transfer learning, the simple calibration ignores the relationship of the outputs with the inputs, and relies on an arbitrary regularization.

This expectation is confirmed in Figure . Here, the setup is slightly different than in Section in that each of the 10 shots is predicted only 15 times (instead of 500) by randomly selected seven shots. Not only are the predictions of the simple calibration much worse than the transfer learned predictions but the simple calibration predictions are worse than the predictions of the initial model for eight out of 10 scalars, sometimes by a large margin. Transfer learning, on the other hand, improved the initial predictions for the majority of the scalar outputs.

To investigate whether simple calibration could be improved by bootstrap aggregation, we averaged out the 15 predictions for each holdout shots and plotted the means in Figure . Many poorly predicted outliers were eliminated by this process but simple calibration still degraded the fit of the simulation-trained model for seven out of 10 scalars.

As a side note, in Figures and we switched from using a $\chi^2$ metric in the transfer learning optimization to the simple $L2$ minimization but the $\chi^2$ metric is still used to evaluate the predictions. Regardless of this change, transfer learning still improved the fit for the majority of the scalars. It is interesting, however, to explain the degradation in the fit for one of the scalars: the DT_YIELD. The prediction error of the simulation-trained model for DT_YIELD is so small compared to other scalars, that the $L2$ optimization, targeting mainly the large errors, allowed for some degradation in the fit of DT_YIELD. In Section , however, when $\chi^2$ was used to measure the goodness of fit, the relatively small measurement error of DT_YIELD gave this scalar a higher weight in the optimization leading to the improved predictions.

For X-ray images, to enable a direct comparison of simple calibration with the transfer learning results in Figure , we computed 500 simple calibration models by randomly splitting the 10 experiments into 7 training and 3 validations shots. The results are shown in Figure . Simple calibration moved the predictions of the three image characteristics towards the experimental values but the spread of the predictions in much larger than in transfer learning predictions. In particular, many of the radius predictions are worse than the predictions of the initial model.

In summary, the simple output calibration degraded predictions of the simulation-trained model for the majority of the scalars, and introduced a large uncertainty in the predictions of the images.

# Conclusions and future work

We have designed a transfer learning method for a complicated regression problem: a calibration of the simulation-trained multi-modal surrogate model against very few experiments. For the first time, we included multiple output data types in the calibration and demonstrated a successful application using only seven ICF experiments to train the model. Transfer learning systematically improved predictions of the simulation-trained surrogate for both real and synthetic validation data; the latter were carefully designed to mimic the simulation bias. Such improvement was not possible with a simple calibration of the outputs (a method we have designed as a baseline), which ignores the experimental inputs. This suggests that the relationship between inputs and outputs that is learned from the simulations, and leveraged by transfer learning, may help to regularize the underdetermined calibration problem.

Extending the transfer learning code to work with an arbitrary set of modalities may not be trivial. New types of data will likely require new, specialized architectures of the autoencoder. The idea of retraining the decoder may, however, can be reused in other architectures.

Future work may involve the integration of transfer learning with the Bayesian estimation of model parameters  to match the experimental outputs as consistently with the simulation code as possible. Recent advances in calibrating uncertainty estimates  could also be incorporated in transfer learned models. Finally, experimenting with the cutting-edge methods of transfer learning could potentially further improve the generalization of the calibrated models.

# Acknowledgments

We thank Art Pak and Benjamin Bachmann for help with experimental images, and Kelli Humbird and Luc Peterson for discussions about transfer learning. The authors appreciate comments from an anonymous reviewers, which were helpful in improving the manuscript.

This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344 and was supported by the LLNL-LDRD Program under Project No. 18-SI-002. Released as LLNL-JRNL-829622. This document was prepared as an account of work sponsored by an agency of the United States government. Neither the United States government nor Lawrence Livermore National Security, LLC, nor any of their employees makes any warranty, expressed or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States government or Lawrence Livermore National Security, LLC. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States government or Lawrence Livermore National Security, LLC, and shall not be used for advertising or product endorsement purposes.


abstract: Oxygen is released to living tissues via conformational changes of hemoglobin from R-state (oxyhemoglobin) to T-state (desoxyhemoglobin). The detailed mechanism of this process is not yet fully understood. We have carried out micromechanical experiments on oxyhemoglobin crystals to determine the behavior of the Young's modulus and the internal friction for temperatures between 20 C and 70 C. We have found that around 49 C oxyhemoglobin crystal samples undergo a sudden and strong increase of their Young's modulus, accompanied by a sudden decrease of the internal friction. This sudden mechanical change (proteinquake) takes place in a partially unfolded state and precedes the full denaturation transition at higher temperatures. The hemoglobin crystals after the proteinquake has the same mechanical properies as the initial state at room temperatures. We conjecture that it can be relevant for explaining the oxygen-releasing function of native oxyhemoglobin when the temperature is increased, e.g. due to active sport. The effect is specific for the quaternary structure of hemoglobin, and is absent for myoglobin with only one peptide sequence.
author: S. G. Gevorkian$^{1,3}$, A.E. Allahverdyan$^{2,3}$, D.S. Gevorgyan$^{4}$, Chin-Kun Hu$^{1}$[^1]
date: 2024-10-03
title: Thermal-induced proteinquake in oxyhemoglobin

Since its discovery in 1840, the hemoglobin is one of the most extensively studied proteins . This is related to its important physiological function: it carries oxygen from the lungs throughout the body allowing us to breathe and live. It consists of four globular units linked into a double-dimer tetrameric structure as shown schematically in Fig. 1. Each unit can carry one oxygen molecule ${\rm O_2}$ attached to its heme group. The hemoglobin structure is adapted to the needs of its function. First, its oxygen binding is cooperative: the response of hemoglobin with respect to ${\rm O_2}$ concentration has a S-shaped region, thereby a relatively slight decrease of the oxygen concentration between the lungs and the body brings in a significant decrease of the bound oxygen (up to 25%) . Second, the oxygen binding ability decreases upon reducing the pH factor or increasing the concentration of ${\rm CO}_2$ . Due to this Bohr's effect a tissue with a stronger need of oxygen receives it more. Cooperative oxygen unbinding of hemoglobin is explained by the change of its tetrameric conformational structure induced by binding of the first oxygen molecule ; see Fig. . The conformational states with (R-state or oxyhemoglobin) and without (T-state or desoxyhemoglobin) the four oxygen molecules are clearly distinguishable by their shape, as seen via X-ray crystallography . *In vivo* those states are more like dynamic ensembles than fixed conformations .

Many aspects of hemoglobin are well understood by now . However, the physics of conformational changes and their interaction with external factors (pressure, oxygen concentration, temperature) is still under active scrutiny . In particular, this concerns the thermal response of hemoglobin that is traditionally studied via denaturation experiments. It is known that the multidomain hemoglobin does not unfold via a single transition . Rather, there is a wide transition zone $\simeq 40^\circ -
60^\circ$ C that includes several events . These events are typically interpreted via the concepts of unfolding and/or internal aggregation, two standard mechanisms normally applied for describing thermal responses of multi-subunit proteins .

Here we report results of micromechanical experiments carried out on crystals of horse and human hemoglobin. We show that in its partially unfolded state\|i.e. for a temperature higher than the physiological temperatures, but lower than the unfolding temperature\|the hemoglobin responds to heating by a sudden release of force and a subsequent jump of the Young's modulus, which is similar to proteinquake reported by Ansari et al. . The detailed structure of this effect is different for human and horse hemoglobin. We argue that the effect relates to certain slowly relaxing degrees of freedom of the quaternary structure that accumulate energy during heating and then suddenly release it at a well-defined temperature that is specific for hemoglobin.

Such an effect is absent in the thermal response of myoglobin. This is a single-unit globular protein that displays a visible transition towards a partially denaturated state around a certain unfolding temperature . Myoglobin also binds and unbinds oxygen, but does so without a sizable cooperativity. This relates to its function: myoglobin is a depot (not transporter) of oxygen in muscles. The difference between hemoglobin and myoglobin was also observed in heating and re-cooling data of Young's modulus for two systems to be reported below.

The proteinquake reported here for hemoglobin crystals has several predecessors in biopolymer physics. Ansari et al. found an indirect experimental evidence that the low-temperature ligand unbinding of myoglobin is modulated by a sudden release of energy accumulated due to the ligand binding . They proposed the term *proteinquake* for such effects. Later on, it was found computationally that proteinquakes are relevant for the functioning of myosin and adenylate kinase . More specifically for hemoglobin, it is known that when crystals of deoxyhemoglobin are exposed to oxygen, they shatter due to the force released during the conformational transition from deoxy to oxyhemoglobin . Postponing detailed connections with literature till the end of this paper, we stress already here that the presented report seems to be the first one, where a proteinquake effect was found under heating which is generally supposed to diminish mechanical features of biopolymers.

Note in this context that the advantage of using biopolymer crystals for measurement is that there is a possibility of controlling and displaying\|via intermolecular contacts regulated by the crystal syngony and the water content\|those motions of the macromolecule that can have only transient character in the solution . Almost all the basic information on the hemoglobin structure came from experiments on soild-state hemoglobins. Figure illustrates the structure of the hemoglobin crystal . The solid state hemoglobin is closer to its *in vivo* state in mammal erythrocytes, where the hemoglobin is densely packed with concentration $\simeq 34\%$ .

mm

We start with the denaturation curve of the human oxyhemoglobin at relative humidity $95\%$ as shown in Fig. . The Young's modulus $E$ is stable between $25^\circ$C and $36^\circ$C and then decreases in discrete steps. In between of each step $E$ is constant. We argue below that that these discrete steps are related to partial dissociation of the quaternary structure. The measured internal friction $\theta$ increases, because the structure breaking liberates new degrees of freedom that are able to dissipate the energy of forced oscillations; see Fig. .

But we could not perform the experiment for temperatures higher than $49^\circ$C, because (at the employed excitation frequency $\simeq 5$ kHz of the plate oscillations) the crystals clove to pieces. The measurement of $\theta$ had to be terminated even earlier due to instability of results; see Fig. . The same breaking effect at $49^\circ$ C was observed for crystals of horse hemoglobin prepared under the same relative humidity $95\%$. This effect indicates on conformational changes taking place in the hemoglobin macromolecule. Recall in this context that deoxyhemoglobin crystals shatter after exposure to oxygen, since they cannot support a large conformational change related to the transition from deoxy to oxyhemoglobin . The difference with our situation is that we work with oxyhemoglobin and that with us the crystals shatter after heating.

To understand this effect, we equilibrated our samples under a smaller relative humidity of $75\%$ at $25^\circ$ C. This was expected to prevent strong instabilities in the crystal , since inter-molecular contacts in the crystal get stronger due to less inter-molecular water (Fig. ). Figure displays the behavior of the Young's modulus for the human and horse hemoglobin under heating at relative humidity $75\%$. Note that compared to the $95\%$-humidity, the absolute value of the Young's modulus increased for about $8$ times; cf Fig.  with Fig. .

For temperatures from $20^\circ$ C till $49^\circ$ C the Young's modulus $E$ of the human hemoglobin decreases again in discrete steps. However, due to less inter-molecular water these steps are now shorter. Indeed, consider the temperature interval $25^\circ
-36^\circ$ C. For $95\%$-humidity $E$ is constant there \[see Fig. \], but for $75\%$-humidity it still makes one sudden change in this interval; see Fig. . Hence the inter-molecular water does stabilize the hemoglobin structure against dissociation, though it decreases the absolute value of $E$. For horse hemoglobin the decay of $E$ for temperatures from $20^\circ$ C till $49^\circ$C is more gradual, but the stepwise change is still visible; see Fig. .

But the temperature $49^\circ$ C is again a special one both for the human and horse hemoglobin; see Figs. , and . In its vicinity, the Young's modulus $E$ changes *abruptly*. We prescribe these effects to the quaternary structure of hemoglobin, since myoglobin which lacks this structure, but still has well-defined tertiary and secondary structure does not show this effect \[see Fig. and Fig. below\]. Thus, it is plausible that certain degrees of freedom of the quaternary structure have long relaxation times. During gradual heating, they go out of equilibrium, accumulate energy in elastic deformations and then suddenly release this strain energy at $49^\circ$ C (proteinquake).

The abrupt change of the Young's modulus for relative humidity $75\%$ is clearly the same effect that is responsible for breaking the crystals at a larger relative humidity $95\%$, where inter-molecular contacts are weaker \[see **1**\]. However, for the human hemoglobin $E$ abruptly *decreases* at $49^\circ$ C, while for the horse hemoglobin it abruptly *increases*. We see that the precise type of the mechanical event\|i.e., whether its Young's modulus increases or decreases\|depends on the type of hemoglobin (human or horse), but the temperature of the event is to a larger extent independent of the type, as Fig.  shows \[we come back to this difference in **4**\]. It is also independent from the relative humidity, in contrast to the absolute value of $E$ and the pattern of its change.

Figure  presents the behavior of both $\theta$ and $E$ for the horse hemoglobin. It is seen that in the immediate vicinity of $49^\circ$ C, $\theta$ abruptly decreases basically to the value it had at $\simeq 35^\circ$ C. This indicates that the degrees of freedom liberated during the previous melting stage get blocked again.

The evolution of $E$ and $\theta$ under heating with temperatures higher than $50^\circ$ C is different: $\theta$ starts to grow again indicating a new trend in structure breaking; see Fig. . But $E$ gradually increases for both human and horse hemoglobin; see Fig. . We interpret this effect via the intra-tetrameric aggregation of partially denaturated monomers of hemoglobin, because such increase of $E$ is absent for the monomeric myoglobin; see Fig.  below.

It is impossible to prescribe the event at $49^\circ$ C to the aggregation *only*, because the changes of $E$ and $\theta$ take place within a too narrow temperature interval. We also cannot prescribe this effect to unfolding, since the decreasing $\theta$ indicates on ordering (rather than disordering) of certain degrees of freedom. Apparently, the only possibility left is that the event at $49^\circ$ C indicates on the transition of the partially denaturated tetramer from the R-state to another conformational state with different visco-elastic features.

Figure  displays the heating-recooling dynamics of the human hemoglobin at relative humidity $95\%$ around $49^\circ$ C. The effect is irreversible, but the initial value of $E$ is roughly recovered for $30^\circ$ C, albeit the characteristic stepwise pattern of decreasing $E$ under heating is not seen during the recooling. This indicates that the discrete steps relate to dissociation of the hemoglobin quaternary structure, which (as compared to the tertiary and secondary structures) is expected to be the most fragile one. Figure  confirms that the event at $49^\circ$ C takes place in a partially unfolded state.

We now face a non-trivial situation: the event happens at the same temperature $49^\circ$ C for both horse and human hemoglobin. But, the behavior of the Young's modulus is very different: it suddenly increases for the horse hemoglobin (more rigid structure for higher temperatures), but decreases for human hemoglobin (less rigid). We repeated the experiment with several different samples, to be sure that the difference between human and horse hemoglobin is well reproduced.

It is well known that these two macromolecules differ by 20-25 acid residues on each hemoglobin unit . Due to such differences the horse hemoglobin has lower reactivity with respect to certain cofactors regulating oxygen binding .

We conjecture that these biochemical differences are reflected in the mechanical features of hemoglobin around $49^\circ$ C. The slow degrees that are responsible for the mechanical event at $49^\circ$ C are most probably the same for the horse and human hemoglobin, otherwise the temperature $49^\circ$ C could not be the same for both situations. But since the environments of these degrees of freedom in horse and human hemoglobin are different, we get a different overall response for horse and human situations.

For temperatures higher than $65^\circ$ C the Young's modulus for the hemoglobin crystals \[both for human and horse\] abruptly decreases again (not shown on figures) indicating on its full denaturation. For such high temperatures we expect that even the secondary structure of the macromolecule is broken. Our experimental samples became unstable for temperatures higher than $70^\circ$ C, so that no reliable data could be extracted.

To gain more evidence on whether the described effect is specific for the tetrameric structure of hemoglobin, we performed the same experiment with the myoglobin crystals and showed the result in Fig. . Upon heating, the Young's modulus $E$ of the myoglobin decreases *gradually*, without discrete steps. This is consistent with breaking the tertiary structure of the myoglobin towards acquiring a more labile state. This also confirms that the discrete steps seen in Figs. and relate to the dissociation of the quaternary structure, which is absent for myoglobin. Apart from relatively small non-monotonicity of $E$ around $57^\circ$ C, the behavior of $E$ is monotonic and reversible upon recooling. It is seen though that the reversibility is better visible for $T>57^\circ$ C than for lower temperatures, since for low temperatures $E$ is more influenced by the well-defined myoglobin tertiary structure, which is not completely recovered after recooling. It is known that the calorimetric experiments for myoglobin show a well-displayed transition to a partially denaturated (molten) state, where its tertiary structure is partially lost; see for further references. Depending on certain experimental conditions this happens around $60^\circ-80^\circ$ C . But the mechanical features of myoglobin do not change suddenly during this transition to the partially molten state. This corresponds to the behavior of the logarithmic decrement of damping for the myoglobin\|see Fig. – and is consistent with the gradual decrease of $E$ with temperature; see Fig. .

*Relations to previous work.* Several experimental studies carried out via various methods (calorimetry, optics) on liquid-state samples displayed that something peculiar happens with hemoglobin around $49^\circ$ C. . The authors of and prescribed the $49^\circ$ C event to the onset of aggregation. As we saw, this is correct, but essentially incomplete: the aggregation indeed starts around $49^\circ$ C, but there is certainly more there than simply aggregation. Artmann *et al.* found indications of conformational transitions (not reducible to aggregation) at $49^\circ$ C using optical methods on liquid state human hemoglobin . This is close to our results. They extensively studied hemoglobin of other species and noted that the event correlates with the physiological temperature and relates to the motion of erythrocytes (red blood cells) . They also suggested that the scenario of this conformational transition can be similar to the glass transition in polymers . Also this suggestion is confirmed by our results, because the peak of the internal friction around transition temperature \[see Fig. \] is a known indication of the glass transition, as was employed recently for detecting the glass transition in collagen ; see also in the context of glassy features of biopolymers.

Several decades ago it was conjectured that conformational changes related to biopolymer functioning proceed via mechanical motion of certain mesoscopic degrees of freedom . This *protein-machine* conjecture was taken up in , where certain aspects of the low-temperature kinetics of myoglobin were interpreted via proteinquakes: a sudden release of energy accumulated in elastic degrees of freedom. Later on, proteinquakes were found to be relevant for functioning of myosin and adenylate kinase . An important aspect of this research was that proteinquakes were connected to partial unfolding of the biopolymer tertiary structure . This agrees with our finding that the heating-induced proteinquake at $49^\circ$ C takes place in a partially unfolded state of hemoglobin.

Meanwhile the protein-machine conjecture was supported from another angle: not only the protein functioning resembles that of a machine, but also the performance of an optimal (high efficiency and a large power) heat engine\|as described by a generalized Carnot cycle\|has shown deep analogies with protein physics and the folding-unfolding transition .

mm

Our main message is that upon temperature elevation horse and human hemoglobins experience a conformational transition around $49^\circ$ C detectable via suddenly changing Young's modulus and decreasing internal friction. We argued that this is a mechanical event and that it cannot be traced back to denaturation and/or aggregation. The precise scenario of the event\|but not its temperature\|appears to be dependent on the type of hemoglobin. We conjectured that this difference relates to structural differences in the horse and human hemoglobin.

The message of our results for the hemoglobin functioning is that its mechanical features can be triggered by temperature *in addition* to other pertinent factors such as pH or oxygen concentration. In particular, our results can turn out to be relevant for understanding the process of oxygen release that in tissues which strongly need oxygen should take place much faster than the oxygen consumption in lungs. During the *in vitro* experiments we naturally do not see those additional factors and thus the temperature has to be larger than the physiological range for seeing the effect.

Note that the global temperatures $\geq 42^\circ$ C are lethal for humans and horses. However, the *local* temperature can easily go to values larger than $42^\circ$ C without causing any serious trouble for living tissues. A pertinent example is the hyperthermia treatment of cancer, where the local temperature goes to values larger than $45-48^\circ$ C without destroying healthy tissues. Note as well that the orientation of hemoglobin molecules in erythrocytes is not random (in that respect they are similar to protein crystals). First indications of this fact were obtained some 30 years ago, but were not widely disseminated in that time . More recently this fact was confirmed by several independent studies; see e.g. .

In conclusion, we reiterate that the main experimental result of this work\|proteinquake in heated hemoglobin\|can be interpreted as a sudden, temperature-controlled mechanic motion. The mechanic character of this motion is to be compared with the fact that certain features of proteins may well have glassy features. Recall that the glassy state is yet another (different from a mechanic motion) form of non-equilibrium that is characterized by slow relaxation and strong memory effects . By now there are many experimental and numerical indications of such a state in biopolymers . It should be interesting to carry out direct experiments and study in which specific way the glassy state in proteins coexists with the mechanic motion.

mm

Monoclinic crystals of horse and human hemoglobin were grown following the modified method of Drabkin . The solution contained $33$ mg/ml oxyhemoglobin, $1\%$ sodium oxalate, $0.9$ M potassium phosphate and had ${\rm
pH}=6.5$. It was poured on glass weighing cups, which were put inside the crystallization chamber. At the bottom of the chamber we poured a solution of $3\%$ sodium oxalate and $2.7$ M potassium phosphate (${\rm pH}=6.5$). Crystallization was processed under $4-6^\circ$ C for several months. The crystals came out as thin rhomboids with the length around $L=4$ mm, width $b=0.05$ mm and thickness $h=0.005$ mm (we stress that different crystal samples have slightly different values of $L$, $b$ and $h$, what are given here are the characteristic values). This form did not differ from that described in where the crystallization was processed in the presence of sodium oxalate and $\left ({\rm NH}_4
\right)_2{\rm SO}_4$. The obtained crystals can be utilized directly (without fixation) for our micromechanical experiments. A typical structure is shown in Fig. 2 . Monoclinic crystals of sperm-whale myoglobin were grown following the method of .

The dynamic Young's modulus $E$ and the logarithmic decrement of damping $\theta$ for hemoglobin and myoglobin crystals were studied via the method described in . The method is based on analyzing electrically induced transverse mechanical oscillations of the plate which is fixed by a cantilever. The dynamic Young's modulus measures the elasticity degree. To measure $E$, one changes smoothly the frequency $f$ of the induced oscillations to determine experimentally the basic resonance frequency $f_0$, which corresponds to the maximal oscillation amplitude of plate's loose end. The Young's modulus for the long axial direction of the plate is given as $$E=3.19\,\frac{f_0^2L^4\rho S}{I},$$ where $L$ is the length of sample, $S=bh$ is the cross-section area of the plate, $\rho$ is its density, and $I={b h^3}/{12}$ is the main inertia moment of the plate.

The logarithmic decrement of damping $\theta$ is used as a measure of the internal friction, and is defined as $\theta=\ln[{A(t)}/{A(t+T)}]$, where $A(t)$ is the oscillation amplitude in time $t$, and $T$ is the period. $\theta$ is measurable by two related methods. One can measure the length of the resonance curve and calculate $\theta$ according to: $\theta={\pi\Delta f}/{f_0}$, where $\Delta f$ is the difference of frequencies between the oscillation amplitude at the maximum amplitude and $\sqrt{2}$ times less than the maximum. A more precise determination method amounts to measuring the phase shifts between the oscillations of exciting force and the sample loose end .

mm

[^1]: E-mail: firstname.lastname@example.com.