From Quantity to Quality: Massive Molecular
Dynamics Simulation of Nanostructures under Plastic
Deformation in Desktop and Service Grid Distributed
Computing Infrastructure
Olexander Gatsenko1 , Lev Bekenev1 , Evgen Pavlov2 , Yuri G. Gordienko1*

arXiv:1404.5764v1 [cs.CE] 23 Apr 2014

1

G.V.Kurdyumov Institute for Metal Physics, National Academy of Sciences of Ukraine, Kiev, Ukraine
2
Taras Shevchenko National University of Kiev, Kiev, Ukraine
*

gord@imp.kiev.ua

Abstract. The distributed computing infrastructure (DCI) on the basis of BOINC and EDGeS-bridge technologies
for high-performance distributed computing is used for porting the sequential molecular dynamics (MD) application
to its parallel version for DCI with Desktop Grids (DGs) and Service Grids (SGs). The actual metrics of the working
DG-SG DCI were measured, and the normal distribution of host performances, and signs of log-normal distributions
of other characteristics (CPUs, RAM, and HDD per host) were found. The practical feasibility and high efficiency
of the MD simulations on the basis of DG-SG DCI were demonstrated during the experiment with the massive
MD simulations for the large quantity of aluminum nanocrystals (∼ 102 -103 ). Statistical analysis (KolmogorovSmirnov test, moment analysis, and bootstrapping analysis) of the defect density distribution over the ensemble
of nanocrystals had shown that change of plastic deformation mode is followed by the qualitative change of defect
density distribution type over ensemble of nanocrystals. Some limitations (fluctuating performance, unpredictable
availability of resources, etc.) of the typical DG-SG DCI were outlined, and some advantages (high efficiency,
high speedup, and low cost) were demonstrated. Deploying on DG DCI allows to get new scientific quality from
the simulated quantity of numerous configurations by harnessing sufficient computational power to undertake MD
simulations in a wider range of physical parameters (configurations) in a much shorter timeframe.

Keywords
Distributed computing, desktop grid, service grid, speedup, molecular dynamics, materials science, nanocrystal, plastic deformation

1 Introduction
Search for new nanoscale functional devices is considered as “El Dorado” and stimulates “Gold Rush” in the modern
materials science. But controlled fabrication of nanoscale functional devices requires careful selection and tuning the
critical parameters (elements, interaction potentials, regimes of external influence, temperature, etc) of atomic selforganization in designed patterns and structures for nanoscale functional devices. That is why molecular dynamics
(MD) simulations of nanofabrication processes with physical parameter decomposition for parameter sweeping in a
brute force manner are very promising. Usually MD-simulations for realistic configurations take huge resources of
supercomputers with large shared memory and big number of CPUs. But the recent advances in computing hardware, algorithms, and infrastructures, especially in development of distributed computing infrastructures, allow us
to elaborate the efficient methods for solving these tasks without expensive scaling-up. For example, the distributed
computing model on the basis of the BOINC [21], XtremWeb-HEP [2], OurGrid [3], EDGeS [30] platforms for highperformance distributed computing becomes very popular due to feasibility to use donated computing resources of
idle PCs and integration with global computing grid. The main aims of the work are as follows:

• to analyze the actual metrics of the working DG-SG DCI for the better understanding of the nominal and
available computing resources and better planning the large scale MD simulations in the variable DCI,
• to demonstrate the practical feasibility and high efficiency of the MD simulations on the basis of DG-SG DCI.

2 Distributed computing infrastructure
Many sequential applications by slight modifications in its code could to be ported to the parallel version for worker
nodes of a distributed computing environment (DCI) as Desktop Grid (DG) by means of the BOINC software
platform and availability of simple and intuitive Distributed Computing Application Programming Interface (DCAPI) [21]. For this purpose the very popular non-commercial open-source package LAMMPS by Sandia Labs [25]
(http://lammps.sandia.gov) was selected as a candidate for porting to DG DCI as the DG-enabled application
LAMMPSoverDCI (Fig. 1) (the details of such porting were given recently in [1]). The typical simulation of the

Figure 1. The general scheme of porting LAMMPSoverDCI application to DG-SG
DCI for massive MD simulations with job distribution by SZTAKI DG approach [21].

investigated nanostructure under 1 configuration of physical parameters — for instance, metal single crystal with 107
atoms with embedded atom potentials for 1-10 picoseconds of the simulated physical process — takes approximately
1-7 days on a single modern CPU. But by means of the new technology of high-performance computations (HPC)
on the basis of DG-SG DCI the massive MD simulations of plastic deformation processes can be carried out for the
large quantity of Al nanocrystals (102 -103 ). These MD simulations were conducted in several powerful computing
environments: in the created DG-SG DCI SLinCA@Home (http://dg.imp.kiev.ua), which is the most powerful
scientific DCI in Ukraine [6], and with involvement of computational resources of the European SG of the European
Grid Initiative (EGI) by means of EDGeS-Bridge technology [30]. Deploying LAMMPSoverDCI application to
this DG-SG DCI potentially allows to utilize thousands of machines (Fig. 2) for simulations of numerous initial
configurations at the same time, but the actual performance can be very variable due to unstable availability of
distributed resources.

3 Results of MD computer simulations in the context of computer science
The quantitative analysis of the available and actually used resources in DG-SG DCI SLinCA@Home was carried
out to estimate feasibility of DG-SG DCI for MD simulations in materials science. Its general characteristics were
calculated for the typical usage during the MD-simulations of plastic deformation of many nanocrystals.

Figure 2. DG-SG DCI SLinCA@Home used for massive MD simulations in the context
of the available HPC approaches (adaptation of the original figure by courtesy of Fermin
Serrano).

3.1 The nominal and actual characteristics of the DG-SG DCI
The whole number of the registered hosts in the DG-SG DCI used for MD simulations was 4161 at the moment of
writing this paper, including 649 hosts actually worked for all (more than 30 versions) applications installed in the
DG-SG DCI, and 189 hosts used for the LAMMPS-application in the current example, which is described below.
It should be emphasized that the actual characteristics of DG-SG DCI are not uniform like in a cluster or
Service Grid infrastructure. Like any other DCI with variable resources, the computing performance of DG-SG
DCI SLinCA@Home cannot be constant, but fluctuates with time depending on the current state of the donated
resources: some hosts can be inactive or unplugged, and, in contrary, some strong hosts can be attached or started
unpredictably. Some long jobs can be obtained by hosts and returned much later that they were finished actually.
That is why, the high nominal characteristics of the such DCI, like many projects in volunteer computing niche,
should not be overestimated and their actual averaged performance should be estimated for the better planning the
massive simulations with many long jobs.
DG-SG DCI SLinCA@Home demonstrates the wide variety of the numbers of CPUs, for example, from 1 CPU
in the usual domestic PCs to 128 CPUs in the Service Grid connected to DG-SG DCI SLinCA@Home. To estimate
its registered and actual potential the analysis of the nominal (registered hosts) and actually used (worked hosts)
computing resources was carried out on the basis of the data queries to the DCI database (mysql) with the history
of calculations for the selected LAMMPS-application. The distribution of the host performances in floating point
operations per second (FLOPs) is very wide also and can be approximated by the normal distribution (Fig. 3,left).
The number of CPUs per host (Fig. 3,right) does not follow the normal distribution and can be better approximated
by log-normal distribution for the low numbers of CPUs. The straight lines of the cumulative distribution function
in linear-probabilistic coordinates in the top part (Fig. 3,left) and logarithmic-probabilistic coordinates in the top
part (Fig. 3,right) give the visual evidences for these approximations.
The first assumption as to the normal distribution of the host performances (in FLOPs) can be explained by the
additive growth of the CPU frequency in the modern machines. The stochastic attachment/detachment of the hosts
to the DG-SG DCI can be described by evolution with diffusive law that gives rise to the normal distribution. The
more detail investigation of such aggregation kinetics in the more general case was given elsewhere [10]. The last
assumption as to the log-normal distribution of the number of CPUs per host can be explained by the multiplicative
growth (with the binary multiplicator) of the number of cores in the modern machines (going mostly in the sequence
1, 2, 4, 8, ... with rare exceptions, like 6 or 12 cores). That is why, the stochastic attachment/detachment of the
hosts to the DG-SG DCI can be described by evolution with Gibrat’s rule of proportionate (multiplicative) growth
that gives rise to the log-normal distribution [7]. The more detail investigation of these properties of the computing
resources in the typical DG-SG DCI will be given elsewhere [11].

Figure 3. Distribution of performances in floating point operations per second
(FLOPs) in linear-probabilistic coordinates (left) and the number of CPUs per host
in the logarithmic-probabilistic coordinates (right) among the registered hosts (black),
the worked hosts (red), and the hosts used for LAMMPS-application (green).

The similar considerations can be applied for the distributions of the sizes of random-access memory (RAM)
(Fig. 4,left) and sizes of hard disk drives (HDD) (Fig. 4,right), those do not follow the normal distribution and can
be better approximated by log-normal distribution for the not very big values of RAM and HDD sizes (the left
tails and central parts of these distributions). The bad approximation for the big values of RAM and HDD sizes
(the right tails of these distributions) can be explained by the attachment of the big SG-hosts or clusters, which
performances (FLOPs, CPUs, RAM, HDD) evolve not stochastically, but abnormally fast and deterministically (by
the strategic plans of their corporative owners).
It should be noted that the more strict statistic methods for estimation of relation of these empirical distributions
to the proposed distributions (normal and log-normal) will be necessary, but it is not possible at this stage, because
of the discrete nature of the available values of some parameters. For example, the number of CPUs per host can
have only the limited set of values (1, 2, 4, 6, 8, 16, 32, 48, 64, 128) and the number of hosts with more than 8
CPUs is very limited (that creates the long right tail of the distribution). This observation is applicable for RAM
and HDD distributions also (Fig. 4). The additional aspect is that the set of hosts (the worked hosts and the hosts
used for LAMMPS) is artificially limited by each type of application to have enough computing resources to run
the task (the certain type of jobs), and these limitations are different for different tasks. That is why the different
and varying with time subsets of all hosts were used and analyzed in the experiment.
Nevertheless, some averaged values for the nominal and actual characteristics of hosts in DG-SG DCI
SLinCA@Home (the mean values with their standard deviations) for the three sets of hosts (registered, worked,
and used in the experiment with LAMMPS application) can be estimated and they are given in the Table 1. The
growth of the mean values for the subsets of hosts “Worked” and “Used in LAMMPS” is explained by several
limitations (namely, by the minimal RAM and job runtime) imposed on the different tasks. It should be noted
that the standard deviation values for all parameters (except for FLOPs) are higher than their mean values, that
is typical for asymmetric long-tailed distributions like log-normal ones.

Figure 4. Distribution of the RAM sizes (left) and HDD sizes (right) for the registered
hosts (black), the worked hosts (red), and the hosts used for LAMMPS-application
(green).

Table 1. The averaged values (i.e. mean±standard deviation) of the nominal and
actual characteristics of hosts in DG-SG DCI SLinCA@Home.

Registered
Worked
Used in LAMMPS

CPUs per host
4.30 ± 4.95
5.3 ± 6.5
6.7 ± 10

GFLOPs
2.25 ± 0.76
2.3 ± 0.7
2.3 ± 0.7

RAM (GB)
6.68 ± 12.15
10 ± 18
16 ± 22

HDD (GB)
257 ± 371
220 ± 310
210 ± 320

3.2 Investigation of the actual efficiency of DG-SG DCI
In addition to the nominal and actual characteristics, the typical average efficiency was estimated in the 1 week
experiment during MD-simulations of metal nanocrystals under plastic deformation. The names of tasks (types of
jobs), the job runtime (Tjob ) on the moderate PC (1 Intel CPU, 2.7 GHz, 2514 MFLOPs, 4GB RAM), the number
of jobs (Njob ), the time needed for sequential execution of all jobs on this CPU (Tseq ), the actual total time of
parallel execution (Tdg ) for each task (type of the jobs), and speedup Tseq /Tdg (i.e. the ratio of the total runtime in
sequential and distributed modes) are given in the Table 2. For example, for the task “S=16x16x16, V=1” (where
Tjob = 00h 150 ) it takes Tseq ≈ 3.5 days to calculate 210 jobs sequentially on the moderate PC used as the single
client. But it takes Tdg ≈ 0.3 days only to calculate them in parallel in DG, if the same moderate PC used as the
DG-server and without any investments in additional hardware and its support. The following notations were used
for the names of jobs: S — the size of the simulated nanocrystal in the lattice spacings (1 spacing for aluminum =
0.4049 nm), and V — the strain rate (in spacings per second). It should be noted that the subtotal value in column
Tdg was estimated as the maximal value for this column (because all tasks were performed in parallel), and the
total value — as the sum of the subtotal and the last task “S=16x16x16, V=0.25” that was executed separately.
The actual computing rate of these jobs is shown in Fig. 5, where the 3 distinctive regimes can be found:
• “the initial stage”, when the jobs are mainly distributed among hosts, the number of in-work jobs increases,
and the small number of results can be obtained by the master-side;

Table 2. The comparison table for sequential and parallel execution of jobs in the
experiment with massive MD simulations of metal nanocrystals.
Task (type of job)

Tjob
Njob
Tseq
Tdg
Speedup,
(hours:minutes)
(days) (days) Tseq /Tdg
Simultaneously executed tasks (all DCI resources are shared among all tasks)
S=16x16x16, V=1
00h : 150
210
3.5
0.3
12.1
h
0
S=16x16x16, V=0.5
00 : 41
419
11.6
6.0
1.9
S=16x32x16, V=2
00h : 200
750
10.4
3.0
3.5
S=16x128x16, V=1
03h : 300
308
44.9
5.0
9.0
h
0
S=32x32x32, V=1
03 : 30
329
48.0
4.3
11.3
S=32x64x32, V=4
01h : 380
394
27.6
6.4
4.3
h
0
S=64x16x64, V=1
06 : 38
449
125.0
4.0
31.2
Subtotal
2859
271.1
6.4
42.3
Separately executed task (all DCI resources are dedicated to the single task)
S=16x16x16, V=0.25
4 hours
501
83.5
1.9
43.9
TOTAL
3360 354.5
8.3
42.7
• “the active stage”, when the number of the finished jobs grows and the effective speedup increases;
• “the final stage”, when no new jobs distributed, the number of the in-work jobs decreases, and the effective
speedup decreases.
In addition, the everyday (and every hour even) stochastic behavior of plugged/unplugged hosts create the fluctuating behavior of all performance parameters. That is why the actual speedup is not constant value and can
change in the course of the experiment and can be different for the different types of jobs with various demands to
the computing resources (Fig. 6). In addition, the several types of jobs those were started simultaneously or with
overlapping in the time must compete for the available resources (hosts) and that is why their effective speedups can
decrease significantly. Nevertheless, if the number of available resources is higher than the number of the distributed
jobs, than the actual speedup (during “the active stage”) will tend to be closer to the theoretical value. Indeed,
the speedup curves (Fig. 6) during “the active stages” tend to be parallel to the theoretical level (dash line), i.e.
the actual speedup increase with the scaled-up number of jobs is nearly equal to the theoretical limit. It is especially evident for the highest (olive) curve for the type of jobs “S=16x16x16, V=0.25”, which was calculated alone
without any concurrency with other types of jobs. As a result, the practical feasibility and high efficiency of MD
simulations of metal nanocrystals on the basis of DG-SG DCI were demonstrated during this experiment. Finally,
it is shown that the total runtime can be decreased by more than 40 times, the whole cost of the similar hardware
(at least 189 hosts, i.e. the number of hosts necessary to get such speedup), and their costs of ownership (power
supply, support, operation, etc) can be decreased by more than 180 times. In addition, to these achievements, the
several important fundamental results were obtained, that can provide the way for the more effective ways of MD
simulations in material science and solid state physics.

4 Results of MD computer simulations in the context of materials science
From a physical point of view the work was motivated by the previous results [13, 12, 24] that single crystal aluminum
foil under the influence of compressed cyclic stretch revealed macro- and micro- scale evolution of crystalline defects
in bulk and on surface. Such defect evolution demonstrates several signs of self-similar geometry and self-organized
behavior [31, 8], that was analyzed by several idealized models [14, 17, 16, 15]. Unfortunately, such models are
very rough and do not take into account the peculiarities of interatomic interactions, especially in distorted crystal
lattices.
In this context, the following objectives were formulated for computer simulation:

Figure 5. The number of calculated jobs as a function of time in the parallel distributed
(DG) mode (symbols) and sequential (SEQ) mode (dash lines). The different types of
jobs are denoted by different symbols and dash lines in the legend. S means the sizes
of the simulated nanocrystal (in the lattice spacings), and V means the strain rate (in
spacings per second).

• to simulate several scenarios of plastic deformation in nanocrystals,
• to investigate defect accumulation kinetics and evolution of defect substructure;
• to find evidences of correlated behavior of individual defects and their complexes;
• to measure statistically such correlation in the ensemble of samples with defects.
MD simulations of defect substructures have been performed for several scenarios of the evolution of defect
substructure. The fast parallel computing algorithm [25] was used for MD simulations of interactions among
atoms in the crystalline state with interatomic potential by Jacobsen, Norskov, Puska (JNP-potential) [20] on
the basis of embedded atom method (EAM) for aluminum (Al). DG-enabled application LAMMPSoverDCI was
developed to adapt LAMMPS software package for DG-SG DCI [1]. The calculations were made for Al nanocrystals
with 105 -107 atoms that required the very large scale resources of the local institutional cluster with 72 CPUs
(pamela.imp.kiev.ua) in G.V.Kurdyumov Institute for Metal Physics, National Academy of Sciences of Ukraine
(IMP NASU), “Ukrainian Academic Grid” with > 103 CPUs, and DG-SG DCI SLinCA@Home with > 104 CPUs.

4.1 Qualitative Results — Single Nanocrystals
MD simulations of uniaxial monotonic tensile, analysis of defects behavior, and analysis of change of the mode of
plastic deformation in Al nanocrystals, were performed for two orientations: <011>{011} and <010>{010}, where
<011> and <010> denote the direction of the load, and {011} and {010} — planes of test machine grips. The
following figures contain snapshots of the atomic arrangement (with visualization of defects only), with exclusion of
atoms in fcc lattice and atoms at the ends, which were inside the test machine grips and for which the tensile was
performed. They are snapshots of the atom positions near crystalline defects (atoms displaced from the position
of the ideal fcc lattice), that were calculated by the defect determination method based on the common neighbor
analysis (CNA) [29]. Direction of tensile is from the center to the lower left corner and from the center to the
upper right corner, the rate of loading — 80 m/s, the number of atoms — 0.25 million. The dislocation cores are
presented in the form of gray atoms at the edge of the plane of atoms denoted by dark gray (red in the electronic
version) colors. Dislocation core is formed by the group of atoms with undefined lattice type, obtained by splitting
the total dislocation into two partial dislocations with the formation of stacking faults (SF) in the form of intrinsic
and extrinsic SFs, i.e. the planes of atoms in a hcp lattice denoted by dark gray (red in the electronic version)

Figure 6. The effective speedup (the ratio of the total runtime in sequential and
parallel distributed modes) for each type of job as a function of the jobs calculated
in the parallel distributed (DG) mode (symbols) in comparison with the theoretical
maximum (dash line). The different types of jobs are denoted by different symbols in
the legend. S means the sizes of the simulated nanocrystal (in the lattice spacings),
and V means the strain rate (in spacings per second).

colors. In addition, some randomly placed perturbations in the form of point-like defects (like atom-vacancy states)
can be observed in groups of 6 neighboring atoms (grey color).
For <010>{010} orientation (Fig.7) deformation is accompanied by a growing number of perturbations of the
atom-vacancy type, due to the impossibility of easy glide of dislocations due to the activation the four slip systems
with two directions of slip in each with large values of Schmid factor. (Note: This and other anaglyph stereo
figures give 3D visual representations of defect substructures, if anaglyph red-green glasses are used for viewing the
color electronic version of the paper.) For <011>{011} orientation (Fig. 8) many intersections of dislocations and
SFs are shown that prevent the further easy glide of dislocations. Further deformation takes place mostly due to
the restructuring of existing defect substructures by correlated displacement of large point-like defect clusters at
intersections of SFs and dislocations. Such behavior is the evidence of the beginning of intense plastic deformation
— collective (hydrodynamic) modes of deformation (the details can be found in [9]).

4.2 From Quantity to New Quality — Statistical Analysis for an Ensemble of
Nanocrystals
The results of MD simulations for plastic deformation of the big number of statistical realizations (i.e. many
samples with identical conditions of strain, but different initial random values of atomic velocities) were analyzed.
Distributions of some variables (stresses, concentrations of defects) were evaluated on the basis of the theory of
extreme values [19]. It corresponds to the view on the localized plastic deformation, as a critical process with
correlated behavior of some parts of the deformed crystal [26]. The localized plastic deformation can take place in
the areas linked by deformation events (“links” of the “chain” of localized strain), according to the model of “a chain
with a weak link”. In such case, the stress values and the defect concentrations for different statistical realizations
of the process (i.e. their distributions over an ensemble of different samples) should be characterized by the extreme
values distributions of I, II, or III type [27]. The aim of the original approach was to carry out MD simulations
of plastic deformation under the same conditions (except for the initial random configuration of atomic velocities)
for extra-large number of samples (from 400 to 1000 statistical realizations for different deformation conditions),
and to analyze parameter distributions over the ensemble of statistical realizations. In the context of the current

Figure 7. Tension of Al nanocrystal, strain ε = 7%, orientation <010>{010}. (It is
anaglyph stereo figure, please, see explanations in the text.)

Figure 8. Tension of Al nanocrystal, strain ε = 7%, orientation <011>{011}. (It is
anaglyph stereo figure, please, see explanations in the text.)

state of the MD simulation of plastic deformation, this approach is essentially new and has no analogues, and,
moreover, it requires very large computing resources. In Fig. 9 an example of the statistical distribution over the
statistical ensemble of 583 nanocrystals (Al single crystals with 1.5 · 105 atoms deformed with strain rate 200 m/s in
<010>{010} orientation) is shown for the concentration of atoms in atom-vacancy states with the unknown lattice
type (UNK) for ε = 20%. The results of fitting to Weibull distribution for ε = 20% (Fig. 9) give the visually good

Figure 9. Probability density distribution plots (“Density”), boxplots, experimental
cumulative density distribution plots (“ECDF”) fitted to Weibull distributions in QQplots and CDF plots for defect concentrations in atom-vacancy states (UNK) ε = 20%.

correspondence to Weibull distribution. Thus, due to these massive character of MD simulations (obtained by means
of the DG-SG DCI) reliability of distribution fitting was possible to estimate by Kolmogorov-Smirnov test (KS-test)
[23, 28]. The higher values of p-value in the KS-tests mean the higher probabilities of wrong rejection of the current
fitting hypothesis, i.e. the higher probability for the current hypothesis to be at least as extreme as the one that
was actually observed. But the p-value> 0.05 (the typical significance level) does not mean that the hypothesis is
absolutely true. Roughly speaking, the higher p-value for the hypothesis of the Weibull distribution, than for the
p-value for the hypothesis of the normal distribution, means the higher probability of wrong rejection of the former
hypothesis that the estimated distribution follows the Weibull distribution than the normal one. The results of the
KS-tests are shown in Fig. 10 for the distributions of concentrations of atoms in the hcp lattice (HCP), i.e. stacking
faults (SFs), and concentrations of atom-vacancy states with the unknown lattice type (UNK). At different stages of
deformation (for various values of ε) distribution of the concentrations for defects of both types can be classified by
normal or Weibull distribution, or cannot be distinguished (the details can be found in [9]). When distributions of
defect concentrations with off-center arrangement of the atoms (with an indefinite lattice type) (UNK) correspond
to the Weibull distribution, atom-vacancy states and their aggregations (see example in Fig.7) are assumed to be
correlated and linked by the “chain” of strain localization zones with a power-law distribution of the basic defect
concentration over the links in the chain, according to the theory of extremal values [19, 27].
The data of moment and bootstrapping analysis on the Pearson diagram [4, 5] (Fig. 11) confirm the qualitative results about change of the behavior of the defect substructure from the unrelated state (from the normal
distribution) to the correlated and linked one (to the zone of Weibull distributions), and about the change of the deformation mode: from uncorrelated motion of defects (the normal distribution of defect concentrations and stresses)
to correlated plastic flow (the zone of Weibull distributions). This indicates availability of the linked local zones
(parts of “chain”) in nanocrystals with hydrodynamic plastic flow that occurs as the collective motion of defects and
their aggregates (atom-vacancy states or SFs) in the weak link with the power law (scale-invariant or fractal) basic
distribution of the defect concentration over the links of the chain [19, 27]. As a result of this study, the change
of the plastic deformation mechanism was revealed in Al nanocrystals with <011>{011} and <010>{010} orientations under conditions of localized plastic deformation: from the uniform laminar flow (based on easy dislocation
slip) to the inhomogeneous localized (hydrodynamic) mechanism (based on the correlated movements of groups of

Figure 10. Kolmogorov-Smirnov test for distributions of defect concentrations: SFs
(HCP), atom-vacancy states (UNK).

Figure 11. Pearson diagram for moment and bootstrapping analysis for: defect
concentration distributions over the ensemble of nanocrystals for SFs (HCP), atomvacancy states (UNK), and for the normal stress values σtop at the atomic planes near
grips of the testing machine.

atoms, or highly excited atom-vacancy states), which is in good correlation with our previous experimental studies
[13, 18, 12].

5 Conclusions
By means of the new HPC technology on the basis of DG-SG DCI the massive MD simulations of plastic deformation
processes were carried out for the large quantity of Al nanocrystals (∼ 102 -103 ).
In the context of computer science, some limitations (fluctuating performance, unpredictable availability of
resources, etc.) of the typical DG-SG DCI are outlined, and some advantages (high efficiency, high speedup, and
low cost) are demonstrated. Some useful characteristics are given that provide the ways for estimation of the
actual metrics of the working DG-SG DCI, for example the normal distribution of host performances (in FLOPs),
and signs of log-normal distributions of some other characteristics (CPUs, RAM, and HDD per host) due to the
stochastic attachment/detachment of the hosts to the DG-SG DCI with their additive (normal distribution) and
multiplicative (log-normal distribution) growth. The practical feasibility and high efficiency of the MD simulations
on the basis of DG-SG DCI were demonstrated during the experiment with MD simulations of metal nanocrytstals.
Finally, it is shown that the total runtime can be decreased by more than 40 times, the whole cost of the similar
hardware, and their costs of ownership can be decreased by more than 180 times in the low-scale DG-SG DCI like
SLinCA@Home even. The previous estimations show that the big perspectives can be foreseen for combination
of the DCI with WS-PGRADE platform [22], that can hugely increase efficiency of scientific computations and
simplify complexities of high-performance computing workflows for ordinary material scientists without the special
background in computer science.
In the context of physics, the several important fundamental results were obtained, that can provide the way
for the more effective ways of MD simulations material science and solid state physics. As an example, the change
of plastic deformation mode was investigated under severe plastic strain: from homogeneous (laminar) mode (on
the basis of easy dislocation glide) to heterogeneous localized (hydrodynamic) mode (on the basis of correlated
displacement of groups of strongly excited atom-vacancy states). The statistical analysis (by Kolmogorov-Smirnov
test, moment analysis, and bootstrapping analysis) of the defect density distribution over the ensemble of nanocrystals had shown that such quantitative change of plastic deformation mode is followed by the qualitative change of
defect density distribution type over ensemble of nanocrystals. This suggests that some linked local zones (links
of chain according to the “chain with a weak link” model) of correlated (hydrodynamic) plastic flow appear in
a nanocrystal, which manifests as collective displacements of defects and their aggregates in a “weak link”, with
power-law (scale-invariant or fractal) basic distribution of defect density over links of the chain.

6 Acknowledgments
The work presented here was partially funded by EU FP7 DEGISCO (Desktop Grids for International Scientific
Collaboration) project, agreement no. RI-261561, EU FP7 SCI-BUS (SCIentific gateway Based User Support)
project, contract no. RI-283481; and partially supported in the framework of the research theme “Introduction and
Use of Grid Technology in Scientific Research of IMP NASU” under the State Targeted Scientific and Technical
Program to Implement Grid Technology in 2009-2013.

References
[1] Baskova O., Gatsenko O., Gordienko Y.:. Enabling high-performance distributed computing to e-science by
integration of 4th generation language environments with desktop grid architecture and convergence with global
computing grid. In Proc. of Cracow Grid Workshop (CGW’10), pages 234–243, Cracow, Poland, 2011.
[2] Cappello F., Djilali S., Fedak G., Herault T., Magniette F., Neri V., Lodygensky O.:. Computing on large-scale
distributed systems: Xtremweb architecture, programming models, security, tests and convergence with grid.
Future Generation Computer Systems, 21(3):417–437, 2005.
[3] Cirne W., Brasileiro F., Andrade N., Costa L., Andrade A., Novaes R., Mowbray M.:. Labs of the world,
unite!!! Journal of Grid Computing, 4(3):225–246, 2006.
[4] Cramer H.:. Mathematical methods of statistics, volume 9. Princeton Univ Pr, 1999.

[5] Cullen A., Frey H.:. Probabilistic techniques in exposure assessment: a handbook for dealing with variability
and uncertainty in models and inputs. Springer, 1999.
[6] Gatsenko O., Baskova O., Gordienko Y.:. Desktop grid computing in materials science lab - example of
development and execution of application for defect aggregation simulations. In Proc. of Cracow Grid Workshop
(CGW’09), pages 264—273, Cracow, Poland, 2010.
[7] Gibrat R.:. Les Inegalites economiques. Paris, France, 1931.
[8] Gordienko Y., Kuznetsov P., Zasimchuk E., Gontareva R., Schreiber J., Karbovsky V.:. Multiscale 2d rectangular and 3d rhombic gratings created by self-organization of crystal structure defects under constrained cyclic
deformation and fracture. Materials Science Forum, 567:421–424, 2008.
[9] Gordienko Y.:. Molecular dynamics simulation of defect substructure evolution and mechanisms of plastic
deformation in aluminum nanocrystals. Metallofizika i Noveishie Tekhnologii (in Ukrainian), 33(9):1217–1247,
2011.
[10] Gordienko Y.:. Generalized model of migration-driven aggregate growth-asymptotic distributions, power laws
and apparent fractality. Int. J. Mod. Phys. B, 26(1), 2012.
[11] Gordienko Y.:. Multiplicative and additive growth of computing resources in dictributed computing infrastructure on the basis of desktop and service grids. Journal of Grid Computing (to be submitted), 2012.
[12] Gordienko Y., Gontareva R., Schreiber J., Zasimchuk E., Zasimchuk I.:. Two-dimensional rectangular and
three-dimensional rhombic grids created by self-organization of random nanoextrusions. Advanced Engineering
Materials, 8(10):957–960, 2006.
[13] Gordienko Y., Zasimchuk E.:. Single-crystal indicators of fatigue and plastic deformation damage. Proceedings
of SPIE, 2361:312, 1994.
[14] Gordienko Y., Zasimchuk E.:. Synergetic model of structure formation during plastic deformation of crystals.
Philosophical Magazine A, 70(1):99–107, 1994.
[15] Gordienko Y., Zasimchuk E.:. Simulation of building one-and two-dimensional structures on many scales in
metals under load. Systems Analysis Modelling Simulation, 18:837–840, 1995.
[16] Gordienko Y., Zasimchuk E.:. Dynamical phase transition in a lattice gas model with aggregation and selforganization. Physica A: Statistical and Theoretical Physics, 229(3-4):540–551, 1996.
[17] Gordienko Y., Zasimchuk E.:. Metastable fractal aggregates as a result of competition between diffusion-limited
aggregation and dissociation. In Proc. of the 8th Joint EPS-APS Int. Conf. on Physics Computing: PC’96:
September 17-21, 1996, Kraków, Poland, page 293. Academic Computer Centre CYFRONET-KRAKÓW,
1996.
[18] Gordienko Y., Zasimchuk E., Gontareva R.:. Unconventional deformation modes and surface roughness evolution in al single crystals under restricted cyclic tension conditions. Journal of Materials Science Letters,
22(3):241–245, 2003.
[19] Gumbel E.:. Statistics of extremes. Dover Pubns, 2004.
[20] Jacobsen K., Norskov J., Puska M.:. Interatomic interactions in the effective-medium theory. Physical Review
B, 35(14):7423, 1987.
[21] Kacsuk P., Kovacs J., Farkas Z., Marosi A., Gombas G., Balaton Z.:. Sztaki desktop grid (szdg): a flexible and
scalable desktop grid system. Journal of Grid Computing, 7(4):439–461, 2009.
[22] Kacsuk P., Sipos G.:. Multi-grid, multi-user workflows in the p-grade grid portal. Journal of Grid Computing,
3(3):221–238, 2005.
[23] Kolmogorov A.:. Sulla determinazione empirica di una legge di distribuzione. Giornale dell’Istituto Italiano
degli Attuari, 4(1):83–91, 1933.
[24] Kuznetsov P., Petrakova I., Gordienko Y., Zasimchuk E., Karbovskii V.:. Formation of self-similar structures
on {100} 00l aluminum single-crystal foils under cyclic tension. Physical Mesomechanics, 12(1-2):85–93, 2009.

[25] Plimpton S.:. Fast parallel algorithms for short-range molecular dynamics. Journal of Computational Physics,
117(1):1–19, 1995.
[26] Rinaldi A., Peralta P., Friesen C., Sieradzki K.:. Sample-size effects in the yield behavior of nanocrystalline
nickel. Acta Materialia, 56(3):511–517, 2008.
[27] Rinne H.:. The Weibull distribution: a handbook. Chapman & Hall/CRC, 2009.
[28] Smirnov N.:. Table for estimating the goodness of fit of empirical distributions. The Annals of Mathematical
Statistics, 19(2):279–281, 1948.
[29] Tsuzuki H., Branicio P., Rino J.:. Structural characterization of deformed crystals by analysis of common
atomic neighborhood. Computer physics communications, 177(6):518–523, 2007.
[30] Urbah E., Kacsuk P., Farkas Z., Fedak G., Kecskemeti G., Lodygensky O., Marosi A., Balaton Z., Caillat G.,
Gombas G., others.:. Edges: bridging egee to boinc and xtremweb. Journal of Grid Computing, 7(3):335–354,
2009.
[31] Zasimchuk E., Gordienko Y., Gontareva R., Zasimchuk I.:. Equidimensional fractal maps for indirect estimation
of deformation damage in nonuniform aircraft alloys. J. Mater. Eng. Perf., 12(1):68–76, 2003.

