text:
Smoothing methods have been developed to improve the reliability of risk cancer estimates from sparsely populated geographical entities. Filtering local details of the spatial variation of the risk leads however to the detection of larger clusters of low or high cancer risk while most spatial outliers are filtered out. Static maps of risk estimates and the associated prediction variance also fail to depict the uncertainty attached to the spatial distribution of risk values and does not allow its propagation through local cluster analysis. This paper presents a geostatistical methodology to generate multiple realizations of the spatial distribution of risk values. These maps are then fed into spatial operators, such as in local cluster analysis, allowing one to assess how risk spatial uncertainty translates into uncertainty about the location of spatial clusters and outliers. This novel approach is applied to age-adjusted breast and pancreatic cancer mortality rates recorded for white females in 295 US counties of the Northeast (1970–1994). A public-domain executable with example datasets is provided.
Geostatistical simulation generates risk maps that are more variable than the smooth risk map estimated by Poisson kriging and reproduce better the spatial pattern captured by the risk semivariogram model. Local cluster analysis of the set of simulated risk maps leads to a clear visualization of the lower reliability of the classification obtained for pancreatic cancer versus breast cancer: only a few counties in the large cluster of low risk detected in West Virginia and Southern Pennsylvania are significant over 90% of all simulations. On the other hand, the cluster of high breast cancer mortality in Niagara county, detected after application of Poisson kriging, appears on 60% of simulated risk maps. Sensitivity analysis shows that 500 realizations are needed to achieve a stable classification for pancreatic cancer, while convergence is reached for less than 300 realizations for breast cancer.
The approach presented in this paper enables researchers to generate a set of simulated risk maps that are more realistic than a single map of smoothed mortality rates and allow the propagation of cancer risk uncertainty through local cluster analysis. Coupled with visualization and querying capabilities of geographical information systems, animated display of realizations can highlight areas that depart consistently from the general behavior observed across the region, guiding further investigation and control activities.
Cancer mortality maps are used by public health officials to identify areas of excess and to guide surveillance and control activities. Quality of decision-making thus relies on an accurate quantification of risks from observed rates which can be very unreliable when computed from sparsely populated geographical entities or for diseases with a low frequency of occurrence [1]. Smoothing methods have been developed to improve the reliability of these estimates by borrowing information from neighboring entities [2,3]. These methods range from simple deterministic techniques (i.e. head banging method [1]) to sophisticated full Bayesian models [4,5]. Empirical Bayes smoothers [6,7] and Poisson kriging [8] provide model-based approaches with intermediate difficulty in terms of implementation and computer requirements. Although simulation studies [7,8] have demonstrated the benefit of smoothing methods for risk prediction, some uncertainty will always be associated with the estimated risk. In Poisson kriging the uncertainty about the risk within a given geographical entity is modeled by computing a minimum error variance (kriging) estimate of the risk and the associated error variance, which can then be combined to derive a Gaussian-type confidence interval. Full Bayes models go one step further and yields the full posterior distribution of the risk while accounting for the uncertainty in the parameters of the model.
Most studies do not make use of the uncertainty measure provided by smoothing methods, and only the map of smoothed rates is reported and used in the analysis. This is unfortunate since all rate smoothers, including Poisson kriging, cause the loss of local details of the spatial variation of the risk. This smoothing potentially affects the subsequent analysis, leading for example to the detection of larger aggregates of low or high cancer risk in local cluster analysis while most spatial outliers are filtered out [9]. To depict the uncertainty attached to risk maps, some authors recommend mapping the 95th percentile range of the posterior distribution of risk values or the probability that the risk in each entity exceeds a specific threshold of interest [4,10,11]. Richardson et al. [12] proposed to use this probability of exceedence to decide whether an area should be classified as having an excess risk of cancer. They discussed different decision rules or loss functions which represent weighted trade-offs between false-positive results (i.e. declaring an area as having elevated risk when in fact its underlying true risk equals the background level) and false-negative results (i.e. declaring an area to be in the background when in facts its underlying risk is elevated).
A major weakness of the uncertainty measures reported in today's health science literature is that they are area-specific, that is they inform on the uncertainty prevailing over a single geographical entity at a time. Except if the risk values are spatially independent, the probabilities of excess of a specific threshold computed for several entities do not provide a measure of uncertainty about whether these entities jointly exceed that threshold. In addition to a measure of "local" uncertainty, one thus needs to assess the "spatial" uncertainty, that is the uncertainty attached to the spatial distribution of risk values across the study area. The quantification of spatial uncertainty is particularly important for cluster detection, since the focus is on risk values for a group of geographical entities considered simultaneously. This information is not conveyed by a statistic map of the estimated risk and the associated prediction variance.
Spatial uncertainty modeling has been one of the most vibrant areas of research in geostatistics for the last 2 decades [13-15]. Applications, such as modeling the migration of pollutants in the subsurface environment, require measures of multiple-point uncertainty, such as the probability of occurrence of a string of high or low permeability values that may represent a flow path or flow barrier [16]. These joint probabilities are assessed numerically from a set of realizations of the spatial distribution of attribute values over the locations of interest. In other words, the spatial uncertainty is modeled through the generation of a set of equally-probable simulated maps, each consistent with the information available, such as histogram or a spatial correlation function. Stochastic simulation allows generation of maps that reproduce the spatial variability of the data without smoothing effect [17]. The set of simulated maps can also be used to propagate the uncertainty through spatial operators or transfer functions. For example, the set of simulated permeability maps can be fed into a flow simulator, yielding a distribution of response values, such as travel times to the water table [18].
From the user's perspective, it is important to be able to visualize the uncertainty in the spatial model of risk values. Although stochastic simulation offers a way to generate a large number of potential scenarios, the burden of manually scrolling through hundreds of different maps will test the patience of most users and be little informative. The information contained in the set of simulated maps is thus often summarized through a static display of probabilities of exceeding particular threshold or some measures of the spread of the posterior distribution [13]. By doing so, one however fails to depict the uncertainty about spatial features and essentially maps the area-specific measures of uncertainty provided by kriging and other smoothing methods. To depict visually the spatial uncertainty, several authors [19,20] have developed algorithms that show the realizations one at a time in rapid succession, like the frames of an animated cartoon, thereby eliminating the burden of manually displaying each simulated map. Like an animated cartoon, successive realizations must be similar enough to allow the eye to catch gradual changes. Such a similarity can be achieved by ranking the realizations appropriately or by using a simulation algorithm, called p-field simulation [21-23], that generates realizations that are incrementally different. The animated display of realizations allows one to distinguish areas that remain stable over all realizations (low uncertainty) from those where large fluctuations occur between realizations (high uncertainty).
This paper presents the first application of geostatistical simulation to model the spatial uncertainty attached to cancer risk values. This approach combines Poisson kriging and p-field simulation to generate multiple realizations of the spatial distribution of cancer risk values. These simulated maps are then fed into a local cluster analysis, allowing one to assess how uncertainty about the spatial distribution of risk values translates into uncertainty about the location of spatial clusters and outliers in cancer risks. The simulation approach is also used to generate a series of realizations that are incrementally different and animations are created using the Space-Time Information System (STIS) technology [24]. A public-domain executable for generating multiple risk maps, along with example datasets, is provided. This novel methodology is applied to the modeling, visualization and propagation of the spatial uncertainty of age-adjusted breast and pancreatic cancer mortality risks for white females in 295 US counties of the Northeast (1970–1994).
The methodology for modeling and propagating the uncertainty about the spatial distribution of health data will be illustrated using directly age-adjusted mortality rates for a frequent (i.e. breast) and less frequent (i.e. pancreatic) cancer. These data are part of the Atlas of Cancer Mortality in the United States [25] and were downloaded from http://www3.cancer.gov/atlasplus/download.html webcite. The rates were adjusted using the 1970 population pyramid. The analysis focuses on white female rates recorded over the 1970–1994 period for 295 counties of 12 New England States. Figure 1 (top graphs) shows the spatial distribution of age-adjusted mortality rates per 100,000 person-years. Following the recommendations of several studies on map color schemes [26,27], a double-ended color scheme with 10 equally-weighted classes (i.e. boundaries correspond to deciles of the histogram) was used: a gradient of red is used for rates higher than the median, while a gradient of blue is used for lower rates. The bottom scattergrams indicate that extreme high or low rates are typically recorded for sparsely populated counties (small number problem). For both cancers, the population at risk was computed as: 100,000 × the total number of deaths over the 1970–1994 period divided by the age-adjusted cancer mortality rate; both datasets are available on NCI website. The population-weighted average of the age-adjusted mortality rates is 30.14 per 100,000 person-years for breast cancer and 7.25 per 100,000 person-years for pancreatic cancer.
Figure 1. Geographic distribution of age-adjusted breast and pancreatic cancer mortality rates for white females. For the two top maps, the fill color in each county represents the age-adjusted mortality rates per 100,000 person-years recorded over the period 1970–1994 for white females. The class boundaries correspond to deciles of the histogram of rates. The scattergrams illustrate the larger variability in rates observed for counties with small populations.
Poisson kriging
The geostatistical methodology for the estimation of risk values from empirical frequencies, and its performance relative to common smoothers, is described in details in Goovaerts [8]. This section briefly reviews its most salient features. For a given number N of entities (e.g. counties, states, electoral ward), denote the observed mortality rates as z(uα) = d(uα)/n(uα), where d(uα) is the number of recorded mortality cases and n(uα) is the size of the population at risk. These entities are referenced geographically by their centroids (or seats) with the vector of spatial coordinates uα = (xα,yα). The disease count d(uα) is interpreted as a realization of a random variable D(uα) that follows a Poisson distribution with one parameter (expected number of counts) that is the product of the population size n(uα) by the local risk R(uα).
The risk estimate over a given entity with centroid uα, and the attached prediction variance, are computed from K neighboring observed rates as:
where CR(ui-uα) is the covariance between the rate measured at ui and the risk estimated at uα ; the spatial proximity is here defined in terms of Euclidian distance between the geographical centroids of the corresponding counties. The kriging weights λi(uα) are the solution of the following system of linear equations, known as the "Poisson Kriging" (PK) system [28,29]:
where δij = 1 if ui = uj and 0 otherwise, and m* is the population-weighted mean of the rates. The term μ(uα) is a Lagrange parameter that results from the minimization of the estimation variance subject to the unbiasedness constraint on the estimator. The addition of an "error variance" term, m*/n(ui), for a zero distance accounts for variability arising from population size, leading to smaller weights for less reliable data (i.e. measured over smaller populations).
The computation of kriging weights and kriging variance requires knowledge of the covariance of the unknown risk, CR(h), or equivalently its semivariogram γR(h) = CR(0)-CR(h). Following Monestiez et al. [28,29] the semivariogram of the risk is estimated as:
where N(h) is the number of pairs of county centroids separated by a vector h. The different pairs [z(uα)-z(uα+h)] are weighted by the corresponding population sizes to homogenize their variance. A permissible model, γR(h), is then fitted to the experimental semivariogram, i.e. using weighted least-square regression [30] in this paper.
Modeling local and spatial uncertainty
The uncertainty about the cancer mortality risk prevailing within the county with centroid uα can be modeled using the conditional cumulative distribution function (ccdf) of the risk variable R(uα) defined as:
where G(.) is the cumulative distribution function of the standard normal random variable. The notation "|(K)" expresses conditioning to the local information, say, K neighboring observed rates. The function (5) gives the probability that the unknown risk is no greater than any given threshold r. It is modeled as a Gaussian distribution with the mean and variance corresponding to the Poisson kriging estimate and variance. Measures of the spread of the distribution (i.e. variance or interquartile range), as well as the probability of exceeding any given threshold, are easily computed and mapped [[13], p. 358–361].
Instead of a unique set of smooth risk estimates {(uα), α = 1,...,N}, stochastic simulation aims to generate a set of L equally-probable realizations of the spatial distribution of risk values, {r(l)(uα), α =1,...,N; l = 1,...,L}, each consistent with the spatial pattern of the risk as modeled using the function γR(h). Simulation of spatial phenomena can be accomplished using a growing variety of techniques that differ in the underlying random function model, the amount and type of information that can be accounted for, and the computer requirements [13]. The main difficulty for the current application is that there is no measured risk data; only a semivariogram indirectly computed from observed rates according to expression (4) is available. The lack of target histogram is not an issue for the p-field simulation approach [21-23]. The basic idea is to generate a realization {r(l)(uα), α = 1,...,N} through the sampling of the set of ccdfs by a set of spatially correlated probability values {p(l)(uα), α = 1,...,N}, known as a probability field or p-field. Since the probability distributions are Gaussian (Equation 5), each risk value is simulated as:
r(l)(uα) = F-1(uα; p(l)(uα) | (K)) = (uα) + σPK(uα)y(l)(uα) (Equation 6)
where y(l)(uα) is the quantile of the standard normal distribution corresponding to the cumulative probability p(l)(uα).
Generating the probability field
The L sets of random deviates or normal scores, {y(l)(uα), α = 1,...N}, are generated using non-conditional sequential Gaussian simulation which proceeds as follows (see [13], p. 380 for more details):
1. Define a random path (i.e. using a random number generator) visiting each county centroid uα only once.
2. At each location uα determine the mean and variance of the Gaussian probability distribution of y-values as:
where y(l)(ui) are normal scores simulated at locations previously visited along the random path and located within a search radius from uα, and C(ui-uα) is the covariance function of the normal score variable Y for the separation vector hiα = ui-uα . In this paper, C(h) was identified to the covariance function of the risk after rescaling to a unit sill, i.e. C(h) = 1-γR(h)/CR(0). The λi are kriging weights obtained by solving the following system of linear equations (simple kriging, SK):
3. Draw a simulated value from the Gaussian ccdf and add it to the data set. In other words, the simulated value at uα is y(l)(uα) = (uα)+σSK(uα) × G-1 [p(l)], where p(l) is a random number between 0 and 1.
4. Proceed to the next location along the random path, and repeat the two previous steps.
5. Loop until all N locations (i.e. N = 295 here) are simulated.
The procedure is repeated using a different random path and set of random numbers to generate another realization. Note that the mean and variance of the set of simulated normal scores can sometimes deviate substantially from zero and one, respectively. Such discrepancies between model and realization statistics are referred to as ergodic fluctuations [[13], p. 426]. These fluctuations can be important when the range of the semivariogram model is large with respect to the size of the simulated area, in particular when the nugget effect is small [[31,32] p. 128–133]. In the program pfield.exe described below, each set of simulated normal scores is rescaled by its mean and variance to fulfill the underlying assumptions of a standard normal random function.
Creating animated displays of realizations
One interesting feature of the p-field simulation approach is its ability to generate easily a series of realizations that are incrementally different. The algorithm, originally proposed by Srivastava [19] for the simulation of raster grids, requires the generation of a probability field that is much larger than the area to be simulated. Multiple realizations are then generated by shifting slightly the probability field before sampling the set of ccdfs. This small shift ensures that, albeit different, the probabilities used to sample the ccdfs from one realization to the next are very close to each other, leading to gradual changes between successive realizations. These realizations can be used as consecutive frames in an animation, enabling a dynamic and evolving display of the uncertainty attached to the spatial distribution of attribute values. A similar approach is here implemented for the simulation of risk values over the non-gridded set of county centroids; see the Results and Discussion Section.
Local cluster analysis and propagation of uncertainty
Once the rates have been geostatistically filtered or simulated, classical Exploratory Spatial Data Analysis (ESDA) techniques can be applied to investigate the existence of local clusters or outliers of high or low cancer risk values. For example, the local Moran test evaluates local clustering or spatial autocorrelation [33]. Its null hypothesis is that there is no association between rates in neighboring geographical units; i.e. counties in this paper. The working (alternative) hypothesis is that spatial clustering exists. For each county, the so-called LISA (Local Indicator of Spatial Autocorrelation) statistic is computed as:
where (uα) is the kriged risk for the county being tested, which is referred to as the "kernel" hereafter; (uj) are the risk values for the J(uα) neighboring counties that are here defined as units sharing a common border or vertex with the kernel uα (1-st order queen adjacencies). All values are standardized using the mean m and standard deviation s of the set of risk estimates. Since the standardized values have zero mean, a negative value for the LISA statistic indicates a negative local auto-correlation and the presence of spatial outlier where the kernel value is much lower (higher) than the surrounding values. Cluster of low (high) values will lead to positive values of the LISA statistic.
In addition to the sign of the LISA statistic, its magnitude informs on the extent to which kernel and neighborhood values differ. To test whether this difference is significant or not, a Monte Carlo simulation is conducted, which traditionally consists of sampling randomly and without replacement the global distribution of rates (i.e. sample histogram) and computing the corresponding simulated neighborhood averages. This operation is repeated many times (e.g. M = 999 draws) and these simulated values are multiplied by the kernel value to produce a set of M simulated values of the LISA statistic at location uα . This set represents a numerical approximation of the probability distribution of the LISA statistic at uα , under the assumption of spatial independence. The observed statistic (Equation 10) is compared to the probability distribution, enabling the computation of the probability of not rejecting the null hypothesis. The so-called p-value is compared to the significance level α chosen by the user and representing the probability of rejecting the null hypothesis when it is true (Type I error). Every county where the p-value is lower than the significance level is classified as a significant spatial outlier (HL: high value surrounded by low values, and LH: low value surrounded by high values) or cluster (HH: high value surrounded by high values, and LL: low value surrounded by low values). If the p-value exceeds the α level, the county is declared non-significant (NS).
Instead of conducting the local cluster analysis on the set of smooth risk estimates, one of the key ideas of this paper is to apply the algorithm to the set of simulated risk maps, yielding a set of classifications of counties into significant clusters and outliers, or non significant units. The ensemble of classified maps can be used to compute the probability that a county belongs to each of the five classes. This county is then allocated to the class with the highest probability of occurrence (maximum likelihood classification).
Any prior information on the spatial pattern of mortality risks could be included directly into the randomization procedure underpinning the test of significance of local cluster analysis using the approach proposed by Goovaerts and Jacquez [9]. In other words, the null hypothesis of spatial randomness and uniform risk, corresponding to the operation of randomization of the outcomes, is replaced by models that are more realistic. Realizations of the so-called "Neutral Models" are also generated using geostatistical simulation. The approach allows the identification of spatial patterns above and beyond that incorporated into the neutral model, enabling, for example, the identification of "hot spots" beyond background variation in a pollutant or the detection of clusters beyond regional variation in the risk of developing cancer [34].
Poisson kriging, including the estimation and modelling of the semivariogram of the risk, was conducted using the public-domain executable poisson-kriging.exe described in Goovaerts [8]. The data and parameter file used for the estimation of pancreatic cancer risks are provided with the paper (1: pancreas.dat, 2: poisson-kriging.par). Probability fields were generated using a modified version of the code sgsim.exe from the public-domain Geostatistical Software Library Gslib [32]. This modified code allows simulation over an irregular grid of county centroids, and the random deviates are directly combined with the output of Poisson kriging to generate simulated risk values. The executable of this p-field code is provided with the paper (3: pfield.exe), along with the parameter file used for pancreatic cancer (4: pfield.par). Local cluster analysis and animation of results were performed using the Space-Time Information System (STIS) technology [24].
Additional File 1. Input data file for poisson_kriging.exe. This dataset follows the Geo-EAS format and includes, for 295 counties of New England, the following information: FIPS code, spatial coordinates of the county geographic centroid, age-adjusted pancreatic cancer mortality rate per 100,000 person-years, and the population at risk for the 1970–1994 period.
Format: DAT Size: 16KB Download file
Additional File 2. Input parameter file for poisson_kriging.exe. This text file includes all the variables and names of input/output files required by the program, as well as the parameters for semivariogram modelling and Poisson kriging.
Format: PAR Size: 1KB Download file
Additional File 3. Executable to generate realizations of the spatial distribution of risk values using p-field simulation.
Format: EXE Size: 716KB Download file
Additional File 4. Input parameter file for pfield.exe. This text file includes all the variables and names of input/output files required by the program, as well as the parameters for the simulation procedure.
Format: PAR Size: 1KB Download file
Figure 2 shows the parameter file, pfield.par, used to generate 100 realizations of the spatial distribution of pancreatic cancer mortality risk values over 295 county centroids. The text file includes the following information:
Figure 2. Example of parameter file required by pfield.exe. This parameter file is used to generate 100 realizations of the spatial distribution of mortality risk values for pancreatic cancer. The input information includes the risk estimates and variances calculated by Poisson kriging, and the semivariogram of risk fitted by the program poisson_kriging.exe and displayed in Figure 5 (right bottom graph).
• Name of the text file including the Poisson kriging risk estimates and variances. This file is one of the output files of poisson_kriging.exe.
• Name of the output text file (Geo-EAS format [35]) that includes the spatial coordinates of each entity centroid and the simulated values for each realization. The output file produced by the parameter file pfield.par, 100pancreas-pfield.out, is shown in Figure 3.
Figure 3. Output file created by pfield.exe following the analysis of pancreatic cancer mortality rates. The output file (Geo-EAS format) includes the spatial coordinates of each entity centroid and the simulated values for each realization. This example shows the first and last few lines of the file (i.e. realization 1 to 100).
• Name of the text file including the ID field and spatial coordinates of the centroids of the geographical units to be simulated.
• The column numbers for the observation identification code (i.e. FIP county), and the variables with the spatial coordinates.
• The number of geographical units to simulate.
• The number of realizations to generate.
• Random number seed to initiate the random number generator. This number should be a large odd integer.
• The maximum number of previously simulated values to use in the computation of kriging weights and kriging variance (parameter K in Equations 7–9). These values are selected according to their covariance with the node being simulated, which accounts for both distance and direction in presence of anisotropy. Values beyond the range of autocorrelation (i.e. zero covariance) are not selected since their weight is systematically zero in simple kriging.
• Parameters of the risk semivariogram model: nugget effect, number and type of basic semivariogram models, sill and range(s) of autocorrelation for each model, azimuth of the direction of maximum range if an anisotropic model is fitted. These values are found in the output text file created by poisson_kriging.exe; see example in Figure 4.
Figure 4. Output semivariogram file created by poisson_kriging.exe following the analysis of pancreatic cancer mortality rates. This output file, called pancreasvariog.txt, includes the semivariogram risk values computed using 15 classes of 20 km, in four directions with the first direction azimuth starting at 22.5° measured clockwise from the NS axis. This file was created by poisson_kriging.exe using the additional files 1 and 2. The parameters of the semivariogram model are copied into the parameter file pfield.par required for p-field simulation (Figure 2).
Results and discussion
Semivariograms of cancer mortality risk
The experimental risk semivariograms for breast and pancreatic cancer mortality were estimated using equation (4) along four directions. Figure 5 (right column) shows the results, while the left column shows the traditional semivariograms computed directly from the observed rates. On each graph, the solid curve denotes the model fitted using weighted least-square regression. For example, the traditional semivariogram estimator for pancreatic cancer was modeled using two cubic models: (min. range = 50 km, max. range = 450 km) and (min. range = 158 km, max. range = 332 km). The risk semivariogram was modeled using a combination of a spherical model (min. range = 108 km, max. range = 450 km) and cubic model (min. range = 376 km, max. range = 737 km).
Figure 5. Directional semivariograms for breast and pancreatic cancer mortality rates and risks with the model fitted. The semivariograms of raw mortality rates (left column) and the semivariograms of the risk (Equation 4, right column) are computed in four directions; azimuth angles are measured in degrees clockwise from the NS axis. The solid curve denotes the anisotropic (i.e. direction-dependent) model fitted using weighted least-square regression (program poisson_kriging.exe in [8]).
The semivariograms of the risk are much better structured and have smaller sills than the corresponding semivariograms of the rates. This is expected since the weights in expression (4) attenuate the influence of extreme rates computed from small population sizes and subtraction of the correction term m* reduces the variance even more. This effect is more pronounced for pancreatic cancer: the relative decrease in sill value is larger than for breast cancer, and the risk semivariogram has a much longer range of autocorrelation than the traditional estimator that is almost pure nugget effect (i.e. no spatial correlation). Since pancreatic cancer is less frequent than breast cancer, its mortality rates are more likely to be impacted by the small number problem and display higher levels of noise. In particular for breast cancer the semivariogram of the risk displays a slight anisotropy, with smaller variability (red curve) along the NE-SW direction for small distances.
Poisson kriging
Risk semivariogram models were used to estimate the cancer mortality risk and the associated prediction variance by Poisson kriging. Following a previous study [8], the closest 32 neighboring counties were used for the estimation. The risk maps in top of Figure 6 are much smoother than the original rate maps (Figure 1), since the noise caused by small population sizes has been filtered. This smoothing effect is also reflected by the lack of reproduction of the risk semivariogram model by the set of kriging estimates, see Figure 7. Especially for pancreatic cancer, there is a severe underestimation of the short-range variability, which is a typical feature of kriging and other least-square interpolation algorithms [[13], p. 372]. These maps, however, facilitate the visualization of areas of higher mortality risks, such as the East coast around the cities of New York and Boston, while West Virginia and Southern Pennsylvania have much lower risks for both cancers. The two risk maps mainly differ in the Northern part of the study area, with higher risks for pancreatic cancer in Maine. Yet, these predictions are based on sparsely populated or geographically remote counties, hence the associated kriging variance is very large; see Figure 6 (middle maps). Large kriging variances are also found in the South where mortality risks for both cancers are lower than average. The bottom scattergrams in Figure 6 illustrate the relationship between the kriging variance and the population size, indicating the expected higher reliability of risk values estimated from densely populated counties.
Figure 6. Maps of breast and pancreatic cancer mortality risks estimated by Poisson kriging and the corresponding kriging variance. For the two top maps, the fill color in each county represents the cancer mortality risk per 100,000 person-years estimated for the period 1970–1994; the class boundaries correspond to the deciles of the histogram of rates. The middle maps display the kriging variance computed using Equation (2); the class boundaries correspond to the deciles of the histogram of kriging variances. Bottom scattergrams illustrate the greater uncertainty of the risk estimated for sparsely populated counties.
Figure 7. Reproduction of the risk semivariogram model by the set of risk estimates. The semivariogram of risk estimates is computed in four directions; azimuth angles are measured in degrees clockwise from the NS axis. The solid curve denotes the anisotropic (i.e. direction-dependent) model used in Poisson kriging. This graph illustrates the underestimation of the spatial variability of the risk by the smooth map of kriging estimates.
Aggregates of counties with lower or higher mortality risks are easily detected in the local cluster analysis, whose results are displayed in Figure 8 (bottom graphs). A significance level α = 0.05 was used and the p-values were corrected for multiple testing using the Simes adjustment [36]. The analysis of risk estimates indicates significant low-low clusters (LL) in West Virginia, and part of Pennsylvania for pancreatic cancer. Significant clusters of high risks (HH) are found around New York and Boston for both cancers.
Figure 8. Results of a local cluster analysis conducted on breast and pancreatic cancer mortality rates and estimated risks. The fill color in each county represents the classification into significant low-low (LL) or high-high (HH) clusters, as well as high-low (HL) or low-high (LH) outliers. Light gray indicates counties that are not significant at the level α = 0.05; the p-values were corrected for multiple testing using the Simes adjustment.
The comparison of results obtained for the observed mortality rates versus risk estimates illustrates the impact of noise filtering on the local cluster analysis. For both cancers, the few spatial outliers detected for mortality rates are not significant in terms of risk. For example, the only significant low-high outlier for breast cancer, Clinton County (NY), was caused by the very large and unreliable age-adjusted breast cancer mortality rate of 38.8 per 100,000 person-years observed in its eastern neighbor, the small county of Grand Isle (VT); see Figure 8 (left top graph). The estimated risk in this sparsely populated county drops to 28.4, leading to a much smaller neighborhood value and the disappearance of the low-high outlier. Another consequence of the smoothing is the expansion of the clusters' size. Table 1 indicates that 50% to 400% more counties are classified as significant clusters based on risk maps versus the original mortality rates. For breast cancer, the cluster of low risks in the South now includes the two high-low outliers detected on the map of mortality rates. Note also in the western part of the map the high-high cluster of three New-York counties, including Niagara, which appears after application of Poisson kriging. This result agrees with the identification of a breast cancer cluster in the Western New-York area by the New-York State's Department of Health [37]. Differences between the classifications of mortality rates and risks are the most important for the less frequent pancreatic cancer, since the rates are expected to be less reliable; see Figure 8 (right column). The LL and HH clusters expanded into much larger clusters on the classified risk maps, while all seven spatial outliers were smoothed out.
Table 1. Results of local cluster analysis of mortality rate and risk maps. Number of counties classified as significant spatial clusters or outliers for breast and pancreatic cancers on the original mortality rate maps, kriged risk maps, and on average over the 500 simulated risk maps.
Stochastic simulation of risk values
A shortcoming of the local cluster analysis in Figure 8 is that it ignores the uncertainty attached to the predicted risks. For example, the large cluster of low mortality risk for pancreatic cancer should be interpreted cautiously because of the large prediction variance in the Southern part of the study area. One notices also the absence of spatial outliers for both cancers which, to some extent, results from the smoothing of high and low values by kriging. This conditional bias (i.e. overestimation of low values and underestimation of high values) might cause some counties to be wrongly classified as non-significant too.
Five hundreds realizations of the spatial distribution of risk values were simulated using the approach outlined in the Methods Section. Figures 9 and 10 show three realizations and the results of the corresponding local cluster analysis. The simulated maps are more variable than the kriged risk maps of Figure 6, yet they are smoother than the maps of potentially unreliable rates of Figure 1. Differences among realizations depict the uncertainty attached to the risk maps. For example, in Maine and Northwestern part of New-York state the simulated risk for pancreatic cancer takes a wide range of values, emphasizing the lack of reliability of high risk estimates in these regions. Differences between realizations are much smaller for breast cancer, which is expected given the higher frequency of this disease leading to more reliable risk estimates.
Figure 9. Simulated risk maps for breast cancer, and results of the local cluster analysis. For the risk maps (left column), the fill color in each county represents the breast cancer mortality risk per 100,000 person-years simulated for the period 1970–1994; the class boundaries correspond to the deciles of the histogram of rates. For the local cluster analysis (right maps), the fill color in each county represents the classification into significant low-low (LL) or high-high (HH) clusters, as well as high-low (HL) or low-high (LH) outliers. Light gray indicates counties that are not significant at the level α = 0.05; the p-values were corrected for multiple testing using the Simes adjustment.
Figure 10. Simulated risk maps for pancreatic cancer, and results of the local cluster analysis. For the risk maps (left column), the fill color in each county represents the pancreatic cancer mortality risk per 100,000 person-years simulated for the period 1970–1994; the class boundaries correspond to the deciles of the histogram of rates. For the local cluster analysis (right maps), the fill color in each county represents the classification into significant low-low (LL) or high-high (HH) clusters, as well as high-low (HL) or low-high (LH) outliers. Light gray indicates counties that are not significant at the level α = 0.05; the p-values were corrected for multiple testing using the Simes adjustment.
Reproduction of a target histogram and semivariogram is a common way for the geostatistician to assess the quality of a simulated map [14,18]. Despite the lack of risk data to compute a target histogram, target summary statistics, such as mean and a priori variance [38], can be identified with the mean of the risk estimates and the sill of the risk semivariogram model, respectively. Figure 11 shows the histogram of these two statistics computed from the set of 500 simulated maps. The a priori variance corresponds to the sill of the model fitted to the directional semivariograms computed for each set of simulated risk values; this statistic is a better measure of dispersion than the sample variance since it accounts for the spatial correlation between risk values (i.e. variance of data separated by a distance larger than the range of autocorrelation). The black dot in the box plot below each histogram is the target value, i.e. the average estimated risk or the sill of the risk semivariogram model. Five vertical lines are the 0.025 quantile, lower quartile, median, upper quartile, and 0.975 quantile of the distribution. The simulated maps reproduce, on average, reasonably well the two target statistics, in particular the target mean. The coefficient of variation is smaller for breast cancer relative to pancreatic cancer. Besides the reproduction of the sill, reproduction of the shape of the target semivariogram model should also be assessed. The directional semivariograms of simulated risk values were computed for each of the 500 realizations, and their average is superimposed on the target model (solid curve) at the bottom of Figure 11. For both cancers the simulated risk maps very well reproduce the spatial anisotropy; the sill is slightly underestimated in the realizations of pancreatic mortality risks, which agrees with the underestimation of the target a priori variance noticed on the histogram. Discrepancies between the realization and target semivariograms (i.e. ergodic fluctuations) in this application are, to a large extent, explained by the large range of autocorrelation (up to 800 km) with respect of the size of the study area, as well as the small nugget effect of the risk semivariogram models. Yet, comparison of Figures 11 and 7 shows that simulated maps better reproduce the spatial variability of risk values, as modeled by the semivariogram function γR(h), than the corresponding kriged maps.
Figure 11. Reproduction of target statistics by the set of simulated risk maps. The top and middle graphs show the histograms of the mean and a priori variance of each set of simulated values. The black dot in the box plot below each histogram is the target value identified as the average estimated risk or the sill of the risk semivariogram model. Five vertical lines are the 0.025 quantile, lower quartile, median, upper quartile, and 0.975 quantile of the distribution. Bottom graphs show the directional semivariograms of simulated risk values, averaged over all 500 realizations; the solid line depicts the target model fitted in Figure 5.
By construction, the mean and variance of the local (i.e. county-specific) distribution of simulated risk values should reproduce the mean and variance of the ccdf that is repeatedly sampled across all realizations. The ccdf parameters are the kriging estimate and variance, and those are plotted against the mean and variance of 500 simulated risk values in Figure 12. The good agreement between the two sets of statistics, in particular the mean, indicates that the ensemble of 500 probability fields provides a uniform sampling of these local distributions of probability.
Figure 12. Reproduction of Poisson kriging estimate and variance by the set of simulated risk values. By construction, the mean and variance of the local (i.e. county-specific) distribution of simulated risk values should be equal to the mean (kriging estimate) and variance (kriging variance) of the ccdf sampled using the probability field. The scatterplots indicate that the ensemble of 500 realizations provides a uniform sampling of the local distributions of probability.
Propagation of uncertainty through local cluster analysis
The classified maps in the right column of Figures 9 and 10 illustrate how the uncertainty about risk values translates into uncertainty about the results of the local cluster analysis. From one realization to another, the shape and position of local clusters can change substantially. For example, the southern part of the cluster of low risk values detected on the kriged map for pancreatic cancer becomes non significant on some realizations; see Figure 10 (bottom right graph). The location and nature of clusters is much more stable for breast cancer. Table 1 indicates that slightly more counties are classified as significant clusters when the analysis is performed on kriged risks instead of simulated values. A few counties are also now classified as significant outliers, which confirms the potential bias of an analysis based on smoothed rates.
The information provided by the set of 500 local cluster analyses is summarized in Figure 13. The color code in the top maps indicates the most frequent classification of each county across the 500 simulated maps. The shading reflects the probability of occurrence or likelihood of the mapped class. Solid shading corresponds to classifications with high frequencies of occurrence (i.e. likelihood > 0.9), while hatched counties denote the least reliable results (i.e. likelihood < 0.75). This coding is somewhat subjective but leads to a clear visualization of the lower reliability of the classification obtained for pancreatic cancer versus breast cancer; a similar conclusion can be drawn from the probability maps displayed at the bottom of Figure 13. The classification likelihood, averaged over all 295 counties, is 0.92 for breast cancer versus 0.81 for pancreatic cancer. In particular, the classification as low risk areas for pancreatic cancer exceeds a 0.9 likelihood only for a few counties in the large cluster detected in West Virginia and Southern Pennsylvania on the map of Figure 8 (right bottom). As intuitively expected, less reliable results are found for counties located on the edge of the clusters as well as for isolated counties. It is noteworthy that Niagara county is still classified as a high-high cluster with a 0.6 probability of occurrence. None of the county is predominantly classified as outlier across all realizations.
Figure 13. Summary of local cluster analyses conducted on 500 simulated risk maps. For the top maps, the fill color in each county represents the most frequent classification observed over 500 simulations of the spatial distribution of breast and pancreatic cancer mortality risks: low-low (LL) or high-high (HH) clusters, while light gray indicates counties that have mostly been found non-significant at an α level of 0.05; the p-values were corrected for multiple testing using the Simes adjustment. The intensity of the shading increases as the classification becomes more certain; the classification likelihood is mapped in the bottom maps.
How many realizations are needed?
The use of stochastic simulation in test of hypothesis relies on the assumption that the space of solution is sampled fairly exhaustively and uniformly (equally-probable realizations [18]). It is thus necessary to investigate how conclusions change as a function of the number of simulated maps generated. For example, Figure 14 shows the influence of increasing the number of realizations from 100 to 500 on the average difference in terms of likelihood values and classification of counties into significant outliers and clusters (the reference is the results obtained using 100 realizations). To reduce sampling fluctuations, for each sample size ranging from 100 to 500 realizations, 50 subsets were randomly selected from the original set of 500 realizations, and the averaged results are plotted in Figure 14. All curves exhibit a plateau within this range of number of realizations, although the asymptotic behavior depends on the type of cancer. Larger classification discrepancies and slower convergence are observed for pancreatic cancer, which confirms previous results regarding its lower classification reliability relative to breast cancer. Yet, for this case study, enough realizations of the spatial distribution of cancer mortality risks were generated to yield a stable classification of counties.
Figure 14. Impact of the number of realizations on the stability of local cluster analysis results. The left graph displays the absolute change in classification likelihood as the number of simulated risk maps increases from 100 to 500. The right graph shows the number of counties that are classified differently as the number of realizations increases from 100 to 500. Both curves represent results averaged over 50 random subsets.
Visualization of spatial uncertainty
A series of 200 incrementally different simulated risk maps was generated by shifting a very large probability field by an EW increment of 33 km between realizations; see an example in Figure 15 for breast cancer. 33 km is the average distance between centroids of contiguous counties. East West corresponds to the approximate direction of largest variability displayed by the risk semivariograms, and it is expected to lead to a more complete exploration of the space of uncertainty through the maximization of differences among realizations. Figure 16 shows the entire probability fields used for both cancers. The breast cancer probability field shows clear NE-SW bands of high and low probabilities, which reflects the anisotropy displayed by the risk semivariogram model in Figure 5. The anisotropy is much less pronounced for pancreatic cancer. Note that since the same random numbers and random path were used in sequential simulation for both cancers, the locations of high and low values are fairly similar in the two probability fields.
Figure 15. Illustration of the p-field approach for generating animated displays of simulated maps. A large simulation grid is first generated by shifting the 295 county centroids by EW increments of 33 km. This large grid is then populated with probability values using sequential Gaussian simulation and the risk semivariogram models of Figure 5. Last, the probability values are used to sample Gaussian local distributions of probability characterized by the Poisson kriging estimate and variance mapped in Figure 6 (Monte-Carlo simulation).
Figure 16. Probability fields used to create incrementally different simulated maps of breast and pancreatic cancer mortality risk. These large probability fields were generated by sequential Gaussian simulation and used to create 200 realizations of simulated risk values according to the procedure described in Figure 15.
Figure 17 shows six consecutive realizations of the animated set created for pancreatic cancer mortality risk; the entire animation is available as 5: pancreas.avi. The most striking feature is the gradual increase of risk values in West Virginia, while risk values decrease in the Southeastern part of New Jersey. This gradual change in spatial pattern of risk values between successive frames of the animation leads to a gradual change in the position and nature of clusters and outliers. Figure 18 depicts a shrinking of the low-low cluster in the South, while the same cluster is expanding to the North. This change illustrates the lack of reliability of the classification of these counties as low-low cluster on the map of Figure 8 (right bottom graph), a feature captured by the summary map of Figure 13 (right top graph). Similarly, a few counties in the Southeastern part of New Jersey classified as high-high cluster on Frame # 12 become non-significant on Frame #17. The entire animation of local cluster results is available as 6: pancreas-LCA.avi.
Figure 17. Six consecutive frames of the animated display of mortality risk maps for pancreatic cancer. The fill color in each county represents the pancreatic cancer mortality risk per 100,000 person-years simulated for the period 1970–1994; fewer class boundaries are selected to enhance the spatial features in all maps.
Additional File 5. Animated display of 200 realizations of the spatial distribution of mortality risk values for pancreatic cancer.
Format: ZIP Size: 2.6MB Download file
Additional File 6. Animated display of 200 realizations of the local cluster analysis of mortality risk values for pancreatic cancer.
Format: ZIP Size: 2.2MB Download file
Figure 18. Six consecutive frames of the animated display of local cluster analysis results for pancreatic cancer. The fill color in each county represents the classification into significant low-low (LL) or high-high (HH) clusters, as well as high-low (HL) or low-high (LH) outliers. Light gray indicates counties that are not significant at the level α = 0.05; the p-values were corrected for multiple testing using the Simes adjustment. The six maps are obtained by performing a local cluster analysis of the six maps of simulated pancreatic cancer mortality risks displayed in Figure 17.
Capitalizing on the abundant geostatistical literature devoted to the modelling of local and spatial uncertainty plus the recent development of Poisson kriging, this paper presented a novel approach, and the corresponding computer code, to generate realizations of the spatial distribution of risk values. P-field simulation proceeds in two steps. First, the local uncertainty about the risk prevailing within each geographical unit is modelled from the observed mortality rates and population at risk using Poisson kriging. The set of local probability distributions is then sampled using a set of spatially correlated probability values generated using non-conditional sequential Gaussian simulation. Through sampling by slowly moving probability fields, the approach also allows the creation of incrementally different realizations that can be used as consecutive frames in an animation, enabling a dynamic and evolving display of the uncertainty attached to the spatial distribution of risk values.
Simulated risk maps reproduce the spatial variability of the risk, thereby overcoming the smoothing effect inherent to all current procedures for stabilization of rate data, including Poisson kriging. In fact, the map of kriged risk is but the average of all simulated risk maps, while the kriging variance corresponds to the variance of the local distribution of simulated risk values. The probability of occurrence of multi-point or spatial features, such as aggregates of counties with low or high cancer mortality risk, can also be assessed numerically from the ensemble of realizations. This information can be conveyed through static maps of spatial clusters and outliers, using a color code indicating the likelihood of the classification, or through the dynamic display of the set of classified maps.
The analysis of breast and pancreatic cancer mortality rates illustrated the potentialities of the approach for modelling and propagating their spatial uncertainty through local cluster analysis. Geostatistical simulation generated risk maps that are more variable than the smooth risk map estimated by Poisson kriging and reproduce better the spatial pattern captured by the risk semivariogram model. Differences between realizations were particularly important for the less frequent pancreatic cancer, reflecting for example the uncertainty attached to higher risk estimates in sparsely populated counties of Maine and North-western New-York. Such uncertainty translates into a lack of reliability of some of the spatial clusters and outliers detected on the map of smoothed rates. The case study showed how geostatistical simulation permits the quantification of the likelihood of spatial clusters and outliers detected using Moran's I. Local cluster analysis of the set of simulated risk maps leads to a clear visualization of the lower reliability of the classification for pancreatic cancer versus breast cancer: only a few counties in the large cluster of low risk detected in West Virginia and Southern Pennsylvania are significant over 90% of all simulations. On the other hand, the cluster of high breast cancer mortality in Niagara county, detected after application of Poisson kriging, is significant for 60% of simulated risk maps. Sensitivity analysis shows that 500 realizations are needed to achieve a stable classification for pancreatic cancer, while convergence is reached after fewer than 300 realizations for breast cancer.
Maps of cancer incidence as well as mortality rates are frequently used as input to disease clustering procedures whose purpose is to identify local areas of excess and deficit. Most users recognize that rates recorded for small populations are uncertain, leading to the routine application of smoothing methods prior to the analysis. Yet, in their interpretation of the risk maps, they tend to forget that the risks themselves are prone to uncertainty and that some features, such as large clusters of low or high risk, might just be artifacts of the smoothing method. Ignoring such uncertainty can lead to misallocation of resources to investigate unreliable clusters of high risk, while areas of real concern might go undetected. Instead of a single, and potentially misleading, map of smoothed rates, the simulation approach provides public health officials with a set of plausible scenarios for the spatial pattern of risk. Those permit investigating the impact of risk uncertainty on alternate intervention and control activities. In the future, the concept of stochastic simulation of mortality risks will be combined with the neutral model methodology [9] to assess geographic clustering using appropriate null hypotheses that account for the spatial correlation and background variation modeled from the observed rates and any ancillary information (i.e. exposure model).
Competing interests
The author is affiliated with BioMedware a research company that also develops software for the exploratory spatial and temporal analysis of health and environmental data. With funding from the National Cancer Institute, the author developed STIS (Space-Time Intelligence System), which is a commercial product of Terraseer and should include Poisson kriging and stochastic simulation functions in a future release.
This research was funded by grants 1R43CA110281-01 and R44-CA092807 from the National Cancer Institute. The views stated in this publication are those of the author and do not necessarily represent the official views of the NCI.
Mungiole M, Pickle LW, Hansen Simonson K: Application of a weighted head-banging algorithm to mortality data maps.
Statistics in Medicine 1999, 18:3201-3209. PubMed Abstract | Publisher Full Text
Pickle LW: Spatial analysis of disease. In Biostatistical Applications in Cancer Research. Volume Chapter 7. Edited by Beam C. Boston, Kluwer Academic Publishers; 2002::113-150.
Waller LA, Gotway CA: Applied Spatial Statistics for Public Health Data. New Jersey: John Wiley and Sons; 2004.
Christensen OF, Waagepetersen R: Bayesian prediction of spatial count data using generalized linear mixed models.
Biometrics 2002, 58:280-286. PubMed Abstract
Best N, Richardson S, Thomson A: A comparison of Bayesian spatial models for disease mapping.
Statistical Methods in Medical Research 2005, 14:35-59. PubMed Abstract | Publisher Full Text
Clayton DG, Kaldor J: Empirical Bayes estimates of age-standardized relative risks for use in disease mapping.
Biometrics 1987, 43:671-681. PubMed Abstract
Marshall RJ: Mapping disease and mortality rates using empirical Bayes estimators.
Applied Statistics 1991, 40(2):283-294. PubMed Abstract
Goovaerts P: Geostatistical analysis of disease data: estimation of cancer mortality risk from empirical frequencies using Poisson kriging.
International Journal of Health Geographics 2005, 4:31. PubMed Abstract | Publisher Full Text | PubMed Central Full Text
Goovaerts P, Jacquez GM: Accounting for regional background and population size in the detection of spatial clusters and outliers using geostatistical filtering and spatial neutral models: the case of lung cancer in Long Island, New York.
International Journal of Health Geographics 2004, 3:14. PubMed Abstract | Publisher Full Text | PubMed Central Full Text
Clayton DG, Bernardinelli L: Bayesian methods for mapping disease risk. In Geographical and Environmental Epidemiology: Methods for Small-area Studies. Edited by Elliot P, Cuzick J, English D, Stern R. Oxford, UK, Oxford University Press; 1992:205-220.
Johnson GD: Small area mapping of prostate cancer incidence in New York State (USA) using fully Bayesian hierarchical modelling.
International Journal of Health Geographics 2004, 3:29. PubMed Abstract | Publisher Full Text | PubMed Central Full Text
Richardson S, Thomson A, Best N, Elliot P: Interpreting posterior relative risk estimates in disease-mapping studies.
Environmental Health Perspectives 2004, 112:1016-1025. PubMed Abstract | Publisher Full Text | PubMed Central Full Text
Goovaerts P: Geostatistics for Natural Resources Evaluation. New York: Oxford University Press; 1997.
Chiles JP, Delfiner P: Geostatistics: Modeling Spatial Uncertainty. New York: Wiley; 1999.
Goovaerts P: Geostatistical modelling of uncertainty in soil science.
Lemke LD, Abriola LM, Goovaerts P: DNAPL source zone characterization: influence of hydraulic property correlation on predictions of DNAPL infiltration and entrapment.
Water Resources Research 2004., 40(1)
Goovaerts P: Estimation or simulation of soil properties? An optimization problem with conflicting criteria.
Goovaerts P: Geostatistical modelling of the spaces of local, spatial and response uncertainty for continuous petrophysical properties. In Stochastic Modeling and Geostatistics: Principles, Methods and Case Studies. AAPG Computer Applications in Geology. Volume 2. Edited by Coburn TC, Yarus JM, Chambers RL. Tulsa, Oklahoma, The American Association of Petroleum Geologists; 2005::1-21.
Srivastava M: The visualization of spatial uncertainty. In Stochastic Modeling and Geostatistics: Principles, Methods and Case Studies. AAPG Computer Applications in Geology. Edited by Yarus JM, Chambers RL. Tulsa, Oklahoma, The American Association of Petroleum Geologists; 1994:339-345.
Wang L: Animated visualization of multiple simulated realizations and assessment of uncertainty. In Report 7 of Stanford Center for Reservoir Forecasting. Stanford, CA, Stanford Center for Reservoir Forecasting; 1994.
Froidevaux R: Probability field simulation. In Geostatistics Troia '92. Volume 2. Edited by Soares A. Dordrecht, The Netherlands, Kluwer Academic Publishers; 1993::73-84.
Srivastava M: Reservoir characterization with probability field simulation. In SPE Annual Conference and Exhibition. Volume 24753. Washington, D.C., Society of Petroleum Engineers; 1992::927-938.
Goovaerts P: Geostatistical modeling of spatial uncertainty using p-field simulation with conditional probability fields.
International Journal of Geographical Systems 2002, 16:167-178.
AvRuskin GA, Jacquez GM, Meliker JR, Slotnick MJ, Kaufmann A, Nriagu JO: Visualization and exploratory analysis of epidemiologic data using using a novel space time information system.
International Journal of Health Geographics 2004, 3:26. PubMed Abstract | Publisher Full Text | PubMed Central Full Text
Pickle LW, Mungiole M, Jones GK, White AA: Exploring spatial patterns of mortality: the new Atlas of United States mortality.
Statistics in Medicine 1999, 18:3211-3220. PubMed Abstract | Publisher Full Text
Grauman DJ, Tarone RE, Devesa SS, Fraumeni JF Jr: Alternate ranging methods for cancer mortality maps.
Journal of the National Cancer Institute 2000, 92(7):534-543. PubMed Abstract | Publisher Full Text
Brewer CA, Pickle L: Evaluation of methods for classifying epidemiological data on choropleth maps in series.
Annals of the Association of American Geographers 2002, 92(4):662-681.
Monestiez P, Dubroca L, Bonnin E, Durbec JP, Guinet C: Comparison of model based geostatistical methods in ecology: application to fin whale spatial distribution in northwestern Mediterranean Sea. In Geostatistics Banff 2004. Volume 2. Edited by Leuangthong O, Deutsch CV. Dordrecht, The Netherlands, Kluwer Academic Publishers; 2005::777-786.
Monestiez P, Dubroca L, Bonnin E, Durbec JP, Guinet C: Geostatistical modelling of spatial distribution of Balenoptera physalus in the northwestern Mediterranean Sea from sparse count data and heterogeneous observation efforts.
Pardo-Iguzquiza E: VARFIT: a Fortran-77 program for fitting variogram models by weighted least squares.
Goovaerts P: Impact of the simulation algorithm, magnitude of ergodic fluctuations and number of realizations on the spaces of uncertainty of flow properties.
Stochastic Environmental Research and Risk Assessment 1999, 13:161-182.
Deutsch CV, Journel AG: GSLIB: Geostatistical Software Library and User's Guide. 2nd edition. New York: Oxford Univ. Press; 1998.
Anselin L: Local indicators of spatial association – LISA.
Goovaerts P: Detection of spatial clusters and outliers in cancer rates using geostatistical filters and spatial neutral models. In geoENV V – Geostatistics for Environmental Applications. Edited by Renard Ph, Demougeot-Renard H, Froidevaux R. The Netherlands, Springer-Verlag; 2005:149-160.
Englund E, Sparks A: Geo-EAS 1.2.1 User's Guide. In EPA Report # 60018-91/008. EPA-EMSL, Las Vegas, NV; 1988.
Simes RJ: An improved Bonferroni procedure for multiple tests of significance.
New York State Department of Health: The New York State Cancer Surveillance Improvement Initiative. Albany, NY; 1998.
Journel AG, Huijbregts ChJ: Mining Geostatistics. London: Academic Press; 1978.


text:
This member hasn't added any personal information yet.
Leave AdotC a message to find out more.
Forum Post: MIKE VICK in Boston!!!!!!!!!!!!!!!!!!!!!!!!!!
Posted 07/31/2009 04:29:07 EDT
the man did his time...quality player and would be a good fit if they throw in the wildcat formation...u say dont sign now but IF he did and IF he was scorign TD'S and winning games i can garentee you more »
©2015 Boston Globe Media Partners, LLC
Separate multiple addresses with a comma

subset: commoncrawl


text:
Kevin Durant appreciates Dwight Howard's kind words, says he's not on LeBron James' level yet
Keep in mind, there is a world of difference between being an unrestricted free agent (James) and agreeing to a contract extension one year before your current deal expires (Durant).
"I'm not sure I wouldn't have gone about it the same way LeBron went about it," Durant said. "He was a free agent. He could pick whatever team in the league he wanted to pick. I wasn't a free agent. I wasn't a restricted free agent. I was just trying to extend my contract. I couldn't talk to other teams or negotiate my contract with other teams. I was just extending my contract, so my situation was a lot different.
"I've never (understood) why people made a big deal about it. He (James) did it the same way when he signed his contract extension. Dwyane Wade did it the same way. Chris Bosh did it the same way. I'm sure whenever I become a free agent, you know, I'll probably do it the same way they did it."
Fresh off becoming the youngest scoring champ in league history at the age of 21 last season, Durant easily outdistanced James in the league's annual preseason poll of NBA general managers, in which 66.7 percent picked Durant to win this year's MVP and 55.6 percent chose him as the player they would sign first if they were starting a franchise.
Thunder at Heat Time: 7:30 p.m. Friday Where: Sprint Center (Kansas City, Mo.) Television: FOX Sports Oklahoma Cox Ch. 37. HD 722. NBA TV Ch. 726 Radio: WWLS 98.1-FM, WWLS 640-AM. THREE THINGS TO KNOW * Miami guard Dwyane Wade will not play tonight because of a hamstring injury. * Tonight's game sold out within 48 hours of LeBron James announcing his plans to sign with Miami. * The game is technically a home game for Miami. Probable starters Thunder (1-0) Pos.;Player;Ht.;Pts.;Reb.;Ast G;Russell Westbrook;6-3;9.0;3.0;4.0 G;James Harden;6-5;18.104.22.168;4.0 F;Kevin Durant;6-9;12.0;1.0;2.0 F;Jeff Green;6-9;25.0;4.0;1.0 C;Serge Ibaka;6-10;12.0;11.0;1.0 Heat (1-0) Pos.;Player;Ht.;Pts.;Reb.;Ast G;Carlos Arroyo;6-2;10.0;2.0;1.0 G;Mike Miller;6-8;6.0;1.0;4.0 F;LeBron James;6-8;18.0;3.0;4.0 F;Chris Bosh;6-10;20.0;6.0;1.0 C;Joel Anthony;6-9;0.0;1.0;2.0


text:
There is an article on Pro Sports Daily under ARod and Papi dinner date pertaining to Alonso and his connections with these two and salary comments as well.
There is an article on Pro Sports Daily under ARod and Papi dinner date pertaining to Alonso and his connections with these two and salary comments as well.
There have been multiple articles and bits from the REDS indicating that its not really the money but the fact that he wants a big league contract. I think that if the REDS really don't want to give him the big league contract so be it. He has not played an inning of proball yet.
Shouldn't have drafted him if you knew he wanted that type of contract.
Do your homework next time. Who's running the draft, Marvin Lewis and Mike Brown?
By GEORGE A. KING III
BOSTON - Alex Rodriguez and David Ortiz shared a late meal Saturday night on the eve of Rodriguez's 33rd birthday at JER-NE restaurant and were joined by somebody Rodriguez predicts will develop into a star.
Sitting with the perennial All Stars was Yonder Alonso, a Coral Gables, Fla., resident, former Miami University star and the seventh pick (by the Reds) in last month's draft who Rodriguez predicts will sign a $7 million contract soon.
"Manny (Ramirez) and (Ortiz) are [my] close friends," Rodriguez said when asked if he often socializes with opponents before the Yanks New York Yankees ' 9-2 loss to the Red Sox last night.
Alonso is more than a friend to Rodriguez, a fellow Coral Gables resident.
"He hits at my house every night, still does," Rodriguez said of left-handed hitting first baseman Rodriguez compared with a young Jason Giambi . "He was my shadow for four months during the winter."
I miss Adam Dunn.
$7 million? Am I reading that right? A 7 million dollar contract for Yonder? That is ridiculous.
Negotiation 101:
Side A asks for the sun, moon, stars and pretty much everything else in the galaxy.
Side B offers a couple of neutrinos.
If both sides play their cards like they are supposed to, it usually comes down to whatever deadline is imposed on the negotiation window. Said deadline is the impetus for each side to either go or get off the proverbial pot.
Once a deal is reached at the 11th hour (as it is in most instances), both sides can claim that they each got what they wanted. Win-win. Alonso shows up for a meet & greet in GAB, takes a few batting practice cuts, and then gears up to go play in the AFL.
It's all just part of the dance.
Hardly any of the other big names have signed either. I'm not worried....yet
"Okay you guys, pair up in threes!" --Yogi Berra
If he turns out like A-rod it'd be worth it :-p.
Follow me on twitter @EricLilly7
What is going on with first-round Draft choice Yonder Alonso? Are the Reds going to sign him or just throw away a Draft pick?
-- Michael J., Cincinnati, Ohio
Right now, there's a lot of feet dragging with all the top-level Draft picks before an Aug. 15 deadline to sign them or lose them. Among the top 10, no one has signed except the No. 1 and No. 6 picks. Agents aren't in a rush because they don't want to set the bar too low on the bonus money. And to no surprise, clubs don't want to set the bar too high. I talked to scouting director Chris Buckley late last week and he seemed optimistic that Alonso would get signed.
I miss Adam Dunn.
Board Moderators may, at their discretion and judgment, delete and/or edit any messages that violate any of the following guidelines: 1. Explicit references to alleged illegal or unlawful acts. 2. Graphic sexual descriptions. 3. Racial or ethnic slurs. 4. Use of edgy language (including masked profanity). 5. Direct personal attacks, flames, fights, trolling, baiting, name-calling, general nuisance, excessive player criticism or anything along those lines. 6. Posting spam. 7. Each person may have only one user account. It is fine to be critical here - that's what this board is for. But let's not beat a subject or a player to death, please.


text:
Filter by:
Content type:
Stage 1&2
Stage 2&3
Stage 3&4
Stage 4&5
Challenge level:
Nim-7 game for an adult and child. Who will be the one to take the last counter?
Reasoning based on this Japanese activity.
Incey Wincey Spider game for an adult and child. Will Incey get to the top of the drainpipe?
You'll need two dice to play this game against a partner. Will Incey Wincey make it to the top of the drain pipe or the bottom of the drain pipe first?
Here is a version of the game 'Happy Families' for you to make and
An odd version of tic tac toe
In this matching game, you have to decide how long different events take.
Take it in turns to place a domino on the grid. One to be placed horizontally and the other vertically. Can you make it impossible for your opponent to play?
Try this matching game which will help you recognise different ways of saying the same time interval.
A game for two players. You'll need some counters and somewhere to draw a board.
In this game, you can add, subtract, multiply or divide the numbers
on the dice. Which will you do so that you get to the end of the
number line first?
A fun puzzle with tantrix tiles.
Solve this Sudoku puzzle whose clues are in the form of sums of the
numbers which should appear in diagonal opposite cells.
Play this well-known game against the computer where each player is
equally likely to choose scissors, paper or rock. Why not try the
variations too?
A game somewhat similar to 'noughts and crosses' on a much larger
First Connect Three game for an adult and child. Use the dice numbers and either addition or subtraction to get three numbers in a straight line.
Match the halves.
A number card game for 2-6 players.
Can you use the numbers on the dice to reach your end of the number line before your partner beats you?
A game for 2 people. Take turns placing a counter on the star. You win when you have completed a line of 3 in your colour.
A game played with a standard pack of cards.
This challenge is a game for two players. Choose two numbers from the grid and multiply or divide, then mark your answer on the number line. Can you get four in a row before your partner?
Some Games That May Be Nice or Nasty for an adult and child. Use your knowledge of place value to beat your oponent.
Four Go game for an adult and child. Will you be the first to have four numbers in a row on the number line?
A game for 2 or more players with a pack of cards. Practise your
skills of addition, subtraction, multiplication and division to hit
the target score.
The game uses a 3x3 square board. 2 players take turns to play,
either placing a red on an empty square, or changing a red to
orange, or orange to green. The player who forms 3 of 1 colour in a
line. . . .
This is a game for 2 players. Each player has 4 counters each, and
wins by blocking their opponent's counters. A good follow-on from
two stones.
This is a challenging game of strategy for two players with many interesting variations.
A game for 2 or more people. Starting with 100, subratct a number from 1 to 9 from the total. You score for making an odd number, a number ending in 0 or a multiple of 6.
Board Block game for two. Can you stop your partner from being able to make a shape on the board?
Board Block Challenge game for an adult and child. Can you prevent your partner from being able to make a shape?
An interactive activity for one to experiment with a tricky tessellation
Totality game for an adult and child. Be the first to reach your agreed total.
Stop the Clock game for an adult and child. How can you make sure you always win this game?
A card pairing game involving knowledge of simple ratio.
A game for 1 person to develop stategy and shape and space awareness. 12 counters are placed on a board. Counters are removed one at a time. The aim is to be left with only 1 counter.
A game for 2 people using a pack of cards Turn over 2 cards and try
to make an odd number or a multiple of 3.
Train game for an adult and child. Who will be the first to make the train?
A game for two people, or play online. Given a target number, say 23, and a range of numbers to choose from, say 1-4, players take it in turns to add to the running total to hit their target.
Here are a collection of games from around the world to try during the holidays or the last few weeks of term.
Advent Calendar 2010 - a mathematical game for every day during the run-up to Christmas.
In this game for two players, you throw two dice and find the product. How many shapes can you draw on the grid which have that area or perimeter?
Dicey Operations for an adult and child. Can you get close to 1000 than your partner?
Design your own scoring system and play Trumps with these Olympic Sport cards.
A game that tests your understanding of remainders.
A train building game for 2 players.
Got It game for an adult and child. How can you play so that you know you will always win?
Take it in turns to make a triangle on the pegboard. Can you block your opponent?
A complicated game played on a 9 x 9 checkered grid.


text:
The purpose of the Bible Study Workshops cultivate unity, fellowship, fun and to teach and reconfirm Christians understanding of the Holy Bible. Emphasis will be given (but not restricted) to teaching the truth about false doctrine and the misinterpretation of scriptures. Lessons shall also be taught on the best methods, place and time to answer Biblical questions. Also methods and on how to schedule and teach a home Bible study to non Christians.
Atlanta, NewYork, Chicago,Nashville,Cleveland, Columbia,Jacksonville,Charlotte,
Detroit,Bowling Green, Los Angeles, Houston, Philadelphia, Phoenix, Dallas, Memphis,
Boston, Denver, Baltimore, Oklahoma, Miami, Oakland, Cincinnati,
United States of Americans


text:
McGwire's brother says ex-slugger used steroids
Mark McGwire might not want to discuss anything that's ever happened in the past, particularly when it involves hypodermic needles, Jose Canseco, and his bottom. But his brother is apparently ready to sell him out. Word is that Jay McGwire has been shopping a book that gives the lowdown on his big brother's steroids usage. He says he's the one who got his brother started on the stuff after he constructed himself into a bodybuilder with the juice that he bought with the $150,000 he made from an insurance settlement that came to him after he lost an eye in a BB gun incident. Youch. (New York Daily News)


text:
This type of account is designed for people seeking investment advice from qualified professionals while still desiring to participate in their investment decisions.
As an agent for your portfolio, Prairie Financial Group will manage your assets, collect dividends and interest payments, make distributions, regulate bill paying, maintain accurate record keeping, and provide statements.
Our qualified investment advisors can provide on-going portfolio management and oversight. Should you choose to direct the investments in your portfolio, we offer you the flexibility to do so.
By utilizing our services, you have the freedom to determine your level of financial assistance.
Call (262) 522-7400 to talk with a Prairie Financial Group Representative today!
To log in to your Prairie Financial Group accounts, click here.
|Not FDIC Insured
|Not Bank Guaranteed
|May Lose Value
|Not Guaranteed by any Government Agency
|Not a Bank Deposit


text:
by Kara
APR is uniquely positioned to deliver the major multi-media coverage of a national firm while offering the hands-on attention of a local company with deep roots in the community. We excel at media relations, crisis communications, social media management, business development and corporate event planning.
(912) 695-7881
Copyright © 2015 Abshire Public Relations.
Powered by WordPress and Florentia.


text:
stereo recording.in the middle of the forest with birds and leaves
Just what I needed: some peace and quiet in the forest...
 |  26 comments
Please log in to comment
920 x 245
481 x 86
375 x 30
We use cookies to ensure you get the best experience on our website. By browsing our site you agree to our use of cookies.
For more information check out our cookies policy.


text:
Now the right hand man of internationally acclaimed DJ, Kaskade,"Amtrac, the solo project of Kentucky's Caleb Cornett, has just the right mixture of pop and cutting-edge sonics to break through the void. On 'Came Along,' Amtrac guides a More Info
Author Archives: bri
Mark Knight at Tier Nightclub Orlando
In a world where music is often limited to genre handles and buzz sounds, Mark Knight has proven a rare and wonderful breed of integral house heavyweight. With a career spanning more than a decade and a solid reputation on More Info
ATB at Tier Nightclub
There are only a very few artists who can exert any real influence on the dance scene today – too many artists out there and seemingly endless output. Andre Tanneberger, however, has been making an impact for the past More Info


text:
Mobile Menu
Craig Berkman charged in Facebook fraud
Former Oregon gubernatorial candidate Craig L. Berkman was charged in an $8 million securities fraud scheme.
Oregon unemployment rate steady
Oregon's February unemployment rate stayed 8.4%, the same as January.
Integra could move HQ
Portland-based telecom company Integra is considering moving its headquarters from the Lloyd District next year.
Portland developer focuses on art
Brian Wannamaker, best known for gentrifying Portland's North Mississippi Avenue, is putting a lot of time and money into the Falcon Art Community.
RYU makes Portland its HQ
Exercise-apparel brand Respect Your Universe is making Portland its headquarters.
I-5 getting crop signs
Three organizations are teaming up to place more than 200 crop identification signs along Interstate 5.
Portland visitor attractions going compostable
The Oregon Convention Center, Portland Expo Center and Portland Center for Performing Arts are all switching to compostable cups for onsite concessions.


text:
|« Back to Article
Group 1 Posts Highest Second Quarter Ever
By David Kaplan | July 27, 2011
Photo By Michael Paulsen/StaffEarl Hesterberg, CEO of Group 1, stands in the Advantage BMW showroom Thursday, April 29, 2010, in Houston. Photos for Chron 100 special section. ( Michael Paulsen / Houston Chronicle )
More Information
Precede goes here
Item No.1: Here
Item No.2: Here
Source goes here
Group 1 Automotive posted record second-quarter profit as the company's dealerships made more money on each new car sold.
The higher profit came despite an earthquake and tsunami in Japan that cut production from automakers that supply 62 percent of Group 1's vehicle sales and inventory.
Net income rose to $24.7 million, or $1.06 per share; compared with $12.8 million, or 54 cents per share, a year earlier. Revenue increased to $1.47 billion from $1.42 billion.
The earnings, the second-highest quarterly results in company history, exceeded most analysts' forecast of 81 cents a share, according to Bloomberg News. Group 1's shares jumped $6.94 to $49.50.
Group 1's president and CEO, Earl Hesterberg, said the company performed well despite the shortage of new Japanese brands by selling more used vehicles, increasing margins on the fewer number of new vehicles sold and reducing marketing and operating expenses.
Gross profit increased to by $455 to $2,252 on each new vehicle, an increase of more than 20 percent, the company said.
Group 1 also benefited from lower interest expense on inventory for its more than 100 dealerships in the U.S. and Britain.
The inventory of new Toyota products is starting to ramp up and Hesterberg said he expects new Honda inventory to increase soon.
Hesterberg predicts inventory levels for Japanese vehicles to return to normal in September.
Starting in late August Hesterberg expects Toyota and Honda to launch aggressive advertising and incentive campaigns to "make up for lost time," he said.
During a conference call Tuesday, Hesterberg said that for the quarter, import sales were down 13 percent, domestic sales were up 11 percent and luxury brand sales were up 7 percent.
Group 1 brands that saw new vehicle sales increases for the quarter included BMW/Mini, Mercedes-Benz, GM and Chrysler.
Among the regions seeing increases in new vehicle sales were the U.K., California and Texas, Hesterberg noted. Houston remains a key market for generating profit for the company, he said.


text:
Prime Minister Benjamin Netanyahu has become the latest target of Israeli musician Noy Alooshe and his satirical music videos.
In the clip released this week, Alooshe takes comments by the prime minister claiming that there would be no protests in Israel akin to those in the Arab World and mixes them with recent footage of Israelis taking to the streets en masse over the spiraling cost of living in the country.
This is not the first that Alooshe has remixed the prime minister's words. In May, the musician made a video based on Netanyahu's speech to Congress; other leaders to find themselves as stars of one of his videos include Silvio Berlusconi and Muammar Gadhafi.
Read more at Haaretz.com.
We welcome your feedback.
Privacy Policy
Your information will not be shared or sold without your consent. Get all the details.
Terms of Service
JewishJournal.com has rules for its commenting community.Get all the details.
JewishJournal.com reserves the right to use your comment in our weekly print publication.


text:
Rap Quickies: In and Out in Two Hot Minutes
by Raymond Cummings | April 28, 2014
A great rapper can accomplish a lot in two minutes or less. Not a freestyle, necessarily, but letting loose with an extremely concentrated burst of storytelling, scene-setting, toasting or reminiscing before ducking out the back. Hip-hop past and present are littered with these rough, 120-second-long songlets; often, they're the most memorable aspects of the albums, EPs, compilations or mixtapes on which they appear.
Recent TDE recruit Isaiah Rashad makes the most of limited space on "Soliloquy," stepping lively through autobiography, fantasy, schlock comedy and tough talk. DMX, meanwhile, triumphantly reps his set on "My N*gg*z"; Fam-Lay cold-bloodedly warns lames against crossing Virginia state lines over a bloop-y Oompa-Loompa Neptunes beat on "Fam-Lay Freestyle." With "Name of the Game," DJ Hi-Tek's soul-soaked piano-loop palpitations elicit career-apogee hot sixteens from Talib Kweli; and Rakim elevates the genre for an entire generation on the funky fly "Don't Sweat the Technique."
By contrast, Earl Sweatshirt spends "Uncle Al" vividly and heatedly free-associating over the sonic equivalent of tumbling backward into a K-hole, while an insulated, insomniac Raekwon makes his stove work for him on "Pyrex Vision." But the crown for best use of two minutes must go to Run-D.M.C., who deftly and incisively employ personification to illustrate the horrors of drug addiction on "Crack," almost two decades before 50 Cent recorded "A Baltimore Love Thing."


text: [[AC:FridgeLogic]]* Why exactly does Donald stay with Daisy? She leaves Donald for Gladstone whenever she damn well feels like it, and it's not like Donald doesn't have better options. (Those "better options" including [[PhysicalGoddess Xadhoom]] and [[ComicBook/DoubleDuck Kay K]]. The former of whom he's flirted far more with than Daisy....)** It's a fool that looks for logic [[Film/OBrotherWhereArtThou in the chambers of a duck's heart.]]** Two ''very'' good reasons. The first is actually shown in the strip it introduced Daisy by making clear that, in-universe, [[HelloNurse Daisy is just that beautiful]] (Donald was furious at the new neighbour accidentally ''graze'' his prized rose hedge with the moving truck. Then saw Daisy driving it and spontaneously cut down the whole hedge). The second, given you bring in the Italian stories featuring or implying ''ComicBook/PaperinikNewAdventures'', is HiddenDepths: Daisy has ''her own'' superhero alter ego, Paperinika, with whom Paperinik has a [[BelligerentSexualTension relationship of obvious rivalry and loathe and barely disguised attraction and admiration]], and Donald may be unconsciously after ''this'' side of hers.[[AC:FridgeHorror]]* If you think too much about Creator/DonRosa's ArcWelding work, you have to conclude that everyone's parents are dead.** Not much fridge: ''ComicBook/TheLifeAndTimesOfScroogeMcDuck'' showed Scrooge's father's ''corpse''... On the other hand, Matilda [=McDuck=] is still alive and well, so Hortense and Della could still be around.** Furthermore, Don Rosa usually implies that his "PresentDay" stories are actually set during the heydays of Creator/CarlBarks' classic stories (thus mostly during TheFifties), which means that as of ''right now'', most characters should be either really old (e.g. Donald and even HD&L) or most probably already dead (e.g. Grandma Duck and Scrooge himself)!*** According to Don Rosa's unofficial timeline, Scrooge died in 1967, at the age of 100. If that should make Scrooge fans upset, it might help to consider that Don Rosa's earlier stories showed Scrooge's ancestors, as well as his father, living content on as ghosts, meaning Scrooge would likely do so as well. * What's going to happen with all of Scrooge's money and businesses around the world after he passes away? Apparently it all goes to Huey, Dewey and Louie as they are smart and sensible enough to take care of it, but assuming they're in their teens, or at most, are young adults when the time comes, it can't turn out a very healthy life for the three having such massive wealth and responsibilities on their backs the rest of their lives. ----


text:
- Filed Under
Jazz and blues pianist Roddy Barnes is making a return trip to Wayne Theatre Alliance's Gateway this week.
"We are more than happy to have Roddy back for a special concert," said Clair Myers, producer of WTA's Gateway. "We jumped at the chance to have him and his blues piano fill our space again."
Although he is now known as a blues and jazz pianist, Roddy Barnes was trained as a classical pianist. He made the transition to blues and jazz during study in France and subsequent graduate work at the Berklee School of Music in Boston. He then moved to New ...


text:
Thanks for redeeming.{{else}}
Success! Thanks for repurchasing.{{/if}} {{else}} {{#if Expired}}
Increase my visibility!{{else}} {{#if IsMultiPack}}
{{#if HasMultiPack}} You have {{MultiPackCount}} top spot(s) left. Now loading you into the search listings... {{else}} You have used all top spots. Now loading you into the search listings... {{/if}}{{else}}
We are loading you into the search listing pages...{{/if}} {{/if}} {{/if}} {{/if}}
{{Current}} just saw you!{{/if}} {{#if LastTopSpotPurchaseIsMulti }} {{#if HasAnyTopSpot}}
{{#if HasFreeTopSpot }} {{ UnclaimedTopSpotFree }} Free {{/if}} {{#if HasPaidTopSpot }} {{#if HasFreeTopSpot }} & {{/if}} {{ MultiPackCount }} {{/if}} Top Spot{{#if Plural}}s{{/if}} Left{{else}}
0 Top Spot{{#if Plural}}s{{/if}} Left{{/if}} {{else}} {{#if HasFreeTopSpot }}
{{ UnclaimedTopSpotFree }} Top Spot{{#if Plural}}s{{/if}} Left{{/if}} {{/if}} {{else}} {{#if HasResults}}
{{Current}} see you now!{{else}} {{/if}} {{/if}}
You can now invite anyone to meet at your favorite Starbucks.
Limited-time feature
36 year old woman | Oakland, CA, USA | Seeking men 30-40 within 30 miles
Not sure what I'm looking for, but I'll know it when I find it...
Quick summary and in no particular order: I prefer dive bars over nightclubs, beer over cocktails, and I always ride roller coasters with my hands up. I love photo booths. I'm pretty good at karaoke and relatively good at DIY crafts. I actually enjoy instant coffee. I'm SUPER punctual. I throw great dinner parties. I have an amazing family back on the east coast, and an eclectic chosen family out here on the west coast. I wouldn't trade either family for anything in the world. Surprise, surprise... I'm an extrovert and love to make people laugh. Sometimes I can be overly sarcastic, which doesn't always translate well in California. At the risk of being a bay area pariah, I don't own a bike and I pretty much suck at all winter sports. At the risk of being a Bay area cliché, I do enjoy yoga and hiking (but not obsessively). I'd rather park at the back of the parking lot and walk, than drive around for 20 minutes looking for a spot. I have a lot of opinions, occasional judgments, and enjoy a spirited debate. I can also be really stubborn when I want to be. I root on the A's whenever the Red Sox aren't in town. I love Buckeye football. I realize that the Red Sox and Buckeyes are notorious for being obnoxious fans, but I like to think that I don't fit into that category. I'm tougher on the outside then I am on the inside. I'm pretty good at choosing my battles and refuse to say things that I'll have to apologize for later on. I moved 7 times in 10 years (during my 20's), resulting in now being able to say that I've driven cross country 3 times by myself. This makes me a good road trip buddy who can read an actual map made out of paper. I say the word "wicked" just to slight the word "hella". I collect coffee mugs.
Camping , Coffee and conversation , Dining out , Hobbies and crafts , Movies/Videos , Museums and art , Exploring new areas , Performing arts , Travel/Sightseeing , Wine tasting
Dancing, Hockey, Other types of exercise, Walking / Hiking
I exercise 1-2 times per week.
I have Cats
The Ohio State University, Columbus, OH
TV: Wilfred, Arrested Development, Chopped Music: Motown, Country (don't judge me), Indie Rock, and everything in between (except Metal. Never got into that) Movies: Idiocracy (hands down favorite movie of all time)
Tis' the season for college football, so that's a popular Saturday activity for me. Other than that, I think that a lot of stuff is fun and am always game for new ideas.
To Place Our Deeds: The African American Community in Richmond, California, 1910-1963
Z{{Cta}} {{#if HasMoreInfo}} ?{{CtaSecondary}} {{/if}}
|What she is looking for
|5'9" (175cms)
|5'10" (177cms) to 8'11" (271cms)
|Body type:
|About average
|No preference
|No preference
|Dark brown
|No preference
|No preference
|Social Drinker
|No preference
|Nonprofit / Volunteer / Activist
|Artistic / Creative / Performance, Executive / Management, Financial / Accounting / Real Estate, Labor / Construction, Legal, Medical / Dental / Veterinary / Fitness, Political / Govt / Civil Service / Military, Self-Employed / Entrepreneur, Technical / Science / Computers / Engineering, Other profession, Nonprofit / Volunteer / Activist, Law enforcement / Security / Military, Architecture / Interior design
I'm a clinical social worker, aka therapist (mental health). I specialize in trauma with kids of all ages 0-18. Presently I'm designing a clinical program for high risk adolescents involved with the juvenile justice system.
|I'll tell you later
|No preference
|Never Married
|Never Married, Widow / Widower, Divorced
|Have kids:
|No preference
|Wants kids:
|Definitely, Someday
|White / Caucasian
|No preference
|No preference
|Graduate degree
|Bachelors degree, Graduate degree, PhD / Post Doctoral
I was an enigma in undergrad; a sorority girl/women's studies major. My master's degree is in Social Work.


text:
Skip to Content - Skip to Navigation
Home > News and Events > IUP News
News and Events
Fraternity members raised $1,500 for the 2011 Movember project, a national men's health awareness event.
"Movember" refers both to the month of November, when events are traditionally held, and to the slang term for mustache, "mo." During November, men are encouraged to "grow their mos" to raise awareness about men's health.
To raise the funds, the fraternities held several events, including a "pack the house" in November for a men's basketball game, a bowling tournament, and a Movember Gala to show off the mustaches they grew during the month. The money will go to the national Movember Foundation, which works to raise awareness of and funds for men's health issues, such as testicular and prostate cancers.
Movember mustaches were grown in the styles of Mario (of video game fame), samurai warriors, and others. Men competed in several categories during the Movember Gala.
IUP's Health AWAREness program also provided information about men's cancers in support of Movember throughout the month.
Greek Life
Posted on 12/16/2011 3:35:44 PM
IT Support Center
Map, Directions,and Parking
Contact Us
Emergency Information
Site Map
Privacy Statement
IUP AthleticsGet schedules, scores, & more
Follow IUP on Social Media
More IUP Social Media
© 2007–15 Indiana University of Pennsylvania 1011 South Drive, Indiana, Pa. 15705724-357-2100 Fraud, Waste, and Abuse Hotline
Your campus companion, updated. Available for Apple and Android devices.


text: Making Rochester a Healthier Community Our mission: To join forces with the community to eliminate health inequalities and improve health through research, education, and service. The Center for Community Health was established by the University of Rochester Medical Center to develop and expand academic-community health partnerships dedicated to improving the health of our community. It represents a new model of institutional commitment to community health that focuses on prevention. View our 2012-2013 Annual Report. Programs and Services Community Partnerships Health Policy UR Lifestyle Management Programs Education Upcoming Events PUBLIC HEALTH GRAND ROUNDS - Thank you for making our 2014-15 Grand Rounds season a successful one! Check back for details on next year's schedule, which will begin in September 2015. GOT HEALTH? TALKS - Stay tuned for information on upcoming talks.


text:
Narrow your search
Last year, a group of fans created an impromptu birthday tribute to Nick Kristof, the crusading New York Times columnist. Time for the 2013 version.
Fans of the two-time Pulitzer Prize-winning New York Times columnist are using social media to celebrate his birthday -- and to bring attention to some good causes.
BlogTalkRadio looks to expand
BlogTalkRadio lets anyone create their own radio show.
How to be Howard Stern: BlogTalkRadio
Alphabetical list of all 300 Webware 100 finalists. Vote now!
Listen to podcasts on your phone instead of your iPod.