text:
Networks of neurons perform complex calculations using distributed, parallel computation, including dynamic "real-time" calculations required for motion control. The brain must combine sensory signals to estimate the motion of body parts using imperfect information from noisy neurons. Models and experiments suggest that the brain sometimes optimally minimizes the influence of noise, although it remains unclear when and precisely how neurons perform such optimal computations. To investigate, we created a model of velocity storage based on a relatively new technique–"particle filtering"–that is both distributed and parallel. It extends existing observer and Kalman filter models of vestibular processing by simulating the observer model many times in parallel with noise added. During simulation, the variance of the particles defining the estimator state is used to compute the particle filter gain. We applied our model to estimate one-dimensional angular velocity during yaw rotation, which yielded estimates for the velocity storage time constant, afferent noise, and perceptual noise that matched experimental data. We also found that the velocity storage time constant was Bayesian optimal by comparing the estimate of our particle filter with the estimate of the Kalman filter, which is optimal. The particle filter demonstrated a reduced velocity storage time constant when afferent noise increased, which mimics what is known about aminoglycoside ablation of semicircular canal hair cells. This model helps bridge the gap between parallel distributed neural computation and systems-level behavioral responses like the vestibuloocular response and perception.
- sensory estimation
- Bayesian
- particle filter
the brain uses networks of neurons to perform complex calculations using distributed, parallel computation, including the calculations required for dynamic motion control of the body, which, in turn, relies on estimating motion using sensory cues from afferent signals that are noisy, complementary, sometimes ambiguous, and could carry incomplete information. It has been proposed that the brain processes and combines vestibular cues using internal models (e.g., Angelaki et al. 2004; Angelaki and Cullen 2008; Borah et al. 1988; Bos and Bles 2002; Droulez and Darlot 1989; Glasauer 1992; Green et al. 2005; Laurens and Angelaki 2011; Laurens and Droulez 2007; MacNeilage et al. 2008; Merfeld et al. 1993, 1999; Merfeld and Zupan 2002; Mergner and Glasauer 1999; Newman 2009; Oman 1982; Paulin et al. 2004; Paulin 2005; Selva 2009; Selva and Oman 2012; Young 2011; Zupan et al. 2002) that reflect the influence of neural noise (Borah et al. 1988; Laurens and Angelaki 2011; Laurens and Droulez 2007; Merfeld et al. 1993; Oman 1982; Paulin et al. 2004; Paulin 2005; Selva 2009; Selva and Oman 2012) and that the brain fuses cues optimally (Borah et al. 1988; Ernst and Banks 2002; Laurens and Droulez 2007; Paulin et al. 2004; Paulin 2005; Selva 2009; Selva and Oman 2012). For example, it has been suggested that a goal of "velocity storage" (the elongation of the time constant of vestibular responses) is to reduce the effects of noise (Borah et al. 1988; Laurens and Angelaki 2011; Laurens and Droulez 2007; Oman 1982; Selva 2009; Selva and Oman 2012), a connection that we explore in this report. Furthermore, velocity storage has been implicated in sensory fusion (Green et al. 2005; Green and Angelaki 2003; Merfeld et al. 1993; Raphan et al. 1977; Raphan and Cohen 2002) of cues from organs located in the inner ear: the semicircular canals (SCCs), which transduce angular acceleration, and the otolith organs, which transduce the combined influence of linear acceleration and gravity (Fernandez and Goldberg 1976). Although psychophysical experiments have suggested that the brain does, at least under some circumstances, optimize sensory fusion based on neural noise (Ernst and Banks 2002; Gu et al. 2008), it is unclear how neurons perform these computations, especially in dynamic settings.
This report describes a new approach combining "internal models" with techniques to optimize neural computation based on noise. An internal model is a representation within the central nervous system (CNS) of sensorimotor dynamics. We extended a previous model of spatial orientation estimation that uses otolith and SCC cues (e.g., Merfeld et al. 1993; Merfeld 1995; Merfeld et al. 2005a, 2005b). We focused on velocity storage, which was originally defined by the prolongation of the decay of perceptual and oculomotor responses (Raphan et al. 1977; Robinson 1977) beyond the decay time constant of the SCC afferent response. Velocity storage was one of the emergent properties of the Merfeld et al. (1993) model, so we build on this framework.
Internal models can be broadly categorized as forward and inverse models (Jordan and Rumelhart 1992; Zupan and Merfeld 2005). A forward model predicts the output of a system for a given input, whereas an inverse model determines an input that could have caused a particular output. For example (Zupan and Merfeld 2005), a forward model of a physical relationship would use head rotation about a non-Earth-vertical axis to estimate the change in the direction of gravity relative to the head, since the head rotation is changing the relative direction of gravity. On the other hand, an inverse model could use the change in the direction of gravity relative to the head to estimate head rotation, since the latter is causing the former. A physiological example of a forward model would be one that uses head rotation about an Earth-vertical axis to estimate SCC afferent firing rate. The associated inverse model would use SCC afferent firing rate to estimate head rotation.
Dynamic vestibular modeling has been applied using both forward and inverse internal models. (See Table 1 for a comparison of some of the models described below.) While many models explain behavior by incorporating inverse models (e.g., Droulez and Darlot 1989; Laurens and Angelaki 2011; Laurens and Droulez 2007; Zupan and Merfeld 2005), using exclusively forward models has several advantages that could make them better choices for neural implementation (Jordan and Rumelhart 1992; Miall and Wolpert 1996; Wolpert and Ghahramani 2000). For example, if the physical relationship has a many-to-one mapping, inverse models may have an infinite solution space, or no solution at all (Jordan and Rumelhart 1992), whereas forward models will always have a single solution. A simple example is the human arm, where a forward mapping transforms joint positions to hand position, and an inverse mapping uses hand position to determine joint positions. In this case, there are many different places the elbow could be, resulting in a huge solution space for joint positions. Similarly, there are certain hand positions that are close together that require completely different joint positions (e.g., running a finger down one's spine). Modeling inaccuracies are less computationally disruptive to a forward model than an inverse model (Jordan and Rumelhart 1992). For example, a small amount of noise in hand position near these transition points can result in a very different solution of joint positions, or no solution at all. However, a small amount of noise in joint positions will cause only small changes in hand position. Those applying forward models alone include models based on observer theory (Merfeld et al. 1993; Newman 2009) and optimal observer theory, including Kalman filters (Bilien 1993; Borah et al. 1988; Kalman 1960; Kalman and Bucy 1961; Pommellet 1990; Selva 2009; Selva and Oman 2012). The goal of an observer is to estimate the state of a dynamic system by updating the state of an internal model of the system (the "observer") (Luenberger 1971). It compares the noisy measurements of the actual system (i.e., afferents conveying noisy information from the vestibular periphery) with the predicted measurements provided by the internal model in the CNS and uses the comparison to update the state of the model. These differences are also known as sensory conflict signals (Oman 1982) and are often used in feedback loops after being multiplied by observer gains. These gains control the tradeoff between rejecting noise and the responsiveness of the internal model to new information. In our observer model (Merfeld et al. 1993), a single observer gain vector allows the model to correctly reproduce vestibuloocular responses (VORs) to a variety of motions (Merfeld 1995; Merfeld et al. 1999, 2005a; Merfeld and Zupan 2002).
Optimal observer theory provides a link between noise levels and the observer gain for linear systems. Specifically, Kalman (Kalman 1960; Kalman and Bucy 1961) proved that a Bayesian optimal filter gain can be calculated for a linear system, which balances the goals of attenuating noise while making the internal model update quickly. The Kalman filter minimizes the mean squared error between the estimated and actual states of the system for a linear system with Gaussian noise. Vestibular models applying Kalman filtering (Bilien 1993; Borah et al. 1988; Paulin et al. 1989; Paulin et al. 2001; Pommellet 1990; Selva 2009; Selva and Oman 2012) show how the brain could incorporate information about noise into dynamic sensory processing (Table 1, Kalman filter).
Particle filtering is a relatively new technique (e.g., Arulampalam et al. 2002; Bolic 2008; Daum 2005; Doucet et al. 2001; Gordon et al. 1993) that applies parallel computations to a distributed set of "particles." These particles are sample values that propagate through a recursive estimator, with each particle in the set differing slightly because of randomly sampled noise values. Together the particles form and propagate a probability distribution, in contrast with the Kalman filter, which propagates only a signal with its estimated variance. Particle filters use sequential Monte Carlo techniques, since they simulate a system many times using actual sampled noise, and can approach Bayesian optimality, when they incorporate optimal Bayesian computations and parameters and techniques are well chosen (Arulampalam et al. 2002). The particle filter technique is an attractive method for modeling dynamic processing in the brain, since its distributed, parallel computations resemble the distributed, parallel nature of neural processing. This approach provides a crucial link for understanding the gap between behavior and parallel, distributed neural computation (Paulin et al. 2004; Paulin 2005). Another advantage of particle filtering is that it is usually better than Kalman filters when applied to nonlinear systems, a feature that has been applied recently to processing of vestibular dynamics (Laurens and Droulez 2007, 2008; MacNeilage et al. 2008; Paulin et al. 2004; Paulin 2005). These specific models relate responses to the modeler's selection of variances for the Gaussian motion prior distribution and measurement likelihood, loosely analogous to the specification of the two noise parameters in the Kalman filter (Table 1, Laurens particle filter and Paulin particle filter). The major disadvantage of the particle filter is that it is computationally intensive using conventional digital computing approaches, although this can be partly mitigated through careful parameter selection (Daum 2005; Daum and Huang 2002).
In this report, we describe our particle filter (Table 1, this particle filter). To our knowledge, this is the first dynamic, vestibular application of a particle filter with only forward internal models, in contrast to past reports, which incorporated one or more inverse calculations (Laurens and Droulez 2007, 2008; MacNeilage et al. 2008; Paulin et al. 2004; Paulin 2005). Another difference is that our particle filter does not explicitly implement Bayes' rule but rather uses transformations derived from the Kalman filter. Unlike other models (Laurens and Droulez 2007; Paulin and Hoffman 2011), our particle filter does not use resampling, a process that helps the set of particles accurately represent the underlying distribution by continually eliminating particles that correspond to parts of the distribution that have low probabilities and adding particles that correspond to parts of the distribution that have high probabilities (Arulampalam et al. 2002). Our particle filter simulates the vestibular observer (Merfeld et al. 1993; Oman 1982) many times in parallel. As with Kalman filters (Bilien 1993; Borah et al. 1988; Paulin et al. 1989, 2001; Pommellet 1990; Selva 2009; Selva and Oman 2012) and other particle filters (Laurens and Droulez 2007, 2008; MacNeilage et al. 2008; Paulin et al. 2004; Paulin 2005), the responses of our particle filter depend on noise properties: the distribution of the parallel particles is used to calculate the particle filter gain. This resembles neural computation because the computations are distributed and parallel in nature. Indeed, we draw on this correspondence by loosely assuming that each particle in our model represents a neuron, which allows us to constrain model parameters using published neural data. We have implemented our particle filter for Earth-vertical yaw rotation. This simple, linear model involves a single SCC plane and no dynamic otolith stimulation. The sensory dynamics in the model have a single input (physical angular velocity) and a single output (afferent firing rate). The model has three free parameters that are uniquely constrained by experimental data: we developed an iterative tuning procedure that adjusted the free parameters so that model estimate metrics match three experimental constraints. This contrasts with past vestibular modeling efforts that incorporated noises in which a family of parameters could result in a given gain (Borah et al. 1988; Laurens and Droulez 2007; MacNeilage et al. 2008; Paulin et al. 1989). However, those models could also be constrained to unique solutions by using additional experimental constraint (Laurens and Droulez 2007; MacNeilage et al. 2008; Paulin et al. 1989), such as in our approach of using the variability of the output of the model, which has also been alluded to by others (Laurens and Droulez 2007; MacNeilage et al. 2008). The model determines a time constant of velocity storage that matches experimental studies based on the noise level of sensory afferents that are derived from experimental studies. This shows that this distributed, parallel computational approach implemented using a forward internal model reproduces experimental results based on noise levels. The model's velocity storage time constant also decreases when measurement noise increases. Furthermore, we found that the particle filter gain matches the Kalman filter gain, showing that this vestibular particle filter can yield near-optimal performance.
Our particle filter is a logical progression of both the observer and Kalman filter. To justify the design of our particle filter, we will begin by explaining the structure of the observer and Kalman filter. Since particle filters approach optimality only when appropriately designed (Arulampalam et al. 2002), we also used simulations of the optimal Kalman filter to serve as a baseline for evaluating the optimality of our particle filter. After describing the development of our particle filter model, we describe the iterative tuning procedure that was used to select the three model free parameters so that the model estimate metrics matched three experimental constraints. The iterative tuning procedure was used to constrain the model when incorporating the properties of regular or irregular neurons.
The major difference between the three models is in the way the filter gain [K(t)] is computed at each time step. In the observer model, K(t) is chosen by the designer based on dynamic considerations and/or noise, and in the Kalman filter, it is computed using the Riccati equation based on knowledge of the system dynamics and noise statistics. In contrast, the particle filter gain K(t) is computed by propagating actual sampled noise through the system.
Model of the sensor.
The SCCs, located in the inner ear, measure angular rotation of the head. Although three SCCs in each ear measure angular rotation in three approximately orthogonal planes, in this model we focused on yaw rotation, which is transduced by the two parallel horizontal SCCs. As in most earlier models (e.g., Borah et al. 1988; Merfeld et al. 1993; Newman 2009; Oman 1982; Selva 2009; Selva and Oman 2012), for simplicity, we modeled the two parallel SCCs as a single head-centered sensor.
SCC fluid dynamics can be modeled as a second-order band-pass filter where y is an output time-varying afferent firing rate scalar, d is an input time-varying angular velocity disturbance scalar, s is the Laplace variable. The slow time constant (τ1) was 5.7 s (0.18 rad/s or 0.028 Hz) (Fernandez and Goldberg 1971; Jones and Milsum 1971), and the fast time constant (τ2) was 0.005 s (200 rad/s or 32 Hz). Although the τ2 has not been measured experimentally, it has been estimated by various models to be between 0.004 and 0.010 s (Fernandez and Goldberg 1971; Groen 1957; Oman et al. 1987; Rabbitt 1999), and the specific value over that range does not affect the ability of our model to make estimates that match experimental constraints. Figure 1A shows the SCC frequency response characteristics for this second-order model and compares the dynamics with a commonly used first-order model. Figure 1B shows the responses evoked by a trapezoidal velocity input. For physiologic stimuli (e.g., stimuli below 30 Hz), these two models yield nearly indistinguishable responses.
The following state-space form of the SCC model was used for the implementation of the Kalman filter: which describes dynamics as a series of first-order differential equations with multiple states. Here, x(t) is the state of the actual system and A, B, and C define the dynamics of the system. The variables for our two-state, phase-variable, canonical state-space form of the SCC, which was derived as described in appendix a, are as follows: d(t) is a time-varying scalar input representing a passive motion disturbance and y(t) is a time-varying scalar output representing afferent information.
Observer model.
The goal of an observer applied to spatial orientation is to estimate motion dynamically using afferent information from the sense organs and copies of efferent information going from the CNS to muscles (Merfeld et al. 1993). Figure 2A shows a general model that applies observer theory to sensory estimation during dynamic voluntary movement. The broad structure is that the output from motor planning in the brain follows two paths that eventually converge. The first causes body motion via muscle activation, which is contaminated by external and other unplanned motion, sensed by imperfect organs, and carried to the brain by noisy afferent neurons. The second path, the observer, is completely neural, consisting of internal models of body and sensor dynamics. The paths converge when the observer receives new information from the noisy afferent signal, which is compared with the expected afferent signal and used to guide the observer's estimate of motion toward the actual amount of motion. The observer gain (K) determines how quickly this guidance occurs; making K large allows nondeterministic motion to be quickly incorporated into the estimated state but also allows measurement noise to have a greater effect. Figure 2 details the model elements, which builds on our earlier observer model (Merfeld et al. 1993, 2005a, 2005b; Merfeld 1995; Oman 1982). In contrast with the earlier velocity storage observer model (Merfeld et al. 1993), which was deterministic, this model incorporates knowledge about noise, using conventions and assumptions commonly used for Kalman filters (Kalman 1960; Kalman and Bucy 1961). Measurement noise represents sensor inaccuracies. Physiologically, it can be interpreted as the inaccuracy introduced when a sensory organ transduces a signal and by afferent neurons that carry the signal to the brain. The mathematical analog of this interpretation is that noise is added to a signal. Process noise represents system perturbations, including but not limited to external disturbances. For the vestibular system, this includes body motion that was not commanded by the brain, from disturbances both internal and external to the body. Internal disturbances include motion due to motor noise and muscle inaccuracies, which are present even when there is no commanded motion. Examples of external disturbances include motion due to movement of an unstable surface, building vibration, earthquakes, and wind gusts. This implementation philosophically matches Kalman's original implementation where process noise represents disturbances like the influence of atmospheric turbulence on a rocket, which causes real changes in the trajectory of the rocket, but does not include commanded motion of the rocket, such as that controlled by intentional changes in thrust direction. Process noise is also often artificially increased to compensate for modeling errors, that is, inaccuracies in creating the internal models that mimic the dynamics of the physical system (Simon 2006). We assume that process noise is typically small compared with the distribution of typical head movement, since a large fraction of daily variability is controlled by the brain and known to the internal model. Movement of a subject by laboratory equipment is not controlled by the brain and thus is process noise. For reasons described below, we have separated the component of process noise due to the experiment as "experimental external motion."
As in earlier observer models (Merfeld et al. 1993, 2005a, 2005b; Merfeld 1995), we made the following simplifications to the observer model shown in Fig. 2A, yielding the observer model for vestibular processing during passive yaw rotation shown in Fig. 2B. First, there is no active control of the body and thus there are no muscle commands, but rather only passive perturbations. Second, only one type of sensory organ (the SCCs responding to angular velocity) is stimulated by motion, and contributions from proprioception and the otoliths are omitted. Third, body dynamics are unity because the actual motion exactly equals the passive disturbance because of experimental head restraint. Finally, the dynamics of the internal model of the sensor are identical to the actual sensor dynamics. For this one-dimensional case, process noise [w(t)] and measurement noise [v(t)] are assumed to be zero-mean Gaussian with variances Q and R, respectively.
The observer filter gain K is selected by the designer and sets the time constant of the estimated angular velocity to (K + 1) times the SCC time constant, which corresponds to the velocity storage time constant; the gain of the response is K/(K + 1) (Merfeld et al. 1993). In experimental studies of velocity storage, ocular responses to rotation decay with an average time constant between 14 and 35 s (Dimitri et al. 2001) and ocular and perceptual responses could rely on a common velocity storage mechanism (Bertolini et al. 2011; Okada et al. 1999). Setting K = 3.0 yields a time constant of 23 s. Figure 3 shows the frequency and temporal responses of the observer. The temporal response demonstrates the tradeoff between noise and bandwidth. When K is large, the observer's estimate is closer to the actual angular velocity, but noise is greater. When K is small, the estimate is less noisy, but it decays more quickly. This also demonstrates that the velocity storage time constant, the rate of decay of the estimated angular velocity, is proportional to K.
Kalman filter model.
Kalman and colleagues (Kalman 1960; Kalman and Bucy 1961) developed a way to select the Kalman filter gain K(t) that is an optimal tradeoff between reducing noise in the estimate and how quickly the estimate responds, by minimizing the root mean square (RMS) difference between the actual and estimated state. The Kalman filter (Fig. 4A) calculates K(t) based on the process and measurement noises specified by the designer. Since the Kalman filter structure is the same as the observer (they differ only in how K is calculated), the velocity storage time constant is also (K + 1) times the SCC time constant. Thus, there is an explicit link between the velocity storage time constant and noise characteristics.
K(t) is determined in two steps. The first is to solve the following Kalman Riccati equation: where P(t) is the covariance of difference between the states of the actual system and the internal model, A and B define the dynamics of the system, T is the transpose operator, Q is the variance of process noise, and R is the variance of measurement noise. Second, for uncorrelated stationary process and measurement noise, K(t) = P(t)CTR−1, which is essentially the ratio of P(t) to R.
Often the estimator's parameters do not perfectly reflect the actual system. In particular, we assumed that Q may reflect the long-term statistics of process noise and that in the short term it may not reflect the actual statistics. This is particular true in the laboratory situation in which head-restrained subjects experience movement not controlled by the brain. Since this is outside of the usual disturbances experienced by the brain, it is not certain that the brain would incorporate these statistics into its internal model (although frequent research subjects may be an exception). To incorporate this into our simulations, we separated the component of process noise due to the experiment as experimental external motion. This allowed us to distinguish between actual process noise and Q specified by the modeler of which the internal model is aware but which does not include experimental external motion.
The sensor model we used has two states, which required that K(t) be a 2 × 1 vector and P(t) a 2 × 2 matrix. x2 depends directly on the input, whereas x1 is influenced by the input only via x2, and thus the first element of K(t) is effectively zero [K11(t)]; this in turn forces all but one element of P(t) to zero [i.e., P11(t), P21(t), and P12(t) equal zero]. Thus, we propagated and stored only scalars K21(t) and P22(t) and set other values to zero. Simulations with and without this simplification showed no noticeable difference. Since our system dynamics and noise properties do not vary with time, K21(t) converges to a steady-state scalar (Kss).
Particle filter model.
Like the Kalman filter, our particle filter (Fig. 4B) is also based on the observer model structure. In contrast with the Kalman filter, the particle filter gain K(t) is computed by propagating actual noise through the system multiple times in parallel and measuring the distribution of the particles after they have passed through the system dynamics. Process and measurement noises are sampled for individual particles and are assumed Gaussian and mutually uncorrelated. We chose to formulate noise sources in the same form as the Kalman filter to facilitate comparisons with the Kalman filter, although with our particle filter there is flexibility in the location and number of noise sources.
More specifically, for a particle filter, the system calculations are performed many times in parallel, once for each "particle." At each time step, the state error covariance P(t) is approximated using the covariance of the particles, yielding the estimate P̂(t). K(t) is then calculated using the following formula: K(t) = P̂(t)CT × R−1, as for the Kalman filter. This requires the assumption that the internal model has learned the noise properties, which is common to most, if not all, vestibular models (e.g., Borah et al. 1988; Laurens and Droulez 2007; Paulin et al. 1989). Since the particle filter transfer functions are the same as the observer and Kalman filters, the velocity storage time constant is also (K + 1) times the SCC time constant.
P̂(t) is required to calculate K(t). As in the Kalman filter, P̂(t) is an estimate of the covariance of the state error x̃(t) = x(t) − x̂(t),which is the difference between the state of the actual system [x(t)] and internal model estimate [x̂(t)]. The Kalman filter analytically estimates P(t) = E[x̃(t)x̃(t)T] = E[(x̂(t) − x(t)) x̂(t) − x(t)]T, where E is the expected value operator. In our model, the state of the actual system is not available, nor can the error covariance be computed analytically as in the Kalman filter. As an alternative, we noted that the mean of the particles of the state estimate was the best available approximation of the state of the actual system, i.e., x(t) ≈ E[x̂(t)], so that for particles x̂i(t),x̂j(t), where i,j ∈ 1 …N and N is the number of particles.
K(t) converges to steady state, with the exception of small random variability related to the noise present. For comparison with the Kalman filter, scalar steady-state particle filter gain (Kss) was calculated for a range of noise characteristics by averaging K21(t) over time after steady state was attained.
A distinction between our particle filter and other particle filters (Arulampalam et al. 2002; Doucet et al. 2001; Laurens and Droulez 2007; Paulin et al. 2004; Paulin 2005) is our implementation. Most particle filters implement Bayes' rule explicitly for each particle. In our particle filter, we implicitly implemented Bayesian optimal weighting via the Kalman gain calculation K(t) = P̂(t)CT × R−1, since the Kalman filter is Bayesian optimal (see also Gelb 1992; Kalman 1960; Kalman and Bucy 1961; Simon 2006). Another distinguishing characteristic of our particle filter is that resampling was not used; we describe our rationale in the discussion. In addition, during simulation of our particle filter, each particle has an independently sampled process noise and measurement noise chosen from a normal distribution. Our particle filter, as with most particle filters, differs from most Monte Carlo simulations in that the parallel simulations interact with each other at each time step. Typical Monte Carlo simulations run independently of each other, and the results are compiled at the end.
Regular versus irregular neurons.
Experimental data on SCC afferent neural noise are available for both regular and irregular neurons (Sadeghi et al. 2007), and we were interested in how our particle filter would be impacted by the properties used. There is evidence that irregular neurons play an important role in vestibular pathways despite their higher noise, which justifies their consideration in this model: vestibular nuclei neurons that take inputs from both regular and irregular neurons have thresholds closer to irregular neurons (Massot et al. 2011). In each simulation, we included the properties of either only regular neurons or only irregular neurons, leading to lower and upper bounds for the affected free parameters. Including regular and irregular neurons together would have added an additional free parameter to the model reflecting the relative proportion of the two, and the experimental data are not available to constrain this parameter.
Model free parameters and iterative tuning procedure.
Our particle filter has three free parameters, which are uniquely set using an iterative tuning procedure. In this tuning procedure, the free parameters are manually adjusted by the model designer, then the model simulates estimated responses. Three model estimate metrics are computed based on the estimated responses and compared with published experimental data, which we refer to as experimental constraints (Table 2). The iterative tuning procedure continues until the three model estimate metrics match experimental constraints to at least two significant digits; to confirm an accurate correspondence, we averaged model estimate metrics across 200 simulations and also computed their SD. In addition, a broad grid-based search of the parameter space confirmed that only a single set of free parameters resulted in model estimate metrics that matched the experimental constraints. One of the experimental constraints corresponds to whether the properties of regular or irregular neurons are used; changing it and applying the iterative tuning procedure resulted in changes in all three free parameters (Table 2).
The first and second free parameters are process noise variance Q and measurement noise variance R. The third free parameter is the number of particles (N). Table 2 shows the values of the free parameters derived from the iterative tuning procedure.
The first of the three experimental constraints is on Kss of the particle filter. As with the observer, we used Kss = 3.0, which yielded a time constant of 23 s, which is approximately the population mean of measured responses for 35-yr-old normal subjects (e.g., Dimitri et al. 2001).
The second experimental constraint is the noise on an individual SCC afferent, which we relate to the noise on an individual particle. Individual afferent noises are derived from neural threshold data from macaque nonhuman primates; thresholds for individual SCC neurons were shown to average 4.0 ± 1.0°/s for regular afferents and 8.7 ± 1.0°/s for irregular afferents over frequencies of 0.5 to 15 Hz (Sadeghi et al. 2007). For the threshold criterion used (d′ = 1), this corresponds to noise SDs of 4.0 and 8.7°/s, respectively. In our particle filter, this value corresponded to the SD of the particle population at each time step, averaging over time, using the particles at the point after measurement noise is added [z(t) in Fig. 4B].
The third experimental constraint is the noise on the estimate of angular velocity from the internal model, which we derived from psychophysical measurements of thresholds. Behavioral thresholds are lower than thresholds for individual neurons, likely in part because of convergence and averaging of information from multiple afferents. Specifically, the threshold for yaw rotation recognition in humans plateaus at 0.71°/s for frequencies of 0.5 Hz and higher (Grabherr et al. 2008), when the threshold is measured using a three-down, one-up paradigm resulting in a 79.4% recognition rate (Leek 2001). For this threshold criterion (d′ = 0.82), this corresponds to a noise SD of 0.87°/s for behavioral responses after convergence. In our particle filter, this value corresponded to the SD over time of the angular velocity estimate [ω̂(t) in Fig. 4B].
In our particle filter, noise estimate metrics for afferents and behavioral responses were calculated using particles during the time that the system was in steady state, before the commencement of motion. The values of process noise, measurement noise, and N were manually varied iteratively to yield afferent and behavioral noise SDs that match those found in the literature, as outlined above.
Although we confirmed that only a single set of free parameters satisfied the constraints using a grid-based search, this can also be understood intuitively. We observed that afferent noise is basically a weighted sum of process and measurement noises and that K increases as R decreases and Q increases. Thus, in R versus Q space, the R versus Q solution space to constrain afferent noise is a line with a negative slope, and to constrain K it is a curve with a slope that varies but is always positive. There can only be one intersection between these solutions, so there are unique solutions for R and Q. With R and Q fixed, the estimated noise decreases monotonically as N increases, so there can only be one solution for N.
Changing measurement noise.
Certain physiological and pathological changes can be understood in the context provided by changes in afferent response. We modeled afferent changes by increasing measurement noise and simulating the model to see if the model estimates change in a similar manner to changes in patients. Although definitive experimental data correlating changes in afferent noise with behavior are not available, a few studies on vestibular hair cell ablation have shown that changes in afferent noise may cause changes in behavior.
Aminoglycosides, such as gentamicin, are used to ablate vestibular function in patients with peripheral vestibular disorders, such as Meniere's disease; vestibular loss is also sometimes a side effect of systemic aminoglycoside use to treat severe infections. In patients with bilateral aminoglycoside ablation, velocity storage time constants typically fall to well below the SCC time constant; for example, one study found an average time constant of 1.7 ± 0.9 s (Ishiyama et al. 2006). The same study found that VOR gain had also greatly decreased. For sinusoidal motion, VOR gain ranged from 0.08 at 0.05 Hz to 0.45 at 0.8 Hz. For high acceleration step stimuli (head thrusts), the average VOR gain was 0.27. Gentamicin acts by destroying SCC hair cells, which causes changes in the responses of the afferents innervated by those hair cells, although the function of the afferents themselves is not affected by gentamicin (Hirvonen et al. 2005). The reduced population of hair cells converging on each afferent could lead one to expect a change in the noise of the afferent responses, which is what occurs in chinchilla: the SD of the interspike interval lognormal distribution for irregular neurons increases (Hirvonen et al. 2005), although it does not change for regular neurons. While these studies were on different species (human vs. chinchilla) and there is no way to compare the relative doses, they do suggest that increased afferent noise may result in a lowered time constant.
We ran simulations with irregular neurons and adjusted measurement noise on each particle so that it was slightly higher. This mimicked the experimental results that showed higher noise with gentamicin treatment. Our hypothesis was a lowered K(t) and thus a lowered velocity storage time constant as well as a lowered VOR gain.
The overall algorithm for executing the particle filter is shown in Table 3. For the first second of the simulation, particle filter gain K(t) was held constant with an initial condition and then released and allowed to converge. Input angular velocity was held at zero for 10 s to allow K(t) to stabilize. We tested our particle filter with trapezoidal inputs in which the velocity increased from 0 to to 90°/s in 1 s as well as with sinusoids to characterize the frequency response.
A major concern in our simulations was numerical stability, since our simulations propagate actual sampled noise through the model, in contrast to many other techniques such as the Kalman filter (Kalman 1960; Kalman and Bucy 1961) and the unscented Kalman filter (Julier and Uhlmann 2004), which propagate only the statistics of the noise. Applying Euler integration with a large time step resulted in high-frequency random noise quickly building to instability. To improve numerical stability, white measurement and process noises were low-pass filtered with a first-order filter with a cutoff of 400 Hz. The noise SDs that we report were measured after this filtering, since this is the actual RMS noise input to the model.
Simulations were implemented in Matlab 7.8 (The Mathworks) on the Harvard Orchestra computation cluster. To improve efficiency, key sections of the simulation were implemented in C++, compiled using gcc, and incorporated into Matlab using the Mex linker. Models were derived in continuous time and implemented as discrete approximations of continuous time systems. Euler integration was used for particle filter simulations using a timestep of 1/8,000 s. K(t) was averaged over a short period of time (i.e., 50 ms) to reduce the effects of random fluctuations in the selection of noise values that could cause unstable positive feedback. While 33 particles resulted in the simulation being stable and matching experimental results, more particles would likely be required if the system dynamics had more states (Daum and Huang 2002). Simulations were run on an IBM BladeCenter HS21 XM with a 3.16-GHz Xeon processor and 8 GB of RAM, although Matlab used only a single processor core. A typical simulation took 12 s with 33 particles for an estimate lasting 100 s.
For simulations of the Kalman filter, the steady-state Kalman filter gain was computed by iteratively solving the Riccati equation. Since process and measurement noises did not vary with time, it was necessary only to allow the Riccati equation to converge before the simulation and not to continuously solve it during the simulation.
Velocity storage is reproduced by our particle filter (regular neurons).
Figure 5A shows that our particle filter reproduces velocity storage for yaw rotation about an Earth-vertical axis, which stimulates the SCC without any dynamic otolith stimulation. Angular velocity rapidly ramped to a constant-velocity rotation. In Fig. 5A, the SCC afferent responses are represented by particles (dark gray cloud) whose distribution at each time step arises because each particle has unique noise. The responses rapidly increased during the velocity ramp, then, as the velocity plateaued, the particles, on average, decayed with a time constant of 5.7 s (i.e., the slow SCC time constant). For the specified Q and R, each SCC afferent had a SD of 4.0°/s, matching the experimental constraints for a regular afferent (Table 2). The particle filter gain (Fig. 5B) converged to a steady-state value in <0.25 s and then continued to have random fluctuations about an average of Kss = 3.0. We found that the particle filter's Kss was not dependent on the initial value of K(t) over a broad range of initial conditions, which we empirically found ranged from ∼0.55 to 79. The particles representing the brain's estimate of angular velocity (light gray cloud in Fig. 5A) showed a prolonged time constant of velocity storage; in this example, 23 s. This time constant was in the range of 14 to 35 s for normal 35-yr-old human subjects (Dimitri et al. 2001). It was also consistent with other models (Borah et al. 1988; Merfeld et al. 1993; Raphan et al. 1977; Robinson 1977). The overall estimated angular velocity (solid line in Fig. 5A) was calculated as the mean of the particles and decayed with the same time constant of 23 s. The estimated angular velocity had a SD of 0.87°/s, equal to the experimental value of 0.87°/s (Table 2). We quantified the repeatability of the particle filter by measuring the SDs of the three metrics across 200 simulations and found that they were 0.054 on K (1.8% of the mean), 0.009 on afferent noise (0.23% of the mean), and 0.016 on the variability of the estimated angular velocity (1.8% of the mean).
Figure 6 shows the mean gain and phase characteristics of our particle filter (circles) versus frequency and compares it with the theoretical predictions (solid line) for velocity storage modeled as a first-order high-pass filter with a time constant of 23 s. Figure 6 shows that the frequency response of our particle filter is consistent with theoretical velocity storage across a broad range of sinusoidal frequencies. It also shows that the extension of the low-frequency dynamics for the particle filter compared with the SCC afferents (dashed line).
Using irregular neurons increases the number of particles required.
To model how the particle filter parameters would change if it incorporated irregular, rather than regular, neurons, we changed the experimental constraint on the SD of afferent noise from 4.0 to 8.7°/s (Sadeghi et al. 2007) and applied the iterative tuning procedure to adjust the three free parameters. Figure 7 shows the response estimates for irregular neurons. The free parameters that fit the adjusted constraints (Table 2) were a process noise SD of 14°/s, a measurement noise SD of 3.6°/s, and N of 158. Thus, with the higher afferent noise associated with irregular neurons, five times more particles are required to fit the behavioral noise constraints, a number that is still physiologically plausible as it is well below the estimated 1,800 fibers innervating each SCC (e.g., Bergstrom 1973; Lopez et al. 2005). We quantified the repeatability of the particle filter by measuring the SDs of the three metrics across 200 simulations and found that they were 0.025 on K (0.82% of the mean), 0.009 on afferent noise (0.11% of the mean), and 0.014 on the variability of the estimated angular velocity (1.6% of the mean).
Velocity storage is reproduced by the Kalman filter.
Figure 8 shows that the Kalman filter reproduces velocity storage for yaw rotation about an Earth-vertical axis, consistent with previous work (Borah et al. 1988; Paulin et al. 1989). It does so with three depictions (Fig. 8, A–C) of the same simulation to demonstrate different aspects of the results. In all cases, as in Fig. 5, angular velocity rapidly ramped to a constant-velocity rotation. The process and measurement noise variances Q and R for this simulation were the same as for our particle filter (Table 2) and were used to find the Kalman gain, which is Kss = 3.0, by finding the steady-state solution of the Riccati equation. The SCC afferent response (dark gray) rapidly increased during the velocity ramp and then, as the velocity plateaued, decayed with a time constant of 5.7 s (i.e., the slow SCC time constant). The Kalman filter's estimated angular velocity (light gray) showed the prolonged time constant of velocity storage; in this example, 23 s. This time constant fell in the range of 14 to 35 s for normal 35-yr-old human subjects (Dimitri et al. 2001), which was also consistent with that found by our particle filter and by other models (Borah et al. 1988; Merfeld et al. 1993; Raphan et al. 1977; Robinson 1977). Thus, the Kalman filter is able to reproduce the dynamics of velocity storage when its properties are determined by noise characteristics from experimental data.
The three depictions in Fig. 8 demonstrate concepts relating the observer, Kalman, and particle filters. In Fig. 8A, the Kalman filter gain was calculated using Q and R, but the simulation was performed with noiseless signals. This depiction resembles the observer, although it is a Kalman filter because the Kalman Riccati equation was used to compute the Kalman filter gain. In Fig. 8B, sampled process and measurement noises were added during the simulation, yielding an afferent with the noise properties of a regular neuron. This resulted in the estimated angular velocity also having noise. This depiction showed the simulation in a way that is closer to the conceptual framework of the Kalman filter. Figure 8C shows multiple parallel executions of the Kalman filter. Although this is an unusual way to depict the Kalman filter, it demonstrates the conceptual relationship of the Kalman filter and our particle filters; despite the gains being calculated in different ways, the simulations were very similar. In this simulation, each has independent sampled noise, yielding a cloud of afferent responses at each time. This cloud's distribution has a SD that matches the experimentally measured value for a regular neuron. The Kalman filter's estimate of angular velocity for each execution (light gray) formed a cloud. When the mean was taken across the estimated angular velocity at each time, the "converged" estimated angular velocity (solid line) had reduced temporal variability. For this particular example, the number of parallel executions was 33, matching the number of particles in the simulation shown in Fig. 5, and the "converged" estimate had a SD of 0.87°/s, consistent with our particle filter and experimental data. There was one key difference between this depiction and the particle filter shown in Fig. 5: while in our particle filter the gain was calculated based on all the particles and thus there was an interaction across particles, in the Kalman filter there was no interaction between the parallel simulations.
Our particle filter calculates optimal gains.
When the particle filter and Kalman filter have the same noise properties (i.e., Q and R), the average particle filter gain (Fig. 5) and Kalman filter gain (Fig. 8) are equal. Specifically, for both the Kalman filter and particle filter, Kss = 3.0.
For a linear system, the Kalman filter will calculate the Bayesian optimal gain Kss that minimizes the RMS estimation error (Kalman 1960; Kalman and Bucy 1961). That the particle filter gains are near the Kalman filter gain on average shows that the particle filter is also approximately Bayesian optimal. Thus, in addition to reproducing experimental results using a distributed, parallel system, our particle filter roughly mimics the Bayesian optimality of Kalman filtering.
Increased afferent noise leads to reduced time constant and gain.
We found that the velocity storage time constant decreased as measurement noise increased (Fig. 9), consistent with previous Kalman and particle filters (Borah et al. 1988; Laurens and Droulez 2007; MacNeilage et al. 2008; Paulin et al. 1989). For example, the average particle filter gain K decreased from 3.0 to 2.0 when measurement noise increased 8%, causing a reduction in the velocity storage time constant from 23 to 17 s and a corresponding 12% VOR gain reduction from 0.75 to 0.67. Furthermore, K decreased to zero when measurement noise increased beyond 10%. This yielded a VOR gain of zero. K = 0 also corresponds to a time constant of 5.7 s, although this time constant has little physical meaning when VOR gain is zero. Furthermore, the noise for the estimated angular velocity became zero.
These results have some similarities with data from patients suffering severe bilateral ototoxicity (Ishiyama et al. 2006). Specifically, in these patients, VOR gain was between 0.08 and 0.45 compared with between 0.50 and 0.94 for the healthy control group (Ishiyama et al. 2006), whereas for our model VOR gain dropped from 0.75 to 0.67 when measurement noise increased moderately and then went to zero when measurement noise increased further. Furthermore, in these patients, the velocity storage time constant was 1.7 ± 0.9 s compared with 12.2 ± 3.6 s for the healthy control group (Ishiyama et al. 2006), whereas for our model it decreased from 23 s to the SCC time constant. While the patient velocity storage time constant can be below the presumed SCC time constant, the lowest possible velocity storage time constant in our model is the SCC time constant; possible explanations are provided in the discussion.
A distributed, parallel, forward model reproduces velocity storage.
We have implemented a distributed, parallel, forward model of a dynamic sensory process–"velocity storage"–using a particle filter approach. Our particle filter estimates angular velocity with characteristics that are consistent with experimental data about the time course of dynamic vestibular processing, the level of afferent noise, and the level of noise in behavioral responses.
The iterative tuning procedure we developed uses three experimental constraints to finds solutions for each of three free parameters (N, Q, and R). This results in the free parameters being uniquely constrained. This contrasts with some past vestibular models, which did not find unique solutions for the model parameters, although these studies could have done so if they incorporated experimental constraints of the variability of model estimates (Borah et al. 1988; Laurens and Droulez 2007; MacNeilage et al. 2008; Merfeld et al. 1993; Paulin et al. 1989). In contrast to previous particle filter models (Laurens and Droulez 2007; MacNeilage et al. 2008; Paulin et al. 2004; Paulin 2005), ours uses only forward models and does not include inverse models. As detailed in the Introduction, forward models have several computational advantages over inverse models that would apply to neural computation (Jordan and Rumelhart 1992; Miall and Wolpert 1996; Wolpert and Ghahramani 2000).
Our particle filter computes a time course of vestibular processing that is Bayesian optimal for the noise parameters Q and R. This was verified by testing whether the Kalman filter and our particle filter produce the same average time constant for the same noise parameters. While this may seem unsurprising since the particle filter incorporates optimal computations, in actuality the particle filter is an approximate, numerical technique and thus is a "suboptimal algorithm" (Arulampalam et al. 2002). In the limit the particle filter approaches optimality, but this depends on practical issues such as the number of particles and the resampling method chosen (Arulampalam et al. 2002). Thus, the similarity of the time constant to that of the Kalman filter demonstrates that, as designed, our particle filter produces Bayesian optimal results.
Relationship between particles and neurons.
We determined that N = 33 particles met the experimental constraints on the model with the noise properties of regular neurons and that N = 158 particles met the constraints with the noise properties of irregular neurons. These values serve as lower and upper bounds for the number of SCC afferents suggested by the model, since the brain presumably uses both for actual implementation. While these numbers are small compared with the roughly 1,800 primary afferents that innervate each SCC (e.g., Bergstrom 1973; Lopez et al. 2005), one experimental study suggested a similar range for the number of SCC afferents required functionally. Specifically, Massot et al. (2011) performed multiunit recordings on regular and irregular afferents and from vestibuloocular neurons and pooled spiking activity to determine the relationship between detection threshold and the number of afferents. They determined that ∼40 neurons are required to reduce detection thresholds to the levels found psychophysically and that little additional information is provided by adding more neurons. Recent data have shown that when the sensitivity of irregular neurons is considered, the signal-to-noise ratio may not be systematically lower for irregular neurons than for regular neurons, although further work is required to understand interspecies differences (Hoffman et al. 2010; Ramachandran and Lisberger 2006). While additional data might change the values of the free parameters in our model, this would not fundamentally alter our conclusions.
Bayesian optimality of our model only implies an optimal neural implementation if all assumptions match.
Experimental studies have suggested that the brain performs Bayesian optimal weighting for the integration of sensory cues (Ernst and Banks 2002; Gu et al. 2008). Despite our particle filter being a near-optimal technique and being well constrained by experimental measurements, we cannot yet argue that it supports or refutes the hypothesis that the brain optimally performs the calculations required to estimate angular velocity in the presence of noise. For example, the brain could be performing the same computations suboptimally, using 10-fold more neurons as we had particles. Providing evidence for optimal performance would require further constraints by experimental values that are not yet known, for example, the number of afferent neurons that innervate each SCC and project to the reflex or perception of interest. Our inability to prove that the neural implementation of vestibular estimation is optimal despite having a Bayesian optimal mathematical formulation is not unique to this model (e.g., Borah et al. 1988; Laurens and Droulez 2007; Paulin et al. 2004; Paulin 2005; Selva 2009; Selva and Oman 2012).
Comparison with prior work.
Table 1 compared the five classes of models discussed in this report: the observer model (Merfeld et al. 1993; Newman 2009; Oman 1982), the Kalman filter (Bilien 1993; Borah et al. 1988; Paulin et al. 1989, 2001; Pommellet 1990; Selva 2009; Selva and Oman 2012), the Laurens particle filter (Laurens and Droulez 2007, 2008), the Paulin particle filter (Paulin et al. 2004; Paulin 2005; Paulin and Hoffman 2011), and our particle filter. The observer model (Table 1) is able to estimate a broad range of experimental results using a forward internal model of the vestibular sensors. The modeler iteratively modifies the observer gain K to make the resulting estimates close to experimental results. The Kalman filter (Table 1) relates responses with the properties of noise in the system specified by the modeler using the Kalman Riccati equations, which are a linked set of quadratic differential equations often written in matrix notation. Specifically, it computes the Kalman filter gain K(t) using the Kalman Riccati equation, based on the process and measurement noises Q and R. Our particle filter (Table 1) makes the same link between responses and the properties of noise specified by the modeler but differs from the Kalman filter in that it uses a distributed, parallel computation rather than the Kalman Riccati equation to compute K. We believe this is an important distinction because the Riccati differential equations are challenging to solve and there is no evidence that the brain does so. On the other hand, the distributed, parallel computation is similar to the brain in two ways. First, the parallel particles mimic parallel bundles of neurons (Paulin et al. 2004; Paulin 2005; Paulin and Hoffman 2011). Second, the computations performed by the particle filter consist of simple arithmetic computations (multiplications/divisions and additions/subtractions) that neurons can implement (Koch 1999). Thus, we believe that while both the Kalman and particle filter connect neural noise with response characteristics, the particle filter does so in a manner that seems much closer to a neural implementation (MacNeilage et al. 2008; Paulin et al. 2004; Paulin 2005; Paulin and Hoffman 2011). As detailed above, unlike previous Kalman (Table 1) and particle filter (Table 1) studies for which a family of parameters yielded a particular gain (Borah et al. 1988; Laurens and Droulez 2007; MacNeilage et al. 2008; Paulin et al. 1989), our approach adds more experimental constraints so that they are equal in number to the model free parameters, yielding a unique solution for the model free parameters; other probabilistic models should also yield a unique solution if constrained with additional experimental constraints (Laurens and Droulez 2007; MacNeilage et al. 2008; Paulin et al. 1989).
There are a few important distinguishing features between the three vestibular particle filter models. At a fundamental level, the Laurens and our particle filters (Table 1) ask "what are the optimal central dynamics given noisy, continuous afferent signals?," in contrast with the Paulin particle filter (Table 1), which elegantly broaches the neural decoding question "what is the most likely instantaneous dynamic sensory input given the discrete information contained in a single noisy neuronal spike?" As a simple example, while the Laurens and our particle filters see particles as carrying the same angular velocity signal but each with different measurement noises, the Paulin particle filter sees particles as representing the probability of a dynamic system being in a certain location in a velocity-acceleration state space, with individual neurons having a specific receptive field in this state space.
While the Laurens and Paulin particle filters (Table 1) use distributed computation based on noise properties, they contrast with our model in that their implementation incorporates both forward and inverse models and because they explicitly calculate probability distributions using Bayes' rule (as in most particle filters), whereas our particle filter implicitly performs Bayesian optimal weighting using the Kalman gain equation: K(t) = P̂(t)CT × R−1.
Unlike our particle filter, both the Laurens and Paulin particle filters (Table 1) implement resampling to make the distribution of particles better represents the overall probability distribution. In our approach, which supposes that the particles represent neurons, resampling would imply that the brain selectively ignores or boosts neurons based on the distribution of neuronal responses on a spike-by-spike basis, which seems unlikely. Laurens does not claim an analog between particles and neurons and sees resampling strictly as a way of improving computational efficiency, and thus it is not in conflict with our view. Paulin argues that since their particles represent a probability of being in a certain location in state space, removing a particle has the neural analog of ending already-low spiking activity in a part of the network that corresponds to the state space that is far from the likely solution; creating a particle is analogous to increasing activity in parts of the network corresponding to the likely input. In summary, while resampling may have a neural analog in the Paulin particle filter, we believe that not resampling is nearer to a neural implementation in our particle filter.
Our implementation differs subtly from other Kalman filters (Bilien 1993; Pommellet 1990; Selva and Oman 2012) that are designed to estimate hidden states of the system, whereas ours estimates the input to the system. While it is straightforward to add another state that equals the input, we chose not to do so because in a neural implementation this distinction would blur, so we simply used the available input to the internal model that represents the estimated angular velocity.
Estimates of the particle filter for increased afferent noise.
Our particle filter's velocity storage time constant decreases as measurement noise increases, which is consistent with other Kalman and particle filter models (Borah et al. 1988; Laurens and Droulez 2007; MacNeilage et al. 2008; Paulin et al. 1989). This loosely matches the evidence for an afferent noise increase and a time constant decrease due to bilateral vestibular ablation using gentamicin.
A reasonable hypothesis about the decrease in the velocity storage time constant observed in patients with bilateral vestibular hypofunction due to ototoxicity, with which our particle filter concurs, is that the time constant decrease results from an interaction between peripheral changes and central processing rather than changes isolated to either the periphery or central processing. Evidence from lesion studies suggests that velocity storage is centrally implemented (e.g., Katz et al. 1991). Likewise, evidence suggests that aminoglycoside acts peripherally. Thus, a possible conclusion is that the peripheral changes somehow modify the afferent signals in a way which causes velocity storage to function differently. Our particle filter parallels these ideas: the changes that occur in peripheral units cause the internal model of central processing to reproduce pathological behavior.
Experimental measurements found that the velocity storage time constant drops to below the SCC time constant for healthy SCCs, whereas in our particle filter it cannot be less than the SCC time constant. The difference could be explained by an aminogylcoside-induced drop in the SCC time constant, such as changes in the dynamics of individual hair cells and/or afferents. Hair cell loss due to aminogylcoside-induced apoptosis (e.g., Matsui et al. 2003) could result in decreased function of the vestibular efferent system. For example, stimulation of the vestibular efference system causes a nonlinear amplification of low-amplitude hair cell responses (Rabbitt et al. 2010). Although this work does not prove frequency dependence, it is known in the auditory system that the efferent system influences the cochlear frequency tuning (Fettiplace and Hackney 2006; Wolfe et al. 2009). Thus, it is plausible that the death of hair cells could modify the SCC time constant because hair cells are the actuators that implement peripheral mechanical tuning. Alternatively, a decrease in the peripheral time constant would result if cupular stiffness increased (Rabbitt 1999), which might occur if hair cell death had a direct mechanical effect on cupular stiffness. Finally, there is a precedent for a central origin for the decrease in the velocity storage time constant below the SCC time constant. In pigeons, there is evidence for "velocity leakage," in which the VOR time constant is less than half that of the SCC (Anastasio and Correia 1994).
Limitations of this work.
Despite the success of the model, it has limitations. Most importantly, it includes only one type of sensory organ, the SCC, and is implemented for upright rotation only, which encompasses only one of many possible states. Although this is sufficient to study velocity storage, expansion of the model to include more states is both desirable and possible; indeed, the observer model from which this model was developed includes nine states (Merfeld et al. 1993).
Our model and other similar ones (Borah et al. 1988; Laurens and Droulez 2007; Merfeld et al. 1993; Newman 2009; Oman 1982; Selva 2009; Selva and Oman 2012) use a first- or second-order transfer function for the SCC, which omits afferent dynamics. With a fourth-order transfer function that includes the rate adaptation term in the transfer function numerator (Fernandez and Goldberg 1971), our particle filter was able to match the three experimental constraints after reapplying the iterative tuning procedure. (For computational reasons, we also added an additional pole at a much higher frequency than any of the other dynamics in the system.)
Since our model simulates a perceptual magnitude estimation task, ideally the experimental constraint for noise SD of the angular velocity estimate would be from a magnitude estimation task rather than from a threshold measurement task. While we are aware of no published data quantifying variability in vestibular perceptual magnitude estimate tasks, there is evidence that similar noise underlies perceptual and motor thresholds for vestibular stimuli (Haburcakova et al. 2012), and thus it is conceivable that perceptual magnitude estimation also have the same underlying noise. Small changes in the experimental constraint for noise SD of the angular velocity estimate would result in a change only in the number of particles in the model and not other free parameters. Only one study has shown evidence for signal-dependent noise in vestibular perceptual responses (Mallery et al. 2010), whereas neuronal recordings have shown that noise is independent of signal amplitude (Sadeghi et al. 2007). Since our model, like other models in the observer family, uses only additive noise, its estimates will not have signal-dependent noise, but this is an area for future investigation.
Experiments to confirm or refute the hypothesis that dynamic estimation depends on noise are conceptually simple but practically difficult. The noise properties or number of neurons would be manipulated and dynamics and output variability measured. However, current technology limits our ability to cleanly perform these manipulations over a large number of neurons, and disease models change more than one parameter simultaneously.
Plausibility of neural implementation.
We chose to combine the particles that represented estimated angular velocity into a single value by calculating their mean; we found that using the median did not change the results appreciably. While other computations could be used to combine particles, we believe the mean was justified based on experimental data from Massot et al. (2011). We fit a power curve to their data for the relationship between threshold and number of neurons (Fig. 9 in Massot et al. 2011) and found an exponent of −0.41. For a theoretical linear unweighted combination (i.e., the mean), the variances of the individual neurons would add, and since threshold is proportional to SD, the threshold should go down with the square root of the number of neurons, yielding an exponent of −0.5. The experimental exponent is close enough to the theoretical one to justify the use of the mean operator.
Even if we assume that the brain were able to implement a direct mathematical solution of the Kalman Riccati equation, when parallel computational elements are available it is likely more computationally efficient to implement the particle filter. For example, while numerous neurons and interconnections were required to implement the Kalman filter using biological plausible neuron models (Deneve et al. 2007) and for the Riccati equation implemented using artificial neural networks (Wang and Wu 1998), our particle filter requires a relatively small number of neurons, with the number of connections scaling linearly with the number of particles. A learned lookup table relating process and measurement noise to gain could reduce the required number of real-time computations, but training the lookup table would likely require the same sorts of computations as described above, unless a scheme could be developed that incorporated feedback-based learning. For these reasons, we think that the particle filter provides a solution that narrows the gap between behavior and neurons and improves our understanding of the role played by noise in dynamic sensory estimation.
This work was supported by National Institute on Deafness and Other Communication Disorders Grant DC0-4158. The Orchestra computational cluster is supported by National Center for Research Resources Shared Equipment Grant 1-S10-RR-028832.
No conflicts of interest, financial or otherwise, are declared by the author(s).
Author contributions: F.K. and D.M.M. conception and design of research; F.K. analyzed data; F.K. and D.M.M. interpreted results of experiments; F.K. prepared figures; F.K. drafted manuscript; F.K. and D.M.M. edited and revised manuscript; F.K. and D.M.M. approved final version of manuscript.
The authors thank Lena Valavani for reviewing a draft of this manuscript and Chuck Oman and Fred Daum for stimulating discussions.
Here, we provide derivations for state-space realizations of the SCC. The state-space form describes the system dynamics as a first-order matrix differential equation with multiple states that are perturbed by the inputs. There are many state-space realizations that can be chosen to represent our system. We chose to use the two-state phase-variable form.
We defined the SCC transfer function as follows: (A1) which relates the output time-varying afferent firing rate scalar (y) to the input time-varying angular velocity disturbance scalar (d), where s is the Laplace variable and τ1 and τ2 are the SCC time constants determined by fluid dynamics and biomechanics.
By defining (A2) and rearranging, we obtained the following equation: (A3)
Transforming to the time domain yielded the following formula: (A4)
We now defined (A5)
It follows that ẋ2 = ÿ′ and x1 = y′. Through substitution, we found the following: (A6)
By rearranging, we found the following: (A7)
Equations A5 and A7 can be written in matrix form as follows: (A8)
Recalling from Eqs. A2 and A5 that y = y′(s/τ2) and ẏ′ = x2, we expressed the output equation in the time domain as follows: (A9)
Thus, the state-space equations for our system are (A10) and (A11) where
- Copyright © 2012 the American Physiological Society


text:
OUR MOTHERS' WAR: American Women at Home and at the Front During World War II
After years of planting Victory gardens, volunteering at USOs and coping with increased home front responsibilities, in early 1945 Yellin's mother quit her desk job at Reader's Digest and shipped out to the Pacific Front to join the Red Cross. Wartime manpower shortages were bending gender rules, and many women seized the opportunity to try something different. While feminist historians have analyzed the meaning of their war experience, journalist Yellin takes a more subjective approach. This nonjudgmental, anecdotal account covers the usual range of topics—women in war industries, in volunteer work, in the armed forces, in undercover operations—but Yellin avoids retelling the familiar. Thus, she discusses the experiences of Lena Horne and Julia Child more fully than those of Eleanor Roosevelt, and delves deeper into the anti-Semitic Mothers' Movement and Hawaiian prostitutes walking picket lines than more mainstream organizations like the CIO women's committees. Yellin describes the exclusion of African-American women from most military units and the internment of Japanese-American women, but adds little to present scholarship on minority women's participation. Indeed, since her most original material comes from interviews with relatives, family friends and contacts, the book is strongest on the experiences of educated white women, which were surprisingly diverse. For WAVES director Mildred McAfee—the president of Wellesley College before the war—life in the navy took her out of her "cloister" and thrust her into a world where "women are women and men are men." For others, like Yellin's mother, the war let their genies out of the bottle. Agent, Jennifer Gates. (May 4)
Release date: 05/01/2004

subset: commoncrawl


text:
ECM and Claims
Because your profitability is influenced by claims payments and LAEs, your ability to assess and process claims — and to mitigate loss — depends on speed and accuracy. Shortened processing cycles enable faster adjudication, saving you money while satisfying claimants. Toward those ends, DocFinity's BPM/Workflow capabilities can help your claims department:
- Populate processes with pertinent, accurate data from Web portals, PDAs, barcodes, and scanned images, eliminating wait times for information.
- Collect, associate, and forward claims documents, emails, voicemails, faxes, photos, and other files for timely action.
- Minimize costs associated with unsettled claims.
- Monitor work volumes and employee productivity to prevent bottlenecks and delays in decision-making.
- Expedite departmental approvals, claims denials, and signatures on documents.
Improved Straight-Through Processing
DocFinity enables quick, accurate turnaround — improving service to agents and adjusters, decreasing cycle times, lowering costs, and helping to attract and retain policyholders. With information at your fingertips, you can manage more claims in less time. By integrating policy and claims administration applications, websites, and other attendant systems, you can get more from all of them. And by using DocFinity's BPM/Workflow tools, you can streamline handling, automatically routing exceptions to qualified personnel for review.
At Your Self-Service
You can expedite processing even more with self-service options that enable agents, adjusters, policyholders, and other parties to claims to update information and check their status online. By improving their experience, you'll improve your retention. And DocFinity's automated signature tools, email management capabilities, and reporting tools further reduce turnaround times and help ease compliance efforts, financial exams, and audits.


text:
More than 25 employers expected at career fair today
The Hernando County Career Fair, "Opportunity 2011," continues today at Pasco-Hernando Community College, Spring Hill Campus, 450 Beverly Court. U.S. Rep. Richard Nugent, R-Spring Hill, will make opening remarks at 1:45 p.m. Doors will open at 2 p.m. for job seekers to meet with more than 25 prospective employers. The event is hosted by Career Central, the Greater Hernando County Chamber of Commerce, Pasco-Hernando Community College and Hernando Today. Call Denise Nohejl at (352) 544-5206.
Learn to manage money, plan for emergencies and the future
The Hernando County Cooperative Extension Service will offer a free financial management class, "Developing an Effective Spending Plan," at 2 p.m. Wednesday at the East Hernando Branch Library, 6457 Windmere Road.
With an effective spending plan, families can identify spending leaks, establish consistent saving habits, prepare for emergencies and begin to focus on future financial health.
Call (352) 540-6391 or (352) 754-4433.
Buy tickets or donate raffle items for Sons of Italy dinner
The Sons of Italy, Nature Coast Lodge 2502, will host the annual Scholarship Dinner Dance from 6 to 10:30 p.m. May 7 at the Hernando County Senior Citizens Club, 7925 Rhanbuoy Road.
Dinner will be catered by Argento's and music provided by Marty and the Nice Guys. Guests can bring their own beverages. Tickets are $20.
For tickets, or to donate a gift or item for raffles, call Grace at (352) 597-3727.
Woman's Club plans two-hour variety show
The Woman's Club of Brookridge will present "Brookridge on Revue" at 7 p.m. April 16 and 17 in the clubhouse at 8150 Hampton St.
This two-hour show, featuring local talent, includes songs, skits and other performances.
Tickets are $8, which includes snacks, coffee and ice tea and ice. Guests can bring their own beverages.
For tickets and information, call Norma at (352) 597-3530.
Here's a chance to share your poetry
Just Poets will meet and discuss poetry from 4:30 to 5:30 p.m. Thursday at the West Hernando/Staffordene T. Foggia Branch Library, 6335 Blackbird Ave.
Poets are invited to read three poems they have written; additional selections can be read if time permits. Non-poets are welcome to read works written by their favorite poets, or just listen.
For information, call Al Svoboda at (352) 793-6556.
Come in uniform to USO dinner and dance
The Knights of Columbus, St. Jude Assembly 1721, will host a USO dinner and dance May 21 at the KofC Hall, 10470 Spring Hill Drive. Doors open at 5:30 p.m. Dinner will be at 6.
The menu includes ziti, meatballs, sausage and bread. Music will be provided by Tammie Sue and Charlie.
Guests are encouraged to dress in accordance to the USO theme of the event. Those who served in the military can wear or bring any articles from their branch of service.
Tickets are $10 each. Funds raised will help support the veterans at the Fisher House in Tampa. For information or tickets, call Jim De Marco at (352) 683-7290.
Kids and sponsors sought for triathlon
The Kiwanis Club of Spring Hill will host the Super Kids Triathlon 8 to 10 a.m. May 21 at Weeki Wachee State Park, 6131 Commercial Way.
Sponsors are needed. Sponsorships range from $150 for a T-shirt sponsor, to $500 for a Gold Level sponsorship.
The event is open to ages 5 to 18, in three age groups, and will include swimming, cycling and running/walking.
Participants must wear helmets and bring their own bicycles for the cycling portion. All bikes must be brought in for inspection during sign-in, from 5 to 7 p.m. May 20. They'll be secured and stored overnight. Hot dogs and goody bags will be provided at sign in.
Hernando County Schools superintendent Brian Blavatt will sound the alarm to start the race. Trophies will be presented; all participants will receive an award.
The event is limited to 200 participants (first come, first served). Apply online at kidssupertriathlon.com. For further details, or to become a sponsor, contact Paul Reeves at (352) 597-3536 or email@example.com.
Library to show movie 'The Queen'
The Hernando County Public Library will have a free showing of the movie, The Queen, at 2 p.m. Thursday at the Spring Hill Branch/Harold G. Zopp Memorial Library, 9220 Spring Hill Drive.
The film gives an intimate behind-the-scenes glimpse at the interaction between Queen Elizabeth II, played by Helen Mirren, and Prime Minister Tony Blair, played by Michael Sheen, following the death of Princess Diana.
The movie is rated PG-13. Light refreshments will be served. The program is sponsored by the Friends of the Library of Hernando County.
For information, call (352) 540-6391.
Sell some gold, get a health screening
Spring Hill Regional Hospital Auxiliary will host a Gold-Buying and Health and Candle Fair from 7 a.m. to 4 p.m. Wednesday and Thursday in the hall by the gift shop. The hospital is at 10461 Quality Drive.
Proceeds will benefit the scholarship fund and local charities. For information, call Pat at (352) 666-8755.
Kids events from flag football to Rock Band
The Division 8 Key Club will host a flag football tournament to benefit the Kiwanis Eliminate project from noon to 7 p.m. April 16 at Hernando High School, 700 Bell Ave.
The event will include carnival-style games for children, as well as activities such as Rock Band or Guitar Hero, and a battle of the bands-type concert. Concessions and T-shirts will be sold.
All proceeds will go to the Eliminate project, which was formed by Kiwanis International and UNICEF, to eliminate maternal and neonatal tetanus.
For information, contact Eric Riser at firstname.lastname@example.com or visit the website at tosavethebabies.weebly.com.
Bring drinks and your dancing shoes
The High Point Community Spring Dance will be from 7 to 10 p.m. April 16 at the High Point Community Center, 12249 Clubhouse Road.
Music will be provided by the Starburst Duo.
Complimentary coffee and ice will be available.
Tickets are $5, and can be purchased at the door.
For information or reservations, call Laverne at (352) 596-2827.
Model train, toy show, swap meet April 16
Regal Railways will host a Model Train and Toy Show and Swap Meet from 10 a.m. to 3 p.m. April 16 at the Brooksville Elks Lodge, 14494 Cortez Blvd., west of Brooksville.
Vendors will be on hand with various scales of trains, tracks, accessories and other items for sale. There will also be a model train layout. Lunch will be available.
Admission is $4; children 12 and younger are admitted free. An "early bird" admission is available for $6, for those wishing to enter between 9 and 10 a.m.
For information, call Joe at (727) 244-1341 or visit regalrailways.com.
Food, prizes at Yacht Club fashion show
The Hernando Beach Yacht Club will host a fashion show from 11:30 a.m. to 3 p.m. April 30 at the club, 4163 Shoal Line Blvd.
Fashions will be presented by La DE Ta's of Crystal River and entertainment by Mid-Life Crisis. There will be food and prizes. Items will be for sale at the show.
Tickets are $21; a portion of the proceeds will benefit the American Cancer Society. Call Anna for tickets at (352) 688-6598.
Classes teach women agribusiness skills
The Hernando County Cooperative Extension Service will offer Annie's Project, a national program developed to empower farm and ranch women to be better business partners. Classes will be at 6 p.m. Tuesdays, April 12 through May 17, at the extension office, 1653 Blaise Drive.
The program helps participants gain entrepreneurial skills to operate their farm. It also helps find new ways to balance demands of family, community and professionalism within the agricultural community.
Sessions combine lecture, discussion, individual and small group activities, as well as software training.
Although geared toward women, anyone can participate.
The cost is $40, which includes software, books, food and materials. To register or for information, call (352) 754-4433.
Remember loved ones at hospice services
HPH Hospice will host its interfaith community "Time for Remembrance" services at 2 and 6 p.m. Tuesday in the administrative building at Pasco-Hernando Community College, Spring Hill Campus, 450 Beverly Court.
The free services are for anyone wishing to honor or remember a loved one who has died. They are led by HPH chaplains and bereavement counselors.
No reservations are needed. For more information, call toll-free 1-800-486-8784 or visit hph-hospice.org.


text:
Milroy, Jauch, introduce new Birth Certificate Bill
Brad Phenow
A Birth Certificate Bill is in the process to give adoptees the ability to revert their birth certificates back to their birth parents.
The bill has been introduced by Representatives Tom Larson, Nick Milroy, and Senator Bob Jauch. It's already had a public hearing in the Senate. Superiorite Mary Fruehauf, was first to contact Milroy.
"I am the oldest of three kids, born to my mom and dad, and my dad died when I was a preschooler. My mother remarried when I was 6 years old, and her second husband adopted the three of us."
After Freuhauf and her siblings were adopted, her biological father's name was removed from her birth certificate and replaced by the name of her mother's second husband.
"They divorced a few years after that, and we have no relationship with him at all, and don't wish to have one. Every time I've needed to use my birth certificate it really bugged me a perfect strangers name is listed as my father on my birth certificate."
These frustrations led Freuhauf to contact Milroy. Milroy says that until he heard from Fruehauf he wasn't aware that adoptees were unable to revert their birth certificates.
"I have real high hopes we will get this bill passed this year. It's such an important part of people's identity and especially for future generations to be able to go and look back at legal documents and know who their ancestors are. I think this is a common sense proposal."
The bill passed by the State Assembly in October. In the public hearing in the Senate in November, they received a favorable response. It's expected to be voted on by the senate committee and then will go to the full senate this month.
"More people will benefit from it than we know a lot more than I think people realize, the American family is so different from the way it was in the 1950s when all of this started."


text:
Article Preview
NEW, WISE, GAY, AND AMAZING; Striking Bits of Current Comment from Various Sources at Home and Abroad.
THE saddest and most discouraging feature of current literature is not the lack of fine examples, but the pessimistic critic's failure to give them recognition. Only the striking example compels his praise, while those many which quietly give satisfaction of the highest order escape his notice.
July 01, 1905
View the full article in TimesMachine.
Subscribers* enjoy full access to TimesMachine—view 129 years of New York Times journalism, as it originally appeared.
Or, download a high-resolution PDF of the individual article.
* Does not include NYT Now or Premium Crosswords subscribers.
Already a subscriber? Log in to view this article »


text:
Bedford Township goes ahead with Halloween activities
Fri, 01 Nov 2013 02:06:01 GMT —
The threat of rain and wind wasn't enough to postpone Halloween activities in Bedford Township Thursday night.
talked to Bedford Township Supervisor Greg Stewart who explained he was watching the radar all day Thursday and didn't see anything such as high winds or thunder that would warrant festivities being postponed. "I'm seeing rain. We had rain last year, but I'm not seeing thunder storms, I'm not seeing the high winds that they called for earlier," explains Stewart.
alloween festivi
s in Bedford Township lasted from 6pm to 8pm. While Bedford and other communities decided to go ahead with Halloween activities, several other cities and towns postponed festivities until the weekend and Monday.


text:
DUNLOP SP SPORT 2000E tyres
Features and benefits
The Dunlop SP Sport 2000E is an all season tyre which has a silica compound helps to improve braking, cornering and handling in most weather conditions.
Superior braking, cornering and handling in wet and dry conditions. Also reduces rolling resistance, which can help enhance fuel economy.
Endorsed by leading car manufacturers as OE (original equipment).
At ATS Euromaster, we sell a wide range of tyres to suit your budget, driving style and personal preference. To view tyre prices, simply click on the tyre size you require from the list below. Alternatively, you can refund your search by selecting your tyre dimensions from the drop down menus.
Refund your search
Fully Fitted PriceAdd to basket


text:
Results 1 to 4 of 4
lactose intolerant mbp needs a need graphics card
- Member Since
- Feb 21, 2010
- Posts
- 10
so i spilled milk on my mbp, and i didnt realize i did it until i heard it whining. So now the graphics card is trashed. Im looking to get a new card and i need some advice. Ive built computers before, but never a mac, so im sorta starting from square one. I need some help deciding on a card, as ive had this comp for a while, and ive kinda fell outta the loop on hardware, and having never built a mac, or a laptop for that matter im even more unsure. Im looking for a card more geared towards gaming, as i play wow on it, but wow isnt the most graphics demanding game, so i dont need anything to brake the bank, but at the same time, more is always better. really need some help as im in college and have a report saved on it, and i need to fix my computer to print it out.
- Member Since
- Dec 20, 2006
- Location
- Lake Mary, Florida
- Posts
- 26,959
- Specs:
- 15" MBP, Core i7/2GHz, 8GB RAM, 480GB Crucial M500 SSD
Sorry to be the one to break it to you, but the GPU in the MBP is soldered fast to the logic board. You can't just replace the card as you could in a desktop, the entire logic board ($700+) must be swapped out.
You should be able to remove the hard drive and connect it to another Mac to retrieve your data. If you need more detail on that, let me know.
Good luck.Liquid and computers don't mix. It might seem simple, but we see an incredible amount of people post here about spills. Keep drinks and other liquids away from your expensive electronics!
- Member Since
- Feb 21, 2010
- Posts
- 10
ha! i was wondering why the macstore quoted me so high! well thanks for the prompt answer, if my mother has a mb, could i connect my hd to her comp to get it? also where can i get one of those logic boards?
02-21-2010, 01:32 PM #4SpinningCompassGuest
There's WeLoveMacs, EBay, and so on. If you have a really small cross-head screwdriver handy, you can take out the lactose-intolerant MBP's hard drive and put it in a USB enclosure for data recovery purposes.
Thread Information
Users Browsing this Thread
There are currently 1 users browsing this thread. (0 members and 1 guests)
Similar Threads
Logic board or graphics card? MBP issueBy user000 in forum Apple NotebooksReplies: 9Last Post: 01-04-2011, 04:50 PM
Just how big of an upgrade is the new graphics card in the new 13" MBP?By cammyfive in forum Apple NotebooksReplies: 6Last Post: 04-20-2010, 03:19 AM
Which graphics card? (MBP)By Jonik in forum Apple NotebooksReplies: 6Last Post: 03-17-2010, 08:37 AM
Graphics Card New MBP 15"By wirelessmacuser in forum Switcher HangoutReplies: 3Last Post: 02-16-2010, 12:13 AM
MBP dented next DVI port.. Does it void fault graphics card warrantyBy umang7888 in forum Apple NotebooksReplies: 3Last Post: 02-20-2009, 08:37 AM


text: What else can I say, we got a W, and if feels good, on top of that Mario gets 1.5 sacks and the crowd went crazy as did Mario. It got a little sloppy especially at the end, but we hung in there. There will be plenty of time to breakdown performances and areas for improvement. But as for this moment........ LET'S CELEBRATE BABY!!!!!!


text:
Biden Says Crying Baby at Rally "Knows What's In Store If Romney Wins"
ABC Digital
Political News
Updated at
(ST. AUGUSTINE, Fla.) — What happens when a baby starts crying when Vice President Joe Biden is speaking at an event? Well the vice president finds a way to work that baby into his speech as he did in St. Augustine Saturday afternoon, saying the crying baby knows how its future would pan out if Mitt Romney becomes president.
"They eliminate help for middle class families who want to send their kids to college like that beautiful baby over there," Biden said as a baby cried at Ketterlinus Gymnasium Saturday. "I don't blame her for crying! I don't blame that baby for crying! That baby, that baby, that baby knows what's in store for him or her if Romney wins! I'm glad someone understands my speech!"
At the last stop of his two day tour through Florida, Biden highlighted the differences between President Obama and Romney, who he accused of deviating from the principles of the Republican Party and constructing a "morphed party."
"He's out of touch where I think this country is, where we move, and now, and now they're even abandoning the core organizing principle of this new Republican party," he said. "This is not the Republican party of ten years ago. This is not the Republican party of 20 years ago. This is not even Mitt Romney's father's Republican party. This is an alliance between the right in the Republican party and the Tea Party—people I saw coming in here. I saw four or five of them."
As Biden's motorcade drove to Saturday's event, a few protestors dressed in colonial garb waved signs, including one that said "Bye-Bye Joe Biden Good Bye!"
The vice president touted the president's and his own performances in previous debates, even noting that his grandfather would be "happy" that "all of America knows what the word 'malarkey' means now," and ahead of the final presidential debate in Boca Raton, Fla. Monday, Biden stressed that President Obama has a strong character and will stand by his word.
"Folks, the stakes for this country are too high. They are too important. It's time for people standing for public office to stand up and say what they believe. Stand by what they say. Have the character of their convictions and state it," he said. "Presidential elections are about character and the character of your convictions and my guy he never tells you anything he doesn't mean and he doesn't do."
Copyright 2012 ABC News Radio


text:
Projection Capable Classroom Standard
Classroom Technical Services developed the University Projection Capable Classroom (PCC) Standard. This standard is a set of six creteria that the Office of Classroom Management uses as a model system for the design and installation of technology in classrooms and conference rooms.
The six criteria help give faculty and staff the ease-of-use and reliability needed for presentation technology provided by CTS.
The overall goal of the PCC technology criteria is to provide:
- A common, consistent and pedagogically-sound learning environment across all learning spaces on the University of Minnesota Twins Cities campus
- Consistent functionality and interfaces with standard operating protocols
- Adaptability of design to address specific instructional needs
- Reliable, well maintained systems that enhance performance and minimize downtime
- Easy management and support of systems and equipment
- Remote system monitoring capabilities
PCC technology standard
The standard includes basic technology to enhance teaching and learning. The following equipment/feature are standard in a PCC standard classroom:
- Fixed hi-resolution data projector and/or flat panel display(s)
- Wired internet connection at instructor station
- University wireless networking coverage
- Smart control system (with networking option)
- User friendly laptop interface
- Document camera
- Accessibility features, including microphone system
- Digital audio/video output via USB connection
- Hotline phone
Some rooms may have other capabilities, including:
- Special input/output connectors for user-provided equipment
- VHS or DVD player
- Installed computers
The PCC standard is the baseline for general purpose classroom technology, and is included in the Classroom Appendix to the U of M Standards and Procedures for Construction (Appendix DD).


text:
Seagate Barracuda 3TB Hard Drive Internal and UltrItem#: M69-0093
Currently Out Of Stock!
Seagate Barracuda 7200.14 3TB SATA III Hard Bundle Product Details
Product TagsPPSSComponentBundleDeals2013
Manufactured by: Seagate
Warranty provided by: Seagate
UPC No: 890552753819
Mfg Part No:
Box Size:
( Length:0, Width:0, Depth:0)
Shipping Weight: 6.6000 pound(s)
Click here for full warranty and support information
- Seagate logos are registered trademarks of Seagate. All others trademarks and copyrights mentioned herein are the property of their respective owners.


text:
Abbey Is Mug
Product Color:
Product information
Your own personalized Mug Abbey Is ensure that your morning coffee, or tee, or chocolate milk, tastes better. The ceramic ensure long durability and give your morning breakfast a sophisticated air, which will also keep your beverage hot longer.
No one can ruin your day after sipping from your favorite Abbey Is mug. And if you aren't a morning person, our 11oz Abbey
Sku: TZ0BRWH00029192222220002LG0000000


text:
Israeli Arab: Attack on Policeman Meant to Avenge Cousin's Death
Cousin killed by Border Police two years ago; Arara resident's lawyer cites mental instability.
A 23-year-old Israeli Arab man said Friday that his assault of a Border Police officer the day before was an attempt to avenge the death of his cousin, who was killed by Border Police nearly two years ago.
Nadim Milham, a resident of the Wadi Ara town of Arara, told police he attempted to snatch the security officer's rifle, and planned to shoot him and and sell the weapon. He said his action came in reaction to the justice system's failure to hold the policeman who killed his cousin accountable for the shooting.
Milham's cousin was fatally shot in the back while security forces searched his house. The Border Police officer who opened fire is currently on trial for manslaughter.
Milham's lawyer, Sami Milham, said he would ask the court to send his client to a psychiatric evaluation because of suspected mental instability.
He said family members feel no need to avenge the death, despite alleged legal foot-dragging in the case.
"It is obvious to everyone that this was a stupid thing to do," the attorney said.
Want to enjoy 'Zen' reading - with no ads and just the article? Subscribe todaySubscribe now