text:
We model the putative neuronal and synaptic mechanisms involved in learning a visual categorization task, taking inspiration from single-cell recordings in inferior temporal cortex (ITC). Our working hypothesis is that learning the categorization task involves both bottom-up, ITC to prefrontal cortex (PFC), and top-down (PFC to ITC) synaptic plasticity and that the latter enhances the selectivity of the ITC neurons encoding the task-relevant features of the stimuli, thereby improving the signal-to-noise ratio. We test this hypothesis by modeling both areas and their connections with spiking neurons and plastic synapses, ITC acting as a feature-selective layer and PFC as a category coding layer. This minimal model gives interesting clues as to properties and function of the selective feedback signal from PFC to ITC that help solving a categorization task. In particular, we show that, when the stimuli are very noisy because of a large number of nonrelevant features, the feedback structure helps getting better categorization performance and decreasing the reaction time. It also affects the speed and stability of the learning process and sharpens tuning curves of ITC neurons. Furthermore, the model predicts a modulation of neural activities during error trials, by which the differential selectivity of ITC neurons to task-relevant and task-irrelevant features diminishes or is even reversed, and modulations in the time course of neural activities that appear when, after learning, corrupted versions of the stimuli are input to the network.
- categorization learning
- feedback
- Hebbian learning
- spiking neuronal network
- visual categorization
a large body of knowledge has accumulated about the brain areas involved in categorization across multiple sensory modalities auditory (Vallabha et al. 2007), somatosensory (Romo and Salinas 2001), and olfactory (Howard et al. 2009) systems, with categorization of visual stimuli being the most studied (Knoblich et al. 2002).
Several open questions remain as to the specific roles played by the areas participating in the association between sensory stimuli and categories (Freedman and Assad 2011; Swaminathan and Freedman 2012) and the learning mechanisms involved. The neural correlates of the acquired association carry multiple traces of category-related modulations (Freedman et al. 2001, 2003; Sigala and Logothetis 2002; De Baene et al. 2008; Meyers et al. 2008); however, it is not always clear (especially for feature-encoding areas) whether such modulations are epiphenomenal reflections of category-specific neural signals generated elsewhere or they have an important computational role in the categorization process.
Among the brain areas involved in categorization, the prefrontal cortex (PFC) plays a fundamental role, notably for learning novel associations and encoding abstract rules (Seger and Miller 2010). Neurons in PFC show sharp response properties across boundaries between categories largely independent of stimulus similarity (Freedman et al. 2003). However, category-related actions/decisions involve multiple areas: premotor cortex for action planning (Boettiger and D'Esposito 2005; Muhammad et al. 2006); parietal cortex to implement visuospatial processing linking perceptual information with potential responses; basal ganglia to gate selectively cortical areas for choice of action (Humphries et al. 2006; Seger 2008); hippocampus and medial temporal lobe to encode and learn items to be categorized (Myers et al. 2003; Shohamy and Wagner 2008); the dopaminergic system and the associated plasticity of striatal and corticostriatal synapses to support reward-modulated learning; and the inferotemporal cortex (ITC), where a modular, feature-based representation has been observed (Tsunoda et al. 2001; Yamane et al. 2006) and where neurons with category-related tuning properties have been reported (Vogels 1999; Freedman et al. 2003).
A general plausible computational principle underlying the categorization process is that it must rely on the selection of relevant features in a specific behavioral context, and neurophysiological studies in ITC have indeed shown that the activity of neurons encoding sensory features relevant for the task is maximally modulated (see Sigala and Logothetis 2002; De Baene et al. 2008).
Starting from this evidence, the basic assumption of the present modeling work is that a mutual interaction between a feature-encoding (e.g., ITC) and a category-encoding (e.g., PFC) brain areas is the fundamental neural substrate of categorization. We implement a learning scenario for the acquisition of an association between stimuli and categories and explore the consequences of top-down selective modulation of sensory representations.
We take as a relevant testing ground of our model the results of Sigala and Logothetis (2002) and De Baene et al. (2008), extending the scope of our previous work Szabo et al. (2006) to the domain of dynamic, online learning, and from this we address more general questions about the computational role of learned selective feedback in a categorization task. As a significant progress over Szabo et al. (2006) in the present work, we face the full complexity of the ongoing dynamic coupling between spiking activity induced by stimuli and the spike-driven, local synaptic dynamics. Beyond the appeal in terms of biological plausibility, this entails inter alia coping with the finite-size effects that are important in determining learning histories (see Del Giudice et al. 2003), due to the distribution of firing rates and the consequent distribution of rates of synaptic changes.
Based on simulations of a multimodular architecture composed of spiking (integrate-and-fire) neurons and plastic, spike-driven synapses, we will indeed show that successful learning histories emerge naturally through a combination of Hebbian plasticity for correct trials and partially anti-Hebbian plasticity for error trials. The learnt top-down synaptic structure produces better performances and faster responses. Besides reproducing, in correct trials, modulation of neural activity in ITC modules, qualitatively similar to the one observed in Sigala and Logothetis (2002), the model generates specific neurophysiological and behavioral predictions, including a different and specific tuning during error trials: the selectivity of the task-relevant feature neurons is diminished or even reversed.
Neuronal and synaptic dynamics.
Our neural model is the single compartment linear integrate-and-fire neuron (Fusi and Mattia 1999). The subthreshold dynamics of the membrane potential of neuron i is: V̇i(t) = −β + Ii(t) (assuming units such that the membrane capacitance C = 1), with a reflecting barrier condition such that if Vi(t) is driven below 0, it stays 0. β Is a constant leakage term. When the membrane potential reaches the threshold θ = 1, the neuron emits a spike and the membrane potential Vi is set and kept to a reset potential Vr for a refractory period τarp. Ii(t) is the total synaptic current afferent to neuron i, and it is the sum of the external excitatory current Iext, the recurrent excitatory and inhibitory currents: Ii(t) = ∑jJij∑k δ(t − tjk − δj) + Iext. Jij represents the amplitude of the instantaneous change of the postsynaptic potential (positive for excitatory synapses and negative for inhibitory synapses). The sums are over all presynaptic neurons j and for each j over all the emitted spikes at times tjk, reaching the target neuron i with delay δj. Delays are randomly sampled from a truncated exponential distribution with a minimum and a maximum value, respectively, δjm and δjM.
Parameters are listed in Table 1.
Plastic synapses in the model are bistable and stochastic as motivated and described in Fusi et al. (2000). The synaptic efficacy J takes one of two values, J− (depressed) and J+ (potentiated). Learning evolves as a sequence of random transitions between J− and J+, triggered by the arrival of presynaptic spikes; the direction of the transition (potentiation or depression) is determined by the instantaneous value of the postsynaptic potential (Fusi et al. 2000), as detailed in the following sections (see Table 3).
Each synapse has an internal dimensionless variable ("synaptic potential," XJ), ranging in the interval [0; 1]. This range is split in two by a threshold θJ; when XJ is above this threshold, the synapse is in the potentiated state and XJ constantly moves toward 1, with a constant drift αX; below θJ, the synapse is depressed and XJ moves toward 0, with the same drift αX. Thanks to the drift, in the absence of presynaptic spikes, the synaptic state (potentiated or depressed) never changes [thus we have long-term potentiation (LTP) or long-term depression (LTD)]. Transitions can happen only upon the arrival (at time tk) of a presynaptic spike (with index k), which causes a sudden jump in XJ. If the postsynaptic potential is found above a threshold θV, the jump will be positive and of size dX+, otherwise it will be negative and of size dX−. A positive jump can take XJ above θJ, making thus the synapse switch to the potentiated state; conversely, a negative jump can make the synapse switch to the depressed state. In formula: LTP results from high presynaptic activity (high rate of triggering presynaptic spikes) and high postsynaptic activity (which on average implies high values of postsynaptic membrane potential). LTD occurs for highly active presynaptic neuron and poorly active postsynaptic one.
Parameter values for the synaptic dynamics are listed in Table 2.
Network architecture and stimuli.
We set up a network with two layers, analogous to the one described in Szabo et al. (2006) (see Fig. 1), meant to describe, respectively, a cortical area coding for the visual features defining each stimulus and a higher cortical area coding for the category assignment to stimuli according to a rule to be learnt. Each layer includes 6,000 neurons, divided into several selective populations of excitatory neurons (see below), one nonselective excitatory "background" population and one inhibitory population.
The first layer ("ITC") comprises NF + 1 feature-selective populations of 240 neurons each (denoted with the letters D and O in Fig. 1, see Task and learning for the role played by the different populations). In the absence of stimuli, all the neurons in each population receive a background (excitatory) Poissonian synaptic input of base-rate λ0. Each stimulus to ITC is defined by the activation of one of the two values of each feature (e.g., small vs. large distance between eyes in a face, see Fig. 3); upon stimulation two disjoint subsets of 120 neurons for each ITC population (D1–D2 and O1–O2: NF = 1 in Fig. 1) will receive a differential current (except for Selective top-down synapses sharpen tuning curve in which population D will be divided into four subsets of 120 neurons each, to code for four values); the active (inactive) value corresponds to an input Poisson spike train with rate λ + Δλ (λ − Δλ), with λ a reference value; λ ± Δλ > λ0. The value of Δλ can be varied (see Influence of selective top-down synapses on network performances). Corrupted stimuli are implemented (see Corrupting learned stimuli: a footprint of categorization in ITC) by reducing the size of selective populations to a fraction x < 1 of the original size, the remaining (1 − x) 240 neurons being given a stimulus-independent current of rate λ0. NF too will be varied in the following sections to study the effects of a more or less complex feature space; NF = 16 unless otherwise specified.
Stimulation parameters are listed in Table 1.
The second layer ("PFC") has a winner-take-all structure, similar to the one described in Wang (2002) in which two cooperating-competing populations (480 neurons each) encode the two categories, C1 and C2; in the regime of interest, upon stimulation of the ITC populations, the network dynamics always leads to a stable state where C1 is firing high and C2 is almost silent or vice versa, signaling a decision of the network as to which category the presented stimulus is assigned to.
All neurons have a probability c = 25% of being synaptically connected with any other neuron in the network, with the exception that excitatory-to-inhibitory and inhibitory-to-excitatory connections are restricted to each of the two layers ("local" inhibition). C1 and C2, as well as the subsets in ITC, are self-excited and mutually excited; besides, they are reciprocally connected with the excitatory background and inhibitory populations in the corresponding layers (see Table 1 and Fig. 1).
The bidirectional synaptic connections between the ITC and PFC layers are the only plastic synapses (see Neuronal and synaptic dynamics) and are thus shaped by learning (see Task and learning).
Values chosen for the fixed synaptic efficacies are in Table 3.
Task and learning.
We define the task after Sigala and Logothetis (2002) and De Baene et al. (2008). In the experiments, monkeys were shown schematic visual stimuli, defined by a fixed number of features, and grouped in two categories, to which the monkey is trained to assign stimuli by trials and errors. Only a subset of features were relevant for the categorization, and neurons in ITC selective for those "diagnostic" features turned out to be maximally modulated depending on the feature values.
We chose only one of the NF + 1 features to be relevant ("diagnostic") for the categorization: expect for Selective top-down synapses sharpen tuning curve, the task the network has to learn is to associate stimuli with one of the two values (e.g., distant eyes D1) of this one feature to category C1, and stimuli taking the other value (e.g., close eyes D2) to C2, regardless of the values taken by the remaining NF nondiagnostic features.
At the beginning of training, we generate a random pattern of activation λ ± Δλ for each of the NF + 1 ITC populations. If the answer of the network, as read from the pattern of activity of C1 and C2 in the PFC layer, is correct (the correct classification being determined by the value of the diagnostic feature), we go on generating a new stimulus encoded by a new random choice of all NF + 1 features for the subsequent trial. If not, in the subsequent trial the network is presented with a new random stimulus belonging, however, to the same class as the preceding (wrongly classified) one (NF random values for the nondiagnostic features). This is consistent with the training strategy adopted in Sigala and Logothetis (2002) (N. Sigala, private communication).
Each stimulus lasts for 2 s. At 1.5 s from stimulus onset, the network response is "read" and a signal reward/no reward is determined, which activates the appropriate synaptic plasticity mode (see below), until the end of the stimulus.
Learning is semisupervised and partially anti-Hebbian: the Hebbian synaptic dynamics (see Neuronal and synaptic dynamics) is activated only upon the correct completion of a trial, that is just after the network has correctly classified a stimulus ("reward" condition). When the network generates a wrong classification ("no reward" condition), synapses that would undergo a positive jump dX+ (upregulated) are subject to a negative jump dX− (downregulated), while the ones that would be downregulated are left unchanged. This way synapses that would be potentiated if the classification provided was correct will be depressed, while the other synapses are left unchanged.
Figure 2 shows a cartoon of the average expected effect of learning on the synaptic structure of the network, both upon correct and wrong classification. This suggests that the synaptic connections between PFC and ITC, after learning, can be effectively described with six parameters (see Fig. 1): JP, the average synaptic efficacy between D1 and C1, and D2 and C2 (correct association); JD, the average synaptic efficacy between D2 and C1, and D1 and C2 (wrong association); Jn, the average synaptic efficacy between category populations and nondiagnostic features (C1/C2 ↔ O1/O2) in both directions.
As already noticed in Roelfsema et al. (2010), synaptic dynamics is required to change after an erroneous answer to prevent the impairment of what was learned contingently to correct answers. Such strong assumptions are consistent with the experimentally observed reward-related modulation of synaptic plasticity by the dopaminergic neurons (Schultz 1998; Schultz and Dickinson 2000).
Rationale for a features-based representation in the ITC layer.
The adopted model is certainly a gross oversimplification, both as to the type of neural representation in ITC and as to the areas involved. However, regarding the former, we emphasize that evidence reported in the literature provides at least a rationale for adopting a neural representation in ITC that is based on feature-selective populations and for assuming that the collection of such segregated representations is what is forwarded in the first place to PFC for further processing. To substantiate this statement, in Fig. 3 we propose a close analogy between our ITC model and the results reported in Tsunoda et al. (2001). These authors extensively explored the representation of visual objects in ITC and how such representations are altered when simplified versions of the same objects are presented (a simplified object being an object deprived of some features). Figure 3A shows the observed patchiness of the neural representations of an object, and what those representations reduce to when some features are removed. It is seen that there are patches uniquely associated to some features, others are overlapping to various degrees. In the words of Tsunoda et al. (2001), "an object is represented by a combination of cortical columns, each of which represents a visual feature (feature column)" (other aspects of the results from Tsunoda et al. will be commented on in the discussion, in the light of the present model). Figure 3B illustrates the assumed patchy representation in ITC that, by way of analogy, we associate with the representation of the Brunswick faces used in the Sigala and Logothetis (2002) work. The scheme is then mapped onto the model architecture described in Fig. 3C, top, where we suggest that the simplified representation we adopted could be imagined to be obtained from a selection of recorded neurons based on their feature selectivity (as exemplified in Fig. 3D).
All the results we present are from simulations in which both network and learning dynamics run concurrently. We performed a preliminary exploration in the large parameter space by resorting to dynamic mean-field equations (Amit and Brunel 1997; Del Giudice et al. 2003; Fusi and Mattia 1999). The simulations have been carried out with a high-performance custom C program, implementing the event-based approach described in Mattia and Del Giudice (2000). To estimate instantaneous firing rates, the spikes from each neuronal population are sampled in a 10-ms sliding window.
In the following sections, we first illustrate the typical time course of a learning history, and describe the way it is affected by the build up of a selective top-down synaptic structure. We then move to illustrate how the network performance is affected by such top-down synaptic structure. Finally, we study the network behaviour for corrupted versions of the training stimuli, and the time course of the neural activities in error trials, and formulate testable predictions in both cases.
Neural correlate of categorization.
Figure 4, A–C, shows the evolution of the network performance and synaptic configuration as learning proceeds. Before stimulation, all populations in the network are in a stable asynchronous state of low firing rate (few Hz). Upon stimulation, one of the two category populations in the PFC layer is in the end brought to an "up state" (≈40 Hz), resulting from winning the competition with the other category, which settles into a "down state" ≈0 Hz.
Depending on whether the winning category is the correct one according to the defined categorization rule, the plastic synapses are allowed to change following an Hebbian rule (for correct outcome) or a partially anti-Hebbian rule (for incorrect outcome), as described in Fig. 2 and in the methods. We recall here that we repeat the stimulus after a wrong answer. Figure 2A shows the time course of the performance on the categorization task, i.e. the fraction of correct outcomes averaged over a nonoverlapping sliding window of 30 trials, for the case in which only the bottom-up (ITC to PFC) synapses are plastic ("TD-off," black) and when both bottom-up and top-down synapses are plastic ("TD-on," grey). Performance is moderately affected by the presence of plastic top-down synapses: learning is seen to be slightly faster and more stable. As seen from Fig. 4, worse performance for the TD-off case is accompanied by larger fluctuations, as expected.
Moreover the differences between the bottom-up structures suggest that there is a better signal-to-noise ratio for the TD-on case even if the performances are similar for TD-on and TD-off, mainly due to the high stimulus contrast, that is the difference of stimulation to the two diagnostic population subsets Δλ = 0.3 Hz, used in these simulations. We will see in the following that as the stimulus contrast gets lower the top-down selective synaptic structure also entails differences in the performance and in the time needed for the categorization.
Figure 4, B and C, shows the corresponding evolution of the fraction of potentiated synapses for the different bottom-up (Fig. 4B) and top-down (Fig. 4C) synapses, grouped according to the feature/category populations they connect. Only a representative subset of synapse groups is shown in Fig. 4.
In Fig. 4D, the three checkerboards illustrate the final synaptic configurations for both plastic and nonplastic top-down synapses. Each square represents the fraction of potentiated synapses at the end of the learning period. The synaptic weights connecting a diagnostic feature population with its (anti-) correlated category were (depressed) potentiated. For the synapse groups involving nondiagnostic features, the case shown is the computationally advantageous one in which the final bottom-up synapses are slightly depressed (which helps in obtaining a stable learning trajectory), and the top-down ones are markedly depressed (which results in a sort of "selective amplification" of the relevant information, improving the categorization performance, see Fig. 6 and discussion below). The final synaptic configuration is consistent with the expectations explained in Fig. 1.
We show the neural correlate of the categorization process in Fig. 5. The first three panels at left show, for three successive stages during learning, the time course of the firing activity of five populations, averaged over 20 correct trials (outcome C1). In each panel, we plot the activity for the two category populations (C1 and C2, respectively, requested and nonrequested class), the population encoding the active value of the diagnostic feature (Δλ = 0.3 Hz), one nonstimulated population and one of the stimulated populations coding for the nondiagnostic features.
Here it is seen that, as learning proceeds, the activities of diagnostic populations stimulated and not stimulated (cyan and orange) split, consistent with the experimental observations of Sigala and Logothetis (2002) and with theoretical results obtained by Szabo et al. (2006) in a simpler context. The last panel in Fig. 5 shows the time course of the average activities for the same populations at the end of learning, but with nonplastic top-down synapses, and confirms that the splitting observed for the TD-on case is an exquisite effect of a selective top-down synaptic structure.
Influence of selective top-down synapses on network performances.
We showed in Fig. 4 that the implemented plasticity in the top-down synapses: 1) sharpens the selectivity of the bottom-up synaptic structure, and 2) moderately affects the time course of the learning dynamics. We also found (Fig. 5) that the selective top-down synaptic structure entails breaking the symmetry between the neural activity encoding stimulated diagnostic and nondiagnostic features, consistent with the results of Sigala and Logothetis (2002). One can still ask to what extent the above results also imply important effects on the computational performance of the network, thereby helping formulating informed guesses about the mechanisms underlying the corresponding experimental findings.
To understand this, it is important first to remark that our system is a noisy one and in fact it is subject to two very different main sources of noise, one "exogenous" and the other "endogenous." The first depends on the dimensionality of the feature space in which the stimuli to be categorized are defined. The very definition of diagnostic vs. nondiagnostic features implies that during learning the former are consistently associated with the defined categories, trial after trial, while the latter implement a random category labeling for each trial. Consequently, the higher the number of nondiagnostic features, the larger the associated component of the total input to PFC, that would overwhelm the one from diagnostic features in the absence of plasticity in top-down synapses, which realizes an effective amplification of this signal-to-noise ratio (which is then to be understood as the ratio between the inputs coming from diagnostic and nondiagnostic features). The other, endogenous noise source is due to stochastic nature of the neuronal network dynamics. The network has sparse connectivity, a different realization of which is generated for each simulation. This quenched noise, together with the finite-size effects due to the finite number of neurons in each population and the consequent distribution of firing rates, affects both the dynamics of decision (through the firing rate fluctuations) and the dynamics of learning (since, as explained in the methods, the dynamics of synaptic plasticity, although rate dependent on average, is stochastic, to the extent that the neural activities are). This endogenous noise, besides being a realistic ingredient of any finite and sparse system, contributes to expand the dynamic repertoire of the network (e.g., the range of decision times). Of course, an additional "fast" noise component is due to the Poisson spike trains implementing the stimuli.
In the following sections, we quantify the effect of a selective top-down synaptic structure in diminishing the effect of the exogenous noise, thus improving learning performance. We also investigate how the top-down synaptic structure affects the dynamics and characteristic times of the classification process.
At the end of learning (obtained with Δλ = 0.3 Hz, NF = 16), we freeze the synaptic structure and then apply new stimuli with different levels of contrast Δλ = 0.05, 0.1, and 0.2 Hz (λ = 4.2 Hz) and different numbers of stimulated nondiagnostic features (NF = 4, 8, and 16), and test the performance. For each Δλ and NF we also test the performance of the network in which we substitute the learned, selective top-down synaptic structure with a uniform set of synapses (JPFB = JDFB = JnFB), the efficacies of which are drawn from the same probability distribution, with an average such as to match the top-down synaptic efficacy averaged over each postsynaptic population of the structured TD-on case.
Figure 6A shows the network performance (percentage of correct classification) for different numbers NF of nondiagnostic features and for three values of stimulus contrast Δλ, with selective and uniform top-down synaptic structure.
For the same number of nondiagnostic features, performance increases with Δλ, as expected; the most relevant result is that, for given Δλ, the network with structured top-down synapses retains high performance even for a large number of nondiagnostic features. The effective signal-to-noise ratio that drives the competitive mechanism in the PFC layer is made almost independent from the number of "distracting" nondiagnostic features, as a result of the depressed top-down synapses pointing to nondiagnostic features. In other words, if we call S and S + ΔS the total input to the two category populations, the structured top-down synapses determine a higher ΔS/S ratio: as the number of stimulated nondiagnostic features increases, the common input S would be dominated by the activity of nondiagnostic populations, were it not for the combined effects of top-down depression of JnFB synapses and the sharpened differentiation of (JDFF vs. JPFF) and (JDFB vs. JPFB) (see Fig. 6D).
On the other hand, we remark that the selective top-down synaptic structure does not increase the signal ΔS since, until the competition in the category layer sets in and a decision is taken, the diagnostic features populations receive equal feedback. This is consistent with the observation that, for low numbers of nondiagnostic features, the performance is essentially the same for structured and unstructured top-down synapses.
Figure 6, B–D, illustrates the relationship between performance and decision times for the same values of NF and Δλ as in Fig. 6A for both selective and uniform top-down synaptic structure. We defined the decision time (DT) as the instant when the absolute difference between the firing rates of the two category populations, divided by their sum, exceeds a given threshold D (we set D = 0.7 as in Marti et al. 2008). The typical speed-vs-performance curve derived from psychophysics experiments is monotonically decreasing (as it derives from increasing the stimulus control parameter, Δλ in our case, which entails increasing performance and decreasing decision time). The selective network (gray lines) is always faster than the uniform one (black lines) at equal performance. Thus the structured feedback not only favors better performance for the same input (Fig. 6A) but also makes the network more prompt to respond if the input current is adjusted to match the performance. In the case with uniform top-down, for given NF, C1 and C2 receive greater symmetric input S, and are therefore less sensitive to the relative variations of their activities, such that they spend more time in a symmetric, "undecided" state. The higher NF, the greater the comparative advantage of the selective network (Fig. 6, B–D). The DT gap between selective and uniform case for high performance is seen to be mostly due to a marked flattening of the DT vs. performance curves for the uniform network: for the selective top-down network, DT preserves higher sensitivity to the selective input strength Δλ and the expected DT vs performance fall-off is observed even for the highest NF. The above observation can be understood again in terms of the larger increase of the symmetric input component S to C1 and C2 for the uniform network. As S increases with NF, the dynamics spends longer and longer times around a state with almost equally high firing rates for both C1 and C2; Δλ has little influence on this time, yet it still determines the performance of the network; taken together, these two effects explain the observed flattening of the RT vs. performance curves. Indeed, an almost symmetric fixed point of the dynamics with high firing rates for C1 and C2 is expected to develop as S increases, around which the dynamics of decision is strongly distorted and where the network stays for longer times.
Figure 7 illustrates the different neural dynamics during the decision process for the selective and uniform networks, for NF = 16 and Δλ = 0.5 Hz, which underlie the behaviour described above. Figure 7, A and B, shows the time course of firing rates of C1 and C2 (black and grey curves, respectively) during the fastest (thicker curves) and the slowest (thinner curves) trials. It is seen that the spread in decision times is much larger for the uniform case (see also the distributions of decision times in Fig. 7, C and D). One possible interpretation, consistent with known phenomenology of cooperative-competitive models of decisionmaking, can be obtained if we picture the network dynamics as the motion on an "energy landscape," with each point being identified by the energy level and the average firing rates of C1 and C2. The stable decision states of the network, induced by a stimulus, are identified by two asymmetric minima of the landscape (high firing of C1, low firing of C2, and vice versa). The diagnostic component of the stimulus determines a force driving the dynamics from the initial saddle the systems starts from (almost equal firing for C1 and C2) towards one of the two decision states, and it is expected to be maximally effective for the selective case in which the component related to diagnostic features is amplified; for the uniform case the strong common component of the input to C1 and C2 makes the system roll on a flatter saddle, the departure from which, towards one of the asymmetric minima, take more time on average.
Of course the chosen value of uniform top-down synapses affects the characteristic times of the decision dynamics; by varying this value between 0 (no feedback) and 2 JFB (beyond which the state of spontaneous activity of the network with no external stimuli is disrupted), we checked that 1) performance is only slightly affected (< 6%); and 2) the qualitative features of the lines in Fig. 6, B–D, are preserved, though the exact values of DT obviously change.
Corrupting learned stimuli: a footprint of categorization in ITC.
The multipopulation model system is a complex recurrent network, with local intramodules feedback and intermodules PFC-ITC feedback. One might then ask whether certain characteristic properties of recurrent networks could play a role in the situation under study, such as the pattern completion ability of attractor networks.
Starting from a network configuration obtained at the end of successful learning, we went on to stimulate the network with corrupted versions of the stimuli, i.e., stimuli for which only a fraction x of the neurons in the currently activated diagnostic population receive the usual increased external current, as explained in methods.
In this situation, we studied the time course of the neural activities of the stimulated and nonstimulated neurons in the diagnostic population defining the current stimulus and how it is affected by the learned, selective synaptic top-down structure. The expectation is that, as the decision process in the PFC matures, the unstimulated neurons belonging to the activated diagnostic feature would be recruited as a result of the combined effect of the selective top-down input and the recurrent interaction with the stimulated neurons in the same population.
Figure 8 illustrates example results, obtained for low value of Δλ = 0.05 Hz (where we expect the recurrent synaptic structure to play a comparatively greater role) and x = 0.75. Neural activities are reported for three trials that happen to have (for the same network configuration and stimulation parameters) different decision times DT. Firstly, we note that, as expected, as the decision process matures the unstimulated population gets recruited (green trace). Secondly, and interestingly, the recruitment occurs with a latency determined by the time it takes for the decision process to complete (compare the three panels in Fig. 8). This latter observation is interesting because it constitutes a specific reflection of the time course of the decision process developing in PFC, in a time-dependent modulation occurring in the unstimulated neurons in ITC, at the single trial level.
The same reasoning would also apply to a situation in which each stimulus is defined by multiple diagnostic features, in which case corrupting a stimulus might mean excluding one or more diagnostic features from the ones the stimulus is supposed to activate.
In other words, assuming the feature selectivity of ITC neurons is experimentally well characterized, so that one can identify the "unstimulated" diagnostic neurons that correspond to a specific corruption of the stimuli, the point in time when those neurons would start to sharply increase their firing activity during the trial would signal the completion of the decision process in the absence of simultaneous recording from PFC.
We remark that the observed recruitment of nonstimulated neurons coding for a diagnostic feature would not be observed in the absence of a category-related top-down information flow, which is consistent with the data reproduced in Fig. 3 where (for the anesthetized animals that do not perform decisions and hence top-down projection would be unavailable and pattern completion should not occur) an impoverished stimulus makes the corresponding feature representations disappear.
Selective top-down synapses sharpen tuning curve.
For all the numerical experiments described so far, we adopted a minimum feature representation (one diagnostic feature, with two values). It is known that feature-selective neurons in the temporal lobe exhibit a variety of tuning curves, see e.g., Freiwald et al. (2009). As already noted, we do not aim at reproducing specific aspects of the activity in the infero-temporal cortex; however, studying the implications of tuning curves in our ITC layer is relevant from the computational point of view that concerns us here. Therefore, we adopted a simple generically plausible shape of tuning curves and explore how they are affected by learning. We report results obtained for a network in which the diagnostic feature possesses four values (therefore, four populations D1, …, D4 code for it in the ITC layer); furthermore, each stimulus is encoded by a profile of activation of the four diagnostic populations, with the maximal activation for the active value of the feature for that stimulus (as before we have NF nondiagnostic features with two values each). In this way we implement a crude representation of tuning curves in this feature layer. Stimuli with maximal activation of D1 and D2 are to be mapped to class C1 and D3 and D4 to C2. Stimuli with maximal activation of D1 and D4, for which the activation profiles of the four diagnostic populations has the smallest overlap, are "easier" to classify with respect to D2 and D3; we will therefore label them as "easy" and "difficult" stimuli. One can expect that the build-up of the selective top-down synaptic structure could affect the activation profile of the diagnostic populations. In fact, we observed (see Fig. 9) a marked sharpening of the tuning curves for both easy and difficult stimuli (compared Fig. 9, A and B vs. C and D) for which, however, we obtained slightly different final performances (see percentages of correct responses reported in Fig. 9, right). The results shown in Fig. 9 constitute a further evidence of the computational consequence of a learned selective top-down synaptic structure and establish a specific experimental prediction. We remark that in our model the sharpening develops after the decision is taken, which suggests that if one could monitor the tuning curves in successive time intervals during trials, depending on when their sharpening occurs with respect to the decision time, one could get an indication about their origin being in a task-specific top-down signal.
Countermodulation in error trials.
In Fig. 10, we show how network activities are differently modulated according to the correct (top) or wrong (bottom) outcome of the trial. Solid lines are the average activities of the relevant populations over five consecutive trials approximately at an intermediate point of the learning process. Figure 10, top, shows the expected (see Fig. 5) ranking of the stimulated diagnostic vs. nondiagnostic features, which is destroyed for the wrong trials. Notice in particular the nonstimulated diagnostic feature value (orange trace), which as expected shows and increase of activity, being tightly correlated to the wrong decision state. This is because in the former case the stimulated diagnostic population receives, in addition to the stimulation, a coherent reinforcement from the correctly winning PFC population, with which learning has already formed strengthened synapses, while in the latter case the wrongly winning PFC population feeds back on it through synapses which have been weakened by learning. This observation suggests that the operation of a task-related selective feedback could be tested in in vivo experiments by comparing the modulation of the activities of neurons with different selectivities in correct and wrong trials. A hint that such a strategy could be viable and informative is provided in Mirabella et al. (2007), where evidence is provided that the activity of neurons in V4 during a visual selection task involving attention is differently modulated depending on the trial being correct or wrong.
The idea that perceptual learning, visual categorization, and/or selective attention involve an effective suppression of irrelevant sensory input is not new (i.e., see Riesenhuber and Poggio 1999; Bar 2003; Spratling and Johnson 2004; Roelfsema and van Ooyen 2005). For the specific case of visual categorization, even if experimental evidence is still inconclusive as to whether top-down control by PFC is needed to accomplish it (see Minamimoto et al. 2010; Buckley and Sigala 2010), several reported results suggest a role of ITC-PFC mutual interaction in the arbitrary stimulus-category association. In the present work, we put this idea in a specific context and address a general computational issue, i.e., the implication of learned, selective top-down projections between a category-aware area and a sensory-coding one, taking visual classification as a relevant case in point. With a simplified ITC-PFC model designed to account for the key results shown in Sigala and Logothetis (2002) and in De Baene et al. (2008), we showed that a semi-anti-Hebbian, spike-driven learning mechanism generates a selective amplification of taskrelevant neural representations in ITC and, because of this, enhanced classification performance and faster response. In the present work, we adopted the simplest choice for the feature space defining the stimuli, i.e., just one diagnostic feature with two possible values. We remark, and checked in simulation in a few cases, that as long as the classification problem remains linearly separable, enlarging the dimension of our one-dimensional "diagnostic subspace" (as in the case of the two-dimensional subspace of Sigala and Logothetis 2002) does not spoil the classification ability of the network (it acts in fact as a Perceptron; Rosenblatt 1958), nor the mechanism of selective amplification of diagnostic information. However, for the higher dimensional case the synaptic configuration generated by online learning does depend on the choice of the training stimuli, on the presentation sequence and on the initial condition (as it is the case for the Perceptron). This work is one of the few so far addressing dynamic learning effected by the ongoing spike-driven synaptic dynamics of LTP and LTD, coupled in closed loop with the stimulus-driven spiking activity in a multimodular network. We showed how robust learning histories lead the global network to perform well in the face of the many sources of instabilities that affect dynamic learning (see Del Giudice and Mattia 2001; Del Giudice et al. 2003; Amit and Mongillo 2003). In particular, finite-size effects are important and bring about deviations from the predictions of the mean field theory that guide simpler approaches like the one we adopted in Szabo et al. (2006). For a finite number of synaptic connections per neuron, each population has a distribution of emission rates. We remind that our synapses are stochastic, as long as neural activities are (see methods). Considering for example the synapses connecting populations of neurons stimulated by the same stimulus, and therefore supposed to get potentiated, the high- and low-rate tails of the actual frequency distribution corrupt the homogeneity of the pattern of synaptic transition probabilities, such that in the same synaptic group some synapses will have too high LTP probability, while others will be unexpectedly unchanged. Similarly, finite-size effects can provoke unwanted synaptic transitions where they are not expected and harmful (such as a potentiation of synapses involving postsynaptic background neurons, which can become the seed of instability for the spontaneous state). One ingredient that makes finite-size effects more or less harmful is the character of the "synaptic transfer function," meaning the function giving the LTP/LTD transition probabilities as functions of the pre- and postsynaptic emission rates. The sensitivity of this function in the critical region where the rate distributions involved overlap is an important factor in determining how serious finite-size effects are going to be. These and other effects make online learning with realistic, spike-driven synaptic dynamics a major challenge that we faced in this work, which, besides the value of the new results and predictions we provide, hopefully contributes to advance a domain of modeling studies that needs progress. The assumed plasticity for the top-down (PFC-to-ITC) synapses turns out to ensure slightly faster, and significantly more robust, learning histories (Fig. 4).
The value of a model lies of course in its ability to generate testable predictions. We list in the following some speculative implications of our model. The learned selective top-down synaptic structure essentially lowers the effect of the "noise" associated with the nondiagnostic features, by amplifying the "signal" component associated with the diagnostic features; it is therefore expected to matter more as the number NF of such features increases. This is indeed what we showed in Fig. 6, where it is seen how the improvement in the classification performance increases markedly with NF. Note that, because of the nonlinearity of network responses, the additive top-down feedback can in fact produce essentially multiplicative effects, as it has been shown in the context of attention modeling in Deco and Rolls (2005).
We expect the predicted task-specific modulation not to depend much on the details of the chosen model and to be shared by any model based on selective amplification of taskrelevant sensory information. We can then speculate that, if the global neural activity induced by a stimulus in ITC is measured, for instance by the BOLD signal, it would be more evenly distributed in the naive subject, before learning the task and more concentrated in the well-trained subject: before learning, the patchy ITC representation would generate signal spots of comparable intensity, while after learning the signals associated with the amplified, taskrelevant features would pop up. Also, one can predict that turning a nondiagnostic feature into a diagnostic one in a previously learned set of stimuli would result in an expansion of the dominant signal spots.
Previous works (Op De Beeck et al. 2006; Gillebert et al. 2009) studied the functional MRI correlate of learning categorization, showing that the BOLD signal associated with categorized images is enhanced after learning. Our results are compatible with those findings, in that the global activity in our feature layer after learning is indeed higher. However, our results together with the electrophysiological results of Sigala and Logothetis (2002) and De Baene et al. (2008) suggest the above prediction which goes beyond these findings, i.e., the spatial variability of the BOLD signal should reflect the differential activation corresponding to diagnostic and nondiagnostic features.
Our results shown in Fig. 9 suggest that if the proposed mechanism of selective amplification of diagnostic features representation operates, learning the categorization task would result in sharpen tuning curves for diagnostic features. This effect is qualitatively compatible with the differential category-tuning reported by De Baene et al. (2008).
We showed in Fig. 10 that error trials entail a qualitatively different modulation of neural activities. This generates a testable prediction, in line with previous suggestions like Mirabella et al. (2007) in which evidence is provided that the activity of neurons in V4 during a visual selection task (involving attention) is modulated depending on the trial being correct or wrong. It is clear that such an option would be viable only for a version of the task allowing for a non negligible error rate even in well trained subjects.
Results shown in Fig. 6, B–D, suggest that some of the direct implications of the selective feedback synaptic structure envisaged in the model might be amenable to investigation in psychophysics. Indeed, both the relevant parameters Δλ and NF playing a role in shaping the plots of Fig. 6, B–D, can be experimentally varied (for NF various choices are available in principle, including adding new features or making preexisting nondiagnostic features variable among stimuli). The nontrivial, and interesting, experimental question relates to the interplay between Δλ and NF: Δλ has the dual role of biasing the decision dynamics and also (when feedback is present and not yet selective) to cause an increase in the activity induced by nondiagnostic features. Therefore, by looking at the changes in the DT vs. performance plots while the subject is "learning" to ignore one more nondiagnostic feature one could qualitatively check the prediction implied by a selective feedback buildup.
More in general, one can easily imagine a situation (frequently explored both in psychophysics and in electrophysiology) where a pair of features are consistently associated with the same category or where stimuli are presented in different sensory modalities. In such situations, after training, a generic and testable prediction is that the presentation of one member of the pair, or the presentation of one sensory modality, would entail the partial activation of the other member of the pair or the representation pertaining to the other sensory modality, respectively.
In Fig. 3, we suggested that the chosen architecture of our simplified model is consistent with reported evidence concerning visual objects representations in ITC. In Tsunoda et al. (2001), besides reporting the patchiness of object representation in IT cortex that we referred to in the methods, the authors also notice that, as the visual appearance of objects is deprived of features that, although "small," are key for its interpretation, not only the corresponding activity patches disappear, but also new ones appear. The authors suggest that the distributed object representation would result from the activation, and active suppression, of a constellation of (possibly overlapping) feature-specific neural populations. Based on our modeling results, we can speculate that the task-dependent modulation of selectivity induced by learning might reshape such regions of overlapping representations (see Fig. 3). Specifically, if a IT neuron, before learning, has a mixed selectivity for two (values of) features, if the latter are mapped by the rule to the same category, the changes induced by learning in the synapses linking that neuron to the PFC category populations are consistent, and this will end up boosting the activities in the mixed selectivity neurons. On the other hand, if the mixed selectivity relates to features belonging to different categories, we can expect that the original differences in the neural responses to those features get amplified. If neurons in the overlapping patches have a nontrivial distribution of firing rates for the two features, learning would result in shrinking the overlapping regions. While the details will depend on several factors (such as the initial tuning curves for the involved features, the frequency of presentation of different stimuli, the nonlinearities in the dependence of synaptic changes on neural activity), we suggest that a task-dependent modulation of the overlaps in the patchy ITC representation would be expected. With reference to the categorization problem in Sigala and Logothetis (2002), in which the category boundary is linear in the two-dimensional diagnostic space, the proposed effect can be seen as a modulation of the classifier margin. Also, the differential modulation of diagnostic and nondiagnostic feature representations could in principle account for the appearance of previously suppressed features when key elements of the visual object are removed (observed in Tsunoda et al. 2001), via the mutual inhibitory interactions in the ITC layer.
Finally, the experiments performed with corrupted stimuli, besides confirming expectations based on the recurrent network architecture, suggest that (thanks to the learned selective topdown synaptic structure) a specific neural correlate of the decision process being completed would be available in a feature-encoding area.
The research leading to these results received funding from the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
No conflicts of interest, financial or otherwise, are declared by the author(s).
We thank Jochen Braun for a critical reading of the manuscript.
- Copyright © 2012 the American Physiological Society


text:
Louise Bourgeois Placemats
Written by Katie on November 28, 2012. Permalink
Chances are that you can't afford to buy the art of Louise Bourgeois, but if you're a fan you sure can afford to pay $60 for a set of 4 place mats featuring designs from her fabric drawings. The intricate, geometric patterns are worthy of the wall, but we'll take it where we can get it. There are coasters too (shown below) if you can believe it.
Purchase Information:Price: $60.00
Available from: Artware Editions

subset: commoncrawl


text:
with beautiful fair trade furniture & rainbow accessories.
Enter your email address & we'll send you news of all our latest designs, super-saver offers & competitions too.
View Basket
Home > Bedspreads & Quilts > Cream Cotton Slub Check Curtain >
Customer reviews
average customer review
(1 customer review)
Discontinued - glad I got the last 4!
Lovely lightweight curtains. Look great up. I would buy these again if they were available in future.
Would you recommend this to a friend? Yes
18 years of beautifully designed fair trade furniture, forest care and fast delivery.
If anything you order isn't exactly what you wanted, simply return it to us for a refund.
Regardless of how many items you order, you only pay one fair delivery charge.


text:
Posts by GABBY:)
Total # Posts: 10
Hendricks --- x Lincoln ----- x+1 Bayside ---- 5 solve for x x + x+1 + 5 = 20 2x+6=20 2x=14 x=7 then plug it back in to hendricks,lincoln, and bayside
because the victims are put down early in life. they are hurt, so they put other people down and hurt them to make themselves look and feel "good"
how many degrees in a heptagon? is it 360? because of that's correct, here how to work it out: a= single angle 126+6a=360 6a=234 a=39 hope that helps!
ok this is my stuff! ok first figure out the y intercept of the 2nd equation. 2y+3x=-4 2y=-3x-4 y=-3x/2-2 so y intercept = -2 then change equation 1 into y-intercept form: 3x-2y=8 -2y=-3x+8 y=3x/2-4 <--- your final answer hope it helps:)
if i understand what you are saying: FOIL: (a+b)(a+b) a^2+ab+ab+b^2= a^2+2ab+b^2 so never true!!
its supposed to be in one matricies but there is no button on the computer for that!!
ok [ 1 -1 0 8] [-2 -5 -6 -27] [9 10 -1 54]
civics/american history 10th grade
thanks so much!!!!!!!!!!!!!!!!!!!:):):):0:):0:);):):)):)
civics/american history 10th grade
How does the Constitution provide for the system of federalism in the American form of government?


text:
(Adds Allergan statement)
By Tom Hals
WILMINGTON, Del., Aug 27 (Reuters) - Valeant Pharmaceuticals International Inc and activist investor William Ackman won their request for an expedited trial on Wednesday over the timing of a special meeting of Allergan Inc shareholders, a key to their $50 billion hostile takeover fight.
Delaware Court of Chancery Chancellor Andre Bouchard ordered a three-day trial to begin on Oct. 6. That start date is in line with their request for the court to order Allergan - after the trial ends - to call a special meeting by mid-November.
That is about a month earlier than the Dec. 18 date Allergan has said it will hold the meeting at which Ackman and Valeant hope to elect new board members and open discussions on a deal.
The court order comes after Ackman's Pershing Square Capital Management hedge fund and Canada's Valeant sued the maker of Botox anti-wrinkle treatment on Friday, saying the company did not intend to call a meeting at all. Allergan subsequently set the meeting date.
In the lawsuit, Pershing Square, Allergan's biggest shareholder, alleged that Allergan was trying to avoid a special meeting to give it time to find an alternative deal.
In setting the expedited trial date, Bouchard said it was pretty apparent to him that "Allergan may not want a special meeting at all."
Since Valeant and Pershing Square offered to buy Allergan on April 22, Allergan has consistently rejected the offer, saying it undervalues the company. It has also announced a series of cost cuts and said it was looking for acquisitions as it seeks to persuade shareholders they are better off if it stands alone.
Allergan's lawyer told Bouchard on Wednesday that it needed time to avoid a "bum rush" by Pershing Square and to determine if Pershing Square had violated federal securities laws in obtaining its 9.7 percent stake.
Allergan said in a statement that it believes Pershing Square and Valeant are trying to hastily schedule the meeting to facilitate Valeant's "grossly" inadequate offer and to mask its operating performance.
Ackman began accumulating his stake in February when he and Valeant started talking about buying Allergan together. He disclosed his stake on April 21, and the companies announced the offer on April 22, which instantly pushed Allergan shares higher and created $1 billion in paper gains for Ackman.
Allergan has sued both Ackman and Valeant for insider trading in federal court in California, saying that aspects of their unusual arrangement violated securities regulations.
Valeant shares fell $1.03, or less than 1 percent, to $116.07 and Allergan was down $1.92, or 1.2 percent, at $162.06.
(Reporting by Tom Hals, additional reporting by Caroline Humer in New York; Editing by Lisa Von Ahn and Jonathan Oatis)


text:
Anamika 13:46
Cecilia de Lys 0:53
Two lesbians one dildo 13:40
A sight To A Gape 2:00
Drink group porn 20:20
Ebony beauty 14:53
Fashionistas Safado 2:00
Super Mario Sisters 10:07
Hot amateur couple 22:41
My neighbor... 10:33
Gobble My spandex 3:01
Pornstar teaser 84:51
Tamil classic old porn 28:42
Teen natasha 14:35
Tan sex kitten fucked 20:36
How to fuck a blonde 23:19
Tribbing 1:21
Amateur webcam slut 1:54
Best Porn Collections
Best free porn video, xxx sex tube Wonderful amateur porn, cute blonde teen sex, hottie girl, hot teen japanese babes xxx video Amateur porn, Teen sex, Blonde, Japanese babe, Xxx video, Mobile porn 28 videos | Popularity: 13721 | freeporn
Bangla xxx video Bangla famous XXX porn scenes, real footage of the busty brunette having her tight little love holes pumped in really erotic movies. Nudity and plenty of foreplay along smashing scenes of quality sex, all stashed in a simple collection with Bangla porn available here! Bangla, Xxx, Bangladeshi, Bangladeshi porn, Bangladeshi sex, Banglaporn 16 videos | Popularity: 15503 | sexyman
Closeup clit xxx collection A wonderful collection of XXX videos with plenty of hot scenes that contain closeup clit fingering and stimulation. Women pinching their big clits in close up scenes while moaning and enjoying many other oral things. A rare collection which contains some of the best and most wanted closeup clit porn scenes. Closeup, Close-up, Clit, Pussy 19 videos | Popularity: 13958 | devereux
Cuckold XXX Porn Collection Cuckold XXX sends the viewer to watch amazing fetish porn scenes with hubbies being turned on and teased by their wives or other chicks when they have sex with other men. Cuckold 16 videos | Popularity: 13998 | pornmagnat


text: Cemetery Orders Sponge Bob Headstones to be Removed By Renee Nelson October 22, 2013 How would you feel about a headstone shaped like Sponge Bob? Well, some have a problem with it in historic Cincinnati cemetery. The headstone is for a young woman who was murdered earlier this year in a hotel room. Her boyfriend has been charged. She also is an Iraq war veteran. Read More Category: Community, Lifestyle, Offbeat Tags: sponge bob Send to a friend! Share on Facebook Share on Twitter Pin it! Reddit This! Share on Tumblr!


text:
ANCHORAGE, Alaska (AP) – Anchorage police say a woman died on the city's west side after she was shot and struck by a vehicle.
Police at about 9 p.m. Wednesday took a call of shots fired in the 1800 block of west 36th Avenue.
Officers found an injured woman lying in a yard of an apartment complex. She died at the scene.
The woman's name was not immediately released.
Investigators say the woman was shot and struck by a vehicle attempting to flee. The vehicle then struck the apartment complex.
Police interviewed the driver and others. Police say the incident was connected to drug use and was not random.
An autopsy will determine cause of death.


text:
What is JotForm?
JotForm is a free online form builder which helps you create online forms without writing a single line of code. No sign-up required.
At JotForm, we want to make sure that you're getting the online form builder help that you need. Our friendly customer support team is available 24/7.
We believe that if one user has a question, there could be more users who may have the same question. This is why many of our support forum threads are public and available to be searched and viewed. If you'd like help immediately, feel free to search for a similar question, or submit your question or concern.
Unread won't go awayAsked by piglit on January 19, 2017 at 11:14 AM
I have one form "Night to Shine Participant Media & Liability Rights Release" and it continually shows one new response. I've gone through and clicked each response and all are read but still it says I have a new unread one.
JotForm Support
Click on More, then on Mark All as Read:
Let us know if you need more help.


text:
The Bell & Gossett Sediment Removal Separator (SRS) is a patented centrifugal style air and sediment separator for use in any HVAC system. Its 3-to-1 body diameter to nozzle diameter ratio slows the fluid velocity to allow entrained air and suspended sediment to come out of solution, while its tangential inlet and outlet nozzles induces centrifugal fluid flow. This centrifugal flow creates a low pressure vortex in the center of the tank where entrained air can come out of solution and float to the top of the tank and suspended sediment can sink to the bottom. In addition, the SRS features an extended collection cap at the bottom of the tank where sediment can collect without the risk of being pulled back into the system by the exiting fluid. These impurities can then be easily removed via an air vent or connection to an expansion tank and a blowdown valve.
Contaminants such as air and suspended sediment can lead to diminished heat transfer, higher energy costs, damage to your system components, and increased system noise. By removing them you can lower the cost to operate your system, extend the life of your components, and provide better comfort to your building occupants.
All SRS models are designed, constructed, inspected, and stamped per Section VIII, Division 1 of the ASME code for 125 psi (862 kPa) maximum working pressure and 350°F (177°C) maximum working temperature. Higher pressures and temperatures are available upon request. Models are available in sizes 3″ through 36″ and are available with NPT (3″ only), flange, or groove end connections.
Features and Benefits
Removes Entrained Air and Suspended Sediment
Centrifugal Flow Pattern
Models from 3″ – 36″
-Other body materials available upon request for 3″ – 36″ models
Designed, constructed, inspected, and stamped per Section VIII, Division 1 of the ASME Code
Xylem Online
We are pleased to introduce Xylem Online for selection and sizing of Bell & Gossett products.
Xylem Online includes the following products:
To access Xylem Online simply:
Now you're ready to log in Xylem online and begin working with the tool.
Recommended Browsers: IE10 or Google Chrome:
General Selection Tools:
Heat Exchanger Product Selection
Steam + Water Pressure Reducing Values
Sizing Tools:
Report Bugs/Request Enhancements
Please email the following address to report issues and request enhancements: email@example.com
Consult your local Bell & Gossett Representative for additional assistance.
Xylem Water Solutions Singapore
6 Wan Lee Road (Jurong)
Singapore 627937
Tel: +65.6266.6006
Fax: +65.6266.5005
Email: email@example.com
|Contact Person
|Email Address


text:
The Black Widower : The Life and Crimes of a Sociopathic Killer Paperback
by Charles Lavery
He drugged his first wife and staged a fireball car crash, collecting a GBP200,000 insurance payout.
He cheated his second wife of her life savings and attempted to kill her in a copycat crash.
He faked cancer to dupe his third victim into a bigamous marriage, plotting her murder to steal her inheritance.
He is Malcolm Webster: The Black Widower. After seventeen years of deception and brutality, Webster was finally jailed for thirty years in July 2011 at the climax of one of the longest trials in Scottish legal history.
In this chilling book, award-winning journalist Charles Lavery documents the Black Widower's life and crimes, giving a compelling insight into the mind of a man who killed for money and attempted to cover his tracks with drugs and fire.
- Format: Paperback
- Pages: 272 pages
- Publisher: Mainstream Publishing
- Publication Date: 01/07/2012
- Category: True crime
Other Formats
- EPUB from £8.99
Free Home Delivery
on all orders
Pick up orders
from local bookshops


text:
What is JotForm?
JotForm is a free online form builder which helps you create online forms without writing a single line of code. No sign-up required.
At JotForm, we want to make sure that you're getting the online form builder help that you need. Our friendly customer support team is available 24/7.
We believe that if one user has a question, there could be more users who may have the same question. This is why many of our support forum threads are public and available to be searched and viewed. If you'd like help immediately, feel free to search for a similar question, or submit your question or concern.
The product I have added that has options doesnt showAsked by Klokhuis on August 31, 2016 at 01:36 PM
The product I have added that has options doesnt show. (third product) The bounding div gets an element style added, not sure how to override this
JotForm Support
It seems that the height of the item in the payment wizard is being overridden by the sub-product options.
Please try injecting the following CSS code to your JotForm that should resolve the issue.
.form-product-item {
height: auto !important;
Please get back to us if you need any further assistance. We will be happy to assist.
aha, didnt think of that. Very simple, solved it. Thanks Kiran.


text:
Manage your accounts from the comfort of your home or anywhere with internet access.
View Online Services
Any time, any place - Family Savings Credit Union will always be with you.
Enroll Today
When you join Family Savings, you become part of our family.
Kasasa Cash Checking up to 2.50% APY*Share Certificates up to 1.71%APY*IRA Share Accounts up to 0.45% APY*
View All Rates & Disclosures >
We are very involved with the communities we serve by sponsoring events, teaching financial literacy in schools & businesses, volunteering to serve others and donating to organizations and projects.
See What's New
Exclusive member discounts from Sprint, TurboTax, Allied Movers, and more...
Extra Links


text:
FOOTE IN THE DOOR: It's probably exaggerating to call playwright Horton Foote the patron saint of Tucson Art Theatre, but the small company has won critical acclaim for its lovingly realized productions of his plays over the years.
The company chose Foote's Valentine's Day for its first-ever production, artistic director David Greenwood remembers, because "the play is about a couple coming together for a life together, preparing for the birth of their child. We thought it was an appropriate metaphor for a new theatre company." Since then, Tucson Art has done four other Foote plays.
"I'm interested in his work because I think he's the best playwright today," Greenwood says. "You have Tennessee Williams and Eugene O'Neill. I think he's their equal in quality, and surpasses them in quantity."
The 79-year-old Foote, who won the Pulitzer Prize for Drama a few weeks ago for his play The Young Man from Atlanta, will be in Tucson in two week's time lending his expertise to local theatre people, partly through the efforts of Greenwood. The annual Arizona Theatre Conference will be held at PCC Center for the Arts June 2 through 4, and Foote will be around the whole weekend to guide participants in the workshopping of his play Roads to Home, a series of three one-acts.
Better known to the general public for his extensive film work--he won Academy Awards for his screenplays for Tender Mercies and To Kill A Mockingbird, and an Indie Award for Trip to Bountiful--Foote has had a long and respected career in theatre. The low-key plays penned by this Texas native are heartbreaking dramas about small-town communities, family life and loss.
It's a real coup for the Arizona Commission on the Arts to have landed an artist of Foote's stature for the conference, and the commission's Claire West points out they were able to do it only with Greenwood's help.
"All I did was make an initial phone call," Greenwood says modestly. "He's very approachable. This is a man with no ego whatsoever."
Greenwood was on the committee that helped put the conference together. "When we were getting ready to have the conference we wondered, do they (speakers) have to be local? Chris Wilken (associate artistic director of Borderlands Theatre) said, 'Why don't you call Horton Foote?' "
Greenwood and other company members had already established a relationship with the genial playwright.
"We had been in contact with Horton back when we were doing (his play) Spring Dance in November of '93," Greenwood says. He wasn't able to make the show, but we kept in contact by phone and letter and then last summer we all went down to Wharton, Texas together and had dinner at Horton's house."
Ken Cavett, one of the Tucson Art Theatre actors who went to Texas to see Foote, then continued on to New York to appear in a Foote play, Talking Pictures, produced by the Signature Theater. This unusual 4-year-old theatre each year devotes its entire season of four plays to the work of a single playwright, who is in residence to offer his or her insights into the plays. This year's season was capped off with Foote winning the Pulitzer for the final play.
Foote will be doing a bit of the same at the theatre conference in Tucson, answering questions, giving advice, explaining characters. A Saturday-afternoon session will have Foote meeting with local playwrights. Three directors, including Wilken, have already been chosen to workshop the three one-acts. Participants can audition for acting parts or sign up to work on a design team.
On Sunday, rough readings of pieces of the play will be given, since no one expects finished scenes in such a short time. And once the conference winds down, Tucson Art Theatre will present a revival of its own production of Spring Dance, one of the three one-acts that make up Roads to Home. Cavett, fresh from his New York turn, will come down to pick up his old part.
"Horton believes in collaborative effort, as I do," Greenwood says. "He believes that a theatre is essentially a group of people."
The conference will also feature a keynote address by noted Broadway director Marshall Mason, and workshops on new technology, voice control for actors and ways to make local theatre relevant.
The Arizona Theatre Conference will be held June 2-4 at Pima Community College Center for the Arts, 2202 W. Anklam Dr. All activities, including the staged readings and Tucson Art Theatre performance, are open only to conference registrants. The fee is $65 for individuals, $45 per participant belonging to a group of three or more, $25 for students. Groups of five or more get one registration free. Limited scholarships are available. For an application or more information call Claire West at 602-229-8231.
| © 1995-97 Tucson Weekly . Info Booth


text:
Hoboken Police & Fire Blotter: 9/3/2011
Hoboken crime and fire action: September 3, 2011
An ongoing list of various noteworthy incidents, crimes and fire-calls throughout the day for Saturday, September 3, 2011. This post may be updated and "bumped" periodically.
Crimes, Incidents, Fire Calls & Vehicular mishaps
- 3:20am (9/4/2011): Hit & Run
Not unusual for a weekend night (or any day for that matter), but a hit & run car accident was reported near 15th & Park. No injuries at this time. A red-colored sedan was supposedly the offending vehicle that left the scene. Sheesh, remember – driving is a privilege, not a right.
- 2:08am (9/4/2011): Smashed car windows
A witness called HPD to say he saw a white male smashing car windows near 9th & Sinatra Drive. He said the alleged actor was vandalizing these cars by punching the windows with a t-shirt wrapped around his fist. What a fuggin loser! Maybe if the sentence for these crimes was a punch to the teeth, people would think twice about damaging the property of others.
2:30am Update: Are any of these NJ license plates yours? Three cars were damaged: D74-AWT (Audi), YXC-99M (Nissan SUV), and E95-AXL (Mercury SUV).
- 2:05am (9/4/2011): Robbery at Black Bear
An alleged victim of a street robbery walked into Hoboken Police Headquarters to say he was robbed at knife point by six black males near Black Bear Bar. He said $30 was stolen, and it happened around 1:35am. The supposed actors of this crime are long gone. The risk/reward here is $30 vs. Jail. Criminals be stupid.
- 12:55am (9/4/2011): Bar violation whirlwind
One Hoboken Police Officer noticed that Lola's Tapas Bar on 14th Street was bending almost all city rules tonight. Here's a rundown of what went wrong: Outdoor cafe open past 11pm, smoking cigarettes inside the establishment, no employee had a valid bar card (including the owner), and civilians were serving alcohol! They got a huge pile of summonses. Whoa Nelly, I always wonder how that place stays afloat! These stiff fines can't be good – probably wiped their profit out from tonight!
- 12:35am (9/4/2011): Tree butchers
HPD was notifed that "three black males and two black females were ripping trees out of the ground near Pier A Park" downtown. First, I'll say "thanks for not assaulting another human" – but what do you guys have against trees? They're not responsible for anything that's gone wrong in your lives!"
- 11:30pm: Down at the Salon
Here's one you don't hear too often in Hoboken: "Man down at Supercuts at 5th & Washington." Booze, OK I understand par for the course – scissors, NOT OK!
(It was actually just a homeless guy on the street, but imagine a salon brawl for real? They got some serious weapons in there!)
[showhide more_text="►►►► Show the rest of the day's blotter action…" less_text="Collapse Blotter ◄◄◄◄"]
- 2:40am: Off-Duty cop assaulted
Hoboken Police received calls that an off-duty police officer was assaulted by four individuals near 2nd & River Streets. Four black males plus one female in a red dress were reportedly involved. They were last seen possibly walking west on 2nd Street.
2:45am Update: Possibly an attempted car-jacking (individuals reportedly entering the vehicle and attempted to drive off with it…)
3:00am Update: Turned out to be no big deal, just pushing & shoving, no charges filed. Why do off-duty cops put themselves in those situations?
- 2:35am: Light Rail Robbery
Reports of a man who was robbed near the 2nd Street Light Rail station in the SW part of Hoboken.
- 2:05am: Assaulted
A man phoned Hoboken Police to say he was assaulted near 10th & Willow bar. Was it something he said?
- 1:45am: Street Fight
Reports of a standard run-of-the-mill street fight on Washington Street between 1st & 2nd. There has to be a way to reduce anger in the world – it's not good for the soul!
- 1:35am: Drunk Driver on the loose!
Hoboken Police received a call that a drunk female entered a red Mistubishi Eclipse and drove away in the area of 2nd & Washington. If you're hell bent on getting inebriated, either do it in walking distance of your home, or have a place to crash (not while driving your car, of course!)
- 12:45am: Grill Fire
HFD was dispatched to 233 Madison Street for a "grill on fire" on the balcony of a 3rd floor apartment. Not for nothing, but don't charcoal grills need to be lit on fire in order to cook your food?
- 12:30am: Courtyard Fight
Reports of a large fight in the courtyard at 300 Marshall Drive. Multiple HPD units being called on scene. One male on a bicycle under arrest so far.
- 12:15am: Female Assaulted
HPD got a call that a homeless female was in the process of being assaulted by a homeless male near the ShopRite and the 9th Street Light Rail station on the west side of town. She suffered a "head injury" and required ambulatory care.
- 12:10am: Bouncer Assaulted
Reports that a bouncer over at the Wicked Wolf Tavern on the waterfront was assaulted by a drunk patron. Boy, that would suck if the bouncers needed a security team.
More to come later…


text:
1. The words "School Shooting" at school are akin to yelling "BOMB!" in an airport. Even if it's just class notes.
2. Being smarter than your teachers isn't exactly a good thing.
3. Listening is an art. One that you wish other people would learn and use more often.
4. Teenagers with anxiety react with flight or fight when backed into a corner. Be gentle with them, and eventually they'll tell you everything.
5. No matter how helpful, naive, and softhearted your kid is, not everyone will believe it and despite the fact he's really smart, he'll still do things that make you want to smack some sense into him.
6. Techie people? Not always as smart as you'd expect.
7. Momma Bear on the outside, a sleepless, shaking, throwing up wreck on the inside.
8. Sometimes, I just hate everyone.
9. When mad enough, I really can curse like a sailor enough to surprise even Hubs.
10. I'm too old for this shit.
Wednesday, January 06, 2010
10 Things I've Learned From a Stress Filled Week
Posted by Karen Humphrey at 8:50 PM Labels: Deep Thoughts and the Soapbox


text:
A LITERATURE festival celebrating great writing will return to Harrogate for a seventh year in 2017 and has moved to a new autumn slot.
The Harrogate Literature Festival will be from October 19-22, at the Crown Hotel.
Yorkshire law firm Raworths has announced its continuation as title sponsor of Harrogate International Festivals' headline literature festival.
The festival has previously welcomed Sir Ranulph Fiennes, Kate Adie, Michael Palin, Alastair Campbell, Lord Melvyn Bragg, Kate Atkinson, Sue Townsend, John Suchet and Noddy Holder.
The programme this year will reflect the Harrogate International Festivals' over-arching theme for 2017 - generations.
Raworths became the inaugural sponsor of the festival in 2012 to celebrate its 125th anniversary.
Zoe Robinson, managing partner, said: "We are thrilled to continue our support of Harrogate International Festivals. There is a real synergy in this partnership of two long-standing Harrogate institutions, both proud of our legacies and contribution to the town."
The programme for the Raworths Harrogate Literature Festival will be announced in June.


text:
|Message view
|« Date » · « Thread »
|« Date » · « Thread »
|"Merwin Yap" <m...@exist.com>
|RE: Mail service
|Fri, 03 Jun 2005 10:46:45 GMT
Hi. Maybe for a newbie like me, I would be a bit confused. :) Anyway, I tried adding the smtp host and port but still failed sending. How about the username and password? About the documentation, maybe samples would help newbie like me. Thanks! Regards, Merwin -----Original Message----- From: Trygve Laugstøl [mailto:email@example.com] Sent: Friday, June 03, 2005 1:08 AM To: email@example.com Subject: Re: Mail service On Thu, Jun 02, 2005 at 06:04:51PM +0800, Merwin Yap wrote: > Thanks. But could you send me a sample of it? Is it in the configuration tag > part? It's documented here[1] under the section "Mail Notification". If anything is unclear please let me know and I'll fix the documentation. Basically you have to set <smtp-host></smtp-host> to your SMTP server. Make sure that you're allowed to relay messages through this server. [1]: http://maven.apache.org/continuum/configuration.html -- Trygve -- No virus found in this incoming message. Checked by AVG Anti-Virus. Version: 7.0.322 / Virus Database: 267.4.0 - Release Date: 6/1/2005 -- No virus found in this outgoing message. Checked by AVG Anti-Virus. Version: 7.0.322 / Virus Database: 267.5.1 - Release Date: 6/2/2005
|View raw message


text:
Subprime Crisis and Instability of Global Financial Markets
In order to prescribe adequate remedies to treat the current financial crisis one has to understand what in the first place went wrong. An age ago, older generations wrote that disease could not be cured without an accurate diagnosis. In contrast to mainstream "efficient markets hypothesis" we argue that Minsky's financial instability hypothesis gives numerous valuable insights into sources and possible consequences of current global financial crisis. Furthermore, two decades ago Hyman P. Minsky predicted possible developments and perils of ever growing process of securitization of illiquid assets.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Volume (Year): 57 (2010)
Issue (Month): 2 (June)
Pages: 209-224
|Contact details of provider:
| Web page: http://www.panoeconomicus.rs/
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Jan A. Kregel, 1998.
"Yes, 'It' Did Happen Again: A Minsky Crisis Happened in Asia,"
Economics Working Paper Archive
wp_234, Levy Economics Institute.
- J.A. Kregel, 1998. "Yes, "It" Did Happen Again - A Minsky Crisis Happened in Asia," Macroeconomics 9805017, EconWPA.
- Hyman P. Minsky & L. Randall Wray, 2008. "Securitization," Economics Policy Note Archive 08-2, Levy Economics Institute.
- Eric Tymoigne, 2009. "Securitization, Deregulation, Economic Stability, and Financial Crisis, Part I--The Evolution of Securitization," Economics Working Paper Archive wp_573_1, Levy Economics Institute.
- Jan Kregel, 2008. "Minsky's Cushions of Safety: Systemic Risk and the Crisis in the U.S. Subprime Mortgage Market," Economics Public Policy Brief Archive ppb_93, Levy Economics Institute.
- Davidson, Paul, 1972. "Money and the Real World," Economic Journal, Royal Economic Society, vol. 82(325), pages 101-115, March.
- Jan Kregel, 2008. "Changes in the U.S. Financial System and the Subprime Crisis," Economics Working Paper Archive wp_530, Levy Economics Institute.
- L. Randall Wray, 2008. "Lessons from the Subprime Meltdown," Challenge, M.E. Sharpe, Inc., vol. 51(2), pages 40-68, March.
- L. Randall Wray, 2007. "Lessons from the Subprime Meltdown," Economics Working Paper Archive wp_522, Levy Economics Institute.
- L. Randall Wray & Eric Tymoigne, 2008. "Macroeconomics Meets Hyman P. Minsky: The Financial Theory of Investment," Economics Working Paper Archive wp_543, Levy Economics Institute. Full references (including those not matched with items on IDEAS)


text:
★ Exciting news! Velvet Limelight is now on Patreon! I've been humming and hawing about starting a page for a while now, and I finally decided to take the plunge because I want to make sure that I'll be able to continue posting here for many years to come. But doing that… Continue reading
Category Archives: ~ Announcements
★ Party Like It's 1939 – I'm Back, Baby!
★ Ladies and Gentlemen, with the start of this new year, it gives me very great pleasure to announce that Velvet Limelight is officially back! I've missed posting so much I can't tell you, and now, after a spruce up and sort out, I'm seizing the opportunity to once again start sharing… Continue reading