text:
Using this invention, more than one variable that is shared in a multiprocessing environment can be updated atomically. Each computer processor operating in the multiprocessing environment contains more than one reservation register which, along with this novel method, are used to place reservations on each of more than one shared variable. During the execution of a program, a plurality of shared variables can be reserved, each by its respective reservation register. A reservation is placed on a shared variable by means of a special instruction. The reservation register keeps track of: the address of the shared variable that it is reserving, the value of the modified results that are to be updated in the shared variable address, whether the variable has been updated, whether the reservation is valid, and whether the processor containing the reservation register has a privilege to update the shared variable. A reservation can be invalidated if a second processor tries to read the address of the reserved shared variable. When an instruction is encountered that tries to update a shared variable, the set of reserved modified shared variables designated by that instruction that have unupdated modified results are updated atomically if and only if all the reservations in the designated set are valid. If any of the reservations in the set are invalid, no shared variable in the set is updated. A condition code reports if the update was successful or did not occur. The condition code can be tested so that the sequence of instructions can be repeated until it is successful.
1. A system of one or more computers in a multiprocessing environment, comprising:
one or more processors connected by an interconnection network to a main memory with one or more shared memory locations;
an arithmetic unit in each processor for calculating results;
a bank of one or more processor registers in each processor for storing calculated results;
a bank of more than one reservation register in each of one or more processors for reserving shared memory locations;
a control unit in each processor with control logic for controlling the arithmetic unit, processor registers, and reservation registers;
a cache memory for storing copies of the shared memory locations;
an address field, in each of the reservation registers, for storing the address of a shared memory location which will be reserved by the reservation register;
a validity field, in each of the reservation registers, for storing information indicating the validity of the reservation of the shared memory location;
a privilege field, in each of the reservation registers, for storing information indicating if the processor on which the reservation register resides has privilege to update the shared memory location of which the address is stored in the address field;
a data field, in each of the reservation registers, for storing modified results which are to update the shared memory location;
means for testing if each reservation in a designated set of reservations is valid during execution of a Write-if-Reserved instruction, the Write-if-Reserved instruction designating the designated set;
means for entering a commitment phase to atomically update the variables reserved by the designated set of reservations during the execution of the Write-if-Reserved instruction when all reservations are valid and the processors updating a set of two or more variables that have privilege to update those respective variables;
means for deferring the response to a request from a second processor for write privilege for access to an address of a reserved shared variable whose address is less than or equal to the last request for write privilege placed by a first processor when the first processor is executing a Write-if-Reserved instruction prior to entering the commitment phase;
means for deferring the response to a request from a second processor for write privilege for access to an address of a reserved shared variable when the first processor is executing a Write-if-Reserved instruction in its commitment phase; and
means for producing a deferred response to respond to a request, a first deferred response granting write privilege and all subsequent deferred responses associated with a same address of the first deferred response causing a receiving processor to rerequest.
2. A system of one or more computers in a multiprocessing environment, as in claim 1, where the reservation register has an additional update field for indicating if the modified results have been written back to the shared memory location.
This is a continuation of application Ser. No. 07/993,193, filed Dec. 18, 1992, abandoned.
This invention relates to the field of updating shared variables in a multiprocessing computer environment. More specifically, this invention relates to the ability to perform an atomic update of a plurality of shared variables by means of a plurality of reservation registers.
Modern multiprocessor computer systems provide a means for two or more processors to access and modify common memory locations. Such locations are said to be shared locations, and each location is said to contain a shared variable.
Another context in which shared variables exist within a computer system is within a single processor in which separate and distinct programs (sometimes called processes) reside concurrently in the single processor. Each process takes control for a period of time called a quantum and at the end of the quantum, is suspended while another process is granted access to the processor. Execution of the processes is such that their respective time quanta are interlaced in time and granted on a round-robin or priority basis. The processes can access and modify common locations, and thus these processes in a single processor logically operate on shared memory locations as if they were executing on separate and distinct processors.
In either case, because two or more concurrent processes can update a shared variable, the potential exists for the update to be done inconsistently. Suppose each of two processes is assigned the task of incrementing a memory location. Each process attempts to do the task by reading from the location to a machine register, incrementing the machine register, and then writing to the new value of the machine register to memory. If Process 1 performs the Read/Modify/Write without intervention from Process 2, and if Process 2 then performs the same operations, the shared variable will be correctly modified by being incremented twice.
An inconsistency arises when the Read/Modify/Write operations of the two processes are interlaced in time. That is, if Process 1 reads the value of a variable X, then Process 2 reads the same value of X, and then the subsequent increments and writes occur in arbitrary order, each process will store the value of X equal to its original value incremented once. Thus the final value of X will reflect only a single increment. One increment will be lost.
The reason for obtaining an incorrect final value is that the two processes operate on inconsistent data. If Process 1 reads the value of X with intent to modify it, then the logical residence of X has shifted from shared memory to the private register associated with Process 1. If subsequently Process 2 reads X, and X has not yet been modified by Process 1, the value read by Process 2 is inconsistent with the actual value of X, because X is currently not accessible in the shared memory, and will not be accessible again until it is rewritten.
To assure correctness, it is necessary to assure consistency. A sufficient condition for consistent behavior is to assure that when a Read/Modify/Write sequence of operations is performed on a shared variable X, the sequence is performed atomically. By atomically we mean that the sequence is performed without permitting any other process to change the value of X between the time the Read X is done and the Write X is done.
There are many ways to assure correctness and consistency of Read/Modify/Write sequences of actions. One way is to enclose such sequences in a region of a program called a critical section. A critical section is preceded by one or more instructions that perform a locking operation, and succeeded by one or more instructions that perform an unlocking operation. The lock and unlock operations assure that at most one process can execute code within the critical section at any one time. If by convention or protocol, all other processes update the same shared variables by means of critical sections controlled by the same lock and unlock mechanism, then the Read/Modify/Write operations within the critical section can update shared variables atomically, because no other process can perform an intervening access to the shared variables while one process is in the act of performing a Read/Modify/Write process in the critical section.
To create a critical section, it is necessary to have a lock function. Within prior art, a common means for implementing such a function is by means of an instruction that itself performs an atomic Read/Modify/Write on a lock variable. Among the instructions used for this purpose are the Test-and-Set instruction and the Increment (or Decrement) instruction.
The Test-and-Set instruction reads a variable X, sets a bit of X to the value 1 regardless of the original state of the bit, rewrites X, and returns a condition code whose value is equal to the original bit before it was forced to be the value 1. Because this instruction performs a Read/Modify/Write of a shared variable, it must be implemented to perform such an update atomically in order to assure consistency of execution. This one instruction can be used to set a lock that guards a critical section in which a Read/Modify/Write sequence of arbitrary complexity can be executed consistently, since the lock prevents intervening accesses to the shared variables by other processes.
To use the Test-and-Set instruction to create a lock, each process protects the critical section with a Test-and-Set instruction that accesses a lock variable. Immediately after the execution of the Test-and-Set instruction, the lock variable will hold the value 1, regardless of its former value. Each process tests the condition code after executing Test-and-Set, and only the process that observes a code of 0 (corresponding to an initial value of 0) can enter the critical section and execute the Read/Modify/Write sequence within the critical section. All other processes attempting to execute the Read/Modify/Write code in their respective critical sections must wait or do something else until the lock for the critical section is in the unlocked (0) state. When a process completes the Read/Modify/Write sequence and leaves the critical section, it clears the lock by storing a 0 in the lock, thereby permitting another process to enter the critical section by executing a Test-and-Set on the lock with an initial value of the variable equal to 0.
Test-and-Set is found on the IBM 370. Increment and decrement can be implemented as atomic Read/Modify/Write operations, and can be used to do essentially what the Test-and-Set does, almost as a direct replacement for Test-and-Set. They are more versatile because they can increment and decrement shared variables atomically, while Test-and-Set can only set a bit. The DEC VAX has atomic increment and decrement instructions.
There are several problems with using Read/Modify/Write operations to create a critical section. Among these are:
1. A critical section allows at most one process to enter at a time. If a process enters the critical section and fails, the entire system fails because no other process can enter the critical section.
2. A lengthy and complex critical section is a performance bottleneck in a multiprocessor system. Since only one process at a time can enter a critical section, if other processes must enter the same critical section, they must wait until it is available, and they may be forced to be idle during this time. A desirable solution to this problem is to update the shared variables by means of sequences of instructions that perform Read/Modify/Write outside any critical section. This modification has to be carefully controlled so that consistency is maintained.
3. Since a critical section contains many instructions, a time quantum for a process can end within a critical section, and that process can be suspended for a lengthy period of time while other processes take control of the processor. During the period of suspension of the process that holds the lock for the critical section, no other process can enter the critical section and update the shared variables controlled by that critical section.
To overcome these disadvantages, it is possible to implement complex operations on shared variables as a single instruction performed atomically. As an example, the DEC VAX has atomic ENQUEUE and DEQUEUE instructions each of which changes up to four shared variables concurrently and atomically, and thus makes changes consistently.
If this approach is followed, the machine designer has to supply an atomic instruction for each distinct operation on shared variables for each data representation. For example, the DEC VAX has different ENQUEUE and DEQUEUE instructions for queues with different representations. Queues with one pointer per element must be manipulated by one of the ENQUEUE/DEQUEUE pairs of instructions, and queues with two pointers per element must be manipulated by a different pair of ENQUEUE/DEQUEUE instructions.
The problem with this approach is that the machine designer must anticipate every conceivable atomic operation and every conceivable data representation, because each such operation is extremely specialized. This approach fails because the programmer cannot easily create and use a custom-made atomic operation for each particular context and data representation.
Therefore, an important problem to address is the ability to produce customized atomic operations for complex updates to shared variables, and to perform these atomic operations so that the actual update takes place during the execution of a single instruction. In this way, the reliability and performance of the multiprocessor system are not at risk due to failures or interruptions of a process that holds a lock for a critical section.
A partial solution to this problem is available through the use of the Compare-and-Swap instruction as implemented on the IBM 370. The Compare-and-Swap instruction provides the last step of a Read/Modify/Write sequence of instructions that is not protected by a critical section, and performs the Write operation only under certain conditions that are suppose to assure consistency and atomicity. To use the Compare-and-Swap, a process first performs by means of conventional nonatomic instructions all of the actions of a Read/Modify/Write sequence for updating a shared variable except for the final Write of the updated value of the shared variable. To perform the final Write action, the process uses the Compare-and-Swap instruction. The Compare-and-Swap rereads the variable from storage and compares the current value in storage to a copy of the prior value that is held in a machine register. If the two values are identical, the Compare-and-Swap updates the variable in storage with the newly computed value. If the copy of the prior value held in a machine register and the current value held in shared memory differ, the Compare-and-Swap does not update storage, and replaces the copy of the prior value held in the machine register with a copy of the current value of the variable in shared memory. The instruction reports what happened in a condition code. Since the Compare-and-Swap itself performs a Read/Modify/Write sequence of actions, those actions must be done atomically to assure program correctness.
The idea of the Compare-and-Swap is that a shared value can be updated if no other process has altered the value since it was last read. This is supposed to assure consistent behavior. Unfortunately, there is a possibility of an inconsistent update. While a first process is in the midst of performing a Read/Modify/Write sequence terminated by a Compare-and-Swap, it is possible for a second process, executing concurrently, to read the value of the variable (say value A), to change the value to a new value (say value B), and for yet another process to return the shared variable to the prior value (value A) while the first process is computing a new value based on value A. When the first process reaches the Compare-and-Swap instruction, the Compare-and-Swap will succeed because the current value and the prior value are both equal to A.
However, for many applications, correctness requires not only that prior and current values of the shared variable be equal, but that the variable in storage maintained the value A continuously between the time it was first read during the execution of the Read/Modify/Write sequence and the time the Compare-and-Swap was executed. The failure of the Compare-and-Swap to detect such a change of values is called the ABA problem.
Most algorithms for concurrent access and modification of shared variables may fail if the ABA problem can occur. There are various software schemes used in conjunction with Compare-and-Swap to eliminate or reduce the probability of a failure due to the ABA problem.
Another approach to the problem is very similar to the use of Compare-and-Swap, except that it detects whether or not a variable has maintained a value continuously at the time an update is attempted. In essence, the scheme works as if the Compare-and-Swap tests a variable for whether it has changed or not instead of testing for equality of current and prior values. The scheme uses a notion called a reservation.
The scheme uses two instructions, Load-with-Reservation and Write-if-Reserved, although the instructions have different names on the various processors that use it. It is in current use on the MIPS R-4000 processor Kane, 1989!, and on the DEC ALPHA processor Digital Equipment Corporation, 1992!. The Load-with-Reservation reads a shared variable from storage and at the same time places the address of that variable in a special register known as a reservation register. The reservation register monitors changes to the variable made by other processes, and those other processes can be those executing on the same processor or on other processors. If any other process changes the value of the variable, the reservation disappears. Otherwise it remains present until the process that placed the reservation reaches the Write-if-Reserved instruction. The Write-if-Reserved instruction performs the update only if the reservation is still present. If not, the Write-if-Reserved performs no update. In either case, the instruction returns a condition code indicating what happened. For many applications, the process then tests the condition code and repeats the Load-with-Reservation, modify, Write-if-Reserved sequence until the update succeeds.
The notion of reservation solves most of the problems posed above for the case of the updating of a single variable. However, most processes that operate on shared data structures must operate on two or more shared variables atomically. That is, when an update to the data structure occurs, the changes to two or more variables associated with that change must be done so that the change is made as if all changes occurred simultaneously. No other process can make an intervening access to these shared data while the update is being performed. A single reservation is not sufficient to implement such operations. Typical data structures that require complex updates involving two or more variables are queues, priority lists, and data bases.
The solution that we seek must contain all of the following components:
1. A single instruction that updates all variables to be updated.
2. A means for executing that single instruction so that the updates are performed with no intervening access permitted by a different process. (Required for atomicity of the update.)
3. A means for reserving two or more shared variables.
4. A means for detecting changes to reserved variables made by other processes.
5. A means for performing the atomic update of the shared variables that depends on the current presence of the reservations placed by the process.
The prior art contains no solution that addresses all of these factors. Critical sections suffer from reliability and performance problems because they require multiple instructions to perform an update. The various single-instruction Read/Modify/Write instructions are able to perform very specific updates in a single cycle, and are unable to perform more complex updates. The Compare-and-Swap instruction provides capabilities for updating one or two shared variables, but fails to detect the presence of the ABA problem because it does not assure that a value has been held continuously. The use of a single reservation is suitable only for the update of a single variable, and fails to provide the facilities needed to update complex shared data structures.
Accordingly, there has been a long-felt need in this area for a method and apparatus that can update a complex shared data structure atomically. Such a mechanism requires all of the components listed above. This would allow programs to create customized Read/Modify/Write processes that have all of the advantages of complex atomic operations such as Enqueue/Dequeue that exist for specific data structures.
Coffman, E. G., Jr.; M. J. Elphick, and A. Shoshani, "System deadlocks," Computing Surveys, Vol. 3, No. 1, pp. 67-78, 1971.
Digital Equipment Corporation, Alpha system reference manual 1992.
Kane, G., MIPS RISC Architecture, Prentice Hall, 1992.
Stone, H. S., High Performance Computer Architecture, Second Edition, Reading MA: Addison-Wesley, 1990.
Sweazy, P. and A. J. Smith, "A class of compatible cache-consistency protocols and their support by the IEEE Futurebus," Proceedings of the 13th Annual International Symposium on Computer Architecture, Tokyo Japan, pp. 414-423, June, 1986.
An object of this invention is an improved method of using reservations to atomically update variables shared by multiple programs or processors.
Another object of this invention is an improved method and apparatus of using multiple reservations to atomically update a group of variables shared by multiple programs or processors.
Another object of this invention is a method and apparatus that permits an efficient modification of a single-process algorithm so that it can run in a multiprocessor and/or multiprogram environment on a single processor.
Another object of this invention is to make as much use as possible of protocols and hardware that would otherwise be present within a multiprocessor so that the facilities provided by this invention can be added to existing art with minimum cost and design effort.
This invention is an efficient, accurate method for using two or more reservations to update a group of shared variables atomically. The invention can use a plurality of reservation registers to atomically update a plurality of shared variables. The group of shared variables are all updated together or none are updated at all.
The invention requires an arbitrary number, N, of reservation registers, typically labeled 0 through N-1, and a novel method that includes placing reservations on a plurality of shared-memory locations. Before any of the shared-memory locations are updated with current information, their reservation status is checked. If the reservations of all locations specified by an instruction are valid as determined by certain reservation status information, all the shared-memory locations values that have been modified are updated atomically. If the validity status memory for one or more of the reserved shared variables is in the invalid state, no update is done on any shared memory location. The result of an attempted update is reported in a condition code whose value signifies whether the update was done or not. A process can test the condition code, and attempt to perform the atomic update of the shared variables again if the attempt failed.
The method makes use of three instructions: Load-with-Reservation (LR), Store Contingent (SC), and Write-if-Reserved (WR). When a process executes an atomic modification of one or more shared-memory locations, it performs a sequence of steps that read the shared-memory locations, modify their contents, and then write back the new values atomically. The process begins this atomic update by reading each of the shared-memory locations with a Load-with-Reservation instruction. The effect of this instruction is to copy the shared-memory locations to registers in the processor that is executing the update process, and to place reservations for those variables within the same processor. In the preferred embodiment, this reservation is represented by an address stored within a reservation register designated by the Load-with-Reservation instruction. The Load-with-Reservation instruction also initializes certain status fields within the same reservation register.
At this point, any general-purpose operations may be performed on the copies of the shared variables retrieved from the shared memory. For example, individual variables may be incremented, decremented, and shifted, and shared variables may be combined by addition or multiplication, or new values may be obtained by using shared variables as indirect pointers to other shared variables. The operations modify one or more of the local copies of the shared variables. The Store Contingent instruction is then used to store the modified result in a temporary memory. In the preferred embodiment, this temporary memory location is also a field of the reservation register associated with the shared variable memory location. The Store Contingent instruction also updates certain reservation status fields to indicate that there are modified results to be written back to the shared-variable memory location. As the processes continue to execute instructions, whether on a multiprogrammed uniprocessor or on a multiprocessor, a plurality of shared variables may be accessed and modified in this way.
At some point, one or more of these modified results must be written back to its respective shared variable memory location. These updates are performed by the Write-if-Reserved instruction. The Write-if-Reserved instruction checks to confirm that the reservations held in specified registers remain valid, and if so, it updates those shared variables whose reservation status registers show that the local copy of that variable has been modified. The modifications of the shared variables are done atomically so that all modifications are made or none are made, and if all are made, no other process can intervene with a write to any of the shared-memory locations. All reservations specified by the Write-if-Reserved instruction are left in the invalid state at the close of execution of the Write-if-Reserved instruction, and the Write-if-Reserved instruction reports through a condition code whether or not the atomic update was completed successfully.
FIG. 1 is a block diagram of a computer apparatus of the present invention having more than one reservation register.
FIG. 2 shows a reservation register apparatus of the preferred embodiment.
FIG. 3 is a flowchart showing the general method of this invention for successfully atomically updating more than one shared memory location with modified data.
FIG. 4 is a flowchart showing the general method of this invention for executing an unsuccessful attempt to atomically update more than one shared memory location with modified data.
FIG. 5 is a flowchart showing the steps of performing a Load-with-Reservation instruction in the preferred embodiment.
FIG. 6 is a flowchart showing the steps of performing a Store Contingent instruction.
FIG. 7 is a flowchart showing the steps of performing the Write-if-Reserved instruction.
FIG. 8 is a block diagram showing logic apparatus to test the reservation status of more than one shared memory location.
FIG. 9 is a block diagram showing an apparatus that finds the least selected address from within a group of reservation registers that do not have a write privilege.
FIG. 10 is a flow chart showing how certain reservation register-fields are updated by the Write-if-Reserved instruction.
FIG. 11 is a flow chart showing how certain other reservation register fields are updated by the Write-if-Reserved instruction.
FIG. 12 is a flow chart that shows the actions of a network message receiver for implementing the reservation protocol.
FIG. 13 is a flow chart that shows how privilege requests are processed by a network message receiver.
FIG. 14 is a flow chart that shows how a processor incorporates reservations into the cache protocol for cache invalidation.
FIG. 15 is a flow chart that shows how the network message receiver grants write privilege to a requestor.
FIG. 16 is a block diagram that shows how deferred messages are processed after the completion of a Write-if-Reserved instruction.
FIG. 17 is a flow chart that shows how to convert a single process algorithm into an algorithm that will run in a multiprocessing environment on a single processor or on a multiprocessor.
The overall system that would make use of the invention is shown in FIG. 1. The figure shows a multiprocessor system consisting of a plurality of processors (blocks 21) connected together through an interconnection network (block 20) through which control and data can be interchanged. The interconnection network can be as simple as a bus or as complex as a crossbar or multistage interconnection network as described, for example, in Chapter 6 of Stone 1990!. Also connected to the interconnection network is a commonly known global shared memory, block 25. In a parallel processing environment, main memory 25 has one or more shared memory locations 28 that contain shared variables used by one or more of the parallel processes and/or processors 21. Copies of shared memory locations 28 can exist on the processors 21, e.g., in cache 24.
Each processor is composed of the blocks shown within block 21 of FIG. 1. They contain registers (block 22), an arithmetic unit (block 27), a control unit (block 23), a cache (block 24), and a plurality of reservation registers (blocks 26). Typically, the processor registers, block 22, has a plurality of registers. In the prior art, a system contains all components shown in FIG. 1, except that no prior art machine known to the inventors has more than one reservation register. An example of a machine with one reservation register is the MIPS R-4000 Kane, 1989!.
Block 26 represents a bank of more than one reservation register. A preferred reservation register 30 used by the present invention is shown in FIG. 2. Each preferred reservation register 30, ResReg j!, of the N number of a plurality of registration registers 26, comprises at least 5 fields including: ResReg j!.Add 32, ResReg j!.S 34, ResReg j!.U 36, ResReg j!.P 38, and ResReg j!.Data 39. (The index, j, in each field keeps track of which reservation register contains the field). The ResReg j!.Add 32 field stores the address of a shared memory location that is reserved by a Load-with-Reservation instruction. The field length of this field is determined by the size of the largest address of a shared memory location that could require a reservation. This temporary address storage location, ResReg j!.Add 32, is located in the reservation register 30 in the preferred embodiment. However, in alternative embodiments this information could be temporarily stored in a cache memory or in other buffers within the local processor. The ResReg j!.S 34 field is typically a 1-bit status flag that indicates whether or not the reservation register 30 holds a reservation. In other words, the flag indicates whether the reservation for a variable in the shared memory location 28 whose address appears in reservation register 30 remains valid or alternatively whether the reservation has been invalidated by the action of a remote processor or process. The shared memory location 28 is associated with the register when the location 28 address is stored in the reservation register 30 ResReg j!.Add 32 field.
In similar fashion, the ResReg j!.U field is typically a 1-bit status flag that indicates whether there are modified results that are to update the shared memory location 28 that is associated with the reservation register 30. The ResReg j!.P field is a status field that indicates whether or not the location has write privilege. A processor must have write privilege for a variable before it can update that variable. A processor must have write privilege for all shared variables designated by a Write-if-Reserved instruction before the atomic update of shared variables designated by that Write-if-Reserved instruction can begin. This is described in more detail later in the FIG. 8 description.
The ResReg j!.Data 39 field is used in the preferred embodiment to store modified results that are to be written back to the shared memory location. In the preferred embodiment the modified results are held temporarily in the reservation registers, but in other embodiments those results can be held in any other convenient temporary storage locations such as cache memory and high-speed buffers.
The present invention is a novel computer apparatus having more than one reservation register and a method that makes effective use of this plurality of reservation registers to update shared variables in a multiprocessing environment. The updates are made atomically in the sense that all modifications of an atomic set are performed or none are performed. Moreover, when a collection of modifications is performed atomically, no other processor can perform intervening writes to the reserved locations in the set. In other words, the updates are made so that all changes to shared variables become visible to all other processors as if the changes happened simultaneously. The preferred embodiment of this invention shows how to implement such updates with reservation registers so that all changes occur or none occur whenever an attempt to update reserved shared variables by means of a Write-if-Reserved instruction occurs.
FIG. 3 shows the overall method of the present invention. The preferred method uses three instructions that are described as follows:
1. Load-with-Reservation (LR): This instruction places a reservation in a specified reservation register associated with a given memory address.
2. Store Contingent (SC): This instruction places a modified result value in a field of a reservation register associated with a shared memory location in preparation for an atomic update.
3. Write-if-Reserved (WR): This instruction performs the atomic update of share memory locations whose addresses are held in reservation registers with valid contents, that have been updated by a Store Contingent instruction after placing the reservation. The atomic update occurs provided that all reservations are valid and write privilege has been obtained successfully for all reservations. If these conditions are not satisfied, the reservations are removed, and no variables are changed.
The method 300 starts when a process accesses the first shared-memory location with a Load-with-Reservation instruction as shown in block 302. The precise details of how a reservation is placed are described more fully later.
Block 304 shows additional Load-with-Reservation instructions reservations being placed on as many shared-memory variables as the atomic update depends, up to the number of reservation registers in the local processor.
Block 306 shows the execution of the computations that produce updated values of shared variables in machine registers. These variables are saved in the reservation registers in block 308 by means of the Store Contingent instruction. The updated variables are possibly all of the reserved variables, or possibly a subset of the reserved variables. Every updated variable must be reserved. In addition, other shared variables must be reserved even if they are not updated if the consistency of the atomic update requires that the update use the most current values of such variables. A Load-with-Reservation is required for each shared variable on which an update depends and for the variables that are updated during the atomic operation. For example, these shared variables might include the inputs and outputs of a procedure.
In block 310, the atomic update is performed by means of the execution of a single Write-if-Reserved instruction. The update is performed in this instance because no remote processor has written to a reserved shared variable, and thereby all reservations are valid when block 310 is reached.
In block 312, the process tests the condition code returned by the Write-if-Reserved instruction and learns that the update has been done. In this case the flow chart takes the success exit.
FIG. 4 is very similar to FIG. 3 except in this case a remote processor or process modifies (writes to) a reserved shared variable, and invalidates a reservation. Process 400 of FIG. 4 begins at block 402 in which all reservations are placed. Block 404 shows the computation of the updated values of the variables. Block 406 shows the modification (writing) of a shared variable by a remote processor or process, and the invalidation of the reservation for that variable in the local processor. Block 408 shows the processor storing all updated values in reservation registers by means of Store Contingent instructions, and block 410 shows the attempt to execute a Write-if-Reserved instruction. Nothing is updated because of the invalid reservation that occurred in block 406. Block 412 shows the process testing the condition code of the Write-if-Reserved and taking the failure exit to repeat this atomic update at block 402. In an alternative embodiment, a remote processor or process will invalidate a reservation of a shared variable by performing any access to shared variable, whether the access modifies the shared variable, as is the case here, or not.
FIG. 5 shows the preferred embodiment of the Load-with-Reservation instruction. In the preferred embodiment, the Load-with-Reservation specifies a reservation register 26, denoted ResReg j! 26, a memory location X, and processor register Reg i! 22.
To place a reservation for X in ResReg j!, the figure shows the process beginning with a cache access (block 40) that tests to see whether there is a copy of X in the cache. In this embodiment, the process first checks to see if a copy of the shared variable is in the local cache memory. If the item is not in cache, as indicated by the "No" exit to the "Hit?" conditional test in block 45, the processor places a request for the value of X at the interconnection interface, block 20 of FIG. 1. The processor waits for the value of X in block 43 of FIG. 5, and when it arrives, the processor places a reservation for the address of X in ResReg j!.Add as shown in block 44. The act of placing a reservation for X requires that the address be stored in ResReg j!.Add, that the S bit (State bit) be set to 1 to indicate that the register holds a reservation, that the U bit (Update bit) be set to 0 to indicate that the value has not been updated, and that the P bit (Privilege bit) be set to the current write privilege that the processor holds for X. If the processor holds write privilege, the P bit is set to 1. If not, the P bit is set to 0. The write privilege is normally stored in the cache entry for X, and is available to the local processor after the cache access in block 40. If X is not present in the cache, the processor normally does not receive write privilege when it receives X after waiting at block 43, although it is possible to give write privilege at this point if the system is able to determine that X is not held in any other cache.
To maintain cache coherence, the system must be constructed so that for any location X at most one processor has write privilege for X at any given time. It is a practice in prior art to build systems that maintain cache coherence by means of write privilege as described by Sweazy and Smith 1986!.
Block 44 of FIG. 5 shows the novel addition of a U bit (for update) and a P bit (for write privilege) that are used in the preferred embodiment of the invention. These reservation parameters enable the atomic updating of more than one shared variable in a multiprocessing environment because they indicate which reservations do not have write privilege and must obtain it before an atomic update can initiate, and they indicate which reserved variables have actually been modified and therefore need to be rewritten to shared memory during an atomic update.
FIG. 6 describes the action of a Store Contingent. This instruction places the newly modified value of a shared variable in ResReg j!.Data in preparation for the atomic update of all modified variables. The instruction marks the reservation as updated by setting the U bit 36 to 1. The actions take place in Block 59. The modified results will eventually be placed into the shared memory location whose address is saved in the same reservation register in the Add field 32. The action of copying the modified results From the reservation register to shared memory takes place during a successful atomic update. Otherwise, the modified data will be discarded when the Write-if-Reserved instruction fails during the attempt to make an atomic update.
The overall structure of Write-if-Reserved is shown in FIG. 7. Later discussion amplifies the explanation of particular blocks in the figure. A Write-if-Reserved instruction designates a set of reservation registers described below in the FIG. 8 description. If all of these reservations are valid at the point of execution of the Write-if-Reserved instruction, and if one or more have newly modified values to be saved in the reserved shared variables, the Write-if-Reserved instruction attempts to write the values of all the variables atomically, or will write none of them if an atomic update cannot occur.
In order to perform an atomic update, the write of all updated variables has to be based on the current values of all selected reserved variables. To assure that the selected reservations contain current values, it is necessary to obtain write privilege for the selected reserved variables. If any of these variables has changed value since the reservation has been placed, or if the value of any reservation changes before a write privilege has been obtained for all reservations, the Write-if-Reserved instruction takes a failure exit, and no variables are changed.
If the instruction succeeds in obtaining write privilege for all selected reserved variables, and if all selected reservations remain .valid at this point, the Write-if-Reserved instruction enters a Commit phase during which all updated variables are updated as if they were updated simultaneously. That is, if any processor sees the updated value of one of the shared variables after this point, it must not also see the unupdated value of all of the others. The scheme for controlling the atomic update and the holding of reservations makes use of cache-coherence protocol messages that must be present in a system that has no reservation registers. Such systems are described by Sweazy and Smith 1986!. Thus, multiple reservations can be implemented within a cache-coherent multiprocessor system by introducing a relatively small additional complexity to what must already be within the system.
In block 60 of FIG. 7, the Write-if-Reserved Flag is set to 1 as an indication that this instruction has begun. Some cache coherence messages received by the processor during this period will be deferred until the Flag returns to the 0 state. The testing of the flag is discussed later. In the preferred embodiment, the Write-if-Reserved Flag is located in the control unit 23 shown in FIG. 1.
The TEST RESERVATIONS logic in block 61 verifies that the S bit of all selected reservations is 1, signifying that all reservations remain valid. If a remote processor writes a new value to a reserved variable, that action will be communicated to this processor through a cache coherence message, and the action will invalidate the reservation by changing the S bit to 0. This is described in detail later. If all reservations are valid, as tested in block 62, the instruction attempts to obtain privilege for another reserved shared variable before retesting validity again. Privilege is obtained through the execution of block 63 to find a candidate reservation. This is explained in the FIG. 9 description below. Then block 64 tests to see if any candidates remain. If so, privilege is requested in block 68, and the instruction waits for a response in block 69. When the response arrives, the P bit of the selected register is updated in block 70, and the loop repeats beginning within a retest of the selected reservations at block 61. While the loop is traversed, a message from a remote processor can arrive and invalidate a selected reservation. Therefore, the selected reservations are tested repeatedly at block 61.
When all privileges have been obtained, the instruction enters the Commit phase starting at block 65 by setting a flag to indicate that Commit processing is ongoing, and at block 66 to perform the Commit processing.
Block 67 contains the housekeeping required for a successful Commit, and block 68 contains analogous housekeeping operations required for an unsuccessful execution of the instruction. Details appear later in the discussion.
FIG. 8 shows the hardware logic required to test reservations. (See block 61 in FIG. 7.) Bits in the instruction register, block 75, specify which reservations take part in the Write-if-Reserved instruction. In this example, the 1s in bit positions 0 and 3 signify that ResReg 0! and ResReg 3! participate.
The reservation registers, blocks 30, are shown in FIG. 8 with their S bits indicated. The two registers specified by the instruction, ResReg 0! and ResReg 3! in this example, have their S bits set to 1, thereby indicating that their reservations remain valid. Block 77 forms the logical OR of the complement of the selection bit with the true value of the S bit. Its output is a logical 1 if the register is not selected or if the S bit is 1. If all OR gates have 1s on their outputs, the AND gate (block 78) produces a 1 output, and otherwise produces a 0. This output is tested in block 62 of FIG. 7.
The logic for selecting a candidate for a write-privilege request (block 63 in FIG. 7) is shown in FIG. 9. What is novel here is that the requests are ordered by ascending address. The intention is to defer conflicting incoming requests for write privilege, when possible. However, unless special steps are taken, the action of deferring incoming requests while awaiting completion of requests issued externally can lead to a deadlock situation in which two or more processors wait among themselves indefinitely, and no progress is possible thereafter. It is known in prior art that when requests by all processors are placed in a fixed order, then no deadlock will occur. cf. Coffman, et al. 1971.! The invention follows this discipline by selecting the least selected address without write privilege as shown in FIG. 9.
The Write-if-Reserved instruction, which is resident in the instruction register, block 75, designates one or more reservation registers. The reservation register, block 30 in FIG. 9, contains an address of a reservation and a P bit to indicate if it has write privilege. The AND gate, block 80, produces a 1 bit if a corresponding reservation register is selected and does not have write privilege. The Sorter, block 81 in FIG. 9, produces a candidate address at its address output, and a binary signal at its None Valid output. If there are no candidates, None Valid will have a logic 1, otherwise will have a logic 0. The None Valid bit is tested in block 64 of FIG. 7.
The success and failure exits of Write-if-Reserved, blocks 67 and 71 of FIG. 7, are described in more detail in FIG. 10. A condition code is set to indicate the outcome, and it is 0 on a failure (block 85) and 1 on a success (block 82). In either case, the act of exiting resets the Write-if-Reserved Flag in block 83 to signify normal handling of requests can be done. Block 84 performs the processing of incoming requests that were deferred during the execution of Write-if-Reserved. This is described in more detail later.
The heart of Write-if-Reserved is the Commit phase, block 66 of FIG. 7. It is described in detail in FIG. 11. At block 90, Commit selects an updated reservation from among the set of selected updated reservations. At block 91, Commit tests to determine if there are any candidates left. If so, it updates the candidate in its local cache in block 92, and sets the S bit to 0 to signify that the reservation has been removed. Commit returns to block 90 to select candidates again, and will not select the candidate just processed because the S bit has been reset. When no additional updates have to be performed, all other S bits are reset in block 94, and the Commit flag is reset in block 95 to signify that the Commit phase is over. Special handling of incoming requests is invoked during the Commit phase, and the resetting of the commit flag permits normal handling of incoming requests to resume.
FIG. 12 shows the logic functions of the receiver, in the control unit 23 of a processor 21, of incoming messages. At least three kinds of messages can be received. One is the response to a request for write privilege. A second is a request for write privilege. The third is a request to invalidate a cache entry because a processor with write privilege has changed the cache entry. Other messages may also be received but are not relevant to the reservation mechanism.
In blocks 100, 102 and 104, the receiver tests to see if the incoming message is one of the three types mentioned here. If so, the receiver performs the respective process cited in block 101, 103, and 105, respectively. When a response 100 to an outstanding write privilege request is received, the receiver notifies the Write-if-Reserved instruction to resume 101 processing at block 70 of FIG. 7. When a request 102 for write privilege is received, if the local processor has such privilege, the write privilege will be granted under some conditions, or deferred under other conditions and granted later. This is performed in block 103 of FIG. 12. How this is done is discussed later.
If an invalidate request 104 is received, the invalidate is performed immediately, as described later. Its action is represented by block 105.
FIG. 13 shows the logic for deferring requests in a manner that will not cause deadlock. The objective is to request write privilege in the order of ascending address. The processor can defer requests for write privilege to any address less than the highest address for which it has a write-privilege request outstanding.
The processor may hold write privilege for higher addresses than the address of its current write-privilege request. If so, in order to avoid deadlock, the processor must give up write up privilege for such addresses if requests for them arrive.
In block 110 of FIG. 13, the message receiver detects that an incoming privilege request is intended for an address held in a reservation register whose S bit is 1, thereby indicating that the reservation is valid. If the Write-if-Reserved instruction is in the Commit phase, the request can be deferred until the end of the phase. This is tested in block 111, and the request is deferred in block 112. If not in Commit phase, block 113 tests to see if a Write-if-Reserved instruction is in execution by testing the Write-if-Reserved Flag at block 113. If so, and if the incoming request is for an address less than or equal to the address of the last outgoing request for privilege, the incoming request can be deferred. This is tested in block 114. In all other cases, the privilege request must be granted. This is done by doing an invalidate process in block 115 and granting the requested privilege in block 116. These processes are explained in more detail below.
The invalidate process (block 115 of FIG. 13) appears in FIG. 14. Block 120 shows that it sets the S bit of the matching reservation register to 0, and this will prevent the success of a current or subsequent Write-if-Reserved instruction. The invalidate signifies that a variable has changed value or will change value in the immediate future, and the reserved value of the shared variable can no longer be deemed to be the current value. In block 121, the processor reads the variable from cache. If the variable is in cache as tested by block 122, the cache entry is invalidated in block 123.
FIG. 15 shows a known process of granting privilege. Block 125 shows the processor testing for privilege, and this is performed on the contents of the entry read from cache. Block 126 shows privilege being transferred to the requester together with the data read from cache. This is known to be the current value of the data because the cache has write privilege associated with it.
FIG. 16 shows how Write-if-Reserved processes defer requests in block 84 of FIG. 10. Block 130 of FIG. 16 selects the requests in first-in, first-out order by selecting the earliest deferred request. Block 131 tests to see if any are left, and exits if not. Block 132 removes the request from the deferred-request queue, and block 133 accesses cache for the address requested. Block 134 tests to see if the address is in cache, because the cache entry may contain write privilege (ownership). If the item is not in cache, processing returns to block 130 to obtain a new request.
Assume momentarily that the item is in cache. The cache entry is invalidated at block 135, since write privilege will be transferred and the new owner will change the variable's value. Block 136 tests to see if the entry read from cache has write privilege. If not, processing returns to block 130 to obtain another deferred request.
If the current processor had ownership, it grants privilege at block 137. There may be other deferred requests for the same entry, and the new owner may have already received and rejected those requests. Therefore at block 138, the processor tests to see if another deferred request exists for the same item. For each such request, the processor removes the request from the deferred-request queue at block 139 and sends a negative acknowledgment (NAK) back to the requester at block 140 to tell the requester to repeat the request since ownership has just transferred.
It is not necessary to order the requests for write privilege as indicated in FIG. 9, block 81. If requests are not ordered, then incoming requests for write privilege cannot be deferred during non-Commit phase processing of Write-if-Reserved at block 113 of FIG. 13. However, they can and should be deferred during the Commit phase as indicated in block 111 of FIG. 13.
The atomicity of the update process is guaranteed by this invention through the means the Commit logic in FIG. 11 interacting with the handling of messages described in FIGS. 12 through 15. Once the Commit phase is started, reservations cannot be lost by invalidate operations or by granting write privilege to remote requests. Invalidates of reserved variables cannot occur during the Commit phase because write privilege has been obtained for all such variables, and therefore no other processor can change them. If a request for write privilege for a selected reserved variable is received during the Commit phase, the request is deferred and honored later. Interrupts and traps must be deferred during the Commit phase so that it can run to completion once it has started. Reservations must be invalidated when an interrupt in a processor changes context to another process that uses the same reservation registers.
Using the present invention, an algorithm designed to operate in a uniprocessor can be effectively modified to work in a multiprocessor environment. See FIG. 17. To do this, first identify the WRITE and READ instructions 170 in the uniprocessor program that access variables that could be subject to modification by more than one process in a multiple processor environment or on which updates of these variables depends. These READ instructions are then changed 172 to Load-with-Reservation instructions and these WRITE instructions are changed 172 to Store Contingent instructions. Immediately following the last Store Contingent instruction, insert a Write-if-Reserved instruction 174 that designates the reservation registers used by the Load-with-Reservation instructions. Immediately after the Write-if-Reserved instruction, insert a conditional branch 176 back to the first Write-if-Reserved instruction, and construct the branch logic so that the branch is taken if the Write-if-Reserved instruction fails to update the shared variables. A multiprocessor environment as described in this disclosure is then created. Doing this creates customized atomic operations for a uniprocessor program that will run as a multiprocessor version of the algorithm in a multiprocessing environment. The multiprocessor algorithm will modify the collection of shared variables identified and guarantee that none of the variables in the collection have been modified by another process before any of them are updated.
This is a general solution for all classes of uniprocessor algorithms.
It will be evident to one skilled in the art having knowledge of this novel disclosure that there are many ways to carry out the teaching of this invention. These alternative embodiments are also contemplated by the inventors. For example, in the preferred embodiment, message handling hardware, like that performing the tasks shown in FIG. 12, and other control functions, like the commit flag, are located in the control unit 23 of each parallel processor 21. Alternatively, this hardware could be located in a hardware interface in a processor 21 that connects the processor 21 to the interconnection network 20. Other locations for these functions are also possible. Further, although the ResReg j!.U bit 34 is used in the preferred embodiment, this bit 34 could be omitted. In this case, all reservation registers 30 would be updated each time a Write-if-Reserve instruction is executed. In addition, the shared memory locations 28, or copies of the values in these locations, can exist in locations other than the main memory 25. These alternative locations can include queues and buffers that may reside on one or more of the processors 21. Further, although in FIG. 4, block 406, a reservation is invalidated if a remote processor modifies the reserved location, an alternative method could require that a reservation be cancelled if a remote processor performs a Load-with-Reservation from the location or if a remote processor modifies the location.
Patent Citations
Non-Patent Citations
Referenced by
Legal Events
Original Image


text:
Shop now and get Free Value Shipping on most orders over $49 to the contiguous 48 states, DC and to all U.S. Military APO/FPO/DPO addresses.
We want to ensure that making a return is as easy and hassle-free as possible! If for any reason you decide that your purchase just isn't for you, simply return the item within 30 days of receipt and we'll cover the cost of return shipping. Learn more about our Return Policy.
Unfortunately Just Cavalli JC0293 Prescription Eyeglasses is no longer carried by OpticsPlanet.
You can also explore other items in the Eyeglasses w/ Single Vision Lenses category yourself to try and find the perfect replacement for you!
The Just Cavalli JC0293 Prescription Eyeglasses has been developed to be the ideal way to look excellent while keeping your sight complete. This pair of Eyeglasses w/ Single Vision Lenses via the optics authorities at Just Cavalli, is created making use of some of the best materials available, to supply you with a reliable pair of Rx glasses that will not disappoint you. Just Cavalli has been in the eyewear industry for a very lengthy time, and their top grade Rx eye glasses are the result of their tireless efforts to make certain you are completely contented with your comfort. At OpticsPlanet, our experienced product experts are here to aid you in finding the finest pair of Single Vision Rx Eyeglasses to match your vision needs. For an amazing way to give the Jones' a run for their money, pick the Just Cavalli JC0293 Prescription Eyeglasses.
Connect with OpticsPlanet
Become our fan, follow us, & subscribe for the latest updates and deals
Subscribe to our email list
Sign up and receive $5 Off and get exclusive access to promotions, sales
events, pre-order sales & more!
Contact Information
Toll-Free: 800-504-5897
Intl.: 847-513-6201
Fax: 847-919-3003
Email: firstname.lastname@example.com
Hours of Operation
8AM-7PM CST Mon-Fri
9AM-5PM CST Sat
9AM-5PM CST Sun (Email & Chat Only)
Our Guarantees

subset: commoncrawl


text:
The first is to use a floating support for well kill operations, while the second involves drilling two relief wells.
Total E&P UK's top official confirmed two strategies that the company is using in parallel to try to stop a major gas leak from its Elgin platform in Britain's North Sea. The leak began March 25, but Philippe Guys, managing director of Total E&P UK, said during a March 30 news conference that "irregular pressure" was first detected Feb. 25 in the annuli of the well, which had been plugged for more than a year, and the company "very quickly moved to kill the annuli pressure by pumping it full with high density mud."
Guys confirmed the estimated rate of natural gas leaking from the platform is 200,000 cubic meters per day. He said the leaking gas appears to be coming from a rock formation 4,000 meters below the sea bed, which is above the main producing reservoir tapped by the plugged well (at 5,500 meters' depth).
"Now, the question has been asked if there could be similar problems with other wells on Elgin," Guys said. "What I can tell you is that when the platform was evacuated, all other wells were left in a safe condition. Onboard safety systems, known as the Christmas tree valves and downhole safety valves, were activated and we know the operation was successful from the platform control room."
No abnormal pressure was detected on the other Elgin wells, he added.
Guys, who was joined by Rt Hon Charles Hendry, MP, Minister of State for the Department of Energy and Climate Change, began by apologizing for the incident. "Let me say how much Total regrets the incident at the Elgin complex. Our top priority is the safety of our personnel," he said. "I can confirm that, in addition to the safe evacuation of 238 personnel from the Elgin platform, the on-board safety systems of the whole complex, including the other wells, were successfully activated."
Paris-based Total S.A. announced March 27 that it had evacuated the workers without injury from the offshore platform, which is located about 145 miles east of Aberdeen, Scotland. It tapped a high-pressure/high-temperature gas and condensate field. Total E&P UK Limited owns 46.17 percent and operates the field through a wholly owned subsidiary.
Drilling relief wells might take six months to accomplish. A shipping exclusion zone two miles from the platform is in place, firefighting ships are standing by, and Shell has evacuated workers from a rig four miles away, The Telegraph reported.
The company's 2011 financial results, announced Feb. 10, were strong, with $15.9 billion in net income -- up 17 percent from the year before.
The company earlier said a surveillance aircraft overflew the area and confirmed a small sheen related to drilling mud and/or light condensate on the water near the platform. "Preliminary assessments indicate no significant impact to the environment and dispersants are not considered necessary at this stage," it said, adding that Oil Spill Response Limited (OSRL) has been alerted and is evaluating the situation. Total E&P UK Limited is cooperating fully with relevant authorities, including the Department of Energy and Climate Change, the Health and Safety Executive, and the Scottish Environmental Protection Agency.
For updates, visit Total's Twitter page.
E-Mail this page
Printable Format
This is a self-directed course that uses interactive lessons and videos to teach you comprehensive First Aid, CPR, and AED knowledge. This program is for anyone with limited or no medical training who needs a course completion card in first aid, CPR and AED use to meet job, regulatory or other requirements.
Click here for more info →
This course teaches employees how to protect themselves and others from being exposed to blood or blood-containing materials. This course covers the general OSHA Standard for bloodborne pathogens training for anyone with a reasonable chance for occupational exposure to bloodborne pathogens.
Click here for more info →
6/24: OHS SuperCast 2015 -
3 Webinars in One Day
Fall Protection - Confined Spaces - Respiratory Protection
6/18: Moving Toward Global-Class Safety Performance & Culture - Advanced Level
more webinars


text:
Know more about this business than we do? Cool! Please submit any corrections or missing details you may have.Help us make it right
Be the first YellowBot user to add photos or videos of New Ritz Cabaret
This gentleman's club features private VIP areas, five stages, a shark tank and plasma TVs.
My initial impression of the Ritz was so-so. I'm not sure when the "NEW Ritz" came to town but I do feel like it's gotten better over the last few years....
Am I really the first person on Yelp to review the Ritz? Are the rest of you just too embarrassed to do so? If you live around here, you know you've been here...at least once...a month...so just man???
This gentleman's club features private VIP areas, five stages, a shark tank and plasma TVs. Become a VIP member and skip the cover charge and get 10 percent off your bill every night.
If you don't see your business listed on YellowBot, please add your business listing.
YellowBot wants to get your input! If you have a comment, find a bug or think of something neat we should do, let us know by emailing us.
© 2007-2015 Solfo, Inc. – All rights reserved


text:
Mon-Fri: 7am-1am EST / Sat-Sun: 7am-11pm EST
ApplianceAmana Dryer
Level of DifficultyReally easy
Time to do repairLess than 15 mins
Age of ApplianceMore than 10 years
0 out of 1 people found this instruction helpful
Repair part just snapped into place. It took longer to open the bag then do the repair. I thought it was going to be difficult to find a part for this dryer but partselect had the right part.Thanks
Help other customers find the most helpful instructions.
Were these instructions helpful?
Part Number: PS2029855
Part Number: PS2162263
All brand logos are trademarks of their respective owners.
The PartSelect logo is a Registered Trademark of Atlantic Laundry Centres, Ltd.
Copyright © 1999-2015 , Eldis Group Partnership. All rights reserved.


text:
|Using FasTrak
Once you have your FasTrak transponder, simply mount it on the inside of your windshield and you're good to go! When driving on the South Bay Expressway, just continue through the non-stop "FasTrak Only" lanes and your toll will be automatically deducted from your prepaid account. It's that easy! You can check your FasTrak account balance on our Web site any time 24/7. And don't forget to take your transponder with you when you travel to Orange County or the Bay Area. You can use your FasTrak transponder on any California toll facility that accepts FasTrak. Click here to see where FasTrak can take you!
Facebook Twitter
Receive Our Newsletter
Toll Calculator
Save up to 80% with FasTrak
Customer Service
(619) 661-7070
Customer Service Hours
Phone: M-F, 8am - 5pm
Walk-In: M-F, 8am - 6pm
Phone: M-F, 8am - 5pm
Walk-In: M-F, 8am - 6pm
Important Information about our Customer Service Center
In observance of Memorial Day, our Customer Service Center will be closed on Monday, May 25, 2015. We will resume normal business hours on Tuesday, May 26, 2015.
Also note that there will be no Toll Attendants on duty at the Otay Mesa Toll Plaza on Monday, May 25, 2015. Cash paying travelers should note that Automated Cash Machines take exact change only, so please plan accordingly. We apologize for any inconvenience.


text:
Designed to meet the nutritional need of multiple large hookbill species including Amazons, African Greys, Cockatoos and Conures. Added vitamins and minerals not usually found in an all seed diet promote colorful feather growth and ensure the overall health and well being for pet birds. Rich with tropical fruits and vegetables high in vitamin A, this colorful diet is attractive to all Parrots and has added calcium necessary for all life stages.
Ingredients:Safflower seed, white millet, red millet, wheat, pumpkin seed, buckwheat, peanuts, oat groats, flaked corn, dehydrated banana, raisins, dehydrated papaya, dehydrated pineapple, dehydrated coconut, dehydrated apple, dehydrated carrot, orange extract, ground yellow corn, ground oat groats, ground wheat, corn gluten meal, dried whole egg, potato protein, dicalcium phosphate, calcium carbonate, L-Lysine monohydrochloride, choline chloride, natrual & artificial flavors, salt, DL-methionine, vitamin E supplement, asorbic acide (source of vitamin C), ferric sulfate, d-biotin, yucca schidigera extract, zinc oxide, manganese oxide, niacinamide, vitamin B12 supplement, BHT (as a preservative), copper sulfate, calciium iodate, beta carotene, vitamin A supplement, calcium panththenate, sodium selenite, folic acid, riboflavin, pyridoxine hydrochloride, thiamine mononitrate, natural and artificial colors, menadion dimethylpyrimidinol bisulfite (source of vitamin K3), vitamin D3 supplement, cobalt sufate
Guaranteed Analysis:Crude Protein (min): 15%, Crude Fat (min):12%, Crude Fiber (max): 16%, Moisture (max): 12%, Calcium (min-max): 0.4% - 0.9%, Phosphorus (min): 0.3%
Internet Price: $14.99
Shop All Products By Sun Seed
Usually Leaves Warehouse the Next Business Day
4.5 lbs.
Here's How it Works:
*Valid on Repeat Delivery eligible products, products subject to change.
|Store Prices Vary
Lafeber's Nutri-Berries Parrot Food
$7.49 to $141.30
Brown's Encore Premium Parrot Food
ZuPreem AvianMaintenance FruitBlend...
$15.99 to $48.99
Sun Seed Sunsations Brain Teaser Bird Toy


text:
NORFOLK -- Two foxes have been captured in the Northside Park community in Norfolk over the last two weeks that have exhibited neurological symptoms similar to rabies, officials said Wednesday.
However, since there were no animal or human exposures, the animals were not tested for the disease.
Officials say a fox captured in that same area in May did test positive for rabies.
Health Officials warn residents to be aware and stay alert and recommend the following precautions:
- Warn adults and children not to approach or feed animals not belonging to them and to report any animal bites or scratches.
- Do not handle or touch stray or wild animals.
- Be sure dogs and cats are up-to-date on vaccinations.
- Keep pets confined to the home and yard.
- Keep yards free of food that could attract wild animals.
- Report stray or unvaccinated animals to Animal Control at 757-664-7387.
- Report all animal or human exposures to the Norfolk Department of Public Health at 757-683-2712.
On September 27, 2014,the Norfolk Health Department will be conducting a rabies vaccination clinic from 1 p.m. to 3 p.m. in the parking lot at its main Public Health Center, 830 Southampton Avenue, Norfolk, VA 23510.
The cost of vaccination is $5.00 for dogs and cats. A previous rabies certificate is required for animals to be eligible to receive the 3-year vaccine. In the absence of a rabies certificate, a 1-year vaccine will be administered. All animals must be at least 16 weeks of age and cats must be in carriers and dogs on leashes.
For further information, please contact the Environmental Health Division of the Norfolk Department of Public Health, at 757-683-2712.


text:
L'Île Noire
1649 rue St-Denis, Montreal, QC H2X 3K4Map
+1 514 982 0866
Neighborhood: Latin Quarter
Undoubtedly the quietest pint to be had in the Latin Quarter, this plush Scottish pub features more than a dozen beers on tap, most imported from Britain and Ireland. The aficionado will find even the most obscure scotches, and there are daily single malt specials for those looking to test their palates. Well-appointed far beyond the gimmickry of the average theme pub, its many nooks and crannies are perfect for a romantic cocktail or nightcap. However, the price tag might prohibit more freewheeling libations. Call or visit their website for more information.
Write a ReviewSign in
Thank you for submitting your review!
See All: Hotels » | Things To Do » | Restaurants » | Nightlife »
- Type: Cocktail Bars
- Accept Credit Card: visa, mastercard, amex
Best in Montreal Travel
Montreal Travel Guide
Hotel Quartier Latin
0.0 mi
Hotel Latin Inn
0.0 mi
Hotel Le Relais Lyonnais
0.0 mi
Celebrities Hotel
0.1 mi
Hotel du Manoir St-Denis
0.1 mi
See All Montreal Hotels »
Les Lundis à Papi
0.0 mi
Passeport Jpr - Sister Act
0.0 mi
Jillian Michaels
0.0 mi
See All Montreal Things To Do »
Le Saint Bock
0.1 mi
Vua Sandwichs
0.1 mi
Brioche Lyonnaise (La)
0.1 mi
Chez Gatsé
0.1 mi
Casa Galicia
0.2 mi
See All Montreal Restaurants »
Les Trois Brasseurs
0.0 mi
St. Denis Theatre
0.0 mi
Bistro à Jojo
0.0 mi
Pub Saint-Ciboire
0.0 mi
See All Montreal Nightlife »


text:
Articles Tagged 'Autolog'
EGM Review:
EGM Review:
Need for Speed: The Run
By Brandon Justice, Executive Editor
Posted on November 14, 2011 AT 11:59am
Posted on November 14, 2011 AT 11:59am
Growing up, Burt Reynolds films were always a guilty pleasure of mine, and few have inspired more "someone ought to make a game outta that movie" chatter than the legendary Cannonball Run series. And while EA didn't exactly shell out the cash to make an actual licensed product, they did the next best thing and ripped off the core concept, fused it with The Fast and the Furious, and crammed the concept into the 18th entry in the Need for Speed series: The Run. READ MORE
Today's Top 10 Stories
Partner Pages
Top Partner Stories
Until Dawn Announced For August 25th With New Trailer, Pre-Order Bonus Scene, And Screenshots
8840 Wilshire Blvd.,
Third Floor,
Beverly Hills, CA 90211
Third Floor,
Beverly Hills, CA 90211
© 2015 EGM Media LLC. All rights reserved. Trademarks belong to their respective owners.
Website Interface © 2012 EGM Digital Media, LLC.
Website Interface © 2012 EGM Digital Media, LLC.


text:
Wide World of Indoor Sports in North Smithfield, RI would like to offer local fastpitch teams the opportunity to use our facility for FREE practice time. We are happy to offer 3 free hours per team in our Sports Dome. This offer runs today through October 21st, 2012.
For more information or to book please contact JR by phone at 401-767-1234 or by email at
For full facility information please visit: www.wideworldofindoorsports.com


text: Fashion fantasy outfit #6 fantasy outfit #6… total price: $1967 (R13,468) – the more i do these the more i realise how ridiculous my fantasies are. and yes yes yes, it's a long skirt! see more fantasy outfits here. skirt / top / necklace / watch / shoes / belt / bag


text:
Get paid to blog for ThinkProgress.
Share this:
"Get paid to blog for ThinkProgress."
ThinkProgress is launching a blog fellows program. It's part time work (~20 hours/week) for six months, you receive a $3000 stipend, and you don't have to live in Washington DC. The deadline for applying is this Sunday. Details HERE.


text:
You are in: BGA
Website >> Info
for Clubs & Members >> Cross-Country
& Competitions >> Competition
Calendar 2015
links and downloadsField LandingNational
Competition Calendar
Nationals entry applications can be done online here (coming shortly), with entries due by 31st January. Regional entries should be done via the host club.
Before entering any competitions, you must have an FAI licence. If applying for nationals, you can apply at the same time. Otherwise, you can apply online here.
Click here for the 2014 calendar.
UPDATED 14th November 2014
There is a list of IGC ranked international competitions at
Terms ¦ Contact ¦ Feedback
© BGA Ltd 2008
Photos © the White Planes picture co. except where stated
Web design © www.launch-point.co.uk


text: People hawking Pope Benedict XVI T-shirts, bobbleheads, domain names, and images on seashells are thanking God (or whomever) for his U.S. visit. For the last two weeks, sales of Pope-related items has spiked 124 percent, according to eBay. There's currently 213 PB16 items for sale. Keep it tight, B, and you could hit John Paul II numbers—773 items relating to him are currently for sale. Sadly, neither pontiff comes close to the 802 items for sale that come up when you search for Satan. [Insider]


text:
One day, many dead: The start of Kenya mall siege
NAIROBI, Kenya It's 1:30 on Saturday afternoon in the Westgate Mall. Rafia Khan is huddling in a crawl space of the Millionaires Casino with her cousin and eight other people as gunmen roam the building and shoot, again and again, into crowds of shoppers.
Now she is teaching those in hiding - perfect strangers - words that she hopes will keep them alive.
The group had found the ceiling-level space as they fled gunfire and explosions.
While they are hiding, word spreads by mobile phone text messages that Islamic militants have taken control of the shopping mall that houses the casino. Word also spreads that the gunmen are allowing Muslims to leave - testing them by asking about their knowledge of Islam.
Khan and her cousin are the only Muslims among the small group. They decide to teach the others to recite the Shahada, the short Arabic-language creed that proclaims there is only one God and Muhammed is his prophet.
Over and over, Khan whispers the words slowly and phonetically, as if to a child: "La il-a-ha il-Al-lah wa Mu-ham-mad ru-soul Al-lah."
Saturdays are crowded at the Westgate Mall, Nairobi's most elite retail destination and a crossroads of the global economy. Rich foreign businessmen go there, as do wealthy Kenyans. There are shopping diplomats, and aid workers watching movies. They stroll the Nakumatt grocery store and have sandwiches at Java House. They buy sunglasses, silk shirts and phones.
Much of Kenya lives on less than a couple of dollars a day, but these poor also come to Westgate. They work inside, carrying boxes at the supermarket, sweeping the marble floors. Or they just come to watch.
"Poor. Rich. High class. All of them are there," says Khan, whose husband is a wealthy businessman.
On this Saturday, though, they would watch children weep and watch them die. They would leave injured friends behind as they fled the attackers. They would be shot, and hit by shrapnel from grenades. At least 67 would die in what became a four-day siege by extremists from al-Shabab, the Somalia-based, Muslim militant group.
This is what happened in those first hours.
The Westgate Mall entrance, about 12:36 p.m.:
Kenyan authorities believe there are as few as six gunmen, although the number remains unclear. The first team, wearing bulletproof vests, storms Westgate's front entrance, throwing grenades and firing assault rifles as they run. They are clearly well-trained.
Few people inside the mall think of terrorism when they hear the first explosion, and many think it's an electrical box giving way under Nairobi's unreliable power grid. But as one blast gives way to another and the clatter of machine-gun fire is heard, thousands of people know they need to move. But where?
Outside at the entrance, Ben Mulwa, a community organizer driving to the mall for lunch, jumps from his car and takes shelter in a shallow flowerbed. He also thinks it's a bank robbery. An unarmed mall security guard takes cover next to him.


text:
#300 of 335
Valparaiso, IN
Comment, Like, Favorite
Expert Printing and Assembly
Shipping Within 2 - 3 Business Days
Millions of Satisfied Customers
Doberman Pinscher
Michel Keck
Painting - Mixed Media Collage On Canvas Board
Modern Dog Art. Doberman art prints and paintings. qty orders (dealers or collectors - phone 219.306.9474 for best pricing!) Please note I can also make custom sizes of any and ALL of my images to fit YOUR specific art needs. I have a database of over 1,000 of my artworks (some not listed) that are available as fine art giclee prints. Call me for any art design projects that you need to fill with art and I can assist you. Every work listed here available also UNSTRETCHED - www.michelkeck.com for lower pricing. firstname.lastname@example.com or phone 219.306.9474 if you do not hear back from me in 24 hrs I may not have rec'd your email (junk/spam folders) call me direct if you dont hear from me. You can choose sections of a painting as well to make prints out of too. I can create any sizing or style you need to make my work fit with your design needs. (WHOLESALE INQUIRIES: Art dealers and decorators ordering in QTY phone me DIRECT at 219.306.9474 for SPECIAL coupon code for WHOLESALE ORDERS!) - Any of the works that you find on the web site http://www.michelkeck.com can be listed for you here on this web site. If you see an image on michelkeck.com that is not listed here simply call me at 219.306.9474 or email me at firstname.lastname@example.com and I will move the image over here for you in whatever size or format you need. Thank you for your continued support of my art. Please also note if you need a piece resized to make it 'wider' or 'taller' we can edit these images for you as well to help you create the perfect piece of art to meet your sizing requirements. INTERIOR DECORATORS please phone me direct for special COUPON CODE to enter for WHOLESALE ORDERS. 219-306-9474. I also have special pricing for NON trade if you are ordering multiple pieces, phone me direct for the best pricing available.
January 2nd, 2012
Viewed 7,955 Times - Last Visitor from Beverly Hills, CA on 05/25/2015 at 6:04 AM
Sales Sheet
doberman pinscher canvas prints
doberman painting canvas prints
doberman paintings canvas prints
doberman pinscher framed prints
doberman painting framed prints
doberman paintings framed prints
More from Michel Keck
Victor Gladkiy 18 Days Ago
Birobidjan, EA - Russian Federation
Moscov, RU - Russian Federation
Phoenixville, PA - United States
Congrats on your sale!!!
Denison, TX - United States
Very nice. Congratulations on your sale.
Stanton, IA - United States
great work congrats
Oslo, Os - Norway
Congratulations on your Art sale!
Singapore - Singapore
Well done! Congrats!
Marietta, GA - United States
Wow! You really gave the dog a lot of emotion in this.
Brooklyn, Ne - United States
Congrats on your sale, Michel! Wonderful use of colors!
Mexico, d. - Mexico
Palm Bay, FL - United States
Love him!!!!!
Brainerd, MN - United States
Congratulations on your sale!
Valencia, Va - Spain
Congratulations... If you have time, please, visit my photos... Thanks!!!
Nuremberg, Ba - Germany
Congratulations on your sale!! :)
Tampa, FL - United States
Love these...Congrats Michel!
Mesa, AZ - United States
Congratulations on your sale
Lexington Park, MD - United States
Congrats! These are really neat!
US, US - United States
Congrats on your sale !
Philadelphia, PA - United States
Congrats on your sale!!
Demotte, IN - United States
thank you guys!!! my dog collage series has been a really fun one for me :)) your kind words r appreciated!!
Salt Lake City, UT - United States
What a great technique you have here. Congratulations.
Bangalore, Ka - India
Philadelphia, PA - United States
Congrats on your sale!
Azuga, PH - Romania
Very nice work !!!
San Antonio, TX - United States
what a great piece! congrats on your sale
Grants Pass, OR - United States
Very nice job!!
Torino, It - Italy
i like it! congrats on your sale!
Voorhees, NJ - United States
Congrats on your sale!!! -Kim
Lisle, ON - Canada
I love this!!!
Melbourne, Vi - Australia
Very cool work!
Dyersburg, TN - United States
This is so unique. What a great image. Love this!
Missoula, MT - United States
Very cool & unique piece, michel!! Great job & congrats on your sale:) ~Teshia
Palm Bay, FL - United States
Love it!!!! very creative and fun!!!
Kochi, ke - India
good work........
Santa Barbara, CA - United States
yes yes yes. this is incredible.
Boston, MA - United States
Original.. Nice work!
Budapest, H - Hungary
Congratulations on your artwork.................Odon.
Warren, MI - United States
Congratulations on your sale, very nice work Michel!!
Nuremberg, Ba - Germany
Crazy and wonderful artwork. Keep it up! V/F
Martinez, GA - United States
amazing...original...i love this!!!
Demotte, IN - United States
thank u guys! :))
Oakton, VA - United States
Love your work, congrats!
Evansville, In - United States
Congrats! This is pretty awesome!
Philadelphia, PA - United States
Congratulations on your sale!!
Voorhees, NJ - United States
Congrats on your sale!!!
Please Wait...
Beverly Hills, CA (United States)
Sign up for our newsletter for exclusive deals, discount codes, and more:
Unsubscribe at any time.
Server Status OK
Copyright © 2015 FineArtAmerica.com - All Rights Reserved


text:
Family Of Medium Tactical VehiclesFMTV
Capacity to Deliver Solutions.
The Oshkosh Defense® FMTV.
The Oshkosh® Family of Medium Tactical Vehicles (FMTV) stands alone as the get-things-done resource for military operations. Crew-protecting armor and advanced technologies work in concert to provide the capability, versatility, mobility and protection to move troops and supplies, recover vehicles and weapon systems or haul equipment wherever the mission requires.
For durability, reliability and advanced performance, the FMTV has been proven time and time again. It meets the demands – of the mission, of the battlefield and of the military personnel who rely on it. Commonality of parts – over 80 percent – across chassis variants significantly reduces the logistics burden as well as operational and support costs. And with a Long-Term Armor Strategy-compliant cab and other advanced technologies, military personnel get the enhanced protection they need to confidently complete their missions.
Related Documents
Related News
Oshkosh Defense Supports Canadian Troops with $25,000 Donation to the True Patriot Love Foundation More »
Oshkosh Defense Showcases Mission Ready Vehicles for Canadian Modernization Efforts at CANSEC 2015 More »
Oshkosh Defense Honors Our Nation's Heroes and their Families at the National Memorial Day Parade More »
U.S. Marine Corps Enters Production Phase of Oshkosh P-19R Aircraft Rescue & Fire Fighting Contract More »
Oshkosh Defense Showcases JLTV Solution, Virtual Task Trainer at AUSA Global Force Symposium More »


text:
The Invisible Antipode
a novella
by Laryssa Jordyn McCardy
"Beth gets down on her knees as the silent ragging continues. She wants out. Now. 'Dear God,' the rants graduate behind her. 'Please make her stop. Please!' With a massive cry, Faye leaves.
For now."
-The Invisible Antipode, Chapter One
Comment posted.
Sign in or create an account to post a comment.
Start your own book today from US $3.99.
Get Started
Blurb Sites


text:
Pronunciation: sistema decimal
Added on: 2013-01-27 Listened: 7 timesin: Add categories to sistema decimal
Pronunciation in Catalan [ca]
- Pronunciation by theternitend (Male from Spain)
0 votes
Could you do it better? different accent? Pronounce sistema decimal in Catalan
Accents & languages on maps
- Random word: cerç
Not satisfied?
Modify word:
· Add languages
· Add categories
Report word:
Is there anything wrong with this word?
Please report it here.


text:
Stylish couple Liev Schriber and Naomi Watts have a date night and were spotted taking a movie in during the Tribeca Film Festival.
Pauly D tosses around a football while hanging on Miami Beach!
DWTS partners, Derek Hough and Nicole Scherzinger grab some coffee in LA.
Rachel Weisz take some time off from shooting 'Dream House' and greets a beautiful horse in Toronto.
Fame Pictures
Anna Hathaway and Adam Shulman seem happy together while out and about in Los Angeles.
Sting participates in The Climate Rally Earth Day 2010 at the National Mall in Washington, D.C..
Ramey Photo
Disney Queens, Miley Cyrus and Demi Lovato hung out in Beverly Hills together!
Ashley Tisdale enjoys an ice cream cone while out and about with some friends in Los Angeles.
George Clooney is as cheerful as can be while going through security at LAX!
Penelope Cruz cuddles up to her man, Javier Bardem when spotted out in LA.
Nikki Reed flashes a smile as she leaves Alice + Olivia on Robertson Boulevard!
Adam Lambert says peace as he heads back to his London hotel!
A growing Claudia Schiffer makes her way back home after dropping the kids off at school.
Britney Spears and Jason Trawick were snapped going to a LA medical building.
Splash News
Angelina Jolie has her hair and makeup done before a photo shoot at the Hotel Danieli in Venice, Italy.
Matthew Broderick scoots with his son, James Wilke Broderick, to school in New York City.
Flash City
Chris Ivery and Ellen Pompeo enjoy a sunny day in Malibu with their daughter Luna Stella. The family looks so happy and cute together!
Pacific Coast News
David Duchovny and Natasha McElhone film the upcoming season of "Californication".
David Beckham still looks stylish despite being on crutches for an appearance on the "Late Show with David Letterman".
David Hasselhoff gets his groove back in Austria.
FAME Pictures
Halle Berry holds a plush toy. Is that for Nahla?
FAME Pictures
Smoochy, smoochy! LeAnn Rimes and Eddie Cibrian share a kiss.
INF Daily
Dominic Cooper and Amanda Seyfried enjoy a day out in NYC.
INF Daily
Ever the gent! Hugh Jackman pulls up his hood while daughter Ava and a little friend get the umbrella.
INF Daily
Jane Krakowski gets spotted in New York City.
INF Daily
Derek Jeter and a young fan pose for photos at the White House.
Ramey Photo
Jennifer Lopez carries Emme as the family leaves paris.
The Last Girl on Earth is hot! Rihanna shows a futuristic style during her "Last Girl on Earth" tour.
Ramey Photo
Sophia Bush and Austin Nichols stroll hand in hand.
Splash News
Victoria Beckham shops at Whole Foods
Adrian Grenier sits a top a hog on the set of "Entourage".
Playboy bunnies, Bridget Marquardt and Jessica Hall have a nice afternoon shopping in Beverly Hills.
Courtney Love arrives to a NYC Best Buy to promote Hole's first album in 10 years, 'Nobody's Daughter'.
Kourtney Kardashian stops off at Baby R Us for some diapers before heading home to baby Mason.
Kristin Cavallari looks sweet and sophisticated as she signs autographs after appearing on 'The Wendy Williams Show' in NYC!
Viola Davis and Denzel Washington prepare to take a bow during the open night curtain call at The Cort Theater for the Broadway play, 'Fences'.
Pacific Coast News
Bronzed and beautiful, Kim Kardashian leaves STK after dinner and heads to Teddy's nightclub in Los Angeles.
Ramey Photo
Lindsay and Ali Lohan get to work creating their own milkshakes at Millions of Milkshakes. To see more of the fun, click here.
The Hot Photos for April 27th, 2010


text:
Hugh Cornwell
27/08/15 - 04/11/15
Register for our TicketAlarm never miss a show by your favourite artists again
The Stranglers are a rock music group, formed on September 11, 1974 in Guildford, Surrey, England, United Kingdom. They were originally called The Guildford Stranglers and operated from an off-licence in the town. They also based themselves in the nearby village of Chiddingfold for a while.Original personnel were singer/guitarist Hugh Cornwell (fro...
Read more


text:
The content on this page is being archived for historic and reference purposes only. The content, links, and pdfs are no longer maintained and might be outdated.
Publication of Reducing the Health Consequences of Smoking: 25 Years of Progress
The Surgeon General's report, Reducing the Health Consequences of Smoking: 25 Years of Progress, was released on January 11, 1989, exactly 25 years after release of the first Srgeon General's report on smoking and health. The 1989 report provides a comprehensive review of developments related to smoking and health during the past quarter century, focusing on the following topics: advances in knowledge of the health effects of smoking; changes in smoking-attributable mortality; trends in public beliefs, attitudes, and opinions about smoking; changes in smoking behavior and knowledge about the determinants of smoking; smoking prevention, cessation and advocacy activities; smoking-control policies; and behavioral and health consequences of changes in the smoking-and-health environment.
A final indexed version of the report will be available for purchase from the Government Printing Office in several months. An executive summary of the report will be published as a supplement to the MMWR within 2 months. A limited supply of executive summaries is now available from the Office on Smoking and Health, CDC, 5600 Fishers Lane, Park Building, Room 1-16, Rockville, MD 20857; telephone (301) 443-1690.
Disclaimer All MMWR HTML documents published before January 1993 are electronic conversions from ASCII text into HTML. This conversion may have resulted in character translation or format errors in the HTML version. Users should not rely on this HTML document, but are referred to the original MMWR paper copy for the official text, figures, and tables. An original paper copy of this issue can be obtained from the Superintendent of Documents, U.S. Government Printing Office (GPO), Washington, DC 20402-9371; telephone: (202) 512-1800. Contact GPO for current prices.**Questions or messages regarding errors in formatting should be addressed to firstname.lastname@example.com.
Page converted: 08/05/98
This page last reviewed 5/2/01


text:
Noté 5 sur 5 étoiles
best ever extension !!!!
i'm using about 60 extensions choosen during long period of FF usage. You can check my collection Power User Pack.
but to be honest i need only 3-4 extensions. Tree Style Tab, Adblock, FlashGot, Session manager , Xmarks and some others.
But if you will say choose only one extension for FF usage... i'll say Tree Style Tab. i'm working with hundred pages, keeping them in groups (i'm networks and servers admin). Such pages i'm looking often, but can't put them into favorites.
Thank you very much !!!
Don't stop developing !!!
and i just saw link on your web site for actual version, stoped using FF becouse of buggy version on this site.


text:
Newport Candle Company, Newport
1 Reviews
1 Reviews
Not exactly Yankee Candle but they had some interesting shaped candles in a varity of fragrances. The store itself is small but full of a rainbow of colored candles. They had interesting shell candles and holiday candles. From tapers to votives they have every size candle.
What to buy: Any candle you could possibly want in an array of colors.
Get an instant answer from local experts and frequent travelers
Sponsored Links
Sponsored Links


text:
Next, you'll be asked to connect with Twitter. Rest assured, we will never send a tweet from your account
without your permission.
We will send you an email with an invite soon.
I am loving new Google Inbox. Mostly. See more on my Facebook account at
See what's Trending Now for @Scobleizer
Follow @Scobleizer on Twitter


text:
RFID Technology In The Blood Tracking Procession
The Unitech PA600 MCA (Mobile Clinical Assistant) is a compact and rugged mobile computer designed especially for healthcare applications. PA600 MCA are now used for blood tracking procession, at the BloodCenter of Wisconsin, USA. A case history by Unitech
How to succeed with mobile solutions
Useful advice from industry expert Mikael Nilebacke, MD, Erisma Technologies
New Tactile Touch Technology for Multi-finger Localized Interaction
NLT Technologies, together with its sales and marketing channel in Europe, Renesas Electronics Europe GmbH, has announced the introduction of an LCD prototype with a tactile touch technology developed
Automatic ticket vendors meet the spirit of the times
Customer-friendly terminals from Inform with Citizen printers at the Vienna Museum of Art History
Worldwide Traditional PC, Tablet, Ultramobile and Mobile Phone Shipments to Grow 4.2 Per Cent in 2014, Gartner Says
Worldwide PC Market to Show Relative Revival in 2014 after Falling 9.5 Per Cent in 2013. Worldwide Tablet Market to Slow Down in 2014 and Reach 256 Million Unit
CWM uses PANMOBILs data collection devices to ensure an error-free transmission to the eShop
The Carl-Wilhelm Meyer Company from Oldenburg took advantage of the PANMOBIL Smart Order Solution and counts it to one of their most important tools when it comes to customer loyalty
Wearable Electronics is a Huge Minefield
On its new report, called Wearable Technology 2014-2024: Technologies, Markets, Forecasts, IDTechEx looks at the big picture of wearable electronics for the first time. And it comes with a cautionary message