text:
Difference between revisions of "RAID"
Drankinatty (talk | contribs)
|Line 353:
|Line 353:
{{Note|Users may alternatively echo '''repair''' to /sys/block/md0/md/sync_action but this is ill-advised since if a mismatch in the data is encountered, it would be automatically updated to be consistent. The danger is that we really don't know whether it's the parity or the data block that's correct (or which data block in case of RAID1). It's luck-of-the-draw whether or not the operation gets the right data instead of the bad data.}}
{{Note|Users may alternatively echo '''repair''' to /sys/block/md0/md/sync_action but this is ill-advised since if a mismatch in the data is encountered, it would be automatically updated to be consistent. The danger is that we really don't know whether it's the parity or the data block that's correct (or which data block in case of RAID1). It's luck-of-the-draw whether or not the operation gets the right data instead of the bad data.}}
It is a good idea to set up a cron job as root to schedule a periodic scrub. See {{AUR|raid-check}} which can assist with this.
It is a good idea to set up a cron job as root to schedule a periodic scrub. See {{AUR|raid-check}} which can assist with this. To perform a periodic scrub using systemd timers instead of cron, See {{AUR|raid-check-systemd}} which contains the same script along with associated systemd timer unit files.
To perform a periodic scrub using systemd timers instead of cron, See {{AUR|raid-check-systemd}} which contains the same script along with associated systemd timer unit files.
==== RAID1 and RAID10 Notes on Scrubbing ====
==== RAID1 and RAID10 Notes on Scrubbing ====
Revision as of 15:32, 23 October 2016
This article explains what RAID is and how to create/manage a software RAID array using mdadm.
- 1 Introduction
- 2 Implementation
- 3 Installation
- 3.1 Prepare the Devices
- 3.2 Create the Partition Table (GPT)
- 3.3 Build the Array
- 3.4 Update configuration file
- 3.5 Assemble the Array
- 3.6 Format the RAID Filesystem
- 4 Mounting from a Live CD
- 5 Installing Arch Linux on RAID
- 6 RAID Maintenance
- 7 Monitoring
- 8 Troubleshooting
- 9 Benchmarking
- 10 See also
See also Wikipedia:RAID.
Redundant Array of Independent Disks (RAID) is a storage technology that combines multiple disk drive components (typically disk drives or partitions thereof) into a logical unit. Depending on the RAID implementation, this logical unit can be a file system or an additional transparent layer that can hold several partitions. Data is distributed across the drives in one of several ways called "RAID levels", depending on the level of redundancy and performance required. The RAID level chosen can thus prevent data loss in the event of a hard disk failure, increase performance or be a combination of both.
Despite redundancy implied by most RAID levels, RAID does not guarantee that data is safe. A RAID will not protect data if there is a fire, the computer is stolen or multiple hard drives fail at once. Furthermore, installing a system with RAID is a complex process that may destroy data.
Standard RAID levels
There are many different levels of RAID, please find hereafter the most commonly used ones.
- Uses striping to combine disks. Even though it does not provide redundancy, it is still considered RAID. It does, however, provide a big speed benefit. If the speed increase is worth the possibility of data loss (for swap partition for example), choose this RAID level. On a server, RAID 1 and RAID 5 arrays are more appropriate. The size of a RAID 0 array block device is the size of the smallest component partition times the number of component partitions.
- The most straightforward RAID level: straight mirroring. As with other RAID levels, it only makes sense if the partitions are on different physical disk drives. If one of those drives fails, the block device provided by the RAID array will continue to function as normal. The example will be using RAID 1 for everything except swap and temporary data. Please note that with a software implementation, the RAID 1 level is the only option for the boot partition, because bootloaders reading the boot partition do not understand RAID, but a RAID 1 component partition can be read as a normal partition. The size of a RAID 1 array block device is the size of the smallest component partition.
- Requires 3 or more physical drives, and provides the redundancy of RAID 1 combined with the speed and size benefits of RAID 0. RAID 5 uses striping, like RAID 0, but also stores parity blocks distributed across each member disk. In the event of a failed disk, these parity blocks are used to reconstruct the data on a replacement disk. RAID 5 can withstand the loss of one member disk.
- Note: RAID 5 is a common choice due to its combination of speed and data redundancy. The caveat is that if one drive were to fail and another drive failed before that drive was replaced, all data will be lost. Furthermore, with modern disk sizes and expected unrecoverable read error rates on consumer disks, the rebuild of a 4TiB array is expected (i.e. higher than 50% chance) to have at least one URE. Because of this, RAID 5 is no longer advised by the storage industry.
- Requires 4 or more physical drives, and provides the benefits of RAID 5 but with security against two drive failures. RAID 6 also uses striping, like RAID 5, but stores two distinct parity blocks distributed across each member disk. In the event of a failed disk, these parity blocks are used to reconstruct the data on a replacement disk. RAID 6 can withstand the loss of two member disks. The robustness against unrecoverable read errors is somewhat better, because the array still has parity blocks when rebuilding from a single failed drive. However, given the overhead, RAID 6 is costly and in most settings RAID 10 in far2 layout (see below) provides better speed benefits and robustness, and is therefore preferred.
Nested RAID levels
- RAID1+0 is a nested RAID that combines two of the standard levels of RAID to gain performance and additional redundancy. It is commonly referred to as RAID10, however, Linux MD RAID10 is slightly different from simple RAID layering, see below.
- RAID10 under Linux is built on the concepts of RAID1+0, however, it implements this as a single layer, with multiple possible layouts.
- The near X layout on Y disks repeats each chunk X times on Y/2 stripes, but does not need X to divide Y evenly. The chunks are placed on almost the same location on each disk they're mirrored on, hence the name. It can work with any number of disks, starting at 2. Near 2 on 2 disks is equivalent to RAID1, near 2 on 4 disks to RAID1+0.
- The far X layout on Y disks is designed to offer striped read performance on a mirrored array. It accomplishes this by dividing each disk in two sections, say front and back, and what is written to disk 1 front is mirrored in disk 2 back, and vice versa. This has the effect of being able to stripe sequential reads, which is where RAID0 and RAID5 get their performance from. The drawback is that sequential writing has a very slight performance penalty because of the distance the disk needs to seek to the other section of the disk to store the mirror. RAID10 in far 2 layout is, however, preferable to layered RAID1+0 and RAID5 whenever read speeds are of concern and availability / redundancy is crucial. However, it is still not a substitute for backups. See the wikipedia page for more information.
RAID level comparison
|RAID level
|Data redundancy
|Physical drive utilization
|Read performance
|Write performance
|Min drives
|Up to nX if multiple processes are reading, otherwise 1X
|67% - 94%
|50% - 88%
Best; on par with RAID0 but redundant
|Up to nX if multiple processes are reading, otherwise 1X
* Where n is standing for the number of dedicated disks.
The RAID devices can be managed in different ways:
- Software RAID
- This is the easier implementation as it does not rely on obscure proprietary firmware and software to be used. The array is managed by the operating system either by:
- Hardware RAID
- The array is directly managed by a dedicated hardware card installed in the PC to which the disks are directly connected. The RAID logic runs on an on-board processor independently of the host processor (CPU). Although this solution is independent of any operating system, the latter requires a driver in order to function properly with the hardware RAID controller. The RAID array can either be configured via an option rom interface or, depending on the manufacturer, with a dedicated application when the OS has been installed. The configuration is transparent for the Linux kernel: it doesn't see the disks separately.
- FakeRAID
- This type of RAID is properly called BIOS or Onboard RAID, but is falsely advertised as hardware RAID. The array is managed by pseudo-RAID controllers where the RAID logic is implemented in an option rom or in the firmware itself with a EFI SataDriver (in case of UEFI), but are not full hardware RAID controllers with all RAID features implemented. Therefore, this type of RAID is sometimes called FakeRAID. dmraid from the official repositories, will be used to deal with these controllers. Here are some examples of FakeRAID controllers: Intel Rapid Storage, JMicron JMB36x RAID ROM, AMD RAID, ASMedia 106x, and NVIDIA MediaShield.
Which type of RAID do I have?
Since software RAID is implemented by the user, the type of RAID is easily known to the user.
However, discerning between FakeRAID and true hardware RAID can be more difficult. As stated, manufacturers often incorrectly distinguish these two types of RAID and false advertising is always possible. The best solution in this instance is to run the
lspci command and looking through the output to find the RAID controller. Then do a search to see what information can be located about the RAID controller. Hardware RAID controllers appear in this list, but FakeRAID implementations do not. Also, true hardware RAID controller are often rather expensive (~$400+), so if someone customized the system, then it is very likely that choosing a hardware RAID setup made a very noticeable change in the computer's price.
Install mdadm from the official repositories. mdadm is used for administering pure software RAID using plain block devices: the underlying hardware does not provide any RAID logic, just a supply of disks. mdadm will work with any collection of block devices. Even if unusual. For example, one can thus make a RAID array from a collection of thumb drives.
Prepare the Devices
To prevent possible issues each device in the RAID should be securely wiped. If the device is being reused or re-purposed from an existing array, erase any old RAID configuration information:
# mdadm --zero-superblock /dev/<drive>
or if a particular partition on a drive is to be deleted:
# mdadm --zero-superblock /dev/<partition>
Create the Partition Table (GPT)
It is highly recommended to pre-partition the disks to be used in the array. Since most RAID users are selecting HDDs >2 TB, GPT partition tables are required and recommended. Disks are easily partitioned using gptfdisk.
- After created, the partition type should be assigned hex code FD00.
- If a larger disk array is employed, consider assigning disk labels or partition labels to make it easier to identify an individual disk later.
- Creating partitions that are of the same size on each of the devices is preferred.
- A good tip is to leave approx 100 MB at the end of the device when partitioning. See below for rationale.
Partitions Types for MBR
For those creating partitions on HDDs with a MBR partition table, the partition types available for use are:
- 0xDA (for non-fs data -- current recommendation by kernel.org)
- 0xFD (for raid autodetect arrays -- was useful before booting an initrd to load kernel modules)
When replacing a failed disk of a RAID, the new disk has to be exactly the same size as the failed disk or bigger — otherwise the array recreation process will not work. Even hard drives of the same manufacturer and model can have small size differences. By leaving a little space at the end of the disk unallocated one can compensate for the size differences between drives, which makes choosing a replacement drive model easier. Therefore, it is good practice to leave about 100 MB of unallocated space at the end of the disk.
Build the Array
mdadm to build the array. Several examples are given below.
The following example shows building a 2-device RAID1 array:
# mdadm --create --verbose --level=1 --metadata=1.2 --raid-devices=2 /dev/md0 /dev/sdb1 /dev/sdc1
The following example shows building a RAID5 array with 4 active devices and 1 spare device:
# mdadm --create --verbose --level=5 --metadata=1.2 --chunk=256 --raid-devices=4 /dev/md0 /dev/sdb1 /dev/sdc1 /dev/sdd1 /dev/sde1 --spare-devices=1 /dev/sdf1
The following example shows building a RAID10,far2 array with 2 devices:
# mdadm --create --verbose --level=10 --metadata=1.2 --chunk=512 --raid-devices=2 --layout=f2 /dev/md0 /dev/sdb1 /dev/sdc1
--homehost and
--name options can be used for a custom raid device name. They are delimited by a colon in the resulting name.
The array is created under the virtual device
/dev/mdX, assembled and ready to use (in degraded mode). One can directly start using it while mdadm resyncs the array in the background. It can take a long time to restore parity. Check the progress with:
$ cat /proc/mdstat
Update configuration file
By default, most of
mdadm.conf is commented out, and it contains just the following:
DEVICE partitions
This directive tells mdadm to examine the devices referenced by
/proc/partitions and assemble as many arrays as possible. This is fine if you really do want to start all available arrays and are confident that no unexpected superblocks will be found (such as after installing a new storage device). A more precise approach is as follows:
# echo 'DEVICE partitions' > /etc/mdadm.conf # mdadm --detail --scan >> /etc/mdadm.conf
This results in something like the following:
DEVICE partitions ARRAY /dev/md/0 metadata=1.2 name=pine:0 UUID=27664f0d:111e493d:4d810213:9f291abe
This also causes mdadm to examine the devices referenced by
/proc/partitions. However, only devices that have superblocks with a UUID of
27664… are assembled in to active arrays.
mdadm.conf(5) for more information.
Assemble the Array
Once the configuration file has been updated the array can be assembled using mdadm:
# mdadm --assemble --scan
Format the RAID Filesystem
The array can now be formatted like any other disk, just keep in mind that:
- Due to the large volume size not all filesystems are suited (see: File system limits).
- The filesystem should support growing and shrinking while online (see: File system features).
- One should calculate the correct stride and stripe-width for optimal performance.
Calculating the Stride and Stripe-width
The array will have an entry in
# /sys/devices/virtual/block/mdX/queue/optimal_io_size
(where mdX is the name of your array). It will give the stripe-width in bytes. Divide by the block size to get the stripe width in blocks, then divide by number of data disks to get the stride. The following calculations should match this.
Stride = (chunk size/block size)
To calculate the best stride, consider the following:
- Arch's default block size for many filesystems is 4096, see:
/etc/mke2fs.conffor details.
- chunk size is a user provided value between 4K (1 block)(512-bytes on Non-Advanced Format disks) and 64K or more. The predominant default chunk size chosen is 64K. If your normal average request is for larger files (such as video editing, graphics processing, etc.) you can reduce the chunk size to one or two blocks to provide more bandwidth for larger files.
- Tip: See also Chunks: the hidden key to RAID performance.
Next, calculate:
Stripe-width = (# of physical data disks * stride)
Example 1. RAID0
Example formatting to ext4 with the correct stripe-width and stride:
- Hypothetical RAID0 array is composed of 2 physical disks.
- Chunk size is 64k.
- Block size is 4k.
Stride = (chunk size/block size). In this example, the math is (64/4) so the stride = 16.
Stripe-width = (# of physical data disks * stride). In this example, the math is (2*16) so the stripe-width = 32.
# mkfs.ext4 -v -L myarray -m 0.5 -b 4096 -E stride=16,stripe-width=32 /dev/md0
Example 2. RAID5
Example formatting to ext4 with the correct stripe-width and stride:
- Hypothetical RAID5 array is composed of 4 physical disks; 3 data discs and 1 parity disc.
- Chunk size is 512k.
- Block size is 4k.
Stride = (chunk size/block size). In this example, the math is 512/4) so the stride = 128.
Stripe-width = (# of physical data disks * stride). In this example, the math is (3*128) so the stripe-width = 384.
# mkfs.ext4 -v -L myarray -m 0.01 -b 4096 -E stride=128,stripe-width=384 /dev/md0
For more on stride and stripe-width, see: RAID Math.
Example 3. RAID10,far2
Example formatting to ext4 with the correct stripe-width and stride:
- Hypothetical RAID10 array is composed of 2 physical disks. Because of the properties of RAID10 in far2 layout, both count as data disks.
- Chunk size is 512k.
- Block size is 4k.
# cat /sys/devices/virtual/block/md0/queue/optimal_io_size # 1048576
So the stripe-width should match 1048576 / 4096 = 256, and the stride should match 256 / 2 = 128.
Stride = (chunk size/block size). In this example, the math is (512/4) so the stride = 128.
Stripe-width = (# of physical data disks * stride). In this example, the math is (2*128) so the stripe-width = 256.
# mkfs.ext4 -v -L myarray -m 0.01 -b 4096 -E stride=128,stripe-width=256 /dev/md0
Mounting from a Live CD
Users wanting to mount the RAID partition from a Live CD, use:
# mdadm --assemble /dev/<disk1> /dev/<disk2> /dev/<disk3> /dev/<disk4>
If your RAID 1 that's missing a disk array was wrongly auto-detected as RAID 1 (as per
mdadm --detail /dev/md<number>) and reported as inactive (as per
cat /proc/mdstat), stop the array first:
# mdadm --stop /dev/md<number>
Installing Arch Linux on RAID
You should create the RAID array between the Partitioning and formatting[broken link: invalid section] steps of the Installation Procedure. Instead of directly formatting a partition to be your root file system, it will be created on a RAID array. Follow the section #Setup[broken link: invalid section] to create the RAID array. Then continue with the installation procedure until the pacstrap step is completed. When using UEFI boot, also read ESP on RAID.
Update configuration file
After the base system is installed the default configuration file,
mdadm.conf, must be updated like so:
# mdadm --detail --scan >> /mnt/etc/mdadm.conf
Always check the mdadm.conf configuration file using a text editor after running this command to ensure that its contents look reasonable.
Continue with the installation procedure until you reach the step "Create initial ramdisk environment", then follow the next section.
Add mdadm hook to mkinitcpio.conf
mdadm_udev to the HOOKS section of the
mkinitcpio.conf to add support for mdadm directly into the init image:
HOOKS="base udev autodetect block mdadm_udev filesystems usbinput fsck"
Then Regenerate the initramfs image.
Configure the boot loader
Add an
md kernel parameter for each RAID array; also point the
root parameter to the correct mapped device. The following example accommodates three RAID 1 arrays and sets the second one as root:
root=/dev/md1 md=0,/dev/sda2,/dev/sdb2 md=1,/dev/sda3,/dev/sdb3 md=2,/dev/sda4,/dev/sdb4
If booting from a software raid partition fails using the kernel device node method above, an alternative and more reliable way is to use Persistent block device naming, for example:
See also GRUB#RAID.
RAID Maintenance
It is good practice to regularly run data scrubbing to check for and fix errors. Depending on the size/configuration of the array, a scrub may take multiple hours to complete.
To initiate a data scrub:
# echo check > /sys/block/md0/md/sync_action
The check operation scans the drives for bad sectors and automatically repairs them. If it finds good sectors that contain bad data (the data in a sector does not agree with what the data from another disk indicates that it should be, for example the parity block + the other data blocks would cause us to think that this data block is incorrect), then no action is taken, but the event is logged (see below). This "do nothing" allows admins to inspect the data in the sector and the data that would be produced by rebuilding the sectors from redundant information and pick the correct data to keep.
As with many tasks/items relating to mdadm, the status of the scrub can be queried by reading
$ cat /proc/mdstat
Personalities : [raid6] [raid5] [raid4] [raid1] md0 : active raid1 sdb1[0] sdc1[1] 3906778112 blocks super 1.2 [2/2] [UU] [>....................] check = 4.0% (158288320/3906778112) finish=386.5min speed=161604K/sec bitmap: 0/30 pages [0KB], 65536KB chunk
To stop a currently running data scrub safely:
# echo idle > /sys/block/md0/md/sync_action
When the scrub is complete, admins may check how many blocks (if any) have been flagged as bad:
# cat /sys/block/md0/md/mismatch_cnt
General Notes on Scrubbing
It is a good idea to set up a cron job as root to schedule a periodic scrub. See raid-checkAUR which can assist with this. To perform a periodic scrub using systemd timers instead of cron, See raid-check-systemdAUR which contains the same script along with associated systemd timer unit files. (note: for typical platter drives, scrubbing can take approximately six minutes per gigabyte [that's one hour forty-five minutes per terabyte] so plan the start of your cron job or timer appropriately)
RAID1 and RAID10 Notes on Scrubbing
Due to the fact that RAID1 and RAID10 writes in the kernel are unbuffered, an array can have non-0 mismatch counts even when the array is healthy. These non-0 counts will only exist in transient data areas where they don't pose a problem. However, we can't tell the difference between a non-0 count that is just in transient data or a non-0 count that signifies a real problem. This fact is a source of false positives for RAID1 and RAID10 arrays. It is however still recommended to scrub regularly in order to catch and correct any bad sectors that might be present in the devices.
Removing Devices from an Array
One can remove a device from the array after marking it as faulty:
# mdadm --fail /dev/md0 /dev/sdxx
Now remove it from the array:
# mdadm -r /dev/md0 /dev/sdxx
Remove device permanently (for example, to use it individually from now on): Issue the two commands described above then:
# mdadm --zero-superblock /dev/sdxx
Stop using an array:
- Umount target array
- Stop the array with:
mdadm --stop /dev/md0
- Repeat the three command described in the beginning of this section on each device.
- Remove the corresponding line from /etc/mdadm.conf
Adding a New Device to an Array
Adding new devices with mdadm can be done on a running system with the devices mounted. Partition the new device using the same layout as one of those already in the arrays as discussed above.
Assemble the RAID array if it is not already assembled:
# mdadm --assemble /dev/md0 /dev/sda1 /dev/sdb1
Add the new device the array:
# mdadm --add /dev/md0 /dev/sdc1
This should not take long for mdadm to do. Again, check the progress with:
# cat /proc/mdstat
Check that the device has been added with the command:
# mdadm --misc --detail /dev/md0
For RAID0 Arrays
If you get an error like:
mdadm: add new device failed for /dev/sdc1 as 2: Invalid argument
It may be because you're using RAID0. The command above will add the new disk as a "spare", but RAID0 doesn't have spares. If you want to add a device to a RAID0 array, you need to "grow" and "add" in the same command:
# mdadm --grow /dev/md0 --raid-devices=3 --add /dev/sdc1
Change sync speed limits
Syncing can take a while. If the machine is not needed for other tasks the speed limit can be increased.
# cat /proc/mdstat
Personalities : [raid1] md0 : active raid1 sda3[2] sdb3[1] 155042219 blocks super 1.2 [2/1] [_U] [>....................] recovery = 0.0% (77696/155042219) finish=265.8min speed=9712K/sec unused devices: <none>
Check the current speed limit.
# cat /proc/sys/dev/raid/speed_limit_min
# cat /proc/sys/dev/raid/speed_limit_max
Increase the limits.
# echo 400000 >/proc/sys/dev/raid/speed_limit_min # echo 400000 >/proc/sys/dev/raid/speed_limit_max
Then check out the syncing speed and estimated finish time.
# cat /proc/mdstat
Personalities : [raid1] md0 : active raid1 sda3[2] sdb3[1] 155042219 blocks super 1.2 [2/1] [_U] [>....................] recovery = 1.3% (2136640/155042219) finish=158.2min speed=16102K/sec unused devices: <none>
See also sysctl#MDADM.
A simple one-liner that prints out the status of the RAID devices:
awk '/^md/ {printf "%s: ", $1}; /blocks/ {print $NF}' </proc/mdstat
md1: [UU] md0: [UU]
Watch mdstat
watch -t 'cat /proc/mdstat'
Or preferably using tmux
tmux split-window -l 12 "watch -t 'cat /proc/mdstat'"
Track IO with iotop
The iotop package displays the input/output stats for processes. Use this command to view the IO for raid threads.
iotop -a -p $(sed 's, , -p ,g' <<<`pgrep "_raid|_resync|jbd2"`)
Track IO with iostat
The iostat utility from sysstat package displays the input/output statistics for devices and partitions.
iostat -dmy 1 /dev/md0 iostat -dmy 1 # all
Mailing on events
A smtp mail server (sendmail) or at least an email forwarder (ssmtp/msmtp) is required to accomplish this. Perhaps the most simplistic solution is to use dmaAUR which is very tiny (installs to 0.08 MiB) and requires no setup.
/etc/mdadm.conf defining the email address to which notifications will be received.
To test the configuration:
# mdadm --monitor --scan --oneshot --test
mdadm includes a systemd service (mdmonitor.service) to perform the monitoring task, so at this point, you have nothing left to do. If you do not set a mail address in
/etc/mdadm.conf, that service will fail. If you do not want to receive mail on mdadm events, the failure can be ignored; if you don't want notifications and are sensitive about failure messages, you can mask the unit.
Alternative method
To avoid the installation of a smtp mail server or an email forwarder you can use the S-nail tool (don't forget to setup) already on your system.
Create a file named
/etc/mdadm_warning.sh with:
#!/bin/bash event=$1 device=$2 echo " " | /usr/bin/mailx -s "$event on $device" firstname.lastname@example.com
And give it execution permissions
chmod +x /etc/mdadm_warning.sh
Then add this to the mdadm.conf
PROGRAM /etc/mdadm_warning.sh
To test and enable use the same as in the previous method.
If you are getting error when you reboot about "invalid raid superblock magic" and you have additional hard drives other than the ones you installed to, check that your hard drive order is correct. During installation, your RAID devices may be hdd, hde and hdf, but during boot they may be hda, hdb and hdc. Adjust your kernel line accordingly. This is what happened to me anyway.
Error: "kernel: ataX.00: revalidation failed"
If you suddenly (after reboot, changed BIOS settings) experience Error messages like:
Feb 9 08:15:46 hostserver kernel: ata8.00: revalidation failed (errno=-5)
Is doesn't necessarily mean that a drive is broken. You often find panic links on the web which go for the worst. In a word, No Panic. Maybe you just changed APIC or ACPI settings within your BIOS or Kernel parameters somehow. Change them back and you should be fine. Ordinarily, turning ACPI and/orACPI off should help.
Start arrays read-only
When an md array is started, the superblock will be written, and resync may begin. To start read-only set the kernel module
md_mod parameter
start_ro. When this is set, new arrays get an 'auto-ro' mode, which disables all internal io (superblock updates, resync, recovery) and is automatically switched to 'rw' when the first write request arrives.
mdadm --readonly before the first write request, or resync can be started without a write using
mdadm --readwrite.
To set the parameter at boot, add
md_mod.start_ro=1 to your kernel line.
Or set it at module load time from
/etc/modprobe.d/ file or from directly from
echo 1 > /sys/module/md_mod/parameters/start_ro
Recovering from a broken or missing drive in the raid
You might get the above mentioned error also when one of the drives breaks for whatever reason. In that case you will have to force the raid to still turn on even with one disk short. Type this (change where needed):
# mdadm --manage /dev/md0 --run
Now you should be able to mount it again with something like this (if you had it in fstab):
# mount /dev/md0
Now the raid should be working again and available to use, however with one disk short! So, to add that one disc partition it the way like described above in Prepare the device. Once that is done you can add the new disk to the raid by doing:
# mdadm --manage --add /dev/md0 /dev/sdd1
If you type:
# cat /proc/mdstat
you probably see that the raid is now active and rebuilding.
You also might want to update your configuration (see: #Update configuration file).
There are several tools for benchmarking a RAID. The most notable improvement is the speed increase when multiple threads are reading from the same RAID volume.
tiobenchAUR specifically benchmarks these performance improvements by measuring fully-threaded I/O on the disk.
bonnie++ tests database type access to one or more files, and creation, reading, and deleting of small files which can simulate the usage of programs such as Squid, INN, or Maildir format e-mail. The enclosed ZCAV program tests the performance of different zones of a hard drive without writing any data to the disk.
hdparm should NOT be used to benchmark a RAID, because it provides very inconsistent results.
See also
- Software RAID in the new Linux 2.4 kernel, Part 1 and Part 2 in the Gentoo Linux Docs
- Linux RAID wiki entry on The Linux Kernel Archives
- How Bitmaps Work
- Chapter 15: Redundant Array of Independent Disks (RAID) of Red Hat Enterprise Linux 6 Documentation
- Linux-RAID FAQ on the Linux Documentation Project
- Dell.com Raid Tutorial - Interactive Walkthrough of Raid
- BAARF including Why should I not use RAID 5? by Art S. Kagel
- Introduction to RAID, Nested-RAID: RAID-5 and RAID-6 Based Configurations, Intro to Nested-RAID: RAID-01 and RAID-10, and Nested-RAID: The Triple Lindy in Linux Magazine
- HowTo: Speed Up Linux Software Raid Building And Re-syncing
- RAID5-Server to hold all your data
Active bugs
- Debian mdadm FAQ
- mdadm source code
- Software RAID on Linux with mdadm in Linux Magazine
Forum threads
- Raid Performance Improvements with bitmaps
- GRUB and GRUB2
- Can't install grub2 on software RAID
- Use RAID metadata 1.2 in boot and root partition
RAID with encryption
- Linux/Fedora: Encrypt /home and swap over RAID with dm-crypt by Justin Wells


text:
Artshai.com Handcrafted Wonders
Be the first to review this product
Availability: In stock
Regular Price:
Rs 299
Special Price
Rs 190
Fast Delivery
Cash on Delivery(COD) available
Call us now at 9810610225 for more info about our products.International shipping Available
10 days easy return policy. .
Excellent finishing
Use spaces to separate tags. Use single quotes (') for phrases.
Artshai brand was made to solve the need of having quality handicraft products at reasonable prices
We make customized products for both home and Corporate need
Excellent Craftsmanship, Worldwide Shipping
Cash On Delivery(COD) & Free Shipping in India
Creative and Innovative Products
Super-fast Delivery. International shipping also available
Industry best Corporate Gifting
Call Us 09810610225

subset: commoncrawl


text:
Welcome to Mailbox Monday, a meme started by Marcia of A Girl and Her Books. The host for May's Mailbox Monday posts will be Martha at Martha's Bookshelf.
Mailbox Monday is a gathering place for readers to share the books that came into their house last week and explore great book blogs.
Warning: Mailbox Monday can lead to envy, toppling TBR piles and humongous wish lists.
Books that came in my mailbox this week:
The Pleasures of Men by Kate Williams from Hyperion
"Catherine Sorgeiul lives with her Uncle in a rambling house in London's East End. She has few companions and little to occupy the days beyond her own colourful imagination. But then a murderer strikes, ripping open the chests of young girls and stuffing hair into their mouths to resemble a beak, leading the press to christen him The Man of Crows. And as Catherine hungrily devours the news, she finds she can channel the voices of the dead … and comes to believe she will eventually channel The Man of Crows himself.
But the murders continue to panic the city and Catherine gradually realizes she is snared in a deadly trap, where nothing is as it first appears … and lurking behind the lies Catherine has been told are secrets more deadly and devastating than anything her imagination can conjure."
Granddad, There's a Head on the Beach by Colin Cotterill from St. Martin's Press (a win from ShelfAwareness)
Her heart is torn between two boys, the one she's always loved and the one who always ignored her. But when the kingdom threatens to tear itself apart due to rumors surrounding the queen's alleged affair, who will Lianne protect and who will she destroy?"
First is Eragon's oath to his cousin Roran: to help rescue Roran's beloved, Katrina, from King Galbatorix's clutches. But Eragon owes his loyalty to others, too. The Varden are in desperate need of his talents and strength—as are the elves and dwarves. When unrest claims the rebels and danger strikes from every corner, Eragon must make choices— choices that take him across the Empire and beyond, choices that may lead to unimagined sacrifice."


text:
KOffice Releases Ninth Alpha of KOffice 2.0
The KOffice team announces
Apart from much invisible, but very important work on improving core
KSpread has regained support for printing. It is possible to print
The Kexi report generator can now generate reports in html and ODS,
Vector layers in Krita can contain text and vector shapes. Editable,
The text shape object, which is the basis for KWord and provides
KOffice-wide, a new implementation of guides provides snapping to
The Google Summer of Code students have been hard at work: Lukas Tvrdy
But all KOffice developers have been working really hard
For more screenshots, please visit our visual
The KOffice team intends to continue delivering montly
The more I look at Koffice 2.0, the more I like it.
By Iuri Fiedoruk at Fri, 2008/07/18 - 5:00am
Re: Nice
Cheers to all KOffice devel & kde community :)
By Shuss at Fri, 2008/07/18 - 5:00am
Re: Nice
the more I look at it, try it, and experience openoffice, the more I am convinced that there will never really be a replacement for microsoft office,
By anon at Sat, 2008/07/19 - 5:00am
Re: Nice
Yes, and a hand-full of developers will never really be a replacement for hundreds or thousands of developers. Yet, it is astonishing to see what KOffice devs achieve, and what they do to reinvent office suite interfaces.
By Stefan Majewsky at Sat, 2008/07/19 - 5:00am
Re: Nice
Well it can't really be a replacement for MS Office because numerous (thousands?) third-party extensions (with Macros and VB-scripts and whatever else) exist for MS Office which try to blow MS Office up to a full ERP-app, a report generator or whatever else.
Possibly it's not even needed as the big flood of MS Office extensions seems to be over anyway (with 75% of the old macros becoming now defunct on new MS Office releases and no one is taking the burdon to port old VB-Macros...most of them are ugly hacks anyway).
As most of the old MS Office Macros got used inhouse at e.g. administration offices and are going to be replaced with cleaner intranet-solutions over time the focus is shifting away from one office-suite-that-wants-to-be-everything to more lightweight solutions. KOffice might come in handy than ;-).. At least for me, it would be the ideal solution.
By thomas at Sat, 2008/07/19 - 5:00am
Which ODF version
Which ODF version is targeted for KOffice 2.0? Is it 1.1 (OOo 2.x) or is KOffice alreading heading for ODF 1.2 (OOo 3)?
By birdy at Fri, 2008/07/18 - 5:00am
Re: Which ODF version
1.2. Actually, we're driving some of the innovations there.
By Boudewijn Rempt at Fri, 2008/07/18 - 5:00am
Re: Which ODF version
Yes, especially since 1.2 brings many improvements on clarity of the spec for better interoperrability. That said, all of ODF 1.2 (or 1.1) won't be covered by KOffice, since only of the subset of the features are supported.
By Cyrille Berger at Fri, 2008/07/18 - 5:00am
Re: Which ODF version
> all of ODF 1.2 (or 1.1) won't be covered by KOffice, since only of the subset of the features are supported
Do you mean KOffice 2.0 by that? I wonder why one should not aim to support the spec totally.
By Stefan Majewsky at Sat, 2008/07/19 - 5:00am
Re: Which ODF version
Part of it is a 2.0 thing -- text tables, for instance, are unlikely to be in 2.0. Part of it is a platform thing: OLE objects, DDE or embedded Java applets are unlikely to ever get in. And part of it is the sheer task of implementing the references standards, like SMIL.
By Boudewijn Rempt at Sat, 2008/07/19 - 5:00am
Thank you
You are doing a great job. Thank you so much.
By kdeuser at Sat, 2008/07/19 - 5:00am
Huge congratulation.
It is so very important that we have a contender that can match with open office.
OpenOffice has numerous small user interface problems, and I just feel that KOffice is more likely to listen to users than OpenOffice ever will (plus, OpenOffice feels rather sluggish)
By markus at Sat, 2008/07/19 - 5:00am
Save as ...
Is there going to be a 'Save as (.doc, .xls, ...)' option? If KOffice allows saving as MS Office formats, it will accelerate its use in office environments where OO.o is being used today.
By Kanwar at Sat, 2008/07/19 - 5:00am
Re: Save as ...
KWord already has a save as .doc option. Of course, what it does is save in the rtf format, but that's okay -- Microsoft seems to do the same when word saves for a different word version. As for KSpread and compatibility with the excel file format, probably not, unless someone steps up and starts coding.
By Boudewijn Rempt at Sat, 2008/07/19 - 5:00am
I'm really looking forward to Koffice2. Congrats to the many talented developers on their progress. And, thanks!
By T at Sat, 2008/07/19 - 5:00am
So, is it going to be use more than Koffice 1.x ?
I've on ocasion used Kword 1.x mainly to print images and acompagnied text with it. It was not the purpose but it dit it well.
By Jand at Sat, 2008/07/19 - 5:00am
Re: So, is it going to be use more than Koffice 1.x ?
I'm assuming you are only half-informed about the status of Koffice apps. I for one would say Krita is a lovely comprehensive app. Kpresenter is also really nice and Kexi is showing a lot of promise. Kspread may not be in an ideal state and kword surely lacks behind atm (but is shaping up pretty nicely). I strongly encourage you to dig a bit deeper before posting in a diffuse way. In fact it's a far way from 1.x to Koffice 2, so many things have changed under the hood. And btw.... I think, there is no "leaderhip" - whatever you might have in mind; there is no such thing I assume.
By thomas at Sat, 2008/07/19 - 5:00am
Re: So, is it going to be use more than Koffice 1.x ?
You know, that's the beautiful thing about having choices. You are free to use what works for you. It's obvious from your post that KOffice doesn't work for you. So be it. By all means don't use it, because calling other people's work crap (and a waste of time as well) accomplishes nothing. On second thought, it does make you seem like an ungrateful brat. I for one am pulling for KOffice. I will try to use it when 2.0 is released. If it works for me, great. If not, I will use something else. Even then though, I will continue to support and encourage the developers. And as soon as it works for me I will use it full time. Keep up the good work KOffice team.
By cirehawk at Sat, 2008/07/19 - 5:00am
Re: So, is it going to be use more than Koffice 1.x ?
KOffice 2.0 has undergone some major refactorings, so in final 2.0 release, it might not have all intended features and still have tons of bugs (or if you prefer to call it... crap?). But the most important thing is, the framework is now ready to take us to the future (2.1 and beyond), so that it will be easier to add further cool new features. I guess you have to do more homework to know what are the cool new technologies behind KOffice ;-).
I think I've heard that KOffice 1.x was already stuck with few things that are hard to improve due to the old framework and the old Qt 3 (notably the text rendering)
By fred at Sun, 2008/07/20 - 5:00am
Simultaneous collaboration, like Abiword?
What's the status of the collaboration feature (listed as "Nice to Have" on the roadmap) with regard to KOffice 2.0?
By D R Evans at Sat, 2008/07/19 - 5:00am
Re: Simultaneous collaboration, like Abiword?
It still would be nice to have :-). At last year's summer of code, we had a student interested in implementing it, but he never produced any code. And right now, everyone is pulling to get KOffice release-ready, so it's extremely unlikely this feature will be in 2.0.
By boudewijn at Sun, 2008/07/20 - 5:00am
Effects for Kword :-)
Exelent work guys! You are doing such great office tool for normal user. It might not beat the Microsoft Office because for it has great amount of plugins / scripts etc... but for normal user, student and writer, Koffice is already enough.
We need to go step by step until we can get bigger user base from windows / Mac OS X side too. First we need to get 2.0 and then 2.1 (you know it ;-)) when more people starts to use it, it will get attension what it reserves and get more coders!
I'm waiting 2.0 but what I'm still waiting, is this kind "eye candy" in future versions (sooner than later please ;-)), to give better usability to see the sheets difference itself. Do not mistake the "fit the page" zoom slider, it should be then without effects but when effects ON, it would be need to have such amount of space :-)
/me is going to install 2.0 final when it hits out....
By Fri13 at Mon, 2008/07/21 - 5:00am
Re: Effects for Kword :-)
Ah, forgot to ask, is there coming fix for the "kword" panel on left side?
By Fri13 at Mon, 2008/07/21 - 5:00am
Re: Effects for Kword :-)
Yes, a preliminary fix for that is already in alpha9.
By Boudewijn Rempt at Mon, 2008/07/21 - 5:00am
Re: Effects for Kword :-)
preliminary fix? I fixed all those issues in SVN and got nobody bringing up any issues.
By Thomas Zander at Tue, 2008/07/22 - 5:00am
Integrated Apps
One feature of OpenOffice i really like, is the ability to open another document type e.g. spreadsheet, from Writer and visa versa. Does 2.0 allow you to do this, if not, are there any plans to do so?
By Ian at Mon, 2008/07/21 - 5:00am
What's that theme?
What theme is being used in Krita? It looks much better and more usable than my default Oxygen. Is is an update of Oxygen or a modification?
By My Themey at Mon, 2008/07/21 - 5:00am
Re: What's that theme?
Nope -- just bog-standard KDE 4.1rc1 Oxygen. I did make the fonts smaller and tweaked the colors and contrast a little. I still it's a pity I cannot make the scrollbars emerald green anymore -- but all in all, I like Oxygen very, very much.
By Boudewijn Rempt at Mon, 2008/07/21 - 5:00am


text:
254 members62 Comments 10 Likes
60 members620 Comments 15 Likes
Greg Varlotta has not received any gifts yet
Welcome, Greg! Glad you could join us. :D
Please consider joining a group to meet people and talk about anything that's on your mind, Hang With Friends. You might also like Atheist Musicians. After you've searched for topics of interest in "Groups" above and in the "Forums", don't forget to look at recent activity which hides along the right margin of the page all the way at the bottom.
Hello Greg
Welcome to this world of rationality, truth and peace, where common sense and science lead to freethinking wisdom --- as you know as an atheist and freethinker like me.
We invite you to make good friends by joining the busy group "ORIGINS: Universe, Astronomy, Life, Earth, Humans, Religion, Gods, Atheism, Evolution, Darwin..." with 700 discussion topics and 3500 members.
Welcome, Greg. You are much more patient than I am.
By the way, I will be speaking in Tuscon, Arizona in November on Sex and God and maybe some other cities.
Greg, thank you for your kind words. Very glad you are finding it enjoyable and affirming. I really appreciate you letting me know. If you have an Amazon account or are on Goodreads, I would love it if you would write a review. Small presses do not have large publicity budgets, so we rely on word of mouth. A few sentences is all that is needed. Let me know what you think when you are finished. The last five chapters are the whole reason I wrote the book.
© 2020 Atheist Nexus. All rights reserved. Admin: The Nexus Group. Powered by


text:
National ShamrockFest 2013
SF Mgmt
Saturday, March 16, 2013 from 1:00 PM to 9:00 PM (EDT)
National ShamrockFest 2013
Ranked "#3 Saint Paddy's festival in US" by Beer Taste Mag
MAIN EVENT TICKET vs. VIP TICKET:
Main Event Ticket - Amenities:
VIP Ticket - Amenities:
It's all about the experience...
The National ShamrockFest is the largest Saint Paddy's festival in the Mid-Atlantic Region, featuring more than 40 amazing bands and DJ's on NINE stages, beer stations as long as two football fields, food, drink & craft markets, rides, activities, strolling entertainers and endless party zones. You really have to see it to believe it..
To stay informed about the ShamrockFest
and other great events we welcome you to join our email list. (click here)
Get ready for the most exciting festival on the East Coast. Munich has Oktoberfest, Tennessee has Bonnaroo, New Orleans has Mardi Gras, Brazil has Carnival…and now ShamrockFest, which rocks the Nation's Capital, has joined the party elite. After twelve years of extraordinary growth, the 13th annual ShamrockFest has now graduated to an entirely new level AGAIN. Taking place at a massive, spectacularly-crafted festival grounds, with a multitude of entertainment areas, dozens of incredible performers, and much more, the National ShamrockFest is now recognized as one of America's premier festivals. So get your green on and get ready to party like never before – at SHAMROCKFEST `13!! *Information subject to change at any time without any notice. Please check back frequently for updates.
This is the official ticket-selling web site for National ShamrockFest. If you purchase from another source, you risk purchasing a counterfeit or invalid ticket. ShamrockFest is not responsible for tickets purchased from unoffical sources.
GoCity Events and Shamrock Festival Management have 35+ years of experience producing and managing thousands of events coast-to-coast... including the most popular bar crawls, largest New Years Eve series in the country, the most popular holiday events in the nation's capital, multiple Presidential Inaugural balls, and of course the one-and-only National ShamrockFest.
In order to purchase these tickets in installments, you'll need an Eventbrite account. Log in or sign up for a free account to continue.


text:
I`m beautiful in my way,cause God makes no misstakes. I was born this way.I was born to be brave:)
I am very cheerful, cheerful and energetic, always in a good mood and always ready to pick it up to you. And not only the mood)
Funny and generous guys, i love flirting and i love the men with sence of humor and a big heart who know how treat a lady
I not like rude, not polite, free lovers


text:
|the Fourth Avenue Cafe
Release Date: 2006.08.30
Peak Position: #5
Label: Kioon/SONY RECORDS
Product Code: KSCL-1027
First Press: Picture-labeled disc
On August 30th, L'Arc~en~Ciel had finally released a new single. Yet, unlike most other singles, fans weren't wondering how it would sound or what the lyrics would be about. They weren't waiting for the PV to air. Instead, they were rejoicing that the single had been released at all. "the Fourth Avenue Cafe" is their most legendary single that was never released, and precisely for that reason.


text:
Looking for more on what's hot with Technorati? They now have a Technorati Daily Vlog:
The Daily Vlog is really our view of what's hot on the World LIVE Web each day, bringing you not only the headlines but a little of the context behind the headlines.
We'll highlight the hot blogs, videos, photos, and games created by people just like you. We'll also show you what movies, books and news of the day blogosphere is abuzz about at any given moment in time. Of course, you can find everything we chat about on Technorati.com. One disclaimer: this is our first and we think that over time, our Daily Vlog will get better and better, so we'd love your feedback about how we can do that. In the meantime, check back each day and get our take on what's hot and what's not. Have fun on the Web today!
Vlogs, once called vblogs or video blogs, are the hottest thing in the Blogosphere. Instead of writing, make your own blog-style television show.
I'll be looking more into vlogs, so stay tuned!
Site Search Tags: vlogs, video, video blogs, vblogs, vblogging, technorati, technorati video, technorati vlog
Copyright Lorelle VanFossen, member of the 9Rules Network


text:
By Marcia Dunn, The Associated Press May 31, 2017 5:56 PM
StoryPhotos ( 1 )
In this Sept. 23, 2014 photo made available by NASA, the SpaceX Dragon commercial cargo craft approaches the International Space Station. On a June 2017 supply run to the station, SpaceX will use this capsule. The milestone comes just two months after the launch of its first reused rocket booster. (NASA via AP)
CAPE CANAVERAL, Fla. в─" SpaceX is taking recycling to a whole new realm в─" all the way to orbit.
By Jesse Emspak, Space.com Contributor | May 31, 2017 04:15pm ET
Credit: agsandrew/Shutterstock.com
A new study may help reveal the nature of dark energy, the mysterious substance that is pushing the universe to expand outward. Dark energy may emerge from fluctuations in the nothingness of empty space, a new hypothesis suggests.
By Kacey Deamer, Live Science Staff Writer | May 31, 2017 04:10pm ET
Times Square will also act as a hub for the festival's events this year, with a program of free activities called "Science in the Square" that will bring science topics to a broad general audience. Credit: World Science Festival
This week, scientists, thinkers, artists and others will convene in New York City for the 10th annual World Science Festival, but even if you can't make it to the Big Apple, you can catch some of the action live online.
By Tariq Malik, Space.com Managing Editor | May 31, 2017 07:40pm ET
Billionaire Paul Allen's private spaceflight company Stratolaunch has just unveiled the world's biggest airplane: a massive carrier plane with a wingspan longer than an entire football field.
The colossal Stratolaunch carrier plane rolled out of its hangar at the Mojave Air and Space Port in Mojave, California, today (May 31) to undergo
fueling tests. It's the first public look at the full craft -which is designed to launch rockets into orbit from the sky - since construction began.
By Mike Wall, Space.com Senior Writer | May 31, 2017 03:29pm ET
SpaceX founder and CEO Elon Musk, left, attending a Jan. 23 meeting with President Donald Trump. Credit: White House
SpaceX founder and CEO Elon Musk said today (May 31) that he'll resign from the White House advisory councils on which he currently serves if President Donald Trump pulls the United States out of the Paris climate pact.
Genelle Weule
It's been on NASA's bucket list for 60 years, and now the ambitious mission to touch the Sun is in its final phase before launch.
The Parker Solar Probe will get closer to the Sun than any spacecraft in history. (Credit: ABC licensed)
We've been to the Moon, landed spacecraft on Mars and had close encounters with other planets в─" and Pluto. Next stop, the Sun.
A "FORMER pilot" for John F Kennedy has been filmed saying the assassinated president had seen government evidence of aliens and UFOs.
By Jon Austin Jon Austin
The man, who features in new documentary 'Unacknowledged' is seen speaking to camera about a conversation with the president.
He described the pair discussing a newspaper article that mentioned UFOs.
The man, who is not named in the clip from the documentary, says the
president asked him what he thought, so he threw the question back at JFK.
He said: "JFK responded, 'well I asked you first'."
By Marcia Dunn, The Associated Press May 31, 2017 11:21 AM
StoryPhotos ( 2 )
NASA's Solar Probe Plus spacecraft approaching the sun.
CAPE CANAVERAL, Fla. в─" A NASA spacecraft will aim straight for the sun next year.
The space agency announced the red-hot mission Wednesday at the University of Chicago.
By Hanneke Weitering, Staff Writer-Producer | May 31, 2017 11:19am ET
Image data from NASA's Cassini spacecraft shows evidence that Saturn's moon Enceladus may have tipped over, reorienting itself so that terrain closer to its original equator was relocated to the poles. This phenomenon is called "true polar wander." Credit: NASA/JPL-Caltech/Space Science Institute/Cornell University
Enceladus, an icy moon of Saturn that could host life, may have tipped over long ago.
NASA is poised to hold a press conference where it will announce a groundbreaking mission to send a probe to the sun and you can watch it live.
By Sean Martin
The space agency will broadcast a live stream of the major announcement, which you can watch live on Express.co.uk, courtesy of NASA TV from 4PM BST (10am CDT).
NASA hopes to get a probe as close as possible to the sun where it will battle extreme temperatures and radiation.
©2011-2013 Life in space


text:
Dan Forbes
- Yield
- Makes 9 to 12 servings
- Active Time
- 45 minutes
- Total Time
- 2 hours (includes cooling time)
- Toffee sauce:
- 1 1/4 cups plus 3 tablespoons (or more) heavy whipping cream
- 1/2 cup (packed) golden brown sugar
- 1/2 cup dark corn syrup
- 1/4 cup (1/2 stick) unsalted butter
- Banana cake:
- 2 cups unbleached all purpose flour
- 1 1/2 teaspoons baking powder
- 3/4 cup (1 1/2 sticks) unsalted butter, room temperature
- 2/3 cup (packed) dark brown sugar
- 2 large eggs
- 1 cup mashed very ripe bananas (2 to 3)
- 1 tablespoon dark rum
- 1 1/2 teaspoons vanilla extract
- Sliced bananas (optional)
- Special Equipment
- 8 x 8 x 2-inch nonstick metal baking pan
- For toffee sauce:
- Bring 1 1/4 cups cream, brown sugar, corn syrup, butter, and 1/8 teaspoon salt to boil in heavy small saucepan over medium heat, whisking until sugar dissolves. Reduce heat to medium-low and cook at gentle boil until sauce coats spoon thickly and is reduced to 11/2 cups, whisking occasionally, about 15 minutes. Remove from heat and cool. Whisk in 3 tablespoons or more cream to thin sauce to desired consistency. DO AHEAD: can be made 2 days ahead. Cover and chill. Rewarm slightly before using.
- For banana cake:
- Preheat oven to 350°F. Butter 8 x 8 x 2-inch nonstick metal baking pan. Dust baking pan with flour, tapping out excess.
- Whisk flour, baking powder, and 1/2 teaspoon salt in medium bowl. Using electric mixer, beat butter and sugar in large bowl until well blended. Beat in eggs 1 at a time. Beat in mashed bananas, rum, and vanilla (batter may look curdled). Add dry ingredients in 4 additions, beating just to blend after each addition. Spread batter evenly in prepared baking pan.
- Bake cake until tester inserted into center comes out clean, 35 to 38 minutes. Spread 1/2 cup toffee sauce evenly over cake. Return cake to oven and bake until sauce is bubbling thickly, about 6 minutes. Cool cake in pan on rack 30 minutes. Cut around cake in pan. Cut cake into 9 squares or 12 rectangles. Serve cake slightly warm or at room temperature with toffee sauce and top with sliced bananas, if desired.
Related Video
Nutritional Info
- Calories463
- Carbohydrates53 g(18%)
- Fat27 g(41%)
- Protein4 g(8%)
- Saturated Fat17 g(83%)
- Sodium98 mg(4%)
- Polyunsaturated Fat1 g
- Fiber1 g(4%)
- Monounsaturated Fat7 g
- Cholesterol111 mg(37%)


text:
At this site we maintain a list of the 5000 Largest Known Primes which is updated hourly. This list is the most important databases at The Prime Pages: a collection of research, records and results all about prime numbers. This page summarizes our information about one of these primes.
field (help)value
Description:3015281006097 · 21290000 - 1
Verification status (*):Proven
Official Comment:
Proof-code(s): (*):L4458 : Daly, TwinGen, PrimeGrid, LLR
Decimal Digits:388342 (log10 is 388341.173734328)
Rank (*):8605 (digit rank is 593)
Entrance Rank (*):4223
Currently on list? (*):no
Submitted:9/30/2016 10:32:17 CDT
Last modified:9/30/2016 11:20:41 CDT
Removed (*):3/9/2017 13:41:43 CDT
Database id:122278
Status Flags:TrialDiv
Score (*):43.7286 (normalized score 0.635)
The Top 5000 Primes is a list for proven primes only. In order to maintain the
integrity of this list, we seek to verify the primality of all submissions.
We are currently unable to check all proofs (ECPP, KP, ...), but we will at least trial
divide and PRP
check every entry before it is included in the list.
machineUsing: Xeon (pool) 4c+4c 3.5GHz
notesCommand: /home/caldwell/clientpool/1/pfgw64 -tp -q"3015281006097*2^1290000-1" 2>&1PFGW Version 126.96.36.199BIT.20130722.x86_Dev [GWNUM 27.11]Primality testing 3015281006097*2^1290000-1 [N+1, Brillhart-Lehmer-Selfridge]Running N+1 test using discriminant 7, base 1+sqrt(7)Calling Brillhart-Lehmer-Selfridge with factored part 100.00% 3015281006097*2^1290000-1 is prime! (2730.6201s+0.0007s)[Elapsed time: 45.52 minutes]
modified2017-01-27 05:57:11
created2016-09-30 10:33:01


text: What to Wear at a Christening in 1901Harry McLaughlin, who has kindly shared this photograph from his Family Photograph Album, explains that "this group portrait was made in 1901 at the christening of Rosemary McLaughlin, who is in the centre on her mother Blanche's lap." For additional information readers should visit his site. Note the variety in men's jackets. Note, too, the elaborate clothing of the women in this prosperous family. [GPL]


text:
breakfast, chia seeds, chocolate gingerbread chia pudding, raw cacao powder, snack, the raw food world
I had been making Pumpkin Pie Chia Pudding this fall (to follow the Chia Hemp Breakfast Pudding I made this summer), but as we approached Christmas I wanted something with slightly different spices. I finally put my thoughts together on how this recipe should work and made this pudding last night for this morning's breakfast – yes, a little late for Christmas, but so delicious.
It was so easy, took under five minutes to make, and tastes rich and delicious. I think this version is full-bodied and the creamiest I have made!
Special thanks to Frugal Babe and Kristen's Raw who shared their great buys from The Raw Food World (they have a special running now – 18% off food using coupon code HOLIDAY18). I joined the fun and bought a 5lb bag of chia seeds (and lots of other raw goodies!).
Chocolate Gingerbread Chia Pudding (Dairy-Free)
- 3/4 cup almond milk
- 1/2 cup coconut yogurt
- 2T chia seeds
- 2T maple syrup (sweeten to taste)
- 2T raw cacao powder
- 1/4 tsp cinnamon*
- 1/4 tsp ground ginger*
Add all ingredients to bowl and wisk well. (I add all my ingredients to a medium sized glass Pyrex container (with lid), wisk in the container, and refrigerate.)
Refrigerate overnight for best results.
*Add more to your liking
As you can see, we LOVE chia puddings. Have you used chia before? What is your favorite way to use them?
Happy New Year!


text:
Hope College is anticipating that a record number of graduating seniors will cross the Commencement stage on Sunday, May 8.
The approximately 745 seniors surpass the previous high of 718 in 2007. The figures reflect that the Classes of 2007 and 2011 were also the largest incoming classes in the fall of 2003 and fall of 2007 respectively.
The college's 146th Commencement will be held at 3 p.m. at Holland Municipal Stadium. Baccalaureate will be held earlier in the day, at 9:30 a.m. and 11:30 a.m. in Dimnent Memorial Chapel.
The Commencement speaker will be Dr. Jesus Montaño, associate professor of English at Hope. The Baccalaureate sermon will be delivered by the Rev. Dr. Blaine Newhouse, currently pastor of preaching and leadership with Calvary Reformed Church in Holland and newly appointed executive director of Geneva Camp and Retreat Center.
Montaño joined the Hope faculty in 1999 as an assistant professor, and was promoted to associate professor in 2004. The graduating class presented him with the "Hope Outstanding Professor Educator" (H.O.P.E.) Award in 2010.
His primary academic interests are Latina/o literature and Medieval English literature, and he has written and delivered invited addresses in both fields. In 2002 he received a Sluyter Fellowship from Hope to explore the literary and cultural issues of the border lands, through a focus on Mexican American literature for children and young adults.
Montaño's work resonates with students, and his courses are always packed. When the college's Cultural Heritage course requirements were adjusted to include more cultural traditions, he introduced a new course that explored the cultural encounters of Native Americans, the Spanish colonies, and Northern European settlers in the American Southwest. Through his course "Routes and Roots," part of the capstone Senior Seminar program through which graduating seniors articulate their life view, he encourages students to understand that even though their point of origin may be known (their roots), their journey is on-going and their destination unknown. His attention to gender-specific learning styles also marks his awareness of student needs, and he has incorporated new types of writing assignments, research opportunities and presentation methods in his classes.
Montaño has also developed new research and artistic inquiries in recent years. He is an accomplished photographer, using his camera to document his frequent road trips to the West and Southwest. He follows the linguistic and artistic migration of words and symbols of Mexican Americans as they travel across the North American landscape. During a recent Critical Issues Symposium on Immigration, Montaño offered a lecture about his own immigrant experience, illustrated with his photographs. Student and faculty interest in the presentation was so great that it had to be moved to a larger room so that more than 300 people could witness his work and hear his stories.
Montaño graduated from the University of Texas at Austin with a Bachelor of Arts degree in English in 1991, and from The Ohio State University with a Master of Arts and a doctorate in English in 1996 and 1999 respectively.
Newhouse, who is a 1986 Hope graduate, will begin serving as executive director of the Geneva Camp and Retreat Center at the beginning of May. Dedicated in the summer of 1948 through the vision of Reformed Church in America pastors and lay leaders for a place for Christ-centered summer programs for youth, the center now hosts up to 4,000 children and youth in its summer programs as well as more than 12,000 adult retreat guests annually.
He is concluding a tenure with Calvary Reformed that began in 1995. During his service, the church has emphasized outreach to the community. Among other initiatives, Calvary Reformed has partnered with two other churches in "Heights of Hope," a Christian community development partnership that focuses on empowering the neighborhood's residents to make social, physical and spiritual life change; established Blacktop Rec., a recreational ministry for neighborhood K-5 grade children; and developed a community vegetable garden on the front lawn that also serves as a neighborly meeting place.
His on-going community involvement also includes serving as a mentor through Kids Hope and for at-risk youth in HollandHeights, and as a member of the spiritual care advisory board of HollandHospital. Among other activities, in May 2010 he was a moderator during the Lakeshore Summit on Racism.
Prior to coming to Calvary Reformed Church, he was with Forest Grove Reformed Church in Hudsonville, serving as director of Christian education and youth from 1986 to 1991 and as co-pastor from 1991 to 1995.
Newhouse has held leadership roles in the Reformed Church in America as well. He was vice president and president of the Synod of the Great Lakes in 2006 and 2007 respectively. From 2000 to 2009 he chaired the denomination's Multiracial Congregational Team, and from 2001 to 2008 he chaired the Holland Classis's Student Support and Supervision Committee. Since 1994, he has also served as a teaching church mentor for Western Theological Seminary.
Newhouse majored in religion at Hope, where his co-curricular activities included serving as president of the college's chapter of Fellowship of Christian Athletes and captaining the football and wrestling teams. He completed his M.Div. at Western Theological Seminary in 1991, and his D.Min. at the seminary in 2006.
In the event of rain, Commencement will be held at the Richard and Helen DeVos Fieldhouse. Admission to Baccalaureate, and to Commencement if indoors, is by ticket only.


text:
The Damned Things - Move Out (feat. Freeway) lyrics
Move Out (feat. Freeway) by The Damned Things
f/ Freeway
[Verse 1 - Red Cafe]
GUESS who stepped in the motha fuckin door!
Who? R.C. I break laws and make laws
You do WHAT? Break jaws and take yours
I got heart that somethin y'all couldn't pay for
Got paper, money forever green
Glock .20 spittin a hundred and seventeen
Who gonna stop money, the homies forever scream
Never gonna happen, all go out clappin
Ay yo, R-Dot sling hard rock yay yo
I'm bout payroll
Hoes, love them niggas that game tight
Trust me, I'm gon' be drillin the same night
that I peeps her, R play with more keys than Alicia
With the poppies I got credit like Visa
I breathe ether, make you fools believers
R Dot Brooklyn bangin a team leader
[Red Cafe]
Y'all niggas industry, my niggas in these streets
We get money endlessly
Bitch niggas don't blend with me
Real niggas move in with me
Now move out
[Red Cafe & Freeway]
Y'all niggas industry, my niggas in these streets
We get money endlessly
Bitch niggas don't blend with me
Real niggas move in with me
Now move out
[Verse 2 - Freeway]
Guess who STEPPED in this mother fucka
Need no intro, entro TECHS in the mother fucka
Free-way, your man and his gat
I cock slugs back rip through your vest
The block run that handle the glock
and die one day pray with the Lord
Scream gun play but run to the cops
When I'm in the room your bitch cater to boss
Rap Prince Nasir slip hook and a block
You wanna BET my team flow better than y'all
Ghetto nigga get head in a drought
Free a Smith & Wesson metal nigga throw lead at your pops
Plus y'all niggas industy
My niggas in the streets
We dump heat, circle the block
Let the mack squirt on whoever act first
Let your Ac hurt, truck in the shop
Listen y'all niggas into rap and don't get interviews
[Verse 3 - Red Cafe]
This the block where niggas run lights
Every night, gun fights
Niggas scream fuck the cops, you better come right
Crack is slung, coke is snorted
And everybody know everybody and they support it
Streets is infested, I can't lie
I'm in the street well invested, nothin I can't buy
And I mean nothin, I can buy your life
Nigga you ain't nothin, go ahead sip somethin
You little punk don't tempt me
I made sure I left my car trunk empty
Just so you know I'm only here to claim the king of the throne
Whether it takes a mic fight or swingin the chrome
I need it, and I'ma bring it till its brought, believe it
Plus I know you ain't got no iron cause you anemic
Hold up, I don't think you heard me
You ain't got no iron cause you anemic
[Outro - Red Cafe]
I gave everybody ample opportunity to get money with me
Now you gonna watch me eat from the sidelines nigga
Lets do it
A-Z Lyrics Universe
Follow us
Lyrics / song texts are property and copyright of their owners and provided for educational purposes.


text:
I've been trying to get Project 20207 working with Deus Ex. Nameless mod? no problem. Redsun2020, fine, but this? no.
I used a clean unmodded copy of Deus Ex, updated it to 1.112fm, then installed microsoft's . framework 3.5 and make sure my Direct X was at 9.0
clicked on play, waited, then "we're sorry, 2027 has experienced a serious error and shut down. I've even tried using Deus Exe, which if you haven't used it, it's great (at least I think so)....so I got to the title screen-2027 in blue numbers and.....that's it....no menu, nothing.
What fllavor of Windows do I need to run this? I was using Windows XP
John B


text:
ECONOMIC OUTLOOK FOR THE. EURO AREA IN 2016 and 2017. Autumn 2016. 1. European Economic and Monetary Union.
London's Economic Outlook: Autumn 2016 GLA Economics Autumn 2016 forecast and consensus calculated referendum on 23 June 2016 to leave the European.
As the UK begins the formal process of exiting the European an autumn Budget. Economic of GDP in 2021 to be broadly the same as it forecast at Autumn
Download European Economic Forecast Autumn 2016 PDF Search Result for european economic forecast autumn 2016 (March 2017) PE 574. 416 2 1. Latest economic.
EUROPEAN COMMISSION published European Economic Forecast and has only been derived for the purpose of this exercise. It Autumn 2015 forecast highlights Economics for business UK Economic Forecast Issue 70 Autumn 2014 EY ITEM Club EY solely sponsors the ITEM Club as part of its until 2017. Subdued consumer. European economic forecast: Growth should pickup further to 1. 9 in 2017 but the Commission concluded that based on the Commission 2013 autumn forecast. European Economic Forecast Autumn economic forecast. Commission forecasts 2017 euro area growth of related to the Autumn 2016 economic forecast.
Nov 05, 2015European Economic Forecast, Winter 2017, EC. European Economic Forecast, Autumn 2016, EC. Friday, PDF. SEE ARCHIVE. Mar 25, 2015Forecasts; Economic Activity; Total Debt; Other Indicators; Dont Miss. SEE ALL. European Economic Forecast, Winter 2017, EC. European Economic Forecast. Council of experts Economic Forecast 2017 and 2018 0317 1. 3 1. 4 1. 6 EU European Commission Research Institutes Joint Economic Forecast Autumn 2016 0916 1. 4 the European economic recovery is expected to continue this year and next: PDF; European Commission (Autumn Forecast: 2017.
was higher than expected in autumn. All falling over the forecast Forecast Winter 2017 Author: European Commission, Economic and Financial.
ECONOMIC GOVERNANCE the publisher is given prior notice and sent a copy. European Union, 2017 are from the European Economic Forecast Autumn 2016. largest economic sectors in Cyprus Forecast 1 Source: European Commission European Economic Forecast Autumn 2016 2015 2016 2017 2018 GDP growth (.
In its autumn forecast, the European Commission predicts EU GDP growth to be 1. 8 in 2016, 1. 6 in 2017 and 1. 8 in European Economic Forecast Autumn.
Source: European Commission, Autumn Economic Forecast, November 2016 201 7 (forecast) By end of 2017.


text:
1 dead, 1 critical after car strikes family
MILFORD -- Police announced that a 53-year-old Milford man died Tuesday from injuries that he received after being struck by a car on Monday along with three other pedestrians, all from Milford, on Bridgeport Avenue in the city's Devon section.
The man was identified as Kevin Tanski, 53. The tragedy occurred at 11 a.m.
Brenda Tanski, 51, remains in critical condition and Jenny Tanski, 21, was released from the hospital. The fourth individual did not require medical attention. It's believed that the family lives in Devon.
The operator of the vehicle was James Dorso, 31, of Milford, police said.
Kevin Tanski died at 3:50 p.m. Tuesday at Bridgeport Hospital. The four pedestrians were walking eastbound on the shoulder of Bridgeport Avenue. The car that struck them was also traveling eastbound.
Police said the accident occurred near the intersection of Cowles Street.
The department's Traffic Division is continuing with the investigation and is asking anyone with information to call 203-783-4749, or to send an email firstname.lastname@example.com.


text:
|This page refers to one of three police cars in GTA V known as the 'Police Cruiser'. Two other police cars exist and share the in-game name of "Police Cruiser, the Police Buffalo and Police Cruiser.
The Vapid Police Cruiser, commonly referred to by the community as the Interceptor, is a law enforcement sedan that appears in Grand Theft Auto V. It is one of the 3 types of police cruisers used by the LSPD (though easily the most frequently used) and as a result it can be found at police stations as well as being seen pursuing the player or NPCs. It also can be found patrolling some areas in Los Santos.
The car's design is clearly inspired by American styling featured on the Taurus-based Ford Police Interceptor sedan. The real life counterpart inspired its name in GTA V to distinguish it from the Stanier and Buffalo-based police cars that appear alongside it.
The front end of the car is dominated by the presence of a large push bar, with four lights in the top horizontal beam of the unit. The base of the front bumper is trimmed with a polymer. The lower central area of the bumper features a trapezium-shaped air duct and at either side, level with the top of the duct, there are LED strip lights. There is a main grille located in the central area at the top of the front face. Near to the grille there are headlamp units made up of two circular lamps and an amber turn indicator area on the outside. There are hideaway strobe lights mounted in the headlight assembly. The post mount spotlight comes on when you switch to its high beams.
The sides of the car feature the black and white color scheme, with the white area having police markings. The sides of the car are fairly simple with the body only featuring flared wheel arches. The doors feature black wing mirrors at the base of the A pillar, with a spotlamp mounted above the left one. The roof mounted light bar is split into eight sections, with the outer three on each side having either red or blue colored lamps. The central two are clear colored. The C pillar of the car is fairly smooth and at the top corners of the rear windscreen there are small colored alternate flashing lights. The roof also features unit numbers. The car uses black wheels with chrome center caps, wrapped in high profile tires. On the inside of the car there is a protective mesh separating the front occupants from the rear.
Near the top of the car's rear face in the central third of the cars width there is an impressed area where the license plate is mounted. Various badges are mounted near almost all of the vertices of the area (excluding the lower left). Similar in height, at the edges of the car body are the rear light units with inner edges parallel to the outer edges of the license plate area. The rear lights are split into four regions, the central strips are where the turn indicator and reverse lamps are found. The rear lights also have the ability to flash alternately in a wig-wag pattern. At the base of the rear bumper, covering three-quarters of the car's width is a trapezium-shaped polymer insert. Near the top of the insert, on either side there are red horizontal reflectors. In the lower corners of the rear insert there are twin-circle exhaust tips.
The rear of the car, especially the rear light units, appears to resemble the Australian Ford FG Falcon. This is somewhat ironic, because the Falcon is more popular as a taxi than a police car in Australia. It also resembles a first generation Nissan Tiida.
This car appears to be the HD Universe succesor to GTA IV's Merit based Police Patrol, as the GTA IV Stanier Mk1 cruiser is replaced by its Mk2 counterpart.
The color scheme is the same as used on the Los Angeles Police Department Interceptors. It also looks like Carbon Motors' E7.
The rear-wheel drive high powered Interceptor employs wishbone suspension for its front axle. The car also features 4-wheel disc brakes. It has good acceleration compared to most sedans, far better than the older platform that it replaced in the LSPD. It also has good braking and above average handling, and it takes a lot of effort to make it lose grip thanks to its stiff suspension.
If it has any flaw, it is its durability. The introduction of crumple points on this car seems to be overused, especially around the front wheels, causing wheel cambering after only several crashes. Compared to the Stanier, it takes less effort to bend the axle to the point that the wheel locks, and the new turbocharged engine is less durable than the old engine found in the standard Police Cruiser. Despite its downsides, the car is powerful and controllable. If the car is not abused, it can be an excellent choice for any officer.
GTA V Overview
- At all police stations across Los Santos.
- Randomly patrolling the streets
- Frequently appears at any wanted level and or chasing criminals.
- At least one can always be found at the Mission Row Police Station.
- At least one can be found patrolling around the interiors of Bolingbroke Penitentiary.
- May spawn patrolling the streets only during certain missions.
- The Interceptor replaces the Police Patrol from Grand Theft Auto IV.
- The Police Interceptor appear with the following aerial roof numbers: 05, 29, 32, 43, 58, 84 and 93.
- When flipped over, the car appears to have no drive shaft. However, if you look closely, the engine is longitudinal and there is a differential at the rear.
- The front fascia resemble that of the Surge.
- Also, the headlights resemble those from the Felon.
- The turbocharged V6 resembles Ford's EcoBoost turbocharged engines, specifically the twin-turbocharged 3.5L V6 used in both the civilian and police version of the Ford Taurus.
- It is the only police vehicle in the game that does not have a civilian variant (the Police Buffalo, Police Cruiser and FIB Granger all have civilian versions, though the Police Cruiser's civilian model is of a previous generation).
- In the original version of the game, the on-board computer that is visible inside the Interceptor features the LCPD database screen.
- This is the only vehicle that flashes a side spotlight when changed to high lights. However, sufficient damage could detach the spotlight.
- An easy way to steal a police cruiser without obtaining a wanted level (or any police car for that matter) is to take either a tow truck or even a Cargobob and snag the vehicle, then when you've driven a few meters, get out of the tow truck/Cargobob and drive away in it.
- All flashing lights are actually controlled separately over the main lights, as these will continue flashing even when the main lights are broken.
- The car's bullbars are actually mounted on the grille and not on the bumper like in real life. This can be seen when the Interceptor loses its bumper, the bullbars won't come off.
- The Interceptor is the third fastest police vehicle in the series, below the Buffalo variant, which goes 3mph faster, with the fastest being the Stinger.
- The Side door panel livery is not taken from the Los Angeles Police Department city livery, as the LAPD Livery does not feature the word POLICE down the side, however the color scheme is revered from its counterpart livery.
- In the enhanced version first person trailer, Interceptors and Sheriff Cruisers have new siren noises, some of the sirens having faster loops and sirens being louder when traveling past them, these sounds being more realistic and louder. These sounds did not make it to the final game.
- There are vehicle mods that are unused, including spoilers, front intake vents, and upgrades for the bullbars. The only way to add these is to edit the game save or by modding the game. It suggests that police vehicles can also be modified in the Beta, being a leftover.
- The Sheriff SUV can also be modified with a glitch before 1.06 update.
- With these upgrades, it has some resemblance to the Police Stinger.
- Strangely, prior to an update, the player could change the "livery" of the Police Cruiser in the Creator. The only visible changes were the roof numbers. After the Heists Update, this feature was removed. The default number is always 32.
- After the Heists Update, sirens on this car, and all other emergency vehicles will be automatically turn off when exiting the vehicle (in GTA Online).
- Strangely, when killing all officers in the Cruiser, the horn will not be the usual cop horn, instead civilian car horns will be used. This can also be seen with the FIB Granger and its variants.
Cultural references
- The inclusion of this car is a direct reference to the Ford Taurus Interceptors that went into use by the Los Angeles Sheriff's Department in 2012.


text:
Flower Crown Bride Wedding Fashion Illustration Art Print
Print available in 4"x6", 5"x7", 8"x10", and 11"x14". Please read entire description before purchasing, thank you!
- Printed on heavy weight, high quality, fade resistant paper with archival inks
- Each print is signed in ink by the artist
- Copyright watermark will not appear on your print
- Unframed prints will be packaged in a protective cello sleeve and backed with sturdy cardboard
- Printed in New York City
Click here to get your print custom framed!
I'm excited to have partnered with Simply Framed to offer high quality custom framing made by hand here in the USA. Please allow an additional 2-3 weeks for your delivery of framed prints. For more information, go to www.SimplyFramed.com
Copyright © Joanna Baker
All images and artwork on this site are copyright © and owned by Joanna Baker. Images and artwork may not be copied, altered, sold, downloaded, or redistributed for either personal or commercial use without written permission by the artist, Joanna Baker. The sale of products on this site does not transfer rights of any kind to the images.