text:
Exclusive Jamdani Sacrves - Indiaprice: check with company for price
Contact for Best price and delivery. Product Specification
Minimum Quantity - 500 Nos.
Shipping info – Delivered within 60 days after confirmation
Measurement - 75 X 180 Cms.
Colour - Multi-Color Accents, Plain Weave with all Organic Colour
Weight (grams) - 70-80 Gms
Material(s) – Pure Hand Woven Cotton/Silk( Handloom)
Company Contact:
- Posted By: bluehorse group
- Phone: 919716599921
- Address: 692/22b, gurgaon, Haryana, India
- Email:
- Website: http://www.bluehorsegroup.com
Published date: October 3, 2016 -
- Business Description: Bluehorse is an International Trading firm engaged in export & import and sourcing.
Based in Gurgaon, India, Bluehorse Group is registered as Bluehorse Trading India LLP.
We are a registered LLP company under the Company's Act, 1956 India.
Related listings
Grey Cotton Skull ScarfClothing - Accessories - Scarves - MZ kids Wear & Swimwear Manufacturer Co., Ltd. - China - September 9, 2016 - contact company for price
Kids Cotton Scarf Manufacturer MZ Garment offers Grey Cotton Skull Scarf OEM Service, 100% or 95% cotton, customized design, for out wear. Type: Grey Cotton Skull Scarf. Fabric: 100% cotton, or 95% cotton, 5% elastane or customized. Supply Type: OEM ...
Fashion Crepe Fabric Scarf Made In ChinaClothing - Accessories - Scarves - mcmaple rayon fabric - China - August 31, 2016 - 2.00 Dollar US$
We bring the stage center spotlight fashion to every corner on the earth, stimulate and enhance every one's self-confidence to pursue your dream bravely.Contact us today to create your fashion style! The sheen and gorgeous abstract polyester crepe fa...
China Cheap Jacquard Fabric Scarf For Fashion DesignersClothing - Accessories - Scarves - mcmaple rayon fabric - China - August 31, 2016 - 2.00 Dollar US$
mcmapletex.com The sheen and gorgeous abstract polyester jacquard fabric is extremely crisp to the touch, also have a sore eye look, the shimmery brocade providing a unique textural touch, beautiful drape and lightweight, it is great for an array of ...
Safe Trade Tips
- Ask for business references and check them
- Use a payment method that offers better protection for all such as Letters of credit and verified professional escrow services. Avoid payments in advance such as money transfers
- Verify their business via their local Chamber of Commerce
- Search the internet using their website address, their business name, their phone and fax numbers, and their email addresses to see if you can find any feedback about them.
- Get to know more about scams to avoid: Internet Crime Complaint Center - International Financial Scams
- This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"


text:
Military Order Of The Loyal Legion Of The United States
(Ny State Commandery)
777 Seventh Ave 16e, New York, NY 10019
Contact: Gerald F Fisher Esq
Our Mission+ Edit Mission Statement
Add a mission statement for "Military Order Of The Loyal Legion Of The United States." What do they do and what makes them unique?
Start a Conversation
Ny State Commandery Military Order Of The Loyal Legion Of The United States is a Subordinate Association. Its Group Exemption Number (2554) indicates that it is a member of the Military Order Of The Loyal Legion Of The United States. For Tax purposes Contributions are deductible.
Financial information in-depth
Form 990 documents
We do not have Form 990 documents for this nonprofit yet. Check back periodically.
Assets and Revenues reported Dec. 1, 2015
- Asset Amount:
- Income Amount:
- Form 990 Revenue Amount:
Organization Information
- NTEE Code:
- Ruling Date:
- Aug. 1, 1974
- Group Exemption Number:
- 2554
- Subsection Code:
- Affiliation Code:
- Subordinate
- Classification Code:
- Deductibility Code:
- Contributions are deductible.
- Foundation Code:
- All organizations except 501(c)(3)
- Activity Code:
- Organization Code:
- Association
- Exempt Organization Status Code:
- Unconditional Exemption
- Advanced Ruling Expiration Date:
- Filing Regulation Code:
- 990 - Required to file Form 990-N - Income less than $25,000 per year
- Filing Regulation Code:
- No 990-PF return
- Asset Code:
- 0
- Income Code:
- 0
- Account Period:
- December
This is my nonprofit
Become accredited today and earn the trust of your donors.Get Started

subset: commoncrawl


text:
The Gathering
Posted 06 October 2012 - 03:55 PM
So I've decided to start one ! I've recently discovered their music, and I was blown away! I still need to listen to all there records but I love the minimalist/progressive tone to their music.
PS. the only record that I own right now is "Home" so that technically makes me a noob to their music, I'm hoping to find more of their records soon. They could possibly be my new favorite band in 4 months xD.
- 0
Posted 06 October 2012 - 04:04 PM
So yeah I LOVE The Gathering. I prefer their later stuff (HTMAP, Souvenirs, if_then_else) and the live album Sleepy Buildings. Mandylion and Nighttime Birds are great albums as well basically I think all their albums are fantastic from whence Anneke partook of them and The West Pole was totally gorgeous.
Yeah, I love The Gathering.
- 0
ME: sorry, i have a dir en grey in my eye
Posted 06 October 2012 - 04:10 PM
- 0
Posted 06 October 2012 - 05:33 PM
- 0
Let it be prog...
Posted 06 October 2012 - 05:48 PM
- 0
I joined the original nightwish.com forum on 3rd February 2003, and have made there exactly 3,091 posts. Then I joined the Nightwish-world forum on 28th August 2009, and made there exactly 451 posts. I joined this forum on 4th December 2011. I couldn't care less how many posts I am going to make here.
Posted 06 October 2012 - 06:39 PM
Home is a very good album, but just blag it and buy the whole lot. The new album is okay as well, but with Anneke they were something truly special. I love Mandylion and Souvenirs the most, but they are all terrific!!
- 0
Laputa the CASTLE IN THE SKY!!
Posted 06 October 2012 - 09:00 PM
- 0
Posted 06 October 2012 - 11:28 PM
I never really got too into this band, although I did get the Adrenaline/Leaves, How To Measure a Planet, and Liberty Bell singles as part of a trade some years ago. By this point, they'd had a major style shift and played the atmospheric rock they became famous for rather than what they played when I first heard them. Really enjoyed those singles, in spite of the style shift, though one or another always managed to get in the way of buying the full-length albums or keeping up with the band.
- 0
The end is nigh
Posted 07 October 2012 - 12:08 PM
- 0
I joined the original nightwish.com forum on 3rd February 2003, and have made there exactly 3,091 posts. Then I joined the Nightwish-world forum on 28th August 2009, and made there exactly 451 posts. I joined this forum on 4th December 2011. I couldn't care less how many posts I am going to make here.
Posted 07 October 2012 - 02:53 PM
MANDYLION: A beautiful, atmospheric masterpiece that is simply indescribable. Although it plays like one long track it is simply spellbinding, with Strange Machines, In Motion II and Leaves in particular standing out as classics. Unmissable, this album is a treat. Get it, it is raw but unmissable.
NIGHTTIME BIRDS: The perfect follow up to Mandylion, this album sees Anneke improving her craft steadily and some of the songs stand out as amongst the finest ever released by any band, ever. Want proof? Try Confusion, Third Chance, Nighttime Birds or the wonderful closer Shrink. This is musical perfection.
HOW TO MEASURE A PLANET: Just wonderful. The band branch out into more diverse genres, standing alongside Radiohead and Massive Attack as masters of electronic music. They sound like no one else on this album, and Marooned, Travel, My Electricity off the first disc are standouts. The 20 minute plus title track is a head scratcher, but relax and go with the flow and you'll find yourself mesmerized by its unique charm. It's easily one of the finest songs in their catalogue, but you must have an open mind. And again, you need to relax as plays. Not perfect, but easily another world class effort. Do not miss this one.
if_then_else: This follow up to HTMAP? is an overlooked gem. It brings back the character of earlier albums whilst pushing the band's electronic edge even further. Amity, Saturnine and Rollercoaster are further classics. One of my favourite albums, it's a magnificent release.
SOUVENIRS: Just get it. This is possibly the wild card selection as it almost sounds like a different band altogether, but I really believe in my heart that this is the album to best introduce newcomers to. You Learn About It is one of the finest pop songs ever written, and should have been a massive hit upon release. Anneke is amazing on this album, and opener Even The Spirits Are Afraid is one of the nicest, most sinister sounding songs ever written. This is a winter album. Play it when it's snowy outside, and it's oddly warming. Another classic.
HOME: It isn't altogether new in sound. It follows on with the direction of the previous album, but again it's one of the band's finest. It's beautiful and an amazing album to relax to. All traces of metal are removed ed on this release, but it's not commercial, it's not easy listening, but it is another experience that must be taken. A wonderful send off to Annekes time with this band.
Sadly, the follow up albums lack the character that define the Anneke era as something special. Buy them, in there own way they are fantastic albums, but Mandylion through to Souvenirs are the unmissable classics.
Also, SLEEPY BUILDINGS: a semi acoustic concert recorded in full. This is without a doubt a desert island disc. If you are going to own just one Gathering album, make it this one. Anneke sounds like a goddess on this release, and many of the recordings on this album are superior to the original, more electric studio recordings. Amity and In Motion II are delicious on this album. The warmth of the concert is almost edible, and if you shut your eyes you are pretty much in that room.
Just get them all. I don't know any other band who have changed so much from their early days, and I cannot see how anybody could not find something to enjoy from this band.
- 0
Laputa the CASTLE IN THE SKY!!
Posted 07 October 2012 - 05:26 PM
- 0
I joined the original nightwish.com forum on 3rd February 2003, and have made there exactly 3,091 posts. Then I joined the Nightwish-world forum on 28th August 2009, and made there exactly 451 posts. I joined this forum on 4th December 2011. I couldn't care less how many posts I am going to make here.
Posted 26 October 2012 - 08:45 PM
The 'Anneke era' is indeed the Golden era and Mandylion and Nighttime Birds was my introduction to female fronted metal, I also think their first album "Always..." is highly underrated. Perhaps not a classic, but still a very good album.
- 0
Posted 02 November 2012 - 07:38 PM
The Gathering to me, are a kick in the face to metal purists : their death metal albums are their weakest, and even when distancing themselves from metal music they keep putting out incredible albums
- 0
Posted 03 November 2012 - 10:06 PM
I must be an exception here, but I prefer Silje's voice over Anneke's in The Gathering. Not that I dislike Anneke as a singer, she is brilliant! But I prefer her voice in her solo work than with the band. Dunno why. I knew Silje's band before she joined TG and I always digged her voice so much. I think she has such a beautiful velvet voice. It's really charming. Like if she was a female version of Katatonia's singer. xD No wonder her voice complemented his voice really well in the duet from Katatonia's new album.
To the ones who are skeptical with the post-anneke material, you should definitely give it a try. In The West Pole album, Silje's voice sounds kinda repressed or shy, if you know what I mean. Dunno if it was a production thing, or if she was kinda shy because all the songs were ready when she joined the band. It's a very mellow album, but hopefull at the same time. I love that album.
The new album Disclosure is definitely a masterpiece!!! I think it is my favorite album from them. Silje's voice is freer and the songs are all so different from each other. It's really interesting. They are masters of arranging the songs with electronic effects and a few string players. If I wasn't following their career for years I would tell they would be big, expensive american producer stars. Silje also experiments with different vocal melodies. It reminds me of Cocteau Twins and those top alternative 80s bands. It's another album with a great feeling.
They definitely have such a big talent they should be much better known around the globe, but I think their do-it-yourself approach kinda hold them down a little bit. Anyway, as long as they are happy, we are happy. Their beautiful music will always be beautiful anyway.
- 0
Posted 04 November 2012 - 09:36 AM
- 0
Laputa the CASTLE IN THE SKY!!
Posted 14 November 2012 - 12:03 AM
- 0
Posted 22 March 2013 - 05:22 PM
I started with "Home" as well, which was their most recent release on that year.
I like it but not too much...until I discover Mandylion and Nighttime birds. I easily got attached and LOVED it!
HTMAP - I find it hard to sink in on the first listen but there are remarkable songs like Illuminating, Travel and Rescue me. After few spins, it grew on me and I like it better than ITE, Souvenirs and Home.
I also love the first album (with Bart Smiths), "Always..". But not, "Almost a dance".
Like everyone said, everything they put out with Anneke are all treasures.
- 0
Posted 22 March 2013 - 05:51 PM
Without each other, I find them merely ok. Not amazing, not exactly mediocre. But the chemistry on the albums from Mandylion through to Home is rare. Its not a bad thing, perhaps had they stayed together for one more album they may have released something subpar. Anneke is still doing fine on her own, but for the price it costs to buy her music in the UK, it simply isn't worth it, in my opinion. I would never say that about her work with the gathering, mind you. I would see her live though.
I am finding Disclosure difficult still. It just lacks a personality. Its beautiful in parts, but Silje simply lacks any vocal charisma.
- 0
Laputa the CASTLE IN THE SKY!!
Posted 26 March 2013 - 09:49 AM
That reminds me of her performances during Dynamo festival (shown in the In Motion DVD).
- 0
Posted 07 April 2013 - 04:11 PM
I think it is their masterpiece. The rest is still stellar, but the rawness and appealing production values hit an emotional nerve. It was bliss in the kitchen when this gem played! It never gets old.
- 0
Laputa the CASTLE IN THE SKY!!
Posted 12 April 2013 - 05:02 AM
- 0
Posted 20 May 2013 - 04:32 AM
- 0
Posted 09 August 2013 - 09:24 PM
The Gathering with Bart & Marieke in 1992:
And 20 years later in '92 line up:
- 0
Posted 02 October 2013 - 06:53 AM
Meltdown (Live)
And the new songs from "Afterwords"
"Echoes keep growing"
"Afterwords" (with Bart Smiths) -- reminds me a lot of Dead Can Dance
- 0
Posted 17 January 2014 - 02:19 PM
Dear friends,
With some great shows and the release of 'Afterwords', a special album that had a fantastic response, we had agood year. But looking in the near future we have decided that we all need a break. After almost 25 years of making albums, touring, etc, we need some time to reconsider how we will shape the future of TG. Also, Marjolein has decided to take other directions and go her own path. We have played, toured and made music together forten years with a lot of joy. She is a great person and musician and she will be missed by all of us. We wish her only good things for the future.
We want to inform you that the shows next week in Nijmegen and Dordrecht (the Netherlands) will be the last ones for a while, and the last ones with Marjolein. We want to thank you for your enduring support, and hope to see you at one of the shows.
"Dear fans & friends of The Gathering,
I have something to tell you, because after quite some time of thinking I have decided to leave The Gathering.
The ten years with The Gathering have been a great experience for me and a dream come true. Making music, traveling all over the world and meeting wonderful people everywhere: I am very thankful and happy to have been a part of this.
But in this life things change, and that's a good thing. Life is never boring. I feel it's time for me to moveon and focus on new things. Also musically.
So, with this backpack full of great memories I look forward to what the future will bring. The open road is inspiring, I guess that's the beauty of uncertainty.
From the bottom of my heart I want to thank everybody for their love and support throughout the years.
I'm looking forward to play two intense final shows in Nijmegen and Dordrecht & hope more good music and experiences will follow.
Until we meet again!
Lots of love,
- 0
And I'll speak to you silently
And know that you'll hear me
The feeling is more than I've ever known
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users


text:
The L1348 group is a perfect combination of plush comfort and sleek, contemporary style. The sofa, chair, and deftly curved conversation sectional show off their hip, cosmopolitan appeal with simple shapes and subtly button-tufted back cushions with bold topstitch detailing. Two shades of leather are available, a dusky, dark brown and lighter cream color. Bring home affordable, quality, leather furniture with the L1348 collection
Browse other items in the L1348 collection from Becker Furniture World in the Twin Cities, Minneapolis, St. Paul, Minnesota area.
Nothing on this page may be copied or reproduced without explicit permission.
Drag anItem Here
To start a new blank room plan, enter the desired room dimensions below and click Create Room.
To request a new password, enter your username or e-mail address and click submit. A new password will automatically be emailed to you.
If you are still having trouble logging on after receiving your new password, please email email@example.com


text:
--Buddy the Moose Day--
- Posted Aug. 7, 2011 by Nancy in Puppy. Viewed 2291 times
- This is a migrated legacy post. Image resolution is low. Info
After putting weeds most of the weekend, we went for a hike and a swim:))
9 There are 9 comments, add yours!
2011.08.12 Edited
A great set of 2 lovely dogs
2011.08.11 Edited
Fantastic captures well done Nancy, all the shots make me smile :-)
2011.08.10 Edited
These dogs of yours always make me smile Nancy.
Like you, I am busy pulling weeds morning, noon and night. Oh, and trying to eat all the veg and fruit. Any ideas what to do with a barrow load of zucchini?
2011.08.10 Edited
fun set
2011.08.09 Edited
Love them ALL! Buddy Day is the best!
2011.08.08 Edited
what a treat!!! I come back to BUDDY DAY!!!!!
i have missed a few i can't believe how big he is getting
2011.08.08 Edited
Full of energy ... :-)
2011.08.08 Edited
A beautiful set of these two guys. Excellent capture in action. Beautiful colors and sharpness. I particularly like the last picture ! So sweet ! :)


text:
Download presentation
Presentation is loading. Please wait.
Published bySemaj Selby Modified over 2 years ago
1 An Overview of Trilinos Michael A. Heroux Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract DE-AC04-94AL85000.
2 Outline of Talk Background / Motivation / Evolution. Trilinos Package Concepts. Whirlwind Tour of Trilinos Packages. Getting Started. Solver Collaborations: ANAs, LALs and APPs. Concluding remarks. Hands On Tutorial
Trilinos Contributors Chris Baker Ross Bartlett Pavel Bochev Paul Boggs Erik Boman Lee Buermann Cedric Chevalier Todd Coffey Eric Cyr David Day Karen Devine Clark Dohrmann Kelly Fermoyle David Gay Mike Heroux Ulrich Hetmaniuk Mark Hoemmen Russell Hooper Vicki Howle Jonathan Hu Joe Kotulski Rich Lehoucq Kevin Long Karla Morris Kurtis Nusbaum Roger Pawlowski Brent Perschbacher Eric Phipps Siva Rajamanickam Lee Ann Riesen Marzio Sala Andrew Salinger Chris Siefert Bill Spotz Heidi Thornquist Ray Tuminaro Jim Willenbring Alan Williams Michael Wolf Past Contributors Jason Cross Michael Gee Esteban Guillen Bob Heaphy Robert Hoekstra Kris Kampshoff Ian Karlin Sarah Knepper Tammy Kolda Joe Outzen Mike Phenow Paul Sexton Bob Shuttleworth Ken Stanley
Target Problems: PDES and more… PDES Circuits Inhomogeneous Fluids And More…
Target Platforms: Any and All (Now and in the Future) Desktop: Development and more… Capability machines: Cielo (XE6), JaguarPF (XT5), Clusters Titan (Hybrid CPU/GPU). Multicore nodes. Parallel software environments: MPI of course. threads, vectors, CUDA OpenCL, … Combinations of the above. User skins: C++/C, Python Fortran. Web.
7 Evolving Trilinos Solution Numerical math Convert to models that can be solved on digital computers Algorithms Find faster and more efficient ways to solve numerical models L(u)=f Math. model L(u)=f Math. model L h (u h )=f h Numerical model L h (u h )=f h Numerical model u h =L h -1 f h Algorithms u h =L h -1 f h Algorithms physics computation Linear Nonlinear Eigenvalues Optimization Linear Nonlinear Eigenvalues Optimization Automatic diff. Domain dec. Mortar methods Automatic diff. Domain dec. Mortar methods Time domain Space domain Time domain Space domain Petra Utilities Interfaces Load Balancing Petra Utilities Interfaces Load Balancing solvers discretizations methods core Beyond a solvers framework Natural expansion of capabilities to satisfy application and research needs Discretization methods, AD, Mortar methods, …
Transforming Computational Analysis To Support High Consequence Decisions Forward Analysis Accurate & Efficient Forward Analysis Robust Analysis with Parameter Sensitivities Optimization of Design/System Quantify Uncertainties/Systems Margins Optimization under Uncertainty Simulation Capability Library Demands Each stage requires greater performance and error control of prior stages: Always will need: more accurate and scalable methods. more sophisticated tools. Each stage requires greater performance and error control of prior stages: Always will need: more accurate and scalable methods. more sophisticated tools. Systems of systems
Trilinos Strategic Goals Scalable Computations: As problem size and processor counts increase, the cost of the computation will remain nearly fixed. Hardened Computations: Never fail unless problem essentially intractable, in which case we diagnose and inform the user why the problem fails and provide a reliable measure of error. Full Vertical Coverage: Provide leading edge enabling technologies through the entire technical application software stack: from problem construction, solution, analysis and optimization. Grand Universal Interoperability: All Trilinos packages, and important external packages, will be interoperable, so that any combination of packages and external software (e.g., PETSc, Hypre) that makes sense algorithmically will be possible within Trilinos. Universal Accessibility: All Trilinos capabilities will be available to users of major computing environments: C++, Fortran, Python and the Web, and from the desktop to the latest scalable systems. Universal Solver RAS: Trilinos will be: Reliable: Leading edge hardened, scalable solutions for each of these applications Available: Integrated into every major application at Sandia Serviceable: Easy to maintain and upgrade within the application environment. Algorithmic Goals Software Goals
Capability Leaders: Layer of Proactive Leadership Areas: Framework, Tools & Interfaces (J. Willenbring). Software Engineering Technologies and Integration (R. Bartlett). Discretizations (P. Bochev). Geometry, Meshing & Load Balancing (K. Devine). Scalable Linear Algebra (M. Heroux). Linear & Eigen Solvers (J. Hu). Nonlinear, Transient & Optimization Solvers (A. Salinger). Scalable I/O: (R. Oldfield) Each leader provides strategic direction across all Trilinos packages within area.
11 Package Concepts
Trilinos Package Summary ObjectivePackage(s) Discretizations Meshing & DiscretizationsSTKMesh, Intrepid, Pamgen, Sundance, ITAPS, Mesquite Time IntegrationRythmos Methods Automatic DifferentiationSacado Mortar MethodsMoertel Services Linear algebra objectsEpetra, Jpetra, Tpetra, Kokkos InterfacesThyra, Stratimikos, RTOp, FEI, Shards Load BalancingZoltan, Isorropia SkinsPyTrilinos, WebTrilinos, ForTrilinos, Ctrilinos, Optika C++ utilities, I/O, thread APITeuchos, EpetraExt, Kokkos, Triutils, ThreadPool, Phalanx Solvers Iterative linear solversAztecOO, Belos, Komplex Direct sparse linear solversAmesos, Amesos2 Direct dense linear solversEpetra, Teuchos, Pliris Iterative eigenvalue solversAnasazi, Rbgen ILU-type preconditionersAztecOO, IFPACK, Ifpack2 Multilevel preconditionersML, CLAPS Block preconditionersMeros, Teko Nonlinear system solversNOX, LOCA Optimization (SAND)MOOCHO, Aristos, TriKota, Globipack, Optipack Stochastic PDEsStokhos
13 Interoperability vs. Dependence (Can Use) (Depends On) Although most Trilinos packages have no explicit dependence, often packages must interact with some other packages: NOX needs operator, vector and linear solver objects. AztecOO needs preconditioner, matrix, operator and vector objects. Interoperability is enabled at configure time. Trilinos cmake system is vehicle for: Establishing interoperability of Trilinos components… Without compromising individual package autonomy. Trilinos_ENABLE_ALL_OPTIONAL_PACKAGES option Architecture support simultaneous development on many fronts.
14 What Trilinos is not … Trilinos is not a single monolithic piece of software. Each package: Can be built independent of Trilinos. Has its own self-contained repository structure. Has its own Bugzilla product and mail lists. Development team is free to make its own decisions about algorithms, coding style, release contents, testing process, etc. Trilinos top layer is not a large amount of source code: ~1.5% Trilinos is not indivisible: You dont need all of Trilinos to get things done. Any collection of packages can be combined and distributed. Current public release contains ~50 of the 55+ Trilinos packages.
15 Whirlwind Tour of Packages Core Utilities Discretizations Methods Solvers
16 Interoperable Tools for Rapid Development of Compatible Discretizations Intrepid Intrepid offers an innovative software design for compatible discretizations: allows access to FEM, FV and FD methods using a common API supports hybrid discretizations (FEM, FV and FD) on unstructured grids supports a variety of cell shapes: standard shapes (e.g. tets, hexes): high-order finite element methods arbitrary (polyhedral) shapes: low-order mimetic finite difference methods enables optimization, error estimation, V&V, and UQ using fast invasive techniques (direct support for cell-based derivative computations or via automatic differentiation) Direct: FV/D Reconstruction Cell Data Reduction Pullback: FEM Higher order General cells Λ k Forms Λ k Forms d,d*,,^,(,) Operations d,d*,,^,(,) Operations {C 0,C 1,C 2,C 3 } Discrete forms {C 0,C 1,C 2,C 3 } Discrete forms D,D*,W,M Discrete ops. D,D*,W,M Discrete ops. Developers: Pavel Bochev and Denis Ridzal
17 Rythmos Suite of time integration (discretization) methods Includes: backward Euler, forward Euler, explicit Runge-Kutta, and implicit BDF at this time. Native support for operator split methods. Highly modular. Forward sensitivity computations will be included in the first release with adjoint sensitivities coming in near future. Developers: Todd Coffey, Roscoe Bartlett
18 Whirlwind Tour of Packages Discretizations Methods Core Solvers
19 Sacado: Automatic Differentiation Efficient OO based AD tools optimized for element-level computations Applies AD at element-level computation Element means finite element, finite volume, network device,… Template applications element-computation code Developers only need to maintain one templated code base Provides three forms of AD Forward Mode: Propagate derivatives of intermediate variables w.r.t. independent variables forward Directional derivatives, tangent vectors, square Jacobians, when m n. Reverse Mode: Propagate derivatives of dependent variables w.r.t. intermediate variables backwards Gradients, Jacobian-transpose products (adjoints), when n > m. Taylor polynomial mode: Basic modes combined for higher derivatives. Developers: Eric Phipps, David Gay
20 Whirlwind Tour of Packages Discretizations Methods Core Solvers
21 Portable utility package of commonly useful tools: ParameterList class: key/value pair database, recursive capabilities. LAPACK, BLAS wrappers (templated on ordinal and scalar type). Dense matrix and vector classes (compatible with BLAS/LAPACK). FLOP counters, timers. Ordinal, Scalar Traits support: Definition of zero, one, etc. Reference counted pointers / arrays, and more… Takes advantage of advanced features of C++: Templates Standard Template Library (STL) Teuchos::ParameterList: Allows easy control of solver parameters. XML format input/output. Developers: Roscoe Barlett, Kevin Long, Heidi Thornquist, Mike Heroux, Paul Sexton, Kris Kampshoff, Chris Baker Teuchos
22 1 Petra is Greek for foundation. Trilinos Common Language: Petra Petra provides a common language for distributed linear algebra objects (operator, matrix, vector) Petra 1 provides distributed matrix and vector services. Exists in basic form as an object model: Describes basic user and support classes in UML, independent of language/implementation. Describes objects and relationships to build and use matrices, vectors and graphs. Has 3 implementations under development.
23 Petra Implementations Epetra (Essential Petra): Current production version. Restricted to real, double precision arithmetic. Uses stable core subset of C++ (circa 2000). Interfaces accessible to C and Fortran users. Tpetra (Templated Petra): Next generation C++ version. Templated scalar and ordinal fields. Uses namespaces, and STL: Improved usability/efficiency. Builds on top of Kokkos manycore node library. Developers: Chris Baker, Mike Heroux, Rob Hoekstra, Alan Williams
24 EpetraExt: Extensions to Epetra Library of useful classes not needed by everyone Most classes are types of transforms. Examples: Graph/matrix view extraction. Epetra/Zoltan interface. Explicit sparse transpose. Singleton removal filter, static condensation filter. Overlapped graph constructor, graph colorings. Permutations. Sparse matrix-matrix multiply. Matlab, MatrixMarket I/O functions. Most classes are small, useful, but non-trivial to write. Developer: Robert Hoekstra, Alan Williams, Mike Heroux
25 Zoltan Data Services for Dynamic Applications Dynamic load balancing Graph coloring Data migration Matrix ordering Partitioners: Geometric (coordinate-based) methods: Recursive Coordinate Bisection (Berger, Bokhari) Recursive Inertial Bisection (Taylor, Nour-Omid) Space Filling Curves (Peano, Hilbert) Refinement-tree Partitioning (Mitchell) Hypergraph and graph (connectivity-based) methods: Hypergraph Repartitioning PaToH (Catalyurek) Zoltan Hypergraph Partitioning ParMETIS (U. Minnesota) Jostle (U. Greenwich) Developers: Karen Devine, Eric Boman, Robert Heaphy
26 Thyra High-performance, abstract interfaces for linear algebra Offers flexibility through abstractions to algorithm developers Linear solvers (Direct, Iterative, Preconditioners) Abstraction of basic vector/matrix operations (dot, axpy, mv). Can use any concrete linear algebra library (Epetra, PETSc, BLAS). Nonlinear solvers (Newton, etc.) Abstraction of linear solve (solve Ax=b). Can use any concrete linear solver library: AztecOO, Belos, ML, PETSc, LAPACK Transient/DAE solvers (implicit) Abstraction of nonlinear solve. … and so on. Developers: Roscoe Bartlett, Kevin Long
27 Skins PyTrilinos provides Python access to Trilinos packages Uses SWIG to generate bindings. Epetra, AztecOO, IFPACK, ML, NOX, LOCA, Amesos and NewPackage are supported. CTrilinos: C wrapper (mostly to support ForTrilinos). ForTrilinos: OO Fortran interfaces. WebTrilinos: Web interface to Trilinos Generate test problems or read from file. Generate C++ or Python code fragments and click-run. Hand modify code fragments and re-run. Will use during hands-on. Developers: Ray Tuminaro, Jonathan Hu, Marzio Sala,Jim Willenbring Developer: Bill Spotz Developers: Nicole Lemaster, Damian Rouson
28 Whirlwind Tour of Packages Discretizations Methods Core Solvers
29 Interface to direct solvers for distributed sparse linear systems (KLU, UMFPACK, SuperLU, MUMPS, ScaLAPACK) Challenges : No single solver dominates Different interfaces and data formats, serial and parallel Interface often changes between revisions Amesos offers: A single, clear, consistent interface, to various packages Common look-and-feel for all classes Separation from specific solver details Use serial and distributed solvers; Amesos takes care of data redistribution Native solvers: KLU and Paraklete Developers: Ken Stanley, Marzio Sala, Tim Davis Amesos
30 Second generation Amesos. Amesos2 offers: Template support. Improved internal structure. Path to threaded and hybrid solvers. Separation from specific solver details Developers: Eric Bavier, Siva Rajamanickam Amesos2/KLU2
31 AztecOO Krylov subspace solvers: CG, GMRES, Bi-CGSTAB,… Incomplete factorization preconditioners Aztec is the workhorse solver at Sandia: Extracted from the MPSalsa reacting flow code. Installed in dozens of Sandia apps. 1900+ external licenses. AztecOO improves on Aztec by: Using Epetra objects for defining matrix and RHS. Providing more preconditioners/scalings. Using C++ class design to enable more sophisticated use. AztecOO interfaces allows: Continued use of Aztec for functionality. Introduction of new solver capabilities outside of Aztec. Developers: Mike Heroux, Alan Williams, Ray Tuminaro
32 Belos Next-generation linear solver library, written in templated C++. Provide a generic framework for developing iterative algorithms for solving large-scale, linear problems. Algorithm implementation is accomplished through the use of traits classes and abstract base classes: Operator-vector products: Belos::MultiVecTraits, Belos::OperatorTraits Orthogonalization: Belos::OrthoManager, Belos::MatOrthoManager Status tests: Belos::StatusTest, Belos::StatusTestResNorm Iteration kernels: Belos::Iteration Linear solver managers: Belos::SolverManager AztecOO provides solvers for Ax=b, what about solvers for: Simultaneously solved systems w/ multiple-RHS: AX = B Sequentially solved systems w/ multiple-RHS: AX i = B i, i=1,…,t Sequences of multiple-RHS systems: A i X i = B i, i=1,…,t Many advanced methods for these types of linear systems Block methods: block GMRES [Vital], block CG/BICG [OLeary] Seed solvers: hybrid GMRES [Nachtigal, et al.] Recycling solvers: recycled Krylov methods [Parks, et al.] Restarting techniques, orthogonalization techniques, … Developers: Heidi Thornquist, Mike Heroux, Mark Hoemmen, Mike Parks, Rich Lehoucq
33 IFPACK: Algebraic Preconditioners Overlapping Schwarz preconditioners with incomplete factorizations, block relaxations, block direct solves. Accept user matrix via abstract matrix interface (Epetra versions). Uses Epetra for basic matrix/vector calculations. Supports simple perturbation stabilizations and condition estimation. Separates graph construction from factorization, improves performance substantially. Compatible with AztecOO, ML, Amesos. Can be used by NOX and ML. Developers: Marzio Sala, Mike Heroux, Siva Rajamanickam, Alan Williams
34 Second generation Ifpack. Ifpack2 offers: Template support. Improved internal structure. Path to threaded and hybrid solvers. Separation from specific solver details Developers: Mike Heroux, Siva Rajamanickam, Alan Williams, Michael Wolf Ifpack2
35 : Multi-level Preconditioners Smoothed aggregation, multigrid and domain decomposition preconditioning package Critical technology for scalable performance of some key apps. ML compatible with other Trilinos packages: Accepts user data as Epetra_RowMatrix object (abstract interface). Any implementation of Epetra_RowMatrix works. Implements the Epetra_Operator interface. Allows ML preconditioners to be used with AztecOO, Belos, Anasazi. Can also be used completely independent of other Trilinos packages. Developers: Ray Tuminaro, Jeremie Gaidamour, Jonathan Hu, Marzio Sala, Chris Siefert
36 Anasazi Next-generation eigensolver library, written in templated C++. Provide a generic framework for developing iterative algorithms for solving large-scale eigenproblems. Algorithm implementation is accomplished through the use of traits classes and abstract base classes: Operator-vector products: Anasazi::MultiVecTraits, Anasazi::OperatorTraits Orthogonalization: Anasazi::OrthoManager, Anasazi::MatOrthoManager Status tests: Anasazi::StatusTest, Anasazi::StatusTestResNorm Iteration kernels: Anasazi::Eigensolver Eigensolver managers: Anasazi::SolverManager Eigenproblem: Anasazi::Eigenproblem Sort managers: Anasazi::SortManager Currently has solver managers for three eigensolvers: Block Krylov-Schur Block Davidson LOBPCG Can solve: standard and generalized eigenproblems Hermitian and non-Hermitian eigenproblems real or complex-valued eigenproblems Developers: Heidi Thornquist, Mike Heroux, Chris Baker, Rich Lehoucq, Ulrich Hetmaniuk
37 NOX: Nonlinear Solvers Suite of nonlinear solution methods Implementation Parallel OO-C++ Independent of the linear algebra package! Jacobian Estimation Graph Coloring Finite Difference Jacobian-Free Newton-Krylov Broydens Method Newtons Method Tensor Method Globalizations Trust Region Dogleg Inexact Dogleg Line Search Interval Halving Quadratic Cubic More-Thuente http://trilinos.sandia.gov/packages/nox Developers: Tammy Kolda, Roger Pawlowski
38 LOCA Library of continuation algorithms Provides Zero order continuation First order continuation Arc length continuation Multi-parameter continuation (via Henderson's MF Library) Turning point continuation Pitchfork bifurcation continuation Hopf bifurcation continuation Phase transition continuation Eigenvalue approximation (via ARPACK or Anasazi) Developers: Andy Salinger, Eric Phipps
39 MOOCHO & Aristos MOOCHO: Multifunctional Object-Oriented arCHitecture for Optimization Large-scale invasive simultaneous analysis and design (SAND) using reduced space SQP methods. Aristos: Optimization of large-scale design spaces Invasive optimization approach based on full-space SQP methods. Efficiently manages inexactness in the inner linear system solves. Developer: Denis Ridzal Developer: Roscoe Bartlett
Full Vertical Solver Coverage Bifurcation Analysis LOCA DAEs/ODEs: Transient Problems Rythmos Eigen Problems: Linear Equations: Linear Problems AztecOO Belos Ifpack, ML, etc... Anasazi Vector Problems: Matrix/Graph Equations: Distributed Linear Algebra Epetra Tpetra Optimization MOOCHO Unconstrained: Constrained: Nonlinear Problems NOX Sensitivities (Automatic Differentiation: Sacado) Kokkos
41 Solver Collaborations: ANAs, LALs and APPs
Trilinos Strategic Goals Scalable Computations: As problem size and processor counts increase, the cost of the computation will remain nearly fixed. Hardened Computations: Never fail unless problem essentially intractable, in which case we diagnose and inform the user why the problem fails and provide a reliable measure of error. Full Vertical Coverage: Provide leading edge enabling technologies through the entire technical application software stack: from problem construction, solution, analysis and optimization. Grand Universal Interoperability: All Trilinos packages, and important external packages, will be interoperable, so that any combination of packages and external software (e.g., PETSc, Hypre) that makes sense algorithmically will be possible within Trilinos. Universal Accessibility: All Trilinos capabilities will be available to users of major computing environments: C++, Fortran, Python and the Web, and from the desktop to the latest scalable systems. Universal Solver RAS: Trilinos will be: –Reliable: Leading edge hardened, scalable solutions for each of these applications –Available: Integrated into every major application at Sandia –Serviceable: Easy to maintain and upgrade within the application environment. Algorithmic Goals Software Goals
43 Categories of Abstract Problems and Abstract Algorithms · Linear Problems: · Linear equations: · Eigen problems: · Nonlinear Problems: · Nonlinear equations: · Stability analysis: · Transient Nonlinear Problems: · DAEs/ODEs: · Optimization Problems: · Unconstrained: · Constrained: Trilinos Packages Belos Anasazi NOX LOCA Aristos Rythmos MOOCHO
44 Abstract Numerical Algorithms An abstract numerical algorithm (ANA) is a numerical algorithm that can be expressed solely in terms of vectors, vector spaces, and linear operators Example Linear ANA (LANA) : Linear Conjugate Gradients scalar product defined by vector space vector-vector operations linear operator applications scalar operations Types of operationsTypes of objects Linear Conjugate Gradient Algorithm ANAs can be very mathematically sophisticated! ANAs can be extremely reusable!
45 ANA Linear Operator Interface Solver Software Components and Interfaces 2) LAL : Linear Algebra Library (e.g. vectors, sparse matrices, sparse factorizations, preconditioners) ANA APP ANA/APP Interface ANA Vector Interface 1) ANA : Abstract Numerical Algorithm (e.g. linear solvers, eigensolvers, nonlinear solvers, stability analysis, uncertainty quantification, transient solvers, optimization etc.) 3) APP : Application (the model: physics, discretization method etc.) Example Trilinos Packages: Belos (linear solvers) Anasazi (eigensolvers) NOX (nonlinear equations) Rhythmos (ODEs,DAEs) MOOCHO (Optimization) … Example Trilinos Packages: Epetra/Tpetra (Mat,Vec) Ifpack, AztecOO, ML (Preconditioners) Meros (Preconditioners) Pliris (Interface to direct solvers) Amesos (Direct solvers) Komplex (Complex/Real forms) … Types of Software Components Thyra ANA Interfaces to Linear Algebra FEI/Thyra APP to LAL Interfaces Custom/Thyra LAL to LAL Interfaces Thyra::Nonlin Examples: SIERRA NEVADA Xyce Sundance … LAL Matrix Preconditioner Vector
Introducing Stratimikos Stratimikos created Greek words "stratigiki (strategy) and "grammikos (linear) Defines class Thyra::DefaultLinearSolverBuilder. Provides common access to: Linear Solvers: Amesos, AztecOO, Belos, … Preconditioners: Ifpack, ML, … Reads in options through a parameter list (read from XML?) Accepts any linear system objects that provide Epetra_Operator / Epetra_RowMatrix view of the matrix SPMD vector views for the RHS and LHS (e.g. Epetra_[Multi]Vector objects) Provides uniform access to linear solver options that can be leveraged across multiple applications and algorithms Key Points Stratimikos is an important building block for creating more sophisticated linear solver capabilities!
Stratimikos Parameter List and Sublists.................. Linear Solvers Preconditioners Sublists passed on to package code! Top level parameters Every parameter and sublist is handled by Thyra code and is fully validated!
48 Trilinos Integration into an Application Where to start? http://trilinos.sandia.gov http://trilinos.sandia.gov
Export Makefile System Once Trilinos is built, how do you link against the application? There are a number of issues: Library link order: -lnoxepetra -lnox –lepetra –lteuchos –lblas –llapack Consistent compilers: g++, mpiCC, icc… Consistent build options and package defines: g++ -g –O3 –D HAVE_MPI –D _STL_CHECKED Answer: Export Makefile system
Why Export Makefiles are Important The number of packages in Trilinos has exploded. As package dependencies (especially optional ones) are introduced, more maintenance is required by the top-level packages: NOXAmesos EpetraExt Epetra Ifpack ML SuperLU Direct DependenciesIndirect Dependencies NOX either must: Account for the new libraries in its configure script (unscalable) Depend on direct dependent packages to supply them through export makefiles. New Library
Export Makefiles in Action #Excerpt from TRILINOS_INSTALL_DIR)/include/Makefile.client.Epetra. # Include the Trilinos export makefile from package=Epetra. include $(TRILINOS_INSTALL_DIR)/include/Makefile.export.Epetra # Add the Trilinos installation directory to the search paths # for libraries and headers LIB_PATH = $(TRILINOS_INSTALL_DIR)/lib INCLUDE_PATH = $(TRILINOS_INSTALL_DIR)/include $(CLIENT_EXTRA_INCLUDES) # Set the C++ compiler and flags to those specified in the export makefile CXX = $(EPETRA_CXX_COMPILER) CXXFLAGS = $(EPETRA_CXX_FLAGS) # Add the Trilinos libraries, search path, and rpath to the # linker command line arguments LIBS = $(CLIENT_EXTRA_LIBS) $(SHARED_LIB_RPATH_COMMAND) \ $(EPETRA_LIBRARIES) \ $(EPETRA_TPL_LIBRARIES) $(EPETRA_EXTRA_LD_FLAGS) # Rules for building executables and objects. %.exe : %.o $(EXTRA_OBJS) $(CXX) -o $@ $(LDFLAGS) $(CXXFLAGS) $< $(EXTRA_OBJS) -L$(LIB_PATH) $(LIBS) %.o : %.cpp $(CXX) -c -o $@ $(CXXFLAGS) -I$(INCLUDE_PATH) $(EPETRA_TPL_INCLUDES) $<
52 Concluding Remarks
53 Trilinos / PETSc Interoperability Epetra_PETScAIJMatrix class Derives from Epetra_RowMatrix Wrapper for serial/parallel PETSc aij matrices Utilizes callbacks for matrix-vector product, getrow No deep copies Enables PETSc application to construct and call virtually any Trilinos preconditioner ML accepts fully constructed PETSc KSP solvers as smoothers Fine grid only Assumes fine grid matrix is really PETSc aij matrix Complements Epetra_PETScAIJMatrix class For any smoother with getrow kernel, PETSc implementation should be *much* faster than Trilinos For any smoother with matrix-vector product kernel, PETSc and Trilinos implementations should be comparable
External Visibility Awards: R&D 100, HPC SW Challenge (04). www.cfd-online.com: Industry Collaborations: Various. Linux distros: Debian, Mandriva, Ubuntu, Fedora. SciDAC TOPS-2 partner, EASI (with ORNL, UT-Knoxville, UIUC, UC-Berkeley). Over 10,000 downloads since March 2005. Occasional unsolicited external endorsements such as the following two-person exchange on mathforum.org: > The consensus seems to be that OO has little, if anything, to offer > (except bloat) to numerical computing. I would completely disagree. A good example of using OO in numerics is Trilinos: http://software.sandia.gov/trilinos/ Trilinos A project led by Sandia to develop an object-oriented software framework for scientific computations. This is an active project which includes several state-of-the-art solvers and lots of other nice things a software engineer writing CFD codes would find useful. Everything is freely available for download once you have registered. Very good!
55 Trilinos Availability / Information Trilinos and related packages are available via LGPL or BSD. Current release (10.6) is click release. Unlimited availability. Trilinos Release 10.8: January 2011. Trilinos Awards: 2004 R&D 100 Award. SC2004 HPC Software Challenge Award. Sandia Team Employee Recognition Award. Lockheed-Martin Nova Award Nominee. More information: http://trilinos.sandia.gov Annual Forums: DOE ACTS Tutorial (3 rd week in August). Annual Trilinos User Group Meeting in November @ SNL talks available for download
Useful Links Trilinos website: http://trilinos.sandia.gov Trilinos tutorial: http://trilinos.sandia.gov/Trilinos10.6Tutorial.pdf Trilinos mailing lists: http://trilinos.sandia.gov/mail_lists.html Trilinos User Group (TUG) meetings: http://trilinos.sandia.gov/events/trilinos_user_group_2009 http://trilinos.sandia.gov/events/trilinos_user_group_2008 56
Trilinos Hands-On Tutorial http://code.google.com/p/trilinos 57
Teuchos Package For many Trilinos packages, this is the only required or depends on package. Provides basic utilities: Parameter List Memory management/Smart Pointer classes Command Line Parser Templated BLAS/LAPACK interfaces XML Parser MPI Communicator 58
Parameter List A key/value pair database that is recursive Uses an implementation of the boost::Any object Can read or output to XML files (internal xml or link to external xml) Recursive: Sublists – nesting of parameter lists within itself Primary means of setting parameters in Trilinos packages: 59 Teuchos::ParameterList p; p.set(Solver, GMRES); p.set(Tolerance, 1.0e-4); p.set(Max Iterations, 100); Teuchos::ParameterList& lsParams = p.sublist(Solver Options); lsParams.set(Fill Factor, 1); double tol = p.get (Tolerance); int max_iters = p.get (Max Iterations); int fill = p.sublist(Solver Options).get (Fill Factor);
Reference Counted Smart Pointer Powerful memory management for Trilinos packages! A wrapper for a pointer so that you dont have to explicity deallocate the memory. When last RCP to the object is deleted, the underlying memory is deallocated. Next C++ standard will have Boost Smart Pointers 60 class A { }; int main { A* a = new A; using namespace Teuchos; RCP a = rcp(new A); RCP b = a; } class A { }; int main { A* a = new A;. delete a; }
Teuchos::RCP Technical Report SAND2007-4078 http://trilinos.sandia.gov/documentation.html Trilinos/doc/RCPbeginnersGuide
Time Monitor Timers that keep track of: Runtime Number of calls Time object associates a string name to the timer. RCP fill_timer = TimeMonitor::getNewTimer(Fill Time); When TimeMonitor is created, the timer starts: TimeMonitor tm(Time& t); When TimeMonitor is destroyed (usually when you leave scope), the timer stops. 62
Epetra Package Linear Algebra Package http://trilinos.sandia.gov/packages/epetra/ 63
Typical Flow of Epetra Object Construction Construct Comm Construct Map Construct x Construct b Construct A Any number of Comm objects can exist. Comms can be nested (e.g., serial within MPI). Maps describe parallel layout. Maps typically associated with more than one comp object. Two maps (source and target) define an export/import object. Computational objects. Compatibility assured via common map.
// Header files omitted… int main(int argc, char *argv[]) { MPI_Init(&argc,&argv); // Initialize MPI, MpiComm Epetra_MpiComm Comm( MPI_COMM_WORLD ); A Simple Epetra/AztecOO Program // ***** Create x and b vectors ***** Epetra_Vector x(Map); Epetra_Vector b(Map); b.Random(); // Fill RHS with random #s // ***** Create an Epetra_Matrix tridiag(-1,2,-1) ***** Epetra_CrsMatrix A(Copy, Map, 3); double negOne = -1.0; double posTwo = 2.0; for (int i=0; i
Petra Implementations Epetra (Essential Petra): Current production version. Restricted to real, double precision arithmetic. Uses stable core subset of C++ (circa 2000). Interfaces accessible to C and Fortran users. Tpetra (Templated Petra): Next generation C++ version. Templated scalar and ordinal fields. Uses namespaces, and STL: Improved usability/efficiency. Advanced node architecture, multiprecision support.
Perform redistribution of distributed objects: Parallel permutations. Ghosting of values for local computations. Collection of partial results from remote processors. Petra Object Model Abstract Interface to Parallel Machine Shameless mimic of MPI interface. Keeps MPI dependence to a single class (through all of Trilinos!). Allow trivial serial implementation. Opens door to novel parallel libraries (shmem, UPC, etc…) Abstract Interface for Sparse All-to-All Communication Supports construction of pre-recorded plan for data-driven communications. Examples: Supports gathering/scatter of off-processor x/y values when computing y = Ax. Gathering overlap rows for Overlapping Schwarz. Redistribution of matrices, vectors, etc… Describes layout of distributed objects: Vectors: Number of vector entries on each processor and global ID Matrices/graphs: Rows/Columns managed by a processor. Called Maps in Epetra. Dense Distributed Vector and Matrices: Simple local data structure. BLAS-able, LAPACK-able. Ghostable, redistributable. RTOp-able. Base Class for All Distributed Objects: Performs all communication. Requires Check, Pack, Unpack methods from derived class. Graph class for structure-only computations: Reusable matrix structure. Pattern-based preconditioners. Pattern-based load balancing tools. Basic sparse matrix class: Flexible construction process. Arbitrary entry placement on parallel machine.
Details about Epetra Maps Note: Focus on Maps (not BlockMaps). Getting beyond standard use case… Note: All of the concepts presented here for Epetra carry over to Tpetra!
1-to-1 Maps 1-to-1 map (defn): A map is 1-to-1 if each GID appears only once in the map (and is therefore associated with only a single processor). Certain operations in parallel data repartitioning require 1- to-1 maps. Specifically: The source map of an import must be 1-to-1. The target map of an export must be 1-to-1. The domain map of a 2D object must be 1-to-1. The range map of a 2D object must be 1-to-1.
2D Objects: Four Maps Epetra 2D objects: CrsMatrix, FECrsMatrix CrsGraph VbrMatrix, FEVbrMatrix Have four maps: RowMap: On each processor, the GIDs of the rows that processor will manage. ColMap: On each processor, the GIDs of the columns that processor will manage. DomainMap: The layout of domain objects (the x vector/multivector in y=Ax). RangeMap: The layout of range objects (the y vector/multivector in y=Ax). Must be 1-to-1 maps!!! Typically a 1-to-1 map Typically NOT a 1-to-1 map
Sample Problem = yA x
Case 1: Standard Approach RowMap = {0, 1} ColMap = {0, 1, 2} DomainMap = {0, 1} RangeMap = {0, 1} First 2 rows of A, elements of y and elements of x, kept on PE 0. Last row of A, element of y and element of x, kept on PE 1. PE 0 ContentsPE 1 Contents RowMap = {2} ColMap = {1, 2} DomainMap = {2} RangeMap = {2} Notes: Rows are wholly owned. RowMap=DomainMap=RangeMap (all 1-to-1). ColMap is NOT 1-to-1. Call to FillComplete: A.FillComplete(); // Assumes = yAx Original Problem
Case 2: Twist 1 RowMap = {0, 1} ColMap = {0, 1, 2} DomainMap = {1, 2} RangeMap = {0} First 2 rows of A, first element of y and last 2 elements of x, kept on PE 0. Last row of A, last 2 element of y and first element of x, kept on PE 1. PE 0 ContentsPE 1 Contents RowMap = {2} ColMap = {1, 2} DomainMap = {0} RangeMap = {1, 2} Notes: Rows are wholly owned. RowMap is NOT = DomainMap is NOT = RangeMap (all 1-to-1). ColMap is NOT 1-to-1. Call to FillComplete: A.FillComplete(DomainMap, RangeMap); = yAx Original Problem
Case 2: Twist 2 RowMap = {0, 1} ColMap = {0, 1} DomainMap = {1, 2} RangeMap = {0} First row of A, part of second row of A, first element of y and last 2 elements of x, kept on PE 0. Last row, part of second row of A, last 2 element of y and first element of x, kept on PE 1. PE 0 ContentsPE 1 Contents RowMap = {1, 2} ColMap = {1, 2} DomainMap = {0} RangeMap = {1, 2} Notes: Rows are NOT wholly owned. RowMap is NOT = DomainMap is NOT = RangeMap (all 1-to-1). RowMap and ColMap are NOT 1-to-1. Call to FillComplete: A.FillComplete(DomainMap, RangeMap); = yAx Original Problem
What does FillComplete Do? A bunch of stuff. One task is to create (if needed) import/export objects to support distributed matrix-vector multiplication: If ColMap DomainMap, create Import object. If RowMap RangeMap, create Export object. A few rules: Rectangular matrices will always require: A.FillComplete(DomainMap,RangeMap); DomainMap and RangeMap must be 1-to-1.
Linear System Solves
AztecOO Aztec is the previous workhorse solver at Sandia: Extracted from the MPSalsa reacting flow code. Installed in dozens of Sandia apps. AztecOO leverages the investment in Aztec: Uses Aztec iterative methods and preconditioners. AztecOO improves on Aztec by: Using Epetra objects for defining matrix and RHS. Providing more preconditioners/scalings. Using C++ class design to enable more sophisticated use. AztecOO interfaces allows: Continued use of Aztec for functionality. Introduction of new solver capabilities outside of Aztec. Belos is coming along as alternative. AztecOO will not go away. Will encourage new efforts and refactorings to use Belos.
AztecOO Extensibility AztecOO is designed to accept externally defined: Operators (both A and M): The linear operator A is accessed as an Epetra_Operator. Users can register a preconstructed preconditioner as an Epetra_Operator. RowMatrix: If A is registered as a RowMatrix, Aztecs preconditioners are accessible. Alternatively M can be registered separately as an Epetra_RowMatrix, and Aztecs preconditioners are accessible. StatusTests: Aztecs standard stopping criteria are accessible. Can override these mechanisms by registering a StatusTest Object.
AztecOO understands Epetra_Operator AztecOO is designed to accept externally defined: Operators (both A and M). RowMatrix (Facilitates use of AztecOO preconditioners with external A). StatusTests (externally- defined stopping criteria).
80 Belos and Anasazi Next generation linear solver / eigensolver library, written in templated C++. Provide a generic interface to a collection of algorithms for solving large-scale linear problems / eigenproblems. Algorithm implementation is accomplished through the use of traits classes and abstract base classes: e.g.: MultiVecTraits, OperatorTraits e.g.: SolverManager, Eigensolver / Iteration, Eigenproblem/ LinearProblem, StatusTest, OrthoManager, OutputManager Includes block linear solvers / eigensolvers: Higher operator performance. More reliable. Solves: AX = XΛ or AX = BXΛ (Anasazi) AX = B (Belos)
81 Why are Block Solvers Useful? Block Solvers ( in general ): Achieve better performance for operator-vector products. Block Eigensolvers ( Op(A)X = LX ): Block Linear Solvers ( Op(A)X = B ): Reliably determine multiple and/or clustered eigenvalues. Example applications: Modal analysis, stability analysis, bifurcation analysis (LOCA) Useful for when multiple solutions are required for the same system of equations. Example applications: Perturbation analysis Optimization problems Single right-hand sides where A has a handful of small eigenvalues Inner-iteration of block eigensolvers
82 Belos and Anasazi are solver libraries that: 1.Provide an abstract interface to an operator-vector products, scaling, and preconditioning. 2.Allow the user to enlist any linear algebra package for the elementary vector space operations essential to the algorithm. (Epetra, PETSc, etc.) 3.Allow the user to define convergence of any algorithm (a.k.a. status testing). 4.Allow the user to determine the verbosity level, formatting, and processor for the output. 5.Allow these decisions to be made at runtime. 6.Allow for easier creation of new solvers through managers using iterations as the basic kernels. Linear / Eigensolver Software Design
83 Anasazi / Belos Design Eigenproblem/ LinearProblem Class Describes the problem and stores the answer Eigensolver / Linear Solver Manager (SolverManager) Class Parameter list driven strategy object describing behavior of solver Eigensolver / Iteration Class Provide basic iteration interface. MultiVecTraits and OperatorTraits Traits classes for interfacing linear algebra SortManagerClass [Anasazi only] Allows selection of desired eigenvalues OrthoManagerClass Provide basic interface for orthogonalization StatusTestClass Control testing of convergence, etc. OutputManagerClass Control verbosity and printing in a MP scenario
84 Anasazi / Belos Status Anasazi (Trilinos Release 8.0) : Solvers: Block Krylov-Schur, Block Davidson, LOBPCG Can solve standard and generalized eigenproblems Can solve Hermitian and non-Hermitian eigenproblems Can target largest or smallest eigenvalues Block size is independent of number of requested eigenvalues Belos (Trilinos Release 8.0) : Solvers: CG, BlockCG, BlockGMRES, BlockFGMRES, GCRO-DR Belos::EpetraOperator, Thyra::LOWS, and Stratimikos interface allows for integration into other codes Block size is independent of number of right-hand sides Linear algebra adapters for Epetra, NOX/LOCA, and Thyra Epetra interface accepts Epetra_Operators, so can be used with ML, AztecOO, Ifpack, Belos, etc… Configurable via Teuchos::ParameterList
Nonlinear System Solves
87 NOX and LOCA are a combined package for solving and analyzing sets of nonlinear equations. NOX: Globalized Newton-based solvers. LOCA: Continuation, Stability, and Bifurcation Analysis. We define the nonlinear problem: is the residual or function evaluation is the solution vector is the Jacobian Matrix defined by: NOX/LOCA: Nonlinear Solver and Analysis Algorithms
88 Broydens Method Newtons Method Tensor Method Iterative Linear Solvers: Adaptive Forcing Terms Jacobian-Free Newton-Krylov Jacobian Estimation: Colored Finite Difference Line Search Interval Halving Quadratic Cubic More-Thuente Curvilinear (Tensor) Homotopy Artificial Parameter Continuation Natural Parameter Continuation Trust Region Dogleg Inexact Dogleg Globalizations Nonlinear Solver Algorithms
Stopping Criteria (Status Test) Example: Newtons Method for F (x) = 0 Choose an initial guess x 0 For k = 0,1,2,... Compute F k = F (x k ) Compute J k where (J k ) ij = F i (x k )/ x j Let d k = - J k -1 F k (Optional) Let k be a calculated step length Set x k + 1 = x k + k d k Test for Convergence or Failure Calculating the Direction Damping or Line Search Iterate Control (Solver) Building Blocks of NOX
Stopping Criteria (StatusTests) Highly Flexible Design: Users build a convergence test hierarchy and registers it with the solver (via solver constructor or reset method). –Norm F: {Inf, One, Two} {absolute, relative} –Norm Update X: {Inf, One, Two} –Norm Weighted Root Mean Square (WRMS): –Max Iterations: Failure test if solver reaches max # iters –FiniteValue: Failure test that checks for NaN and Inf on –Stagnation: Failure test that triggers if the convergence rate fails a tolerance check for n consecutive iterations. –Combination: {AND, OR} –Users Designed: Derive from NOX::StatusTest::Generic
Building a Status Test Fail if value of becomes Nan or Inf NOX::StatusTest::FiniteValue finiteValueTest; FiniteValue: finiteValueTest Fail if we reach maximum iterations Converge if both: MaxIters: maxItersTest NOX::StatusTest::MaxIters maxItersTest(200); normFTest NOX::StatusTest::NormF normFTest(); normWRMSTest NOX::StatusTest::NormWRMS normWRMSTest(); Combo(AND): convergedTest NOX::StatusTest::Combo convergedTest(NOX::StatusTest::Combo::AND); Combo(OR) allTests NOX::StatusTest::Combo allTests(NOX::StatusTest::Combo::OR); allTests.addStatusTest(finiteValueTest); allTests.addStatusTest(maxItersTest); allTests.addStatusTest(convergedTest); convergedTest.addStatusTest(normFTest); convergedTest.addStatusTest(normWRMSTest);
Status Tests Continued User Defined are Derived from NOX::StatusTest::Generic NOX::StatusTest::StatusType checkStatus(const NOX::Solver::Generic &problem) NOX::StatusTest::StatusType checkStatusEfficiently(const NOX::Solver::Generic &problem, NOX::StatusTest::CheckType checkType) NOX::StatusTest::StatusType getStatus() const ostream& print(ostream &stream, int indent=0) const -- Status Test Results -- **...........OR Combination -> **...........AND Combination -> **...........F-Norm = 5.907e-01 = 1) (Max Lin Solv Tol: 1.314e-15 < 0.5) **...........Finite Number Check (Two-Norm F) = Finite **...........Number of Iterations = 2 < 200 -- Final Status Test Results -- Converged....OR Combination -> Converged....AND Combination -> Converged....F-Norm = 3.567e-13 = 1) (Max Lin Solv Tol: 4.951e-14 < 0.5) ??...........Finite Number Check (Two-Norm F) = Unknown ??...........Number of Iterations = -1 < 200
93 NOX Interface GroupVector computeF()innerProduct() computeJacobian()scale() applyJacobianInverse()norm() update() NOX solver methods are ANAs, and are implemented in terms of group/vector abstract interfaces: NOX solvers will work with any group/vector that implements these interfaces. Four concrete implementations are supported: 1.LAPACK 2.EPETRA 3.PETSc 4.Thyra (Release 8.0)
NOX Interface Solver Layer Abstract Vector & Abstract Group Abstract Layer Solvers - Line Search - Trust Region Directions - e.g., Newton Line Searches - e.g., Polynomial Status Tests - e.g., Norm F Dont need to directly access the vector or matrix entries, only manipulate the objects. NOX uses an abstract interface to manipulate linear algebra objects. Isolate the Solver layer from the linear algebra implementations used by the application. This approach means that NOX does NOT rely on any specific linear algebra format. Allows the apps to tailor the linear algebra to their own needs! –Serial or Parallel –Any Storage format: User Defined, LAPACK, PETSc, Epetra
NOX Framework Solver Layer Abstract Vector & Abstract Group Abstract Layer Linear Algebra Interface Implementations - EPetra - PETSc - LAPACK - USER DEFINED EPetra Dependent Features - Jacobian-Free Newton-Krylov - Preconditioning - Graph Coloring / Finite Diff. Solvers - Line Search - Trust Region Directions - e.g., Newton Line Searches - e.g., Polynomial Status Tests - e.g., Norm F Application Interface Layer User Interface - Compute F - Compute Jacobian - Compute Preconditioner
The Epetra Goodies Matrix-Free Newton-Krylov Operator Derived from Epetra_Operator Can be used to estimate Jacobian action on a vector NOX::Epetra::MatrixFree Finite Difference Jacobian Derived from an Epetra_RowMatrix Can be used as a preconditioner matrix NOX::Epetra::FiniteDifference Graph Colored Finite Difference Jacobian Derived from NOX::Epetra::FiniteDifference Fast Jacobian fills – need connectivity/coloring graph (NOX::Epetra::FiniteDifferenceColoring) Full interface to AztecOO using NOX parameter list Preconditioners: internal AztecOO, Ifpack, User defined Scaling object
Similar presentations
© 2017 SlidePlayer.com Inc.
All rights reserved.


text:
Harpersville AL Real Estate & Homes for Sale
8 Properties Found
The median home value in Harpersville, AL is $148,067.
This is
lower than
the county median home value of $183,600.
The national median home value is $185,800.
The average price of homes sold in Harpersville, AL is $148,067.
Approximately 65.55% of Harpersville homes are owned,
compared to 16.67% rented, while
17.79% are vacant.
Harpersville real estate listings include condos, townhomes, and single family homes for sale.
Commercial properties are also available.
If you see a property you're interested in, contact a Harpersville real estate agent to arrange a tour today!
Sort Results:
1 - 8 of 8 Properties Displayed
Refine Property Search
Page 1 of 1 Prev | Next
Courtesy: RE/MAX Southern Homes-280
View additional info
Resort style living on a beautiful lakefront property. Deerwood Lake is an exclusive gated community of 40 lots surrounding an 110 acre lake. This 4BR home features walls of windows with gorgeous views of the lake. Enjoy one level living in the dramatic cathedral ceiling great room, complete with brick gas log fireplace and lovely lake views. The kitchen is a cooks dream with gas stove, a whole wall of cabinets, gigantic eat-at island and butlers pantry. The Owners suite features a large sitting area, again overlooking the peaceful lake. Masterbath is well-appointed with dual vanities, an over-sized glass shower and large jetted tub. ML Laundry/Mud room. 2 additional BRs and full baths also on the ML. Upstairs is an optional 4th BR, library and/or huge bonus/rec room. Outdoor spaces include a deck, covered patio, swim dock and screened porch on the lake. Full basement with tall ceilings and stubbed in and ready for finishing. Full bath finished in basement. So much to see!
Courtesy: RE/MAX Southern Homes-280
View additional info
Spectacular Lakefront setting! Custom built, architect designed everything on one level! Unbelievable out door entertaining area with all the way across the back of house plus a cool screen porch. There is also a deck built across the shoreline plus boat house with extra storage. The home is a true work of art! Open plan with tons of exposed beams, vaulted ceilings, floor to ceiling Pella windows, hardwood floors, custom stone work! Top of the line eat-in Kitchen with stainless appliances, 5 eye gas cook top, breakfast bar and pantry. Great room with built-in book cases & stacked stone fireplace. Spacious master suite also has stacked stone fireplace and opens to the deck, master bath w/jetted tub and separate shower. Bedroom 2 & 3 share a jack and jill bath. Cool natural wood screen porch and massive party deck! Special lake home only minutes from Birmingham!
Courtesy: Keller Williams Metro South
View additional info
Welcome Home! Dont miss this 3 Bedroom charmer with gorgeous updated kitchen including new counter tops, tile back splash, and tile floors. Original hardwood floors add character and charm to this 1 level, full brick home sitting on .89 acres. Separate dining room that could be used as a home office or entertainment room. Mud room and separate laundry room with new flooring and plenty of room for storage. New faux-wood blinds and fresh paint throughout. Roomy covered front porch perfect for rocking chairs and quiet evenings. Separate storage building in large, level back yard for lawn equipment and all of your toys! Great location just off Hwy 280 in Harpersville. Home has a storm cellar (located/access under carport) Close to local eats, gas stations, and shopping.
Courtesy: Coldwell Banker Preferred Prop
View additional info
This quintessential southern plantation home was built in 1875, and still holds the character of the original hardwood floors and timeless details. The high ceilings and large open rooms allow for perfect social gatherings, and the 3 surrounding porches are perfect for sipping and conversation. Shiplap walls in the dining room, and wainscot backsplash in the kitchen make for the ideal Southern Living accents. The clawfoot tub in the main level bath, and the spacious walk-thru closet in the upstairs add the right touch to the 2 bathrooms and 3 bedrooms. The laundry room can serve as a mudroom room placed just off the patio. The 3.44 acres are fenced with a 3 stall barn, and The Henny Girls have their own separate chicken coup. With this beautiful and loved historical house, you arent just buying a home, you are buying a piece of times gone by...dont let this opportunity slip you by. Welcome home!
Courtesy: RealtySouth-Inverness Office
View additional info
Home needs some TLC. Priced accordingly. Home is to be sold in as is condition.
Courtesy: Killough Bailey Properties LLC
View additional info
PRICE REDUCED!!!THE IDEAL PLACE AS A HUNTING RETREAT OR SMALL FARM - A perfect mixture of open pasture land, old growth hardwoods, creek/swamp, and a small pond! This property also offers a timber cabin, barn, equipment shed, and storage areas. The pastures are level and fenced/cross-fenced with excellent grazing and/or can be used for organic farming. With the creek area, hardwoods, as well as, pasture land it is ideal for waterfowl and deer hunting. Located in Harpersville, Alabama, it is only a short drive from Birmingham. To list a few of the many other amenities: kitchen with bar counter, second bedroom, wood-burning fireplace, large porch on three sides, storm shelter, city water and a well. One needs to explore this ideal Hunting Retreat/Small Farm for themselves to totally appreciate all it has to offer. Please call to schedule your private showing.
Courtesy: Weichert Realtors, Lowe Realty
View additional info
This one level must see brick home located along Hwy 280 is priced just right to sell. It would be a great starter home or perfect for retirees. It has 2 storage buildings and a RV Carport as well.
Courtesy: RealtySouth-MB-Cahaba Rd
View additional info
DEERWOOD LAKE is approximately 25 minutes from Birmingham and is a world away. This home sits on the best lot in the lake community. Amazing beauty. Home has been extensively updated: New chefs kitchen in 2005 (Wolf, Sub Zero, Thermador and Fisher & Paykel appliances); new windows in 2015; exterior painted and caulked in 2015; chimney and foundation rebuilt in 2015; plantation shutters throughout; tankless hot water heater; 300 to 500 gallon sunken LP tank for gas stove, H20 and grill. Boat house with two slips. Decks and fabulous screened porch. Sprinkler system for the manicured lawn. Incredible home and opportunity to truly enjoy the beauty of Deerwood Lake.
Refine Property Search
Page 1 of 1 Prev | Next
1 - 8 of 8 Properties Displayed
How may I help you?
Get property information, schedule a showing or find an agent
Harpersville ZIPs35078 Homes for Sale


text:
Gals are showing off what they have
horny girls getting what they want movie film 1
Sucking is what they love to do when they are horny
Gals crave for licking enjoyment
These two guys know what they want and what they want is to kidnapped...
Lustful luscious girls getting what they wish
lovely ladies getting freaky as they fuck and lezz out
Horny gals getting fuck with big cocks
Horny german bitches show what they've got
Horny gals getting fuck with big cocks orgy style
Cute american twinks gay porn They liked what they were doin
These two are true exhibitionists, its clear they love what they do....
They know what they want
Lovely India Summer getting horny
TrafficHolder.com - Buy and Sell Adult Traffic|Trafficshop.com - Let your business grow|Contact Us|Webmaster
All content, including images, text, graphics, video and audio content contained in the website is protected under the laws of copyright, owned or under license to company or its designees,and represents proprietary and valuable intellectual property.
Contact Webmaster 18 U.S.C. 2257 Record-Keeping Requirements Compliance Statement
Powered by Stream Rotator


text:
Hotel Globales Bouganvilla
Service & facilities
|Earliest check-in
|Latest check-out
Service & facilities
Hotel facilities
- Reception (lobby)
- Public Internet terminal
- Car park is directly by hotel
- TV room
- No-smoking room 614
Room facilities
- Satellite TV
- Telephone by the bed
- Room safe
- Windows for opening
- Hairdryer
In-house services
- Multilingual staff on hand 24 hours a day
- BBQ facilities
- Car rental
- Laundry service
- Pets not allowed
Style of hotel and ambience
The family hotel Bouganvilla is a modern and comfortable apartment complex on Mallorca island, suitable for both couples and families. The apartments are equipped to modern standard and include balcony or terrace. Some provide a small kitchen. Furthermore, two beautiful swimming pools, three pools for children with water slides and many animation programmes are offered.
Special features of the hotel
2 adults pools and 3 children's pools. 46.000m2 for activities, sports, or just to relax. Wide range of entertainment, mini club, evening shows. Wide range of food to choose from.
Hotel data
Hotel built in 1988, Last complete renovation 1995, Last partial renovation 2008, Number of floors 3, Total number of rooms 614, Number of single rooms 0, Number of double rooms 614, Number of apartments 614, Holiday apartments, Apartment/Suite hotel, Holiday hotel, Beach hotel, child-friendly hotel, Family hotel
Service times
Reception open:
12:00 AM to 12:00 AM
Reception manned at weekends:
12:00 AM to 12:00 AM
Earliest check-in:
Latest check-out:
Accepted payment methods
- Visa
- Eurocard/MasterCard
C Margaritas 21, 07560 Sant Llorenç des Cardassar - Illes Balears
The hotel Bouganvilla is located in the village of Sa Coma. A beautiful sandy beach, easily accessible with a free train from the hotel, is one kilometre away. The airport is 75 kilometres away from the hotel Bouganvilla.
- 7.88 km
- 55.12 km
- Tennis court: 0.0 km
- 18-hole golf course: 10.0 km
- Beach: 1.5 km
- Water skiing: 1.5 km
- Sailing: 1.5 km
- Surfing: 1.5 km
- Beach volleyball: 0.0 km
- Boat trips: 1.5 km
- Table tennis: 0.0 km
- Billiards: 0.0 km
- Miniature golf: 2.5 km
- Bike rental: 0.0 km
- Riding facilities: 2.0 km


text:
Subbing for later reading
Subbing for later reading
I find a lot of the keys to a lunch box success is the prep and equipment.
I got ds a freezable reusable container for his yoghurt (it's still cold at 3pm) instead of using expensive pouches we buy a big tub for the whole family.
We also have a few smaller ice bricks to really surround all his containers and keep them chilled all round and a compartmentalised lunch box so things don't get smushed, bruised or soggy.
Some recipes that make things easy..
We freeze small meatballs, ATM they are chicken, bacon & zucchini
Frozen slices of frittata
Frozen vegemite scrolls
Frozen scones or rock cakes
I bake in bulk and freeze after cutting. So we just grab a portion each morning from the freezer, by the time he has lunch they are still cold and ready to eat.
Most days he also has some cheese, tin of tuna and crackers with a disposable fork so it doesn't matter if it gets lost.
Fruit - grapes, banana or cut up apple
And today he has left over homemade crumbed chicken tenders and some cherry tomatoes plus carrot sticks and a small container of hommus.
Ds for some reason doesn't like sandwiches. He always wants lots of little things and his lunch ends up looking like an antipasto platter.
http://www.barbellsandbellinis.com/2...bread.html?m=1 this 'healthier' recipe to make mini banana bread muffins. Added frozen raspberries and shredded coconut. ImageUploadedByThe Bub Hub1423535968.898241.jpg
Will freeze and put a couple in daycare lunches each day.
Amgine (12-02-2015)
I haven't read all the posts, so sorry if repeating anyone.
It may sound ridiculous, but sometimes, when I changed the look of something/ or the way I described it my DS ate it. i.e. Soft boiled eggs became "dippy eggs with soldiers (toast fingers), or a salad sandwich became a salad face on a plate.
Or I grated carrot and lightly fried (with spray oil) and called in Orange pasta Etc
Of course not everything works and it might work one day but not the next.
just some ideas
Just saw this recipe on good chef bad chef : frozen mint and cacao chia balls - I might try make them on the weekend
ImageUploadedByThe Bub Hub1424237206.192907.jpg
Catzilla (18-02-2015),MadeWithLove (18-02-2015)
Pregnant for the first-time?
Not sure where to start? We can help!
Our Insider Programs for pregnancy first-timers will lead you step-by-step through the 14 Pregnancy Must Dos!


text:
Displaying 1 - 10 of 39 results
Sort by
Parishes: Goodneston
The History and Topographical Survey of the County of Kent: Volume 9
for this manor. ROLLING, usually called Rowling, is a manor and hamlet ... situation. At the northern boundary of the parish is the hamlet of Twitham, ... At the...View result
Parishes: Braborne
The History and Topographical Survey of the County of Kent: Volume 8
At the foot of the hills westward are Combe, Bedlestone, the hamlet of West ... the liberty of the royal manor of Wye. THE MANOR OF BRABORNE, soon ... loads of wood, and twenty hens. Who were the...View result
Parishes: Crundal
The History and Topographical Survey of the County of Kent: Volume 7
or hamlets, one in the valley, called Danord, corruptly for Danewood-street; ... from the manor of that name, the house of which is situated on the western bounds ... THE ROYAL MANOR OF WYE...View result
Parishes: Eastry
The History and Topographical Survey of the County of Kent: Volume 10
lies the hamlet of Updown, adjoining to Ham and Betshanger, in the former ... adjoining to Tilmanstone, lies the hamlet of Westone, formerly called ... in this parish, is yet within the hundred of Downhamford and...View result
Freebridge Hundred: Sechey Magna, and Hardwick
An Essay Towards A Topographical History of the County of Norfolk: Volume 9
AND HARDWICK, Are two hamlets belonging to North Rungton: Setche Magna ... over which there is here a bridge. It was part of the Lord Bardolf's manor of Rungton, and that lord ... as above, and was part of the...View result
Parishes: Upwood
A History of the County of Huntingdon: Volume 2
belonging to the demesne of the manor, namely, Bottenhale, Uppenhale ... are the initials and date M / RE 1677. The Manor House stands to the west of the High ... on whom it was settled in 1578. It was built by...View result
Kidlington: Manors and other estates
A History of the County of Oxford: Volume 12, Wootton Hundred (South) Including Woodstock
Kidlington Manors and other estates Manors and other estates In 1086 Robert d'Oilly held KIDLINGTON in demesne, 91 and the manor descended ... Plessis, who entered on the manor on...View result
Parishes: Lindridge
A History of the County of Worcester: Volume 3
and Lindridge. There is no village at Lindridge, but at Eardiston, a hamlet ... Longstaffe, Menney Wood, 15 Milne Leasowes 16 (xvii cent.). MANORS The manor ... it is, however, clear that it...View result
Parishes: Burnham with Lower Boveney
A History of the County of Buckingham: Volume 3
down to Lent, a small hamlet and ancient liberty of the parish. On the eastern side it becomes later Britwell Road, connecting Burnham with the hamlet ... manor-house of East Burnham or Allards,...View result
Wisbech Hundred: Newton
A History of the County of Cambridge and the Isle of Ely: Volume 4, City of Ely; Ely, N. and S. Witchford and Wisbech Hundreds
defined, and the small hamlet of Fitton End lies across this boundary. ... as lord of the manor, claimed the ownership of the soil of all the common ... 948 acres), held by 32 owners, 9 together with the ...View result


text:
27,593 likes
frenchmontanaMe and @jlo new video I love her the #ny queen #southbronx #miami
- cesaropradooShe lools damm fine af
- cesaropradooLatin queen#1
- quan__finestI love and admire both of you! we lived in the same hood [Tremont) & jlo shot hold you down wit joe in front of my house on Tiffany! shit crazy small world. love where we come from #southsidebronx
- quan__finest@jlo
- quan__finest@frenchmontana
- sabry_zaeemdamn she piff and still look young french must of tapped yjay ayleast onece
- keciacastelinax#Jheeeeze #HAAAAN #Frenchy ♥♡♥♡♥
- chydollazDo it for diddy @iamdiddy
- simply_rubiaWheres her booty tho? @frenchmontana
- jaebashdamn dog
- jaebashthats some cray shit tho hahah good shit
- dnice.bniceHaaan 💋
- will_vitaliYeaa this niggaa
- jes.sennJlo even likes em ;) 😍😍😍 @lalo___23
- coacho.g#latinaslovemoroccans @frenchmontana
- g_mariealvarez@gabrielacfalcon hell yeah 😍
- lovegodmeYou always look awesome
- curli3_locksoh no 👋 the NY queen... gettttt DafUK out of here... please that bitch need to take a seat... #sitDown
- 1derfullyfe247_w_uLook whos talking. . Lol
- mzkizzy15She's on him kinda hard, im seeing her more than Chloe. Jlo thirsty ass fucked him.
Log in to like or comment.


text:
Rethinking Democratic Accountability
By (author) Robert D. Behn
Format: Paperback
Normal Price: $39.99
Your Price: $35.99 AUD, inc. GST
Shipping: $7.95 per order
You Save: $4.00! (10% off normal price)
Plus...earn $1.80 in Boomerang Bucks
Availability: Available to Backorder, No Due Date for Supply
Rethinking Democratic Accountability by Robert D. Behn
Book DescriptionTraditionally, American government has created detailed, formal procedures to ensure that its agencies and employees are accountable for finances and fairness. Now in the interest of improved performance, we are asking our front-line workers to be more responsive, we are urging our middle managers to be innovative, and we are exhorting our public executives to be entrepreneurial. Yet what is the theory of democratic accountability that empowers public employees to exercise such discretion while still ensuring that we remain a government of laws? How can government be responsive to the needs of individual citizens and still remain accountable to the entire polity? In Rethinking Democratic Accountability , Robert D. Behn examines the ambiguities, contradictions, and inadequacies in our current systems of accountability for finances, fairness, and performance. Weaving wry observations with political theory, Behn suggests a new model of accountability uwith "compacts of collective, mutual responsibility" uto address new paradigms for public management.
Buy Rethinking Democratic Accountability book by Robert D. Behn from Australia's Online Bookstore, Boomerang Books.
Book DetailsISBN: 9780815708612
(229mm x 152mm x 19mm)
Pages: 328
Imprint: Brookings Institution
Publisher: Brookings Institution
Publish Date: 1-Jul-2000
Country of Publication: United States
Other Editions...
Books By Author Robert D. Behn
Performancestat Potential, Paperback (July 2014)
It started two decades ago with CompStat in the New York City Police Department, and quickly jumped to police agencies across the US and other nations. This book analyzes the leadership behaviors at the core of PerformanceStat to identify how they work to produce results.
Leadership Counts, Paperback (December 1994)» View all books by Robert D. Behn
How can public officials move large government agencies to produce significant results? In "Leadership Counts" Robert Behn explains exactly what managers in the inherently political environment of government need to do to obtain such performance.
» Have you read this book? We'd like to know what you think about it - write a review about Rethinking Democratic Accountability book by Robert D. Behn and you'll earn 50c in Boomerang Bucks loyalty dollars (you must be a member - it's free to sign up!)
Author Biography - Robert D. Behn
Robert D. Behn is professor of public policy at Duke University's Terry Sanford Institute of Public Policy and director of The Governors Center. He is the author of Leadership Counts: Lessons for Public Managers (Harvard, 1991) and writes the management column for Governing.
Facebook Page | Twitter | Google+ | Bulletin e-Newsletter | Blog | RSS
Become a Member | Book Lists | Recently Released | Coming Soon | Fast Delivery Books
Bestselling Books: Our Current Bestsellers | Australia's Hottest 1000 Books | Bestselling Fiction | Bestselling Crime Mysteries and Thrillers | Bestselling Non Fiction Books | Bestselling Sport Books | Bestselling Gardening and Handicrafts Books | Bestselling Biographies | Bestselling Food and Drink | Bestselling History | Bestselling Travel Books | Bestselling School Textbooks & Study Guides | Bestselling Children's General Non-Fiction | Bestselling Young Adult Fiction | Bestselling Children's Fiction | Bestselling Picture Books | Top 100 US Bestsellers
For: Schools | Organisations | Libraries | Publishers | Authors | Book Clubs | Bloggers | Affiliates
About Us | Contact Us | Help Desk | Security | Privacy | Terms of Use | Copyright
Phone: 1300 36 33 32 (9am-5pm Mon-Fri AEST) - International: +61 2 9960 7998 - Online Form
Address: Boomerang Books, 878 Military Road, Mosman Junction, NSW, 2088
© 2003-2017. All Rights Reserved. Eclipse Commerce Pty Ltd - ACN: 122 110 687 - ABN: 49 122 110 687
For every $20 you spend on books, you will receive $1 in Boomerang Bucks loyalty dollars. You can use your Boomerang Bucks as a credit towards a future purchase from Boomerang Books. Note that you must be a Member (free to sign up) and that conditions do apply.


text:
Tolentino of Winnipeg said: "Mike did my sunroom. He is a nice person as well as a contractor. He finshed the project as per agreed completion date. Also his price is so much lowe...Read more
Have you hired Big Rock Construction Inc? Write a review and share your experience!
Have you hired Slimline Sunrooms? Write a review and share your experience!
Have you hired Glastar Sunroom? Write a review and share your experience!
Description: Parkview Renovations Ltd. is a Family owned and operated business. We specialize in Additions and Renovations. Quality Renovations with a 2 year warr...more
Not sure which contractor to call for your sunroom project? Post your project and let local, top-rated pros come to you and compete for your job!
If you can't find the company you hired and want to submit a review, add them to the TrustedPros directory.
Post your project and within hours you'll be comparing offers from top-rated and trusted
professionals. It's free to post and you're under no obligation to hire.
Post your project and compare offers from top-rated pros.


text:
|Contact HR People + Strategy
Member Care Center
If you have questions or need assistance, please contact HR People + Strategy Member Care Center
9:00 a.m.–5:00 p.m. EST, Monday–Friday
1.888.602-3270 (U.S. & Canada)
Headquarters — Alexandria, VA
1.703.535.6056 (Direct Phone)
1800 Duke Street.
Send dues, registration or other payments to:
How Can We Assist You?
(FLHRPS Affiliate) Creating a Culture of Career Development to Increase Employee Engagaement


text:
iPhone apps
BIGSCORE: Baseball Scoreboard
## Top 30 Sports in 5 Countries #### App Store What's Hot! ##This is Baseball Scoreboard for iPad. You can use any situation, school, club team, etc.BIGSCORE is very easy to use. You need only touch on the iPad! And you can write score, member….. Read more
iPad Screenshots
Video Reviews
No video review..
Customer reviews
Be the first to review this app. Write a Review
Be the first question this app.
Users Community
The information may be outdated. For actual information go to iTunes
Related to «BIGSCORE: Baseball Scoreboard» applications
BIGSCORE: Football Scoreboard
BIGSCORE series for Football Scoreboard. You can very easily keep score. You just touch the iPad, then score is coming! All One-touch operation! You can use any situation, school, club team, etc.If… [more..]
Price: $0.99 |
Baseball Scoreboard Stratman
Baseball Scoreboard Complete baseball scoring app. It is so easy to score a game you can do it while coaching 1st or 3rd , in the dugout or anywhere else on or off the field.The baseball scoreboard… [more..]
Price: $4.99 |
My BaseBall ScoreBoard
My BaseBall ScoreBoard is your personal BaseBall Game ScoreBoard. Application allows you have your own scoreboard for your game, your son/daughter's game or any game you want to track. No need to… [more..]
Price: $0.99 |
Baseball Scoreboard
Now, finally a Baseball Scoreboard on your phone. Keep track of the score to all the little league, softball games you attend. Nothing is more annoying then being at a game and not knowing the score… [more..]
Price: $0.99 |
Baseball Scoreboard -ATBaseball
ATBaseball is a handy scoreboard for baseball and softball games. Just tap on the ball on the top or bottom of the screen, you will easily add points to home or guest team. If you have added a point… [more..]
Price: $1.99 |
Lazy Guy's Baseball Scoreboard
Keep score at the ball park with the easiest to use baseball scoreboard App on the market, allowing you to keep your attention fully on the game.Optionally track ball-strike count as well as number of… [more..]
Price: $0.99 |
Lazy Guy's Baseball Scoreboard Free
Keep score at the ball park with the easiest to use baseball scoreboard App on the market, allowing you to keep your attention fully on the game. Optionally track ball-strike count as well as number… [more..]
Price: free |
Baseball Game Scoreboard
Baseball Scoreboard is great for keeping game score at Little League, school games, YMCA game or anywhere you need it. Baseball Scoreboard is equipped with the features you need wrapped into a simple… [more..]
Price: $0.99 |
Red Sox Fan - Boston Baseball, News, Scoreboard,…
Red Sox Club Fan! Come join the Red Sox Community for the latest news, videos, scoreboard, photos and more! [more..]
Price: free |


text:
Does He Know Your Name?
A Friend that Sticks Closer than a Brother
Every time my heart feels low and I feel like the whole world is against me, I often remember the Psalmist saying, "Abba I waited patiently, you turned to me and heard my cry, set my feet on a rock, put a song in my mouth, a song of praise to You, a hymn of praise to my God" (Psalm 40)
For those of you who dont know Abba is transliterated from the Aramaic and it means Papa.
It is an endearing way that the Psalmist David cries out to His Papa as he awaits for his heavenly Father to answer the call of his heart.
When David was out in the fields tending his fathers flock he spent many nights speaking to his heavenly Father and hearing the voice of God out in the wilderness through the Holy Spirit pouring out a new hymn to his God, a psalm that bore witness of God's love for him.
During his lowest times, David would recall these psalms of God's never ending love for him, and God would assure David that He knew David intimately. Because God knew David by name (on a first hand basis) David now had the capacity to know God (his character, his person, his ways) in an intimate way that would cause total assurance to swell up in David's soul to the reality that He knew who he was because of his intimate relationship with God.
We too must learn our identity that comes from the intimacy of knowing God by His name and acknowledging that there is no one else in heaven or on earth that will ever know us as intimately as God the Father knows us.
The Father knows your name, now are you willing to come and learn His name? Will you dare to get close and find out that you have a friend that sticks closer than a brother?
Rest Assure Your Maker Knows You Intimately
More by this Author
- 11
Servant Leadership: A Challenge to Become Great in God's Kingdom Today, many believers are seeking to be mentored by sincere, genuine faithful leaders. Unfortunately, throughout the years, the...
- 14
Christmas surely is a time of jubilation, of great and victorious praise for the remembrance of Christ's first advent. We are filled with joy, hope, and great love. Our outlook in the midst of winter changes from gloom...
- 9
This is a very short book with only three chapters, written by Habakkuk. Habakkuk is a professional prophet who pursued his ministry in the temple in Jerusalem. As a prophet, serving in the temple, his ministry would...
16 comments
Very good observations, and so true! Thank you for the uplifting message!
I enjoyed reading your work. Very encouraging.
"We too must learn our identity that comes from the intimacy of knowing God by His name and acknowledging that there is no one else in heaven or on earth that will ever know us as intimately as God the Father knows us."
...simply lovely pure and true
There are many who say they know Jesus, though the real question is,"Does He know me?" If He does, than you will then one day be able to say,"I am who God says I am."
Likewise, many of us are quick to say we trust God, though the real test comes as we go through tests and tribulations. Will we still have faith? Will we still praise Him?
Will we still love Him when our change is strange and our money gets funny?
More to the point, Does God trust YOU?
Thanks for a short and to the point Hub which shows us David's need and strong desire to develop and maintain an intimate relationship with God. Something we all need to do.
He never said we would not have troubles. Through Him, we find we don't have to allow troubles to have us!
Beautiful!!!! So GLAD brother Unchained Grace posted this hub link on Facebook and I found you!!!! Welcome to HubPages! Thank you for shining our Lord's love and Light!!
Amen. though I was like to David feeding the flocks, but in my young Christian life. spending time with the Lord is my most enjoyable time for the day. I will sing and read His words especially book of Psalm and those words would appear like Reimar word to me and they comfort my soul.
am new here but i hope i will be blessed thru this.
Very beautiful!!! I'm glad i dropped by and read this hub!


text:
Is Khutso Kalapeng Funeral Services incorrect or missing key business information? Update your Hotfrog listing today.
Contact details
Are these details correct?
Hotfrog SouthAfrica provides information regarding Khutso Kalapeng Funeral Services in Klerksdorp Western Cape. Khutso Kalapeng Funeral Services is located at 7 Mercury Rd, Klerksdorp Western Cape 2571 and provides Funeral Services services. Contact them on 018 469 2463.
Is Khutso Kalapeng Funeral Services in 7 Mercury Rd, Klerksdorp Western Cape 2571 your business? Claim your listing and attract more leads by adding more content, photos and other business details.
We have more Funeral Services services in Klerksdorp Western Cape available on Hotfrog SouthAfrica. You can update your search for Klerksdorp Funeral Services by location, keyword or service options.
79 Williams Street Wilkoppies Klerksdorp Western Cape
Stand No 4013 Ext 7 Klerksdorp Western Cape 2571
Noordstraat 2A Klerksdorp Western Cape 2570
2 Terblanche St Klerksdorp Western Cape 2571
Small Business Hub
Sharing tips, ideas and advice to help grow your small business.
Your profile without ads
Have you considered upgrading to Hotfrog AdVantage? No competitor advertising means exclusive focus on your business. You take centre stage.
Create your free Hotfrog business profile
Follow Hotfrog on:
Share on:
Hotfrog Small Business Hub


text:
DIRECTV's TV Service is Recommended by CableTV.com
Are you searching high and low for the best TV service provider in Masonville? Your search just got a lot easier, thanks to CableTV.com! We take the results of independent consumer surveys and use them to rate the cable companies and television services available in your area. With all our research, we've found that DIRECTV is the best provider of all satellite TV and cable companies in Masonville, CO.
Major networks are typically available nationwide, but smaller channels may only be offered with select TV packages in Masonville. This means that weighing channel choices is just as important as considering cost when choosing the best cable company in Masonville, CO. Let's say that you want to invite friends over to watch the latest or Denver Broncos game—depending on your area, you may need a premier package with extra channels in order to get the coverage you're after. With our info on the highest rated providers available in Masonville, it's easier than ever to compare channels, prices, and extra features, and choose a provider you'll be happy with.
When you're making a commitment to a cable company in Masonville, CO, it's important to take a look at their customer service ratings and past reviews about their reliability. Fortunately, you can find all the tools you need to find the best possible provider at CableTV.com. In fact, CableTV.com keeps customer service and reliability in mind when rating and recommending TV providers. So take advantage of these recommendations and increase your chances of enjoying great customer support and fewer problems with your service.