text:
From SRB
General Information
What does the SRB do?
As the name implies the Storage Resource Broker, brokers storage resources (sorry, couldn't resist). It provides access, via a uniform API, to various types of data storage across local and wide-area networks, and maintains meta-data (data about the data) about each stored object (files). SRB, in conjunction with MCAT, provides a means for accessing data objects and resources through querying their attributes instead of knowing their physical names and/or locations.
The SDSC Storage Resource Broker (SRB) provides the abstraction mechanisms needed to implement data grids, digital libraries, and persistent archives for data sharing, data publication, and data preservation.
Many people, using only a subset of the features, find that using the SRB as global file system is its most compelling function. Users of multiple distributed computing systems find it to be an essential tool to easily and quickly access files from various locations. With the SRB's parallel I/O capabilities, the SRB will transfer files at least as quickly as any other mechanism, and usually faster.
What is zoneSRB? or How can I federate SRB systems?
ZoneSRB (or federated MCAT SRB) is the next generation of the SRB released as Version 3.0. It provides facilties for two or more independent SRB systems to interact with each other and allow for seamless access of data and metadata across these SRB systems. These systems are called the 'zones. More information about zoneSRB can be found at Fed MCAT.
What kinds of resources does the SRB support?
Storage resources can be directories in Unix file systems, directories in Windows file systems, archival storage systems such as HPSS (and, previously, UniTree and DMF), binary large objects stored in a DBMS (DB2, Oracle, Illustra), database SQL-queriable objects in DB2 or Oracle, and tape library systems. Tape systems can be combined with disk cache into Compound Resources, and the SRB can function as a complete basic archival storage system. SRB includes a set of tape I/O functions and an interface to the STK tape library system.
Is the SRB Open Source?
No, not exactly, although the full source code is readily available to academic organizations and government agencies. The normal distribution is via source. The client sources, that is the Scommands, client C library, inQ, and Jargon, are freely available via a BSD license. Interfaces on top of these, Matrix for example, are also readily available. For commercial applications, please contact the UCSD Technology Transfer & Intellectual Property Services at email@example.com. See Is_SRB_Open_Source for more information.
How does the SRB compare to commercial software?
As far as we know, there is no commercial product much like the SRB (except for the commercial version of the SRB, see below). The biggest difference between commercial software and research products like the SRB is the lack of a Quality Assurance testing group. But we do a lot of testing of new features, as do our collaborative sites, and we have recently developed some automatic testing scripts and systems. SRB is also a mature product as it has been in production use since 1997. In 2000, a government agency thoroughly examined the code and provided us with fixes (memory overruns, etc). The design is such that most problems are fail-safe, due the the client/server design, and cross-checks within our MCAT library and of the DMBS systems themselves. We build on the quality and robust-features of modern DBMSs.
Is there a commercial version?
Yes, General Atomics has certain exclusive commercial rights. See http://www.nirvanastorage.com. Nirvana Storage's SRB software split from SDSC SRB software in version 1.1.8 in 2001. Since then SDSC has released multiple versions of the SRB software with substantial enhancements including Zones, Bulk Operations, improved administration/installation, stronger security, extended clients such as inQ, JARGON, MySRB, Matrix and Kepler, and extended metadata capabilities.
How does the SRB relate to Grid technologies?
In many ways:
a) The SRB is a complete data Grid system in itself, and has been since SRB 1.0 in 1997. It operates, in production, as collections of client and server hosts distributed across local and/or wide-area networks, cooperating to provide transparent access to storage resources, data, and meta-data (data about data).
b) We are participating in many data grid research and development / production collaborations, including PPDG, GriPhyN, BaBar, CDL, NASA Information Power Grid and many more. The SRB is either used in production or is being evaluated across multiple projects at NSF, NASA, DOE, DOD, NIH, NLM, NARA, and the Library of Congress. See Projects
c) We support the Globus Grid Security Infrastructure (GSI) as an
optional method of authentication.
d) The SDSC Matrix workflow management system is
a grid-based system and uses a Web Service Definition Language (WSDL)
e) We plan to develop an OGSA-compliant SRB.
Is the SRB middle-ware?
Yes and no. It can be considered middle-ware like other grid technologies as it can be combined with higher level software, can interoperate with other grid components, and depends on other lower-level systems (archives, file systems, networks, a DBMS for the metadata catalog, etc). But unlike many other middle-ware components, SRB does not have to be combined with higher-level software to be utilized. With the various clients (Scommands, inQ, mySRB, etc), SRB is also a complete solution itself, a functional whole.
How secure is the SRB?
The SRB is quite secure. No computer system is perfectly secure, but the SRB provides a reasonable level of security while still providing convenience features and high performance. The Encrypt1 challenge/response is secure against network eavesdropping, while the use of user passwords is convenient and straight-forward for both users and administrators. Placing user passwords into files on host systems is a convenience, although if a host is compromised, those files could be read and the user's SRB identity assumed. GSI is also secure against network eavesdropping and somewhat less vulnerable against compromised hosts as only temporary delegation certificates are stored in files.
Generally, the SRB is as secure as the DBMS used to store the MCAT and the physical resources used to store the data. User identity is as secure as the client host system.
Since the SRB server runs as a non-root user, it does not present a vulnerability to the OS if compromised. This is a big advantage over software systems that need to be run as root.
Starting in April 2004, SRB releases include a paper describing how to run a secure SRB system: readme.dir/srb-security.html.
Starting with SRB 2.1 (late May, 2003), we provide a mechanism by which SRB data files can be encrypted for both network transmission and storage. This system provides security against network eavesdropping for the data objects exchanged via the SRB and also improves the security of the data objects as they reside on any of the various physical resources. This system was implemented to be efficient, although the encryption and decryption is always a compute-intensive operation and there will be some unavoidable performance penalty. See Secure Compressed Data for more information.
How fast is the SRB?
For transferring large files, SRB will normally be significantly faster than FTP, SCP, or NFS and the like, because of the SRB's parallel I/O capabilities (multiple threads each sending a data stream on the network). Sreplicate and Scp use parallel I/O for large-file data transfers by default, and you can use the -m option on Sput and Sget to select parallel I/O.
For small files, transfers can be a little slower due to the additional interaction with the MCAT (especially to a remote MCAT), but you can use Containers and/or Sbload (Bulk load) and Sbunload (Bulk unload) to greatly speed these. For more information see, the man pages and Containers questions in this FAQ. We are working toward enhancing Sget and Sput to do bulk operations to non-container files to speed them up too.
How was the SRB developed?
We were funded through a series of research/development proposals. After the initial version, we used the SRB as a basis for additional proposals and applied research projects. Because of this, the SRB is very customer driven, as we strive to meet the specific needs of current projects. Since the projects are similar in nature (at the SRB level), they often share a similar set of requirements, and we can usually leverage the development for one project to assist in other current and/or future projects. In this sense, the SRB provides a uniform data management fabric layer to build large applications.
How many people work on the SRB?
The SDSC SRB Team is currently about 11 people (depending how you count). We also encourage others to develop and share new features. We have integrated a number of capabilities developed outside the core group. We receive a lot of advice and suggestions from the community, both formally and not.
What support is provided?
We will freely provide answers and provide some limited support to help get sites up and running with the SRB. There is a srb-chat email list for SRB admins, developers and users to discuss questions, problems, and solutions (it includes an archive of previous posts). Our web site includes information on current bugs, future plans, current projects, etc. The SRB tar release contains many README files to explain installation and operation. Of course, many of our activities are collaborative funded projects which include specific development tasks and more extensive support.
What operating systems does the SRB run on?
SRB has been ported to a variety of Unix platforms including Linux, Mac OS X, AIX (ex. SP-2 machines), Solaris, SunOS, SGI Irix and to Windows. The Windows version of the Server cannot be configured with an MCAT (so it talks to one that is), but can store and retrieve data from the Windows file system. SRB is easily portable to Unix-type OSes.
What authentication mechanisms are available for SRB?
SRB supports three types of authentication: 1) A basic password-based authentication (now phased out), 2) password-based authentication in which the password is used in a challenge-response protocol so no plain-text password is sent on the network ("Encrypt1"), and 3) GSI authentication. Encrypt1 is a simple and secure stand-alone authentication system. In both password-based systems, user passwords are stored in the MCAT and users can record their passwords into their ~/.srb/.MdasAuth file to provide convenient and reasonably-secure access. GSI (Globus Grid Security Infrastructure) is convenient when using other Globus tools but requires users to acquire Certificates (i.e. a Public Key Infrastructure is needed). Previously we also supported SEA authentication (SDSC Encryption and Authentication system) but now GSI provides similar functionality.
What are the future plans for the SRB?
We'd like to see the use of the SRB continue to expand, and expect that it will. We will continue to add new features. We are currently participating in many collaborative projects under various funding agencies, and have every reason to believe that this will continue long term. See our plans for the near future in our [Bugzilla] system which we use to track bugs and pending features.
Where can I find more information about SRB and related systems?
We maintain a set of web-pages at http://www.sdsc.edu/srb where a lot information about the SRB is available. This FAQ also contains many links to additional information on specific topics. There are also many documents included with the release under the MCAT and readme.dir directories.
Some general information is also available in http://en.wikipedia.org/wiki/Storage_resource_broker.
What kind of query capabilibities are available?
In SRB, we have two types of metadata: "system" and "user-defined". "system" metadata are maintained by the SRB server and "user-defined" are maintained by users. We have well defined API's and utilities for querying both "system" and "user-defined" metadata.
How can I SRB-enable my application?
See How To SRB Enable for a list of options and links to additional information.
How does SRB compare with competing products?
The following is a list of products that compete with SRB in some manner, with a brief description of some differences. SRB is an integrated solution for distributed data management and distributed shared collections.
- AFS - SRB is more than a file system. SRB manages metadata, replication, parallel I/O, containers.
- Veritas - SRB is more than a backup system, it supports replicas, versions, and snapshots of files and containers.
- Oracle 10g IFS - SRB is more than a database system, it supports execution of SQL commands at remote databases.
- HPSS - SRB is more than an archive system, it integrates access across administrative domains and across heterogeneous storage systems.
- Avaki - SRB is more than a persistent object environment, it manages relational metadata.
- Globus toolkit - SRB is more than a set of services. SRB manages consistent state information in distributed environment.
Interfaces and Tools
What are the Scommands?
Scommands refers to a set of utility routines that can be used in a Unix shell or Windows DOS command shell and access data and meta data information from SRB and MCAT. For more information on Scommands see User_Environment. Scommands also have a set of man pages describing each of the commands. One first logs in via a Sinit, and can then do Sls, Scd, Sput, Sget, etc. For the full list see the Scommands Man pages .
What is inQ?
inQ is a graphical SRB client for Windows 98/Me/NT/2k/XP.
In a nutshell, inQ provides a familiar file-manager-like interface that SRB users can use to manage their data stored on SRB; actually it's more like a file-manager interface on steroids. inQ looks and acts a lot like Windows Explorer or Nautilus but also throws in features found in several web browsers like Internet Explorer or Netscape Navigator. It offers an easy way to manage metadata and access permissions, as well as a query builder capable of performing nested queries. It also throws in friendly, context-sensitive buttons that show you which actions can be performed on any given item in SRB.
What is MySRB?
MySRB is a web-based browse and search interface to the SRB. See the mySRB home page at http://www.sdsc.edu/srb/mySRB/mySRB.html for more information.
What APIs are available?
The most comprehensive programmatic API is the SRB C library which can be linked with any application program. We also have a pure Java client library, Jargon, which includes all the client function calls. Almost all of the C library calls can be accessed through our Python binding. Some sample programs for using the API can be found in the release under test/examples. Also see the API description at C_API and SRB User Manual
What is the srbBrowser?
The srbBrowser is a java-based graphical SRB client. It provides a subset of the functionality of inQ but can be used as a graphical client on Unix systems.
What is the mcatAdmin (Java Admin Tool) ?
mcatAdmin (also commonly called the Java Admin Tool) is a java-based graphical (GUI) srb-mcat Administration tool. It assists in the administration by making clear the available functions (like most GUIs) and presenting available values from which to choose. For example, when adding a new user, the existing domains are listed and the adminstrator clicks on the domain to use for the new user. And when modifying a user, one clicks on a domain and is given a list of the users in that domain to choose from. The GUI includes windows to create, display, and modify zones, users, resources, locations, domains, and other tokens. There are also command-line utilities that perform administrative functions.
What is Jargon (Java API)?
JARGON is a pure Java API for developing SRB (or other) datagrid interfaces. The API currently handles file I/O for local and SRB file systems and is easily extensible to other file systems. File handling with JARGON closely matches file handling in Sun's java.io API, a familiar API to most java programmers.
What is the SDSC Matrix?
SDSC Matrix is a data grid workflow management system. Matrix can be used to create, access and manage workflow process pipelines. Matrix internally uses the Data Grid Language, which can be used to describe, query and control process-flow pipelines.
The Matrix API can be used to define multiple SRB commands (and non-SRB grid services) as a single dataflow process and execute it on multiple servers. Matrix is available as a (SOAP/WSDL) web service. Matrix client programming for SRB is made very simple using a developer friendly Java API (less learning curve).
Does MCAT functionality vary from one client to another?
All functionalities are supported in the Scommand utilities for Unix/Linux/MacOSX and Windows. This is because we do all development on Unix clients and they get ported to other platforms. The MySRB provides a different perspective to metadata management but on a single-file level and collection level. It provides a good way of browsing and querying of metadata across collections, and also allows for ingesting, extracting, updating and deleting metadata and user annotations for single SRBobject or SRB collection. The inQ provides a unique capability where one can associate metadata to SRB objects and collections in an intuitive way and also query across collection and form (temporary) query-collections. This allows one to query based on attribute-metadata and then get a collection and slowly refine the query to drill down to a sub-collection that is of interest.
Hence, each client provides a unique way of handling metadata and their management. One of our goals is to provide uniform functionality across all client interfaces. But this requires a huge amount of programming which we are unable to dedicate at this time.
Is one client better than another for entering metadata?
The Scommands client is very good for entering metadata. As mentioned before one can use inQ or MySRB for entering/updating metadata of individual SRB object and SRB collection. But the Scommands provide for Bulk ingestion of metadata for multiple SRB objects possibly residing in more than one SRB collection.
For cutting and pasting, there are utilities in both MySRB and in Scommands for copying metadata from one SRBobject to another, from one SRB collection to another and from one SRB collection to an SRB object. This is different from cutting and pasting as it is done internal to the SRB and not at the user-GUI.
Is there a way to load attribute/value pairs from another application into the MCAT?
Yes. SRB allows one to bulk ingest metadata associated with one or more SRB objects. This is done by writing a metadata file in a particular format. Hence, if an application can generate a file in that format or one can write a wrapper which takes the application output and creates the file in the SRB metadataFile format then we can ingest the metadata attribute/value pairs. Actually, if you are doing this in Unix-based systems you can do that by writing simple scripts or by piping multiple applications together with the final pipe going to the SRB Scommand for ingesting metadata.
Also another unique way of associating metadata for SRB objects is to do automatic extraction INSIDE SRB and storing them in the MCAT. This is done by writing simple templates (basically rules) that allows one to identify the metadata values in the SRB object and then extracting them and storing them as attribute-value pairs in the MCAT. We have done this type of templates for multiple file formats including DICOM, FITS, email, NSFAwardAbstracts and HTML files. This can be launched through the MySRB or through the Scommands.
MetaData Catalog (MCAT)
What is MCAT?
MCAT, or Meta data Catalog, is a meta data repository system implemented at SDSC to provide a mechanism for storing and querying system-level and domain-dependent meta data using a uniform interface. MCAT provides a resource and data object discovery mechanism that can be effectively used to identify and discover resources and data objects of interest using a combination of their characteristic attributes instead of their physical names and/or locations.
What is meta data?
Meta data is information about data.
What is system-level meta data?
MCAT considers five kinds of entities as primitive objects on which it keeps additional information. These are: data objects, resources, collections, users and methods. The system-level MCAT meta data items are these primitive objects and others derived from these.
Since there are primitive MCAT objects, are there other MCAT objects?
There are many derived MCAT objects. For example, MCAT, in the current release, supports notions of logical resources, compound resources, user groups, etc.
What is application-level meta data?
Application-level meta data are information about data objects that pertain to the non-systemic description of the data objects. Application-level meta data are characterized by information that is particular to the data for that application and are not generalizable across all data objects. For example, location, size, creation date information are systemic as they are available for every data object where as information about how the data object was created and what parameters were used in its creation may not be easily generalized across all data objects and hence form part of application-level meta data. Also, certain applications might have metadata specific to the data object such as FITS metadata used in Astronomy and DICOM metadata for medical images.
What is domain-dependent meta data?
Domain-dependent meta data is another name for application-level meta data.
Does SRB/MCAT support application-level meta data?
Yes, the SRB does support application-level meta data. There are two ways in which the SRB can support application-level meta data: First, as user-defined metadata and second as schema-extended metadata.
What databases can be used for installing MCAT?
MCAT can be installed on either Oracle, DB2, Sybase, Postgres, Informix, or MySQL 4. SQLServer, since it is so similar to Sybase, should be fairly straight-forward to implement too.
What do I need to run SRB?
As noted elsewhere, one can have many different setups of SRB. You can get the source code for any of these setups and build your SRB server or client as needed. SRB has been ported on to several platforms (see appropriate FAQ question) and we recommend that you use one of these. If you port to other platforms, we would be glad to include it in our subsequent releases. If you are setting up an MCAT-enabled SRB, you will require either an Oracle, DB2, Sybase, or Postgres database to which MCAT has been ported. We also recommend having a separate user-account called 'srb' (or any variant such as "ucsdsrb") which can be used for setting, administrating and running the system. Once you have the source for SRB and/or MCAT, separate readme files are included to take you through the build, setup and test process.
What are the hardware requirements (disk space, CPU speed, memory) for an SRB Server host?
The hard disk size depends upon how much storage you want to broker. The SRB software system itself requires only about 200 MBytes of storage. For MCAT-enabled servers, the DBMS will require additional space; on Linux, for example, the SRB with Postgres and ODBC take about 700 MB.
We normally recommend 1 to 6 TBytes, depending on the usage. We have specs for a system called the SRB Brick which costs around $15K for 6 TBytes (January, 2005).
As for CPU speeds, any Linux system with more than 1.5 GHz should be fine. Memory of 1/2 GB or 1 GB will be sufficient.
Which DB system should I use?
For a large and/or heavy-load instance of SRB, you will probably want to use a commercial DBMS like Oracle. It does have better performance, at least in many cases. It costs money though, and you really should have a DBA to manage it. We also have a project planned for the fall 2005 (with some UK folks) that would make use of some Oracle features (including some stored procedures) that will further enhance performance when using Oracle.
Postgresql works fine for initial testing (for "getting your feet wet"), and it works fine for light to moderate data loads. It is also relatively easy to install via our install.pl script. It is used in production for some projects (for example, SIOExplorer project which takes SRB ship-board for ocean surveys). Some Postgresql tuning is available via the 'install.pl vacuum' and 'install.pl index' commands (see install.pl for documentation).
For any DBMS system, the performance decreases as the size of the MCAT increases.
What is a data object (data set)?
In the terminology of SRB, a data object is a "stream-of-bytes" entity that can be uniquely identified. For example, a file in HPSS or Unix is a data object, or a LOB stored in a SRB Vault database is a data object. Importantly, note that a data object is not a set of data objects/files. Each data object in SRB is given a unique internal identifier by SRB. A data object is associated with a collection (see below). Previously, we used the term "data set" for this, but are phasing it out (as it was often confusing) and instead using "SRB data object".
Who is a registered SRB user?
SRB users are registered in the MCAT catalog and are given unique SRB ids. These identifiers are independent of the location or system ids, such as Unix ids.
What is a method?
In the terminology of SRB, a method is any executable piece of code that is registered in the MCAT catalog.
Methods can be defined to operate on data on the server before being returned to the client. This can be quite efficient in cases where the data object is being reduced by the method (for example, the method selects a subset of the data object based on inputs, such as metadata extractors (FITS, DICOM, etc)). Format converters, such as tiff2gif and tex2ps can also be useful SRB methods.
Who is SRBadmin?
SRBadmin is the person who creates and manages SRB and MCAT systems. A SRBadmin is also a registered SRB user who has additional privileges compared to normal users. A SRBadmin does NOT need to have "root" privilege.
What is a (data object) collection?
A collection is a logical name given to a set of data objects. All data objects stored in SRB/MCAT are stored in some collection. A collection can have sub-collections, and hence provides a hierarchical structure. As a simple analogy, a collection in SRB/MCAT can be equated to a directory in a Unix file system. But unlike a file system, a collection is not limited to a single device (or partition). A collection is logical but the data objects grouped under a collection can be stored in heterogeneous storage devices. There is one obvious restriction, the name given to a data object in a collection or sub-collection should be unique in that collection.
What is the SRB logical name space?
It is easy to think of SRB Collections as Unix directories (or Windows folders), but there is a fundamental difference. Each individual data object (file) in a collection can be stored on a different physical device. Unix directories and Windows folders use space from the physical device on which they reside, but SRB collections are part of a "logical name space" that exists in the MCAT and maps individual data objects (files) to physical files.
The logical name space is the set of names of collections (directories) and data objects (files) maintained by the SRB. Users see and interact with the logical name space, and the physical location is handled by the SRB system and administrators. The SRB system adds this logical name space on top of the physcial name space, and derives much of its power and functionality from that.
What is a resource?
In the terminology of SRB, a resource is a software/hardware system that provides the storage functionalities. The term is equivalent to "physical resource". For example, HPSS can be a resource, as can a Unix file system.
What is a physical SRB resource?
A physical SRB resource is a system that is capable of storing data objects and is accessible to the SRB (see [FAQ:What kinds of resources does the SRB support?]). It is registered in SRB with its physical characteristics such as its physical location, resource type, latency, and maximum file size.
What is a logical SRB resource?
A logical SRB resource is a SRB resource that is derived from physical SRB resources. A logical SRB resource might be derived with further constraints on a registered physical resource or by combining more than one physical resource as an entity. For example, if a physical resource 'A' is defined using a particular directory in a HPSS, a logical resource A-bar might be defined as a resource that restricts to a further sub-directory in 'A'.
What is a logical SRB resource set?
A 'logical SRB resource set' is kind of logical SRB resource. It is defined as a set of physical SRB resources. The aim is for this is to give a unique (logical) name to a set of resources and when SRB opens or writes a buffer to the logical resource it opens or writes to every resource in that set. A logical resource containing multiple physical resources can be treated as a 'single' resource when using it.
What is a compound SRB resource?
A compound resource allows the SRB to function as a complete (although basic) archival storage system (also known as an hierarchical storage system (HSM)). A compound resource may be configured to contain a pool of cache resources and a tape resource. When a user creates a file using a compound resource, the object created becomes a "compound object". The actual data of a "compound object" may reside on cache or tape or both. Unlike the SRB replica, a "compound object" always appears as a single object even though there may be multiple copies of the data. It is a simple hierarchical system where data migrate automatically between cache and tape. Data is always staged on cache automatically whenever it is accessed and migrates to tape by the system administrator when more cache space is needed. The cache and tape resources can be distributed across a WAN.
What is a user group?
A user group is a uniquely identifiable name given to a set of SRB registered users.
Who can form a user group?
Any set of mutually agreeable users can form a user group.
Who can register a user group?
SRBadmin has the authority to register user groups.
What is a domain?
A domain is a string used to identify a site or project. Users are uniquely identified by their usernames combined with their domain 'smith@npaci'. SRBadmin has the authority to create domains.
What are tokens?
Tokens are string items stored in the MCAT used as root items when creating other items (resources, etc). We have quite a few predefined tokens. SRBadmin has the authority to create tokens.
What is a replicated data object?
In SRB, one can make copies of a data object and store the copies in different locations. But, all these copies in SRB are considered to be identifiable by the same identifier. That is, each copy is considered to be equivalent to each other.
How can one read a replicated data object?
When a user reads a replicated data object, SRB cycles through all the copies of the data object and reads the one that is accessible at that time. It uses a simple replica identificatoin mechanism to order this list of replicated data objects.
How can one create a replicated data object?
There are three ways of creating a replicated data object. In the first method, which can be viewed as asynchronous replication, one can create a data object (using Sput Scommand or srbObjCreate API), and then replicate the data object using the Sreplicate Scommand or the srbObjReplicate API. In the second method, which can be viewed as synchronous replication, one can define a 'logical resource set' as a set of resources and then create a data object in that logical resource set (using Sput Scommand or srbObjCreate API). SRB automatically replicates the data object as it gets written.
One can also off-line create two data objects separately in a physical resource and then register them as replicas of each other. This is called out-of-band replication. SRB provides the means to replicate collections of data objects recursively.
Also see "Replicated Data Management user SRB" (GGF-4, February, 2002) at http://www.sdsc.edu//srb/Pubs/SRBReplication.ppt.
What is a Container?
A Container is a way to put together a lot of small files into one larger file to improve performance. This works very well with resources that include tapes (such as HPSS). The whole container is retrieved from tape, cached on SRB disk, and then multiple files can be quickly read and written on the container copy on disk. The SRB handles the book-keeping for the container.
How do Containers work?
The SRB container is a like a tarball in the sense that it stores multiple files as a one single file. It grows the container on the fly by adding new files as they are ingested into the container. Hence, unlike a tarball, the container can be grown as needed. Also, unlike a tarball, users can read individual files without downloading the container on to their desktops.
The SRB keeps all the information about how the container is laid out in its Metadata Catalog (MCAT) and uses it when retrieving individual files. One can also modify and delete files in a container as though they are doing these operations on a normal file and the SRB takes care of the operation.
To answer a related question, the container is not "made" on the desktop and then loaded into the SRB. Instead it is constructed in situ on the resource. But what happens is that containers are normally assigned a logical resource which has two physical components: an archive resource such as the HPSS or roadnet-sam, and a cache resource such as a unix file system (eg. roadnet-unix). All the construction, file access and modifications are done on the cache resource and the storage of a full container or a non-needed container is done on the archive resource.
Hence, the archive sees a single file and the construction is done before getting into the archive on the cache resource (not on the users desktop) which is also a resource controlled by the SRB.
Containers grow in size and are pinched off into physical pieces by the SRB so that a container might look really long, but are actually multiple files of smaller sizes. Normally we recommend these pinching off to be around 100 MBytes or 200 MBytes but then can be in the GB range also. This is akin to blocks in a tape system.
What this means is that the user sees one container where they "put" in their data, but like a goods-train, the container is physically divided. Obviously individual files are much smaller than the container size. To give an example, in one of our collections, we have containers of size around 50 MBytes, storing files of sizes 2 MBytes each. Each container stores about 25 files in its physical blocks.
Does Sget work properly for files that are in containers?
Yes, Sget works fine for files in containers. The MCAT stores all the file offsets for each file in a container, and Sget will download just the portion of the container that has the file you are trying to download. Since Sget (currently) doesn't support any bulk operations it's still slow trying to download a lot of small files.
How do you discover the container information?
If you're on a windows machine InQ is the easiest, the file details show the container information. In Scommands, SgetD on a file prints container_name and the respective container (if any) that the file is contained in.
Once I know which container a file is in, what is the most efficient way to download the data?
If you just need a few small files, then running Sget on each will be the quickest. If you want all or most of the container, and you know the container you want to download, then simply running 'Sbunload <container>' will be much faster.
Who can register SRB users?
SRBadmin can add new users to the MCAT catalog.
Who can register physical or logical resources?
SRBadmin has the authority and the required privileged utilities to register physical and logical resources.
How does SRB provide access to remote storage systems?
SRB provides access to remote storage systems through a proxy mechanism. When one stores a data object under SRB, the data object is stored and accessed by SRB acting as a proxy for the user. Because of this mechanism, a user can store data objects on remote storage systems without having personal accounts at these site. In this mode, SRB acts as a 'system privileged proxy' user. The above proxy mode also allows for SRB to SRB authentication enabling servers to access files that are under the control of another SRB server.
Can multiple SRB servers be federated?
Yes. SRB servers can communicate to other servers and can form a federation. More than one federation can also exist with one SRB federation being unaware of another. A user can access data objects stored under any SRB in the federation provided the user has proper permissions.
In 3.0 we released a Federated MCAT capability, where complete MCAT-enabled SRB systems can be integrated with other SRB federations. Each MCAT member of such a federation is called an SRB Zone.
How does one SRB know about another SRB?
A SRB server knows about another SRB through the MCAT. When the SRBAdmin creates a location, a SRB host is specified. When the SRBAdmin ingests a resource at a location, that resource is associated with that SRB host.
What are the different setup configurations that I can have at my site?
First, there are three basic configurations for the SRB/MCAT system:
(1) client-only, (2) server without MCAT and (3) server with MCAT.
Each of these three setups can be enabled with password-encrypt1, and/or GSI authentication.
In the simplest configuration, one can use the SRB client components (client utilities, GUI applications, and libraries) at a site and use SRB servers running at remote sites or hosts. A SRB client can connect to a specific (possibly remote) SRB server and access data objects that are under the control of that server and/or other servers in the federation. With the client-only setup one cannot access any data object at the local site through SRB. In the second setup, a site can have a SRB server running locally but without any MCAT service. In this setup, the local SRB server can provide access to local resources and contacts another SRB server that has MCAT service for retrieving the meta data about data objects. In the third configuration, one can have a SRB server and a MCAT database running locally. Any client can talk to any SRB server and need not necessarily talk to a local or 'nearest' server.
Is MCAT needed to run SRB?
Yes, an MCAT is needed but you do not need to install one yourself. Many sites use the SDSC MCAT-enabled SRB to support their SRB system.
Where can I get SRB?
Source code and related material for SRB and MCAT can be obtained from the web-site at http://www.sdsc.edu/srb. The tar files are PGP encrypted and one can get the passwords for decrypting them by sending email to firstname.lastname@example.com.
What is a SRB Vault?
SRB vault is a data repository system that SRB can maintain in any of the storage systems that it can access. For example, the SRB runningat sdsc (host: srb.sdsc.edu) runs a SRB vault in its Unix file system, and another SRB running at sdsc (host: hpss47.sdsc.edu) runs SRB vaults in HPSS, a unix file system and a DB2 database. SRB vaults provide a convenient storage area for storing data objects. A data object stored in a SRB vault is stored as a SRB-written object and its access is controlled through the MCAT catalog. This is different to legacy data objects that can be accessed by SRB but which are still owned by previous owners of the data. One can define SRB vaults in any storage device that can be accessed by a SRB server. In thecase of file systems such as Unix and HPSS, a separate directory is used for the purpose, and in case of databases such as Oracle, DB2 orIllustra, a system-defined table with LOB-space is used for the purpose.
What is a SRB Space?
SRB space is a union of all SRB Vaults that can be accessed by a system of SRB servers. Users registered in the system can store, retrieve and modify data objects (provided owners of the data objects grant appropriate permits) in this space. Hence, one can visualize SRB space as a logical storage volume that is distributed and heterogeneous.
What are the various data object interfaces supported by SRB?
The SRB supports four types of interfaces. The first type is a stream interface. It allows Unix file operations such as open, close, read, write and seek on SRB data objects. The second is an object-level interface. It provides means to create, modify and destroy collections of objects, move, copy and replicate objects, and apply user-defined proxy operations on objectsto obtain a new type of the object. The third type is a discovery-level interface for obtaining meta data information about data objects (eg., replication information, ownership, access, location, type information, etc), resources and users. These operations accessthe information located in MCAT catalog. Finally, SRB provides an interface for modifying the data about data objects in SRB, and for performing access control and auditing on various SRB objects.
How do I backup SRB space, both SRB data and MCAT metadata?
It is a good idea to backup the MCAT database daily. If your MCAT DBMS (Oracle, DB2, etc) can do hot backups, then you can do it when the system is being used. Otherwise, you will need to stop the SRB (killsrb), do the cold backup and then restart the SRB.
As for the files stored under the SRB, one can do it in multiple ways: The first and easist is to backup the storage resource directory (for example, the SRBVault directory), as an incremental backup. Depending upon your system, you can do it on the fly or during PMs. Weekly PMs will be helpful.
A second startegy is to make sure that there are replicated copies of the file in two distributed storage systems which hopefully don't share any hardware and are geographically separated. This can be done either under user-control (replicate only those that are needed) or under srbAdmin control (possible with 3.0.2 release soon) which will replicate all files that are modified to a particular backup resource.
A third strategy, is to use the zoneSRB is to run a backupZone at a remote site and back up to this zone from your zone. We are testing and finalizing some protocols for doing this.
What ports does the SRB use? What ports do I need to open in a firewall to run the SRB?
The firewall needs to open some ports on the server side, and possibly on the client side too.
On the SRB server server-side, you must open the port that the srbMaster is listening on, plus a set of 100 or so configurable data ports (described below).
The srbMaster listens on the port defined in srb.h or specified in srbPort environment variable (often set in the runsrb script). By default, srb.h has DefaultPort "5544" but this can be changed via the configure --enable-srbport=value option. Regardless of the DefaultPort value, the srbMaster will listen on the port specified in the srbPort environment variable value if it is defined. You can edit the runsrb script to change this.
(The clients also need to know the port number to connect to. For the Scommands they will default to the value in srb.h or will use the number specified in the srbPort line in each user's ~/.MdasEnv file.)
To configure a specific range of ports for the servers, include
'--enable-commports' on the configure line. Without this, the
srbServers will use arbitrary ports.
By default, the configurable ports are 20000 to 20199 (see mk/mk.config COMM_PORT_NUM_START and COMM_PORT_NUM_COUNT). So './confiugre --enable-commports' will restrict the servers to using ports 20000 to 20199 (plus the DefaultPort). You can change the start and number of the ports via configure options --enable-commstart and --enable-commnum, for example: ./configure --enable-commports --enable-commstart=21000 --enable-commnum=200
Based on our experience, we recommend using at least 100 ports, but
you may need more or possibly fewer. It depends on how many transfers
(especially parallel transfers), you will have going at the same time.
There's a MaxThread parameter in runsrb that specifies how many
threads to use; 4 is default, but you may wish to increase that. Each
of these threads uses a port, so each parallel transfer could take 4
(or MaxThread) ports. If the servers run out of ports, the later
transfers will fail. So it's a trade-off. If you don't set commnum
high enough, and you get quite a few transfers going at the same time,
some of them could fail.
On the SRB client side, if you use the Sput or Sget -m option (server
initiated connection for parallel I/O), the client's firewall needs to
open at least 16 configurable ports. These are the same ports as the
server uses, i.e. 20000 to 20199 if just --enable-commports is used.
As with the server, the port range can be modified, for example:
./configure --enable-commports --enable-commstart=21000
But starting with 3.1.1, users can now use the -M option (client initiated connection for parallel I/O) which does not require the opening of ports on the client side.
The commports are used for data transfer and are also normally used for non-data connections too. If the server system (the srbMaster server) is prespawning server processes (PRE_SPAWN_CNT is greater than 0 in runsrb, which is normally the case), then the server will use one of these ports for its communication connection. The client will connect to the srbMaster on the defaultPort (5544 or whatever) and then will be told which port to connect back to for the particular pre-spawned server that has been assigned.
Does SRB exploit any specific interfaces to HPSS to optimize performance?
Yes, the SRB uses both the sequential POSIX like interface as well as the parallel mover interface of HPSS for data movement. We have a set of SRB API's for both types of interfaces. In addition, all our data movement utilities have a switch that allows users to choose between these two modes.
What kind of ingest rates can SRB get?
In terms of number of files per second, for files stored in HPSS, it is limited by the ingestion rate of HPSS (we are still using the ENCINA based HPSS). The SRB bulk load mechanism can do 30-50 files per second.
For I/O rate, it pretty much depends on the hardware and network. We can get up to 50 Mb/sec with 3-4 mover threads while the rate from HSI is about 30-40 % higher because data does not have to go through any SRB server.
How well does SRB handle packaging small data packets into "bundles", and store?
Very well. SRB can do bulk loads with or without containers (our term for "bundles"). Without using containers, a bulk load packs a large number of small files and ships them all at once to the server. The server then unpacks it into small files. With the use of containers, small files are packed into a container and the server saves the container as a single file. This use of containers is very simple and transparent to users. This is the recommended way of storing small files in HPSS.
What are the limitations of SRB, i.e 2TB of data, # of data entries?
There are practically no limits due to the SRB itself (address space of 64 bits). The underlying resources (e.g., file system) may have limits. At SDSC, SRB is managing 126 million files and 830 TB as of 9/18/06
SRB allows very long file names. However, the maximum length of a SRB file name is fixed and depends on the SRB version you are using.
The maximum file size of a single SRB file depends on the underlying storage resource where the file would be stored.
The number of files you can store depends on the database you use to support MCAT. Each file you store in SRB results in more tuples (rows in) in MCAT database. Each database vendor will have their own limitation on the number of rows (tuples) that can be supported (usually this is a very very large number).
User Operation
Who can register data objects?
Any SRB user can register data objects. When a user creates a data object in SRB, the data object is automatically registered in SRB. A user can also register legacy data objects that they own and created outside SRB using the Sregister Scommand or the srbRegisterDataSet API.
Who can create data object collections?
A collection is always created as a sub-collection under an existing collection (SRB/MCAT when it is initialized starts with a root level collection). Any SRB user can create data set sub-collections provided they have permission to create sub-collections under the pertaining collection.
Who can use SRB?
To use SRB one needs to be a registered SRB user. One can register themselves by sending email to a SRBadmin. If there is a local SRB system administrator then requests should be to them, otherwise applications can be made to email@example.com. There is one mechanism, called ticket-based access, that allows unregistered users to access (read only) data objects stored under SRB's control. Owners of data objects can issue tickets on their data objects that can allow everyone to access the data objects. Separate APIs have been developed that can be used by unregistered users.
How does SRB deal with unregistered or anonymous users?
SRB provides access to unregistered users using a second kind of proxy mechanism. In this mode, SRB acts as a 'ticket user proxy' and facilitates access to data objects through the ticket mechanism.
What are the types of access control provided by SRB/MCAT?
SRB supports two types of access control. The first type is similar to Unix-type access control. In this type, the owner can provide read, write and all access to other users or user groups at the level of individual data objects and collections. Unlike Unix, one can control access to as many users as needed and as many groups as needed. The second type of access control is controlled through tickets. Tickets are issued by owners of a data object (or collection) to other users, groups and everyone. One can use these tickets to access data objects that they control. A ticket user need not be a registered SRB user. There are APIs and Scommands that can permit non-registered users to access ticketed data objects.
What are the different modes of access control, supported by SRB?
SRB supports the following modes: read(r), write(w), all(a), annotate(t), and none(n). Read and write permissions refer to the data, annotate to metadata, and all means ownership. A user with 'all' permissions can change the permissions.
What is the 'all' mode of access control?
The 'all' mode provides a complete access control to a user. A user with this permission can not only read and write the data object (or collection) but also grant and revoke access permits for others for the object. The user can also issue tickets on the data object. At the collection-level, the mode grants sub-collection creation permission to the holder.
Can only one user have 'all' permission on a data object?
No. Any number of users can have 'all' permission on a data object. When a data object is registered, the registrar is considered to be the owner of the data object and is given the 'all' permission for access. Subsequently, the owner can grant this permission to other users and these users can grant the same to others.
Since data objects can be stored in remote storage devices, should I remember the path names or location information of my data object?
No. SRB along with MCAT relieves you of the necessity to remember physical locational details for your data object. For each data object, MCAT stores all the physical details abouts its location (and indeed about locations, since a data object can be replicated) and details about access mechanisms that are needed to open that location.
How does one use resources? When are they specified?
You don't need to specify a resource when getting or accessing an SRB file, as the SRB system will determine the best resource to use. For example, if you Sget a file that is replicated on both a disk resource and a tape resource, the SRB server will read the file on disk.
When you store a file, you need to inform the SRB system which resource you want to use, as they have different characteristics for different uses. For example, if you know a file is for long-term storage, you may want to store it to an archival resource (to go to tape) rather than to a disk cache.
For the Scommands, you can set a default resource in your ~/.srb/.MdasEnv file. Then, when you Sput a file, it will be stored on your default resource unless you use the Sput option to specify a different resource.
Your local SRB administrator can help you with using the appropriate resources for your SRB system.
How do I know in which collection to store my data?
Each SRB-registered user is started with a 'home' collection. They are given read, write and create-sub collection and grant permission to that collection. But, SRB/MCAT can also maintain project-level collections that can be shared by users and groups. Hence, one can store their data objects either in their home-collection hierarchy or in a project collection hierarchy in which thet have appropriate access permissions.
How useful are collections?
Collections provide a logical grouping mechaism. Assume that you have several data objects coming out of an experiment and further assume that few of the data objects are very large containing raw data (or image) generated by the experiment and a few other data objects are small and possibly containing some meta data information about the experiment. One can logically group these data in a collection (possibly by its experiment name and timestamp) and place the collection with other ones of similar kind. Physically, the large data objects may be stored in archival storage systems or in a large-scale disk system closer to where you are planning to perform some studies on the data (ex. a disk attached to a T3E system) and the smaller data objects may be stored in a local file or database system. By logically bundling the data objects in one collection, one has a single point of access for the experimental data.
Should my data always be in a collection?
Yes. Every data object under SRB/MCAT is associated with a collection.
Can I have the same data object in more than one collection?
Yes, the SRB does support soft-linking of data objects across collections.
How do I identify a data object?
In the simplest case, a user can access a data object by knowing its name and its collection name. The SRB/MCAT system also provides a rich discovery system for identifying data objects. They provide a query-based capability to identify dataets using srbObjOpen() and srbGetDataDirInfo() APIs. In these two calls, the objID parameter provides the means to provide the characteristics for the data object(s) of interest. The objId parameter can be a data object name or can be a set of attribute-condition-value triplets. These triplets are viewed as providing a conjunctive characteristic that defines the data object of interest. For example one can provide in objId a string of the form "&DTYPE='C code' &DTIME>'1998-01-26-10.00.00' &DCOMMENTS like '%test%'" will get information about a C program that was created after 10 AM on January 26, 1998 and has been commented as test.
What is the srbObjOpen() API?
The srbObjOpen() API allows one to open a data object for further operation, such as read, write, seek, etc.
What is the srbGetDataDirInfo() API?
The srbGetDataDirInfo() API allows one to access information about data objects, stored in the MCAT catalog.
How do I know what are the available resources that I can use?
The Scommand called SgetR provides an easy means of finding the resources that are accessible in your SRB system.
How do I get information about a data object?
Scommands provide a few ways of getting this information. Using SgetD, Sls and using SgetU and SgetR with appropriate flags, one can access meta information about data objects. See What are the Scommands?
What are tickets? How can one issue them? use them?
The ticket system is a mechanism to control access to data objects. Tickets can be issued on a data object by a SRB user who has 'all' mode of access permission. SRB createsa ticket (which is an ASCII string) and associates withthe concerned data object (or collection). The issuer can attach someconditions on the use of the ticket. One can control the user base of the ticket by giving a list of user names and/or user-group names. One can issue a ticket to all users (both registered and un-registered SRB users) using a special user-name called 'ticket-user' (the APIs do it automatically if no user is mentioned). If one wants to allow access to only SRB registered users, then issuing a ticket to 'public' would serve the purpose. One can provide a begin and end date-time for the validity of the ticket. One can also provide a maximum count (which can be infinity, denotedby -1) for using the ticket. One can issue a ticket to a single data object or to a collection or to a recursive collection (i.e., collection and sub-collections ad infinitum). When a ticket is used, for a data object SRB/MCAT checks whether the issuer of the ticket still owns the data object before providing access to the data object. If a ticket issuer no longer has 'all' access permission at the time when the ticket is used, the data object access is denied. Note that if more than one data object is associated with a ticket and/or more than one user is allowed to use a ticket, the count of usage is at the ticket-level and not at per user or per data object level.
Can I issue ticket only for data objects?
Tickets are associated with data objects. Even though one can issue a ticket to collections or recursively to collections and sub-collections underneath collections, the tickets are still associated with data objects in those collections.
If a ticket is issued for a collection will that allow access to all data sets in that collection.
No. A ticket issued on a collection allows access ONLY to data objects in that collection for which the issuer has 'all' permission. Other data objects that belong to others are not accessible using that ticket. The same logic applies when tickets are issued for recursive collections.
Can I issue a ticket for a 'future' data object.
No and Yes. A ticket issued to a data object requires that the data object be registered at the time of issue. But, a ticket issued on a collection can allow acess to data objects that are created in the future but for which the issuer has 'all' access permission.


text:
Click to return to | Baseball-Cards.com Wholesale Ultra-Pro Baseball card supplies |
1972 O-Pee-Chee/OPC #218 Eddie Kasko Manager Baseball cardPrice = $ 3.25NM/MT to NM
Select a different Sport or Vintage Baseball Cards set Enter words,partial words,partial words with wildcards (*) or a phrase in quotes. 1959 Topps Yankees displays vintage 1959 Topps Yankees cards. Bowman Mantle displays all Bowman Mickey Mantle cards, old and recent. |
Have web site? We'll escort your inventory online Boston,Miami.
New York City,Miami,Los Angeles weekly baseball card auctions.
Below are some tidbits on baseball and sportscard collecting.
Visit our web site for more info on vintage and current
baseball, football, basketball, hockey, sports and
non-sport cards and card collecting. |
(part 2) In hockey, there were a few sets issued in the 1910's and while O-Pee-Chee issued some sets in the 1930's, the real modern sets began in 1951 with the itroduction of Parkhurst's first set. In racing, while cards go back as far as the early Indy car days of 1911, modern racing sets began in 1988 with the issues released by MAXX. |
1952,1953,1954,1955 Red Man TOBACCORed Man Tobacco issued baseball cards in 1952, 1953, 1954 and 1955, making them the only tobacco company to do so since 1920. The cards are very attractive with a large, painted portrait and a short player's bio on the front. On the back is company advertising. 1/2" tabs at the bottom of each card could be exchanged for a prize. The exchange rate was 50 tabs for one free Big League style baseball cap. Thus, cards with the tabs still intact are much, much, harder to find making them more valuable.Without the tabs it is difficult to determine which year certain players were issued. It is usually easiest to determine the year by looking at the expiration date on the back. Subtract 1 from the expiration year to determine the year of the card. Each set is made up of 25 players from each league all personally selected by Editor J.G. Taylor Spink of the "Sporting News". Managers from each league were included in the 1952 and 1953 sets. The 1954 set had four different variations. If you ignore the many variations of the expiration dates, that brings the total to only 208 cards to complete your Master Red Man Tobacco Baseball Card Set !!! Start collecting now !
Click for complete
1952,1953,1954,1955 Red Man Tobacco cards checklist and prices
1971 O-Pee-Chee BaseballAlso referred to as OPC or Topps Canada, most vintage OPC sets were near replicas of the Topps cards from that year. Exactly same in design they usually only differed with the addition of French to the backs and some fronts.To the benefit of collector's OPC made several changes in their 1971 set. The most obvious and useful was a complete redesign of the card backs and the addition of another player photo ! Additionly, over 20 cards were changed including the inclusion of what could be considered the first "Traded" cards. Another difference: Topps cards #202 and #289 were changed to allow the addition of 2 more Expos to the set. The 1971 OPC set is legendary for its short print run, estimated at perhaps just 5% of Topps' Production. This issue is considered quite elusive, even in Canada. TOP ROOKIE: Steve Garvey TOP STARS: Nolan Ryan, Roberto Clemente, Willie Mays, Hank Aaron, Ernie Banks, Pete Rose, Ted Williams, Thurman Munson, Reggie Jackson, Don Baylor/Dusty Baker RC & MORE !!!
Click for complete
1971 OPC/O-Pee-Chee Baseball checklist and prices
Web site services provided by
CA: San Diego, Los Angeles, San Francisco; Las Vegas, Miami, New York City, Washington DC escorts

subset: commoncrawl


text: TSW Jarama (Painted/Hyper Silver) Wheels Price Range: $189.99 to $522.99 * Appearance may vary slightly based on the size and offset. The Circuito Permanente del Jarama (Permanent circuit of the Jarama) race course is located just north of Madrid, Spain. The 3.404 km (2.115 miles) race circuit has hosted nine Formula One Spanish Grand Prix. The layout consists of a short straight and many tight corners which has made it a notoriously difficult circuit for overtaking. Gilles Villeneuve, racing for Ferrari, came second in the 1979 Grand Prix to teammate Jody Scheckter, and had his last victory at this Jarama Circuit in 1981, often regarded as his tactical masterpiece. Also available in these colours: Share this Wheel: HAVE A QUESTION? 1-877-877-1010 ASK AN EXPERT! LIVE CHAT FITMENT GUARANTEE All orders are verified for fitment guarantee. Helpful Resources Shipping Information Frequently Asked Questions Sizes & Prices Customer Reviews Wheel SizeBolt PatternWheel OffsetHub BoreWeightColoursProduct CodePrice 19 x 8 5/112 45 mm. 72.00 - Hyper Silver 1980JAR455112S72 $261.99 Add to Cart * show all Sort By: Sort by Style Ease Of Installation Price/Value Quality There are no reviews for TSW Jarama Rate Now


text:
Kosher Appetizers
Green Olive Dip -- Parve |
KosherEye.comIngredients: 5-ounce jar green olives with pimentos, rinsed, drained (set liquid aside) Directions: In a food processor, blend the cream cheese and mayonnaise with the green olives and onion until smooth. Thin the mixture, if necessary, by adding some of the juice from the olive jar. Serve chilled with chips, crackers or raw vegetables. Notes: For a dairy version, use cream cheese Recipes: Appetizers, Dips, Parve or Dairy, Kosher |


text:
Top Definition
A phrase that expresses affection, popularized by the movie Jerry Maguire. At the end of the movie, when Jerry expresses his love in a long-winded speech to Dorothy, Dorothy's reply was the simple phrase: "You had me at hello."
Jerry Maguire: I love you. You... complete me.
Dorothy: Shut up. Just shut up. You had me at "hello."
Dorothy: Shut up. Just shut up. You had me at "hello."
von Lei G.
28. Januar 2004
3 more definitions
a person started liking the person once they said hello
person 1: you had me after you told me you were a model.
person 2: you had me at hello.
person 2: you had me at hello.
von polaroiddd
4. April 2009
we are fuckin tonight!!!
guy says "hey baby, how about some anal enjoyment?"
girl says "of course, you had me at hello"
girl says "of course, you had me at hello"
von eegerageabeav
27. Januar 2004
Shut up i wanna fuck, even if it is in front of all these whiny ass divorced bitches. Just put it in my ass right now, Jerry! (From the retarded movie Jerry McGuire)
I asked this blonde girl at the club if she wanted a drink and she said "You had me at hello". I had my dick in her ass before I got the car started.
von bohits
28. Januar 2004


text: Assuming Harder is done and a wolfpack is indeed called (and I can somehow swing the extra vacation time and hotel expense to accommodate all those additional road travel days!), you can COUNT ON both Seaview and Harder being in attendance! Heck, I've transported coffee tables inside that magnificent coupe before. It's her unique door configuration and fold-down back seats which make it all possible! I've test fit 66" Nautilus in there before too: like a glove!)


text:
Reviews & Community
What do you think of the
Chrome Midway Shoe - Men's
? Share a...
When will backcountry be getting size 10.5...
When will backcountry be getting size 10.5 in black and red back in stock?
Mike D Hilverda
Unfortunately it looks like we don't have any more of the Chrome Midway Shoe on order at the moment. It is always possible that we will order more at the beginning of the new year, so please check back in a week or so if you haven't found another source by then.
Best sneakers I've ever had.
- Familiarity: I've put it through the wringer
- Fit: Runs large
I've been riding bicycles for over a year now and I didn't want to make the commitment to clip/clip-less shoes yet and I was struggling to find a good pair of shoes that would stand up to my riding style. A friend of mine had a pair of Midway's and told me they were great.
He was right. The moment I strapped them on and rode I almost felt like I was riding faster. They're so comfortable!! They might resemble Chucks in the look but their construction, material and comfort don't even compare. I rode through the rain several times and they kept my feet for the most part warm and dry.
ALSO! The smallest detail, which I did not notice in the description which blew my mind, is the reflective strip on the backside of the shoe for further visibility.
Great shoe, definitely recommend.!
Backcountry Video
Chrome Midway Shoe - Men's
Wow, wish these came in my size.
Wow, wish these came in my size.


text: Few people have so mastered an instrument as Bela Fleck has the banjo. In fact the man is so synonymous with this instrument that words like master and genius almost fall short in their simplicity. From the time he was first inspired listening to the Earl Scruggs' recording of The Beverly Hillbillies Theme Song… Read more »


text:
Grave Encounters 2
This terrifying new sequel follows a group of film students who break into the hospital from the first film to do their own paranormal investigation and quickly realize that GRAVE ENCOUNTERS was not just a movie... it was real.
Cast: Stephanie Bennett, Richard Harmon, Reese Alexander, Leanne Lapp, Howie Lai
Produced by: Shawn Angelski, Martin Fisher
Directed by: John Poliquin
Written by: The Vicious Brothers
Running time:
1hr 40min
Opens: Oct 12, 2012 Limited
Theaters for Today |
Pick a day
on this day. |


text:
The Wonderful World of Customer Service at Disney" is a celebration of great business practices that can be applied to your own service organization. See it from the eyes of J. Jeff Kober, who is the foremost thought leader in benchmarking practices at Disney.
Whether you're in the private or public sector, you'll find solutions that can take your organization to the next level. Order your copy today at Amazon.com.
Here's what others are saying:
"Behind the costumes, the fantasy and the magic, Disney World is a business like any other. And [...]


text: Ducati North America IS RECALLING 1,196 model year 2010 MTS 1200S motorcycles due to a problem with the fuel injection system. In the event the operator should downshift or maneuver with the clutch disengaged and the engine at idle the vehicle could stall, increasing the odds of a crash. Dealers will re-flash the electronic control unit free of charge. Ducati Safety recall #RCL-10-004 . If needed owners may contact DUCATI 800-231-6696 or the National Highway Traffic Safety Administration's vehicle safety hotline at 1-888-327-4236 (TTY 1-800-424-9153), or go to http://www.safecar.gov


text:
Tankerton, Whitstable, CT5 2BD, Tel: 01227 862162, Email, www.canterbury.gov.uk/coast(1 miles, 2 km)
As you walk along the Whitstable front you will come to grassy banks that gently slope down to the beach, characterised by pretty wooden beach huts and an established sailing club. Blue Flag Award 2014.
Whitstable, CT5 1BU, Tel: 01227 862162, Email(0 miles, 1 km)
The beach is one of the very few in the country that has a pub on it. With its pebbles and groynes, this unspoilt shoreline will make you reminisce. Choose to swim, stroll or sit and enjoy the stunning sunsets on this popular beach.
Canterbury Road, Herne Bay, CT6 7TZ, Tel: 01227 862000, Email(5 miles, 7 km)
Curtis Wood Park is an informal area of protected open space situated on the outskirts of Herne. The site provides local residents and visitors the opportunity to enjoy a variety of semi-natural habitats in a relaxed and pleasant setting.
Whitstable, CT5 1BX, Tel: 01227 862162, Email(0 miles, 1 km)
Whitstable is like no other town by the sea. Its traditional charms, strong arts culture and rich maritime history complement Whitstable's modern appeal.
Whitstable, CT5 4FJ, Tel: 01227 862000, Email(1 miles, 1 km)
Duncan Down is the largest open space in Whitstable. Originally earmarked for housing in the 1930s, the land is now protected as a Village Green, providing opportunities for local people to relax and enjoy wildlife.
New Road, Rough Common, Canterbury, CT2 9DB, www.theblean.co.uk/(4 miles, 6 km)
Blean Woods are the largest in Kent and, in addition to their intrinsic interest as ancient woodlands they surround a number of attractive villages with pubs, where you can eat and drink, places to visit.
Pier Avenue, Herne Bay, Kent, CT6 8PD(4 miles, 7 km)
Today the sports centre has been demolished and the pier is now open to visitors as a leisure and events space.
Marine Parade, Whitstable, Kent, CT5 2BE, Tel: 01227 862162, Email(1 miles, 1 km)
The cliff-top lawns of Tankerton Slopes roll gently towards the sea and provide an excellent view of 'The Street' and a vantage point to watch the nautical world go by. Tankerton is east of Whitstable town centre.
Seafront, Herne Bay, CT6 8SS, Tel: 01227 862162, Email, www.canterbury.gov.uk/coast(4 miles, 7 km)
If you visit Herne Bay, you'll fall in love with the British seaside all over again. Whether you relax on the beach with a picnic or take a dip in the inviting water, Herne Bay will take you back to the holidays of your childhood.
Yorkletts, Whitstable, Kent, CT2 9JX, Email, www.woodlandtrust.org.uk/visiting-woods/wood-information/victory-wood/(3 miles, 4 km)
This is a place for a great walk set on the edge of the Blean Woodland area. See a wood with a difference! This is the Flagship Site, one of 33 woods plant around the UK, for the Trafalgar Woods Project to commemorate the 200th anniversary.
Whitstable, CT5 1AB, Tel: 01227 274086, www.whitstableharbour.org(0 miles, 1 km)
This working harbour's activities include fishing, commercial shipping, restaurants, cafés, shellfish & fish sales, sailing barge trips, wind farm operations storage facilities & beach hut rental.
Western Esplanade to Central Parade, Herne Bay, CT6 8RG, Tel: 01227 862162, Email, www.canterbury.gov.uk/coast(4 miles, 7 km)
A popular bathing area for families with amusements and amenities nearby, and quaint and colourful beach huts to the western end of the seafront between Herne Bay pier and Hampton pier. Seaside Award 2014.


text:
WholeFoods Magazine SourceBook: The Natural Products Directory
News about promotions, new hires, retirements and in memoriam.
In its September issue, Consumer Reports included a report claiming that dietary supplements are dangerous to people's health and posted a list of "12 supplements you should avoid."
Seattle, WA—Many studies have focused on the benefits of fish oil, which has high levels of omega-3 fatty acids, EPA and DHA. Now a new study, published in Cancer Epidemiology, Biomarkers and Prevention in July, found that it can also reduce the risk of breast cancer.
The old adage "you eat with your eyes before you eat with your stomach" holds true for several cases. Brightly colored foods entice people, but foods that are artificially dyed can be very detrimental to one's health according to the Center for Science in the Public Interest (CSPI) report entitled, Food Dyes, Rainbow of Risks. CSPI wants food dyes to be banned because they are a threat to public health.
Researchers at Worcester Polytechnic Institute (WPI) have measured cranberry juice's ability to ward off urinary tract infections (UTIs) in humans at the molecular level. During the study, Terri Camesano and his team closely examined E. coli bacteria, which are believed to cause UTIs.
The U.S. Food and Drug Administration (FDA) is seeking public comments as they draft guidelines to help implement a new federal law that requires the posting of calorie content and other nutritional information on menus at certain chain restaurants, similar retail food operations and vending machines.
A new study published in the July issue of the Archives of Neurology found that consuming vitamin E may lower a person's risk of dementia and Alzheimer's disease.
Acquisitions, new launches, new partnerships, awards, new initiatives and more.
On Monday, June 21, the Supreme Court overturned a controversial ban on genetically modified (GM) alfalfa seeds created by United States biotech giant Monsanto. According to George Kimbrell, senior staff attorney for the Center for Food Safety and lead council for the case (Monsanto v. Geertson Seed Farms), the decision leads to some important implications in future GMO cases.
According to the HerbalGram, sales of herbal...
Los Angeles, CA—The Institute for...
all products


text:
- Flat Rate Shipping. Any Size Order! -
- A Portion of Proceeds Benefit Baltimore Ravens Athletics -
Baltimore Ravens Gear
Baltimore Ravens Ladies
Baltimore Ravens Ladies T-Shirts
Baltimore Ravens Ladies T-Shirts Tank Tops
$40 to $60
(3 items)
Product ID: 1348961
Main Content
This item ships within one business day.
Order as many items as you like with our $6.99 flat rate shipping.
Need it faster?
Glam up your Baltimore Ravens style, gal! In this Sequin tank top from Meesha and Mia, your Baltimore Ravens spirit will definitely shine. It has a sequin-accented top panel and an applique Baltimore Ravens logo on the bottom left surrounded by rhinestones. Your game day look as never been so stylish!
- 92% Rayon/8% Spandex body
- 95% Polyester/5% Spandex sequin fabric
- Applique logo
- Glitter accents
- Made in the USA
- Officially licensed NFL product
- Sequin-accented top portion
- Sleeveless
Ravens Customers also liked:
Special event items are produced by manufacturers only after the outcome of a game
or event. These are advanced sale items and will ship immediately after they are
received in our warehouse.
Manufacturer direct items are shipped directly from the manufacturer. These items
are not available for international or expedited shipping.
Customized items can be personalized with options such as your name, your favorite
number, and/or designs. Some options may be limited by league rules.


text:
Choose album
There are no tags for this photo
See all photos »
Sign in, if you're already a member of this group or Join Around Arlington Meetup
72 photos
Activity on May 6, 2015
1 photo
Activity on May 5, 2015
70 photos
Activity on May 4, 2015
3 photos
Activity on May 3, 2015
Do you want to move this photo to "__ALBUM_NAME__"?
Yes, I'm Sure
About us…
Help support your Meetup
WELCOME! We're a fun group of singles and couples who like to have some fun close to home. AROUND ARLINGTON there's lots of fun stuff to do. Dallas-Fort Worth is HUGE, and sometimes its nice to have Meetups in our own neighborhoods. We will have Meetups of all types, in and around Arlington, Grand Prairie, Mansfield, Hurst, Euless, Bedford, Irving, and other nearby locations. We welcome adults of all ages.
Please review the ATTENDANCE POLICY on our ABOUT US page - we take our RSVPs seriously around here. Once you attend, you'll become an ACTIVE MEMBER! If you're new to Meetup, check out the MESSAGE BOARD for info about how to read the CALENDAR - the blue posts are Events you can RSVP for, while the yellow posts are Notes which are FYI only.
We try to plan something different each week, and we host about 100 events per year, so jump on in to any event as your first! Be sure to read the event details to know how to find the group at each location. Come join us soon for some fun!
972-296-0154. Owner is Around Arlington member Joseph Bohnsack.
Haircut, Color and Massage by Francis, Lincoln Square, 817-226-4247
Stanfield Realtors, Inc. 972-641-0447 Office, 469-583-0608 Mobile
1,749 Performance Artists
1,074 Lake Lovers
925 Theater Lovers
626 Girlfriends
3,064 Photographers
529 People
Meetup members, Log in
By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy


text:
New Releases, Giveaways & Special Projects
Technical design made to move.
Comfort & support all week long.
Your shopping cart is currently empty
You have no items to compare.
Every style of SAXX has a different fit, feel & function.
Use the filters below to find your perfect pair.
What is Modal fabric?
Modal is a natural fibre made from a European beachwood pulp making it incredibly soft to the touch.
What does Modern Fit Trunk mean?
Trunk has a slightly shorter inseam length (2") than a classic boxer brief (4"). Modern Fit is a slightly slimmer more tailored fit, kind of like the difference between slim and regular fit jeans.
Fly versus No Fly?
"Fly" refers to the opening on the front pouch on select pairs of SAXX. Some men prefer to have a fly while some don't use it at all. Use the fly filter on the Shop page to find your preference.
Please note that Platinum replaced Luxury.
95% Modal / 5% Spandex
Availability: Out of stock


text:
STYLE: In Flight Directions Card
Printable Directions Card
Different engravings of swallows combine for a light-hearted joyous flight, bringing the news of your big day. A script font based on the days when writing was done with a feather quill highlights your message. The whole design has a sense of elegance offset with the lovely unevenness of the hand-written and hand-engraved.
Regular Card Size: 4-1/4" x 5-1/2"
Shown in: Clementine and Custom blue
You will receive your first electronic proof within five business days. If you need it faster we offer a Rush Service Option!


text:
Baltimore Ravens Gear
Baltimore Ravens Mens
Baltimore Ravens Mens Jackets
(85 items)
Product ID: 1360345
Main Content
- 100% Polyester shell backing and front lining
- 68% Nylon/32% Polyester shell face
- Breathable wind and water-resistant film
- Bungee drawcord on waist
- Chest pocket with zipper
- Embroidered applique graphics
- Full zip front
- Hood features double snap button closure under chin
- Hook and loop fastener closures on cuffs
- Imported
- Inner pocket on right chest
- Locker loop
- Officially licensed
- Olympic collar
- Removable hood with zipper
- Stretch outershell bonded to fleece lining
- Three layer soft shell
- Two front pockets
Ravens Customers also liked:
Special event items are produced by manufacturers only after the outcome of a game
or event. These are advanced sale items and will ship immediately after they are
received in our warehouse.
Manufacturer direct items are shipped directly from the manufacturer. These items
are not available for international or expedited shipping.
Customized items can be personalized with options such as your name, your favorite
number, and/or designs. Some options may be limited by league rules.


text:
Get a TV bed at Dreams and treat yourself to supreme relaxation. A magnificent bed with elegant fabric headboards makes for a fantastic centrepiece to any bedroom and the added bonus of a TV discretely housed in the foot ensures you will look forward to bedtime every night.
After a hard day at work, you will love sinking into a sumptuous TV bed with prime time television playing until you sleep. A simple press of a button activates the screen so you can view your favourite shows in complete relaxation. There is also space underneath for units such as DVD players or games consoles.
We have a range of beds in a variety of colours, styles and sizes in double, king and super king to complete any bedroom whether the décor is modern urban living or classic opulence.
Our delivery team will also be happy to install your new TV bed and you have the option of a 10 Year Guarantee to give you that extra peace of mind.
If you have any questions or for more information on any of our great range of beds, don't hesitate to speak to one of our friendly sales team on 0800 652 5090.


text:
Remington UMC Handgun 250-Round Ammo Mega Pack
Key Features
Use for practice, target shooting, or training
Value and performance for high-volume shooting
Performs every time
Our Price $69.99 - $129.99
- You must be at least 21 years old to purchase this item.
- Local and/or state laws prohibit the shipment of handgun ammunition to AK, CT, DC, HI, MA, NJ, Chicago IL, Cincinnati OH, Los Angeles CA, Oakland CA, and San Francisco CA. IL and NY customers must ship orders to Gander Mountain stores. Other restrictions may apply.
- Additional discounts do not apply.
Prices, promotions, styles and availability may vary by store and online.
- details
back to topProduct Description
Value and performance for high-volume shooting. Whether it's being used for practice, target shooting, or training exercises, UMC centerfire pistol and revolver ammunition will perform every time. Shipped ground only.


text:
1993-95 Mazda RX-7 Performance Parts : Engine Mounts/Bracing
Sorry, these products are temporarily out of stock.
Racing Beat LLC © 2015, Privacy Policy
1993-95 Mazda RX-7 Performance Parts
Select a Part Category
Engine - Porting & Assembly Tools
Engine - Rotor Housings & Aluminum Side Housings
Visit Our Showroom
Visit Our Anaheim, California
salescounter and showroom.
salescounter and showroom.
Open M-F
Repair Manuals & Books
We offer a wide selection of Mazda repair guides, books, and performace guides.
Brake Line Kit
Braided Stainless Steel Brake Line Set - 1993-95 RX-7 - Improve the braking performance of your 93-95 RX-7 by upgrading ...
Our Price: $147.00
RX-7/RX-8 Flywheel - Aluminum
87-95 RX-7 Turbo / RX-8
Racing Beat-designed RX-7 flywheels are both engineered and manufactured by Racing Beat for a wide ...
Our Price: $378.00
Stainless Steel Clutch Line
93-95 RX-7 / 90-97 Miata
Replace the original rubber clutch line on your 1993-95 RX-7/1990-97 Miata chassis with an upgraded braided stainless ...
Our Price: $27.00


text:
How to Tie a Sarong
When you know how to tie a sarong a few different ways, you'll love wearing one to the beach or the pool as a swimsuit cover-up, on vacation as an outfit, or just around town on a casual summer day. A sarong can be worn as a dress, wrapped around your waist as a long skirt, or doubled over to create a short skirt. Here's how to do it.


text:
Farm Frenzy 3 - American Pie
3 Online
Log In to play with your friends
| |
Farm Squaresby TweenSoft
The object of this game is to rotate the farm icons until four icons of the same kind form the four corners of a square. The square can be of any size and orientation. Tap to rotate the icons and click the arrow buttons on the left to change the direction of rotation.
Report an Issue
Farm Squares


text:
Owners and veterinarians are constantly in search of methods to prevent the onset of osteoarthritis, reduce its severity, or halt its progression. Nutraceuticals such as joint supplements have become popular preventative therapies.
To continue reading this article, become a member of TheHorse.com.
It's FREE and you'll get full access to more than 20,000 articles, video, free reports & more.