1. A method of data correlation and analysis of past activities and prediction of future activity using a distributed analysis engine, the method comprising: establishing a database comprising structured metadata on at least one computer and a distributed system of networked computers comprising a plurality of levels each having at least one personal computer, wherein an entry level of the plurality of levels further comprises at least one personal digital assistant or hand held computer; configuring a database front-end to parse incoming data, the database front-end defining a plurality of entities, one or more attributes for each entity of the plurality of entities, a plurality of events, one or more attributes for each event of the plurality of events, and one or more correlation IDs, the correlation IDs being user defined attribute relationships that correlate events and entities in the database; collecting data from a plurality of sources; parsing the incoming data in the database front-end into structured metadata comprising one or more of entities, attributes, events and correlation IDs; and said distributed analysis engine: correlating the structured metadata of the incoming data with structured metadata in the database and determining micro-patterns in the structured metadata using said distributed analysis engine; generating a graphical representation of a composite network of determined micro-patterns in the structured metadata between events and entities in the incoming structured metadata and structured metadata in the database as one or more super-objects; and predicting future activity from the one or more super-objects representing the determined micro-patterns.