1. A multi-perspective context sensitive behavior assessment system comprising: an adaptive behavior model builder, executed by a processor, establishing a real-time reference model capturing intention of motion behavior by modeling outputs of multiple user defined scoring functions with respect to multiple references of application specific target areas of interest, wherein at least two of the target areas have criticality values representing a user's preference regarding at least one of the target areas with respect to at least one other of the target areas, and wherein the outputs of the scoring functions are multiplied by the critically values to form high level sequences of representation that are communicated to the user, further comprising a behavior assessment module that performs behavior assessment by: using the scoring functions associated with application specific target areas to calculate an intention score, and the scoring functions assign a score to a current sample point of a trajectory by aggregating previous scores of the trajectory in a moving time window; normalizing the intention score by using a score assessment model that is continuously updated for each of plural application contexts; calculating a target-intention matrix by using the normalized intention scores with the criticality value of each target area; and assigning an application specific high level semantic label to a moving object by using values in the target-intention matrix and application context descriptions.