Occupation Times in Markov Processes - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Reports (Research Report) Year : 1999

## Occupation Times in Markov Processes

Bruno Sericola

#### Abstract

We consider, in a homogeneous Markov process with finite state space, the occupation times that is, the times spent by the process in given subsets of the state space during a finite interval of time. We first derive the distribution of the occupation time of one subset and then we generalize this result to the joint distribution of occupation times of different subsets of the state space by the use of order statistics from the uniform distribution. Next, we consider the distribution of weighted sums of occupation times. We obtain the forward and backward equations describing the behavior of these weighted sums and we show how these equations lead to simple expressions of this distribution.

Other [cs.OH]

### Dates and versions

inria-00072852 , version 1 (24-05-2006)

### Identifiers

• HAL Id : inria-00072852 , version 1

### Cite

Bruno Sericola. Occupation Times in Markov Processes. [Research Report] RR-3806, INRIA. 1999. ⟨inria-00072852⟩

### Export

BibTeX TEI Dublin Core DC Terms EndNote Datacite

136 View
{"ft_lang_label":"__label__en","ft_lang_prob":0.90729135,"math_prob":0.66196257,"size":745,"snap":"2023-14-2023-23","text_gpt3_token_len":134,"char_repetition_ratio":0.1659919,"word_repetition_ratio":0.017094018,"special_character_ratio":0.17181209,"punctuation_ratio":0.062015504,"nsfw_num_words":0,"has_unicode_error":false,"math_prob_llama3":0.9562667,"pos_list":[0,1,2,3,4],"im_url_duplicate_count":[null,null,null,null,null],"WARC_HEADER":"{\"WARC-Type\":\"response\",\"WARC-Date\":\"2023-06-10T18:45:53Z\",\"WARC-Record-ID\":\"<urn:uuid:f34f20ad-1b16-4b0e-9682-ffe2d5305f7d>\",\"Content-Length\":\"83587\",\"Content-Type\":\"application/http; msgtype=response\",\"WARC-Warcinfo-ID\":\"<urn:uuid:8f9d6548-688f-4889-af1c-f38dbd2580ea>\",\"WARC-Concurrent-To\":\"<urn:uuid:a3d3963e-a62b-4845-a1b2-9e3360e1058c>\",\"WARC-IP-Address\":\"193.48.96.10\",\"WARC-Target-URI\":\"https://inria.hal.science/inria-00072852v1\",\"WARC-Payload-Digest\":\"sha1:JZQJEZ372HY3VVFIHXAD72SW5WAYRJAR\",\"WARC-Block-Digest\":\"sha1:LEE2VT4PHDSRQNE25L4YSQKRIM2ALYXI\",\"WARC-Identified-Payload-Type\":\"application/xhtml+xml\",\"warc_filename\":\"/cc_download/warc_2023/CC-MAIN-2023-23/CC-MAIN-2023-23_segments_1685224657735.85_warc_CC-MAIN-20230610164417-20230610194417-00268.warc.gz\"}"}