# How to make use of opponent policy on designing ours in multi-agent learning

I’m currently working on a multi-agent reinforcement learning. The setting is a cooperative multi-agent system with a stationary assumption on the opponent policy. Suppose I have the model of the opponent policy $$\rho(\cdot|s_t)$$, where $$s_t$$ denotes the environment state at time $$t$$. I’m currently wondering how to actually make use of it to design our controllable agent policy $$\pi(\cdot|s_t)$$?

Intuitively, I think the form of the policy should be like $$\pi(\cdot|s_t,\rho(\cdot|s_t))$$. Yet, I don’t have any idea to parameterize the expression, i.e. make it as a functional form $$\pi(\cdot|s_t,\rho(\cdot|s_t)) = f(s_t,\rho(\cdot|s_t))$$. Does anyone have some clue with a sound/best practice parameterization? Any thought would be appreciated.

Posted on Categories proxies
{"ft_lang_label":"__label__en","ft_lang_prob":0.92464757,"math_prob":0.98500484,"size":760,"snap":"2021-04-2021-17","text_gpt3_token_len":195,"char_repetition_ratio":0.1441799,"word_repetition_ratio":0.0,"special_character_ratio":0.26052633,"punctuation_ratio":0.11564626,"nsfw_num_words":0,"has_unicode_error":false,"math_prob_llama3":0.99233,"pos_list":[0],"im_url_duplicate_count":[null],"WARC_HEADER":"{\"WARC-Type\":\"response\",\"WARC-Date\":\"2021-01-22T13:52:06Z\",\"WARC-Record-ID\":\"<urn:uuid:fd7b7527-0ad0-47c9-9ad1-a3b140714b16>\",\"Content-Length\":\"23811\",\"Content-Type\":\"application/http; msgtype=response\",\"WARC-Warcinfo-ID\":\"<urn:uuid:9022c778-711f-446f-a6db-93fe1d89a054>\",\"WARC-Concurrent-To\":\"<urn:uuid:b282ea05-d36f-49bb-a00c-26f8a8e4fc08>\",\"WARC-IP-Address\":\"173.212.203.156\",\"WARC-Target-URI\":\"https://proxieslive.com/how-to-make-use-of-opponent-policy-on-designing-ours-in-multi-agent-learning/\",\"WARC-Payload-Digest\":\"sha1:4MGNGKTT3I7BRCVSH4GBY7EPAFIBEQ5Z\",\"WARC-Block-Digest\":\"sha1:J7MJGE62HV6QRTXHQJC6R2HWJHRPWUEK\",\"WARC-Identified-Payload-Type\":\"text/html\",\"warc_filename\":\"/cc_download/warc_2021/CC-MAIN-2021-04/CC-MAIN-2021-04_segments_1610703529331.99_warc_CC-MAIN-20210122113332-20210122143332-00185.warc.gz\"}"}