0^{b_n}(u(n,I+1,S-p) - u(n,I,S)) f(p) dp = 0. \qquad \text{(A.2)}$$

From the terminal condition $u(N,I,S) = g(N,I,S)$, the value function $u$ can easily be approximated numerically by backward induction on a grid.\
The optimal bid for the $n^{\text{th}}$ auction is given by the optimality condition $$u(n,I_{n-1}+1,S_{n-1}-b^*_n) = u(n,I_{n-1},S_{n-1})$$ or by $b^*_n = S_{n-1}$ if $u(n,I_{n-1}+1,0) > u(n,I_{n-1},S_{n-1})$. In particular, when the constraint is not binding, the optimal bid is consistent with the fact that, in the case of Vickrey auctions, participants have the incentive to bid their true valuation for the item.\
It is noteworthy that a similar change of variables as in the continuous-time model of Section 2 can be used in the special case where $g(N,I,S) = I$. In that case, if we write $u(n,I,S) = I + v(n,S)$, then the Bellman equation (A.2) can be simplified into: $$v(n,S) - v(n-1,S) + \max_{b_n \in [0,S]}\int_0^{b_n}(v(n,S-p) - v(n,S) + 1) f(p) dp = 0,$$ and the terminal condition is $v(N,S) = 0$.\
This model in discrete-time is useful to understand the general modeling framework we use, but it is limited. First, in practice, auctions arrive at random times and we do not know in advance how many auction requests the algorithm will receive. Moreover, for problems where different sources of auction requests have to be treated in parallel, the above discrete modeling approach is not convenient. Continuous-time models, where the (random) occurrence of auction requests are modeled by the jumps of a Poisson process, are definitely more realistic and flexible.\

[10]{} Amin, K., K
0^{b_n}(u(n, I+1,S - p) - u(n, I, S) ) f(p) dp = 0. \qquad \text{(A.2)}$$ 

 From the terminal condition $ u(N, I, S) = g(N, I, S)$, the value function $ u$ can well be approximate numerically by backward induction on a grid.\ 
 The optimal command for the $ n^{\text{th}}$ auction is given by the optimality circumstance $ $ u(n, I_{n-1}+1,S_{n-1}-b^*_n) = u(n, I_{n-1},S_{n-1})$$ or by $ b^*_n = S_{n-1}$ if $ u(n, I_{n-1}+1,0) > u(n, I_{n-1},S_{n-1})$. In particular, when the constraint is not tie down, the optimal bid is reproducible with the fact that, in the case of Vickrey auctions, player have the incentive to bid their dependable evaluation for the item.\ 
 It is noteworthy that a similar change of variable star as in the continuous - time model of part 2 can be used in the special case where $ g(N, I, S) = I$. In that character, if we write $ u(n, I, S) = I + v(n, S)$, then the Bellman equation (A.2) can be simplified into: $ $ v(n, S) - v(n-1,S) + \max_{b_n \in [ 0,S]}\int_0^{b_n}(v(n, S - p) - v(n, S) + 1) f(p) dp = 0,$$ and the concluding condition is $ v(N, S) = 0$.\ 
 This mannequin in discrete - time is useful to understand the cosmopolitan modeling framework we use, but it is limited. First, in practice, auction arrive at random times and we do not know in advance how many auction requests the algorithm will receive. Moreover, for problems where different sources of auction requests suffer to be treated in parallel, the above discrete model overture is not convenient. Continuous - time models, where the (random) happening of auction requests are model by the jumps of a Poisson process, are decidedly more realistic and flexible.\ 

 [ 10 ] { } Amin, K., K
0^{b_n}(u(j,I+1,S-p) - u(n,I,S)) f(p) dp = 0. \qquad \text{(A.2)}$$

From the jeeminal condifion $u(N,I,R) = g(N,I,S)$, the value function $u$ cqn eawily be approximated njmericallj by backqard unduction on a grid.\
The olbimal uid for the $n^{\tewt{th}}$ auctiot is given by dhd lptimality condition $$u(n,I_{n-1}+1,S_{n-1}-b^*_n) = u(n,I_{n-1},F_{n-1})$$ or bu $h^*_n = S_{n-1}$ if $u(n,I_{n-1}+1,0) > u(n,P_{n-1},F_{n-1})$. Ih particular, when the constraint ia not bpnding, the optimak bid is consistent with tje fwct that, in the cade of Vickrgg atxtions, partizipants hanz the incenjive to bid their true valuation for che item.\
It us nohgworthy that a siiilar change of varidbles ax in the contikuous-vime model of Section 2 cai be used in the spesial case wkere $g(N,I,S) = I$. In that xawe, if we fritd $u(n,K,S) = I + b(n,S)$, thfn vhe Bellman equation (A.2) can be simplified onei: $$v(n,S) - v(n-1,S) + \mzx_{b_n \ig [0,F]}\int_0^{b_n}(v(n,S-p) - v(n,S) + 1) f(p) dp = 0,$$ and the termital condition is $v(N,S) = 0$.\
This model in discrete-timg is usefuj to understand the general modeling framework we use, uug iu lf oilited. First, in practice, auctions arrive at ragsok nimes and we do njt know in sdgamse how many aoction xsqhests the algorithl will teceivw. Moreovew, fot problems where different wources of alctiin requests have tl be treateb in psrallrl, the above discrete mudeljng approacj is not dunvenient. Continjoux-thme models, where the (randoi) occurreice oy auctiov reauests are modelfd by the jumps of a Poidson krocesv, are defijitely more realistic and flexiuke.\

[10]{} Amin, K., K
0^{b_n}(u(n,I+1,S-p) - u(n,I,S)) f(p) dp = 0. From terminal condition = g(N,I,S)$, the be numerically by backward on a grid.\ optimal bid for the $n^{\text{th}}$ auction given by the optimality condition $$u(n,I_{n-1}+1,S_{n-1}-b^*_n) = u(n,I_{n-1},S_{n-1})$$ or by $b^*_n = S_{n-1}$ $u(n,I_{n-1}+1,0) > u(n,I_{n-1},S_{n-1})$. In particular, when the constraint is not binding, the optimal is with fact in the case of Vickrey auctions, participants have the incentive to bid their true valuation for item.\ It is noteworthy that a similar change variables as in the model of Section 2 can used the special where = In that case, we write $u(n,I,S) = I + v(n,S)$, then the Bellman equation (A.2) can be simplified into: $$v(n,S) v(n-1,S) + [0,S]}\int_0^{b_n}(v(n,S-p) - + f(p) = 0,$$ and condition is $v(N,S) = 0$.\ This is useful to understand the general modeling framework use, but is limited. First, in practice, auctions at random times and we do not know advance how many auction requests the algorithm will receive. Moreover, for problems where different sources requests have to be in parallel, the discrete approach not Continuous-time models, the (random) occurrence of auction requests are modeled by the jumps a Poisson process, are definitely more realistic and flexible.\ [10]{} K
0^{b_n}(u(n,I+1,S-p) - u(n,I,S)) f(p) dp = 0. \qquad \text{(A.2)}$$

from the terMinal ConDitIoN $u(N,I,s) = g(N,I,s)$, the value functIOn $u$ cAn easily be approximated NumerIcALly bY BaCkwarD inductIOn ON A grId.\
thE opTiMAl Bid foR thE $n^{\text{tH}}$ auction is GivEn By the optimalITy Condition $$u(N,I_{n-1}+1,s_{n-1}-b^*_n) = u(n,I_{n-1},S_{n-1})$$ or By $b^*_N = S_{n-1}$ if $u(N,I_{N-1}+1,0) > u(n,i_{N-1},S_{n-1})$. In ParTiculAr, when THe consTraint is nOt BInding, THe optimAL BiD is cOnsistent with the fACt THat, in the case of vickreY aUCtIONs, pArtIcipants haVe The inCEntive tO BiD THEir TRue valuation fOr the item.\
It IS noTewortHy ThaT A similAr chaNgE Of vAriables as iN the ContinuouS-time mODel of SeCTion 2 can Be used In tHe sPeciAL cAsE whErE $G(N,I,s) = i$. IN thAT caSe, if we wrItE $u(N,I,S) = I + v(N,S)$, thEN THE BelLmaN equAtion (a.2) can be simplifIed Into: $$V(N,S) - v(N-1,S) + \max_{B_n \in [0,S]}\Int_0^{b_N}(v(N,S-p) - v(n,s) + 1) f(p) dp = 0,$$ aNd the TeRminal condition Is $v(N,s) = 0$.\
This modeL in DiScrEtE-time IS usefuL to UndErstand The geneRAl mOdELINg Framework we use, but iT iS LImIted. FirsT, in praCTiCe, AUctions aRrIve At raNDOm timEs anD We Do not knoW in advANcE hOw many aUcTion reQuEstS thE algoRIthm Will reCeive. MorEover, FOr problems wherE Different sourCEs OF AuCTion ReqUests have to Be trEAted In paRAlLel, THe aboVe disCrETe MOdeling approach is noT cOnveniEnt. CoNtinuous-time mOdels, where THE (Random) ocCurrENcE Of auction requeSts arE modeled by THe jumps oF a PoiSson procEss, are defINItely morE reAliStiC anD FLeXible.\

[10]{} Amin, K., K
0^{b_n}(u(n,I+1,S-p) - u(n ,I,S)) f(p ) dp= 0 . \ qq uad\tex t{(A.2)}$$

Fr o m th e terminal condition $ u(N,I ,S )  = g ( N, I,S)$ , the v a lu e fun ct io n $ u$ ca n eas ily  be app roximatednum er ically by ba c kw ard induct ion  on a grid.\ 
Th e opti ma l b i d for  th e $n^ {\text { th}}$auction i sg iven b y  the op t i ma lity  condition $$u(n, I _{ n -1}+1,S_{n-1}- b^*_n)  = u( n , I_{ n-1 },S_{n-1}) $$  or b y  $b^*_n =S _ { n-1 } $ if $u(n,I_{ n-1}+1,0) > u(n ,I_{n- 1} ,S_ { n-1})$ . Inpa r tic ular, whentheconstrain t is n o t bindi n g, theoptima l b idis c o ns is ten tw ith th e f a ctthat, in  t he  case  ofV i c k reyauc tion s, pa rticipants ha vethei nce ntive  to b id t he ir tr ue val uatio nfor the item.\It i s notewor thy  t hat  a  simi l ar cha nge  of  variab les asi n t he c o nt inuous-time modelof S ec tion 2 c an beu se di n the sp ec ial  cas e where  $g( N ,I ,S) = I$ . In t h at  c ase, if  w e writ e$u( n,I ,S) = I +v(n,S) $, thenthe B e llman equation (A.2) can bes im p l if i ed i nto : $$v(n,S)- v( n -1,S ) +\ ma x_{ b _n \i n [0, S] } \i n t_0^{b_n}(v(n,S-p)-v(n,S)  + 1)  f(p) dp = 0, $$ and the t e rminal c ondi t io n  is $v(N,S) =0$.\This model in discr ete-t ime is u seful tou n derstand  th e g ene ral m od eling framewo r k  weus e, butitis limi ted . F irs t,in  practice , auctio ns  a rr iv e a t ran d om times  a ndwe  do  notk now in  adva nceho wm any  auctio n  r e q uest sth e al gor it hm wi ll r e cei ve. Mor eover, fo r p r oble ms  w here di fferent sourc es  of auctio nreq uestsh a ve to be  treated in parallel, t h e above  di scret e mo deling ap pro ach is  no t  conve nient.  Cont in uou s - timem o de ls,  w here the ( r a ndo m) oc cu rren ce of a uction requests ar e  mo deled by thejum ps o f aPoi s so n  pr oc e ss, a re definitely m ore realis ti c  a nd flexibl e .\
[ 10]{} A min, K. , K
0^{b_n}(u(n,I+1,S-p) -_u(n,I,S)) f(p)_dp = 0. \qquad_\text{(A.2)}$$

From the_terminal_condition $u(N,I,S)_=_g(N,I,S)$, the value_function $u$ can_easily be approximated numerically_by backward induction_on_a grid.\
The optimal bid for the $n^{\text{th}}$ auction is given by the optimality condition_$$u(n,I_{n-1}+1,S_{n-1}-b^*_n)_= u(n,I_{n-1},S_{n-1})$$_or_by_$b^*_n = S_{n-1}$ if $u(n,I_{n-1}+1,0)_> u(n,I_{n-1},S_{n-1})$. In particular, when_the constraint_is not binding, the optimal bid is consistent_with_the fact that,_in the case of Vickrey auctions, participants have the_incentive to bid their true valuation_for the item.\
It_is_noteworthy_that a similar change_of variables as in the continuous-time_model of Section 2 can be_used in the special case where $g(N,I,S)_= I$. In that case, if_we write $u(n,I,S) = I_+ v(n,S)$,_then the Bellman equation (A.2)_can be simplified_into: $$v(n,S)_- v(n-1,S) +_\max_{b_n \in [0,S]}\int_0^{b_n}(v(n,S-p) - v(n,S) +_1) f(p) dp_= 0,$$ and the terminal condition_is_$v(N,S) = 0$.\
This_model_in_discrete-time is_useful to understand_the_general modeling_framework_we use, but it is limited._First,_in practice, auctions arrive at random times_and we do not_know_in advance how many_auction requests the algorithm will_receive. Moreover, for problems where different_sources of_auction requests_have to be treated in parallel, the above discrete modeling approach_is not convenient. Continuous-time models, where_the (random) occurrence of_auction requests_are_modeled by the_jumps_of a_Poisson process, are definitely more realistic and_flexible.\

[10]{} Amin,_K., K