Stochastic approximation approaches for CVaR-based variational inequalities
This paper considers variational inequalities (VI) defined by the conditional value-at-risk (CVaR) of uncertain functions and provides three stochastic approximation schemes to solve them. All methods use an empirical estimate of the CVaR at each iteration. The first algorithm constrains the iterates to the feasible set using projection. To overcome the computational burden of projections, the second one handles inequality and equality constraints defining the feasible set differently. Particularly, projection onto to the affine subspace defined by the equality constraints is achieved by matrix multiplication and inequalities are handled by using penalty functions. Finally, the third algorithm discards projections altogether by introducing multiplier updates. We establish asymptotic convergence of all our schemes to any arbitrary neighborhood of the solution of the VI. A simulation example concerning a network routing game illustrates our theoretical findings.
\section{Introduction}
\label{sec:introduction}
This document is a template for \LaTeX. If you are 
reading a paper or PDF version of this document, please download the 
electronic file, trans\_jour.tex, from the IEEE Web site at \underline
{http://www.ieee.org/authortools/trans\_jour.tex} so you can use it to prepare your manuscript. If 
you would prefer to use LaTeX, download IEEE's LaTeX style and sample files 
from the same Web page. You can also explore using the Overleaf editor at 
\underline
{https://www.overleaf.com/blog/278-how-to-use-overleaf-with-}\discretionary{}{}{}\underline
{ieee-collabratec-your-quick-guide-to-getting-started\#.}\discretionary{}{}{}\underline{xsVp6tpPkrKM9}

If your paper is intended for a conference, please contact your conference 
editor concerning acceptable word processor formats for your particular 
conference. 

IEEE will do the final formatting of your paper. If your paper is intended 
for a conference, please observe the conference page limits. 

\subsection{Abbreviations and Acronyms}
Define abbreviations and acronyms the first time they are used in the text, 
even after they have already been defined in the abstract. Abbreviations 
such as IEEE, SI, ac, and dc do not have to be defined. Abbreviations that 
incorporate periods should not have spaces: write ``C.N.R.S.,'' not ``C. N. 
R. S.'' Do not use abbreviations in the title unless they are unavoidable 
(for example, ``IEEE'' in the title of this article).

\subsection{Other Recommendations}
Use one space after periods and colons. Hyphenate complex modifiers: 
``zero-field-cooled magnetization.'' Avoid dangling participles, such as, 
``Using \eqref{eq}, the potential was calculated.'' [It is not clear who or what 
used \eqref{eq}.] Write instead, ``The potential was calculated by using \eqref{eq},'' or 
``Using \eqref{eq}, we calculated the potential.''

Use a zero before decimal points: ``0.25,'' not ``.25.'' Use 
``cm$^{3}$,'' not ``cc.'' Indicate sample dimensions as ``0.1 cm 
$\times $ 0.2 cm,'' not ``0.1 $\times $ 0.2 cm$^{2}$.'' The 
abbreviation for ``seconds'' is ``s,'' not ``sec.'' Use 
``Wb/m$^{2}$'' or ``webers per square meter,'' not 
``webers/m$^{2}$.'' When expressing a range of values, write ``7 to 
9'' or ``7--9,'' not ``7$\sim $9.''

A parenthetical statement at the end of a sentence is punctuated outside of 
the closing parenthesis (like this). (A parenthetical sentence is punctuated 
within the parentheses.) In American English, periods and commas are within 
quotation marks, like ``this period.'' Other punctuation is ``outside''! 
Avoid contractions; for example, write ``do not'' instead of ``don't.'' The 
serial comma is preferred: ``A, B, and C'' instead of ``A, B and C.''

If you wish, you may write in the first person singular or plural and use 
the active voice (``I observed that $\ldots$'' or ``We observed that $\ldots$'' 
instead of ``It was observed that $\ldots$''). Remember to check spelling. If 
your native language is not English, please get a native English-speaking 
colleague to carefully proofread your paper.

Try not to use too many typefaces in the same article. You're writing
scholarly papers, not ransom notes. Also please remember that MathJax
can't handle really weird typefaces.

\subsection{Equations}
Number equations consecutively with equation numbers in parentheses flush 
with the right margin, as in \eqref{eq}. To make your equations more 
compact, you may use the solidus (~/~), the exp function, or appropriate 
exponents. Use parentheses to avoid ambiguities in denominators. Punctuate 
equations when they are part of a sentence, as in
\begin{equation}E=mc^2.\label{eq}\end{equation}

Be sure that the symbols in your equation have been defined before the 
equation appears or immediately following. Italicize symbols ($T$ might refer 
to temperature, but T is the unit tesla). Refer to ``\eqref{eq},'' not ``Eq. \eqref{eq}'' 
or ``equation \eqref{eq},'' except at the beginning of a sentence: ``Equation \eqref{eq} 
is $\ldots$ .''

\subsection{\LaTeX-Specific Advice}

Please use ``soft'' (e.g., \verb|\eqref{Eq}|) cross references instead
of ``hard'' references (e.g., \verb|(1)|). That will make it possible
to combine sections, add equations, or change the order of figures or
citations without having to go through the file line by line.

Please don't use the \verb|{eqnarray}| equation environment. Use
\verb|{align}| or \verb|{IEEEeqnarray}| instead. The \verb|{eqnarray}|
environment leaves unsightly spaces around relation symbols.

Please note that the \verb|{subequations}| environment in {\LaTeX}
will increment the main equation counter even when there are no
equation numbers displayed. If you forget that, you might write an
article in which the equation numbers skip from (17) to (20), causing
the copy editors to wonder if you've discovered a new method of
counting.

{\BibTeX} does not work by magic. It doesn't get the bibliographic
data from thin air but from .bib files. If you use {\BibTeX} to produce a
bibliography you must send the .bib files. 

{\LaTeX} can't read your mind. If you assign the same label to a
subsubsection and a table, you might find that Table I has been cross
referenced as Table IV-B3. 

{\LaTeX} does not have precognitive abilities. If you put a
\verb|\label| command before the command that updates the counter it's
supposed to be using, the label will pick up the last counter to be
cross referenced instead. In particular, a \verb|\label| command
should not go before the caption of a figure or a table.

Do not use \verb|\nonumber| inside the \verb|{array}| environment. It
will not stop equation numbers inside \verb|{array}| (there won't be
any anyway) and it might stop a wanted equation number in the
surrounding equation.

If you are submitting your paper to a colorized journal, you can use
the following two lines at the start of the article to ensure its
appearance resembles the final copy:

\smallskip\noindent
\begin{small}
\begin{tabular}{l}
\verb+\+\texttt{documentclass[journal,twoside,web]\{ieeecolor\}}\\
\verb+\+\texttt{usepackage\{\textit{Journal\_Name}\}}
\end{tabular}
\end{small}

\section{Units}
Use either SI (MKS) or CGS as primary units. (SI units are strongly 
encouraged.) English units may be used as secondary units (in parentheses). 
This applies to papers in data storage. For example, write ``15 
Gb/cm$^{2}$ (100 Gb/in$^{2})$.'' An exception is when 
English units are used as identifiers in trade, such as ``3\textonehalf-in 
disk drive.'' Avoid combining SI and CGS units, such as current in amperes 
and magnetic field in oersteds. This often leads to confusion because 
equations do not balance dimensionally. If you must use mixed units, clearly 
state the units for each quantity in an equation.

The SI unit for magnetic field strength $H$ is A/m. However, if you wish to use 
units of T, either refer to magnetic flux density $B$ or magnetic field 
strength symbolized as $\mu _{0}H$. Use the center dot to separate 
compound units, e.g., ``A$\cdot $m$^{2}$.''

\section{Some Common Mistakes}
The word ``data'' is plural, not singular. The subscript for the 
permeability of vacuum $\mu _{0}$ is zero, not a lowercase letter 
``o.'' The term for residual magnetization is ``remanence''; the adjective 
is ``remanent''; do not write ``remnance'' or ``remnant.'' Use the word 
``micrometer'' instead of ``micron.'' A graph within a graph is an 
``inset,'' not an ``insert.'' The word ``alternatively'' is preferred to the 
word ``alternately'' (unless you really mean something that alternates). Use 
the word ``whereas'' instead of ``while'' (unless you are referring to 
simultaneous events). Do not use the word ``essentially'' to mean 
``approximately'' or ``effectively.'' Do not use the word ``issue'' as a 
euphemism for ``problem.'' When compositions are not specified, separate 
chemical symbols by en-dashes; for example, ``NiMn'' indicates the 
intermetallic compound Ni$_{0.5}$Mn$_{0.5}$ whereas 
``Ni--Mn'' indicates an alloy of some composition 
Ni$_{x}$Mn$_{1-x}$.

\begin{figure}[!t]
\centerline{\includegraphics[width=\columnwidth]{fig1.png}}
\caption{Magnetization as a function of applied field.
It is good practice to explain the significance of the figure in the caption.}
\label{fig1}
\end{figure}

Be aware of the different meanings of the homophones ``affect'' (usually a 
verb) and ``effect'' (usually a noun), ``complement'' and ``compliment,'' 
``discreet'' and ``discrete,'' ``principal'' (e.g., ``principal 
investigator'') and ``principle'' (e.g., ``principle of measurement''). Do 
not confuse ``imply'' and ``infer.'' 

Prefixes such as ``non,'' ``sub,'' ``micro,'' ``multi,'' and ``ultra'' are 
not independent words; they should be joined to the words they modify, 
usually without a hyphen. There is no period after the ``et'' in the Latin 
abbreviation ``\emph{et al.}'' (it is also italicized). The abbreviation ``i.e.,'' means 
``that is,'' and the abbreviation ``e.g.,'' means ``for example'' (these 
abbreviations are not italicized).

A general IEEE styleguide is available at \underline{http://www.ieee.org/authortools}.

\section{Guidelines for Graphics Preparation and Submission}
\label{sec:guidelines}

\subsection{Types of Graphics}
The following list outlines the different types of graphics published in 
IEEE journals. They are categorized based on their construction, and use of 
color/shades of gray:

\subsubsection{Color/Grayscale figures}
{Figures that are meant to appear in color, or shades of black/gray. Such 
figures may include photographs, illustrations, multicolor graphs, and 
flowcharts.}

\subsubsection{Line Art figures}
{Figures that are composed of only black lines and shapes. These figures 
should have no shades or half-tones of gray, only black and white.}

\subsubsection{Author photos}
{Head and shoulders shots of authors that appear at the end of our papers. }

\subsubsection{Tables}
{Data charts which are typically black and white, but sometimes include 
color.}

\begin{table}
\caption{Units for Magnetic Properties}
\label{table}
\setlength{\tabcolsep}{3pt}
\begin{tabular}{|p{25pt}|p{75pt}|p{115pt}|}
\hline
Symbol& 
Quantity& 
Conversion from Gaussian and \par CGS EMU to SI $^{\mathrm{a}}$ \\
\hline
$\Phi $& 
magnetic flux& 
1 Mx $\to  10^{-8}$ Wb $= 10^{-8}$ V$\cdot $s \\
$B$& 
magnetic flux density, \par magnetic induction& 
1 G $\to  10^{-4}$ T $= 10^{-4}$ Wb/m$^{2}$ \\
$H$& 
magnetic field strength& 
1 Oe $\to  10^{3}/(4\pi )$ A/m \\
$m$& 
magnetic moment& 
1 erg/G $=$ 1 emu \par $\to 10^{-3}$ A$\cdot $m$^{2} = 10^{-3}$ J/T \\
$M$& 
magnetization& 
1 erg/(G$\cdot $cm$^{3}) =$ 1 emu/cm$^{3}$ \par $\to 10^{3}$ A/m \\
4$\pi M$& 
magnetization& 
1 G $\to  10^{3}/(4\pi )$ A/m \\
$\sigma $& 
specific magnetization& 
1 erg/(G$\cdot $g) $=$ 1 emu/g $\to $ 1 A$\cdot $m$^{2}$/kg \\
$j$& 
magnetic dipole \par moment& 
1 erg/G $=$ 1 emu \par $\to 4\pi \times  10^{-10}$ Wb$\cdot $m \\
$J$& 
magnetic polarization& 
1 erg/(G$\cdot $cm$^{3}) =$ 1 emu/cm$^{3}$ \par $\to 4\pi \times  10^{-4}$ T \\
$\chi , \kappa $& 
susceptibility& 
1 $\to  4\pi $ \\
$\chi_{\rho }$& 
mass susceptibility& 
1 cm$^{3}$/g $\to  4\pi \times  10^{-3}$ m$^{3}$/kg \\
$\mu $& 
permeability& 
1 $\to  4\pi \times  10^{-7}$ H/m \par $= 4\pi \times  10^{-7}$ Wb/(A$\cdot $m) \\
$\mu_{r}$& 
relative permeability& 
$\mu \to \mu_{r}$ \\
$w, W$& 
energy density& 
1 erg/cm$^{3} \to  10^{-1}$ J/m$^{3}$ \\
$N, D$& 
demagnetizing factor& 
1 $\to  1/(4\pi )$ \\
\hline
\multicolumn{3}{p{251pt}}{Vertical lines are optional in tables. Statements that serve as captions for 
the entire table do not need footnote letters. }\\
\multicolumn{3}{p{251pt}}{$^{\mathrm{a}}$Gaussian units are the same as cg emu for magnetostatics; Mx 
$=$ maxwell, G $=$ gauss, Oe $=$ oersted; Wb $=$ weber, V $=$ volt, s $=$ 
second, T $=$ tesla, m $=$ meter, A $=$ ampere, J $=$ joule, kg $=$ 
kilogram, H $=$ henry.}
\end{tabular}
\label{tab1}
\end{table}

\subsection{Multipart figures}
Figures compiled of more than one sub-figure presented side-by-side, or 
stacked. If a multipart figure is made up of multiple figure
types (one part is lineart, and another is grayscale or color) the figure 
should meet the stricter guidelines.

\subsection{File Formats For Graphics}\label{formats}
Format and save your graphics using a suitable graphics processing program 
that will allow you to create the images as PostScript (PS), Encapsulated 
PostScript (.EPS), Tagged Image File Format (.TIFF), Portable Document 
Format (.PDF), Portable Network Graphics (.PNG), or Metapost (.MPS), sizes them, and adjusts 
the resolution settings. When 
submitting your final paper, your graphics should all be submitted 
individually in one of these formats along with the manuscript.

\subsection{Sizing of Graphics}
Most charts, graphs, and tables are one column wide (3.5 inches/88 
millimeters/21 picas) or page wide (7.16 inches/181 millimeters/43 
picas). The maximum depth a graphic can be is 8.5 inches (216 millimeters/54
picas). When choosing the depth of a graphic, please allow space for a 
caption. Figures can be sized between column and page widths if the author 
chooses, however it is recommended that figures are not sized less than 
column width unless when necessary. 

There is currently one publication with column measurements that do not 
coincide with those listed above. Proceedings of the IEEE has a column 
measurement of 3.25 inches (82.5 millimeters/19.5 picas). 

The final printed size of author photographs is exactly
1 inch wide by 1.25 inches tall (25.4 millimeters$\,\times\,$31.75 millimeters/6 
picas$\,\times\,$7.5 picas). Author photos printed in editorials measure 1.59 inches 
wide by 2 inches tall (40 millimeters$\,\times\,$50 millimeters/9.5 picas$\,\times\,$12 
picas).

\subsection{Resolution }
The proper resolution of your figures will depend on the type of figure it 
is as defined in the ``Types of Figures'' section. Author photographs, 
color, and grayscale figures should be at least 300dpi. Line art, including 
tables should be a minimum of 600dpi.

\subsection{Vector Art}
In order to preserve the figures' integrity across multiple computer 
platforms, we accept files in the following formats: .EPS/.PDF/.PS. All 
fonts must be embedded or text converted to outlines in order to achieve the 
best-quality results.

\subsection{Color Space}
The term color space refers to the entire sum of colors that can be 
represented within the said medium. For our purposes, the three main color 
spaces are Grayscale, RGB (red/green/blue) and CMYK 
(cyan/magenta/yellow/black). RGB is generally used with on-screen graphics, 
whereas CMYK is used for printing purposes.

All color figures should be generated in RGB or CMYK color space. Grayscale 
images should be submitted in Grayscale color space. Line art may be 
provided in grayscale OR bitmap colorspace. Note that ``bitmap colorspace'' 
and ``bitmap file format'' are not the same thing. When bitmap color space 
is selected, .TIF/.TIFF/.PNG are the recommended file formats.

\subsection{Accepted Fonts Within Figures}
When preparing your graphics IEEE suggests that you use of one of the 
following Open Type fonts: Times New Roman, Helvetica, Arial, Cambria, and 
Symbol. If you are supplying EPS, PS, or PDF files all fonts must be 
embedded. Some fonts may only be native to your operating system; without 
the fonts embedded, parts of the graphic may be distorted or missing.

A safe option when finalizing your figures is to strip out the fonts before 
you save the files, creating ``outline'' type. This converts fonts to 
artwork what will appear uniformly on any screen.

\subsection{Using Labels Within Figures}

\subsubsection{Figure Axis labels }
Figure axis labels are often a source of confusion. Use words rather than 
symbols. As an example, write the quantity ``Magnetization,'' or 
``Magnetization M,'' not just ``M.'' Put units in parentheses. Do not label 
axes only with units. As in Fig. 1, for example, write ``Magnetization 
(A/m)'' or ``Magnetization (A$\cdot$m$^{-1}$),'' not just ``A/m.'' Do not label axes with a ratio of quantities and 
units. For example, write ``Temperature (K),'' not ``Temperature/K.'' 

Multipliers can be especially confusing. Write ``Magnetization (kA/m)'' or 
``Magnetization (10$^{3}$ A/m).'' Do not write ``Magnetization 
(A/m)$\,\times\,$1000'' because the reader would not know whether the top 
axis label in Fig. 1 meant 16000 A/m or 0.016 A/m. Figure labels should be 
legible, approximately 8 to 10 point type.

\subsubsection{Subfigure Labels in Multipart Figures and Tables}
Multipart figures should be combined and labeled before final submission. 
Labels should appear centered below each subfigure in 8 point Times New 
Roman font in the format of (a) (b) (c). 

\subsection{File Naming}
Figures (line artwork or photographs) should be named starting with the 
first 5 letters of the author's last name. The next characters in the 
filename should be the number that represents the sequential 
location of this image in your article. For example, in author 
``Anderson's'' paper, the first three figures would be named ander1.tif, 
ander2.tif, and ander3.ps.

Tables should contain only the body of the table (not the caption) and 
should be named similarly to figures, except that `.t' is inserted 
in-between the author's name and the table number. For example, author 
Anderson's first three tables would be named ander.t1.tif, ander.t2.ps, 
ander.t3.eps.

Author photographs should be named using the first five characters of the 
pictured author's last name. For example, four author photographs for a 
paper may be named: oppen.ps, moshc.tif, chen.eps, and duran.pdf.

If two authors or more have the same last name, their first initial(s) can 
be substituted for the fifth, fourth, third$\ldots$ letters of their surname 
until the degree where there is differentiation. For example, two authors 
Michael and Monica Oppenheimer's photos would be named oppmi.tif, and 
oppmo.eps.

\subsection{Referencing a Figure or Table Within Your Paper}
When referencing your figures and tables within your paper, use the 
abbreviation ``Fig.'' even at the beginning of a sentence. Do not abbreviate 
``Table.'' Tables should be numbered with Roman Numerals.

\subsection{Checking Your Figures: The IEEE Graphics Analyzer}
The IEEE Graphics Analyzer enables authors to pre-screen their graphics for 
compliance with IEEE Transactions and Journals standards before submission. 
The online tool, located at
\underline{http://graphicsqc.ieee.org/}, allows authors to 
upload their graphics in order to check that each file is the correct file 
format, resolution, size and colorspace; that no fonts are missing or 
corrupt; that figures are not compiled in layers or have transparency, and 
that they are named according to the IEEE Transactions and Journals naming 
convention. At the end of this automated process, authors are provided with 
a detailed report on each graphic within the web applet, as well as by 
email.

For more information on using the Graphics Analyzer or any other graphics 
related topic, contact the IEEE Graphics Help Desk by e-mail at 
graphics@ieee.org.

\subsection{Submitting Your Graphics}
Because IEEE will do the final formatting of your paper,
you do not need to position figures and tables at the top and bottom of each 
column. In fact, all figures, figure captions, and tables can be placed at 
the end of your paper. In addition to, or even in lieu of submitting figures 
within your final manuscript, figures should be submitted individually, 
separate from the manuscript in one of the file formats listed above in 
Section \ref{formats}. Place figure captions below the figures; place table titles 
above the tables. Please do not include captions as part of the figures, or 
put them in ``text boxes'' linked to the figures. Also, do not place borders 
around the outside of your figures.

\subsection{Color Processing/Printing in IEEE Journals}
All IEEE Transactions, Journals, and Letters allow an author to publish 
color figures on IEEE Xplore\textregistered\ at no charge, and automatically 
convert them to grayscale for print versions. In most journals, figures and 
tables may alternatively be printed in color if an author chooses to do so. 
Please note that this service comes at an extra expense to the author. If 
you intend to have print color graphics, include a note with your final 
paper indicating which figures or tables you would like to be handled that 
way, and stating that you are willing to pay the additional fee.

\section{Conclusion}
A conclusion section is not required. Although a conclusion may review the 
main points of the paper, do not replicate the abstract as the conclusion. A 
conclusion might elaborate on the importance of the work or suggest 
applications and extensions. 

\appendices

Appendixes, if needed, appear before the acknowledgment.

\section*{Acknowledgment}

The preferred spelling of the word ``acknowledgment'' in American English is 
without an ``e'' after the ``g.'' Use the singular heading even if you have 
many acknowledgments. Avoid expressions such as ``One of us (S.B.A.) would 
like to thank $\ldots$ .'' Instead, write ``F. A. Author thanks $\ldots$ .'' In most 
cases, sponsor and financial support acknowledgments are placed in the 
unnumbered footnote on the first page, not here.

\section*{References and Footnotes}

\subsection{References}
References need not be cited in text. When they are, they appear on the 
line, in square brackets, inside the punctuation. Multiple references are 
each numbered with separate brackets. When citing a section in a book, 
please give the relevant page numbers. In text, refer simply to the 
reference number. Do not use ``Ref.'' or ``reference'' except at the 
beginning of a sentence: ``Reference \cite{b3} shows $\ldots$ .'' Please do not use 
automatic endnotes in \emph{Word}, rather, type the reference list at the end of the 
paper using the ``References'' style.

Reference numbers are set flush left and form a column of their own, hanging 
out beyond the body of the reference. The reference numbers are on the line, 
enclosed in square brackets. In all references, the given name of the author 
or editor is abbreviated to the initial only and precedes the last name. Use 
them all; use \emph{et al.} only if names are not given. Use commas around Jr., 
Sr., and III in names. Abbreviate conference titles. When citing IEEE 
transactions, provide the issue number, page range, volume number, year, 
and/or month if available. When referencing a patent, provide the day and 
the month of issue, or application. References may not include all 
information; please obtain and include relevant information. Do not combine 
references. There must be only one reference with each number. If there is a 
URL included with the print reference, it can be included at the end of the 
reference. 

Other than books, capitalize only the first word in a paper title, except 
for proper nouns and element symbols. For papers published in translation 
journals, please give the English citation first, followed by the original 
foreign-language citation See the end of this document for formats and 
examples of common references. For a complete discussion of references and 
their formats, see the IEEE style manual at
\underline{http://www.ieee.org/authortools}.

\subsection{Footnotes}
Number footnotes separately in superscript numbers.\footnote{It is recommended that footnotes be avoided (except for 
the unnumbered footnote with the receipt date on the first page). Instead, 
try to integrate the footnote information into the text.} Place the actual 
footnote at the bottom of the column in which it is cited; do not put 
footnotes in the reference list (endnotes). Use letters for table footnotes 
(see Table \ref{table}).

\section{Submitting Your Paper for Review}

\subsection{Final Stage}
When you submit your final version (after your paper has been accepted), 
print it in two-column format, including figures and tables. You must also 
send your final manuscript on a disk, via e-mail, or through a Web 
manuscript submission system as directed by the society contact. You may use 
\emph{Zip} for large files, or compress files using \emph{Compress, Pkzip, Stuffit,} or \emph{Gzip.} 

Also, send a sheet of paper or PDF with complete contact information for all 
authors. Include full mailing addresses, telephone numbers, fax numbers, and 
e-mail addresses. This information will be used to send each author a 
complimentary copy of the journal in which the paper appears. In addition, 
designate one author as the ``corresponding author.'' This is the author to 
whom proofs of the paper will be sent. Proofs are sent to the corresponding 
author only.

\subsection{Review Stage Using ScholarOne\textregistered\ Manuscripts}
Contributions to the Transactions, Journals, and Letters may be submitted 
electronically on IEEE's on-line manuscript submission and peer-review 
system, ScholarOne\textregistered\ Manuscripts. You can get a listing of the 
publications that participate in ScholarOne at 
\underline{http://www.ieee.org/publications\_standards/publications/}\discretionary{}{}{}\underline{authors/authors\_submission.html}.
First check if you have an existing account. If there is none, please create 
a new account. After logging in, go to your Author Center and click ``Submit 
First Draft of a New Manuscript.'' 

Along with other information, you will be asked to select the subject from a 
pull-down list. Depending on the journal, there are various steps to the 
submission process; you must complete all steps for a complete submission. 
At the end of each step you must click ``Save and Continue''; just uploading 
the paper is not sufficient. After the last step, you should see a 
confirmation that the submission is complete. You should also receive an 
e-mail confirmation. For inquiries regarding the submission of your paper on 
ScholarOne Manuscripts, please contact oprs-support@ieee.org or call +1 732 
465 5861.

ScholarOne Manuscripts will accept files for review in various formats. 
Please check the guidelines of the specific journal for which you plan to 
submit.

You will be asked to file an electronic copyright form immediately upon 
completing the submission process (authors are responsible for obtaining any 
security clearances). Failure to submit the electronic copyright could 
result in publishing delays later. You will also have the opportunity to 
designate your article as ``open access'' if you agree to pay the IEEE open 
access fee. 

\subsection{Final Stage Using ScholarOne Manuscripts}
Upon acceptance, you will receive an email with specific instructions 
regarding the submission of your final files. To avoid any delays in 
publication, please be sure to follow these instructions. Most journals 
require that final submissions be uploaded through ScholarOne Manuscripts, 
although some may still accept final submissions via email. Final 
submissions should include source files of your accepted manuscript, high 
quality graphic files, and a formatted pdf file. If you have any questions 
regarding the final submission process, please contact the administrative 
contact for the journal. 

In addition to this, upload a file with complete contact information for all 
authors. Include full mailing addresses, telephone numbers, fax numbers, and 
e-mail addresses. Designate the author who submitted the manuscript on 
ScholarOne Manuscripts as the ``corresponding author.'' This is the only 
author to whom proofs of the paper will be sent. 

\subsection{Copyright Form}
Authors must submit an electronic IEEE Copyright Form (eCF) upon submitting 
their final manuscript files. You can access the eCF system through your 
manuscript submission system or through the Author Gateway. You are 
responsible for obtaining any necessary approvals and/or security 
clearances. For additional information on intellectual property rights, 
visit the IEEE Intellectual Property Rights department web page at 
\underline{http://www.ieee.org/publications\_standards/publications/rights/}\discretionary{}{}{}\underline{index.html}. 

\section{IEEE Publishing Policy}
The general IEEE policy requires that authors should only submit original 
work that has neither appeared elsewhere for publication, nor is under 
review for another refereed publication. The submitting author must disclose 
all prior publication(s) and current submissions when submitting a 
manuscript. Do not publish ``preliminary'' data or results. The submitting 
author is responsible for obtaining agreement of all coauthors and any 
consent required from employers or sponsors before submitting an article. 
The IEEE Transactions and Journals Department strongly discourages courtesy 
authorship; it is the obligation of the authors to cite only relevant prior 
work.

The IEEE Transactions and Journals Department does not publish conference 
records or proceedings, but can publish articles related to conferences that 
have undergone rigorous peer review. Minimally, two reviews are required for 
every article submitted for peer review.

\section{Publication Principles}
The two types of contents of that are published are; 1) peer-reviewed and 2) 
archival. The Transactions and Journals Department publishes scholarly 
articles of archival value as well as tutorial expositions and critical 
reviews of classical subjects and topics of current interest. 

Authors should consider the following points:

\begin{enumerate}
\item Technical papers submitted for publication must advance the state of knowledge and must cite relevant prior work. 
\item The length of a submitted paper should be commensurate with the importance, or appropriate to the complexity, of the work. For example, an obvious extension of previously published work might not be appropriate for publication or might be adequately treated in just a few pages.
\item Authors must convince both peer reviewers and the editors of the scientific and technical merit of a paper; the standards of proof are higher when extraordinary or unexpected results are reported. 
\item Because replication is required for scientific progress, papers submitted for publication must provide sufficient information to allow readers to perform similar experiments or calculations and 
use the reported results. Although not everything need be disclosed, a paper 
must contain new, useable, and fully described information. For example, a 
specimen's chemical composition need not be reported if the main purpose of 
a paper is to introduce a new measurement technique. Authors should expect 
to be challenged by reviewers if the results are not supported by adequate 
data and critical details.
\item Papers that describe ongoing work or announce the latest technical achievement, which are suitable for presentation at a professional conference, may not be appropriate for publication.
\end{enumerate}

\section{Reference Examples}

\begin{itemize}

\item \emph{Basic format for books:}\\
J. K. Author, ``Title of chapter in the book,'' in \emph{Title of His Published Book, x}th ed. City of Publisher, (only U.S. State), Country: Abbrev. of Publisher, year, ch. $x$, sec. $x$, pp. \emph{xxx--xxx.}\\
See \cite{b1,b2}.

\item \emph{Basic format for periodicals:}\\
J. K. Author, ``Name of paper,'' \emph{Abbrev. Title of Periodical}, vol. \emph{x, no}. $x, $pp\emph{. xxx--xxx, }Abbrev. Month, year, DOI. 10.1109.\emph{XXX}.123456.\\
See \cite{b3}--\cite{b5}.

\item \emph{Basic format for reports:}\\
J. K. Author, ``Title of report,'' Abbrev. Name of Co., City of Co., Abbrev. State, Country, Rep. \emph{xxx}, year.\\
See \cite{b6,b7}.

\item \emph{Basic format for handbooks:}\\
\emph{Name of Manual/Handbook, x} ed., Abbrev. Name of Co., City of Co., Abbrev. State, Country, year, pp. \emph{xxx--xxx.}\\
See \cite{b8,b9}.

\item \emph{Basic format for books (when available online):}\\
J. K. Author, ``Title of chapter in the book,'' in \emph{Title of
Published Book}, $x$th ed. City of Publisher, State, Country: Abbrev.
of Publisher, year, ch. $x$, sec. $x$, pp. \emph{xxx--xxx}. [Online].
Available: \underline{http://www.web.com}\\
See \cite{b10}--\cite{b13}.

\item \emph{Basic format for journals (when available online):}\\
J. K. Author, ``Name of paper,'' \emph{Abbrev. Title of Periodical}, vol. $x$, no. $x$, pp. \emph{xxx--xxx}, Abbrev. Month, year. Accessed on: Month, Day, year, DOI: 10.1109.\emph{XXX}.123456, [Online].\\
See \cite{b14}--\cite{b16}.

\item \emph{Basic format for papers presented at conferences (when available online): }\\
J.K. Author. (year, month). Title. presented at abbrev. conference title. [Type of Medium]. Available: site/path/file\\
See \cite{b17}.

\item \emph{Basic format for reports and handbooks (when available online):}\\
J. K. Author. ``Title of report,'' Company. City, State, Country. Rep. no., (optional: vol./issue), Date. [Online] Available: site/path/file\\
See \cite{b18,b19}.

\item \emph{Basic format for computer programs and electronic documents (when available online): }\\
Legislative body. Number of Congress, Session. (year, month day). \emph{Number of bill or resolution}, \emph{Title}. [Type of medium]. Available: site/path/file\\
\textbf{\emph{NOTE: }ISO recommends that capitalization follow the accepted practice for the language or script in which the information is given.}\\
See \cite{b20}.

\item \emph{Basic format for patents (when available online):}\\
Name of the invention, by inventor's name. (year, month day). Patent Number [Type of medium]. Available: site/path/file\\
See \cite{b21}.

\item \emph{Basic format}\emph{for conference proceedings (published):}\\
J. K. Author, ``Title of paper,'' in \emph{Abbreviated Name of Conf.}, City of Conf., Abbrev. State (if given), Country, year, pp. \emph{xxxxxx.}\\
See \cite{b22}.

\item \emph{Example for papers presented at conferences (unpublished):}\\
See \cite{b23}.

\item \emph{Basic format for patents}$:$\\
J. K. Author, ``Title of patent,'' U.S. Patent \emph{x xxx xxx}, Abbrev. Month, day, year.\\
See \cite{b24}.

\item \emph{Basic format for theses (M.S.) and dissertations (Ph.D.):}
\begin{enumerate}
\item J. K. Author, ``Title of thesis,'' M.S. thesis, Abbrev. Dept., Abbrev. Univ., City of Univ., Abbrev. State, year.
\item J. K. Author, ``Title of dissertation,'' Ph.D. dissertation, Abbrev. Dept., Abbrev. Univ., City of Univ., Abbrev. State, year.
\end{enumerate}
See \cite{b25,b26}.

\item \emph{Basic format for the most common types of unpublished references:}
\begin{enumerate}
\item J. K. Author, private communication, Abbrev. Month, year.
\item J. K. Author, ``Title of paper,'' unpublished.
\item J. K. Author, ``Title of paper,'' to be published.
\end{enumerate}
See \cite{b27}--\cite{b29}.

\item \emph{Basic formats for standards:}
\begin{enumerate}
\item \emph{Title of Standard}, Standard number, date.
\item \emph{Title of Standard}, Standard number, Corporate author, location, date.
\end{enumerate}
See \cite{b30,b31}.

\item \emph{Article number in~reference examples:}\\
See \cite{b32,b33}.

\item \emph{Example when using et al.:}\\
See \cite{b34}.

\end{itemize}


\section{Introduction}
\label{sec:introduction}
\IEEEPARstart{T}{his} document is a template for \LaTeX. If you are 
reading a paper or PDF version of this document, please download the 
electronic file, trans\_jour.tex, from the IEEE Web site at \underline
{http://www.ieee.org/authortools/trans\_jour.tex} so you can use it to prepare your manuscript. If 
you would prefer to use LaTeX, download IEEE's LaTeX style and sample files 
from the same Web page. You can also explore using the Overleaf editor at 
\underline
{https://www.overleaf.com/blog/278-how-to-use-overleaf-with-}\discretionary{}{}{}\underline
{ieee-collabratec-your-quick-guide-to-getting-started\#.}\discretionary{}{}{}\underline{xsVp6tpPkrKM9}

If your paper is intended for a conference, please contact your conference 
editor concerning acceptable word processor formats for your particular 
conference. 

IEEE will do the final formatting of your paper. If your paper is intended 
for a conference, please observe the conference page limits. 

\subsection{Abbreviations and Acronyms}
Define abbreviations and acronyms the first time they are used in the text, 
even after they have already been defined in the abstract. Abbreviations 
such as IEEE, SI, ac, and dc do not have to be defined. Abbreviations that 
incorporate periods should not have spaces: write ``C.N.R.S.,'' not ``C. N. 
R. S.'' Do not use abbreviations in the title unless they are unavoidable 
(for example, ``IEEE'' in the title of this article).

\subsection{Other Recommendations}
Use one space after periods and colons. Hyphenate complex modifiers: 
``zero-field-cooled magnetization.'' Avoid dangling participles, such as, 
``Using \eqref{eq}, the potential was calculated.'' [It is not clear who or what 
used \eqref{eq}.] Write instead, ``The potential was calculated by using \eqref{eq},'' or 
``Using \eqref{eq}, we calculated the potential.''

Use a zero before decimal points: ``0.25,'' not ``.25.'' Use 
``cm$^{3}$,'' not ``cc.'' Indicate sample dimensions as ``0.1 cm 
$\times $ 0.2 cm,'' not ``0.1 $\times $ 0.2 cm$^{2}$.'' The 
abbreviation for ``seconds'' is ``s,'' not ``sec.'' Use 
``Wb/m$^{2}$'' or ``webers per square meter,'' not 
``webers/m$^{2}$.'' When expressing a range of values, write ``7 to 
9'' or ``7--9,'' not ``7$\sim $9.''

A parenthetical statement at the end of a sentence is punctuated outside of 
the closing parenthesis (like this). (A parenthetical sentence is punctuated 
within the parentheses.) In American English, periods and commas are within 
quotation marks, like ``this period.'' Other punctuation is ``outside''! 
Avoid contractions; for example, write ``do not'' instead of ``don't.'' The 
serial comma is preferred: ``A, B, and C'' instead of ``A, B and C.''

If you wish, you may write in the first person singular or plural and use 
the active voice (``I observed that $\ldots$'' or ``We observed that $\ldots$'' 
instead of ``It was observed that $\ldots$''). Remember to check spelling. If 
your native language is not English, please get a native English-speaking 
colleague to carefully proofread your paper.

Try not to use too many typefaces in the same article. You're writing
scholarly papers, not ransom notes. Also please remember that MathJax
can't handle really weird typefaces.

\subsection{Equations}
Number equations consecutively with equation numbers in parentheses flush 
with the right margin, as in \eqref{eq}. To make your equations more 
compact, you may use the solidus (~/~), the exp function, or appropriate 
exponents. Use parentheses to avoid ambiguities in denominators. Punctuate 
equations when they are part of a sentence, as in
\begin{equation}E=mc^2.\label{eq}\end{equation}

Be sure that the symbols in your equation have been defined before the 
equation appears or immediately following. Italicize symbols ($T$ might refer 
to temperature, but T is the unit tesla). Refer to ``\eqref{eq},'' not ``Eq. \eqref{eq}'' 
or ``equation \eqref{eq},'' except at the beginning of a sentence: ``Equation \eqref{eq} 
is $\ldots$ .''

\subsection{\LaTeX-Specific Advice}

Please use ``soft'' (e.g., \verb|\eqref{Eq}|) cross references instead
of ``hard'' references (e.g., \verb|(1)|). That will make it possible
to combine sections, add equations, or change the order of figures or
citations without having to go through the file line by line.

Please don't use the \verb|{eqnarray}| equation environment. Use
\verb|{align}| or \verb|{IEEEeqnarray}| instead. The \verb|{eqnarray}|
environment leaves unsightly spaces around relation symbols.

Please note that the \verb|{subequations}| environment in {\LaTeX}
will increment the main equation counter even when there are no
equation numbers displayed. If you forget that, you might write an
article in which the equation numbers skip from (17) to (20), causing
the copy editors to wonder if you've discovered a new method of
counting.

{\BibTeX} does not work by magic. It doesn't get the bibliographic
data from thin air but from .bib files. If you use {\BibTeX} to produce a
bibliography you must send the .bib files. 

{\LaTeX} can't read your mind. If you assign the same label to a
subsubsection and a table, you might find that Table I has been cross
referenced as Table IV-B3. 

{\LaTeX} does not have precognitive abilities. If you put a
\verb|\label| command before the command that updates the counter it's
supposed to be using, the label will pick up the last counter to be
cross referenced instead. In particular, a \verb|\label| command
should not go before the caption of a figure or a table.

Do not use \verb|\nonumber| inside the \verb|{array}| environment. It
will not stop equation numbers inside \verb|{array}| (there won't be
any anyway) and it might stop a wanted equation number in the
surrounding equation.

If you are submitting your paper to a colorized journal, you can use
the following two lines at the start of the article to ensure its
appearance resembles the final copy:

\smallskip\noindent
\begin{small}
\begin{tabular}{l}
\verb+\+\texttt{documentclass[journal,twoside,web]\{ieeecolor\}}\\
\verb+\+\texttt{usepackage\{\textit{Journal\_Name}\}}
\end{tabular}
\end{small}

\section{Units}
Use either SI (MKS) or CGS as primary units. (SI units are strongly 
encouraged.) English units may be used as secondary units (in parentheses). 
This applies to papers in data storage. For example, write ``15 
Gb/cm$^{2}$ (100 Gb/in$^{2})$.'' An exception is when 
English units are used as identifiers in trade, such as ``3\textonehalf-in 
disk drive.'' Avoid combining SI and CGS units, such as current in amperes 
and magnetic field in oersteds. This often leads to confusion because 
equations do not balance dimensionally. If you must use mixed units, clearly 
state the units for each quantity in an equation.

The SI unit for magnetic field strength $H$ is A/m. However, if you wish to use 
units of T, either refer to magnetic flux density $B$ or magnetic field 
strength symbolized as $\mu _{0}H$. Use the center dot to separate 
compound units, e.g., ``A$\cdot $m$^{2}$.''

\section{Some Common Mistakes}
The word ``data'' is plural, not singular. The subscript for the 
permeability of vacuum $\mu _{0}$ is zero, not a lowercase letter 
``o.'' The term for residual magnetization is ``remanence''; the adjective 
is ``remanent''; do not write ``remnance'' or ``remnant.'' Use the word 
``micrometer'' instead of ``micron.'' A graph within a graph is an 
``inset,'' not an ``insert.'' The word ``alternatively'' is preferred to the 
word ``alternately'' (unless you really mean something that alternates). Use 
the word ``whereas'' instead of ``while'' (unless you are referring to 
simultaneous events). Do not use the word ``essentially'' to mean 
``approximately'' or ``effectively.'' Do not use the word ``issue'' as a 
euphemism for ``problem.'' When compositions are not specified, separate 
chemical symbols by en-dashes; for example, ``NiMn'' indicates the 
intermetallic compound Ni$_{0.5}$Mn$_{0.5}$ whereas 
``Ni--Mn'' indicates an alloy of some composition 
Ni$_{x}$Mn$_{1-x}$.

\begin{figure}[!t]
\centerline{\includegraphics[width=\columnwidth]{fig1.png}}
\caption{Magnetization as a function of applied field.
It is good practice to explain the significance of the figure in the caption.}
\label{fig1}
\end{figure}

Be aware of the different meanings of the homophones ``affect'' (usually a 
verb) and ``effect'' (usually a noun), ``complement'' and ``compliment,'' 
``discreet'' and ``discrete,'' ``principal'' (e.g., ``principal 
investigator'') and ``principle'' (e.g., ``principle of measurement''). Do 
not confuse ``imply'' and ``infer.'' 

Prefixes such as ``non,'' ``sub,'' ``micro,'' ``multi,'' and ``ultra'' are 
not independent words; they should be joined to the words they modify, 
usually without a hyphen. There is no period after the ``et'' in the Latin 
abbreviation ``\emph{et al.}'' (it is also italicized). The abbreviation ``i.e.,'' means 
``that is,'' and the abbreviation ``e.g.,'' means ``for example'' (these 
abbreviations are not italicized).

A general IEEE styleguide is available at \underline{http://www.ieee.org/authortools}.

\section{Guidelines for Graphics Preparation and Submission}
\label{sec:guidelines}

\subsection{Types of Graphics}
The following list outlines the different types of graphics published in 
IEEE journals. They are categorized based on their construction, and use of 
color/shades of gray:

\subsubsection{Color/Grayscale figures}
{Figures that are meant to appear in color, or shades of black/gray. Such 
figures may include photographs, illustrations, multicolor graphs, and 
flowcharts.}

\subsubsection{Line Art figures}
{Figures that are composed of only black lines and shapes. These figures 
should have no shades or half-tones of gray, only black and white.}

\subsubsection{Author photos}
{Head and shoulders shots of authors that appear at the end of our papers. }

\subsubsection{Tables}
{Data charts which are typically black and white, but sometimes include 
color.}

\begin{table}
\caption{Units for Magnetic Properties}
\label{table}
\setlength{\tabcolsep}{3pt}
\begin{tabular}{|p{25pt}|p{75pt}|p{115pt}|}
\hline
Symbol& 
Quantity& 
Conversion from Gaussian and \par CGS EMU to SI $^{\mathrm{a}}$ \\
\hline
$\Phi $& 
magnetic flux& 
1 Mx $\to  10^{-8}$ Wb $= 10^{-8}$ V$\cdot $s \\
$B$& 
magnetic flux density, \par magnetic induction& 
1 G $\to  10^{-4}$ T $= 10^{-4}$ Wb/m$^{2}$ \\
$H$& 
magnetic field strength& 
1 Oe $\to  10^{3}/(4\pi )$ A/m \\
$m$& 
magnetic moment& 
1 erg/G $=$ 1 emu \par $\to 10^{-3}$ A$\cdot $m$^{2} = 10^{-3}$ J/T \\
$M$& 
magnetization& 
1 erg/(G$\cdot $cm$^{3}) =$ 1 emu/cm$^{3}$ \par $\to 10^{3}$ A/m \\
4$\pi M$& 
magnetization& 
1 G $\to  10^{3}/(4\pi )$ A/m \\
$\sigma $& 
specific magnetization& 
1 erg/(G$\cdot $g) $=$ 1 emu/g $\to $ 1 A$\cdot $m$^{2}$/kg \\
$j$& 
magnetic dipole \par moment& 
1 erg/G $=$ 1 emu \par $\to 4\pi \times  10^{-10}$ Wb$\cdot $m \\
$J$& 
magnetic polarization& 
1 erg/(G$\cdot $cm$^{3}) =$ 1 emu/cm$^{3}$ \par $\to 4\pi \times  10^{-4}$ T \\
$\chi , \kappa $& 
susceptibility& 
1 $\to  4\pi $ \\
$\chi_{\rho }$& 
mass susceptibility& 
1 cm$^{3}$/g $\to  4\pi \times  10^{-3}$ m$^{3}$/kg \\
$\mu $& 
permeability& 
1 $\to  4\pi \times  10^{-7}$ H/m \par $= 4\pi \times  10^{-7}$ Wb/(A$\cdot $m) \\
$\mu_{r}$& 
relative permeability& 
$\mu \to \mu_{r}$ \\
$w, W$& 
energy density& 
1 erg/cm$^{3} \to  10^{-1}$ J/m$^{3}$ \\
$N, D$& 
demagnetizing factor& 
1 $\to  1/(4\pi )$ \\
\hline
\multicolumn{3}{p{251pt}}{Vertical lines are optional in tables. Statements that serve as captions for 
the entire table do not need footnote letters. }\\
\multicolumn{3}{p{251pt}}{$^{\mathrm{a}}$Gaussian units are the same as cg emu for magnetostatics; Mx 
$=$ maxwell, G $=$ gauss, Oe $=$ oersted; Wb $=$ weber, V $=$ volt, s $=$ 
second, T $=$ tesla, m $=$ meter, A $=$ ampere, J $=$ joule, kg $=$ 
kilogram, H $=$ henry.}
\end{tabular}
\label{tab1}
\end{table}

\subsection{Multipart figures}
Figures compiled of more than one sub-figure presented side-by-side, or 
stacked. If a multipart figure is made up of multiple figure
types (one part is lineart, and another is grayscale or color) the figure 
should meet the stricter guidelines.

\subsection{File Formats For Graphics}\label{formats}
Format and save your graphics using a suitable graphics processing program 
that will allow you to create the images as PostScript (PS), Encapsulated 
PostScript (.EPS), Tagged Image File Format (.TIFF), Portable Document 
Format (.PDF), Portable Network Graphics (.PNG), or Metapost (.MPS), sizes them, and adjusts 
the resolution settings. When 
submitting your final paper, your graphics should all be submitted 
individually in one of these formats along with the manuscript.

\subsection{Sizing of Graphics}
Most charts, graphs, and tables are one column wide (3.5 inches/88 
millimeters/21 picas) or page wide (7.16 inches/181 millimeters/43 
picas). The maximum depth a graphic can be is 8.5 inches (216 millimeters/54
picas). When choosing the depth of a graphic, please allow space for a 
caption. Figures can be sized between column and page widths if the author 
chooses, however it is recommended that figures are not sized less than 
column width unless when necessary. 

There is currently one publication with column measurements that do not 
coincide with those listed above. Proceedings of the IEEE has a column 
measurement of 3.25 inches (82.5 millimeters/19.5 picas). 

The final printed size of author photographs is exactly
1 inch wide by 1.25 inches tall (25.4 millimeters$\,\times\,$31.75 millimeters/6 
picas$\,\times\,$7.5 picas). Author photos printed in editorials measure 1.59 inches 
wide by 2 inches tall (40 millimeters$\,\times\,$50 millimeters/9.5 picas$\,\times\,$12 
picas).

\subsection{Resolution }
The proper resolution of your figures will depend on the type of figure it 
is as defined in the ``Types of Figures'' section. Author photographs, 
color, and grayscale figures should be at least 300dpi. Line art, including 
tables should be a minimum of 600dpi.

\subsection{Vector Art}
In order to preserve the figures' integrity across multiple computer 
platforms, we accept files in the following formats: .EPS/.PDF/.PS. All 
fonts must be embedded or text converted to outlines in order to achieve the 
best-quality results.

\subsection{Color Space}
The term color space refers to the entire sum of colors that can be 
represented within the said medium. For our purposes, the three main color 
spaces are Grayscale, RGB (red/green/blue) and CMYK 
(cyan/magenta/yellow/black). RGB is generally used with on-screen graphics, 
whereas CMYK is used for printing purposes.

All color figures should be generated in RGB or CMYK color space. Grayscale 
images should be submitted in Grayscale color space. Line art may be 
provided in grayscale OR bitmap colorspace. Note that ``bitmap colorspace'' 
and ``bitmap file format'' are not the same thing. When bitmap color space 
is selected, .TIF/.TIFF/.PNG are the recommended file formats.

\subsection{Accepted Fonts Within Figures}
When preparing your graphics IEEE suggests that you use of one of the 
following Open Type fonts: Times New Roman, Helvetica, Arial, Cambria, and 
Symbol. If you are supplying EPS, PS, or PDF files all fonts must be 
embedded. Some fonts may only be native to your operating system; without 
the fonts embedded, parts of the graphic may be distorted or missing.

A safe option when finalizing your figures is to strip out the fonts before 
you save the files, creating ``outline'' type. This converts fonts to 
artwork what will appear uniformly on any screen.

\subsection{Using Labels Within Figures}

\subsubsection{Figure Axis labels }
Figure axis labels are often a source of confusion. Use words rather than 
symbols. As an example, write the quantity ``Magnetization,'' or 
``Magnetization M,'' not just ``M.'' Put units in parentheses. Do not label 
axes only with units. As in Fig. 1, for example, write ``Magnetization 
(A/m)'' or ``Magnetization (A$\cdot$m$^{-1}$),'' not just ``A/m.'' Do not label axes with a ratio of quantities and 
units. For example, write ``Temperature (K),'' not ``Temperature/K.'' 

Multipliers can be especially confusing. Write ``Magnetization (kA/m)'' or 
``Magnetization (10$^{3}$ A/m).'' Do not write ``Magnetization 
(A/m)$\,\times\,$1000'' because the reader would not know whether the top 
axis label in Fig. 1 meant 16000 A/m or 0.016 A/m. Figure labels should be 
legible, approximately 8 to 10 point type.

\subsubsection{Subfigure Labels in Multipart Figures and Tables}
Multipart figures should be combined and labeled before final submission. 
Labels should appear centered below each subfigure in 8 point Times New 
Roman font in the format of (a) (b) (c). 

\subsection{File Naming}
Figures (line artwork or photographs) should be named starting with the 
first 5 letters of the author's last name. The next characters in the 
filename should be the number that represents the sequential 
location of this image in your article. For example, in author 
``Anderson's'' paper, the first three figures would be named ander1.tif, 
ander2.tif, and ander3.ps.

Tables should contain only the body of the table (not the caption) and 
should be named similarly to figures, except that `.t' is inserted 
in-between the author's name and the table number. For example, author 
Anderson's first three tables would be named ander.t1.tif, ander.t2.ps, 
ander.t3.eps.

Author photographs should be named using the first five characters of the 
pictured author's last name. For example, four author photographs for a 
paper may be named: oppen.ps, moshc.tif, chen.eps, and duran.pdf.

If two authors or more have the same last name, their first initial(s) can 
be substituted for the fifth, fourth, third$\ldots$ letters of their surname 
until the degree where there is differentiation. For example, two authors 
Michael and Monica Oppenheimer's photos would be named oppmi.tif, and 
oppmo.eps.

\subsection{Referencing a Figure or Table Within Your Paper}
When referencing your figures and tables within your paper, use the 
abbreviation ``Fig.'' even at the beginning of a sentence. Do not abbreviate 
``Table.'' Tables should be numbered with Roman Numerals.

\subsection{Checking Your Figures: The IEEE Graphics Analyzer}
The IEEE Graphics Analyzer enables authors to pre-screen their graphics for 
compliance with IEEE Transactions and Journals standards before submission. 
The online tool, located at
\underline{http://graphicsqc.ieee.org/}, allows authors to 
upload their graphics in order to check that each file is the correct file 
format, resolution, size and colorspace; that no fonts are missing or 
corrupt; that figures are not compiled in layers or have transparency, and 
that they are named according to the IEEE Transactions and Journals naming 
convention. At the end of this automated process, authors are provided with 
a detailed report on each graphic within the web applet, as well as by 
email.

For more information on using the Graphics Analyzer or any other graphics 
related topic, contact the IEEE Graphics Help Desk by e-mail at 
graphics@ieee.org.

\subsection{Submitting Your Graphics}
Because IEEE will do the final formatting of your paper,
you do not need to position figures and tables at the top and bottom of each 
column. In fact, all figures, figure captions, and tables can be placed at 
the end of your paper. In addition to, or even in lieu of submitting figures 
within your final manuscript, figures should be submitted individually, 
separate from the manuscript in one of the file formats listed above in 
Section \ref{formats}. Place figure captions below the figures; place table titles 
above the tables. Please do not include captions as part of the figures, or 
put them in ``text boxes'' linked to the figures. Also, do not place borders 
around the outside of your figures.

\subsection{Color Processing/Printing in IEEE Journals}
All IEEE Transactions, Journals, and Letters allow an author to publish 
color figures on IEEE Xplore\textregistered\ at no charge, and automatically 
convert them to grayscale for print versions. In most journals, figures and 
tables may alternatively be printed in color if an author chooses to do so. 
Please note that this service comes at an extra expense to the author. If 
you intend to have print color graphics, include a note with your final 
paper indicating which figures or tables you would like to be handled that 
way, and stating that you are willing to pay the additional fee.

\section{Conclusion}
A conclusion section is not required. Although a conclusion may review the 
main points of the paper, do not replicate the abstract as the conclusion. A 
conclusion might elaborate on the importance of the work or suggest 
applications and extensions. 

\appendices

Appendixes, if needed, appear before the acknowledgment.

\section*{Acknowledgment}

The preferred spelling of the word ``acknowledgment'' in American English is 
without an ``e'' after the ``g.'' Use the singular heading even if you have 
many acknowledgments. Avoid expressions such as ``One of us (S.B.A.) would 
like to thank $\ldots$ .'' Instead, write ``F. A. Author thanks $\ldots$ .'' In most 
cases, sponsor and financial support acknowledgments are placed in the 
unnumbered footnote on the first page, not here.

\section*{References and Footnotes}

\subsection{References}
References need not be cited in text. When they are, they appear on the 
line, in square brackets, inside the punctuation. Multiple references are 
each numbered with separate brackets. When citing a section in a book, 
please give the relevant page numbers. In text, refer simply to the 
reference number. Do not use ``Ref.'' or ``reference'' except at the 
beginning of a sentence: ``Reference \cite{b3} shows $\ldots$ .'' Please do not use 
automatic endnotes in \emph{Word}, rather, type the reference list at the end of the 
paper using the ``References'' style.

Reference numbers are set flush left and form a column of their own, hanging 
out beyond the body of the reference. The reference numbers are on the line, 
enclosed in square brackets. In all references, the given name of the author 
or editor is abbreviated to the initial only and precedes the last name. Use 
them all; use \emph{et al.} only if names are not given. Use commas around Jr., 
Sr., and III in names. Abbreviate conference titles. When citing IEEE 
transactions, provide the issue number, page range, volume number, year, 
and/or month if available. When referencing a patent, provide the day and 
the month of issue, or application. References may not include all 
information; please obtain and include relevant information. Do not combine 
references. There must be only one reference with each number. If there is a 
URL included with the print reference, it can be included at the end of the 
reference. 

Other than books, capitalize only the first word in a paper title, except 
for proper nouns and element symbols. For papers published in translation 
journals, please give the English citation first, followed by the original 
foreign-language citation See the end of this document for formats and 
examples of common references. For a complete discussion of references and 
their formats, see the IEEE style manual at
\underline{http://www.ieee.org/authortools}.

\subsection{Footnotes}
Number footnotes separately in superscript numbers.\footnote{It is recommended that footnotes be avoided (except for 
the unnumbered footnote with the receipt date on the first page). Instead, 
try to integrate the footnote information into the text.} Place the actual 
footnote at the bottom of the column in which it is cited; do not put 
footnotes in the reference list (endnotes). Use letters for table footnotes 
(see Table \ref{table}).

\section{Submitting Your Paper for Review}

\subsection{Final Stage}
When you submit your final version (after your paper has been accepted), 
print it in two-column format, including figures and tables. You must also 
send your final manuscript on a disk, via e-mail, or through a Web 
manuscript submission system as directed by the society contact. You may use 
\emph{Zip} for large files, or compress files using \emph{Compress, Pkzip, Stuffit,} or \emph{Gzip.} 

Also, send a sheet of paper or PDF with complete contact information for all 
authors. Include full mailing addresses, telephone numbers, fax numbers, and 
e-mail addresses. This information will be used to send each author a 
complimentary copy of the journal in which the paper appears. In addition, 
designate one author as the ``corresponding author.'' This is the author to 
whom proofs of the paper will be sent. Proofs are sent to the corresponding 
author only.

\subsection{Review Stage Using ScholarOne\textregistered\ Manuscripts}
Contributions to the Transactions, Journals, and Letters may be submitted 
electronically on IEEE's on-line manuscript submission and peer-review 
system, ScholarOne\textregistered\ Manuscripts. You can get a listing of the 
publications that participate in ScholarOne at 
\underline{http://www.ieee.org/publications\_standards/publications/}\discretionary{}{}{}\underline{authors/authors\_submission.html}.
First check if you have an existing account. If there is none, please create 
a new account. After logging in, go to your Author Center and click ``Submit 
First Draft of a New Manuscript.'' 

Along with other information, you will be asked to select the subject from a 
pull-down list. Depending on the journal, there are various steps to the 
submission process; you must complete all steps for a complete submission. 
At the end of each step you must click ``Save and Continue''; just uploading 
the paper is not sufficient. After the last step, you should see a 
confirmation that the submission is complete. You should also receive an 
e-mail confirmation. For inquiries regarding the submission of your paper on 
ScholarOne Manuscripts, please contact oprs-support@ieee.org or call +1 732 
465 5861.

ScholarOne Manuscripts will accept files for review in various formats. 
Please check the guidelines of the specific journal for which you plan to 
submit.

You will be asked to file an electronic copyright form immediately upon 
completing the submission process (authors are responsible for obtaining any 
security clearances). Failure to submit the electronic copyright could 
result in publishing delays later. You will also have the opportunity to 
designate your article as ``open access'' if you agree to pay the IEEE open 
access fee. 

\subsection{Final Stage Using ScholarOne Manuscripts}
Upon acceptance, you will receive an email with specific instructions 
regarding the submission of your final files. To avoid any delays in 
publication, please be sure to follow these instructions. Most journals 
require that final submissions be uploaded through ScholarOne Manuscripts, 
although some may still accept final submissions via email. Final 
submissions should include source files of your accepted manuscript, high 
quality graphic files, and a formatted pdf file. If you have any questions 
regarding the final submission process, please contact the administrative 
contact for the journal. 

In addition to this, upload a file with complete contact information for all 
authors. Include full mailing addresses, telephone numbers, fax numbers, and 
e-mail addresses. Designate the author who submitted the manuscript on 
ScholarOne Manuscripts as the ``corresponding author.'' This is the only 
author to whom proofs of the paper will be sent. 

\subsection{Copyright Form}
Authors must submit an electronic IEEE Copyright Form (eCF) upon submitting 
their final manuscript files. You can access the eCF system through your 
manuscript submission system or through the Author Gateway. You are 
responsible for obtaining any necessary approvals and/or security 
clearances. For additional information on intellectual property rights, 
visit the IEEE Intellectual Property Rights department web page at 
\underline{http://www.ieee.org/publications\_standards/publications/rights/}\discretionary{}{}{}\underline{index.html}. 

\section{IEEE Publishing Policy}
The general IEEE policy requires that authors should only submit original 
work that has neither appeared elsewhere for publication, nor is under 
review for another refereed publication. The submitting author must disclose 
all prior publication(s) and current submissions when submitting a 
manuscript. Do not publish ``preliminary'' data or results. The submitting 
author is responsible for obtaining agreement of all coauthors and any 
consent required from employers or sponsors before submitting an article. 
The IEEE Transactions and Journals Department strongly discourages courtesy 
authorship; it is the obligation of the authors to cite only relevant prior 
work.

The IEEE Transactions and Journals Department does not publish conference 
records or proceedings, but can publish articles related to conferences that 
have undergone rigorous peer review. Minimally, two reviews are required for 
every article submitted for peer review.

\section{Publication Principles}
The two types of contents of that are published are; 1) peer-reviewed and 2) 
archival. The Transactions and Journals Department publishes scholarly 
articles of archival value as well as tutorial expositions and critical 
reviews of classical subjects and topics of current interest. 

Authors should consider the following points:

\begin{enumerate}
\item Technical papers submitted for publication must advance the state of knowledge and must cite relevant prior work. 
\item The length of a submitted paper should be commensurate with the importance, or appropriate to the complexity, of the work. For example, an obvious extension of previously published work might not be appropriate for publication or might be adequately treated in just a few pages.
\item Authors must convince both peer reviewers and the editors of the scientific and technical merit of a paper; the standards of proof are higher when extraordinary or unexpected results are reported. 
\item Because replication is required for scientific progress, papers submitted for publication must provide sufficient information to allow readers to perform similar experiments or calculations and 
use the reported results. Although not everything need be disclosed, a paper 
must contain new, useable, and fully described information. For example, a 
specimen's chemical composition need not be reported if the main purpose of 
a paper is to introduce a new measurement technique. Authors should expect 
to be challenged by reviewers if the results are not supported by adequate 
data and critical details.
\item Papers that describe ongoing work or announce the latest technical achievement, which are suitable for presentation at a professional conference, may not be appropriate for publication.
\end{enumerate}

\section{Reference Examples}

\begin{itemize}

\item \emph{Basic format for books:}\\
J. K. Author, ``Title of chapter in the book,'' in \emph{Title of His Published Book, x}th ed. City of Publisher, (only U.S. State), Country: Abbrev. of Publisher, year, ch. $x$, sec. $x$, pp. \emph{xxx--xxx.}\\
See \cite{b1,b2}.

\item \emph{Basic format for periodicals:}\\
J. K. Author, ``Name of paper,'' \emph{Abbrev. Title of Periodical}, vol. \emph{x, no}. $x, $pp\emph{. xxx--xxx, }Abbrev. Month, year, DOI. 10.1109.\emph{XXX}.123456.\\
See \cite{b3}--\cite{b5}.

\item \emph{Basic format for reports:}\\
J. K. Author, ``Title of report,'' Abbrev. Name of Co., City of Co., Abbrev. State, Country, Rep. \emph{xxx}, year.\\
See \cite{b6,b7}.

\item \emph{Basic format for handbooks:}\\
\emph{Name of Manual/Handbook, x} ed., Abbrev. Name of Co., City of Co., Abbrev. State, Country, year, pp. \emph{xxx--xxx.}\\
See \cite{b8,b9}.

\item \emph{Basic format for books (when available online):}\\
J. K. Author, ``Title of chapter in the book,'' in \emph{Title of
Published Book}, $x$th ed. City of Publisher, State, Country: Abbrev.
of Publisher, year, ch. $x$, sec. $x$, pp. \emph{xxx--xxx}. [Online].
Available: \underline{http://www.web.com}\\
See \cite{b10}--\cite{b13}.

\item \emph{Basic format for journals (when available online):}\\
J. K. Author, ``Name of paper,'' \emph{Abbrev. Title of Periodical}, vol. $x$, no. $x$, pp. \emph{xxx--xxx}, Abbrev. Month, year. Accessed on: Month, Day, year, DOI: 10.1109.\emph{XXX}.123456, [Online].\\
See \cite{b14}--\cite{b16}.

\item \emph{Basic format for papers presented at conferences (when available online): }\\
J.K. Author. (year, month). Title. presented at abbrev. conference title. [Type of Medium]. Available: site/path/file\\
See \cite{b17}.

\item \emph{Basic format for reports and handbooks (when available online):}\\
J. K. Author. ``Title of report,'' Company. City, State, Country. Rep. no., (optional: vol./issue), Date. [Online] Available: site/path/file\\
See \cite{b18,b19}.

\item \emph{Basic format for computer programs and electronic documents (when available online): }\\
Legislative body. Number of Congress, Session. (year, month day). \emph{Number of bill or resolution}, \emph{Title}. [Type of medium]. Available: site/path/file\\
\textbf{\emph{NOTE: }ISO recommends that capitalization follow the accepted practice for the language or script in which the information is given.}\\
See \cite{b20}.

\item \emph{Basic format for patents (when available online):}\\
Name of the invention, by inventor's name. (year, month day). Patent Number [Type of medium]. Available: site/path/file\\
See \cite{b21}.

\item \emph{Basic format}\emph{for conference proceedings (published):}\\
J. K. Author, ``Title of paper,'' in \emph{Abbreviated Name of Conf.}, City of Conf., Abbrev. State (if given), Country, year, pp. \emph{xxxxxx.}\\
See \cite{b22}.

\item \emph{Example for papers presented at conferences (unpublished):}\\
See \cite{b23}.

\item \emph{Basic format for patents}$:$\\
J. K. Author, ``Title of patent,'' U.S. Patent \emph{x xxx xxx}, Abbrev. Month, day, year.\\
See \cite{b24}.

\item \emph{Basic format for theses (M.S.) and dissertations (Ph.D.):}
\begin{enumerate}
\item J. K. Author, ``Title of thesis,'' M.S. thesis, Abbrev. Dept., Abbrev. Univ., City of Univ., Abbrev. State, year.
\item J. K. Author, ``Title of dissertation,'' Ph.D. dissertation, Abbrev. Dept., Abbrev. Univ., City of Univ., Abbrev. State, year.
\end{enumerate}
See \cite{b25,b26}.

\item \emph{Basic format for the most common types of unpublished references:}
\begin{enumerate}
\item J. K. Author, private communication, Abbrev. Month, year.
\item J. K. Author, ``Title of paper,'' unpublished.
\item J. K. Author, ``Title of paper,'' to be published.
\end{enumerate}
See \cite{b27}--\cite{b29}.

\item \emph{Basic formats for standards:}
\begin{enumerate}
\item \emph{Title of Standard}, Standard number, date.
\item \emph{Title of Standard}, Standard number, Corporate author, location, date.
\end{enumerate}
See \cite{b30,b31}.

\item \emph{Article number in~reference examples:}\\
See \cite{b32,b33}.

\item \emph{Example when using et al.:}\\
See \cite{b34}.

\end{itemize}


\section{Introduction} \label{section introduciton}

\IEEEPARstart{A}{} variety of equilibrium-seeking problems in game theory can be cast as a variational inequality (VI) problem~\cite{FF-JSP:03}. For example, Nash equilibria of a game and Wardrop equilibria of a network routing game both correspond to solutions of a VI under mild conditions. Inspired by real-life, it is natural to perceive the costs or utilities that players wish to optimize in such games as uncertain. Faced with randomness, risk-preferences of players often determines their decisions. Players optimize a risk-measures of random costs in such scenarios and consequently, equilibria can be found by solving a VI involving risk-measures of uncertain costs.  Motivated by this setup, we consider VIs defined by the conditional value-at-risk (CVaR) of random  costs and develop stochastic approximation (SA) schemes to solve them.

\subsubsection*{Literature review}
The most popular way of incorporating uncertainty in VIs is the stochastic variational inequality (SVI) problem, see e.g.~\cite{UVS:13} and references therein. Here, the map associated to the VI is the expectation of a random function. SA methods for solving SVI are well studied~\cite{UVS:13, YC-GL-YO:14}. A key feature of such schemes is the use of an unbiased estimators of the map using any number of sample of the uncertainty. This leads to strong convergence guarantees under a mild set of assumptions. However, the empirical estimator of CVaR, while being consistent, is biased~\cite{RPR-NDS:10}. Therefore, depending on the required level of precision, more samples are required to estimate the CVaR. This biasedness poses challenges in the convergence analysis of SA schemes. For a general discussion on risk-based VIs, including CVaR, and their potential applications, see~\cite{UR:14}. In~\cite{AC:19-cdc}, a sample average approximation method for estimating the solution of CVaR-based VI was discussed. Our work also broadly relates to~\cite{AT-YC-MG-SM:17} and~\cite{CJ-LAP-FM-SM-CS:18} where sample-based methods are used for optimizing the CVaR and other risk measures, respectively. The convergence analysis of our iterative methods consists of approximating the asymptotic behavior of iterates with a trajectory of a continuous-time dynamical system and studying their stability. See~\cite{HJK-DSC:78} and~\cite{VB:08} for a comprehensive account of such analysis.

\subsubsection*{Statement of Contributions}
Our starting point is the definition of the CVaR-based variational inequality (VI), where the map defining the VI consists of components that are the CVaR of random functions. The feasibility set, assumed to be a convex compact set, is defined by a set of inequality and linear equality constraints. We motivate the VI problem using two examples from noncooperative games. Our \emph{first contribution} is the first SA scheme termed as the projected method. This iterative method consists of moving along the empirical estimate of the map defining the VI and projecting each iterate onto the feasibility set. We show that under strict monotonicity, the projected algorithm asymptotically converges to any arbitrary neighborhood of the solution of the VI, where the size of the neighborhood influences the number of samples required to form the empirical estimate in each iteration. Our \emph{second contribution} is the subspace-constrained method that overcomes the computational burden of calculating projections onto the feasibility set by dealing with equality and inequalities differently. In particular, the proximity to satisfying inequality constraints is ensured using penalty functions and iterates are constrained on the subspace generated by linear equality constraints by pre-multiplying the iteration step by an appropriate matrix. We establish that under strict monotonicity, the algorithm converges asymptotically to any neighborhood of the solution of the VI. Our \emph{third contribution} is the multiplier-driven method where projections are discarded altogether by introducing a multiplier for the inequality constraints. The iterates satisfy equality constraints throughout the execution as is the case with the subspace-constrained method by using matrix pre-multiplication. The iterates are shown to converge asymptotically under strict monotonicity to any neighborhood of the solution of the VI. Finally, we demonstrate the behavior of the algorithms using a network routing example. Our work here is an extension of~\cite{JV-AC:20}. Most notably, we have extended the result for the first projection-based algorithm to the case with only a finite number samples of the uncertainty available in each iteration. In addition our second and third algorithm have been modified by introducing a matrix pre-multiplication which constrains iterates to lie in the affine subspace defined by the equality constraints.

\section{Preliminaries} \label{section preliminaries}

\subsubsection{Notation} \label{sec:notation}
Let $\mathbb{R}$ and $\mathbb{N}$ denote the real and natural numbers, respectively. For $N \in \mathbb{N}$, we write ${\until{N} := \{1, 2, \dots, N\}}$. For a given $x \in \mathbb{R}$, we use the notation $[x]^+ := \max(x,0)$. For $x, y \in \mathbb{R}$, the operator $[x]_{y}^+$ equals $x$ if $y > 0$ and it equals $\max\{0,x\}$ if $y \leq 0$. For $x \in \mathbb{R}^n$, we let $x_i$ denote the $i$-th element of $x$, and the $i$-th element of the vector $[x]^+$ is $[x_i]^+$. For vectors $x,y \in \mathbb{R}^n$, $[x]_{y}^+$ denotes the vector whose $i$-th element is $[x_i]_{y_i}^+$, $i \in \until{n}$. The Euclidean norm of $x$ is given by $\norm{x}$. The Euclidean projection of $x$ onto the set $\mathcal{H}$ is then denoted $\Pi_\mathcal{H}(x):=\operatorname{argmin}_{y \in \mathcal{H}} \norm{x-y}$. The $\epsilon$-neigborhood of $x$ is defined as ${\mathcal{B}_{\epsilon}(x) := \setdef{y \in \mathbb{R}^n}{\norm{y-x} < \epsilon}}$. The closure of a set $\SS \subset \mathbb{R}^n$ is denoted by $\mathrm{cl}(\SS)$. The normal cone to a set $\mathcal{X} \subseteq \mathbb{R}^n$ at $x \in \mathcal{X}$ is defined as ${\mathcal{N}_\mathcal{X}(x) := \setdef{y \in \mathbb{R}^n}{y^\top(z - x) \leq 0 \enskip \forall z \in \mathcal{X}}}$. The set ${\mathcal{T}_\mathcal{X}(x) := \mathrm{cl}\big(\cup_{y \in \mathcal{X}} \cup_{\lambda > 0} \lambda(y - x)\big)}$ is referred to as the tangent cone to $\mathcal{X}$ at $x \in \mathcal{X}$. 

\subsubsection{Variational inequalities and KKT points}\label{sec:vi-kkt}
For a given map $F: \mathbb{R}^n \rightarrow \mathbb{R}^n$ and a closed set $\mathcal{H} \subseteq \mathbb{R}^n$, the associated \textit{variational inequality} (VI) problem, $\operatorname{VI}(\mathcal{H},F)$, is to find ${h^* \in \mathcal{H}}$ such that ${(h - h^*)^\top F(h^*) \geq 0}$ holds for all ${h \in \mathcal{H}}$. The set of all points that solve $\operatorname{VI}(\mathcal{H},F)$ is denoted $\operatorname{SOL}(\mathcal{H},F)$. The map $F$ is called \textit{monotone} if $\big(F(x) \! - \! F(y)\big)^\top \! (x \! - \! y) \! \ge \! 0$ holds for all ${x,y \in \mathbb{R}^n}$. If the inequality is strict for $x \not = y$, then $F$ is \textit{strictly monotone}. If $\mathcal{H}$ is nonempty, compact and $F$ is continuous, then $\operatorname{SOL}(\mathcal{H},F)$ is nonempty. If $F$ is strictly monotone, then $\operatorname{VI}(\mathcal{H},F)$ has at most one solution. Under the \textit{linear independence constraint qualification} (LICQ), we next characterize $\operatorname{SOL}(\mathcal{H},F)$ as the set of Karush-Kuhn-Tucker (KKT) points.
\begin{lemma}\longthmtitle{KKT points of $\operatorname{VI}(\mathcal{H},F)$}\label{le:KKT}
    Let 
    \begin{equation*}
        \mathcal{H} := \setdef{h  \in  \mathbb{R}^n }{Ah  =  b,  \enskip q^i(h)  \leq  0, \enskip \forall i \in  [s]},
    \end{equation*}
    where $A \in \mathbb{R}^{l \times n}$, $b \in \mathbb{R}^{l}$ and $l \in \mathbb{N}$, and the functions ${q^i: \mathbb{R}^n \rightarrow \mathbb{R}}$, $i \in \until{s}$, $s \in \mathbb{N}$ are convex and continuously differentiable. For $q(h) \! := \! (q^1(h), \dots, q^s(h))^\top \! \in \! \mathbb{R}^s$, let ${D q(h) \! \in \! \mathbb{R}^{s \times n}}$ be the Jacobian at $h$. For any ${h^* \in \mathbb{R}^n}$, if there exists a multiplier ${(\lambda^*, \mu^*) \in \mathbb{R}^s \times \mathbb{R}^l}$ satisfying
    \begin{equation} \label{KKT}
        \begin{split}
             &F(h^*) + \big( D q(h^*)\big)^\top \lambda^* + A^\top \mu^* = 0, \\
             Ah^* & = b, \quad q(h^*) \leq 0, \quad  \lambda^{*} \geq 0, \quad \lambda^{*\top}q(h^*) = 0,
        \end{split}
    \end{equation}
    then we have $h^* \in \operatorname{SOL}(\mathcal{H},F)$. Such a point $(h^*,\lambda^*, \mu^*)$ is referred to as a KKT point of the $\operatorname{VI}(\mathcal{H},F)$. Conversely, for $h^* \in \operatorname{SOL}(\mathcal{H},F)$, let $\mathcal{I}_{h^*} = \setdef{i \in \until{s}}{q^i(h^*) = 0}$. If the vectors $\{\nabla q^i(h^*)\}_{i \in \mathcal{I}_{h^*}}$ and the row vectors $\{A_j\}_{j \in [l]}$ are linearly independent, or in other words, the LICQ holds at $h^*$, then there exists a $(\lambda^*, \mu^*)$ satisfying \eqref{KKT}.
\end{lemma}
The above result is well known in the context of convex optimization. The extension to the VI setting can be deduced from $\text{\cite[Proposition 3.46]{DS:18}}$, \cite[Theorem 12.1]{UF-WK-GS:10}, and noting that if $h^* \in \operatorname{SOL}(\mathcal{H}, F)$, then it is also a minimizer of the function $y \mapsto y^\top F(h^*)$ subject to $y \in \mathcal{H}$.

\subsubsection{Projected dynamical systems}\label{sec:proj}
For a given map ${F: \mathbb{R}^n \times [0,\infty) \rightarrow \mathbb{R}^n}$ and a closed set $\mathcal{H} \subseteq \mathbb{R}^n$ the associated projected dynamical system is given by
\begin{equation*}
	\dot{h}(t) = \Pi_{\mathcal{T}_{\mathcal{H}}(h(t))}\big(F(h,t)\big).
\end{equation*}
Here $\mathcal{T}_{\mathcal{H}}(h)$ is the tangent cone of $\mathcal{H}$ at $h$ ${\text{(see Section~\ref{sec:notation})}}$.
We say that a map $\bar{h} : [0,\infty) \rightarrow \mathcal{H}$ with $\bar{h}(0) \in \mathcal{H}$ is a solution of the above system when $\bar{h}(\cdot)$ is absolutely continuous and $\dot{\bar{h}}(t) = \Pi_{\mathcal{T}_{\mathcal{H}}(\bar{h}(t))}\Big(F\big(\bar{h}(t), t\big)\Big)$ for almost all $t \in [0, \infty)$. Note that $\bar{h}(t) \in \mathcal{H}$ for all $t$. We use the terms solution and trajectory interchangeably throughout the paper. 

\subsubsection{Conditional Value-at-Risk}
The \textit{Conditional Value-at-Risk} (CVaR) \textit{at level} $\alpha \in (0,1]$ of a real-valued random variable $Z$, defined on a probability space $(\Omega, \mathcal{F}, \mathbb{P})$, is
\begin{equation*} 
    \operatorname{CVaR}_\alpha[Z] := \inf_{\eta \in \mathbb{R}}\big\{\eta + \alpha^{-1} \mathbb{E}[Z - \eta]^+\big\},
\end{equation*}
where the expectation is with respect to $\mathbb{P}$. The value $\alpha$ is a constant that characterizes risk-averseness. 
Given $N$ i.i.d samples $\{\widehat{Z}_j\}_{j \in [N]}$ of random variable $Z$, one can approximate $\operatorname{CVaR}_\alpha[Z]$ using the following empirical estimate:
\begin{equation} \label{estimator CVaR}
    \widehat{\operatorname{CVaR}}_\alpha^N[Z] = \inf_{\eta \in \mathbb{R}}\big\{ \eta + (N \alpha)^{-1}  \textstyle\sum_{j=1}^N[\widehat{Z}_j - \eta]^+ \big\}.
\end{equation}
This estimator is biased, but consistent \cite[Page 300]{AS-DD-AR:14}. That is, $\widehat{\operatorname{CVaR}}_\alpha^N[Z] \to \operatorname{CVaR}_\alpha[Z]$ almost surely as $N \to \infty$. 

\section{Problem statement and motivating examples} \label{section problem statement}
Consider a set of functions $C_i: \mathbb{R}^n \times \mathbb{R}^m \rightarrow \mathbb{R}$, ${i \in \until{n}}$, $(h,\xi) \mapsto C_i(h,\xi)$, where $\xi$ represents a random variable with distribution $\mathbb{P}$. For a fixed $h$, $C_i(h,\xi)$ is therefore a real-valued random variable. Define the map $\map{F_i}{\mathbb{R}^n}{\mathbb{R}}$ as the CVaR of $C_i$ at level $\alpha \in (0,1]$:
\begin{equation} \label{definition elements F}
       F_i(h) := \operatorname{CVaR}_\alpha\big[C_i(h,\xi)\big], \quad \text{ for all } i \in \until{n}.
\end{equation}
For notational convenience, let $C: \mathbb{R}^n \times \mathbb{R}^m \rightarrow \mathbb{R}^n$ and $\map{F}{\mathbb{R}^n}{\mathbb{R}^n}$ be the element-wise concatenation of the maps $\{C_i\}_{i \in \until{n}}$ and $\{F_i\}_{i \in \until{n}}$, respectively. Let $\mathcal{H} \subseteq \mathbb{R}^n$ be a nonempty closed set of the form
\begin{equation} \label{explicit contrained set 2}
    \mathcal{H} := \setdef{h  \in  \mathbb{R}^n }{Ah  =  b,  \enskip q^i(h)  \leq  0, \enskip \forall i  \in  [s]},
\end{equation}
where $A \in \mathbb{R}^{l \times n}$, $b \in \mathbb{R}^l$ and $l \in \mathbb{N}$, and the functions ${q^i: \mathbb{R}^n \rightarrow \mathbb{R}}$, ${i \in \until{s}}$, $s \in \mathbb{N}$ are convex and continuously differentiable. The objective of this paper is to provide stochastic approximation (SA) algorithms to solve the variational inequality problem $\operatorname{VI}(\mathcal{H},F)$. Our strategy will be to use an empirical estimator, derived from samples of $C(h,\xi)$, of the map $F$ at each iteration of the algorithm. Below we discuss two motivating examples for our setup.

\subsection{CVaR-based routing games} \label{section routing game}
Consider a directed graph $\mathcal{G} = (\mathcal{V},\mathcal{E})$, where ${\mathcal{V} = \until{n}}$ is the set of vertices, and ${\mathcal{E} \subseteq \mathcal{V} \times \mathcal{V}}$ is the set edges. To such a graph we associate a set $\mathcal{W} \subseteq \mathcal{V} \times \mathcal{V}$ of origin-destination (OD) pairs. An OD-pair $w$ is given by an ordered pair $(v^w_o,v^w_d)$, where $v^w_o, v^w_d \in \mathcal{V}$ are called the origin and the destination of $w$, respectively. The set of all paths in $\mathcal{G}$ from the origin to the destination of $w$ is denoted $\mathcal{P}_w$. The set of all paths is given by $\mathcal{P} = \cup_{w \in \mathcal{W}} \mathcal{P}_w$. Each of the participants, or agents, of the routing game is associated to an OD-pair, and can choose which path to take to travel from its origin to its destination. The choices of all agents give rise to a flow vector $h \in \mathbb{R^{|\mathcal{P}|}}$. We consider a non-atomic routing game and so $h$ is a continuous variable.

For each (OD)-pair $w$, a value $D_w \geq 0$ defines the demand associated to it. The feasible set $\mathcal{H} \subset \mathbb{R}^{|\mathcal{P}|}$ is then given by ${\mathcal{H} = \setdef{h}{\sum_{p \in \mathcal{P}_w}h_p = D_w, \enskip \forall w \in \mathcal{W}, \enskip h_p \geq 0 \enskip \forall p \in \mathcal{P} }}$. To each of the paths $p \in \mathcal{P}$, we associate a cost function $C_p: \mathbb{R}^{|\mathcal{P}|} \times \mathbb{R}^{m} \rightarrow \mathbb{R}, (h,\xi) \mapsto C_p(h,\xi)$, which depends on the flow $h$, as well as on the uncertainty $\xi \in \mathbb{R}^m$. Each agent chooses $p \in \mathcal{P}_w$ that minimizes $\operatorname{CVaR}_\alpha\big[C_p(h,\xi)\big]$. These elements define the CVaR-based routing game~\cite{AC:19-cdc} to which we assign the following notion of equilibrium: the flow $h^* \in \mathcal{H}$ is said to be a CVaR-based Wardrop equilibrium (CWE) of the CVaR-based routing game if, for all $w \in \mathcal{W}$ and all $p,p' \in \mathcal{P}_w$ such that $h^*_p > 0$, we have
\begin{equation*}
    \operatorname{CVaR}_\alpha\big[C_p(h^*,\xi)\big] \leq \operatorname{CVaR}_\alpha\big[C_{p'}(h^*,\xi)].
\end{equation*}
The intuition is that at equilibrium, for each agent, there is no other path than the selected one that has a smaller value of conditional value-at-risk. Under continuity of $C_p$, the set of CWE is equal to the set of solutions of $\operatorname{VI}(\mathcal{H},F)$, where $F: \mathbb{R}^{|\mathcal{P}|} \rightarrow \mathbb{R}^{|\mathcal{P}|}$ takes the form~\eqref{definition elements F}.

\subsection{CVaR-based Nash equilibrium}
A more general example of our setup would be in finding the Nash equilibrium of a non-cooperative game~\cite[section 1.4.2]{FF-JSP:03}. Let there be $N$ players with individual cost functions $\map{\theta_i}{\mathbb{R}^{nN}}{\mathbb{R}}$, $x \mapsto \theta_i(x)$ and possible strategy sets $\mathcal{X}_i \subseteq \mathbb{R}^n$. Here $x \in \mathbb{R}^{nN}$ denotes the vector containing the strategies of all players, where $x_i \in \mathbb{R}^n$ is the strategy of player $i$. We assume without loss of generality that the action/strategy sets of each player are of the same dimension $n$. An alternative notation is $\theta_i(x) = \theta_i(x_i, x_{-i})$, where $x_{-i}$ is the vector containing the strategies of all players except $i$. Each player $i$ aims to minimize its cost $\theta_i$ by choosing its own strategy optimally. That is, for any fixed $\tilde{x}_{-i}$ they solve
\begin{align*}
	\text{minimize }    \quad &\theta_i(x_i,\tilde{x}_{-i}),  \\
	\text{subject to }  \quad &x_i \in \mathcal{X}_i.
\end{align*}
A Nash equilibrium of such a game is a solution vector $x^*$ such that none of the players can reduce their cost by changing their strategy. Under the assumption that the sets $\mathcal{X}_i$ are convex and closed, and the functions $x_i \mapsto \theta_i(x_i, \tilde{x}_{-i})$ are convex and continuously differentiable for any $\tilde{x}_{-i}$, a joint strategy vector $x^*$ is a Nash equilibrium if and only if it is a solution to $\operatorname{VI}(\mathcal{X}, F)$, where $F(x) := (\nabla_{x_i}\theta_i(x))_{i = 1}^N$ is the concatenation of the gradients of $\theta_i$ functions, and ${\mathcal{X} = \prod_{i = 1}^n\mathcal{X}_i}$ . Consider the functions $\theta_i$ of the form
\begin{equation*}
	\theta_i(x) := \operatorname{CVaR}_\alpha [f_i(x_i, x_{-i})g(\xi) + \bar{f}_i(x_i, x_{-i})],
\end{equation*}
where functions $f_i$, $g$ and $\bar{f}_i$ are real-valued, $\xi$ models the uncertainty, and $f_i(x_i,x_{-i}) \geq 0$ for all $x$. Then,  $\operatorname{VI}(\mathcal{X}, F)$ is a CVaR-based variational inequality as discussed in our paper. Specifically, in this case, since CVaR is positive-homogeneous and shift-invariant~\cite[Chapter 6]{AS-DD-AR:14}, we have
\begin{align*}
	\theta_i(x) = \operatorname{CVaR}_\alpha[g(\xi)] f_i(x_i,x_{-i}) + \bar{f}_i(x_i, x_{-i}).
\end{align*}
As a consequence, we get
\begin{align*}
	\nabla \theta_i(x) = \operatorname{CVaR}_\alpha[g(\xi)] \nabla_{x_i} f_i(x_i,x_{-i}) + \nabla_{x_i} \bar{f}_i(x_i, x_{-i}).
\end{align*}
Under the assumption that $\nabla_{x_i} f_i$ is nonnegative for all ${x \in \mathcal{X}}$, we get
\begin{align*}
	\nabla \theta_i(x) = \operatorname{CVaR}_\alpha[g(\xi) \nabla_{x_i} f_i(x_i,x_{-i}) + \nabla_{x_i} \bar{f}_i(x_i, x_{-i})].
\end{align*}
where $\operatorname{CVaR}$ is understood component-wise. Thus, $F$ can be written as concatenation of $\operatorname{CVaR}$ of various functions and finding the Nash equilibrium of this game is equivalent to solving $\operatorname{VI}(\mathcal{X}, F)$, which fits into our presented framework.

\section{Stochastic approximation algorithms for solving $\operatorname{VI}(\mathcal{H}, F)$} \label{section results} \label{section stochastic approximation algorithms}
In this section, we introduce the SA algorithms along with their convergence analysis. All introduced schemes approximate $F$ with the estimator given in~\eqref{estimator CVaR}. Given $N$ independently and identically distributed samples $\big\{(\widehat{C_i(h,\xi)} )_j\big\}_{j=1}^N$ of the random variable $C_i(h,\xi)$, let 
\begin{align*}\label{eq:Fhat}
    \widehat{F}^N_i(h) := \textstyle \inf_{t \in \mathbb{R}}\Big\{ t + (N \alpha)^{-1} \sum_{j=1}^N\big[(\widehat{C_i(h,\xi)})_j - t\big]^+ \Big\}
\end{align*}
stand for the estimator of $F_i(h)$. Analogously, the estimator of $F(h)$ formed using the element-wise concatenation of $\widehat{F}^N_i(h)$, $i \in \until{n}$, is denoted by $\widehat{F}^N(h)$. We assume that the $N$ samples of each cost function are a result of the same set of $N$ events, that is, the distribution of $\widehat{F}^N(h)$ depends on $\mathbb{P}^N$. We next present our first algorithm.

\subsection{Projected algorithm}
For a given sequence of step-sizes $\{\gamma^k\}_{k=0}^\infty$, with $\gamma^k > 0$ for all $k$, a sequence $\{N_k\}_{k=0}^\infty \subset \mathbb{N}$, and an initial vector $h^0 \in \mathcal{H}$, the first algorithm under consideration, which we will refer to as the \textit{projected algorithm}, is given by
\begin{equation}\label{eq:projected-original-form}
    h^{k+1} = \Pi_{\mathcal{H}}\big( h^k - \gamma^k\widehat{F}^{N_k}(h^{k})\big),
\end{equation}
where $\Pi_{\mathcal{H}}$ is the projection operator (see Section~\ref{sec:notation}) and $h^k$ is the $k$-th iterate of $h$ produced by the algorithm. The above algorithm is inspired by the SA schemes for solving a stochastic VI problem, see~\cite{UVS:13} for details on other SA schemes. The key difference from the setup in~\cite{UVS:13} is the fact that there the map $F$ is the expected value of a random variable for which an unbiased estimator $\widehat{F}$ is available. In our case the estimator is biased posing limitations on the sample requirements for convergence of the algorithms. We can write the projected algorithm~\eqref{eq:projected-original-form} equivalently as
\begin{equation} \label{algorithm with error term}
    h^{k+1} = \Pi_{\mathcal{H}}\Big( h^k - \gamma^k\big(F(h^{k}) + \widehat{\beta}^{N_k} \big) \Big),
\end{equation}
where $\widehat{\beta}^{N_k} := \widehat{F}^{N_k}(h^k) - F(h^k)$ is the error introduced by the estimation. For this and the upcoming algorithms, common assumptions on the sequence $\{\gamma^k\}$ are
\begin{equation} \label{stepsize}
    \begin{split}
       \textstyle \sum_{k = 0}^\infty \gamma^k = \infty, &\qquad  \textstyle \sum_{k = 0}^\infty (\gamma^{k})^2 < \infty.
    \end{split}
\end{equation}
Our first result gives sufficient conditions for convergence of \eqref{algorithm with error term} to any neighborhood of the solution $h^*$ of $\operatorname{VI}(\mathcal{H},F)$.
\begin{proposition} \longthmtitle{Convergence of the projected algorithm~\eqref{eq:projected-original-form}} \label{projected theorem}
	Let $F$ as defined in \eqref{definition elements F} be a strictly monotone, continuous function, and let $\mathcal{H}$ be a compact convex set of the form~\eqref{explicit contrained set 2}. For the algorithm \eqref{algorithm with error term}, assume that step-sizes $\{\gamma^k\}$ satisfies \eqref{stepsize} and the sequence $\{N_k\}$ is such that $\{\widehat{\beta}^{N_k}\}$ is bounded with probability one. Then, for any $\epsilon > 0$ there exists $N_{\epsilon} \in \mathbb{N}$ such that $N_k \geq N_\epsilon$ for all $k$ implies, with probability one,
	\begin{equation*}
		\lim_{k \rightarrow \infty}\norm{h^k - h^*} \le \epsilon.
	\end{equation*}
\end{proposition}
\begin{proof}
	To ease the exposition of this proof, we split the error as $\widehat{\beta}^{N_k} = e^{N_k} + \widehat{\varepsilon}^{N_k}$, where $e^{N_k} = \mathbb{E}[\widehat{\beta}^{N_k}]$. Note that we then have $\mathbb{E}[\widehat{\varepsilon}^{N_k}] = 0$, and  by the boundedness assumption, there exists a constant $B_e > 0$ such that $\norm{e^{N_k}} \leq B_e$ for all $k$. The first step of the proof is to show that the sequence $\{h^k\}$ converges to a trajectory of the following continuous-time projected dynamical system:
    %
	\begin{equation} \label{eq:ODE projected} 
		\dot{\bar{h}}(t) = \Pi_{\mathcal{T}_\mathcal{H}(\bar{h}(t))} \Big( -F\big(\bar{h}(t)\big) - e(t) \Big), \quad \bar{h}(0) \in \mathcal{H}. 
	\end{equation}
	%
	Here $e(\cdot)$ is a uniformly bounded measurable map satisfying $\norm{e(t)} \leq B_e$ for all $t$ (see Section~\ref{sec:proj} for further details on how solutions to projected dynamical systems are defined). For the sake of rigor, we note that the existence of a trajectory of~\eqref{eq:ODE projected} starting from any point in $\mathcal{H}$ is guaranteed by~\cite[Lemma A.1]{MS-AC-NM:22-auto}. To make precise the convergence of the sequence generated by~\eqref{algorithm with error term} to a trajectory of~\eqref{eq:ODE projected}, we say that $\{h^k\}$ converges to a trajectory $\bar{h}( \cdot )$ of \eqref{eq:ODE projected} if
	%
	\begin{equation} \label{eq:convergence to trajectory}
		\lim_{i \rightarrow \infty} \sup_{j \geq i}\Bnorm{h^j - \bar{h}\Bigl(\sum_{k=i}^{j-1} \gamma^k\Bigr)} = 0.
	\end{equation}
	%
    That is, the discrete-time trajectory formed by the linear interpolation of the iterates $\{h^k\}$ approaches the continuous time trajectory $t \mapsto \bar{h}(t)$. The proof of the existence of a map $\bar{h}(\cdot)$ satisfying~\eqref{eq:convergence to trajectory} is similar to that of~\cite[Theorem 5.3.1]{HJK-DSC:78}, with the only change being the existence of an error term $e(t)$ in dynamics~\eqref{eq:ODE projected} which is absent in the cited reference. The inclusion of the error term is facilitated by reasoning presented in the proof of~\cite[Theorem 5.2.2]{HJK-DSC:78}. We avoid repeating these arguments here in the interest of space. 

    Convergence of the sequence $\{h^k\}$ can now be analyzed by studying the asymptotic stability of \eqref{eq:ODE projected}. To this end, we consider the candidate Lyapunov function
    %
    \begin{equation*}
	    V\big(\bar{h}\big) = \frac{1}{2}\norm{\bar{h} - h^*}^2,
    \end{equation*}
    %
    where $h^*$ is the unique solution of $\operatorname{VI}(\mathcal{H},F)$. We first look at the case $e(\cdot) \equiv 0$.  For notational convenience, define the right-hand side of~\eqref{eq:ODE projected} in such a case by the map ${\map{X_{e\equiv0}}{\mathbb{R}^n}{\mathbb{R}^n}}$. The Lie derivative of $V$ along $X_{e\equiv 0}$ is then given by
    %
    \begin{align} \label{eq:Lie-derivative}
	    \nabla V(\bar{h})^\top X_{e \equiv 0}(\bar{h})  = (\bar{h} - h^*)^\top \Pi_{\mathcal{T}_\mathcal{H}(\bar{h})} \big( -F(\bar{h}) \big).
    \end{align}
    %
    We want to show that the right-hand side of the above equation is negative for all $\bar{h} \neq h^*$. We first note that by Moreau’s decomposition theorem~\cite[Theorem 3.2.5]{JBHU-CL:93}, for any $v \in \mathbb{R}^n$ and $\bar{h} \in \mathcal{H}$, we have ${\Pi_{\mathcal{T}_\mathcal{H}(\bar{h})}(v) = v - \Pi_{\mathcal{N}_\mathcal{H}(\bar{h})}(v)}$, where $\mathcal{N}_\mathcal{H}(\bar{h})$ is the normal cone to $\mathcal{H}$ at $\bar{h}$. Using the above relation in~\eqref{eq:Lie-derivative} gives
    %
    \begin{align}
	    \nabla V(\bar{h})^\top \! X_{e \equiv 0}(\bar{h}) \! =  &-(\bar{h}  -  h^*)^\top \! F(\bar{h}) \notag   \\
	    &+ (h^*  -  \bar{h})^\top \! \Pi_{\mathcal{N}_\mathcal{H}(\bar{h})} \big( \! - \! F(\bar{h}) \big)	\notag \\
	    \leq &-(\bar{h}  -  h^*)^\top \! F(\bar{h}), \label{eq:lyap-ineq-1}
    \end{align}
    %
    where the inequality is due to the definition of the normal cone (see Section \ref{sec:notation}) and the fact that $h^* \in \mathcal{H}$. 
    Due to strict monotonicity of $F$, we have ${(\bar{h} - h^*)^\top F(\bar{h}) > (\bar{h} - h^*)^\top F(h^*)}$ whenever ${\bar{h} \neq h^*}$. Furthermore, since $h^* \in \operatorname{SOL}(\mathcal{H},F)$ we know that ${(\bar{h} - h^*)^\top F(h^*) \geq 0}$ for all $\bar{h} \in \mathcal{H}$. Combining these two facts implies that the function $W(\bar{h}) := (\bar{h} - h^*)^\top F(\bar{h})$ satisfies $W(\bar{h}) > 0$ whenever $\bar{h} \neq h^*$.
    Using this in the inequality~\eqref{eq:lyap-ineq-1} yields
    %
    \begin{equation} \label{eq:Lyapunov-less-than}
    	\nabla V(\bar{h})^\top X_{e \equiv 0}(\bar{h}) \le - W(\bar{h}) < 0
    \end{equation}
    %
    whenever $\bar{h} \neq h^*$. Now let $\overline{\mathcal{H}}_{\epsilon} := \setdef{h \in \mathcal{H}}{\norm{h - h^*} \geq \epsilon}$. Since $\mathcal{H}$ is compact, $\overline{\mathcal{H}}_{\epsilon}$ is compact. Since $W$ is continuous, there exists a $\delta > 0$ such that $W(\bar{h}) \ge \delta$ for all $\bar{h} \in \overline{\mathcal{H}}_{\epsilon}$. Therefore we get, from~\eqref{eq:Lyapunov-less-than},
    %
    \begin{align}\label{eq:Lie-delta}
    	\nabla V(\bar{h})^\top X_{e \equiv 0}(\bar{h}) \le - \delta, \quad \text{for all } \bar{h} \in \overline{\mathcal{H}}_{\epsilon}.
    \end{align}
    %
    Next, we drop the assumption that $e(\cdot) \equiv 0$ and use the map $\map{X}{\mathbb{R}^n \times [0,\infty)}{\mathbb{R}^n}$ to denote the right-hand side of~\eqref{eq:ODE projected}. Consider any trajectory $t \mapsto \bar{h}(t)$ of~\eqref{eq:ODE projected}. Since the map is absolutely continuous and $V$ is differentiable, we have for almost all $t \ge 0$ and for $\bar{h}(t) \in \overline{\mathcal{H}}_\epsilon$,
    %
    \begin{align*}
    	\frac{dV}{dt}(t) = \nabla V(\bar{h}(t))^\top X(\bar{h}(t),t) \le - \delta - (\bar{h}(t) - h^*)^\top e(t),
    \end{align*}
    %
    where for obtaining the above inequality we have first used Moreau's decomposition as before to get rid of the projection operator in $X$ and then employed~\eqref{eq:Lie-delta}. Next we bound the error term in the above inequality. Since $\mathcal{H}$ is compact and $ h^* \in \mathcal{H}$, there exists $B_h > 0$ such that $\norm{\bar{h} - h^*} \le B_h$ for all $\bar{h} \in \mathcal{H}$.  In addition $\norm{e(t)} \le B_e$ for all $t$, where $B_e$ is the bound satisfying $\norm{e^{N_k}} \le B_e$. 
    Since the empirical estimate of the CVaR is consistent, we know that $B_e$ can be made arbitrarily small by selecting $N_k$ to be appropriately large for all $k$. That is, there exists $N_\epsilon \in \mathbb{N}$ such that when $N_k > N_\epsilon$ we have $\norm{e^{N_k}} < \frac{\delta}{B_h}$. Consequently, if $N_k > N_\epsilon$ for all $k$, then $\norm{e(t)} < \frac{\delta}{B_h}$ for all $t$. By selecting such a sample size at each iteration and thus bounding the error term, we obtain
    %
    \begin{equation*}
        \begin{split}
            \frac{dV}{dt}(t)&\leq -\delta - (\bar{h}(t) - h^*)^\top e(t)    \\
        	&\leq -\delta + \norm{\bar{h}(t) - h^*} \norm{e(t)} < -\delta + B_h \frac{\delta}{B_h} \leq 0,	
        \end{split}
    \end{equation*}
    %
    which holds for almost all $t$ whenever $\bar{h}(t) \in \overline{\mathcal{H}}_\epsilon$. That is, the trajectory converges to the set $\setdef{h \in \mathcal{H}}{\norm{h - h^*} \le \epsilon}$ as $t \to \infty$. This concludes the proof. 
\end{proof}
In the above result, the restriction $N_k \geq N_\epsilon$ does not need to hold for all $k$. The result also holds if there exists a $K \in \mathbb{N}$ such that $N_k \geq N_\epsilon$ for all $k \geq K$. Regarding boundedness of  $\{\widehat{\beta}^{N_k}\}$, it is ensured if for example each $C_i$ is bounded over the set  $\mathcal{H} \times \Xi$, where $\Xi$ is the support of  $\xi$. 

Despite the convergence property established in Proposition \ref{projected theorem}, the algorithm in \eqref{algorithm with error term} suffers from some disadvantages. Most notably, the algorithm requires computing projections onto the set $\mathcal{H}$ at each iteration, which can be computationally expensive. To address these issues we propose two algorithms that achieve similar convergence to any neighborhood of the solution of the $\operatorname{VI}(\mathcal{H},F)$. The first requires projection onto inequality constraints only and the second does not involve any projection on the primal iterates and instead ensures feasibility using dual variables. As in Proposition~\ref{projected theorem}, we will impose continuity and monotonicity assumptions on $F$ in the upcoming results. We provide the following general result on the continuity and monotonicity properties of $F$.
\begin{lemma}\longthmtitle{Sufficient conditions for monotonicity and continuity of $F$}
    The following hold:
    \begin{itemize}
        \item   If for any $\epsilon > 0$ there exist a $\delta > 0$ such that ${\norm{h - h'} \le         \delta}$ implies $\norm{ C_i(h,\xi) - C_i(h',\xi)} \le \epsilon$ for all $i \in           \until{n}$ and all $\xi$, then $F$ is continuous.
        \item   Assume that there exist functions ${f_i:\mathbb{R}^n \rightarrow \mathbb{R}}$ and ${g_i:            \mathbb{R}^m \rightarrow \mathbb{R}}$ such that ${C_i(h,\xi) \equiv f_i(h) + g_i(\xi)}$, for         all $i \in [n]$. Let ${f(h):= \big(f_1(h), \dots, f_n(h)\big)}$. Then, $F$ is             monotone (resp. strictly) if $f$ is monotone (resp. strictly monotone).
    \end{itemize}
\end{lemma} 
\begin{proof}
    Continuity follows by arguments similar to the proof of \cite[Lemma IV.8]{AC:19-cdc}. For the second part, note that CVaR satisfies ${\operatorname{CVaR}_\alpha\big[C_i(h,\xi)\big] = f_i(h) + \operatorname{CVaR}_\alpha\big[g_i(\xi)\big]}$, for all $h$ and $i \in [n]$ \cite[Page 261]{AS-DD-AR:14}. The proof then follows from the fact that $F(h) - F(h^*) = f(h) - f(h^*)$.
\end{proof}
In the above result, the continuity condition, that may be difficult to check in practice, holds if $\xi$ has a compact support and for any fixed $\xi$, the functions $C_i$ are continuous with respect to $h$. We now introduce our next algorithm.

\subsection{Subspace-constrained algorithm}
In this section, we take a closer look at the form of $\mathcal{H}$ given in~\eqref{explicit contrained set 2} and design an algorithm that handles inequality and equality constraints independently. To this end, we write $\HH_{\mathrm{aff}}  := \setdef{h \in \mathbb{R}^n}{Ah=b}$, and ${\HH_{\mathrm{ineq}}  := \setdef{h \in \mathbb{R}^n}{q^i(h) \le 0, \enskip \forall i \in [s]}}$ for the sets of points satisfying the equality and inequality constraints, respectively. We then have $\mathcal{H} = \HH_{\mathrm{aff}} \cap \HH_{\mathrm{ineq}}$. It turns out that, using matrix operation, we can ensure that the iterates of our algorithm always remain in $\HH_{\mathrm{aff}}$. The method works as follows. Let $\{a_1,\cdots,a_l\}$ be the row vectors of $A$, and let $\{u_1,\cdots,u_n\}$ be an orthonormal basis for $\mathbb{R}^n$ such that the first $M \in \mathbb{N}$ vectors $\{u_1,\cdots,u_{M}\}$ form a basis for the span of vectors $\{a_1,\cdots,a_l\}$. Then, for the subspace ${\SS = \setdef{g \in \mathbb{R}^n}{Ag = 0}}$,  we have
\begin{equation*}
	\Pi_{\SS}(v) = \textstyle \Big(I - \sum_{i = 1}^{M} u_i u_i^\top \Big)v, \quad \text{ for any } v \in \mathbb{R}^n.
\end{equation*}
This well known fact follows from \cite[Theorem 7.10]{DCL-SRL-JJM:16} and noting that $\Pi_{\SS}(v) = v - \Pi_{\SS^{\perp}}(v)$, where $\SS^{\perp}$ is the set of vectors orthogonal to the subspace $\SS$. Thus, the projection onto $\SS$ is achieved by pre-multiplying with the matrix
\begin{equation} \label{eq:subspace-projection-matrix}
	L := I - \sum_{i = 1}^{M} u_i u_i^T.
\end{equation}
Consequently, for any vector $z$ of the form $z = L v$, ${v \in \mathbb{R}^n}$ we have $A z = 0$. To construct $L$ one can find the orthonormal basis vectors $\{u_i\}_{i \in [l]}$ for the span of $\{a_j\}_{j \in [l]}$ and $\mathbb{R}^n$ by using Gram-Scmhidt orthogonalization process \cite[Section 6.4]{DCL-SRL-JJM:16}. Alternatively, if $A$ has full row rank one can use ${L := I - A^\top(AA^\top)^{-1}A}$, see e.g.,~\cite{CDM:00}. We use this projection operator to define our next method called the \textit{subspace-constrained algorithm}:
\begin{equation}\label{eq:subspace-algo}
	h^{k+1} \! = \! h^k \! - \! \gamma^k L \Big(F(h^k) \! + \! c\big(h^k \! - \! \Pi_{\mathcal{H}_{\mathrm{ineq}}}(h^k)\big)  \!+ \! \widehat{\beta}^{N_k}\Big),
\end{equation}
where the initial iterate $h^0 \in \HH_{\mathrm{aff}}$. In the above, $c > 0$ is a parameter to be specified later in the convergence result, the error sequence $\{\widehat{\beta}^{N_k}\}$ is as defined in~\eqref{algorithm with error term}, and $L \in \mathbb{R}^{n \times n}$ is as defined in \eqref{eq:subspace-projection-matrix}.
	
Due to the presence of $L$ in the above algorithm, the direction in which the iterate moves in each iteration is projected onto the subspace $\SS$. Hence, $h^k \in \HH_{\mathrm{aff}}$ for all $k$. We formally establish this in the below result. Furthermore, convergence to a neighbourhood of the set $\HH_{\mathrm{ineq}}$ is achieved through the term $h^k - \Pi_{\HH_{\mathrm{ineq}}}(h^k)$. That is, the higher the value of the design parameter $c$, the closer the limit of $\{h^k\}$ is to $\HH_{\mathrm{ineq}}$. Together, these mechanisms ensure that we keep iterates close to $\mathcal{H}$ and ultimately drive them to a neighbourhood of $h^*$.
\begin{proposition} \label{pr:subspace-cons} \longthmtitle{Convergence of the subspace-constrained algorithm~\eqref{eq:subspace-algo}}
	Let $F$ as defined in \eqref{definition elements F} be a strictly monotone, continuous function, and let $\mathcal{H}$ be a compact convex set of the form~\eqref{explicit contrained set 2}. For the algorithm \eqref{eq:subspace-algo}, assume that step-sizes $\{\gamma^k\}$ satisfies \eqref{stepsize} and that the sequence $\{N^k\}$ is such that there exists $B_{\mathrm{traj}} \in \mathbb{R}$ satisfying $\norm{h^k} \le B_{\mathrm{traj}}$ and also $\{\widehat{\beta}^{N_k}\}$ is bounded with probability one. Then, for any $\epsilon > 0$, there exist $c_{\epsilon}(B_{\mathrm{traj}}) > 0$ and $N_{\epsilon}(B_{\mathrm{traj}}) \in \mathbb{N}$ such that $c \geq c_{\epsilon}(B_{\mathrm{traj}})$ and ${N_k \geq N_{\epsilon}(B_{\mathrm{traj}})}$ for all $k$ imply that the iterates of~\eqref{eq:subspace-algo} satisfy, with probability one, 
	%
	\begin{equation*}
		\lim_{k \rightarrow \infty} \norm{h^k - h^*} \leq \epsilon.
	\end{equation*}
	%
\end{proposition}
\begin{proof}
	First we show that $h^k \in \HH_{\mathrm{aff}}$ for all $k$. To see this, recall that $AL v= 0$ for any $v \in \mathbb{R}^n$. Using this in~\eqref{eq:subspace-algo} implies $Ah^{k+1} = Ah^k$ for all $k$. Consequently, for all $k$, we have $Ah^k = A h^0 = b$ and therefore $h^k \in \HH_{\mathrm{aff}}$. 
	
	Analogous to the proof of Proposition \ref{projected theorem}, it can be established that $\{h^k \}$ converges with probability one, in the sense of \eqref{eq:convergence to trajectory}, to a trajectory of the following dynamics
	%
	\begin{equation} \label{eq:subspace-ode}
		\dot{\bar{h}}(t) \! = \! - \! L \Bigl(  F\big(\bar{h}(t)\big) \!  + \!  c\Big(\bar{h}(t) \!  - \!  \Pi_{\HH_{\mathrm{ineq}}}\big(\bar{h}(t) \big) \Big) \!  - \!  e(t) \Bigr) ,
	\end{equation}
	%
	with the initial state $\bar{h}(0) \in \HH_{\mathrm{aff}}$. Here, $e(\cdot)$ is a uniformly bounded measurable map satisfying $\norm{e(t)} \leq B$ for all $t$. We will use the above fact to establish convergence of the sequence $\{h^k\}$ by analyzing the asymptotic stability of~\eqref{eq:subspace-ode}. Note that $A\dot{\bar{h}}(t) = 0$ for all $t$, and therefore a trajectory $\bar{h}(\cdot)$ of~\eqref{eq:subspace-ode}  satisfies $\bar{h}(t) \in \HH_{\mathrm{aff}}$ for all $t \geq 0$ as  $\bar{h}(0) \in \HH_{\mathrm{aff}}$. Now consider the Lyapunov candidate
	%
	\begin{align*}
		V(\bar{h} ) = \frac{1}{2} \norm{\bar{h} - h^*}^2,
	\end{align*}
	%
	where $h^*$ is the unique solution of $\operatorname{VI}(\mathcal{H},F)$, that follows from strict monotonicity. As was the case for the previous result, we will first analyze the evolution of $V$ along~\eqref{eq:subspace-ode} when $e \equiv 0$. Therefore, we define the notation ${\map{X_{e\equiv0}}{\mathbb{R}^n}{\mathbb{R}^n}}$ to represent the right-hand side of~\eqref{eq:subspace-ode} with  $e \equiv 0$. The Lie derivative of $V$ along $X_{e\equiv0}$ is
	%
	\begin{align}
		\nabla V (\bar{h})^\top X_{e \equiv 0}(\bar{h}) = -(\bar{h} &- h^*)^\top  L \Bigl(  F(\bar{h})  \notag  
		\\
		& +  c\big(\bar{h}   -  \Pi_{\HHineq} (\bh) \big) \Bigr). \label{eq:subspace-lie}
	\end{align}
	%
	Since $\bar{h},h^* \in \HH_{\mathrm{aff}}$, we have $A(\bar{h} - h^*) = 0$ and so ${(\bar{h} - h^*) \in \SS}$. Consequently, for any vector $v \in \mathbb{R}^n$, we have
	%
	\begin{align*}
	    (\bar{h} - h^*)^\top v &= (\bar{h} - h^*)^\top \big( \Pi_{\SS}(v) + \Pi_{\SS^\perp}(v) \big) \notag 
	    \\
	    & = (\bar{h} - h^*)^\top \Pi_{\SS}(v) = (\bar{h} - h^*)^\top L v.
	\end{align*}
	%
	Using the above equality in~\eqref{eq:subspace-lie} gives
	%
	\begin{align}
		\nabla V (\bar{h})^\top X_{e \equiv 0}(\bar{h}) = -(\bar{h} &- h^*)^\top \Bigl(  F(\bar{h})  \notag 
		\\
		& +  c\big(\bar{h}   -  \Pi_{\HHineq} (\bh) \big) \Bigr). \label{eq:Lie-d-subspace}
	\end{align}
	%
	We first upper bound the second term on the right-hand side of the above equality. We have
	%
	\begin{align}
	    & - c (\bar{h} - h^*)^\top \big(\bar{h} - \Pi_{\HHineq} (\bh) \big) \notag    
	    \\
	    & = - c \Big( \bar{h} - \Pi_{\HHineq} (\bh) + \Pi_{\HHineq} (\bh) - h^* \Big)^\top \big(\bar{h} - \Pi_{\HHineq} (\bh) \big) \notag
	    \\
	    & = - c \norm{ \bar{h} - \Pi_{\HHineq} (\bh) }^2 \notag 
	    \\
	    & \qquad + c \big( h^* - \Pi_{\HHineq} (\bh) \big)^\top \big(\bar{h} - \Pi_{\HHineq} (\bh) \big) \le 0,  \label{eq:subspace-lie-second}
	\end{align}
	%
	where for the inequality we have used the fact that  ${\big(\bar{h} - \Pi_{\HHineq} (\bh)\big)^\top\big(h^* - \Pi_{\HHineq} (\bh) \big) \leq 0}$ for any $\bar{h} \in \mathbb{R}^n$ (see \cite[Thm. 3.1.1]{JBHU-CL:01}). Note that the inequality~\eqref{eq:subspace-lie-second} is strict whenever $\bar{h} \neq \Pi_{\HHineq} (\bh)$. We now turn our attention towards the first term in~\eqref{eq:Lie-d-subspace}. Due to strict monotonicity of $F$ and the fact that $h^* \in \operatorname{SOL}(\mathcal{H},F)$, we obtain
	%
	\begin{align}
	    - (\bar{h} - h^*)^\top F(\bar{h})  < - (\bar{h} - h^*)^\top  F(h^*) \le 0 \label{eq:subspace-strict}
	\end{align}
	%
	whenever $\bar{h} \in \mathcal{H}$ and $\bar{h} \not = h^*$. The above inequality along with~\eqref{eq:subspace-lie-second} shows $\nabla V (\bar{h})^\top X_{e \equiv 0}(\bar{h}) \le 0$ for any $\bar{h} \in \mathcal{H}$. However, recalling the approach in the proof of Proposition~\ref{projected theorem}, what we require in order to establish convergence is the existence of $\delta > 0$ such that
	%
	\begin{align}
	    \nabla V (\bar{h})^\top X_{e \equiv 0}(\bar{h}) \le -\delta \text{ for all } \bar{h} \in \overline{\mathcal{H}}_{\epsilon}, \label{eq:subspace-delta}
	\end{align}
	%
	where $\overline{\mathcal{H}}_{\epsilon} := \setdef{h \in \HH_{\mathrm{aff}}}{\norm{h - h^*} \geq \epsilon}$. We obtain this bound below. Note that the strict inequality~\eqref{eq:subspace-strict}  along with continuity of $F$ imply that for any $h \in \mathcal{H} \setminus \{h^*\}$, there exists $\varepsilon_h > 0$ such that
	%
	\begin{align}
	    -(\hat{h} - h^*)^\top  F(\hat{h}) < 0 \text{ for all } \hat{h} \in \mathcal{B}_{\varepsilon_h}(h), \label{eq:subspace-nbd}
	\end{align}
	%
	where we recall that $\mathcal{B}_{\varepsilon_h}(h)$ is the open $\varepsilon_h$-ball centered at $h$. Now let $\mathcal{H}_{\epsilon} := \mathcal{H} \setminus \mathcal{B}_{\epsilon}(h^*)$. Since $\mathcal{H}$ is compact, so is  $\mathcal{H}_{\epsilon}$. Using this property and~\eqref{eq:subspace-nbd}, we deduce that there exists $\varepsilon_0 > 0$ such that for every $h \in \mathcal{H}_\epsilon$ we have
	%
	\begin{align}
	    - (\hat{h} - h^*)^\top F(\hat{h}) < 0 \text{ for all } \hat{h} \in \mathcal{B}_{\varepsilon_0}(h). \label{eq:subspace-nbd-two}
	\end{align}
	%
	Next define 
	%
	\begin{equation*}
	    \Delta_{\varepsilon_0} := \setdef{\bar{h}  \in  \HH_{\mathrm{aff}} \setminus \mathcal{B}_{\epsilon}(h^*)  }{  \bar{h} \not \in \mathcal{B}_{\varepsilon_0}(\mathcal{H}_\epsilon) \text{ and }  \norm{\bar{h}}  \leq  B_{\mathrm{traj}}}.
	\end{equation*}
	%
	Here, $\mathcal{B}_{\varepsilon_0}(\mathcal{H}_\epsilon)$ is the open $\varepsilon_0$-ball of the set $\mathcal{H}_\epsilon$ and ${B_{\mathrm{traj}} > 0}$ is used as an upper bound on any trajectory $\bar{h}(\cdot)$ of~\eqref{eq:subspace-ode}. Note that $\Delta_{\varepsilon_0}$ is compact. Therefore,  there exists $B_F > 0$ satisfying
	%
	\begin{equation}
	    -(\bar{h} - h^*)^\top F(\bar{h}) \leq B_F \text{ for all } \bar{h} \in \Delta_{\varepsilon_0}. \label{eq:subspace-F-bound}
	\end{equation}
	%
	Furthermore, by definition, if $\bar{h} \in \Delta_{\varepsilon_0}$, then $\bar{h} \not \in \mathcal{H}$ and $\bar{h} \in \HH_{\mathrm{aff}}$. Thus, $\bar{h} \in \Delta_{\varepsilon_0}$ implies $\bar{h} \not \in \HH_{\mathrm{ineq}}$. That is, for such a point, the inequality~\eqref{eq:subspace-lie-second} holds strictly. This along with compactness of $\Delta_{\varepsilon_0}$ implies that there exists $B_{\Pi} > 0$ such that
	%
	\begin{equation}\label{eq:subspace-negative-pi}
	    -(\bar{h} - h^*)^\top \big(\bar{h}   -  \Pi_{\HHineq} (\bh) \big) \leq -B_{\Pi} \text{ for all } \bar{h} \in \Delta_{\varepsilon_0}.
	\end{equation}
	%
	Using~\eqref{eq:subspace-F-bound} and~\eqref{eq:subspace-negative-pi} in~\eqref{eq:subspace-lie-second} and setting $c > \frac{B_F}{B_{\Pi}}$ yields
	%
	\begin{align}
	    \nabla V (\bar{h})^\top X_{e \equiv 0}(\bar{h}) < 0 \text{ for all } \bar{h} \in \Delta_{\varepsilon_0}. \label{eq:subspace-first-region}
	\end{align}
	%
	Now consider $\bar{h}$ satisfying $\bar{h} \notin \Delta_{\epsilon_0} \cup \mathcal{B}_{\epsilon}(h^*)$ and ${\norm{\bar{h}} \leq B_{\mathrm{traj}}}$. Note that such a point belongs to ${\HH_{\mathrm{aff}} \cap \mathcal{B}_{\varepsilon_0}(\mathcal{H}_\epsilon) \cap \mathcal{B}_{B_{\mathrm{traj}}}(0)}$. Thus, by~\eqref{eq:subspace-nbd-two}, we have $-(\bar{h} - h^*)^\top F(\bar{h}) < 0$ for such a point. This fact combined with~\eqref{eq:subspace-first-region} leads us to the conclusion that
	%
	\begin{align*}
	    \nabla V(\bar{h})^\top X_{e \equiv 0}(\bar{h}) < 0 \text{ for all } \bar{h} \in \overline{\mathcal{H}}_\epsilon.
	\end{align*}
	%
	Since the left-hand side of the above equation is a continuous function and $\overline{\mathcal{H}}_\epsilon$ is compact, we deduce that~\eqref{eq:subspace-delta} holds. The rest of the proof is then analogous to the corresponding section of the proof in Proposition \ref{projected theorem}.
\end{proof}
\begin{remark}\longthmtitle{Practical considerations of~\eqref{eq:subspace-algo}}\label{equivalent to bounded problem}
	In Proposition~\ref{pr:subspace-cons}, for small values of $\epsilon$, one would require a large value of $c$ to ensure convergence. This may result in large oscillations of $h^k$ when $\gamma^k$ remains large. Such behavior can be prevented by either starting with small values of $\gamma^k$ or increasing $c$ along iterations, until it reaches a predetermined size. The result is then still valid but the convergence can only be guaranteed once $c$ reaches the required size. 
	
	We note that the required assumption of boundedness of $\{h^k\}$ can be ensured by constraining the iterates in $\{h^k\}$ to lie in a hyper-rectangle containing $\mathcal{H}$ (cf. \cite[Page 40]{HJK-DSC:78}). However, on the boundary of the hyper-rectangle, one would have to make use of steps of the form \eqref{algorithm with error term} to ensure that the iterates remain in the feasible set. \relax\ifmmode\else\unskip\hfill\fi\oprocendsymbol
\end{remark} 
\subsection{Multiplier-driven algorithm}
Algorithms \eqref{algorithm with error term} and \eqref{eq:subspace-algo} involve projection onto $\mathcal{H}$ or $\HH_{\mathrm{ineq}}$ at each iteration, which can be computationally burdensome. Our next algorithm overcomes this limitation. We assume $\mathcal{H}$ to be of the form \eqref{explicit contrained set 2} and introduce a multiplier variable ${\lambda \in {\mathbb{R}}_{\ge 0}^s}$ that enforces satisfaction of the inequality constraint as the algorithm progresses. In order to simplify the coming equations we introduce the notation ${H(h,\lambda) := F(h) + Dq(h)^\top \lambda}$, where $Dq(h)$ is the Jacobian of $q$ at $h$. The \emph{multiplier-driven algorithm} is now given as
\begin{equation} \label{Lagrangian algorithm}
    \begin{split}
        h^{k + 1} &= h^k  - \gamma^k L \big(H(h^k,\lambda^k) + \widehat{\beta}^{N_k}\big), 
        \\
        \lambda^{k+1} &= \big[\lambda^{k} + \gamma^k q(h^k) \big]^+.
    \end{split}
\end{equation}
Here $L$ is as defined in \eqref{eq:subspace-projection-matrix}. Also recall that $\widehat{\beta}^{N_k}$ is the error due to empirical estimation of $F$. The next result establishes the convergence properties of~\eqref{Lagrangian algorithm} to a KKT point of the VI (see Section~\ref{section preliminaries} for definitions) and so to a solution of the VI.
\begin{proposition} \longthmtitle{Convergence of the multiplier-driven algorithm~\eqref{Lagrangian algorithm}} \label{lagrange theorem}
    Let $F$, as defined in \eqref{definition elements F}, be a strictly monotone, continuous function, and let $\mathcal{H}$ be a compact convex set of the form \eqref{explicit contrained set 2}, where functions $q^i$, $i \in \until{s}$, are affine. Assume that the LICQ holds for ${h^* \in \operatorname{SOL}(\mathcal{H}, F)}$, and let $(h^*,\lambda^*, \mu^*
    )$ be an associated KKT point. 
    For algorithm \eqref{Lagrangian algorithm}, assume that  step-sizes $\{\gamma^k\}$ satisfies \eqref{stepsize} and let $\{N_k\}$ be such that $\{\widehat{\beta}^{N_k}\}$, $\{h^k\}$, and $\{\lambda^k\}$
    are bounded with probability~one.
    Then, for any $\epsilon > 0$, there exists an $N_\epsilon \in \mathbb{N}$ such that if $N_k \geq N_\epsilon$ for all $k$, then, with probability one,
    %
    \begin{equation*}
        \lim_{k \rightarrow \infty} \norm{h^k - h^*} \leq \epsilon.
    \end{equation*}
    %
\end{proposition}
\begin{proof}
    Analogous to the proof of Proposition~\ref{projected theorem}, the first step establishes convergence with probability one of the sequence $\big\{(h^k, \lambda^k)\big\}$, in the sense of \eqref{eq:convergence to trajectory}, to a trajectory $\big(\bar{h}(\cdot),\bar{\lambda}(\cdot) \big)$ of the following dynamics
    %
    \begin{subequations}\label{eq:ODE-h-lm}
        \begin{align}
            \dot{\bar{h}}(t) &= -L \Bigl( H\big(\bar{h}(t), \bar{\lambda}(t)
            \big)  + e(t) \Bigr), \label{ODE lambda part0}  
            \\
            \dot{\bar{\lambda}}(t) &= \Big[q\big(\bar{h}(t)\big)\Big]_{\bar{\lambda}(t)}^+, \label{ODE lambda part}
        \end{align}
    \end{subequations}
    %
    with initial condition $\bar{h}(0) \in \mathbb{R}^n$ and $\bar{\lambda}(0) \in {\mathbb{R}}_{\ge 0}^l$. Note that due to the presence of this operator in~\eqref{ODE lambda part}, $\bar{\lambda}$ is contained in the nonnegative orthant along any trajectory of the system.
    The map $\bar{e}(\cdot)$ is uniformly bounded and so, as before, we have $\norm{e(t)} \le B_e$ for all $t$. The proof of convergence of the iterates to a continuous trajectory is similar to that of \cite[Theorem 5.2.2]{HJK-DSC:78} and is not repeated here for brevity. Note that, as was the case for Proposition \ref{pr:subspace-cons}, multiplication with the matrix $L$ ensure that $h^k,\bar{h}(t) \in \HH_{\mathrm{aff}}$ for all $k$ and $t \geq 0$. Next, we analyze the convergence of~\eqref{eq:ODE-h-lm}. We will occasionally use $\bar{x}$ as shorthand for $(\bar{h},\bar{\lambda})$. Define the candidate Lyapunov function
    %
    \begin{equation} \label{lyapunov function}
        V(\bar{h},\bar{\lambda}) := \frac{1}{2}\big(\norm{\bar{h} - h^*}^2 + \norm{\bar{\lambda} - \lambda^*}^2\big),
    \end{equation}
    %
    where $h^*$ is the unique solution of $\operatorname{VI}(\mathcal{H}, F)$ and there exist $\mu^* \in \mathbb{R}^l$ such that $(h^*,\lambda^*, \mu^*)$ is an associated KKT point.We analyze the evolution of \eqref{lyapunov function} for the case $e \equiv 0$. Denoting the right-hand side of~\eqref{eq:ODE-h-lm} for this case by $X_{e \equiv 0}$, the Lie derivative of $V$ along~\eqref{eq:ODE-h-lm} is
    %
    \begin{equation} \label{lagrange proof vdot}
        \begin{split}
            \nabla V(\bar{x})^\top   X_{e \equiv 0}&(\bar{x})  = -(\bar{h} - h^*)^\top H(\bar{h},\bar{\lambda})    
            \\ 
            \! \!&+ (\bar{\lambda}  \! - \! \lambda^*)^\top \! \big(q(\bar{h}) \! + \! [q(\bar{h})]_{\bar{\lambda}}^+ \! - \! q(\bar{h})\big) \!. 
        \end{split}
    \end{equation}
    %
    Here we have dropped the matrix $L$ from the term ${(\bar{h} - h^*)^\top LH(\bar{h},\bar{\lambda})}$, which is justified by the same argument used for deriving \eqref{eq:Lie-d-subspace}. Note that for any $i$, ${([q(\bar{h})]_{\bar{\lambda}}^+)_i = (q(\bar{h}))_i}$ if $\bar{\lambda}_i > 0$. Also, if $\bar{\lambda}_i = 0$, then ${\bar{\lambda}_i - \lambda^*_i \le 0}$. Thus, we find $(\bar{\lambda} \! - \! \lambda^*)^\top([q(\bar{h})]_{\bar{\lambda}}^+ \! - \! q(\bar{h})) \leq 0$. Since $q$ is affine, we have $Dq(\bar{h}) = Dq(h^*)$ for all $\bar{h} \in \mathbb{R}^n$. Combined with strict monotonicity this gives, for $\bar{h} \not = h^*$,
    %
    \begin{equation} \label{eq:derivation-in-multiplier}
        \begin{split}
            0&<(\bar{h} - h^*)^\top \big(H(\bar{h},\bar{\lambda})
            - H(h^*,\bar{\lambda}) \big)    
            \\
            &=(\bar{h} - h^*)^\top \big(H(\bar{h},\bar{\lambda})
             - H(h^*,\lambda^*) 
            \\ 
            &+ Dq(h^*)^\top\lambda^* - Dq(h^*)^\top\bar{\lambda}\big).
        \end{split}
    \end{equation}
    %
    From \eqref{KKT} we have $-H(h^*,\lambda^*) = A^\top \mu^*$. Since we have $\bar{h},h^* \in \HH_{\mathrm{aff}}$ it follows that $-(\bar{h} - h^*)^\top H(h^*,\lambda^*) = 0$. Then, using the assumption that $q$ is affine, \eqref{eq:derivation-in-multiplier} gives us $- (\bar{h}  -  h^*)^\top H(\bar{h},\bar{\lambda}) < (\lambda^* - \bar{\lambda})^\top \big(q(\bar{h}) - q(h^*)\big)$ Combining these derivations, and writing $W(\bar{h})$ for the right-hand side of \eqref{lagrange proof vdot} we get that for ${\bar{h} \not = h^*}$, ${W(\bar{h}) <  (\bar{\lambda} -\lambda^{*} )^\top  q(h^*)}$. From \eqref{KKT} we have $\lambda^{*\top }q(h^*) = 0$ and $\bar{\lambda}^\top q(h^*) \leq 0$, which then implies $\nabla V(\bar{h},\bar{\lambda})  X_{e \equiv 0}(\bar{h},\bar{\lambda}) < 0$ for almost all $t$ with $\bar{h}(t) \not = h^*$. The rest of the proof is analogous to the corresponding section of the proof of Proposition \ref{projected theorem}.
\end{proof}
\begin{remark} \longthmtitle{Implementation aspect of Proposition~\ref{lagrange theorem}} \label{remark generalization}
    In Proposition \ref{lagrange theorem} we require boundedness of $\{h^k\}$, $\{\lambda^k\}$. When upper bounds on $\norm{\lambda^*}$ are known beforehand, projection onto hyper-rectangles can ensure boundedness of $\{\lambda^k\}$, while the result remains valid, (cf.~\cite[Page 40,~Theorem 5.2.2]{HJK-DSC:78}). For boundedness of $\{h^k\}$, see Remark \ref{equivalent to bounded problem}.
    \relax\ifmmode\else\unskip\hfill\fi\oprocendsymbol
 \end{remark}
\section{Simulations} \label{section simulations}
\begin{figure}     
    \centering
    \includegraphics[width = 0.9\columnwidth]{converge_plot_hold.eps}
    \vspace*{-2ex}
    \caption{\footnotesize Plot illustrating the convergence of the algorithms for the routing example explained in Section~\ref{section simulations}. The initial condition for all algorithms is set as $h_0$ defined as $(h_0)_i = 30$ for $i \in \{1,\dots,10\}$, $(h_0)_i = 60$ for $i \in \{11, \dots, 20\}$ and $(h_0)_i = 20$ for $i \in \{21,\dots, 30\}$.}
    \label{figure logscale}
\end{figure}
Here we demonstrate an application of the presented stochastic approximation algorithms for finding the solutions of a CVaR-based variational inequality. The example is an instance of a CVaR-based routing game (see Section~\ref{section routing game}) based on the Sioux Falls network~\cite{120820}. The network consists of $24$ nodes and $76$ edges. To each of the edges, we associate an affine cost function given by $C_e(f_e,u_e) = t_e(1 + u_{e} \frac{100}{c_e}f_e)$, where $f_e$ is the flow over edge $e$, and $t_e$ and $c_e$ are the free-flow travel time and capacity of edge $e$, respectively, as obtained from~\cite{120820}. The uncertainty $u_e$ has the uniform distribution over the interval $[0,0.5]$ for all edges connected to the vertices $10$, $16$, or $17$. For the rest of the edges, $u_e$ is set to zero. This defines the cost functions for all edges, and consequently defines the costs of all paths through the network as well. We consider three origin destination(OD) pairs $\mathcal{W} = \{(1,19),(13,8),(12,18)\}$, and for each of these paths we select the ten paths that have the smallest free-flow travel time associated to them. The set of these 30 paths we denote as $\mathcal{P}$. The demands for each OD-pair are given by $d_{1,19} = 300$, $d_{13,8} = 600$, $d_{12,18} = 200$. We aim to find a CVaR-based Wardrop equilibrium which is equivalent to finding a solution of the VI problem defined by a map ${F(h) := A h + b + \operatorname{CVaR}_\alpha[\xi]}$, and a feasible set $\mathcal{H} = \setdef{{h \in \mathbb{R}^{30}}}{{h \geq 0},  {\sum_{i = 1}^{10}h_i = 300},  {\sum_{i = 11}^{20}h_i = 600}, \newline  {\sum_{i = 21}^{30}h_i = 200}}$. Here, $h,b \in \mathbb{R}^{30}$, ${A \in \mathbb{R}^{30 \times 30}}$, and ${\alpha = 0.05}$. The exact values of $A$ and $b$ and the distribution of $\xi$ are constructed using the cost functions and the network structure, see~\cite[Section 6]{AC:22} for details.

In Figure \ref{figure logscale}, we see the evolution of the error for each of the different algorithms. The stepsize sequence for the projected, subspace-constrained, and multiplier-driven algorithms are $\gamma^k = \frac{100}{100 + k}$, $\gamma^k = \frac{200}{200 + k}$, and ${\gamma^k = \min(\frac{100}{100 + k},\frac{1}{2})}$, respectively.  In addition, for the subspace-constrained algorithm we initially let $c$ depend on $k$, to prevent unstable behaviour. We used $c = \min(\frac{1}{\gamma^k},200)$. For the multiplier driven algorithm, for similar reasons, we used a modified step-size sequence for updating the multipliers $\lambda$ given by $\gamma^k_{\lambda} = 2 \gamma^k$ for $k < 1000$ and $\gamma^k_{\lambda} = 0.5 \gamma^k$, otherwise. The figure shows that all algorithms converge to a neighbourhood of the solution of the variational inequality, albeit requiring a different number of iterations. Specifically, the number of iterations taken by the projected algorithm to converge is two orders of magnitude less than that of the subspace-constrained and multiplier-driven algorithms. The quality of convergence is summarized in Table \ref{tab:mean}, where we can see both the accuracy of the achieved convergence as well as the effect of increasing the sample sizes. It is important to note that the errors shown in Fig.~\ref{figure logscale} and Table~\ref{tab:mean} are in terms of the deviation in the value of the map $\norm{F(h^k) - F(h^*)}$, rather than deviation in the solution $\norm{h^k - h^*}$. This is because the solution $h^*$ is not unique for the formulated VI.  However, for any two solutions ${h^*,\tilde{h}^* \in \operatorname{SOL}(F,\mathcal{H})}$ we do have $F(\tilde{h}^*) = F(h^*)$.
\begin{table}[] 
	\centering
	\begin{tabular}{l|l|l|l}
		\text{Samples per iteration}&25  &50  &100  \\ \hline
		\text{Projected}&0.3875 &0.2062  &0.1157  \\ \hline
		\text{Subspace constrained}&0.3780 &0.2015  &0.1332  \\ \hline
		\text{Multiplier-driven}&0.3889  &0.1987  & 0.1064
	\end{tabular}
    \caption{The average error of the iterates for each of the algorithms after an upper bound on the error of $0.6$, $0.3$ and $0.15$ has been achieved using $25$, $50$ and $100$ samples in each iteration respectively. The number of iterates used are $1000$, $50000$ and $100000$ for the projected, subspace-constrained and multiplier-driven algorithms respectively.}
    \label{tab:mean}
\end{table}
\section{Conclusions} \label{section conclusion}
We have considered variational inequalities defined by the CVaR of cost functions and provided stochastic approximation algorithms for solving them. We have analyzed the asymptotic convergence of these algorithms when, at each iteration, only a finite number of samples are used to estimate the CVaR. Future work will focus on analyzing the finite-time properties of the introduced algorithms and the sample complexity for a desired error tolerance of the last iterate. Finally, we wish to explore accelerated methods to solve the problem. 



2022-11-16T02:11:51.000
2211
2211.07227
en
https://arxiv.org/abs/2211.07227
This paper considers variational inequalities (VI) defined by the conditional value-at-risk (CVaR) of uncertain functions and provides three stochastic approximation schemes to solve them. All methods use an empirical estimate of the CVaR at each iteration. The first algorithm constrains the iterates to the feasible set using projection. To overcome the computational burden of projections, the second one handles inequality and equality constraints defining the feasible set differently. Particularly, projection onto to the affine subspace defined by the equality constraints is achieved by matrix multiplication and inequalities are handled by using penalty functions. Finally, the third algorithm discards projections altogether by introducing multiplier updates. We establish asymptotic convergence of all our schemes to any arbitrary neighborhood of the solution of the VI. A simulation example concerning a network routing game illustrates our theoretical findings.
Optimization and Control (math.OC)
Stochastic approximation approaches for CVaR-based variational inequalities
Qwen/Qwen-72B
1. YES
2. YES