---
author:
- '**Risheng Liu, Xuan Liu, Shangzhi Zeng, Jin Zhang, Yixuan Zhang**'
bibliography:
- 'output.bib'
title: '**Summary of differences between this work and our conference version \[1\]**'
---

A preliminary version of this work has been published in ICML 2021 @liu2021value. In this journal submission, a series of substantial extensions have been made to improve our conference work. To be specific, we summarize our main extensions as follows.

1.  In our conference work @liu2021value, an interior-point-type method with the log barrier function has been proposed to solve Bi-Level Optimization (BLO) with non-convex lower-level sub-problems. As a significant extension, this journal work formulates BLO from a more general sequential-minimization perspective and designs an extended algorithmic framework, named BVFSM, to solve various types of BLO. Within the BVFSM framework, we can uniformly solve different categories of BLO by a general value-function-based reformulation scheme with a variety of penalty and barrier techniques, containing polynomial penalty, inverse barrier, truncated log barrier and so on. Therefore, BVFSM is more general and flexible than the algorithm proposed in @liu2021value.

2.  Different from @liu2021value, which only considers solving optimistic BLO, in this work we extend our method to address BLO in two more challenging scenarios, including BLO with functional constraints and pessimistic BLO. Specifically, we extend our method to solve BLO that contains inequality constraints $H_{j} (\x,\y) \leq 0, \forall \ j$, and $h_{j'}(\x,\y) \leq 0, \forall \ j'$, on the upper- and lower-level sub-problems, respectively. Besides, it is known that solving pessimistic BLO is definitely more challenging than other types of BLO. Fortunately, BVFSM can also bring out an effective gradient-based method to address these pessimistic BLO problems.

3.  Additionally, we thoroughly improve the theoretical results in @liu2021value. In particular, rather than analyzing the convergence behaviors of the standard optimistic BLO in @liu2021value, we prove our convergence results on BLO that contains both upper- and lower-level functional constraints. Thus we actually obtain more general theoretical properties for BVFSM. Furthermore, the convergence of BVFSM on pessimistic BLO can also be derived accordingly. **To our best knowledge, the proposed BVFSM in this journal version is the first gradient-based algorithm that can solve different kinds of BLO problems (e.g., optimistic, pessimistic and with constraints) all with solid convergence guarantees.**

4.  In this journal submission, we also substantially improve the experimental part to validate our new theoretical findings and evaluate the performance in more practical applications. Specifically, we first design new high-dimensional numerical examples to evaluate BVFSM from diverse aspects, including various initialization, inner iterations, and penalty/barrier strategies, etc. We also compare BVFSM with different mainstream gradient-based methods on BLO under varying dimensions to illustrate our numerical efficiency, especially in high-dimensional optimization scenarios. Moreover, we evaluate BVFSM on other types of BLO, such as BLO with constraints and pessimistic BLO. Last but not least, we formulate and address GAN within our BVFSM framework to demonstrate the potential applications of pessimistic BLO in modern learning tasks.

{'source': 'arXiv_out/2110'}