<!DOCTYPE html><html lang="en">
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<title>[2406.15877] BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions</title><meta property="og:description" content="Automated software engineering has been greatly empowered by the recent advances in Large Language Models (LLMs) for programming. While current benchmarks have shown that LLMs can perform various software engineering t…">
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta name="twitter:card" content="summary">
<meta name="twitter:title" content="BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions">
<meta name="twitter:image:src" content="https://ar5iv.labs.arxiv.org/assets/ar5iv_card.png">
<meta name="twitter:image:alt" content="ar5iv logo">
<meta property="og:title" content="BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions">
<meta property="og:site_name" content="ar5iv">
<meta property="og:image" content="https://ar5iv.labs.arxiv.org/assets/ar5iv_card.png">
<meta property="og:type" content="article">
<meta property="og:url" content="https://ar5iv.labs.arxiv.org/html/2406.15877">

<!--Generated on Fri Jul  5 18:08:09 2024 by LaTeXML (version 0.8.8) http://dlmf.nist.gov/LaTeXML/.-->
<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">

<script>
  function detectColorScheme(){
    var theme="light";
    var current_theme = localStorage.getItem("ar5iv_theme");
    if(current_theme){
      if(current_theme == "dark"){
        theme = "dark";
      } }
    else if(!window.matchMedia) { return false; }
    else if(window.matchMedia("(prefers-color-scheme: dark)").matches) {
      theme = "dark"; }
    if (theme=="dark") {
      document.documentElement.setAttribute("data-theme", "dark");
    } else {
      document.documentElement.setAttribute("data-theme", "light"); } }

  detectColorScheme();

  function toggleColorScheme(){
    var current_theme = localStorage.getItem("ar5iv_theme");
    if (current_theme) {
      if (current_theme == "light") {
        localStorage.setItem("ar5iv_theme", "dark"); }
      else {
        localStorage.setItem("ar5iv_theme", "light"); } }
    else {
        localStorage.setItem("ar5iv_theme", "dark"); }
    detectColorScheme(); }
</script>
<link media="all" rel="stylesheet" href="/assets/ar5iv-fonts.0.7.9.min.css"><link media="all" rel="stylesheet" href="/assets/ar5iv.0.7.9.min.css"><link media="all" rel="stylesheet" href="/assets/ar5iv-site.0.2.2.css">
</head>
<body>
<div class="ltx_page_main">
<div class="ltx_page_content">
<article class="ltx_document ltx_authors_1line">
<div id="p1" class="ltx_para">
<span id="p1.1" class="ltx_ERROR undefined">\noptcrule</span>
</div>
<h1 class="ltx_title ltx_title_document">
<span id="id1.1" class="ltx_text" style="position:relative; bottom:-3.5pt;"><img src="/html/2406.15877/assets/bigcode.png" id="id1.1.g1" class="ltx_graphics ltx_img_square" width="14" height="14" alt="[Uncaptioned image]"></span> <span id="id60.id1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions</h1>
<div class="ltx_authors">
<span class="ltx_creator ltx_role_author">
<span class="ltx_personname">

Terry Yue Zhuo<sup id="id61.59.id1" class="ltx_sup"><span id="id61.59.id1.1" class="ltx_text ltx_font_italic" style="color:#000000;">1,2,3</span></sup>    <span id="id34.33.32" class="ltx_text" style="color:#87BAE6;">
Chien Vu<sup id="id34.33.32.29" class="ltx_sup"><span id="id34.33.32.29.1" class="ltx_text" style="color:#000000;">4</span></sup>   
Jenny Chim<sup id="id34.33.32.30" class="ltx_sup"><span id="id34.33.32.30.1" class="ltx_text" style="color:#000000;">5</span></sup>   
Han Hu<sup id="id34.33.32.31" class="ltx_sup"><span id="id34.33.32.31.1" class="ltx_text ltx_font_italic" style="color:#000000;">1,3</span></sup>   
Wenhao Yu<sup id="id34.33.32.32" class="ltx_sup"><span id="id34.33.32.32.1" class="ltx_text" style="color:#000000;">6</span></sup>   

<br class="ltx_break">
<span id="id7.6.5.1" class="ltx_text ltx_font_bold">Ratnadira Widyasari<sup id="id7.6.5.1.1" class="ltx_sup"><span id="id7.6.5.1.1.1" class="ltx_text ltx_font_medium" style="color:#000000;">3</span></sup></span>   
<span id="id8.7.6.2" class="ltx_text ltx_font_bold">Imam Nur Bani Yusuf<sup id="id8.7.6.2.1" class="ltx_sup"><span id="id8.7.6.2.1.1" class="ltx_text ltx_font_medium" style="color:#000000;">3</span></sup></span>   
<span id="id9.8.7.3" class="ltx_text ltx_font_bold">Haolan Zhan<sup id="id9.8.7.3.1" class="ltx_sup"><span id="id9.8.7.3.1.1" class="ltx_text ltx_font_medium" style="color:#000000;">1</span></sup></span>   
<span id="id10.9.8.4" class="ltx_text ltx_font_bold">Junda He<sup id="id10.9.8.4.1" class="ltx_sup"><span id="id10.9.8.4.1.1" class="ltx_text ltx_font_medium" style="color:#000000;">3</span></sup></span>   

<br class="ltx_break">
<span id="id11.10.9.5" class="ltx_text ltx_font_bold">Indraneil Paul<sup id="id11.10.9.5.1" class="ltx_sup"><span id="id11.10.9.5.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">7</span></sup></span>   
<span id="id12.11.10.6" class="ltx_text ltx_font_bold">Simon Brunner<sup id="id12.11.10.6.1" class="ltx_sup"><span id="id12.11.10.6.1.1" class="ltx_text ltx_font_medium" style="color:#000000;">8</span></sup></span>   
<span id="id13.12.11.7" class="ltx_text ltx_font_bold">Chen Gong<sup id="id13.12.11.7.1" class="ltx_sup"><span id="id13.12.11.7.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">9</span></sup></span>   
<span id="id14.13.12.8" class="ltx_text ltx_font_bold">Thong Hoang<sup id="id14.13.12.8.1" class="ltx_sup"><span id="id14.13.12.8.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">2</span></sup></span>   
<span id="id15.14.13.9" class="ltx_text ltx_font_bold">Armel Zebaze<sup id="id15.14.13.9.1" class="ltx_sup"><span id="id15.14.13.9.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">10</span></sup></span>   

<br class="ltx_break"><span id="id34.33.32.28" class="ltx_text" style="color:#008080;">
<span id="id16.15.14.10.1" class="ltx_text ltx_font_bold">Xiaoheng Hong<sup id="id16.15.14.10.1.1" class="ltx_sup"><span id="id16.15.14.10.1.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">11</span></sup></span>   
<span id="id17.16.15.11.2" class="ltx_text ltx_font_bold">Wen-Ding Li<sup id="id17.16.15.11.2.1" class="ltx_sup"><span id="id17.16.15.11.2.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">12</span></sup></span>   
<span id="id18.17.16.12.3" class="ltx_text ltx_font_bold">Jean Kaddour<sup id="id18.17.16.12.3.1" class="ltx_sup"><span id="id18.17.16.12.3.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">13</span></sup></span>   
<span id="id19.18.17.13.4" class="ltx_text ltx_font_bold">Ming Xu<sup id="id19.18.17.13.4.1" class="ltx_sup"><span id="id19.18.17.13.4.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">8</span></sup></span>   
<span id="id20.19.18.14.5" class="ltx_text ltx_font_bold">Zhihan Zhang<sup id="id20.19.18.14.5.1" class="ltx_sup"><span id="id20.19.18.14.5.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">6</span></sup></span>   

<br class="ltx_break">
<span id="id21.20.19.15.6" class="ltx_text ltx_font_bold">Prateek Yadav<sup id="id21.20.19.15.6.1" class="ltx_sup"><span id="id21.20.19.15.6.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">14</span></sup></span>   
<span id="id22.21.20.16.7" class="ltx_text ltx_font_bold">Naman Jain<sup id="id22.21.20.16.7.1" class="ltx_sup"><span id="id22.21.20.16.7.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">15</span></sup></span>   
<span id="id23.22.21.17.8" class="ltx_text ltx_font_bold">Alex Gu<sup id="id23.22.21.17.8.1" class="ltx_sup"><span id="id23.22.21.17.8.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">16</span></sup></span>   
<span id="id24.23.22.18.9" class="ltx_text ltx_font_bold">Zhoujun Cheng<sup id="id24.23.22.18.9.1" class="ltx_sup"><span id="id24.23.22.18.9.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">17</span></sup></span>   
<span id="id34.33.32.28.19" class="ltx_text" style="color:#0000A6;">
<span id="id25.24.23.19.10.1" class="ltx_text ltx_font_bold">Jiawei Liu<sup id="id25.24.23.19.10.1.1" class="ltx_sup"><span id="id25.24.23.19.10.1.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">18</span></sup></span>   

<br class="ltx_break">
<span id="id26.25.24.20.11.2" class="ltx_text ltx_font_bold">Qian Liu<sup id="id26.25.24.20.11.2.1" class="ltx_sup"><span id="id26.25.24.20.11.2.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">19</span></sup></span>   
<span id="id27.26.25.21.12.3" class="ltx_text ltx_font_bold">Zijian Wang<sup id="id27.26.25.21.12.3.1" class="ltx_sup"><span id="id27.26.25.21.12.3.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">20</span></sup></span>   
<span id="id28.27.26.22.13.4" class="ltx_text ltx_font_bold">Binyuan Hui<sup id="id28.27.26.22.13.4.1" class="ltx_sup"><span id="id28.27.26.22.13.4.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">8</span></sup></span>   
<span id="id29.28.27.23.14.5" class="ltx_text ltx_font_bold">Niklas Muennighoff<sup id="id29.28.27.23.14.5.1" class="ltx_sup"><span id="id29.28.27.23.14.5.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">21</span></sup></span>   
<span id="id30.29.28.24.15.6" class="ltx_text ltx_font_bold">David Lo<sup id="id30.29.28.24.15.6.1" class="ltx_sup"><span id="id30.29.28.24.15.6.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">3</span></sup></span>   

<br class="ltx_break">
<span id="id31.30.29.25.16.7" class="ltx_text ltx_font_bold">Daniel Fried<sup id="id31.30.29.25.16.7.1" class="ltx_sup"><span id="id31.30.29.25.16.7.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">22</span></sup></span>   
<span id="id32.31.30.26.17.8" class="ltx_text ltx_font_bold">Xiaoning Du<sup id="id32.31.30.26.17.8.1" class="ltx_sup"><span id="id32.31.30.26.17.8.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">1</span></sup></span>   
<span id="id33.32.31.27.18.9" class="ltx_text ltx_font_bold">Harm de Vries<sup id="id33.32.31.27.18.9.1" class="ltx_sup"><span id="id33.32.31.27.18.9.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">23</span></sup></span>   
<span id="id34.33.32.28.19.10" class="ltx_text ltx_font_bold">Leandro von Werra<sup id="id34.33.32.28.19.10.1" class="ltx_sup"><span id="id34.33.32.28.19.10.1.1" class="ltx_text ltx_font_medium ltx_font_italic" style="color:#000000;">24</span></sup></span>
</span></span></span>

<br class="ltx_break">
<br class="ltx_break"><span id="id62.60.id2" class="ltx_text ltx_font_bold" style="color:#87BAE6;">Core contributors, random ordering</span>

<br class="ltx_break"><span id="id63.61.id3" class="ltx_text ltx_font_bold" style="color:#008080;">Additional contributors, random ordering</span>

<br class="ltx_break"><span id="id64.62.id4" class="ltx_text ltx_font_bold" style="color:#0000A6;">Senior contributors, random ordering</span>

<br class="ltx_break">
<br class="ltx_break"><sup id="id65.63.id5" class="ltx_sup">1</sup>Monash University   
<sup id="id66.64.id6" class="ltx_sup">2</sup>CSIRO’s Data61   
<sup id="id67.65.id7" class="ltx_sup">3</sup>Singapore Management University

<br class="ltx_break"><sup id="id68.66.id8" class="ltx_sup">4</sup>Detomo Inc., Japan   
<sup id="id69.67.id9" class="ltx_sup">5</sup>Queen Mary University of London   
<sup id="id70.68.id10" class="ltx_sup"><span id="id70.68.id10.1" class="ltx_text ltx_font_italic">6</span></sup> University of Notre Dame   

<br class="ltx_break"><sup id="id71.69.id11" class="ltx_sup">7</sup>TU Darmstadt   
<sup id="id72.70.id12" class="ltx_sup">8</sup>Independent   
<sup id="id73.71.id13" class="ltx_sup">9</sup>University of Virginia   
<sup id="id74.72.id14" class="ltx_sup"><span id="id74.72.id14.1" class="ltx_text ltx_font_italic">10</span></sup>Inria   
<sup id="id75.73.id15" class="ltx_sup"><span id="id75.73.id15.1" class="ltx_text ltx_font_italic">11</span></sup>Intel

<br class="ltx_break"><sup id="id76.74.id16" class="ltx_sup"><span id="id76.74.id16.1" class="ltx_text ltx_font_italic">12</span></sup>Cornell University   
<sup id="id77.75.id17" class="ltx_sup"><span id="id77.75.id17.1" class="ltx_text ltx_font_italic">13</span></sup>University College London   
<sup id="id78.76.id18" class="ltx_sup"><span id="id78.76.id18.1" class="ltx_text ltx_font_italic">14</span></sup>UNC Chapel Hill   
<sup id="id79.77.id19" class="ltx_sup"><span id="id79.77.id19.1" class="ltx_text ltx_font_italic">15</span></sup>UC Berkeley

<br class="ltx_break"><sup id="id80.78.id20" class="ltx_sup"><span id="id80.78.id20.1" class="ltx_text ltx_font_italic">16</span></sup>MIT   
<sup id="id81.79.id21" class="ltx_sup"><span id="id81.79.id21.1" class="ltx_text ltx_font_italic">17</span></sup>Shanghai Jiaotong University   
<sup id="id82.80.id22" class="ltx_sup"><span id="id82.80.id22.1" class="ltx_text ltx_font_italic">18</span></sup>UIUC   
<sup id="id83.81.id23" class="ltx_sup"><span id="id83.81.id23.1" class="ltx_text ltx_font_italic">19</span></sup>Sea AI Lab   
<sup id="id84.82.id24" class="ltx_sup"><span id="id84.82.id24.1" class="ltx_text ltx_font_italic">20</span></sup>AWS AI Labs

<br class="ltx_break"><sup id="id85.83.id25" class="ltx_sup"><span id="id85.83.id25.1" class="ltx_text ltx_font_italic">21</span></sup>Contextual AI   
<sup id="id86.84.id26" class="ltx_sup"><span id="id86.84.id26.1" class="ltx_text ltx_font_italic">22</span></sup>Carnegie Mellon University   
<sup id="id87.85.id27" class="ltx_sup"><span id="id87.85.id27.1" class="ltx_text ltx_font_italic">23</span></sup>ServiceNow Research   
<sup id="id88.86.id28" class="ltx_sup"><span id="id88.86.id28.1" class="ltx_text ltx_font_italic">24</span></sup>Hugging Face

<br class="ltx_break">
<br class="ltx_break"><span id="id59.58.33" class="ltx_text" style="position:relative; bottom:-2.0pt;"><img src="/html/2406.15877/assets/bigcode.png" id="id59.58.33.g1" class="ltx_graphics ltx_img_square" width="14" height="14" alt="[Uncaptioned image]"></span> <a target="_blank" href="https://bigcode-bench.github.io/" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://bigcode-bench.github.io/</a>

<br class="ltx_break">
<br class="ltx_break"><span id="id89.87.id29" class="ltx_text ltx_font_typewriter">{terry.zhuo@monash.edu; contact@bigcode-project.org}
<br class="ltx_break"></span>
</span><span class="ltx_author_notes">The work does not relate to the author’s position at Amazon.</span></span>
</div>

<div class="ltx_abstract">
<h6 class="ltx_title ltx_title_abstract">Abstract</h6>
<p id="id90.id1" class="ltx_p">Automated software engineering has been greatly empowered by the recent advances in Large Language Models (LLMs) for programming. While current benchmarks have shown that LLMs can perform various software engineering tasks like human developers, the majority of their evaluations are limited to short and self-contained algorithmic tasks.
Solving challenging and practical programming tasks requires the capability of utilizing <span id="id90.id1.1" class="ltx_text ltx_font_bold ltx_font_italic">diverse function calls as tools</span> to efficiently implement functionalities like data analysis and web development.
In addition, using multiple tools to solve a task needs compositional reasoning by accurately understanding <span id="id90.id1.2" class="ltx_text ltx_font_bold ltx_font_italic">complex instructions</span>. Fulfilling both of these characteristics can pose a great challenge for LLMs.
To assess how well LLMs can solve challenging and practical programming tasks, we introduce <span id="id90.id1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, a benchmark that challenges LLMs to invoke multiple function calls as tools from 139 libraries and 7 domains for 1,140 fine-grained programming tasks.
To evaluate LLMs rigorously, each programming task encompasses 5.6 test cases with an average branch coverage of 99%.
In addition, we propose a natural-language-oriented variant of <span id="id90.id1.4" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, <span id="id90.id1.5" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="id90.id1.6" class="ltx_text ltx_font_typewriter">Instruct</span>, that automatically transforms the original docstrings into short instructions only with essential information. Our extensive evaluation of 60 LLMs shows that <span id="id90.id1.7" class="ltx_text ltx_font_bold ltx_font_italic">LLMs are not yet capable of following complex instructions to use function calls precisely, with scores up to 60%, significantly lower than the human performance of 97%</span>. The results underscore the need for further advancements in this area.</p>
</div>
<div id="p2" class="ltx_para">
<span id="p2.1" class="ltx_ERROR undefined">\doparttoc</span><span id="p2.2" class="ltx_ERROR undefined">\faketableofcontents</span>
</div>
<figure id="S0.F1" class="ltx_figure"><img src="/html/2406.15877/assets/x1.png" id="S0.F1.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="154" alt="Refer to caption">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 1: </span>Programming tasks in <span id="S0.F1.2.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> are structured with complex instructions in the docstrings, annotated by experts. The behavior of the solution is evaluated against a class of rigorous test cases with the proper environment setup.</figcaption>
</figure>
<section id="S1" class="ltx_section">
<h3 class="ltx_title ltx_title_section">
<span class="ltx_tag ltx_tag_section">1 </span>Introduction</h3>

<div id="S1.p1" class="ltx_para ltx_noindent">
<p id="S1.p1.1" class="ltx_p">Automated software engineering, like code generation and repair <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib19" title="" class="ltx_ref">19</a>, <a href="#bib.bib24" title="" class="ltx_ref">24</a>, <a href="#bib.bib72" title="" class="ltx_ref">72</a>]</cite>, has attracted significant interest from academia and industry to facilitate the development of advanced models. With recent advances in data-centric deep learning techniques, large language models (LLMs) trained on large-scale corpora have shown superior capabilities of generating syntactically correct and functional programs.
However, widely-used benchmarks like HumanEval <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib14" title="" class="ltx_ref">14</a>]</cite> and MBPP <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib9" title="" class="ltx_ref">9</a>]</cite> only contain short, self-contained, and algorithm-focused programming tasks and have been saturated by recent model releases.
In this work, we aim to close the evaluation gap between these isolated coding exercises and realistic software engineering problems, asking <em id="S1.p1.1.1" class="ltx_emph ltx_font_bold ltx_font_italic">Can LLMs solve more challenging and more practical programming tasks?</em></p>
</div>
<div id="S1.p2" class="ltx_para ltx_noindent">
<p id="S1.p2.1" class="ltx_p"><span id="S1.p2.1.1" class="ltx_text ltx_font_italic">Solving programming tasks</span> in real-world scenarios typically has two main characteristics: (1) <em id="S1.p2.1.2" class="ltx_emph ltx_font_bold ltx_font_italic">Diverse Function Calls as Tools</em>.<span id="footnote1" class="ltx_note ltx_role_footnote"><sup class="ltx_note_mark">1</sup><span class="ltx_note_outer"><span class="ltx_note_content"><sup class="ltx_note_mark">1</sup><span class="ltx_tag ltx_tag_note">1</span>In this work, we refer to “tools” as library-oriented but non-object-oriented Code Function Call APIs, which are discussed in <a target="_blank" href="https://gorilla.cs.berkeley.edu/blogs/4_open_functions.html" title="" class="ltx_ref ltx_href ltx_font_typewriter">Gorilla OpenFunctions</a> The Code Function Calling APIs are typically seen in common external Python packages like Numpy, Sklearn, and Pandas.</span></span></span>
A complex programming task often requires the invocation of diverse function call sequences as tools <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib51" title="" class="ltx_ref">51</a>, <a href="#bib.bib25" title="" class="ltx_ref">25</a>, <a href="#bib.bib50" title="" class="ltx_ref">50</a>]</cite>.
To avoid reinventing the wheel, domain-specific libraries are designed to cover function calls (or APIs) with comprehensive functionalities; and
(2) <em id="S1.p2.1.3" class="ltx_emph ltx_font_bold ltx_font_italic">Complex Instructions</em>. Due to the complexity of software development, instructions may require compositional reasoning ability to perform a sequence of functionalities in the correct order (e.g., input data manipulation, error message handling, and specific output formatting) <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib60" title="" class="ltx_ref">60</a>, <a href="#bib.bib46" title="" class="ltx_ref">46</a>, <a href="#bib.bib48" title="" class="ltx_ref">48</a>]</cite>. For instance, creating a network application that includes functionality for retrieving responses from an HTTPS server (<a href="#S0.F1" title="Figure 1 ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 1</span></a>) requires integrating several components with multiple function calls, such as managing SSL contexts, handling socket connections, and ensuring the response is returned in the specific format.</p>
</div>
<div id="S1.p3" class="ltx_para ltx_noindent">
<p id="S1.p3.1" class="ltx_p">Building a high-quality execution-based benchmark that simulates aforementioned programming tasks with practical and challenging constraints is non-trivial.
First, it is hard to naturally source self-contained programming tasks with complex instructions, unlike the short code exercises in HumanEval.
Although most GitHub repositories contain realistic source code, the functions inside these repositories often require cross-file information <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib18" title="" class="ltx_ref">18</a>]</cite>.
Second, real-world programming scenarios are extremely diverse <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib71" title="" class="ltx_ref">71</a>]</cite>. Existing benchmarks <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib68" title="" class="ltx_ref">68</a>, <a href="#bib.bib32" title="" class="ltx_ref">32</a>]</cite> only focus on popular scenarios like data science.
Third, mainstream programming benchmarks have a significant number of ambiguous or under-specified specifications, resulting in inaccurate evaluation results <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib54" title="" class="ltx_ref">54</a>, <a href="#bib.bib27" title="" class="ltx_ref">27</a>]</cite>. While there have been attempts to improve the data quality with LLMs <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib28" title="" class="ltx_ref">28</a>]</cite>, LLMs have their own bias and cannot reliably perform refinement <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib70" title="" class="ltx_ref">70</a>]</cite>.</p>
</div>
<div id="S1.p4" class="ltx_para ltx_noindent">
<p id="S1.p4.1" class="ltx_p">To construct massive high-quality programming tasks, we propose a novel framework (<a href="#S2.F2" title="Figure 2 ‣ 2 Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 2</span></a>) that uses collaboration between LLMs and human experts to build a rigorous execution-based benchmark, <span id="S1.p4.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>. Particularly, we utilize LLMs to source programming tasks, refactor programs, and add test cases, under constant human supervision.
Our benchmark contains 1,140 rich-context and multi-tool-use programming tasks, covering 723 function calls from 139 popular libraries across 7 domains.
As we aim to let models reason any suitable function calls to complete the tasks, we design the test cases in an open-ended manner and examine certain behaviors based on different inputs <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib27" title="" class="ltx_ref">27</a>]</cite>. We assess two common programming scenarios: (1) Code Completion (<span id="S1.p4.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S1.p4.1.3" class="ltx_text ltx_font_typewriter">Complete</span>), which evaluates the capability of code generation based on the structured docstrings; and (2) Instruction to Code (<span id="S1.p4.1.4" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S1.p4.1.5" class="ltx_text ltx_font_typewriter">Instruct</span>), which evaluates the ability to complete programming tasks based on natural-language-oriented (NL-oriented) instructions. While <span id="S1.p4.1.6" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S1.p4.1.7" class="ltx_text ltx_font_typewriter">Complete</span> emphasizes structured docstring prompts, <span id="S1.p4.1.8" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S1.p4.1.9" class="ltx_text ltx_font_typewriter">Instruct</span> challenges LLMs to generate precise code without relying on non-essential details like <a target="_blank" href="https://docs.python.org/3/library/doctest.html" title="" class="ltx_ref ltx_href">interactive Python examples</a>.</p>
</div>
<div id="S1.p5" class="ltx_para ltx_noindent">
<p id="S1.p5.1" class="ltx_p">Through extensive studies on 60 models, we find that LLMs still struggle to invoke multiple function calls from cross-domain libraries and follow complex instructions to solve programming tasks. Specifically, the best performing LLM, GPT-4o, solves merely 60% of tasks on <span id="S1.p5.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S1.p5.1.2" class="ltx_text ltx_font_typewriter">Complete</span> and less than 50% on <span id="S1.p5.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S1.p5.1.4" class="ltx_text ltx_font_typewriter">Instruct</span>, indicating that LLMs themselves lack the ability to align with human expectations when instructions are more natural. Interestingly, we find that some instruction-tuned LLMs like GPT-4 constantly refuse to follow long instructions to repeat essential context and thus fail the test cases.
Furthermore, LLMs perform differently when using domain-specific function calls as tools.
We also demonstrate the strongly positive correlations between mainstream benchmarks and <span id="S1.p5.1.5" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, validating our evaluation results.</p>
</div>
</section>
<section id="S2" class="ltx_section">
<h3 class="ltx_title ltx_title_section">
<span class="ltx_tag ltx_tag_section">2 </span>Benchmark Construction</h3>

<div id="S2.p1" class="ltx_para ltx_noindent">
<p id="S2.p1.1" class="ltx_p">In this section, we introduce our human-LLM-collaboration framework for the <span id="S2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> construction. As shown in <a href="#S2.F2" title="Figure 2 ‣ 2 Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 2</span></a>, the process of <span id="S2.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S2.p1.1.3" class="ltx_text ltx_font_typewriter">Complete</span> encompasses three stages: Data Synthesis, Semi-automatic Program Refactoring and Testing Case Generation, and Human Curation. In addition, we construct <span id="S2.p1.1.4" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S2.p1.1.5" class="ltx_text ltx_font_typewriter">Instruct</span> in <a href="#S2.SS4" title="2.4 Benchmarking NL-oriented Instructions to Code Generation ‣ 2 Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Section 2.4</span></a>, an NL-oriented benchmark for programming-task solving. Further information is available in <a href="#A2" title="Appendix B Datacard ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix B</span></a> and <a href="#A7" title="Appendix G Detailed Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix G</span></a>. The construction is progressively contributed by 20 authors as annotators for one year in total, with 75% of them having more than 5 years of experience in Python programming. The progress is continually managed by the lead annotator to control the data quality. Each constructed programming task is expected to: (1) have clear instructions inside <a target="_blank" href="https://peps.python.org/pep-0257/" title="" class="ltx_ref ltx_href">PEP-257</a>-structured docstrings; (2) use multiple libraries as tools to solve the problem; and (3) be paired with at least five test cases encapsulated in the <a target="_blank" href="https://docs.python.org/3/library/unittest.html" title="" class="ltx_ref ltx_href ltx_font_typewriter">unittest</a> framework, with a complex test setup (e.g., database connection, and directory creation), to verify program behaviors instead of relying on simple input-output assertions.</p>
</div>
<figure id="S2.F2" class="ltx_figure"><img src="/html/2406.15877/assets/x2.png" id="S2.F2.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="123" alt="Refer to caption">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 2: </span>Each programming task in <span id="S2.F2.2.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> is created through a three-stage construction process. The task quality is controlled by the human-LLM collaboration.
</figcaption>
</figure>
<section id="S2.SS1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">2.1 </span>Data Synthesis</h4>

<div id="S2.SS1.p1" class="ltx_para ltx_noindent">
<p id="S2.SS1.p1.1" class="ltx_p">One intuitive method would be to rely on source code repositories to construct the function-level programming tasks. However, most repository-level functions require cross-file information, such as customized modules <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib18" title="" class="ltx_ref">18</a>]</cite>, which are hard to self-contain and document. We argue that leveraging LLMs to synthesize customized programming tasks can be more viable <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib59" title="" class="ltx_ref">59</a>, <a href="#bib.bib38" title="" class="ltx_ref">38</a>]</cite>, especially when overseen by humans.
Given a code snippet of API usage with a brief human instruction as the seed example (<a href="#S2.F2" title="Figure 2 ‣ 2 Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 2</span></a>), an LLM is instructed to enrich the programming intent and refine the corresponding implementation by using diverse libraries. Specifically, we use seed examples from ODEX <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib58" title="" class="ltx_ref">58</a>]</cite>, a benchmark containing intent-paired code skeletons from Stack Overflow. We use the GPT-4 API,<span id="footnote2" class="ltx_note ltx_role_footnote"><sup class="ltx_note_mark">2</sup><span class="ltx_note_outer"><span class="ltx_note_content"><sup class="ltx_note_mark">2</sup><span class="ltx_tag ltx_tag_note">2</span>We use the model version <span id="footnote2.1" class="ltx_text ltx_font_typewriter">gpt-4-0613</span>.</span></span></span> the strongest LLM at the time of data sourcing, to synthesize the programming tasks. To help the LLM synthesize self-contained and relevant programming tasks based on the seed example, we instruct the model with a 2-shot in-context demonstration (<a href="#A7.SS1" title="G.1 Data Synthesis Prompt ‣ Appendix G Detailed Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref">Appendix <span class="ltx_ref ltx_nolink"><span class="ltx_text ltx_ref_tag">G.1</span></span></a>) crafted by the lead annotator.</p>
</div>
<div id="S2.SS1.p2" class="ltx_para ltx_noindent">
<p id="S2.SS1.p2.1" class="ltx_p">As previous studies have shown that LLMs favor their own generations <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib70" title="" class="ltx_ref">70</a>, <a href="#bib.bib47" title="" class="ltx_ref">47</a>]</cite>, such phenomena can make the model evaluation unfair.
We mitigate the model biases with an obfuscation and perturbation process. We first replace the semantic-rich program entry points with dummy function names. In addition, we perturb the natural language descriptions in docstrings with the back-translation method of NL-Augmenter <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib17" title="" class="ltx_ref">17</a>]</cite>, inspired by ReCode <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib57" title="" class="ltx_ref">57</a>]</cite>. After validating the post-processed programs with an abstract syntax tree parser, we collected 4,718 function-level programming samples.</p>
</div>
</section>
<section id="S2.SS2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">2.2 </span>Semi-automatic Program Refactoring and Testing Case Generation</h4>

<div id="S2.SS2.p1" class="ltx_para ltx_noindent">
<p id="S2.SS2.p1.1" class="ltx_p">Programs synthesized by LLMs may contain various issues, such as undeclared variables and runtime bugs. Without proper verification, the implementation cannot directly serve as a ground-truth solution. To construct a high-quality execution-based benchmark, we need to add test cases that can rigorously verify the correctness of programs and identify any bugs.
However, it takes non-trivial effort for human developers to understand synthesized programs and properly refactor them with thorough testing. To improve the program quality and ease human annotation, we propose a conversion-driven framework for program refactoring and test case generations inspired by <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib62" title="" class="ltx_ref">62</a>]</cite>. Specifically, we utilize the <a target="_blank" href="https://openai.com/index/chatgpt-plugins/" title="" class="ltx_ref ltx_href">Code Interpreter</a> session in the web-based GPT-4, which is back-ended by a Linux-based virtual environment with pre-installed Python packages. We engage 13 authors as human annotators (including the lead annotator) for this step, assigning each annotator 100 randomly sampled programming tasks based on their preferences of code topics (<a href="#A7.SS2.SSS1" title="G.2.1 Programming Task Classification Prompt ‣ G.2 Semi-automatic Program Refactoring and Testing Case Generation ‣ Appendix G Detailed Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref">Appendix <span class="ltx_ref ltx_nolink"><span class="ltx_text ltx_ref_tag">G.2.1</span></span></a>). We detail the design of this human-in-the-loop framework from human and LLM aspects as follows:</p>
</div>
<section id="S2.SS2.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Human Aspect</h6>

<div id="S2.SS2.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="S2.SS2.SSS0.Px1.p1.1" class="ltx_p">Human developers possess varying preferences and levels of familiarity with specific data types and programming scenarios. To aid human annotators in providing more precise feedback for refining programs with GPT-4, we have defined 10 data types (e.g., SQL, CSV, and Python built-in types) and task scenarios (e.g., data analysis, networking, and visualization). GPT-4 API is utilized to automatically classify each program according to these categories, with detailed descriptions available in <a href="#A7.SS2.SSS1" title="G.2.1 Programming Task Classification Prompt ‣ G.2 Semi-automatic Program Refactoring and Testing Case Generation ‣ Appendix G Detailed Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref">Appendix <span class="ltx_ref ltx_nolink"><span class="ltx_text ltx_ref_tag">G.2.1</span></span></a>. The annotators’ role is to continually instruct GPT-4 to refractor the programs and to provide continuous feedback to guide the model whenever it fails to self-debug or incorrectly refactor the program.</p>
</div>
</section>
<section id="S2.SS2.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">LLM Aspect</h6>

<div id="S2.SS2.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="S2.SS2.SSS0.Px2.p1.1" class="ltx_p">To effectively guide GPT-4 in the iterative refinement of programs and test cases, we provide detailed annotation guidelines in <a href="#A7.SS2.SSS2" title="G.2.2 Guidelines ‣ G.2 Semi-automatic Program Refactoring and Testing Case Generation ‣ Appendix G Detailed Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref">Appendix <span class="ltx_ref ltx_nolink"><span class="ltx_text ltx_ref_tag">G.2.2</span></span></a> as an initial prompt. These guidelines encompass two high-level instructions: (1) Refine the function, including its docstrings, to enhance realism and reduce ambiguity; and (2) Write unit tests to ensure the functional correctness of the given program description. Specifically, the model is taught to follow a step-by-step refinement process: (1) Remove unused libraries and add necessary libraries if they are missing in the code snippet; (2) Reformat docstrings to adhere to <a target="_blank" href="https://peps.python.org/pep-0257/" title="" class="ltx_ref ltx_href">PEP-257</a> conventions; (3) Align program implementations with the instructions inside docstrings; (4) Write and execute unit tests to ensure they pass; and (5) Add refined programs and test cases to files for downloading.</p>
</div>
<div id="S2.SS2.SSS0.Px2.p2" class="ltx_para ltx_noindent">
<p id="S2.SS2.SSS0.Px2.p2.1" class="ltx_p">During interactions with GPT-4, we identify two main drawbacks in the Code Interpreter session. First, GPT-4 struggles to write proper test cases when mocking tests are employed. While the model can generate high-level designs of mocking tests, it often fails to understand how test cases should be constructed based on execution feedback. Second, GPT-4 can become stuck while resolving runtime bugs, leading to iterative refinement until the session times out. Continuous human feedback on viable solutions is essential to address these issues and ensure the model stays on track.</p>
</div>
<div id="S2.SS2.SSS0.Px2.p3" class="ltx_para ltx_noindent">
<p id="S2.SS2.SSS0.Px2.p3.1" class="ltx_p">During the post-processing of the annotated data, we observe that a significant number of test cases were incomplete. This issue arises because GPT-4 often omits partial content when writing long contexts into files. After removing all invalid programs via program analysis, we end up with 1,223 refactored programming tasks with paired test cases.</p>
</div>
</section>
</section>
<section id="S2.SS3" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">2.3 </span>Human Curation</h4>

<div id="S2.SS3.p1" class="ltx_para ltx_noindent">
<p id="S2.SS3.p1.1" class="ltx_p">To enhance the benchmark quality, we implement a three-fold human curation process:</p>
</div>
<section id="S2.SS3.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Examination</h6>

<div id="S2.SS3.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="S2.SS3.SSS0.Px1.p1.1" class="ltx_p">We first perform a rigorous manual examination of the benchmarks, guided by a set of detailed guidelines (<a href="#A7.SS3" title="G.3 Human Curation Guidelines ‣ Appendix G Detailed Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref">Appendix <span class="ltx_ref ltx_nolink"><span class="ltx_text ltx_ref_tag">G.3</span></span></a>) to add more test cases and resolve a list of runtime issues due to the LLM-generated flaky tests <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib37" title="" class="ltx_ref">37</a>]</cite>. In addition, we aim to formalize further the programming tasks based on the following criteria: (1) The task should utilize at least two libraries to enrich the task scopes; (2) Import statements should be limited to those used in the task implementations and be natural based on human understanding; (3) The docstring should follow PEP-257 to ensure consistent styles; (4) Both the task implementation and test cases should be clearly aligned with the task docstrings, based on human understanding; and (5) Required library modules in the docstrings should be aligned with the import statements.
For test case construction, the criteria are as follows: (1) Test cases should be encapsulated by the <a target="_blank" href="https://docs.python.org/3/library/unittest.html" title="" class="ltx_ref ltx_href ltx_font_typewriter">unittest</a> framework, making them <a target="_blank" href="https://docs.pytest.org/en/stable/" title="" class="ltx_ref ltx_href ltx_font_typewriter">pytest</a>-compatible; and (2) Test cases need to be deterministic, asserting expected program behaviors based on the inputs <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib27" title="" class="ltx_ref">27</a>]</cite>.</p>
</div>
</section>
<section id="S2.SS3.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Pre-Evaluation</h6>

<div id="S2.SS3.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="S2.SS3.SSS0.Px2.p1.1" class="ltx_p">To enhance the benchmark quality, we perform a dry run to pre-evaluate an LLM other than GPT-4 used in previous steps. We choose GPT-3.5-Turbo API<span id="footnote3" class="ltx_note ltx_role_footnote"><sup class="ltx_note_mark">3</sup><span class="ltx_note_outer"><span class="ltx_note_content"><sup class="ltx_note_mark">3</sup><span class="ltx_tag ltx_tag_note">3</span>We use model version <span id="footnote3.1" class="ltx_text ltx_font_typewriter">gpt-3.5-turbo-1106</span>.</span></span></span> to generate solutions based on the examined task prompts. By understanding how the model fails on the tasks, annotators may add essential details to the docstrings to clarify the task instructions but avoid describing step-by-step implementations.</p>
</div>
</section>
<section id="S2.SS3.SSS0.Px3" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Cross-Checking</h6>

<div id="S2.SS3.SSS0.Px3.p1" class="ltx_para ltx_noindent">
<p id="S2.SS3.SSS0.Px3.p1.1" class="ltx_p">To further validate data quality and ensure consistency across all programming tasks in the testing environment, 7 additional annotators refine and finalize the data annotated by others. This round focuses on the utility of docstrings and test cases. We automatically parse the docstrings and ask annotators to manually correct the docstring structures, specifically addressing task descriptions, function parameters, expected returns, exception handling, required modules, and interactive examples. Additionally, we remove unused imported modules via program analysis. For the interactive examples, we ensure their correctness via <a target="_blank" href="https://docs.python.org/3/library/doctest.html" title="" class="ltx_ref ltx_href ltx_font_typewriter">doctest</a>, except for those requiring system and network access.
The confirmed programming tasks are finally validated by the automated test workflows in <a target="_blank" href="https://github.com/features/packages" title="" class="ltx_ref ltx_href">GitHub Container Registry</a>, where the test cases are automatically run against the task implementations in a configured sandbox environment. To ensure the finalized data quality, we randomly assign 33 finalized task prompts to the 11 annotators (the lead annotator was excluded; one annotator was unavailable at the time), to write the solutions. The lead annotator conducts the evaluation of the solutions, finding that 97% (32 out of 33) of sampled tasks can pass all test cases.</p>
</div>
<figure id="S2.F3" class="ltx_figure"><img src="/html/2406.15877/assets/x3.png" id="S2.F3.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="346" height="159" alt="Refer to caption">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 3: </span>Each task prompt in <span id="S2.F3.5.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S2.F3.6.2" class="ltx_text ltx_font_typewriter">Instruct</span> are transformed from <span id="S2.F3.7.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S2.F3.8.4" class="ltx_text ltx_font_typewriter">Complete</span> via the pre-defined rules. We omit non-essential details during the transformation.</figcaption>
</figure>
</section>
</section>
<section id="S2.SS4" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">2.4 </span>Benchmarking NL-oriented Instructions to Code Generation</h4>

<div id="S2.SS4.p1" class="ltx_para ltx_noindent">
<p id="S2.SS4.p1.1" class="ltx_p">When instruction tuning LLMs using NL data, the input is mainly an NL instruction, and the target output is the NL or source code for completion <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib40" title="" class="ltx_ref">40</a>]</cite>. This training objective aligns with the downstream applications such as multi-turn dialogue, where users ask questions or provide task-specific instructions to the models. While existing programming benchmarks commonly format the verbose instructions in docstrings <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib14" title="" class="ltx_ref">14</a>]</cite>, users may instruct the models to generate code samples with the less verbose NL context. Despite that there have been similar attempts like HumanEvalPack <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib40" title="" class="ltx_ref">40</a>]</cite> addressing this limitation, their inputs still lack some naturalness. Generally, users tend to describe the high-level idea of functionalities and avoid redundant information (e.g., parameters) or too-specific details (e.g., interactive examples). Thus, we create <span id="S2.SS4.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S2.SS4.p1.1.2" class="ltx_text ltx_font_typewriter">Instruct</span>, a benchmark variant that prompts LLMs to solve programming tasks with more NL-oriented instructions, assessing the model’s ability to understand human requirements correctly.
Based on the task prompts created in <span id="S2.SS4.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S2.SS4.p1.1.4" class="ltx_text ltx_font_typewriter">Complete</span>, we design a set of parsing rules and transform them into more natural instructions (<a href="#S2.F3" title="Figure 3 ‣ Cross-Checking ‣ 2.3 Human Curation ‣ 2 Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 3</span></a>). For quality control, 5 authors who do not participate in previous stages inspect the randomly sampled prompts and their corresponding ground-truth solutions and reach an agreement on the alignment between the instruction prompts and task implementations.</p>
</div>
</section>
</section>
<section id="S3" class="ltx_section">
<h3 class="ltx_title ltx_title_section">
<span class="ltx_tag ltx_tag_section">3 </span>Benchmark Statistics</h3>

<figure id="S3.F4" class="ltx_figure"><img src="/html/2406.15877/assets/x4.png" id="S3.F4.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="268" alt="Refer to caption">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 4: </span>Examples of tools in <span id="S3.F4.3.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> are illustrated. Each function call belongs to a domain-specific library. The distribution of each domain is computed based on the frequency of domain-specific libraries appearing per task. For example, “63%” in “Computation” means that there are 63% tasks in <span id="S3.F4.4.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span> using at least one computation library.</figcaption>
</figure>
<figure id="S3.T1" class="ltx_table">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_table">Table 1: </span>Summarized statistics of representative function-level Python programming benchmarks
, partially inspired by <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib69" title="" class="ltx_ref">69</a>]</cite>.
<span id="S3.T1.10.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> are more complex regarding the depth of task complexity and breadth of tool-use knowledge.
<span id="S3.T1.11.2" class="ltx_text ltx_font_bold">PL.</span>: Programming Language. <span id="S3.T1.12.3" class="ltx_text ltx_font_bold">Cov.</span>: Branch Coverage. <span id="S3.T1.13.4" class="ltx_text ltx_font_bold">Char.</span>: Characters. <span id="S3.T1.14.5" class="ltx_text ltx_font_bold">C.C.</span>: Cyclomatic Complexity (starting from 0, higher values indicate more complex code).
<span id="S3.T1.15.6" class="ltx_text ltx_font_bold">Lib.</span>: Library. <span id="S3.T1.16.7" class="ltx_text ltx_font_bold">Dom.</span>: Domain. <span id="S3.T1.17.8" class="ltx_text ltx_font_bold">Std.</span>: <a target="_blank" href="https://docs.python.org/3/library/index.html" title="" class="ltx_ref ltx_href">Python Standard Library</a>. <span id="S3.T1.18.9" class="ltx_text ltx_font_bold">Ext.</span>: <a target="_blank" href="https://pypi.org/" title="" class="ltx_ref ltx_href">Python External Library</a>.</figcaption>
<div id="S3.T1.19" class="ltx_inline-block ltx_align_center ltx_transformed_outer" style="width:433.6pt;height:222.2pt;vertical-align:-0.0pt;"><span class="ltx_transformed_inner" style="transform:translate(-81.8pt,41.9pt) scale(0.726064105873443,0.726064105873443) ;">
<table id="S3.T1.19.1" class="ltx_tabular ltx_align_middle">
<tr id="S3.T1.19.1.1" class="ltx_tr">
<td id="S3.T1.19.1.1.1" class="ltx_td ltx_align_center ltx_border_tt" colspan="9"><span id="S3.T1.19.1.1.1.1" class="ltx_text ltx_font_bold">Overall Statistics</span></td>
</tr>
<tr id="S3.T1.19.1.2" class="ltx_tr">
<td id="S3.T1.19.1.2.1" class="ltx_td ltx_align_left ltx_border_tt" rowspan="2"><span id="S3.T1.19.1.2.1.1" class="ltx_text ltx_font_bold">Benchmark</span></td>
<td id="S3.T1.19.1.2.2" class="ltx_td ltx_align_center ltx_border_tt" rowspan="2"><span id="S3.T1.19.1.2.2.1" class="ltx_text ltx_font_bold"># Task</span></td>
<td id="S3.T1.19.1.2.3" class="ltx_td ltx_align_center ltx_border_tt" colspan="2">
<span id="S3.T1.19.1.2.3.1" class="ltx_text ltx_font_bold">Test</span> (Avg.)</td>
<td id="S3.T1.19.1.2.4" class="ltx_td ltx_align_center ltx_border_tt" colspan="2">
<span id="S3.T1.19.1.2.4.1" class="ltx_text ltx_font_bold">Prompt</span> (Avg.)</td>
<td id="S3.T1.19.1.2.5" class="ltx_td ltx_align_center ltx_border_tt" colspan="3">
<span id="S3.T1.19.1.2.5.1" class="ltx_text ltx_font_bold">Solution</span> (Avg.)</td>
</tr>
<tr id="S3.T1.19.1.3" class="ltx_tr">
<td id="S3.T1.19.1.3.1" class="ltx_td ltx_align_center ltx_border_t">#</td>
<td id="S3.T1.19.1.3.2" class="ltx_td ltx_align_center ltx_border_t">Cov.</td>
<td id="S3.T1.19.1.3.3" class="ltx_td ltx_align_center ltx_border_t">Char. (Code)</td>
<td id="S3.T1.19.1.3.4" class="ltx_td ltx_align_center ltx_border_t">Line</td>
<td id="S3.T1.19.1.3.5" class="ltx_td ltx_align_center ltx_border_t">Char.</td>
<td id="S3.T1.19.1.3.6" class="ltx_td ltx_align_center ltx_border_t">Line</td>
<td id="S3.T1.19.1.3.7" class="ltx_td ltx_align_center ltx_border_t">C.C.</td>
</tr>
<tr id="S3.T1.19.1.4" class="ltx_tr">
<td id="S3.T1.19.1.4.1" class="ltx_td ltx_align_left ltx_border_t">HumanEval</td>
<td id="S3.T1.19.1.4.2" class="ltx_td ltx_align_center ltx_border_t">164</td>
<td id="S3.T1.19.1.4.3" class="ltx_td ltx_align_center ltx_border_t">7.8</td>
<td id="S3.T1.19.1.4.4" class="ltx_td ltx_align_center ltx_border_t">98%</td>
<td id="S3.T1.19.1.4.5" class="ltx_td ltx_align_center ltx_border_t">450.6 (450.6)</td>
<td id="S3.T1.19.1.4.6" class="ltx_td ltx_align_center ltx_border_t">13.7</td>
<td id="S3.T1.19.1.4.7" class="ltx_td ltx_align_center ltx_border_t">180.9</td>
<td id="S3.T1.19.1.4.8" class="ltx_td ltx_align_center ltx_border_t">6.8</td>
<td id="S3.T1.19.1.4.9" class="ltx_td ltx_align_center ltx_border_t">3.6</td>
</tr>
<tr id="S3.T1.19.1.5" class="ltx_tr">
<td id="S3.T1.19.1.5.1" class="ltx_td ltx_align_left">DS-1000</td>
<td id="S3.T1.19.1.5.2" class="ltx_td ltx_align_center">1,000</td>
<td id="S3.T1.19.1.5.3" class="ltx_td ltx_align_center">1.6</td>
<td id="S3.T1.19.1.5.4" class="ltx_td ltx_align_center">98%</td>
<td id="S3.T1.19.1.5.5" class="ltx_td ltx_align_center">871.8 (193.9)</td>
<td id="S3.T1.19.1.5.6" class="ltx_td ltx_align_center">29.1</td>
<td id="S3.T1.19.1.5.7" class="ltx_td ltx_align_center">138.1</td>
<td id="S3.T1.19.1.5.8" class="ltx_td ltx_align_center">5.1</td>
<td id="S3.T1.19.1.5.9" class="ltx_td ltx_align_center">1.6</td>
</tr>
<tr id="S3.T1.19.1.6" class="ltx_tr">
<td id="S3.T1.19.1.6.1" class="ltx_td ltx_align_left">DS-1000 (Orig.)</td>
<td id="S3.T1.19.1.6.2" class="ltx_td ltx_align_center">452</td>
<td id="S3.T1.19.1.6.3" class="ltx_td ltx_align_center">1.5</td>
<td id="S3.T1.19.1.6.4" class="ltx_td ltx_align_center">98%</td>
<td id="S3.T1.19.1.6.5" class="ltx_td ltx_align_center">831.4 (201.2)</td>
<td id="S3.T1.19.1.6.6" class="ltx_td ltx_align_center">26.2</td>
<td id="S3.T1.19.1.6.7" class="ltx_td ltx_align_center">115.5</td>
<td id="S3.T1.19.1.6.8" class="ltx_td ltx_align_center">4.2</td>
<td id="S3.T1.19.1.6.9" class="ltx_td ltx_align_center">1.4</td>
</tr>
<tr id="S3.T1.19.1.7" class="ltx_tr">
<td id="S3.T1.19.1.7.1" class="ltx_td ltx_align_left">ODEX</td>
<td id="S3.T1.19.1.7.2" class="ltx_td ltx_align_center">945</td>
<td id="S3.T1.19.1.7.3" class="ltx_td ltx_align_center">1.8</td>
<td id="S3.T1.19.1.7.4" class="ltx_td ltx_align_center">96%</td>
<td id="S3.T1.19.1.7.5" class="ltx_td ltx_align_center">87.5 (87.5)</td>
<td id="S3.T1.19.1.7.6" class="ltx_td ltx_align_center">1.0</td>
<td id="S3.T1.19.1.7.7" class="ltx_td ltx_align_center">50.4</td>
<td id="S3.T1.19.1.7.8" class="ltx_td ltx_align_center">1.9</td>
<td id="S3.T1.19.1.7.9" class="ltx_td ltx_align_center">1.4</td>
</tr>
<tr id="S3.T1.19.1.8" class="ltx_tr">
<td id="S3.T1.19.1.8.1" class="ltx_td ltx_align_left ltx_border_t">
<span id="S3.T1.19.1.8.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S3.T1.19.1.8.1.2" class="ltx_text ltx_font_typewriter">Complete</span>
</td>
<td id="S3.T1.19.1.8.2" class="ltx_td ltx_align_center ltx_border_t" rowspan="2"><span id="S3.T1.19.1.8.2.1" class="ltx_text">1,140</span></td>
<td id="S3.T1.19.1.8.3" class="ltx_td ltx_align_center ltx_border_t" rowspan="2"><span id="S3.T1.19.1.8.3.1" class="ltx_text">5.6</span></td>
<td id="S3.T1.19.1.8.4" class="ltx_td ltx_align_center ltx_border_t" rowspan="2"><span id="S3.T1.19.1.8.4.1" class="ltx_text">99%</span></td>
<td id="S3.T1.19.1.8.5" class="ltx_td ltx_align_center ltx_border_t">1112.5 (1112.5)</td>
<td id="S3.T1.19.1.8.6" class="ltx_td ltx_align_center ltx_border_t">33.5</td>
<td id="S3.T1.19.1.8.7" class="ltx_td ltx_align_center ltx_border_t" rowspan="2"><span id="S3.T1.19.1.8.7.1" class="ltx_text">426.0</span></td>
<td id="S3.T1.19.1.8.8" class="ltx_td ltx_align_center ltx_border_t" rowspan="2"><span id="S3.T1.19.1.8.8.1" class="ltx_text">10.0</span></td>
<td id="S3.T1.19.1.8.9" class="ltx_td ltx_align_center ltx_border_t" rowspan="2"><span id="S3.T1.19.1.8.9.1" class="ltx_text">3.1</span></td>
</tr>
<tr id="S3.T1.19.1.9" class="ltx_tr">
<td id="S3.T1.19.1.9.1" class="ltx_td ltx_align_left">
<span id="S3.T1.19.1.9.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S3.T1.19.1.9.1.2" class="ltx_text ltx_font_typewriter">Instruct</span>
</td>
<td id="S3.T1.19.1.9.2" class="ltx_td ltx_align_center">663.2 (124.0)</td>
<td id="S3.T1.19.1.9.3" class="ltx_td ltx_align_center">11.7</td>
</tr>
<tr id="S3.T1.19.1.10" class="ltx_tr">
<td id="S3.T1.19.1.10.1" class="ltx_td ltx_align_center ltx_border_tt" colspan="9"><span id="S3.T1.19.1.10.1.1" class="ltx_text ltx_font_bold">Tool Statistics</span></td>
</tr>
<tr id="S3.T1.19.1.11" class="ltx_tr">
<td id="S3.T1.19.1.11.1" class="ltx_td ltx_align_left ltx_border_tt" rowspan="2"><span id="S3.T1.19.1.11.1.1" class="ltx_text ltx_font_bold">Benchmark</span></td>
<td id="S3.T1.19.1.11.2" class="ltx_td ltx_align_center ltx_border_tt" rowspan="2"><span id="S3.T1.19.1.11.2.1" class="ltx_text ltx_font_bold"># Dom.</span></td>
<td id="S3.T1.19.1.11.3" class="ltx_td ltx_align_center ltx_border_tt"><span id="S3.T1.19.1.11.3.1" class="ltx_text ltx_font_bold"># Lib.</span></td>
<td id="S3.T1.19.1.11.4" class="ltx_td ltx_align_center ltx_border_tt"><span id="S3.T1.19.1.11.4.1" class="ltx_text ltx_font_bold"># Call</span></td>
<td id="S3.T1.19.1.11.5" class="ltx_td ltx_align_center ltx_border_tt" colspan="2">
<span id="S3.T1.19.1.11.5.1" class="ltx_text ltx_font_bold">Tasks</span> (Avg.)</td>
<td id="S3.T1.19.1.11.6" class="ltx_td ltx_align_center ltx_border_tt" colspan="3"><span id="S3.T1.19.1.11.6.1" class="ltx_text ltx_font_bold">Combination</span></td>
</tr>
<tr id="S3.T1.19.1.12" class="ltx_tr">
<td id="S3.T1.19.1.12.1" class="ltx_td ltx_align_center">Std. / Ext.</td>
<td id="S3.T1.19.1.12.2" class="ltx_td ltx_align_center">Std. / Ext.</td>
<td id="S3.T1.19.1.12.3" class="ltx_td ltx_align_center ltx_border_t"># Lib.</td>
<td id="S3.T1.19.1.12.4" class="ltx_td ltx_align_center ltx_border_t"># Call</td>
<td id="S3.T1.19.1.12.5" class="ltx_td ltx_align_center ltx_border_t"># Lib.</td>
<td id="S3.T1.19.1.12.6" class="ltx_td ltx_align_center ltx_border_t"># Calls</td>
<td id="S3.T1.19.1.12.7" class="ltx_td ltx_align_center ltx_border_t"># Dom.</td>
</tr>
<tr id="S3.T1.19.1.13" class="ltx_tr">
<td id="S3.T1.19.1.13.1" class="ltx_td ltx_align_left ltx_border_t">HumanEval <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib14" title="" class="ltx_ref">14</a>]</cite>
</td>
<td id="S3.T1.19.1.13.2" class="ltx_td ltx_align_center ltx_border_t">3</td>
<td id="S3.T1.19.1.13.3" class="ltx_td ltx_align_center ltx_border_t">4 / 0</td>
<td id="S3.T1.19.1.13.4" class="ltx_td ltx_align_center ltx_border_t">7 / 0</td>
<td id="S3.T1.19.1.13.5" class="ltx_td ltx_align_center ltx_border_t">0.1</td>
<td id="S3.T1.19.1.13.6" class="ltx_td ltx_align_center ltx_border_t">0.1</td>
<td id="S3.T1.19.1.13.7" class="ltx_td ltx_align_center ltx_border_t">6</td>
<td id="S3.T1.19.1.13.8" class="ltx_td ltx_align_center ltx_border_t">8</td>
<td id="S3.T1.19.1.13.9" class="ltx_td ltx_align_center ltx_border_t">5</td>
</tr>
<tr id="S3.T1.19.1.14" class="ltx_tr">
<td id="S3.T1.19.1.14.1" class="ltx_td ltx_align_left">DS-1000 <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib32" title="" class="ltx_ref">32</a>]</cite>
</td>
<td id="S3.T1.19.1.14.2" class="ltx_td ltx_align_center">4</td>
<td id="S3.T1.19.1.14.3" class="ltx_td ltx_align_center">5 / 9</td>
<td id="S3.T1.19.1.14.4" class="ltx_td ltx_align_center">7 / 321</td>
<td id="S3.T1.19.1.14.5" class="ltx_td ltx_align_center">0.8</td>
<td id="S3.T1.19.1.14.6" class="ltx_td ltx_align_center">1.1</td>
<td id="S3.T1.19.1.14.7" class="ltx_td ltx_align_center">66</td>
<td id="S3.T1.19.1.14.8" class="ltx_td ltx_align_center">331</td>
<td id="S3.T1.19.1.14.9" class="ltx_td ltx_align_center">24</td>
</tr>
<tr id="S3.T1.19.1.15" class="ltx_tr">
<td id="S3.T1.19.1.15.1" class="ltx_td ltx_align_left">DS-1000 (Orig.) <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib32" title="" class="ltx_ref">32</a>]</cite>
</td>
<td id="S3.T1.19.1.15.2" class="ltx_td ltx_align_center">4</td>
<td id="S3.T1.19.1.15.3" class="ltx_td ltx_align_center">4 / 9</td>
<td id="S3.T1.19.1.15.4" class="ltx_td ltx_align_center">5 / 289</td>
<td id="S3.T1.19.1.15.5" class="ltx_td ltx_align_center">0.9</td>
<td id="S3.T1.19.1.15.6" class="ltx_td ltx_align_center">1.3</td>
<td id="S3.T1.19.1.15.7" class="ltx_td ltx_align_center">59</td>
<td id="S3.T1.19.1.15.8" class="ltx_td ltx_align_center">260</td>
<td id="S3.T1.19.1.15.9" class="ltx_td ltx_align_center">23</td>
</tr>
<tr id="S3.T1.19.1.16" class="ltx_tr">
<td id="S3.T1.19.1.16.1" class="ltx_td ltx_align_left">ODEX <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib58" title="" class="ltx_ref">58</a>]</cite>
</td>
<td id="S3.T1.19.1.16.2" class="ltx_td ltx_align_center">7</td>
<td id="S3.T1.19.1.16.3" class="ltx_td ltx_align_center">40 / 26</td>
<td id="S3.T1.19.1.16.4" class="ltx_td ltx_align_center">128 / 102</td>
<td id="S3.T1.19.1.16.5" class="ltx_td ltx_align_center">0.6</td>
<td id="S3.T1.19.1.16.6" class="ltx_td ltx_align_center">0.5</td>
<td id="S3.T1.19.1.16.7" class="ltx_td ltx_align_center">105</td>
<td id="S3.T1.19.1.16.8" class="ltx_td ltx_align_center">202</td>
<td id="S3.T1.19.1.16.9" class="ltx_td ltx_align_center">20</td>
</tr>
<tr id="S3.T1.19.1.17" class="ltx_tr">
<td id="S3.T1.19.1.17.1" class="ltx_td ltx_align_left ltx_border_bb ltx_border_t"><span id="S3.T1.19.1.17.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span></td>
<td id="S3.T1.19.1.17.2" class="ltx_td ltx_align_center ltx_border_bb ltx_border_t">7</td>
<td id="S3.T1.19.1.17.3" class="ltx_td ltx_align_center ltx_border_bb ltx_border_t">77 / 62</td>
<td id="S3.T1.19.1.17.4" class="ltx_td ltx_align_center ltx_border_bb ltx_border_t">281 / 442</td>
<td id="S3.T1.19.1.17.5" class="ltx_td ltx_align_center ltx_border_bb ltx_border_t">2.8</td>
<td id="S3.T1.19.1.17.6" class="ltx_td ltx_align_center ltx_border_bb ltx_border_t">4.7</td>
<td id="S3.T1.19.1.17.7" class="ltx_td ltx_align_center ltx_border_bb ltx_border_t">577</td>
<td id="S3.T1.19.1.17.8" class="ltx_td ltx_align_center ltx_border_bb ltx_border_t">1045</td>
<td id="S3.T1.19.1.17.9" class="ltx_td ltx_align_center ltx_border_bb ltx_border_t">56</td>
</tr>
</table>
</span></div>
</figure>
<section id="S3.SS0.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Overall Statistics</h6>

<div id="S3.SS0.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="S3.SS0.SSS0.Px1.p1.1" class="ltx_p">The first part of <a href="#S3.T1" title="Table 1 ‣ 3 Benchmark Statistics ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Table 1</span></a> presents an overview comparison between <span id="S3.SS0.SSS0.Px1.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> and other mainstream function-level Python programming benchmarks. We note that the full DS-1000 dataset emphasizes the perturbed tasks to avoid model memorization and thus includes an original subset for reference.
Therefore, we also include statistics for non-perturbed problems (DS-1000 Orig.). As the provided statistics suggest, <span id="S3.SS0.SSS0.Px1.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span> contains much more rigorous execution-based evaluation and has longer task prompts that contain complex instructions. The ground-truth solutions are also longer than in prior benchmarks, indicating that the tasks inside <span id="S3.SS0.SSS0.Px1.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span> require more complex implementation logic. To illustrate the programming complexity, we measure cyclomatic complexity, which is the number of independent paths through the task solution. We notice that <span id="S3.SS0.SSS0.Px1.p1.1.4" class="ltx_text ltx_font_typewriter">BigCodeBench</span> has a similar complexity to HumanEval, much higher than DS-1000 and ODEX. The high cyclomatic complexity indicates that solving the tasks in <span id="S3.SS0.SSS0.Px1.p1.1.5" class="ltx_text ltx_font_typewriter">BigCodeBench</span> requires non-trivial reasoning ability from the programming perspective.</p>
</div>
<figure id="S3.F5" class="ltx_figure ltx_align_floatright">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 5: </span>Complexity - tool comparisons with various benchmarks.</figcaption><img src="/html/2406.15877/assets/x5.png" id="S3.F5.g1" class="ltx_graphics ltx_centering ltx_img_square" width="161" height="140" alt="Refer to caption">
</figure>
</section>
<section id="S3.SS0.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Tool Statistics</h6>

<div id="S3.SS0.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="S3.SS0.SSS0.Px2.p1.1" class="ltx_p">In this work, we highlight any libraries and function calls from these libraries as program-based tools for LLMs <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib50" title="" class="ltx_ref">50</a>]</cite>. Therefore, we compare the tools used among the mainstream benchmarks in the second part of <a href="#S3.T1" title="Table 1 ‣ 3 Benchmark Statistics ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Table 1</span></a>. First, <span id="S3.SS0.SSS0.Px2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> covers 281 function calls from 77 standard libraries and 442 from 62 external libraries, which is far more diverse than the other benchmarks. The examples of these tools are shown in <a href="#S3.F4" title="Figure 4 ‣ 3 Benchmark Statistics ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 4</span></a>.
Based on the <a target="_blank" href="https://pypi.org/" title="" class="ltx_ref ltx_href">PyPI</a> download statistics, the mean download counts of the recent 30 days are 56.9M+ for the 62 external libraries, suggesting their high popularity in real-world software development.
Second, <span id="S3.SS0.SSS0.Px2.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span> frequently invokes a sequence of function calls from multiple libraries to solve a single task, requiring significant compositional reasoning ability for task-solving. Third, <span id="S3.SS0.SSS0.Px2.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span> has more diverse combinations among libraries, function calls, and domains in the ground-truth solutions.
We visualize the library and function call density used by different benchmarks in <a href="#A6.SS1" title="F.1 Analysis ‣ Appendix F Tool Statistics ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref">Appendix <span class="ltx_ref ltx_nolink"><span class="ltx_text ltx_ref_tag">F.1</span></span></a>, showing the even broader tool-use diversity in <span id="S3.SS0.SSS0.Px2.p1.1.4" class="ltx_text ltx_font_typewriter">BigCodeBench</span>.
To better understand solution complexity (measured by characters) and tool-use diversity (measured by distinct function calls), we compare the tasks in BigCodeBench with those in representative benchmarks in <a href="#S3.F5" title="Figure 5 ‣ Overall Statistics ‣ 3 Benchmark Statistics ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 5</span></a> (details are provided in <a href="#A6.SS2" title="F.2 Comparison to Existing Programming Benchmarks ‣ Appendix F Tool Statistics ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref">Appendix <span class="ltx_ref ltx_nolink"><span class="ltx_text ltx_ref_tag">F.2</span></span></a>). We find that BigCodeBench requires more complex reasoning and problem-solving skills to implement comprehensive functionalities.</p>
</div>
</section>
</section>
<section id="S4" class="ltx_section">
<h3 class="ltx_title ltx_title_section">
<span class="ltx_tag ltx_tag_section">4 </span>Evaluation</h3>

<div id="S4.p1" class="ltx_para ltx_noindent">
<p id="S4.p1.4" class="ltx_p">Our evaluation uses the unbiased version of Pass@<math id="S4.p1.1.m1.1" class="ltx_Math" alttext="K" display="inline"><semantics id="S4.p1.1.m1.1a"><mi id="S4.p1.1.m1.1.1" xref="S4.p1.1.m1.1.1.cmml">K</mi><annotation-xml encoding="MathML-Content" id="S4.p1.1.m1.1b"><ci id="S4.p1.1.m1.1.1.cmml" xref="S4.p1.1.m1.1.1">𝐾</ci></annotation-xml><annotation encoding="application/x-tex" id="S4.p1.1.m1.1c">K</annotation></semantics></math> <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib14" title="" class="ltx_ref">14</a>]</cite> to accurately assess the functional correctness of generated code snippets by LLMs. To make general observations, we extensively evaluate 60 state-of-the-art LLMs on <span id="S4.p1.4.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.p1.4.2" class="ltx_text ltx_font_typewriter">Complete</span> and 35 instruction-tuned LLMs on <span id="S4.p1.4.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.p1.4.4" class="ltx_text ltx_font_typewriter">Instruct</span>. Specifically, following prior works <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib52" title="" class="ltx_ref">52</a>, <a href="#bib.bib35" title="" class="ltx_ref">35</a>, <a href="#bib.bib32" title="" class="ltx_ref">32</a>]</cite>, we report Pass@1 with greedy decoding for the main experiments in the zero-shot setting. To investigate more thoroughly, we compute Pass@1 and Pass@5 results with random sampling to generate <math id="S4.p1.2.m2.1" class="ltx_Math" alttext="N" display="inline"><semantics id="S4.p1.2.m2.1a"><mi id="S4.p1.2.m2.1.1" xref="S4.p1.2.m2.1.1.cmml">N</mi><annotation-xml encoding="MathML-Content" id="S4.p1.2.m2.1b"><ci id="S4.p1.2.m2.1.1.cmml" xref="S4.p1.2.m2.1.1">𝑁</ci></annotation-xml><annotation encoding="application/x-tex" id="S4.p1.2.m2.1c">N</annotation></semantics></math> (<math id="S4.p1.3.m3.1" class="ltx_Math" alttext="N" display="inline"><semantics id="S4.p1.3.m3.1a"><mi id="S4.p1.3.m3.1.1" xref="S4.p1.3.m3.1.1.cmml">N</mi><annotation-xml encoding="MathML-Content" id="S4.p1.3.m3.1b"><ci id="S4.p1.3.m3.1.1.cmml" xref="S4.p1.3.m3.1.1">𝑁</ci></annotation-xml><annotation encoding="application/x-tex" id="S4.p1.3.m3.1c">N</annotation></semantics></math>=5) samples with a temperature of 0.8 and top-p of 0.95 in <a href="#A9" title="Appendix I Detailed Benchmarking Results and Analysis ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix I</span></a>. While it is encouraged to generate much more (<math id="S4.p1.4.m4.1" class="ltx_Math" alttext="N\geq K" display="inline"><semantics id="S4.p1.4.m4.1a"><mrow id="S4.p1.4.m4.1.1" xref="S4.p1.4.m4.1.1.cmml"><mi id="S4.p1.4.m4.1.1.2" xref="S4.p1.4.m4.1.1.2.cmml">N</mi><mo id="S4.p1.4.m4.1.1.1" xref="S4.p1.4.m4.1.1.1.cmml">≥</mo><mi id="S4.p1.4.m4.1.1.3" xref="S4.p1.4.m4.1.1.3.cmml">K</mi></mrow><annotation-xml encoding="MathML-Content" id="S4.p1.4.m4.1b"><apply id="S4.p1.4.m4.1.1.cmml" xref="S4.p1.4.m4.1.1"><geq id="S4.p1.4.m4.1.1.1.cmml" xref="S4.p1.4.m4.1.1.1"></geq><ci id="S4.p1.4.m4.1.1.2.cmml" xref="S4.p1.4.m4.1.1.2">𝑁</ci><ci id="S4.p1.4.m4.1.1.3.cmml" xref="S4.p1.4.m4.1.1.3">𝐾</ci></apply></annotation-xml><annotation encoding="application/x-tex" id="S4.p1.4.m4.1c">N\geq K</annotation></semantics></math>) samples to avoid bias, we take the lower bound due to limited computational resources. We use the same prompts for code generation from <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib35" title="" class="ltx_ref">35</a>]</cite>, given in <a href="#A8" title="Appendix H Evaluation Setup ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix H</span></a>.</p>
</div>
<section id="S4.SS1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">4.1 </span>Measuring Task-Level Performance</h4>

<div id="S4.SS1.p1" class="ltx_para ltx_noindent">
<p id="S4.SS1.p1.1" class="ltx_p">We first evaluate the task-solving performance of each LLM and summarize the findings as follows. We show the main results in <a href="#S4.F6" title="Figure 6 ‣ 4.1 Measuring Task-Level Performance ‣ 4 Evaluation ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 6</span></a>. As models constantly omit the essential code in the generation and hence fail the tests, we calibrate the generation quality by adding the missing setup. The Pearson’s <math id="S4.SS1.p1.1.m1.1" class="ltx_Math" alttext="r" display="inline"><semantics id="S4.SS1.p1.1.m1.1a"><mi id="S4.SS1.p1.1.m1.1.1" xref="S4.SS1.p1.1.m1.1.1.cmml">r</mi><annotation-xml encoding="MathML-Content" id="S4.SS1.p1.1.m1.1b"><ci id="S4.SS1.p1.1.m1.1.1.cmml" xref="S4.SS1.p1.1.m1.1.1">𝑟</ci></annotation-xml><annotation encoding="application/x-tex" id="S4.SS1.p1.1.m1.1c">r</annotation></semantics></math> correlation between the model ranks on <span id="S4.SS1.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.p1.1.2" class="ltx_text ltx_font_typewriter">Complete</span> and <span id="S4.SS1.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.p1.1.4" class="ltx_text ltx_font_typewriter">Instruct</span> is 0.982, indicating a strong alignment. In addition, model rankings show the signs of scaling laws <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib30" title="" class="ltx_ref">30</a>]</cite>, where bigger models can solve more tasks. We also observe that there is still some performance gap between the top closed models and open ones. Detailed studies can be found in <a href="#A10" title="Appendix J Qualitative Studies ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix J</span></a>. We highlight a few findings as follows:</p>
</div>
<figure id="S4.F6" class="ltx_figure">
<div class="ltx_flex_figure">
<div class="ltx_flex_cell ltx_flex_size_1">
<div id="S4.F6.1" class="ltx_block ltx_figure_panel ltx_minipage ltx_align_center ltx_align_top" style="width:411.9pt;">
<img src="/html/2406.15877/assets/x6.png" id="S4.F6.1.g1" class="ltx_graphics ltx_img_landscape" width="461" height="255" alt="Refer to caption">
</div>
</div>
<div class="ltx_flex_break"></div>
<div class="ltx_flex_cell ltx_flex_size_1">
<div id="S4.F6.2" class="ltx_block ltx_figure_panel ltx_minipage ltx_align_center ltx_align_top" style="width:411.9pt;">
<img src="/html/2406.15877/assets/x7.png" id="S4.F6.2.g1" class="ltx_graphics ltx_img_landscape" width="461" height="258" alt="Refer to caption">
</div>
</div>
</div>
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 6: </span>Pass@1 results of instruction-tuned LLMs on <span id="S4.F6.7.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.F6.8.2" class="ltx_text ltx_font_typewriter">Complete</span> (Top) and <span id="S4.F6.9.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.F6.10.4" class="ltx_text ltx_font_typewriter">Instruct</span> (Bottom). We only highlight the calibrated results having at least a difference of 1% from the original Pass@1.</figcaption>
</figure>
<section id="S4.SS1.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Instruction-tuned LLMs omit essential details of long code prompts</h6>

<div id="S4.SS1.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="S4.SS1.SSS0.Px1.p1.1" class="ltx_p">Interestingly, we observe that instruction-tuned LLMs can omit the essential import statements of the given prompts in <span id="S4.SS1.SSS0.Px1.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px1.p1.1.2" class="ltx_text ltx_font_typewriter">Complete</span>, which can lead to task failure due to the lack of proper module and constant definitions. The omission is likely to happen when models need to repeat the long context in the response. Such behaviors are denoted as “model laziness” in long-context interactions, similar to the observations in <a href="#S2.SS2" title="2.2 Semi-automatic Program Refactoring and Testing Case Generation ‣ 2 Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Section 2.2</span></a>. Due to the limited prompt length of existing programming benchmarks (<a href="#S3.T1" title="Table 1 ‣ 3 Benchmark Statistics ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Table 1</span></a>), there is no quantitative evidence of the laziness phenomenon in prior code generation benchmarks. To understand how laziness can affect the model performance, we calibrate the generation quality by adding the missing setup (e.g., import statements and global constants). When comparing the calibrated Pass@1 and the original ones in the top figure of <a href="#S4.F6" title="Figure 6 ‣ 4.1 Measuring Task-Level Performance ‣ 4 Evaluation ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 6</span></a> and <a href="#A9" title="Appendix I Detailed Benchmarking Results and Analysis ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix I</span></a>, we find that GPT-4 tends to omit much more context and perform poorly on <span id="S4.SS1.SSS0.Px1.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px1.p1.1.4" class="ltx_text ltx_font_typewriter">Complete</span>, consistent with the previous community discussion<span id="footnote4" class="ltx_note ltx_role_footnote"><sup class="ltx_note_mark">4</sup><span class="ltx_note_outer"><span class="ltx_note_content"><sup class="ltx_note_mark">4</sup><span class="ltx_tag ltx_tag_note">4</span><a target="_blank" href="https://community.openai.com/t/why-i-think-gpt-is-now-lazy" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://community.openai.com/t/why-i-think-gpt-is-now-lazy</a></span></span></span> and confirmed by OpenAI <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib43" title="" class="ltx_ref">43</a>]</cite>. While instruction-tuned LLMs have an average performance degradation of 0.8% on <span id="S4.SS1.SSS0.Px1.p1.1.5" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px1.p1.1.6" class="ltx_text ltx_font_typewriter">Complete</span>, there is a less than 0.3% difference on <span id="S4.SS1.SSS0.Px1.p1.1.7" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px1.p1.1.8" class="ltx_text ltx_font_typewriter">Instruct</span>, which validates the hypothesis that models omit more information of longer inputs.</p>
</div>
</section>
<section id="S4.SS1.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Instruction tuning helps to follow programming constraints</h6>

<div id="S4.SS1.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="S4.SS1.SSS0.Px2.p1.1" class="ltx_p">When comparing instruction-tuned LLMs with their base ones (<a href="#A9" title="Appendix I Detailed Benchmarking Results and Analysis ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix I</span></a>), we observe that instruction tuning can improve the capability of following complex constraints of the prompts. The mean calibrated Pass@1 on <span id="S4.SS1.SSS0.Px2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px2.p1.1.2" class="ltx_text ltx_font_typewriter">Complete</span> for instruction-tuned LLMs and paired base LLMs are 40.7% and 35.7%, respectively, indicating the great performance gap. The performance disparity is further magnified when the instruction-tuned LLMs are calibrated. We also note that the task performance of CodeQwen1.5-7B is not enhanced by instruction tuning, possibly due to the lack of fine-grained data during training.</p>
</div>
</section>
<section id="S4.SS1.SSS0.Px3" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">LLMs are sensitive to the verbosity of programming instructions</h6>

<div id="S4.SS1.SSS0.Px3.p1" class="ltx_para ltx_noindent">
<p id="S4.SS1.SSS0.Px3.p1.1" class="ltx_p">From the bottom figure of <a href="#S4.F6" title="Figure 6 ‣ 4.1 Measuring Task-Level Performance ‣ 4 Evaluation ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 6</span></a>, we notice that LLMs perform much worse on <span id="S4.SS1.SSS0.Px3.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px3.p1.1.2" class="ltx_text ltx_font_typewriter">Instruct</span> than <span id="S4.SS1.SSS0.Px3.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px3.p1.1.4" class="ltx_text ltx_font_typewriter">Complete</span> with an average decrease of 8.5% on Pass@1, while maintaining similar rankings. This observation indicates that LLMs still lack the proper understanding of condensed human requirements since the task instructions of <span id="S4.SS1.SSS0.Px3.p1.1.5" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px3.p1.1.6" class="ltx_text ltx_font_typewriter">Instruct</span> are less verbose. While it is possible that the lower verbosity may introduce more ambiguity, we make sure that the instructions transformed from <span id="S4.SS1.SSS0.Px3.p1.1.7" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px3.p1.1.8" class="ltx_text ltx_font_typewriter">Complete</span> do not lose the key information from the human perspective. In addition, we find that models with lower scores on <span id="S4.SS1.SSS0.Px3.p1.1.9" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px3.p1.1.10" class="ltx_text ltx_font_typewriter">Complete</span> degrade less on <span id="S4.SS1.SSS0.Px3.p1.1.11" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS1.SSS0.Px3.p1.1.12" class="ltx_text ltx_font_typewriter">Instruct</span>, limited by their programming capability.</p>
</div>
<figure id="S4.F7" class="ltx_figure ltx_align_floatright"><img src="/html/2406.15877/assets/x8.png" id="S4.F7.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="207" height="164" alt="Refer to caption">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 7: </span>Top 5 instruction-tuned LLMs on <span id="S4.F7.3.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.F7.4.2" class="ltx_text ltx_font_typewriter">Complete</span>.</figcaption>
</figure>
</section>
</section>
<section id="S4.SS2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">4.2 </span>Measuring Tool-Level Performance</h4>

<div id="S4.SS2.p1" class="ltx_para ltx_noindent">
<p id="S4.SS2.p1.1" class="ltx_p">Besides evaluating task completion performance, we try to understand how well LLMs can use tools for task-solving. As it is hard to evaluate the accuracy of each independent function call regardless of the correctness of the model solutions, we rely on the calibrated greedy decoding results on <span id="S4.SS2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS2.p1.1.2" class="ltx_text ltx_font_typewriter">Complete</span> and deem the use of the associated library correct if the task is passed by all test cases.</p>
</div>
<section id="S4.SS2.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Jack of all trades, master of most.</h6>

<div id="S4.SS2.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="S4.SS2.SSS0.Px1.p1.1" class="ltx_p"><a href="#S4.F7" title="Figure 7 ‣ LLMs are sensitive to the verbosity of programming instructions ‣ 4.1 Measuring Task-Level Performance ‣ 4 Evaluation ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 7</span></a> shows the top 5 calibrated instruction-tuned LLMs ranked on <span id="S4.SS2.SSS0.Px1.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS2.SSS0.Px1.p1.1.2" class="ltx_text ltx_font_typewriter">Complete</span>. The best overall performing LLMs, like GPT-4o, excel in most domains but still fall short in certain ones. We suggest that domain specialization can result from the training data. Similar findings can be found in the base models, which are visualized in <a href="#A9.SS2" title="I.2 Further Analysis ‣ Appendix I Detailed Benchmarking Results and Analysis ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref">Appendix <span class="ltx_ref ltx_nolink"><span class="ltx_text ltx_ref_tag">I.2</span></span></a>.</p>
</div>
<figure id="S4.T2" class="ltx_table ltx_align_floatright">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_table">Table 2: </span>Tool-use comparisons between all generated solutions (<span id="S4.T2.9.1" class="ltx_text ltx_font_bold">Sol.</span>) and ground truths (<span id="S4.T2.10.2" class="ltx_text ltx_font_bold">GT.</span>) on <span id="S4.T2.11.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.T2.12.4" class="ltx_text ltx_font_typewriter">Complete</span>.</figcaption>
<div id="S4.T2.4" class="ltx_inline-block ltx_align_center ltx_transformed_outer" style="width:195.1pt;height:52.4pt;vertical-align:-0.0pt;"><span class="ltx_transformed_inner" style="transform:translate(-36.6pt,9.8pt) scale(0.727282431833731,0.727282431833731) ;">
<table id="S4.T2.4.4" class="ltx_tabular ltx_align_middle">
<tr id="S4.T2.4.4.5" class="ltx_tr">
<td id="S4.T2.4.4.5.1" class="ltx_td ltx_border_tt" rowspan="2"></td>
<td id="S4.T2.4.4.5.2" class="ltx_td ltx_align_center ltx_border_tt" colspan="2">
<span id="S4.T2.4.4.5.2.1" class="ltx_text ltx_font_bold">Library</span> (%)</td>
<td id="S4.T2.4.4.5.3" class="ltx_td ltx_align_center ltx_border_tt" colspan="2">
<span id="S4.T2.4.4.5.3.1" class="ltx_text ltx_font_bold">Function Call</span> (%)</td>
</tr>
<tr id="S4.T2.4.4.4" class="ltx_tr">
<td id="S4.T2.1.1.1.1" class="ltx_td ltx_align_center ltx_border_t"><math id="S4.T2.1.1.1.1.m1.1" class="ltx_math_unparsed" alttext="Sol.\subseteq GT." display="inline"><semantics id="S4.T2.1.1.1.1.m1.1a"><mrow id="S4.T2.1.1.1.1.m1.1b"><mi id="S4.T2.1.1.1.1.m1.1.1">S</mi><mi id="S4.T2.1.1.1.1.m1.1.2">o</mi><mi id="S4.T2.1.1.1.1.m1.1.3">l</mi><mo lspace="0em" rspace="0.0835em" id="S4.T2.1.1.1.1.m1.1.4">.</mo><mo lspace="0.0835em" id="S4.T2.1.1.1.1.m1.1.5">⊆</mo><mi id="S4.T2.1.1.1.1.m1.1.6">G</mi><mi id="S4.T2.1.1.1.1.m1.1.7">T</mi><mo lspace="0em" id="S4.T2.1.1.1.1.m1.1.8">.</mo></mrow><annotation encoding="application/x-tex" id="S4.T2.1.1.1.1.m1.1c">Sol.\subseteq GT.</annotation></semantics></math></td>
<td id="S4.T2.2.2.2.2" class="ltx_td ltx_align_center ltx_border_t"><math id="S4.T2.2.2.2.2.m1.1" class="ltx_math_unparsed" alttext="Sol.\nsubseteq GT." display="inline"><semantics id="S4.T2.2.2.2.2.m1.1a"><mrow id="S4.T2.2.2.2.2.m1.1b"><mi id="S4.T2.2.2.2.2.m1.1.1">S</mi><mi id="S4.T2.2.2.2.2.m1.1.2">o</mi><mi id="S4.T2.2.2.2.2.m1.1.3">l</mi><mo lspace="0em" rspace="0.0835em" id="S4.T2.2.2.2.2.m1.1.4">.</mo><mo lspace="0.0835em" id="S4.T2.2.2.2.2.m1.1.5">⊈</mo><mi id="S4.T2.2.2.2.2.m1.1.6">G</mi><mi id="S4.T2.2.2.2.2.m1.1.7">T</mi><mo lspace="0em" id="S4.T2.2.2.2.2.m1.1.8">.</mo></mrow><annotation encoding="application/x-tex" id="S4.T2.2.2.2.2.m1.1c">Sol.\nsubseteq GT.</annotation></semantics></math></td>
<td id="S4.T2.3.3.3.3" class="ltx_td ltx_align_center ltx_border_t"><math id="S4.T2.3.3.3.3.m1.1" class="ltx_math_unparsed" alttext="Sol.\subseteq GT." display="inline"><semantics id="S4.T2.3.3.3.3.m1.1a"><mrow id="S4.T2.3.3.3.3.m1.1b"><mi id="S4.T2.3.3.3.3.m1.1.1">S</mi><mi id="S4.T2.3.3.3.3.m1.1.2">o</mi><mi id="S4.T2.3.3.3.3.m1.1.3">l</mi><mo lspace="0em" rspace="0.0835em" id="S4.T2.3.3.3.3.m1.1.4">.</mo><mo lspace="0.0835em" id="S4.T2.3.3.3.3.m1.1.5">⊆</mo><mi id="S4.T2.3.3.3.3.m1.1.6">G</mi><mi id="S4.T2.3.3.3.3.m1.1.7">T</mi><mo lspace="0em" id="S4.T2.3.3.3.3.m1.1.8">.</mo></mrow><annotation encoding="application/x-tex" id="S4.T2.3.3.3.3.m1.1c">Sol.\subseteq GT.</annotation></semantics></math></td>
<td id="S4.T2.4.4.4.4" class="ltx_td ltx_nopad_r ltx_align_center ltx_border_t"><math id="S4.T2.4.4.4.4.m1.1" class="ltx_math_unparsed" alttext="Sol.\nsubseteq GT." display="inline"><semantics id="S4.T2.4.4.4.4.m1.1a"><mrow id="S4.T2.4.4.4.4.m1.1b"><mi id="S4.T2.4.4.4.4.m1.1.1">S</mi><mi id="S4.T2.4.4.4.4.m1.1.2">o</mi><mi id="S4.T2.4.4.4.4.m1.1.3">l</mi><mo lspace="0em" rspace="0.0835em" id="S4.T2.4.4.4.4.m1.1.4">.</mo><mo lspace="0.0835em" id="S4.T2.4.4.4.4.m1.1.5">⊈</mo><mi id="S4.T2.4.4.4.4.m1.1.6">G</mi><mi id="S4.T2.4.4.4.4.m1.1.7">T</mi><mo lspace="0em" id="S4.T2.4.4.4.4.m1.1.8">.</mo></mrow><annotation encoding="application/x-tex" id="S4.T2.4.4.4.4.m1.1c">Sol.\nsubseteq GT.</annotation></semantics></math></td>
</tr>
<tr id="S4.T2.4.4.6" class="ltx_tr">
<td id="S4.T2.4.4.6.1" class="ltx_td ltx_align_center ltx_border_t">Pass</td>
<td id="S4.T2.4.4.6.2" class="ltx_td ltx_align_center ltx_border_t">79.84</td>
<td id="S4.T2.4.4.6.3" class="ltx_td ltx_align_center ltx_border_t">20.16</td>
<td id="S4.T2.4.4.6.4" class="ltx_td ltx_align_center ltx_border_t">40.46</td>
<td id="S4.T2.4.4.6.5" class="ltx_td ltx_nopad_r ltx_align_center ltx_border_t">59.54</td>
</tr>
<tr id="S4.T2.4.4.7" class="ltx_tr">
<td id="S4.T2.4.4.7.1" class="ltx_td ltx_align_center ltx_border_bb">Fail</td>
<td id="S4.T2.4.4.7.2" class="ltx_td ltx_align_center ltx_border_bb">71.78</td>
<td id="S4.T2.4.4.7.3" class="ltx_td ltx_align_center ltx_border_bb">28.22</td>
<td id="S4.T2.4.4.7.4" class="ltx_td ltx_align_center ltx_border_bb">22.47</td>
<td id="S4.T2.4.4.7.5" class="ltx_td ltx_nopad_r ltx_align_center ltx_border_bb">77.53</td>
</tr>
</table>
</span></div>
</figure>
</section>
<section id="S4.SS2.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">LLMs use different function calls to solve tasks.</h6>

<div id="S4.SS2.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="S4.SS2.SSS0.Px2.p1.1" class="ltx_p">We assess how all 60 calibrated models use tools on <span id="S4.SS2.SSS0.Px2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S4.SS2.SSS0.Px2.p1.1.2" class="ltx_text ltx_font_typewriter">Complete</span> and report the mean statistics in <a href="#S4.T2" title="Table 2 ‣ Jack of all trades, master of most. ‣ 4.2 Measuring Tool-Level Performance ‣ 4 Evaluation ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Table 2</span></a>. By inspecting the library usage, we find that models use imported libraries in more than 70% of tasks. For the remaining 20%, we notice that models tend to import additional libraries to solve the tasks. After some inspection, we notice that most of these added libraries are standard, explaining why they can still pass the tests. When analyzing the function calls, we find that models tend to use different function calls from the ones in ground truths.
Due to the open-endedness of the programming tasks, the invocation of function calls is expected to be flexible. However, using more diverse function calls is more likely to introduce task failures. We provide several examples where the model-generated solution contains function calls different from the ground truth in <a href="#A10" title="Appendix J Qualitative Studies ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix J</span></a>, Examples 9 and 10.</p>
</div>
</section>
</section>
</section>
<section id="S5" class="ltx_section">
<h3 class="ltx_title ltx_title_section">
<span class="ltx_tag ltx_tag_section">5 </span>Comparison to Existing Programming Benchmarks</h3>

<figure id="S5.T3" class="ltx_table">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_table">Table 3: </span>Correlation coefficients measured by Pearson’s <math id="S5.T3.3.m1.1" class="ltx_Math" alttext="r" display="inline"><semantics id="S5.T3.3.m1.1b"><mi id="S5.T3.3.m1.1.1" xref="S5.T3.3.m1.1.1.cmml">r</mi><annotation-xml encoding="MathML-Content" id="S5.T3.3.m1.1c"><ci id="S5.T3.3.m1.1.1.cmml" xref="S5.T3.3.m1.1.1">𝑟</ci></annotation-xml><annotation encoding="application/x-tex" id="S5.T3.3.m1.1d">r</annotation></semantics></math> and Spearman’s <math id="S5.T3.4.m2.1" class="ltx_Math" alttext="p" display="inline"><semantics id="S5.T3.4.m2.1b"><mi id="S5.T3.4.m2.1.1" xref="S5.T3.4.m2.1.1.cmml">p</mi><annotation-xml encoding="MathML-Content" id="S5.T3.4.m2.1c"><ci id="S5.T3.4.m2.1.1.cmml" xref="S5.T3.4.m2.1.1">𝑝</ci></annotation-xml><annotation encoding="application/x-tex" id="S5.T3.4.m2.1d">p</annotation></semantics></math>. against HumanEval+ and LiveCodeBench.</figcaption>
<div id="S5.T3.8" class="ltx_inline-block ltx_align_center ltx_transformed_outer" style="width:260.2pt;height:83.1pt;vertical-align:-0.0pt;"><span class="ltx_transformed_inner" style="transform:translate(17.3pt,-5.5pt) scale(1.15348157408638,1.15348157408638) ;">
<table id="S5.T3.8.4" class="ltx_tabular ltx_align_middle">
<tr id="S5.T3.8.4.5" class="ltx_tr">
<td id="S5.T3.8.4.5.1" class="ltx_td ltx_border_tt"></td>
<td id="S5.T3.8.4.5.2" class="ltx_td ltx_align_center ltx_border_tt" colspan="2">
<span id="S5.T3.8.4.5.2.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S5.T3.8.4.5.2.2" class="ltx_text ltx_font_typewriter">Complete</span>
</td>
<td id="S5.T3.8.4.5.3" class="ltx_td ltx_align_center ltx_border_tt" colspan="2">
<span id="S5.T3.8.4.5.3.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S5.T3.8.4.5.3.2" class="ltx_text ltx_font_typewriter">Instruct</span>
</td>
</tr>
<tr id="S5.T3.8.4.4" class="ltx_tr">
<td id="S5.T3.8.4.4.5" class="ltx_td"></td>
<td id="S5.T3.5.1.1.1" class="ltx_td ltx_align_center ltx_border_t"><math id="S5.T3.5.1.1.1.m1.1" class="ltx_Math" alttext="r" display="inline"><semantics id="S5.T3.5.1.1.1.m1.1a"><mi id="S5.T3.5.1.1.1.m1.1.1" xref="S5.T3.5.1.1.1.m1.1.1.cmml">r</mi><annotation-xml encoding="MathML-Content" id="S5.T3.5.1.1.1.m1.1b"><ci id="S5.T3.5.1.1.1.m1.1.1.cmml" xref="S5.T3.5.1.1.1.m1.1.1">𝑟</ci></annotation-xml><annotation encoding="application/x-tex" id="S5.T3.5.1.1.1.m1.1c">r</annotation></semantics></math></td>
<td id="S5.T3.6.2.2.2" class="ltx_td ltx_align_center ltx_border_t"><math id="S5.T3.6.2.2.2.m1.1" class="ltx_Math" alttext="p" display="inline"><semantics id="S5.T3.6.2.2.2.m1.1a"><mi id="S5.T3.6.2.2.2.m1.1.1" xref="S5.T3.6.2.2.2.m1.1.1.cmml">p</mi><annotation-xml encoding="MathML-Content" id="S5.T3.6.2.2.2.m1.1b"><ci id="S5.T3.6.2.2.2.m1.1.1.cmml" xref="S5.T3.6.2.2.2.m1.1.1">𝑝</ci></annotation-xml><annotation encoding="application/x-tex" id="S5.T3.6.2.2.2.m1.1c">p</annotation></semantics></math></td>
<td id="S5.T3.7.3.3.3" class="ltx_td ltx_align_center ltx_border_t"><math id="S5.T3.7.3.3.3.m1.1" class="ltx_Math" alttext="r" display="inline"><semantics id="S5.T3.7.3.3.3.m1.1a"><mi id="S5.T3.7.3.3.3.m1.1.1" xref="S5.T3.7.3.3.3.m1.1.1.cmml">r</mi><annotation-xml encoding="MathML-Content" id="S5.T3.7.3.3.3.m1.1b"><ci id="S5.T3.7.3.3.3.m1.1.1.cmml" xref="S5.T3.7.3.3.3.m1.1.1">𝑟</ci></annotation-xml><annotation encoding="application/x-tex" id="S5.T3.7.3.3.3.m1.1c">r</annotation></semantics></math></td>
<td id="S5.T3.8.4.4.4" class="ltx_td ltx_align_center ltx_border_t"><math id="S5.T3.8.4.4.4.m1.1" class="ltx_Math" alttext="p" display="inline"><semantics id="S5.T3.8.4.4.4.m1.1a"><mi id="S5.T3.8.4.4.4.m1.1.1" xref="S5.T3.8.4.4.4.m1.1.1.cmml">p</mi><annotation-xml encoding="MathML-Content" id="S5.T3.8.4.4.4.m1.1b"><ci id="S5.T3.8.4.4.4.m1.1.1.cmml" xref="S5.T3.8.4.4.4.m1.1.1">𝑝</ci></annotation-xml><annotation encoding="application/x-tex" id="S5.T3.8.4.4.4.m1.1c">p</annotation></semantics></math></td>
</tr>
<tr id="S5.T3.8.4.6" class="ltx_tr">
<td id="S5.T3.8.4.6.1" class="ltx_td ltx_align_center ltx_border_t">HumanEval+</td>
<td id="S5.T3.8.4.6.2" class="ltx_td ltx_align_center ltx_border_t">0.849</td>
<td id="S5.T3.8.4.6.3" class="ltx_td ltx_align_center ltx_border_t">0.861</td>
<td id="S5.T3.8.4.6.4" class="ltx_td ltx_align_center ltx_border_t">0.864</td>
<td id="S5.T3.8.4.6.5" class="ltx_td ltx_align_center ltx_border_t">0.894</td>
</tr>
<tr id="S5.T3.8.4.7" class="ltx_tr">
<td id="S5.T3.8.4.7.1" class="ltx_td ltx_align_center ltx_border_bb">LiveCodeBench</td>
<td id="S5.T3.8.4.7.2" class="ltx_td ltx_align_center ltx_border_bb">0.853</td>
<td id="S5.T3.8.4.7.3" class="ltx_td ltx_align_center ltx_border_bb">0.898</td>
<td id="S5.T3.8.4.7.4" class="ltx_td ltx_align_center ltx_border_bb">0.778</td>
<td id="S5.T3.8.4.7.5" class="ltx_td ltx_align_center ltx_border_bb">0.815</td>
</tr>
</table>
</span></div>
</figure>
<div id="S5.p1" class="ltx_para ltx_noindent">
<p id="S5.p1.1" class="ltx_p">We compare model performances on <span id="S5.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S5.p1.1.2" class="ltx_text ltx_font_typewriter">Complete</span> against existing benchmarks like HumanEval+ <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib35" title="" class="ltx_ref">35</a>]</cite> and LiveCodeBench <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib26" title="" class="ltx_ref">26</a>]</cite> used for evaluating the coding capabilities of LLMs. We compute the Pearson and Spearman correlation coefficients for the calibrated model ranks on <span id="S5.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S5.p1.1.4" class="ltx_text ltx_font_typewriter">Complete</span> and <span id="S5.p1.1.5" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="S5.p1.1.6" class="ltx_text ltx_font_typewriter">Instruct</span> against HumanEval+ and LiveCodeBench. From <a href="#S5.T3" title="Table 3 ‣ 5 Comparison to Existing Programming Benchmarks ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Table 3</span></a>, we observe the strong correlations for both coefficients, suggesting that <span id="S5.p1.1.7" class="ltx_text ltx_font_typewriter">BigCodeBench</span> is well aligned with the mainstream evaluation trend. However, as <span id="S5.p1.1.8" class="ltx_text ltx_font_typewriter">BigCodeBench</span> measures the different aspects from HumanEval+ and LiveCodeBench, some models are expected to have various ranks among these benchmarks. In addition, we note that models which have saturated HumanEval like GPT-4o, still have room for improvement on <span id="S5.p1.1.9" class="ltx_text ltx_font_typewriter">BigCodeBench</span> in comparison to human performance.</p>
</div>
</section>
<section id="S6" class="ltx_section">
<h3 class="ltx_title ltx_title_section">
<span class="ltx_tag ltx_tag_section">6 </span>Related Work</h3>

<section id="S6.SS0.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Large Language Models for Code</h6>

<div id="S6.SS0.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="S6.SS0.SSS0.Px1.p1.1" class="ltx_p">With the rise of LLMs, there have been various models trained on code. Codex <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib14" title="" class="ltx_ref">14</a>]</cite> marks the first base LLM pre-trained on code, which was used as the backbone model for GitHub Copilot. More recently, pre-trained base code models <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib41" title="" class="ltx_ref">41</a>, <a href="#bib.bib34" title="" class="ltx_ref">34</a>, <a href="#bib.bib36" title="" class="ltx_ref">36</a>, <a href="#bib.bib52" title="" class="ltx_ref">52</a>]</cite>
have been built to perform accurate code completion.
Later, with the advance in instruction tuning <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib45" title="" class="ltx_ref">45</a>]</cite>, LLMs can generate the code snippet that aligns with the given NL instruction.
Instruction-tuned code models <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib40" title="" class="ltx_ref">40</a>, <a href="#bib.bib38" title="" class="ltx_ref">38</a>, <a href="#bib.bib59" title="" class="ltx_ref">59</a>]</cite>, are generally better at programming than their base ones.</p>
</div>
</section>
<section id="S6.SS0.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Programming Benchmarks</h6>

<div id="S6.SS0.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="S6.SS0.SSS0.Px2.p1.1" class="ltx_p">To assess the programming capability of LLMs, researchers have proposed many programming benchmarks. Most existing benchmarks focus on short, self-contained, and algorithm-specific programming tasks, such as HumanEval <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib14" title="" class="ltx_ref">14</a>]</cite> and MBPP <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib9" title="" class="ltx_ref">9</a>]</cite>.
Recently, open-domain coding benchmarks <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib58" title="" class="ltx_ref">58</a>, <a href="#bib.bib32" title="" class="ltx_ref">32</a>]</cite> have been built to challenge code LLMs on application-specific scenarios by using specific sets of tools and libraries.
However, they focus on simple intents and use limited specific function calls per programming task, making their evaluation less challenging and realistic.
Benchmarks like SWE-bench <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib29" title="" class="ltx_ref">29</a>]</cite> are built to evaluate the performance of a code agent framework (e.g., iterated prompting, real-time environment interaction, and long-context exploration).
Our <span id="S6.SS0.SSS0.Px2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> focuses on evaluating the fundamental code generation capability of LLMs, which is also an essential path toward strong code agents.
In addition, SWE-Bench is constructed from GitHub repositories with existing test cases — which limits the diversity of the tasks considered. In contrast, our collaborative LLM-human annotator procedure allows generating tasks from seed queries from StackOverflow (collected in <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib58" title="" class="ltx_ref">58</a>]</cite>), tackling a broader range of software tasks.</p>
</div>
</section>
</section>
<section id="S7" class="ltx_section">
<h3 class="ltx_title ltx_title_section">
<span class="ltx_tag ltx_tag_section">7 </span>Conclusion</h3>

<div id="S7.p1" class="ltx_para ltx_noindent">
<p id="S7.p1.1" class="ltx_p">We introduce <span id="S7.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, a new high-quality programming benchmark constructed via the collaboration between human experts and LLMs, assessing the capability of tool use and complex instruction following. Through the extensive evaluation of 60 LLMs, we find that there is a long way for models to achieve perfection on this benchmark and share a few findings that can potentially improve the performance. We urge the community to work on more advanced LLMs for code and continually build upon our benchmark as discussed in our long-term roadmap (<a href="#A4" title="Appendix D Long-Term Roadmap and Call for Contributions ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix D</span></a>).</p>
</div>
</section>
<section id="Sx1" class="ltx_section">
<h3 class="ltx_title ltx_title_section">Acknowledgements</h3>

<div id="Sx1.p1" class="ltx_para">
<p id="Sx1.p1.1" class="ltx_p">We truly appreciate BigCode making many great works happen, including The Stack <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib36" title="" class="ltx_ref">36</a>]</cite>, SantaCoder <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib6" title="" class="ltx_ref">6</a>]</cite>, StarCoder <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib34" title="" class="ltx_ref">34</a>]</cite>, OctoPack <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib40" title="" class="ltx_ref">40</a>]</cite>, Astraios <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib73" title="" class="ltx_ref">73</a>]</cite>, StarCoder2 <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib36" title="" class="ltx_ref">36</a>]</cite>, and StarCoder2-Instruct <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib12" title="" class="ltx_ref">12</a>]</cite>. <span id="Sx1.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> cannot be built without the support of the BigCode community. We thank Sea AI Lab and MASSIVE for providing the computational resources. The project is also partially supported by Terry Yue Zhuo’s CSIRO’s Data61 PhD Scholarships and Xiaoning Du’s Google Research Scholar Program Award. For the benchmark, we particularly thank Xiangru Tang, Dmitry Abulkhanov, Noah Ziems, Chengran Yang, Jiamou Sun, Nickil Maveli, and Lili Bo for their eagerness to participate. We are extremely grateful to the EvalPlus team for their open-source evaluation framework. We also thank Loubna Ben Allal, Zhiruo Wang, Zhensu Sun, Sean Hughes, and Zhou Yang for their valuable comments.</p>
</div>
</section>
<section id="bib" class="ltx_bibliography">
<h3 class="ltx_title ltx_title_bibliography">References</h3>

<ul class="ltx_biblist">
<li id="bib.bib1" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[1]</span>
<span class="ltx_bibblock">
J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat, et al.

</span>
<span class="ltx_bibblock">Gpt-4 technical report.

</span>
<span class="ltx_bibblock"><span id="bib.bib1.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2303.08774</span>, 2023.

</span>
</li>
<li id="bib.bib2" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[2]</span>
<span class="ltx_bibblock">
M. AI.

</span>
<span class="ltx_bibblock">Mistral.

</span>
<span class="ltx_bibblock"><a target="_blank" href="https://mistral.ai/news/mistral-large/" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://mistral.ai/news/mistral-large/</a>, 2024.

</span>
</li>
<li id="bib.bib3" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[3]</span>
<span class="ltx_bibblock">
M. AI.

</span>
<span class="ltx_bibblock">Mixtral-8x22b-instruct-v0.1.

</span>
<span class="ltx_bibblock"><a target="_blank" href="https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1</a>, 2024.

</span>
</li>
<li id="bib.bib4" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[4]</span>
<span class="ltx_bibblock">
M. AI.

</span>
<span class="ltx_bibblock">Mixtral-8x22b-v0.1.

</span>
<span class="ltx_bibblock"><a target="_blank" href="https://huggingface.co/mistralai/Mixtral-8x22B-v0.1" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/mistralai/Mixtral-8x22B-v0.1</a>, 2024.

</span>
</li>
<li id="bib.bib5" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[5]</span>
<span class="ltx_bibblock">
AI@Meta.

</span>
<span class="ltx_bibblock">Llama 3 model card.

</span>
<span class="ltx_bibblock">2024.

</span>
</li>
<li id="bib.bib6" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[6]</span>
<span class="ltx_bibblock">
L. B. Allal, R. Li, D. Kocetkov, C. Mou, C. Akiki, C. M. Ferrandis, N. Muennighoff, M. Mishra, A. Gu, M. Dey, et al.

</span>
<span class="ltx_bibblock">Santacoder: don’t reach for the stars!

</span>
<span class="ltx_bibblock">In <span id="bib.bib6.1.1" class="ltx_text ltx_font_italic">Deep Learning for Code (DL4C) Workshop</span>, 2023.

</span>
</li>
<li id="bib.bib7" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[7]</span>
<span class="ltx_bibblock">
S. Anand, E. K. Burke, T. Y. Chen, J. Clark, M. B. Cohen, W. Grieskamp, M. Harman, M. J. Harrold, P. McMinn, A. Bertolino, et al.

</span>
<span class="ltx_bibblock">An orchestrated survey of methodologies for automated software test case generation.

</span>
<span class="ltx_bibblock"><span id="bib.bib7.1.1" class="ltx_text ltx_font_italic">Journal of systems and software</span>, 86(8):1978–2001, 2013.

</span>
</li>
<li id="bib.bib8" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[8]</span>
<span class="ltx_bibblock">
A. Anthropic.

</span>
<span class="ltx_bibblock">The claude 3 model family: Opus, sonnet, haiku.

</span>
<span class="ltx_bibblock"><span id="bib.bib8.1.1" class="ltx_text ltx_font_italic">Claude-3 Model Card</span>, 2024.

</span>
</li>
<li id="bib.bib9" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[9]</span>
<span class="ltx_bibblock">
J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. Cai, M. Terry, Q. Le, et al.

</span>
<span class="ltx_bibblock">Program synthesis with large language models.

</span>
<span class="ltx_bibblock"><span id="bib.bib9.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2108.07732</span>, 2021.

</span>
</li>
<li id="bib.bib10" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[10]</span>
<span class="ltx_bibblock">
J. Bai, S. Bai, Y. Chu, Z. Cui, K. Dang, X. Deng, Y. Fan, W. Ge, Y. Han, F. Huang, B. Hui, L. Ji, M. Li, J. Lin, R. Lin, D. Liu, G. Liu, C. Lu, K. Lu, J. Ma, R. Men, X. Ren, X. Ren, C. Tan, S. Tan, J. Tu, P. Wang, S. Wang, W. Wang, S. Wu, B. Xu, J. Xu, A. Yang, H. Yang, J. Yang, S. Yang, Y. Yao, B. Yu, H. Yuan, Z. Yuan, J. Zhang, X. Zhang, Y. Zhang, Z. Zhang, C. Zhou, J. Zhou, X. Zhou, and T. Zhu.

</span>
<span class="ltx_bibblock">Qwen technical report.

</span>
<span class="ltx_bibblock"><span id="bib.bib10.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2309.16609</span>, 2023.

</span>
</li>
<li id="bib.bib11" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[11]</span>
<span class="ltx_bibblock">
E. M. Bender and B. Friedman.

</span>
<span class="ltx_bibblock">Data statements for natural language processing: Toward mitigating system bias and enabling better science.

</span>
<span class="ltx_bibblock"><span id="bib.bib11.1.1" class="ltx_text ltx_font_italic">Transactions of the Association for Computational Linguistics</span>, 6:587–604, 2018.

</span>
</li>
<li id="bib.bib12" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[12]</span>
<span class="ltx_bibblock">
BigCode.

</span>
<span class="ltx_bibblock">starcoder2-15b-instruct-v0.1.

</span>
<span class="ltx_bibblock"><a target="_blank" href="https://huggingface.co/bigcode/starcoder2-15b-instruct-v0.1" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/bigcode/starcoder2-15b-instruct-v0.1</a>, 2024.

</span>
</li>
<li id="bib.bib13" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[13]</span>
<span class="ltx_bibblock">
A. Z. Broder.

</span>
<span class="ltx_bibblock">Identifying and filtering near-duplicate documents.

</span>
<span class="ltx_bibblock">In <span id="bib.bib13.1.1" class="ltx_text ltx_font_italic">Annual symposium on combinatorial pattern matching</span>, pages 1–10. Springer, 2000.

</span>
</li>
<li id="bib.bib14" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[14]</span>
<span class="ltx_bibblock">
M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. d. O. Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, et al.

</span>
<span class="ltx_bibblock">Evaluating large language models trained on code.

</span>
<span class="ltx_bibblock"><span id="bib.bib14.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2107.03374</span>, 2021.

</span>
</li>
<li id="bib.bib15" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[15]</span>
<span class="ltx_bibblock">
X. Chen, M. Lin, N. Schaerli, and D. Zhou.

</span>
<span class="ltx_bibblock">Teaching large language models to self-debug.

</span>
<span class="ltx_bibblock">In <span id="bib.bib15.1.1" class="ltx_text ltx_font_italic">The 61st Annual Meeting Of The Association For Computational Linguistics</span>, 2023.

</span>
</li>
<li id="bib.bib16" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[16]</span>
<span class="ltx_bibblock">
DeepSeek-AI.

</span>
<span class="ltx_bibblock">Deepseek-v2: A strong, economical, and efficient mixture-of-experts language model, 2024.

</span>
</li>
<li id="bib.bib17" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[17]</span>
<span class="ltx_bibblock">
K. Dhole, V. Gangal, S. Gehrmann, A. Gupta, Z. Li, S. Mahamood, A. Mahadiran, S. Mille, A. Shrivastava, S. Tan, et al.

</span>
<span class="ltx_bibblock">Nl-augmenter: A framework for task-sensitive natural language augmentation.

</span>
<span class="ltx_bibblock"><span id="bib.bib17.1.1" class="ltx_text ltx_font_italic">Northern European Journal of Language Technology</span>, 9(1), 2023.

</span>
</li>
<li id="bib.bib18" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[18]</span>
<span class="ltx_bibblock">
Y. Ding, Z. Wang, W. Ahmad, H. Ding, M. Tan, N. Jain, M. K. Ramanathan, R. Nallapati, P. Bhatia, D. Roth, et al.

</span>
<span class="ltx_bibblock">Crosscodeeval: A diverse and multilingual benchmark for cross-file code completion.

</span>
<span class="ltx_bibblock"><span id="bib.bib18.1.1" class="ltx_text ltx_font_italic">Advances in Neural Information Processing Systems</span>, 36, 2024.

</span>
</li>
<li id="bib.bib19" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[19]</span>
<span class="ltx_bibblock">
A. Fan, B. Gokkaya, M. Harman, M. Lyubarskiy, S. Sengupta, S. Yoo, and J. M. Zhang.

</span>
<span class="ltx_bibblock">Large language models for software engineering: Survey and open problems.

</span>
<span class="ltx_bibblock"><span id="bib.bib19.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2310.03533</span>, 2023.

</span>
</li>
<li id="bib.bib20" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[20]</span>
<span class="ltx_bibblock">
L. Gao, A. Madaan, S. Zhou, U. Alon, P. Liu, Y. Yang, J. Callan, and G. Neubig.

</span>
<span class="ltx_bibblock">Pal: Program-aided language models.

</span>
<span class="ltx_bibblock">In <span id="bib.bib20.1.1" class="ltx_text ltx_font_italic">International Conference on Machine Learning</span>, pages 10764–10799. PMLR, 2023.

</span>
</li>
<li id="bib.bib21" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[21]</span>
<span class="ltx_bibblock">
T. Gebru, J. Morgenstern, B. Vecchione, J. W. Vaughan, H. Wallach, H. D. Iii, and K. Crawford.

</span>
<span class="ltx_bibblock">Datasheets for datasets.

</span>
<span class="ltx_bibblock"><span id="bib.bib21.1.1" class="ltx_text ltx_font_italic">Communications of the ACM</span>, 64(12):86–92, 2021.

</span>
</li>
<li id="bib.bib22" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[22]</span>
<span class="ltx_bibblock">
D. Guo, Q. Zhu, D. Yang, Z. Xie, K. Dong, W. Zhang, G. Chen, X. Bi, Y. Wu, Y. Li, et al.

</span>
<span class="ltx_bibblock">Deepseek-coder: When the large language model meets programming–the rise of code intelligence.

</span>
<span class="ltx_bibblock"><span id="bib.bib22.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2401.14196</span>, 2024.

</span>
</li>
<li id="bib.bib23" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[23]</span>
<span class="ltx_bibblock">
D. Hendrycks, S. Basart, S. Kadavath, M. Mazeika, A. Arora, E. Guo, C. Burns, S. Puranik, H. He, D. Song, et al.

</span>
<span class="ltx_bibblock">Measuring coding challenge competence with apps.

</span>
<span class="ltx_bibblock">In <span id="bib.bib23.1.1" class="ltx_text ltx_font_italic">Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2)</span>, 2021.

</span>
</li>
<li id="bib.bib24" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[24]</span>
<span class="ltx_bibblock">
X. Hou, Y. Zhao, Y. Liu, Z. Yang, K. Wang, L. Li, X. Luo, D. Lo, J. C. Grundy, and H. Wang.

</span>
<span class="ltx_bibblock">Large language models for software engineering: A systematic literature review.

</span>
<span class="ltx_bibblock"><span id="bib.bib24.1.1" class="ltx_text ltx_font_italic">ArXiv</span>, abs/2308.10620, 2023.

</span>
</li>
<li id="bib.bib25" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[25]</span>
<span class="ltx_bibblock">
X. Hu, G. Li, X. Xia, D. Lo, S. Lu, and Z. Jin.

</span>
<span class="ltx_bibblock">Summarizing source code with transferred api knowledge.

</span>
<span class="ltx_bibblock">In <span id="bib.bib25.1.1" class="ltx_text ltx_font_italic">Proceedings of the 27th International Joint Conference on Artificial Intelligence</span>, pages 2269–2275, 2018.

</span>
</li>
<li id="bib.bib26" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[26]</span>
<span class="ltx_bibblock">
N. Jain, K. Han, A. Gu, W.-D. Li, F. Yan, T. Zhang, S. Wang, A. Solar-Lezama, K. Sen, and I. Stoica.

</span>
<span class="ltx_bibblock">Livecodebench: Holistic and contamination free evaluation of large language models for code.

</span>
<span class="ltx_bibblock"><span id="bib.bib26.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2403.07974</span>, 2024.

</span>
</li>
<li id="bib.bib27" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[27]</span>
<span class="ltx_bibblock">
N. Jain, M. Shetty, T. Zhang, K. Han, K. Sen, and I. Stoica.

</span>
<span class="ltx_bibblock">R2e: Turning any github repository into a programming agent environment.

</span>
<span class="ltx_bibblock">In <span id="bib.bib27.1.1" class="ltx_text ltx_font_italic">ICML 2024</span>.

</span>
</li>
<li id="bib.bib28" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[28]</span>
<span class="ltx_bibblock">
N. Jain, T. Zhang, W.-L. Chiang, J. E. Gonzalez, K. Sen, and I. Stoica.

</span>
<span class="ltx_bibblock">Llm-assisted code cleaning for training accurate code generators.

</span>
<span class="ltx_bibblock"><span id="bib.bib28.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2311.14904</span>, 2023.

</span>
</li>
<li id="bib.bib29" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[29]</span>
<span class="ltx_bibblock">
C. E. Jimenez, J. Yang, A. Wettig, S. Yao, K. Pei, O. Press, and K. R. Narasimhan.

</span>
<span class="ltx_bibblock">Swe-bench: Can language models resolve real-world github issues?

</span>
<span class="ltx_bibblock">In <span id="bib.bib29.1.1" class="ltx_text ltx_font_italic">The Twelfth International Conference on Learning Representations</span>, 2023.

</span>
</li>
<li id="bib.bib30" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[30]</span>
<span class="ltx_bibblock">
J. Kaplan, S. McCandlish, T. Henighan, T. B. Brown, B. Chess, R. Child, S. Gray, A. Radford, J. Wu, and D. Amodei.

</span>
<span class="ltx_bibblock">Scaling laws for neural language models.

</span>
<span class="ltx_bibblock"><span id="bib.bib30.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2001.08361</span>, 2020.

</span>
</li>
<li id="bib.bib31" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[31]</span>
<span class="ltx_bibblock">
W. Kwon, Z. Li, S. Zhuang, Y. Sheng, L. Zheng, C. H. Yu, J. Gonzalez, H. Zhang, and I. Stoica.

</span>
<span class="ltx_bibblock">Efficient memory management for large language model serving with pagedattention.

</span>
<span class="ltx_bibblock">In <span id="bib.bib31.1.1" class="ltx_text ltx_font_italic">Proceedings of the 29th Symposium on Operating Systems Principles</span>, pages 611–626, 2023.

</span>
</li>
<li id="bib.bib32" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[32]</span>
<span class="ltx_bibblock">
Y. Lai, C. Li, Y. Wang, T. Zhang, R. Zhong, L. Zettlemoyer, W.-t. Yih, D. Fried, S. Wang, and T. Yu.

</span>
<span class="ltx_bibblock">Ds-1000: A natural and reliable benchmark for data science code generation.

</span>
<span class="ltx_bibblock">In <span id="bib.bib32.1.1" class="ltx_text ltx_font_italic">International Conference on Machine Learning</span>, pages 18319–18345. PMLR, 2023.

</span>
</li>
<li id="bib.bib33" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[33]</span>
<span class="ltx_bibblock">
M. Lamothe, Y.-G. Guéhéneuc, and W. Shang.

</span>
<span class="ltx_bibblock">A systematic review of api evolution literature.

</span>
<span class="ltx_bibblock"><span id="bib.bib33.1.1" class="ltx_text ltx_font_italic">ACM Computing Surveys (CSUR)</span>, 54(8):1–36, 2021.

</span>
</li>
<li id="bib.bib34" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[34]</span>
<span class="ltx_bibblock">
R. Li, Y. Zi, N. Muennighoff, D. Kocetkov, C. Mou, M. Marone, C. Akiki, L. Jia, J. Chim, Q. Liu, et al.

</span>
<span class="ltx_bibblock">Starcoder: may the source be with you!

</span>
<span class="ltx_bibblock"><span id="bib.bib34.1.1" class="ltx_text ltx_font_italic">Transactions on Machine Learning Research</span>, 2023.

</span>
</li>
<li id="bib.bib35" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[35]</span>
<span class="ltx_bibblock">
J. Liu, C. S. Xia, Y. Wang, and L. Zhang.

</span>
<span class="ltx_bibblock">Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation.

</span>
<span class="ltx_bibblock"><span id="bib.bib35.1.1" class="ltx_text ltx_font_italic">Advances in Neural Information Processing Systems</span>, 36, 2024.

</span>
</li>
<li id="bib.bib36" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[36]</span>
<span class="ltx_bibblock">
A. Lozhkov, R. Li, L. B. Allal, F. Cassano, J. Lamy-Poirier, N. Tazi, A. Tang, D. Pykhtar, J. Liu, Y. Wei, et al.

</span>
<span class="ltx_bibblock">Starcoder 2 and the stack v2: The next generation.

</span>
<span class="ltx_bibblock"><span id="bib.bib36.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2402.19173</span>, 2024.

</span>
</li>
<li id="bib.bib37" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[37]</span>
<span class="ltx_bibblock">
Q. Luo, F. Hariri, L. Eloussi, and D. Marinov.

</span>
<span class="ltx_bibblock">An empirical analysis of flaky tests.

</span>
<span class="ltx_bibblock">In <span id="bib.bib37.1.1" class="ltx_text ltx_font_italic">Proceedings of the 22nd ACM SIGSOFT international symposium on foundations of software engineering</span>, pages 643–653, 2014.

</span>
</li>
<li id="bib.bib38" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[38]</span>
<span class="ltx_bibblock">
Z. Luo, C. Xu, P. Zhao, Q. Sun, X. Geng, W. Hu, C. Tao, J. Ma, Q. Lin, and D. Jiang.

</span>
<span class="ltx_bibblock">Wizardcoder: Empowering code large language models with evol-instruct.

</span>
<span class="ltx_bibblock">In <span id="bib.bib38.1.1" class="ltx_text ltx_font_italic">The Twelfth International Conference on Learning Representations</span>, 2023.

</span>
</li>
<li id="bib.bib39" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[39]</span>
<span class="ltx_bibblock">
M. Mishra, M. Stallone, G. Zhang, Y. Shen, A. Prasad, A. M. Soria, M. Merler, P. Selvam, S. Surendran, S. Singh, et al.

</span>
<span class="ltx_bibblock">Granite code models: A family of open foundation models for code intelligence.

</span>
<span class="ltx_bibblock"><span id="bib.bib39.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2405.04324</span>, 2024.

</span>
</li>
<li id="bib.bib40" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[40]</span>
<span class="ltx_bibblock">
N. Muennighoff, Q. Liu, A. R. Zebaze, Q. Zheng, B. Hui, T. Y. Zhuo, S. Singh, X. Tang, L. Von Werra, and S. Longpre.

</span>
<span class="ltx_bibblock">Octopack: Instruction tuning code large language models.

</span>
<span class="ltx_bibblock">In <span id="bib.bib40.1.1" class="ltx_text ltx_font_italic">The Twelfth International Conference on Learning Representations</span>, 2023.

</span>
</li>
<li id="bib.bib41" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[41]</span>
<span class="ltx_bibblock">
E. Nijkamp, B. Pang, H. Hayashi, L. Tu, H. Wang, Y. Zhou, S. Savarese, and C. Xiong.

</span>
<span class="ltx_bibblock">Codegen: An open large language model for code with multi-turn program synthesis.

</span>
<span class="ltx_bibblock">In <span id="bib.bib41.1.1" class="ltx_text ltx_font_italic">The Eleventh International Conference on Learning Representations</span>, 2022.

</span>
</li>
<li id="bib.bib42" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[42]</span>
<span class="ltx_bibblock">
OpenAI.

</span>
<span class="ltx_bibblock">Gpt-3.5-turbo.

</span>
<span class="ltx_bibblock"><a target="_blank" href="https://openai.com/index/introducing-chatgpt-and-whisper-apis/" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://openai.com/index/introducing-chatgpt-and-whisper-apis/</a>, 2023.

</span>
</li>
<li id="bib.bib43" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[43]</span>
<span class="ltx_bibblock">
OpenAI.

</span>
<span class="ltx_bibblock">Gpt-4-turbo.

</span>
<span class="ltx_bibblock"><a target="_blank" href="https://openai.com/index/new-embedding-models-and-api-updates/" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://openai.com/index/new-embedding-models-and-api-updates/</a>, 2024.

</span>
</li>
<li id="bib.bib44" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[44]</span>
<span class="ltx_bibblock">
OpenAI.

</span>
<span class="ltx_bibblock">Gpt-4o.

</span>
<span class="ltx_bibblock"><a target="_blank" href="https://openai.com/index/hello-gpt-4o/" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://openai.com/index/hello-gpt-4o/</a>, 2024.

</span>
</li>
<li id="bib.bib45" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[45]</span>
<span class="ltx_bibblock">
L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray, et al.

</span>
<span class="ltx_bibblock">Training language models to follow instructions with human feedback.

</span>
<span class="ltx_bibblock"><span id="bib.bib45.1.1" class="ltx_text ltx_font_italic">Advances in neural information processing systems</span>, 35:27730–27744, 2022.

</span>
</li>
<li id="bib.bib46" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[46]</span>
<span class="ltx_bibblock">
F. Paetsch, A. Eberlein, and F. Maurer.

</span>
<span class="ltx_bibblock">Requirements engineering and agile software development.

</span>
<span class="ltx_bibblock">In <span id="bib.bib46.1.1" class="ltx_text ltx_font_italic">WET ICE 2003. Proceedings. Twelfth IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, 2003.</span>, pages 308–313. IEEE, 2003.

</span>
</li>
<li id="bib.bib47" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[47]</span>
<span class="ltx_bibblock">
A. Panickssery, S. R. Bowman, and S. Feng.

</span>
<span class="ltx_bibblock">Llm evaluators recognize and favor their own generations.

</span>
<span class="ltx_bibblock"><span id="bib.bib47.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2404.13076</span>, 2024.

</span>
</li>
<li id="bib.bib48" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[48]</span>
<span class="ltx_bibblock">
H. A. Partsch.

</span>
<span class="ltx_bibblock"><span id="bib.bib48.1.1" class="ltx_text ltx_font_italic">Specification and transformation of programs: a formal approach to software development</span>.

</span>
<span class="ltx_bibblock">Springer Science &amp; Business Media, 2012.

</span>
</li>
<li id="bib.bib49" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[49]</span>
<span class="ltx_bibblock">
S. G. Patil, T. Zhang, X. Wang, and J. E. Gonzalez.

</span>
<span class="ltx_bibblock">Gorilla: Large language model connected with massive apis.

</span>
<span class="ltx_bibblock"><span id="bib.bib49.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2305.15334</span>, 2023.

</span>
</li>
<li id="bib.bib50" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[50]</span>
<span class="ltx_bibblock">
Y. Qin, S. Hu, Y. Lin, W. Chen, N. Ding, G. Cui, Z. Zeng, Y. Huang, C. Xiao, C. Han, et al.

</span>
<span class="ltx_bibblock">Tool learning with foundation models.

</span>
<span class="ltx_bibblock"><span id="bib.bib50.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2304.08354</span>, 2023.

</span>
</li>
<li id="bib.bib51" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[51]</span>
<span class="ltx_bibblock">
M. P. Robillard and R. DeLine.

</span>
<span class="ltx_bibblock">A field study of api learning obstacles.

</span>
<span class="ltx_bibblock"><span id="bib.bib51.1.1" class="ltx_text ltx_font_italic">Empirical Software Engineering</span>, 16:703–732, 2011.

</span>
</li>
<li id="bib.bib52" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[52]</span>
<span class="ltx_bibblock">
B. Roziere, J. Gehring, F. Gloeckle, S. Sootla, I. Gat, X. E. Tan, Y. Adi, J. Liu, T. Remez, J. Rapin, et al.

</span>
<span class="ltx_bibblock">Code llama: Open foundation models for code.

</span>
<span class="ltx_bibblock"><span id="bib.bib52.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2308.12950</span>, 2023.

</span>
</li>
<li id="bib.bib53" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[53]</span>
<span class="ltx_bibblock">
N. Shinn, F. Cassano, A. Gopinath, K. Narasimhan, and S. Yao.

</span>
<span class="ltx_bibblock">Reflexion: Language agents with verbal reinforcement learning.

</span>
<span class="ltx_bibblock"><span id="bib.bib53.1.1" class="ltx_text ltx_font_italic">Advances in Neural Information Processing Systems</span>, 36, 2024.

</span>
</li>
<li id="bib.bib54" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[54]</span>
<span class="ltx_bibblock">
M. L. Siddiq, S. Dristi, J. Saha, and J. Santos.

</span>
<span class="ltx_bibblock">Quality assessment of prompts used in code generation.

</span>
<span class="ltx_bibblock"><span id="bib.bib54.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2404.10155</span>, 2024.

</span>
</li>
<li id="bib.bib55" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[55]</span>
<span class="ltx_bibblock">
G. Team, T. Mesnard, C. Hardin, R. Dadashi, S. Bhupatiraju, S. Pathak, L. Sifre, M. Rivière, M. S. Kale, J. Love, et al.

</span>
<span class="ltx_bibblock">Gemma: Open models based on gemini research and technology.

</span>
<span class="ltx_bibblock"><span id="bib.bib55.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2403.08295</span>, 2024.

</span>
</li>
<li id="bib.bib56" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[56]</span>
<span class="ltx_bibblock">
J. Wang, Y. Huang, C. Chen, Z. Liu, S. Wang, and Q. Wang.

</span>
<span class="ltx_bibblock">Software testing with large language models: Survey, landscape, and vision.

</span>
<span class="ltx_bibblock"><span id="bib.bib56.1.1" class="ltx_text ltx_font_italic">IEEE Transactions on Software Engineering</span>, 2024.

</span>
</li>
<li id="bib.bib57" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[57]</span>
<span class="ltx_bibblock">
S. Wang, Z. Li, H. Qian, C. Yang, Z. Wang, M. Shang, V. Kumar, S. Tan, B. Ray, P. Bhatia, et al.

</span>
<span class="ltx_bibblock">Recode: Robustness evaluation of code generation models.

</span>
<span class="ltx_bibblock">In <span id="bib.bib57.1.1" class="ltx_text ltx_font_italic">The 61st Annual Meeting Of The Association For Computational Linguistics</span>, 2023.

</span>
</li>
<li id="bib.bib58" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[58]</span>
<span class="ltx_bibblock">
Z. Wang, S. Zhou, D. Fried, and G. Neubig.

</span>
<span class="ltx_bibblock">Execution-based evaluation for open-domain code generation.

</span>
<span class="ltx_bibblock">In <span id="bib.bib58.1.1" class="ltx_text ltx_font_italic">Findings of the Association for Computational Linguistics: EMNLP 2023</span>, pages 1271–1290, 2023.

</span>
</li>
<li id="bib.bib59" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[59]</span>
<span class="ltx_bibblock">
Y. Wei, Z. Wang, J. Liu, Y. Ding, and L. Zhang.

</span>
<span class="ltx_bibblock">Magicoder: Source code is all you need.

</span>
<span class="ltx_bibblock"><span id="bib.bib59.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2312.02120</span>, 2023.

</span>
</li>
<li id="bib.bib60" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[60]</span>
<span class="ltx_bibblock">
K. E. Wiegers and J. Beatty.

</span>
<span class="ltx_bibblock"><span id="bib.bib60.1.1" class="ltx_text ltx_font_italic">Software requirements</span>.

</span>
<span class="ltx_bibblock">Pearson Education, 2013.

</span>
</li>
<li id="bib.bib61" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[61]</span>
<span class="ltx_bibblock">
Z. Xi, W. Chen, X. Guo, W. He, Y. Ding, B. Hong, M. Zhang, J. Wang, S. Jin, E. Zhou, et al.

</span>
<span class="ltx_bibblock">The rise and potential of large language model based agents: A survey.

</span>
<span class="ltx_bibblock"><span id="bib.bib61.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2309.07864</span>, 2023.

</span>
</li>
<li id="bib.bib62" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[62]</span>
<span class="ltx_bibblock">
C. S. Xia and L. Zhang.

</span>
<span class="ltx_bibblock">Keep the conversation going: Fixing 162 out of 337 bugs for $0.42 each using chatgpt.

</span>
<span class="ltx_bibblock"><span id="bib.bib62.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2304.00385</span>, 2023.

</span>
</li>
<li id="bib.bib63" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[63]</span>
<span class="ltx_bibblock">
F. Yan, H. Mao, C. C.-J. Ji, T. Zhang, S. G. Patil, I. Stoica, and J. E. Gonzalez.

</span>
<span class="ltx_bibblock">Berkeley function calling leaderboard.

</span>
<span class="ltx_bibblock"><a target="_blank" href="https://gorilla.cs.berkeley.edu/blogs/8_berkeley_function_calling_leaderboard.html" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://gorilla.cs.berkeley.edu/blogs/8_berkeley_function_calling_leaderboard.html</a>, 2024.

</span>
</li>
<li id="bib.bib64" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[64]</span>
<span class="ltx_bibblock">
J. Yang, C. E. Jimenez, A. Wettig, K. Lieret, S. Yao, K. Narasimhan, and O. Press.

</span>
<span class="ltx_bibblock">Swe-agent: Agent-computer interfaces enable automated software engineering.

</span>
</li>
<li id="bib.bib65" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[65]</span>
<span class="ltx_bibblock">
S. Yang, W.-L. Chiang, L. Zheng, J. E. Gonzalez, and I. Stoica.

</span>
<span class="ltx_bibblock">Rethinking benchmark and contamination for language models with rephrased samples.

</span>
<span class="ltx_bibblock"><span id="bib.bib65.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2311.04850</span>, 2023.

</span>
</li>
<li id="bib.bib66" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[66]</span>
<span class="ltx_bibblock">
A. Young, B. Chen, C. Li, C. Huang, G. Zhang, G. Zhang, H. Li, J. Zhu, J. Chen, J. Chang, et al.

</span>
<span class="ltx_bibblock">Yi: Open foundation models by 01. ai.

</span>
<span class="ltx_bibblock"><span id="bib.bib66.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2403.04652</span>, 2024.

</span>
</li>
<li id="bib.bib67" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[67]</span>
<span class="ltx_bibblock">
D. Zan, B. Chen, Z. Lin, B. Guan, W. Yongji, and J.-G. Lou.

</span>
<span class="ltx_bibblock">When language model meets private library.

</span>
<span class="ltx_bibblock">In <span id="bib.bib67.1.1" class="ltx_text ltx_font_italic">Findings of the Association for Computational Linguistics: EMNLP 2022</span>, pages 277–288, 2022.

</span>
</li>
<li id="bib.bib68" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[68]</span>
<span class="ltx_bibblock">
D. Zan, B. Chen, D. Yang, Z. Lin, M. Kim, B. Guan, Y. Wang, W. Chen, and J.-G. Lou.

</span>
<span class="ltx_bibblock">Cert: continual pre-training on sketches for library-oriented code generation.

</span>
<span class="ltx_bibblock"><span id="bib.bib68.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2206.06888</span>, 2022.

</span>
</li>
<li id="bib.bib69" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[69]</span>
<span class="ltx_bibblock">
D. Zan, B. Chen, F. Zhang, D. Lu, B. Wu, B. Guan, W. Yongji, and J.-G. Lou.

</span>
<span class="ltx_bibblock">Large language models meet nl2code: A survey.

</span>
<span class="ltx_bibblock">In <span id="bib.bib69.1.1" class="ltx_text ltx_font_italic">Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)</span>, pages 7443–7464, 2023.

</span>
</li>
<li id="bib.bib70" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[70]</span>
<span class="ltx_bibblock">
L. Zheng, W.-L. Chiang, Y. Sheng, S. Zhuang, Z. Wu, Y. Zhuang, Z. Lin, Z. Li, D. Li, E. Xing, et al.

</span>
<span class="ltx_bibblock">Judging llm-as-a-judge with mt-bench and chatbot arena.

</span>
<span class="ltx_bibblock"><span id="bib.bib70.1.1" class="ltx_text ltx_font_italic">Advances in Neural Information Processing Systems</span>, 36, 2024.

</span>
</li>
<li id="bib.bib71" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[71]</span>
<span class="ltx_bibblock">
X. Zhout, K. Kim, B. Xu, J. Liu, D. Han, and D. Lo.

</span>
<span class="ltx_bibblock">The devil is in the tails: How long-tailed code distributions impact large language models.

</span>
<span class="ltx_bibblock">In <span id="bib.bib71.1.1" class="ltx_text ltx_font_italic">2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE)</span>, pages 40–52. IEEE, 2023.

</span>
</li>
<li id="bib.bib72" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[72]</span>
<span class="ltx_bibblock">
T. Y. Zhuo, Z. Yang, Z. Sun, Y. Wang, L. Li, X. Du, Z. Xing, and D. Lo.

</span>
<span class="ltx_bibblock">Data augmentation approaches for source code models: A survey.

</span>
<span class="ltx_bibblock"><span id="bib.bib72.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2305.19915</span>, 2023.

</span>
</li>
<li id="bib.bib73" class="ltx_bibitem">
<span class="ltx_tag ltx_tag_bibitem">[73]</span>
<span class="ltx_bibblock">
T. Y. Zhuo, A. Zebaze, N. Suppattarachai, L. von Werra, H. de Vries, Q. Liu, and N. Muennighoff.

</span>
<span class="ltx_bibblock">Astraios: Parameter-efficient instruction tuning code large language models.

</span>
<span class="ltx_bibblock"><span id="bib.bib73.1.1" class="ltx_text ltx_font_italic">arXiv preprint arXiv:2401.00788</span>, 2024.

</span>
</li>
</ul>
</section>
<div class="ltx_pagination ltx_role_newpage"></div>
<section id="Pt1" class="ltx_part">
<h2 class="ltx_title ltx_title_part"></h2>

<section id="Ax1" class="ltx_appendix">
<h3 class="ltx_title ltx_font_bold ltx_title_appendix">Appendix</h3>

<div id="Ax1.p1" class="ltx_para ltx_noindent">
<span id="Ax1.p1.1" class="ltx_ERROR undefined">\mtcsettitle</span>
<p id="Ax1.p1.2" class="ltx_p">parttocContents
<span id="Ax1.p1.2.1" class="ltx_ERROR undefined">\parttoc</span></p>
</div>
<div class="ltx_pagination ltx_role_newpage"></div>
</section>
<section id="A1" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix A </span>Contributions</h3>

<section id="A1.SSx1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">Project Leadership</h4>

<div id="A1.SSx1.p1" class="ltx_para ltx_noindent">
<p id="A1.SSx1.p1.1" class="ltx_p">Terry Yue Zhuo</p>
</div>
</section>
<section id="A1.SSx2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">Benchmark Construction</h4>

<div id="A1.SSx2.p1" class="ltx_para ltx_noindent">
<p id="A1.SSx2.p1.1" class="ltx_p">Chien Vu,
Jenny Chim,
Han Hu,
Haolan Zhan,
Xiaoheng Hong,
Wenhao Yu,
Niklas Muennighoff,
Jean Kaddor,
Wen-Ding Li,
Junda He,
Ming Xu,
Zhihan Zhang,
Ratnadira Widyasari,
Indraneil Paul,
Simon Brunner,
Imam Nur Bani Yusuf,
Thong Hoang,
Chen Gong,
Armel Zebaze,
Prateek Yadav,
Terry Yue Zhuo</p>
</div>
</section>
<section id="A1.SSx3" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">Experiment</h4>

<div id="A1.SSx3.p1" class="ltx_para ltx_noindent">
<p id="A1.SSx3.p1.1" class="ltx_p">Terry Yue Zhuo,
Binyuan Hui</p>
</div>
</section>
<section id="A1.SSx4" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">Evaluation Framework</h4>

<div id="A1.SSx4.p1" class="ltx_para ltx_noindent">
<p id="A1.SSx4.p1.1" class="ltx_p">Terry Yue Zhuo,
Indraneil Paul,
Jiawei Liu,
Zhoujun Cheng</p>
</div>
</section>
<section id="A1.SSx5" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">Analysis</h4>

<div id="A1.SSx5.p1" class="ltx_para ltx_noindent">
<p id="A1.SSx5.p1.1" class="ltx_p">Terry Yue Zhuo,
Binyuan Hui,
Zhoujun Cheng,
Alex Gu,
Naman Jain</p>
</div>
</section>
<section id="A1.SSx6" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">Paper Writing</h4>

<div id="A1.SSx6.p1" class="ltx_para ltx_noindent">
<p id="A1.SSx6.p1.1" class="ltx_p">Terry Yue Zhuo</p>
</div>
</section>
<section id="A1.SSx7" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">Presentation Editing</h4>

<div id="A1.SSx7.p1" class="ltx_para ltx_noindent">
<p id="A1.SSx7.p1.1" class="ltx_p">Niklas Muennighoff,
Indraneil Paul,
David Lo,
Zijian Wang,
Daniel Fried,
Binyuan Hui,
Qian Liu,
Jean Kaddor,
Jiawei Liu,
Imam Nur Bani Yusuf,
Chen Gong</p>
</div>
</section>
<section id="A1.SSx8" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">Long-term Advice &amp; Support</h4>

<div id="A1.SSx8.p1" class="ltx_para ltx_noindent">
<p id="A1.SSx8.p1.1" class="ltx_p">Daniel Fried,
Niklas Muennighoff,
Qian Liu,
Zijian Wang,
Binyuan Hui,
Xiaoning Du,
David Lo,
Jiawei Liu,
Harm de Vries,
Leandro von Werra</p>
</div>
</section>
</section>
<section id="A2" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix B </span>Datacard</h3>

<div id="A2.p1" class="ltx_para ltx_noindent">
<p id="A2.p1.1" class="ltx_p">We follow <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib11" title="" class="ltx_ref">11</a>]</cite> to create the datacard for <span id="A2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, where we tend to summarize and centralize all information that might be relevant for the benchmark analysis.</p>
</div>
<section id="A2.SS0.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Curation Rationale</h6>

<div id="A2.SS0.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="A2.SS0.SSS0.Px1.p1.1" class="ltx_p">This is detailed in <a href="#S2" title="2 Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Section 2</span></a> and <a href="#A7" title="Appendix G Detailed Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix G</span></a>.</p>
</div>
</section>
<section id="A2.SS0.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Language Variety</h6>

<div id="A2.SS0.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="A2.SS0.SSS0.Px2.p1.1" class="ltx_p">Information about our annotators’ nationality will not be provided, as the constructed benchmark is hardly related to regional or social dialects. However, we confirm that all communications during the annotation process are in mainstream English (en-US). We note that the first language of some annotators is not English, which can introduce some inaccurate expressions to the task prompts in <span id="A2.SS0.SSS0.Px2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>.</p>
</div>
</section>
<section id="A2.SS0.SSS0.Px3" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Curators Demographic</h6>

<div id="A2.SS0.SSS0.Px3.p1" class="ltx_para ltx_noindent">
<p id="A2.SS0.SSS0.Px3.p1.1" class="ltx_p">The benchmark construction requires the great annotation effort of Curators, who are involved in the process detailed in <a href="#S2" title="2 Benchmark Construction ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Section 2</span></a>. They come from the following population:</p>
</div>
<div id="A2.SS0.SSS0.Px3.p2" class="ltx_para ltx_noindent">
<span id="A2.SS0.SSS0.Px3.p2.1" class="ltx_ERROR undefined">{easylist}</span>
<p id="A2.SS0.SSS0.Px3.p2.2" class="ltx_p">[itemize]
@ <span id="A2.SS0.SSS0.Px3.p2.2.1" class="ltx_text ltx_font_bold">Age</span>:
@@ 18-25: 25% (5/20)
@@ 26-35: 70% (14/20)
@@ 36-45: 5% (1/20)
@ <span id="A2.SS0.SSS0.Px3.p2.2.2" class="ltx_text ltx_font_bold">Experience in Python Programming (Years)</span>:
@@ 1-3: 5% (1/20)
@@ 3-5: 20% (4/20)
@@ 5+: 75% (15/20)
@ <span id="A2.SS0.SSS0.Px3.p2.2.3" class="ltx_text ltx_font_bold">Academic Background</span>:
@@ Bachelor: 5% (1/20)
@@ Master: 20% (4/20)
@@ PhD: 75% (15/20)</p>
</div>
</section>
<section id="A2.SS0.SSS0.Px4" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Text Characteristics</h6>

<div id="A2.SS0.SSS0.Px4.p1" class="ltx_para ltx_noindent">
<p id="A2.SS0.SSS0.Px4.p1.1" class="ltx_p">This is detailed in <a href="#S3" title="3 Benchmark Statistics ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Section 3</span></a>.</p>
</div>
</section>
</section>
<section id="A3" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix C </span>Data Sheet</h3>

<div id="A3.p1" class="ltx_para ltx_noindent">
<p id="A3.p1.1" class="ltx_p">Besides the provided Datacard, we follow the documentation frameworks provided by <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib21" title="" class="ltx_ref">21</a>]</cite>.</p>
</div>
<section id="A3.SS1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">C.1 </span>Motivation</h4>

<section id="A3.SS1.SSS1" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">C.1.1 </span>For what purpose was the dataset created?</h5>

<div id="A3.SS1.SSS1.p1" class="ltx_para ltx_noindent">
<p id="A3.SS1.SSS1.p1.1" class="ltx_p">Our dataset aims at providing a thorough assessment of the capability of solving programming tasks. Particularly, we focus on the challenges and practicability of the tasks, and pinpoint two main characteristics that few benchmarks highlight: (1) Diverse Function Calling; and (2) Complex Instruction Following. This dataset will help stakeholders better understand the fundamental abilities and limitations associated with deploying LLMs.</p>
</div>
<div id="A3.SS1.SSS1.p2" class="ltx_para ltx_noindent">
<p id="A3.SS1.SSS1.p2.1" class="ltx_p">We believe that there are three main expectations of a good execution-based programming benchmark:</p>
</div>
<div id="A3.SS1.SSS1.p3" class="ltx_para ltx_noindent">
<ul id="A3.I1" class="ltx_itemize">
<li id="A3.I1.i1" class="ltx_item" style="list-style-type:none;">
<span class="ltx_tag ltx_tag_item">•</span> 
<div id="A3.I1.i1.p1" class="ltx_para">
<p id="A3.I1.i1.p1.1" class="ltx_p">The benchmark should be easy to use and efficient in evaluating the fundamental capabilities of LLMs. Repo-level benchmarks (e.g., SWE-bench <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib64" title="" class="ltx_ref">64</a>]</cite>) are not suitable for this purpose.</p>
</div>
</li>
<li id="A3.I1.i2" class="ltx_item" style="list-style-type:none;">
<span class="ltx_tag ltx_tag_item">•</span> 
<div id="A3.I1.i2.p1" class="ltx_para">
<p id="A3.I1.i2.p1.1" class="ltx_p">The benchmark should be practical, covering various programming scenarios. Algorithm-specific benchmarks (e.g., HumanEval <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib14" title="" class="ltx_ref">14</a>]</cite> and MBPP <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib9" title="" class="ltx_ref">9</a>]</cite>) are unsuitable. Domain-specific benchmarks (e.g., DS-1000 <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib32" title="" class="ltx_ref">32</a>]</cite>) are also unsuitable for this purpose.</p>
</div>
</li>
<li id="A3.I1.i3" class="ltx_item" style="list-style-type:none;">
<span class="ltx_tag ltx_tag_item">•</span> 
<div id="A3.I1.i3.p1" class="ltx_para ltx_noindent">
<p id="A3.I1.i3.p1.1" class="ltx_p">The benchmark should be challenging, where the tasks require LLMs’ strong compositional reasoning capabilities and instruction-following capabilities. The benchmarks with simple tasks (e.g., ODEX <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib58" title="" class="ltx_ref">58</a>]</cite>) are unsuitable.</p>
</div>
</li>
</ul>
</div>
<div id="A3.SS1.SSS1.p4" class="ltx_para ltx_noindent">
<p id="A3.SS1.SSS1.p4.1" class="ltx_p">BigCodeBench is the first benchmark that meets all three expectations. It is an easy-to-use benchmark that evaluates LLMs with practical and challenging programming tasks, accompanied by an end-to-end evaluation framework <a target="_blank" href="https://github.com/bigcode-project/bigcodebench" title="" class="ltx_ref ltx_href ltx_font_typewriter">bigcodebench</a>. We aim to assess how well LLMs can solve programming tasks in an open-ended setting.</p>
</div>
</section>
</section>
<section id="A3.SS2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">C.2 </span>Composition/Collection Process/Preprocessing/Cleaning/Labeling and Use</h4>

<div id="A3.SS2.p1" class="ltx_para ltx_noindent">
<p id="A3.SS2.p1.1" class="ltx_p">The answers are described in our paper as well as the GitHub repository: <a target="_blank" href="https://github.com/bigcode-project/bigcodebench-annotation" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/bigcode-project/bigcodebench-annotation</a>.</p>
</div>
</section>
<section id="A3.SS3" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">C.3 </span>Distribution</h4>

<section id="A3.SS3.SSS1" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">C.3.1 </span>Will the dataset be distributed to third parties outside of the entity (e.g., company, institution, organization) on behalf of which the dataset was created?</h5>

<div id="A3.SS3.SSS1.p1" class="ltx_para ltx_noindent">
<p id="A3.SS3.SSS1.p1.1" class="ltx_p">No. Our dataset will be managed and maintained by the BigCode community (<a target="_blank" href="https://www.bigcode-project.org/" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://www.bigcode-project.org/</a>).</p>
</div>
</section>
<section id="A3.SS3.SSS2" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">C.3.2 </span>How will the dataset be distributed (e.g., tarball on website, API, GitHub)?</h5>

<div id="A3.SS3.SSS2.p1" class="ltx_para ltx_noindent">
<p id="A3.SS3.SSS2.p1.1" class="ltx_p">The evaluation dataset is released to the public, and hosted on GitHub and Hugging Face.</p>
</div>
</section>
<section id="A3.SS3.SSS3" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">C.3.3 </span>When will the dataset be distributed?</h5>

<div id="A3.SS3.SSS3.p1" class="ltx_para ltx_noindent">
<p id="A3.SS3.SSS3.p1.1" class="ltx_p">It has been released now.</p>
</div>
</section>
<section id="A3.SS3.SSS4" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">C.3.4 </span>Will the dataset be distributed under a copyright or other intellectual property (IP) license, and/or under applicable terms of use (ToU)?</h5>

<div id="A3.SS3.SSS4.p1" class="ltx_para ltx_noindent">
<p id="A3.SS3.SSS4.p1.1" class="ltx_p">Our dataset is distributed under the Apache-2.0 license.</p>
</div>
</section>
</section>
<section id="A3.SS4" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">C.4 </span>Maintenance</h4>

<section id="A3.SS4.SSS1" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">C.4.1 </span>How can the owner/curator/manager of the dataset be contacted (e.g., email address)?</h5>

<div id="A3.SS4.SSS1.p1" class="ltx_para ltx_noindent">
<p id="A3.SS4.SSS1.p1.1" class="ltx_p">Please contact Terry Yue Zhuo (<a href="mailto:terry.zhuo@monash.edu" title="" class="ltx_ref ltx_href ltx_font_typewriter">terry.zhuo@monash.edu</a>) and the BigCode Project (<a href="mailto:contact@bigcode-project.org" title="" class="ltx_ref ltx_href ltx_font_typewriter">contact@bigcode-project.org</a>), who are responsible for maintenance.</p>
</div>
</section>
<section id="A3.SS4.SSS2" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">C.4.2 </span>Will the dataset be updated (e.g., to correct labeling errors, add new instances, delete instances)?</h5>

<div id="A3.SS4.SSS2.p1" class="ltx_para ltx_noindent">
<p id="A3.SS4.SSS2.p1.1" class="ltx_p">Yes. If we include more tasks or find any errors, we will correct the dataset hosted on Hugging Face and GitHub and update the results in the leaderboard accordingly. It will be updated on our website.</p>
</div>
</section>
<section id="A3.SS4.SSS3" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">C.4.3 </span>If others want to extend/augment/build on/contribute to the dataset, is there a mechanism for them to do so?</h5>

<div id="A3.SS4.SSS3.p1" class="ltx_para ltx_noindent">
<p id="A3.SS4.SSS3.p1.1" class="ltx_p">For dataset contributions and evaluation modifications, the most efficient way to reach us is via GitHub pull requests. For more questions, please contact Terry Yue Zhuo (<a href="mailto:terry.zhuo@monash.edu" title="" class="ltx_ref ltx_href ltx_font_typewriter">terry.zhuo@monash.edu</a>) and BigCode Project (<a href="mailto:contact@bigcode-project.org" title="" class="ltx_ref ltx_href ltx_font_typewriter">contact@bigcode-project.org</a>), who are responsible for maintenance.</p>
</div>
</section>
</section>
</section>
<section id="A4" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix D </span>Long-Term Roadmap and Call for Contributions</h3>

<div id="A4.p1" class="ltx_para ltx_noindent">
<p id="A4.p1.1" class="ltx_p">In this section, we share a long-term roadmap to address the limitations of <span id="A4.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, and sustainably build with the community. We believe that program-aided language models <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib20" title="" class="ltx_ref">20</a>]</cite> for task completion and reasoning provide the possibility towards artificial general intelligence. Our goal is to provide the community with the most open, reliable, and scalable evaluations to truly understand the fundamental capabilities of LLMs for programming, pinpointing the ways to unleash their power.</p>
</div>
<section id="A4.SS1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">D.1 </span>Limitations</h4>

<div id="A4.SS1.p1" class="ltx_para ltx_noindent">
<p id="A4.SS1.p1.1" class="ltx_p">Given the limited time and budget we have to develop the initial benchmark, we have foreseen several limitations and aim to address them step-by-step.</p>
</div>
<section id="A4.SS1.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Multilingualism</h6>

<div id="A4.SS1.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="A4.SS1.SSS0.Px1.p1.1" class="ltx_p">One of the main limitations is that <span id="A4.SS1.SSS0.Px1.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> is Python-only and cannot be easily extended to other programming languages. As the function calls are mostly language-specific, we may not be able to find a package or library with exactly the same functionalities other than Python. However, given the fact that Python is the most flexible and popular programming language used by software developers, <span id="A4.SS1.SSS0.Px1.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span> may fulfill most of the community needs. In the meantime, we still seek efficient approaches to construct <span id="A4.SS1.SSS0.Px1.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-like programming tasks with tools in other languages, without much human effort.</p>
</div>
</section>
<section id="A4.SS1.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Saturation</h6>

<div id="A4.SS1.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="A4.SS1.SSS0.Px2.p1.1" class="ltx_p">Another potential criticism is that some LLMs can still perform reasonably well <span id="A4.SS1.SSS0.Px2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, considering that the best models can only resolve no more than 30% of real-world GitHub issues on SWE-bench. One might indicate that our benchmark is not challenging enough. However, we note that the low performance on SWE-bench is likely due to the under-specified instructions and misaligned test cases<span id="footnote5" class="ltx_note ltx_role_footnote"><sup class="ltx_note_mark">5</sup><span class="ltx_note_outer"><span class="ltx_note_content"><sup class="ltx_note_mark">5</sup><span class="ltx_tag ltx_tag_note">5</span><a target="_blank" href="https://github.com/princeton-nlp/SWE-bench/issues/72" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/princeton-nlp/SWE-bench/issues/72</a></span></span></span>. Compared to SWE-bench, we tend to make the programming tasks much less ambiguous and ensure that the authors can pass their own solutions during annotation.</p>
</div>
</section>
<section id="A4.SS1.SSS0.Px3" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Reliability</h6>

<div id="A4.SS1.SSS0.Px3.p1" class="ltx_para ltx_noindent">
<p id="A4.SS1.SSS0.Px3.p1.1" class="ltx_p">During the execution-based evaluation, we notice that some test cases are flaky <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib37" title="" class="ltx_ref">37</a>]</cite>, which results in uncertainty across multiple test runs without any code changes. We have progressively resolved some identified issues, such as missing setup of random states and improper removal of non-existent files. However, the remaining cases are trickier. For example, the socket query can be timed out or refused due to the unstable connection. With that being said, we try our best to make the uncontrollable changes of Pass@1 under 0.6%. We plan to continually enhance the reliability of all test cases, with the help of the community.</p>
</div>
</section>
<section id="A4.SS1.SSS0.Px4" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Efficiency</h6>

<div id="A4.SS1.SSS0.Px4.p1" class="ltx_para ltx_noindent">
<p id="A4.SS1.SSS0.Px4.p1.1" class="ltx_p">Currently, our execution-based evaluation requires non-trivial computational resources on CPUs. Our machines with 36 CPU cores typically execute the tests for 1,140 samples under 10 minutes, with the default time limits. For machines with few cores, it may take 1 - 2 hours to finish, which is quite costly. The main reason behind the long-time execution is due to the heavy dependency on external libraries and the complex computation required in specific programming tasks. We will make an effort to improve the efficiency of the evaluation to ease the burden.</p>
</div>
</section>
<section id="A4.SS1.SSS0.Px5" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Rigorousness</h6>

<div id="A4.SS1.SSS0.Px5.p1" class="ltx_para ltx_noindent">
<p id="A4.SS1.SSS0.Px5.p1.1" class="ltx_p">While we achieve high test coverage for the ground-truth solutions in <span id="A4.SS1.SSS0.Px5.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, it does not guarantee that any code generated by LLMs will be correctly assessed against existing test cases. Previous works like EvalPlus <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib35" title="" class="ltx_ref">35</a>]</cite> have attempted to extend the limited test cases by augmenting the input-output pairs via LLM- and mutation-based strategies. However, it is challenging to adapt EvaPlus to the test harness in <span id="A4.SS1.SSS0.Px5.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, as the harness only examines the expected program behaviors during the runtime (e.g., mocking tests). Furthermore, the function calls used to pass test cases by LLMs are more nondeterministic, making traditional test generation <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib7" title="" class="ltx_ref">7</a>]</cite> methods cover all possible scenarios. Therefore, we still consider LLM-based test generation <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib56" title="" class="ltx_ref">56</a>]</cite> promising, but with proper designs. Specifically, a possible approach is to collect all the generated solutions that pass the current test cases and make a capable LLM (e.g., GPT-4o) harness with self-refinement in a sandbox environment.</p>
</div>
</section>
<section id="A4.SS1.SSS0.Px6" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Generalization</h6>

<div id="A4.SS1.SSS0.Px6.p1" class="ltx_para ltx_noindent">
<p id="A4.SS1.SSS0.Px6.p1.1" class="ltx_p">One intuitive question is “How well do the models generalize to the unseen tools and tasks?” Current <span id="A4.SS1.SSS0.Px6.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> only covers the common libraries and daily programming tasks. It will be more interesting to benchmark models on the programming tasks that use emerging libraries like <a target="_blank" href="https://github.com/huggingface/transformers" title="" class="ltx_ref ltx_href ltx_font_typewriter">transformers</a> and <a target="_blank" href="https://github.com/langchain-ai/langchain" title="" class="ltx_ref ltx_href ltx_font_typewriter">langchain</a>. Crafting new high-quality programming tasks requires huge effort, as demonstrated in this paper. There are two efficient approaches for building a programming benchmark for model generalization. First, we can instruction tune an LLM on <span id="A4.SS1.SSS0.Px6.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span> data with additional information of libraries and function calls. The trained model is expected to generate programming tasks with proper test cases based on the given library or function call details.
However, the quality of such data synthesis is unknown, making the practicability questionable.
Another way is to replace the function calls and libraries in <span id="A4.SS1.SSS0.Px6.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span> with the synthetic names, simulating the unseen ones. A similar approach <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib68" title="" class="ltx_ref">68</a>]</cite> has been used for code generation on unknown libraries. Although this method may lose the naturalness of software development, the construction process is more controllable and practical.</p>
</div>
</section>
<section id="A4.SS1.SSS0.Px7" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Evolution</h6>

<div id="A4.SS1.SSS0.Px7.p1" class="ltx_para ltx_noindent">
<p id="A4.SS1.SSS0.Px7.p1.1" class="ltx_p">Naturally, the libraries can be obsolete or updated <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib33" title="" class="ltx_ref">33</a>]</cite>, which means that the source code data for model training will constantly evolve. Thus, the models may not memorize function calls from a deprecated library version. This poses a challenge for any tool-dependent programming benchmarks to correctly examine the model capability without periodic updates. Another related concern is the test set contamination issue due to the evolving training data. It is suggested to have both a public set and a private set for better evaluation in a recent blog<span id="footnote6" class="ltx_note ltx_role_footnote"><sup class="ltx_note_mark">6</sup><span class="ltx_note_outer"><span class="ltx_note_content"><sup class="ltx_note_mark">6</sup><span class="ltx_tag ltx_tag_note">6</span><a target="_blank" href="https://www.jasonwei.net/blog/evals" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://www.jasonwei.net/blog/evals</a></span></span></span>. For future releases, we aim to perform the benchmark evolution both publicly and privately, and host the private test set internally.</p>
</div>
</section>
<section id="A4.SS1.SSS0.Px8" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Interaction</h6>

<div id="A4.SS1.SSS0.Px8.p1" class="ltx_para ltx_noindent">
<p id="A4.SS1.SSS0.Px8.p1.1" class="ltx_p">Recent interests are around the concept of <span id="A4.SS1.SSS0.Px8.p1.1.1" class="ltx_text ltx_font_italic">LLMs as Agents</span> <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib61" title="" class="ltx_ref">61</a>]</cite>, which is deemed as a way towards artificial general intelligence. Specifically, LLMs will be grounded in a less constrained sandbox environment, where they can interact with any given applications, such as the web browser and terminal. The environment can help unlock the capabilities like self-debugging <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib15" title="" class="ltx_ref">15</a>]</cite> and self-reflection <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib53" title="" class="ltx_ref">53</a>]</cite>. We tend to work in this direction and see how well <span id="A4.SS1.SSS0.Px8.p1.1.2" class="ltx_text ltx_font_italic">LLMs as Agents</span> can perform on <span id="A4.SS1.SSS0.Px8.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>.</p>
</div>
</section>
</section>
<section id="A4.SS2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">D.2 </span><span id="A4.SS2.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-Mini</h4>

<div id="A4.SS2.p1" class="ltx_para ltx_noindent">
<p id="A4.SS2.p1.1" class="ltx_p">Running the full set of <span id="A4.SS2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> will be burdensome for common users, especially when evaluating a large model on both <span id="A4.SS2.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A4.SS2.p1.1.3" class="ltx_text ltx_font_typewriter">Complete</span> and <span id="A4.SS2.p1.1.4" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A4.SS2.p1.1.5" class="ltx_text ltx_font_typewriter">Instruct</span>. In order to save budgets, we plan to release a minimal high-quality subset of <span id="A4.SS2.p1.1.6" class="ltx_text ltx_font_typewriter">BigCodeBench</span>, serving as a proxy for the full set. To conclude the best practice, We will explore the evaluation results with multiple approaches like manual selection, hash-based deduplication <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib13" title="" class="ltx_ref">13</a>]</cite> and LLM-based decontamination <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib65" title="" class="ltx_ref">65</a>]</cite>.</p>
</div>
</section>
<section id="A4.SS3" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">D.3 </span><span id="A4.SS3.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-OOD</h4>

<div id="A4.SS3.p1" class="ltx_para ltx_noindent">
<p id="A4.SS3.p1.1" class="ltx_p">We will construct <span id="A4.SS3.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-OOD, a variant of <span id="A4.SS3.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span> that assesses the generalization ability on out-of-distribution (OOD) libraries and programming tasks <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib71" title="" class="ltx_ref">71</a>]</cite>. We note that any features that do not frequently appear can be considered OOD. We tend to build <span id="A4.SS3.p1.1.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-OOD with two different types of OOD: (1) Completely synthetic features; and (2) Real but long-tail features. The first type can represent the private libraries that are unknown to the models, and the latter one may represent the ones trending in the recent programming practice but have not yet played major roles in the training data.</p>
</div>
</section>
<section id="A4.SS4" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">D.4 </span><span id="A4.SS4.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-Interact</h4>

<div id="A4.SS4.p1" class="ltx_para ltx_noindent">
<p id="A4.SS4.p1.1" class="ltx_p">To examine the agent-centric programming ability, we will adapt <span id="A4.SS4.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> to an interactive sandbox environment, with a list of applications that can help models program and repair iteratively as humans. Unlike existing programming benchmarks such as HumanEval and MBPP, <span id="A4.SS4.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span> covers a wide range of tasks that require profound programming knowledge. Without the proper understanding, models are likely to fail in debugging and repair. There are potentially two options for the evaluation. One naive option is to allow models to see the backtrace of how they fail in the test cases, which can guide them to repair the bugs with a clear goal. A more challenging setup is to make models fix bugs independently without seeing any backtrace. Capable models are expected to resolve issues by generating their own test cases and inspecting the execution outcomes.</p>
</div>
</section>
</section>
<section id="A5" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix E </span>Artifacts</h3>

<figure id="A5.T4" class="ltx_table">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_table">Table 4: </span>Artifacts for reproducibility.</figcaption>
<div id="A5.T4.1" class="ltx_inline-block ltx_align_center ltx_transformed_outer" style="width:433.6pt;height:1072.7pt;vertical-align:-0.0pt;"><span class="ltx_transformed_inner" style="transform:translate(-79.5pt,196.7pt) scale(0.731692144744747,0.731692144744747) ;">
<table id="A5.T4.1.1" class="ltx_tabular ltx_align_middle">
<tr id="A5.T4.1.1.1" class="ltx_tr">
<td id="A5.T4.1.1.1.1" class="ltx_td ltx_align_left ltx_border_tt"><span id="A5.T4.1.1.1.1.1" class="ltx_text ltx_font_bold">Name</span></td>
<td id="A5.T4.1.1.1.2" class="ltx_td ltx_align_left ltx_border_tt"><span id="A5.T4.1.1.1.2.1" class="ltx_text ltx_font_bold">Public Link or Endpoint</span></td>
</tr>
<tr id="A5.T4.1.1.2" class="ltx_tr">
<td id="A5.T4.1.1.2.1" class="ltx_td ltx_align_center ltx_border_t" colspan="2"><span id="A5.T4.1.1.2.1.1" class="ltx_text ltx_font_typewriter ltx_font_italic">BigCodeBench<span id="A5.T4.1.1.2.1.1.1" class="ltx_text ltx_font_serif"> (v0.1.0)</span></span></td>
</tr>
<tr id="A5.T4.1.1.3" class="ltx_tr">
<td id="A5.T4.1.1.3.1" class="ltx_td ltx_align_left ltx_border_t">GitHub</td>
<td id="A5.T4.1.1.3.2" class="ltx_td ltx_align_left ltx_border_t"><a target="_blank" href="https://github.com/bigcode-project/bigcodebench-annotation/releases/tag/v0.1.0" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/bigcode-project/bigcodebench-annotation/releases/tag/v0.1.0</a></td>
</tr>
<tr id="A5.T4.1.1.4" class="ltx_tr">
<td id="A5.T4.1.1.4.1" class="ltx_td ltx_align_left">Hugging Face</td>
<td id="A5.T4.1.1.4.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/datasets/bigcode/bigcodebench" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/datasets/bigcode/bigcodebench</a></td>
</tr>
<tr id="A5.T4.1.1.5" class="ltx_tr">
<td id="A5.T4.1.1.5.1" class="ltx_td ltx_align_left">Croissant</td>
<td id="A5.T4.1.1.5.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/api/datasets/bigcode/bigcodebench/croissant" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/api/datasets/bigcode/bigcodebench/croissant</a></td>
</tr>
<tr id="A5.T4.1.1.6" class="ltx_tr">
<td id="A5.T4.1.1.6.1" class="ltx_td ltx_align_center ltx_border_t" colspan="2"><span id="A5.T4.1.1.6.1.1" class="ltx_text ltx_font_italic">Annotation Framework</span></td>
</tr>
<tr id="A5.T4.1.1.7" class="ltx_tr">
<td id="A5.T4.1.1.7.1" class="ltx_td ltx_align_left ltx_border_t">GitHub</td>
<td id="A5.T4.1.1.7.2" class="ltx_td ltx_align_left ltx_border_t"><a target="_blank" href="https://github.com/bigcode-project/bigcodebench-annotation" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/bigcode-project/bigcodebench-annotation</a></td>
</tr>
<tr id="A5.T4.1.1.8" class="ltx_tr">
<td id="A5.T4.1.1.8.1" class="ltx_td ltx_align_center ltx_border_t" colspan="2"><span id="A5.T4.1.1.8.1.1" class="ltx_text ltx_font_italic">Evaluation Framework</span></td>
</tr>
<tr id="A5.T4.1.1.9" class="ltx_tr">
<td id="A5.T4.1.1.9.1" class="ltx_td ltx_align_left ltx_border_t">GitHub</td>
<td id="A5.T4.1.1.9.2" class="ltx_td ltx_align_left ltx_border_t"><a target="_blank" href="https://github.com/bigcode-project/bigcodebench" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/bigcode-project/bigcodebench</a></td>
</tr>
<tr id="A5.T4.1.1.10" class="ltx_tr">
<td id="A5.T4.1.1.10.1" class="ltx_td ltx_align_left">PyPI</td>
<td id="A5.T4.1.1.10.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://pypi.org/project/bigcodebench/" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://pypi.org/project/bigcodebench/</a></td>
</tr>
<tr id="A5.T4.1.1.11" class="ltx_tr">
<td id="A5.T4.1.1.11.1" class="ltx_td ltx_align_center ltx_border_t" colspan="2"><span id="A5.T4.1.1.11.1.1" class="ltx_text ltx_font_italic">Datasets for Comparisons</span></td>
</tr>
<tr id="A5.T4.1.1.12" class="ltx_tr">
<td id="A5.T4.1.1.12.1" class="ltx_td ltx_align_left ltx_border_t">HumanEval</td>
<td id="A5.T4.1.1.12.2" class="ltx_td ltx_align_left ltx_border_t"><a target="_blank" href="https://github.com/openai/human-eval/blob/master/data/HumanEval.jsonl.gz" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/openai/human-eval/blob/master/data/HumanEval.jsonl.gz</a></td>
</tr>
<tr id="A5.T4.1.1.13" class="ltx_tr">
<td id="A5.T4.1.1.13.1" class="ltx_td ltx_align_left">ODEX</td>
<td id="A5.T4.1.1.13.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://github.com/zorazrw/odex/tree/master/data" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/zorazrw/odex/tree/master/data</a></td>
</tr>
<tr id="A5.T4.1.1.14" class="ltx_tr">
<td id="A5.T4.1.1.14.1" class="ltx_td ltx_align_left">DS-1000</td>
<td id="A5.T4.1.1.14.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://github.com/xlang-ai/DS-1000/blob/main/data/ds1000.jsonl.gz" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/xlang-ai/DS-1000/blob/main/data/ds1000.jsonl.gz</a></td>
</tr>
<tr id="A5.T4.1.1.15" class="ltx_tr">
<td id="A5.T4.1.1.15.1" class="ltx_td ltx_align_left">APPS</td>
<td id="A5.T4.1.1.15.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://github.com/hendrycks/apps" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/hendrycks/apps</a></td>
</tr>
<tr id="A5.T4.1.1.16" class="ltx_tr">
<td id="A5.T4.1.1.16.1" class="ltx_td ltx_align_left">APIBench</td>
<td id="A5.T4.1.1.16.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://github.com/ShishirPatil/gorilla/tree/main/data/apibench" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/ShishirPatil/gorilla/tree/main/data/apibench</a></td>
</tr>
<tr id="A5.T4.1.1.17" class="ltx_tr">
<td id="A5.T4.1.1.17.1" class="ltx_td ltx_align_left">MBPP</td>
<td id="A5.T4.1.1.17.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://github.com/google-research/google-research/tree/master/mbpp" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/google-research/google-research/tree/master/mbpp</a></td>
</tr>
<tr id="A5.T4.1.1.18" class="ltx_tr">
<td id="A5.T4.1.1.18.1" class="ltx_td ltx_align_left">NumpyEval</td>
<td id="A5.T4.1.1.18.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://github.com/microsoft/PyCodeGPT/tree/main/cert/pandas-numpy-eval" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/microsoft/PyCodeGPT/tree/main/cert/pandas-numpy-eval</a></td>
</tr>
<tr id="A5.T4.1.1.19" class="ltx_tr">
<td id="A5.T4.1.1.19.1" class="ltx_td ltx_align_left">PandasEval</td>
<td id="A5.T4.1.1.19.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://github.com/microsoft/PyCodeGPT/tree/main/cert/pandas-numpy-eval" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/microsoft/PyCodeGPT/tree/main/cert/pandas-numpy-eval</a></td>
</tr>
<tr id="A5.T4.1.1.20" class="ltx_tr">
<td id="A5.T4.1.1.20.1" class="ltx_td ltx_align_left">TorchDataEval</td>
<td id="A5.T4.1.1.20.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://github.com/microsoft/PyCodeGPT/blob/main/apicoder/private-eval/data/real_torchdata_eval_v3.jsonl.gz" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://github.com/microsoft/PyCodeGPT/blob/main/apicoder/private-eval/data/real_torchdata_eval_v3.jsonl.gz</a></td>
</tr>
<tr id="A5.T4.1.1.21" class="ltx_tr">
<td id="A5.T4.1.1.21.1" class="ltx_td ltx_align_center ltx_border_t" colspan="2"><span id="A5.T4.1.1.21.1.1" class="ltx_text ltx_font_italic">Models for Evaluations</span></td>
</tr>
<tr id="A5.T4.1.1.22" class="ltx_tr">
<td id="A5.T4.1.1.22.1" class="ltx_td ltx_align_left ltx_border_t">GPT-4o</td>
<td id="A5.T4.1.1.22.2" class="ltx_td ltx_align_left ltx_border_t">gpt-4-turbo-2024-04-09</td>
</tr>
<tr id="A5.T4.1.1.23" class="ltx_tr">
<td id="A5.T4.1.1.23.1" class="ltx_td ltx_align_left">GPT-4-Turbo</td>
<td id="A5.T4.1.1.23.2" class="ltx_td ltx_align_left">gpt-4-0125-preview</td>
</tr>
<tr id="A5.T4.1.1.24" class="ltx_tr">
<td id="A5.T4.1.1.24.1" class="ltx_td ltx_align_left">GPT-4</td>
<td id="A5.T4.1.1.24.2" class="ltx_td ltx_align_left">gpt-4-0613</td>
</tr>
<tr id="A5.T4.1.1.25" class="ltx_tr">
<td id="A5.T4.1.1.25.1" class="ltx_td ltx_align_left">GPT-3.5-Turbo</td>
<td id="A5.T4.1.1.25.2" class="ltx_td ltx_align_left">gpt-3.5-turbo-0125</td>
</tr>
<tr id="A5.T4.1.1.26" class="ltx_tr">
<td id="A5.T4.1.1.26.1" class="ltx_td ltx_align_left">Claude-3-Opus</td>
<td id="A5.T4.1.1.26.2" class="ltx_td ltx_align_left">claude-3-opus-20240229</td>
</tr>
<tr id="A5.T4.1.1.27" class="ltx_tr">
<td id="A5.T4.1.1.27.1" class="ltx_td ltx_align_left">Claude-3-Sonnet</td>
<td id="A5.T4.1.1.27.2" class="ltx_td ltx_align_left">claude-3-sonnet-20240229</td>
</tr>
<tr id="A5.T4.1.1.28" class="ltx_tr">
<td id="A5.T4.1.1.28.1" class="ltx_td ltx_align_left">Claude-3-Haiku</td>
<td id="A5.T4.1.1.28.2" class="ltx_td ltx_align_left">claude-3-haiku-20240307</td>
</tr>
<tr id="A5.T4.1.1.29" class="ltx_tr">
<td id="A5.T4.1.1.29.1" class="ltx_td ltx_align_left">DeepSeek-V2-Chat</td>
<td id="A5.T4.1.1.29.2" class="ltx_td ltx_align_left">deepseek-chat (API, 32K)</td>
</tr>
<tr id="A5.T4.1.1.30" class="ltx_tr">
<td id="A5.T4.1.1.30.1" class="ltx_td ltx_align_left">Mistral-Large</td>
<td id="A5.T4.1.1.30.2" class="ltx_td ltx_align_left">mistral-large-2402</td>
</tr>
<tr id="A5.T4.1.1.31" class="ltx_tr">
<td id="A5.T4.1.1.31.1" class="ltx_td ltx_align_left">Mistral-Small</td>
<td id="A5.T4.1.1.31.2" class="ltx_td ltx_align_left">mistral-small-2402</td>
</tr>
<tr id="A5.T4.1.1.32" class="ltx_tr">
<td id="A5.T4.1.1.32.1" class="ltx_td ltx_align_left">DeepSeek-Coder-33b-Instruct</td>
<td id="A5.T4.1.1.32.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct</a></td>
</tr>
<tr id="A5.T4.1.1.33" class="ltx_tr">
<td id="A5.T4.1.1.33.1" class="ltx_td ltx_align_left">DeepSeek-Coder-6.7b-Instruct</td>
<td id="A5.T4.1.1.33.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-instruct</a></td>
</tr>
<tr id="A5.T4.1.1.34" class="ltx_tr">
<td id="A5.T4.1.1.34.1" class="ltx_td ltx_align_left">DeepSeek-Coder-1.3b-Instruct</td>
<td id="A5.T4.1.1.34.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-instruct</a></td>
</tr>
<tr id="A5.T4.1.1.35" class="ltx_tr">
<td id="A5.T4.1.1.35.1" class="ltx_td ltx_align_left">CodeLlama-70B-Instruct</td>
<td id="A5.T4.1.1.35.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf</a></td>
</tr>
<tr id="A5.T4.1.1.36" class="ltx_tr">
<td id="A5.T4.1.1.36.1" class="ltx_td ltx_align_left">CodeLlama–34B-Instruct</td>
<td id="A5.T4.1.1.36.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf</a></td>
</tr>
<tr id="A5.T4.1.1.37" class="ltx_tr">
<td id="A5.T4.1.1.37.1" class="ltx_td ltx_align_left">CodeLlama-13B-Instruct</td>
<td id="A5.T4.1.1.37.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/codellama/CodeLlama-13b-Instruct-hf" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/codellama/CodeLlama-13b-Instruct-hf</a></td>
</tr>
<tr id="A5.T4.1.1.38" class="ltx_tr">
<td id="A5.T4.1.1.38.1" class="ltx_td ltx_align_left">CodeLlama-7B-Instruct</td>
<td id="A5.T4.1.1.38.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/codellama/CodeLlama-7b-Instruct-hf" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/codellama/CodeLlama-7b-Instruct-hf</a></td>
</tr>
<tr id="A5.T4.1.1.39" class="ltx_tr">
<td id="A5.T4.1.1.39.1" class="ltx_td ltx_align_left">Llama-3-70B-Instruct</td>
<td id="A5.T4.1.1.39.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct</a></td>
</tr>
<tr id="A5.T4.1.1.40" class="ltx_tr">
<td id="A5.T4.1.1.40.1" class="ltx_td ltx_align_left">Llama-3-8B-Instruct</td>
<td id="A5.T4.1.1.40.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct</a></td>
</tr>
<tr id="A5.T4.1.1.41" class="ltx_tr">
<td id="A5.T4.1.1.41.1" class="ltx_td ltx_align_left">Qwen2-72B-Instruct</td>
<td id="A5.T4.1.1.41.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/Qwen/Qwen2-72B-Instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/Qwen/Qwen2-72B-Instruct</a></td>
</tr>
<tr id="A5.T4.1.1.42" class="ltx_tr">
<td id="A5.T4.1.1.42.1" class="ltx_td ltx_align_left">Qwen2-7B-Instruct</td>
<td id="A5.T4.1.1.42.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/Qwen/Qwen2-7B-Instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/Qwen/Qwen2-7B-Instruct</a></td>
</tr>
<tr id="A5.T4.1.1.43" class="ltx_tr">
<td id="A5.T4.1.1.43.1" class="ltx_td ltx_align_left">Qwen2-57B-A14B</td>
<td id="A5.T4.1.1.43.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/Qwen/Qwen2-57B-A14B" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/Qwen/Qwen2-57B-A14B</a></td>
</tr>
<tr id="A5.T4.1.1.44" class="ltx_tr">
<td id="A5.T4.1.1.44.1" class="ltx_td ltx_align_left">CodeQwen1.5-7B-Chat</td>
<td id="A5.T4.1.1.44.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/Qwen/CodeQwen1.5-7B-Chat" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/Qwen/CodeQwen1.5-7B-Chat</a></td>
</tr>
<tr id="A5.T4.1.1.45" class="ltx_tr">
<td id="A5.T4.1.1.45.1" class="ltx_td ltx_align_left">Qwen1.5-110B-Chat</td>
<td id="A5.T4.1.1.45.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/Qwen/Qwen1.5-110B-Chat" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/Qwen/Qwen1.5-110B-Chat</a></td>
</tr>
<tr id="A5.T4.1.1.46" class="ltx_tr">
<td id="A5.T4.1.1.46.1" class="ltx_td ltx_align_left">Qwen1.5-72B-Chat</td>
<td id="A5.T4.1.1.46.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/Qwen/Qwen1.5-72B-Chat" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/Qwen/Qwen1.5-72B-Chat</a></td>
</tr>
<tr id="A5.T4.1.1.47" class="ltx_tr">
<td id="A5.T4.1.1.47.1" class="ltx_td ltx_align_left">Qwen1.5-32B-Chat</td>
<td id="A5.T4.1.1.47.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/Qwen/Qwen1.5-32B-Chat" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/Qwen/Qwen1.5-32B-Chat</a></td>
</tr>
<tr id="A5.T4.1.1.48" class="ltx_tr">
<td id="A5.T4.1.1.48.1" class="ltx_td ltx_align_left">Yi-1.5-34B-Chat</td>
<td id="A5.T4.1.1.48.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/01-ai/Yi-1.5-34B-Chat" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/01-ai/Yi-1.5-34B-Chat</a></td>
</tr>
<tr id="A5.T4.1.1.49" class="ltx_tr">
<td id="A5.T4.1.1.49.1" class="ltx_td ltx_align_left">Yi-1.5-9B-Chat</td>
<td id="A5.T4.1.1.49.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/01-ai/Yi-1.5-9B-Chat" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/01-ai/Yi-1.5-9B-Chat</a></td>
</tr>
<tr id="A5.T4.1.1.50" class="ltx_tr">
<td id="A5.T4.1.1.50.1" class="ltx_td ltx_align_left">Yi-1.5-6B-Chat</td>
<td id="A5.T4.1.1.50.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/01-ai/Yi-1.5-6B-Chat" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/01-ai/Yi-1.5-6B-Chat</a></td>
</tr>
<tr id="A5.T4.1.1.51" class="ltx_tr">
<td id="A5.T4.1.1.51.1" class="ltx_td ltx_align_left">Mixtral-8x22B-Instruct</td>
<td id="A5.T4.1.1.51.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1</a></td>
</tr>
<tr id="A5.T4.1.1.52" class="ltx_tr">
<td id="A5.T4.1.1.52.1" class="ltx_td ltx_align_left">Magicoder-S-DS</td>
<td id="A5.T4.1.1.52.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/ise-uiuc/Magicoder-S-DS-6.7B" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/ise-uiuc/Magicoder-S-DS-6.7B</a></td>
</tr>
<tr id="A5.T4.1.1.53" class="ltx_tr">
<td id="A5.T4.1.1.53.1" class="ltx_td ltx_align_left">CodeGemma-7B-Instruct</td>
<td id="A5.T4.1.1.53.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/google/codegemma-7b-it" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/google/codegemma-7b-it</a></td>
</tr>
<tr id="A5.T4.1.1.54" class="ltx_tr">
<td id="A5.T4.1.1.54.1" class="ltx_td ltx_align_left">StarCoder2-Instruct</td>
<td id="A5.T4.1.1.54.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/bigcode/starcoder2-15b-instruct-v0.1" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/bigcode/starcoder2-15b-instruct-v0.1</a></td>
</tr>
<tr id="A5.T4.1.1.55" class="ltx_tr">
<td id="A5.T4.1.1.55.1" class="ltx_td ltx_align_left">Granite-34B-Code-Instruct</td>
<td id="A5.T4.1.1.55.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/ibm-granite/granite-34b-code-instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/ibm-granite/granite-34b-code-instruct</a></td>
</tr>
<tr id="A5.T4.1.1.56" class="ltx_tr">
<td id="A5.T4.1.1.56.1" class="ltx_td ltx_align_left">Granite-20B-Code-Instruct</td>
<td id="A5.T4.1.1.56.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/ibm-granite/granite-20b-code-instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/ibm-granite/granite-20b-code-instruct</a></td>
</tr>
<tr id="A5.T4.1.1.57" class="ltx_tr">
<td id="A5.T4.1.1.57.1" class="ltx_td ltx_align_left">Granite-8B-Code-Instruct</td>
<td id="A5.T4.1.1.57.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/ibm-granite/granite-8b-code-instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/ibm-granite/granite-8b-code-instruct</a></td>
</tr>
<tr id="A5.T4.1.1.58" class="ltx_tr">
<td id="A5.T4.1.1.58.1" class="ltx_td ltx_align_left">Granite-3B-Code-Instruct</td>
<td id="A5.T4.1.1.58.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/ibm-granite/granite-3b-code-instruct" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/ibm-granite/granite-3b-code-instruct</a></td>
</tr>
<tr id="A5.T4.1.1.59" class="ltx_tr">
<td id="A5.T4.1.1.59.1" class="ltx_td ltx_align_left">CodeLlama-70B-Base</td>
<td id="A5.T4.1.1.59.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/codellama/CodeLlama-70b-hf" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/codellama/CodeLlama-70b-hf</a></td>
</tr>
<tr id="A5.T4.1.1.60" class="ltx_tr">
<td id="A5.T4.1.1.60.1" class="ltx_td ltx_align_left">CodeLlama-34B-Base</td>
<td id="A5.T4.1.1.60.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/codellama/CodeLlama-34b-hf" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/codellama/CodeLlama-34b-hf</a></td>
</tr>
<tr id="A5.T4.1.1.61" class="ltx_tr">
<td id="A5.T4.1.1.61.1" class="ltx_td ltx_align_left">CodeLlama-13B-Base</td>
<td id="A5.T4.1.1.61.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/codellama/CodeLlama-13b-hf" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/codellama/CodeLlama-13b-hf</a></td>
</tr>
<tr id="A5.T4.1.1.62" class="ltx_tr">
<td id="A5.T4.1.1.62.1" class="ltx_td ltx_align_left">CodeLlama-7B-Base</td>
<td id="A5.T4.1.1.62.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/codellama/CodeLlama-7b-hf" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/codellama/CodeLlama-7b-hf</a></td>
</tr>
<tr id="A5.T4.1.1.63" class="ltx_tr">
<td id="A5.T4.1.1.63.1" class="ltx_td ltx_align_left">Llama-3-70B-Base</td>
<td id="A5.T4.1.1.63.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/meta-llama/Meta-Llama-3-70B" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/meta-llama/Meta-Llama-3-70B</a></td>
</tr>
<tr id="A5.T4.1.1.64" class="ltx_tr">
<td id="A5.T4.1.1.64.1" class="ltx_td ltx_align_left">Llama-3-8B-Base</td>
<td id="A5.T4.1.1.64.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/meta-llama/Meta-Llama-3-8B" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/meta-llama/Meta-Llama-3-8B</a></td>
</tr>
<tr id="A5.T4.1.1.65" class="ltx_tr">
<td id="A5.T4.1.1.65.1" class="ltx_td ltx_align_left">DeepSeek-Coder-base-33B</td>
<td id="A5.T4.1.1.65.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/deepseek-ai/deepseek-coder-33b-base" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/deepseek-ai/deepseek-coder-33b-base</a></td>
</tr>
<tr id="A5.T4.1.1.66" class="ltx_tr">
<td id="A5.T4.1.1.66.1" class="ltx_td ltx_align_left">DeepSeek-Coder-base-6.7B</td>
<td id="A5.T4.1.1.66.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-base" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-base</a></td>
</tr>
<tr id="A5.T4.1.1.67" class="ltx_tr">
<td id="A5.T4.1.1.67.1" class="ltx_td ltx_align_left">DeepSeek-Coder-base-1.3B</td>
<td id="A5.T4.1.1.67.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base</a></td>
</tr>
<tr id="A5.T4.1.1.68" class="ltx_tr">
<td id="A5.T4.1.1.68.1" class="ltx_td ltx_align_left">CodeQwen1.5-7b</td>
<td id="A5.T4.1.1.68.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/Qwen/CodeQwen1.5-7B" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/Qwen/CodeQwen1.5-7B</a></td>
</tr>
<tr id="A5.T4.1.1.69" class="ltx_tr">
<td id="A5.T4.1.1.69.1" class="ltx_td ltx_align_left">Yi-1.5-34B</td>
<td id="A5.T4.1.1.69.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/01-ai/Yi-1.5-34B" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/01-ai/Yi-1.5-34B</a></td>
</tr>
<tr id="A5.T4.1.1.70" class="ltx_tr">
<td id="A5.T4.1.1.70.1" class="ltx_td ltx_align_left">Yi-1.5-9B</td>
<td id="A5.T4.1.1.70.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/01-ai/Yi-1.5-9B" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/01-ai/Yi-1.5-9B</a></td>
</tr>
<tr id="A5.T4.1.1.71" class="ltx_tr">
<td id="A5.T4.1.1.71.1" class="ltx_td ltx_align_left">Yi-1.5-6B</td>
<td id="A5.T4.1.1.71.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/01-ai/Yi-1.5-6B" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/01-ai/Yi-1.5-6B</a></td>
</tr>
<tr id="A5.T4.1.1.72" class="ltx_tr">
<td id="A5.T4.1.1.72.1" class="ltx_td ltx_align_left">Mixtral-8x22B-Base</td>
<td id="A5.T4.1.1.72.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/mistralai/Mixtral-8x22B-v0.1" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/mistralai/Mixtral-8x22B-v0.1</a></td>
</tr>
<tr id="A5.T4.1.1.73" class="ltx_tr">
<td id="A5.T4.1.1.73.1" class="ltx_td ltx_align_left">CodeGemma-7B</td>
<td id="A5.T4.1.1.73.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/google/codegemma-7b" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/google/codegemma-7b</a></td>
</tr>
<tr id="A5.T4.1.1.74" class="ltx_tr">
<td id="A5.T4.1.1.74.1" class="ltx_td ltx_align_left">CodeGemma-2B</td>
<td id="A5.T4.1.1.74.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/google/codegemma-2b" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/google/codegemma-2b</a></td>
</tr>
<tr id="A5.T4.1.1.75" class="ltx_tr">
<td id="A5.T4.1.1.75.1" class="ltx_td ltx_align_left">StarCoder2-15B</td>
<td id="A5.T4.1.1.75.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/bigcode/starcoder2-15b" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/bigcode/starcoder2-15b</a></td>
</tr>
<tr id="A5.T4.1.1.76" class="ltx_tr">
<td id="A5.T4.1.1.76.1" class="ltx_td ltx_align_left">StarCoder2-7B</td>
<td id="A5.T4.1.1.76.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/bigcode/starcoder2-7b" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/bigcode/starcoder2-7b</a></td>
</tr>
<tr id="A5.T4.1.1.77" class="ltx_tr">
<td id="A5.T4.1.1.77.1" class="ltx_td ltx_align_left">StarCoder2-3B</td>
<td id="A5.T4.1.1.77.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/bigcode/starcoder2-3b" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/bigcode/starcoder2-3b</a></td>
</tr>
<tr id="A5.T4.1.1.78" class="ltx_tr">
<td id="A5.T4.1.1.78.1" class="ltx_td ltx_align_left">Granite-34B-Code-Base</td>
<td id="A5.T4.1.1.78.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/ibm-granite/granite-34b-code-base" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/ibm-granite/granite-34b-code-base</a></td>
</tr>
<tr id="A5.T4.1.1.79" class="ltx_tr">
<td id="A5.T4.1.1.79.1" class="ltx_td ltx_align_left">Granite-20B-Code-Base</td>
<td id="A5.T4.1.1.79.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/ibm-granite/granite-20b-code-base" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/ibm-granite/granite-20b-code-base</a></td>
</tr>
<tr id="A5.T4.1.1.80" class="ltx_tr">
<td id="A5.T4.1.1.80.1" class="ltx_td ltx_align_left">Granite-8B-Code-Base</td>
<td id="A5.T4.1.1.80.2" class="ltx_td ltx_align_left"><a target="_blank" href="https://huggingface.co/ibm-granite/granite-8b-code-base" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/ibm-granite/granite-8b-code-base</a></td>
</tr>
<tr id="A5.T4.1.1.81" class="ltx_tr">
<td id="A5.T4.1.1.81.1" class="ltx_td ltx_align_left ltx_border_bb">Granite-3B-Code-Base</td>
<td id="A5.T4.1.1.81.2" class="ltx_td ltx_align_left ltx_border_bb"><a target="_blank" href="https://huggingface.co/ibm-granite/granite-3b-code-base" title="" class="ltx_ref ltx_url ltx_font_typewriter">https://huggingface.co/ibm-granite/granite-3b-code-base</a></td>
</tr>
</table>
</span></div>
</figure>
</section>
<section id="A6" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix F </span>Tool Statistics</h3>

<section id="A6.SS1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">F.1 </span>Analysis</h4>

<figure id="A6.F8" class="ltx_figure">
<div class="ltx_flex_figure">
<div class="ltx_flex_cell ltx_flex_size_1">
<p id="A6.F8.1" class="ltx_p ltx_figure_panel ltx_align_center"><span id="A6.F8.1.1" class="ltx_text" style="position:relative; bottom:0.0pt;">
<span id="A6.F8.1.1.1" class="ltx_inline-block ltx_transformed_outer" style="width:168.1pt;height:261.9pt;vertical-align:-261.9pt;"><span class="ltx_transformed_inner" style="transform:translate(0.0pt,0.0pt) scale(1,1) ;">
<span id="A6.F8.1.1.1.1" class="ltx_p"><span id="A6.F8.1.1.1.1.1" class="ltx_text"></span></span>
</span></span></span></p>
</div>
<div class="ltx_flex_break"></div>
<div class="ltx_flex_cell ltx_flex_size_1">
<figure id="A6.F8.sf1" class="ltx_figure ltx_figure_panel ltx_align_center"><img src="/html/2406.15877/assets/x9.png" id="A6.F8.sf1.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="213" alt="Refer to caption">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(a) </span><span id="A6.F8.sf1.2.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span></figcaption>
</figure>
</div>
<div class="ltx_flex_break"></div>
<div class="ltx_flex_cell ltx_flex_size_1">
<p id="A6.F8.2" class="ltx_p ltx_figure_panel ltx_align_center"><span id="A6.F8.2.1" class="ltx_text" style="position:relative; bottom:-301.6pt;">
<span id="A6.F8.2.1.1" class="ltx_inline-block ltx_transformed_outer" style="width:254.8pt;height:596.2pt;vertical-align:-294.6pt;"><span class="ltx_transformed_inner" style="transform:translate(0.0pt,0.0pt) scale(1,1) ;">
<span id="A6.F8.2.1.1.1" class="ltx_p"><span id="A6.F8.2.1.1.1.1" class="ltx_text"><span id="A6.F8.2.1.1.1.1.1" class="ltx_inline-logical-block ltx_minipage ltx_align_middle" style="width:251.5pt;">
<span id="A6.F8.sf2" class="ltx_figure"><img src="/html/2406.15877/assets/x10.png" id="A6.F8.sf2.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="235" alt="Refer to caption">
<span class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(b) </span>HumanEval</span>
</span>
<span id="A6.F8.sf3" class="ltx_figure ltx_align_center"><img src="/html/2406.15877/assets/x11.png" id="A6.F8.sf3.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="223" alt="Refer to caption">
<span class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(c) </span>ODEX</span>
</span>
<span id="A6.F8.sf4" class="ltx_figure ltx_align_center"><img src="/html/2406.15877/assets/x12.png" id="A6.F8.sf4.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="216" alt="Refer to caption">
<span class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(d) </span>DS-1000 (Orig.)</span>
</span>
<span id="A6.F8.sf5" class="ltx_figure ltx_align_center"><img src="/html/2406.15877/assets/x13.png" id="A6.F8.sf5.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="216" alt="Refer to caption">
<span class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(e) </span>DS-1000</span>
</span></span></span></span>
</span></span></span></p>
</div>
</div>
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 8: </span>Library density comparisons. We sort the libraries by frequency count, showcasing the long-tail distribution to highlight the broad diversity within <span id="A6.F8.4.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>.</figcaption>
</figure>
<figure id="A6.F9" class="ltx_figure">
<div class="ltx_flex_figure">
<div class="ltx_flex_cell ltx_flex_size_1">
<p id="A6.F9.1" class="ltx_p ltx_figure_panel ltx_align_center"><span id="A6.F9.1.1" class="ltx_text" style="position:relative; bottom:0.0pt;">
<span id="A6.F9.1.1.1" class="ltx_inline-block ltx_transformed_outer" style="width:168.1pt;height:261.9pt;vertical-align:-261.9pt;"><span class="ltx_transformed_inner" style="transform:translate(0.0pt,0.0pt) scale(1,1) ;">
<span id="A6.F9.1.1.1.1" class="ltx_p"><span id="A6.F9.1.1.1.1.1" class="ltx_text"></span></span>
</span></span></span></p>
</div>
<div class="ltx_flex_break"></div>
<div class="ltx_flex_cell ltx_flex_size_1">
<figure id="A6.F9.sf1" class="ltx_figure ltx_figure_panel ltx_align_center"><img src="/html/2406.15877/assets/x14.png" id="A6.F9.sf1.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="213" alt="Refer to caption">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(a) </span><span id="A6.F9.sf1.2.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span></figcaption>
</figure>
</div>
<div class="ltx_flex_break"></div>
<div class="ltx_flex_cell ltx_flex_size_1">
<p id="A6.F9.2" class="ltx_p ltx_figure_panel ltx_align_center"><span id="A6.F9.2.1" class="ltx_text" style="position:relative; bottom:-303.1pt;">
<span id="A6.F9.2.1.1" class="ltx_inline-block ltx_transformed_outer" style="width:254.8pt;height:599.2pt;vertical-align:-296.1pt;"><span class="ltx_transformed_inner" style="transform:translate(0.0pt,0.0pt) scale(1,1) ;">
<span id="A6.F9.2.1.1.1" class="ltx_p"><span id="A6.F9.2.1.1.1.1" class="ltx_text"><span id="A6.F9.2.1.1.1.1.1" class="ltx_inline-logical-block ltx_minipage ltx_align_middle" style="width:251.5pt;">
<span id="A6.F9.sf2" class="ltx_figure"><img src="/html/2406.15877/assets/x15.png" id="A6.F9.sf2.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="235" alt="Refer to caption">
<span class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(b) </span>HumanEval</span>
</span>
<span id="A6.F9.sf3" class="ltx_figure ltx_align_center"><img src="/html/2406.15877/assets/x16.png" id="A6.F9.sf3.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="220" alt="Refer to caption">
<span class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(c) </span>ODEX</span>
</span>
<span id="A6.F9.sf4" class="ltx_figure ltx_align_center"><img src="/html/2406.15877/assets/x17.png" id="A6.F9.sf4.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="220" alt="Refer to caption">
<span class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(d) </span>DS-1000 (Orig.)</span>
</span>
<span id="A6.F9.sf5" class="ltx_figure ltx_align_center"><img src="/html/2406.15877/assets/x18.png" id="A6.F9.sf5.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="461" height="220" alt="Refer to caption">
<span class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">(e) </span>DS-1000</span>
</span></span></span></span>
</span></span></span></p>
</div>
</div>
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 9: </span>Function call density comparisons. We sort function calls by frequency count, showcasing the long-tail distribution to highlight the broad diversity within <span id="A6.F9.4.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>.</figcaption>
</figure>
</section>
<section id="A6.SS2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">F.2 </span>Comparison to Existing Programming Benchmarks</h4>

<figure id="A6.T5" class="ltx_table">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_table">Table 5: </span>Depth (Complexity — Solution Characters) and breath (Diversity – Function Calls) comparisons to existing programming benchmarks in Python.</figcaption>
<div id="A6.T5.1" class="ltx_inline-block ltx_align_center ltx_transformed_outer" style="width:173.4pt;height:116pt;vertical-align:-0.0pt;"><span class="ltx_transformed_inner" style="transform:translate(-61.3pt,41.0pt) scale(0.586024597030931,0.586024597030931) ;">
<table id="A6.T5.1.1" class="ltx_tabular ltx_align_middle">
<tr id="A6.T5.1.1.1" class="ltx_tr">
<td id="A6.T5.1.1.1.1" class="ltx_td ltx_align_left ltx_border_tt"><span id="A6.T5.1.1.1.1.1" class="ltx_text ltx_font_bold">Benchmark</span></td>
<td id="A6.T5.1.1.1.2" class="ltx_td ltx_align_left ltx_border_tt"><span id="A6.T5.1.1.1.2.1" class="ltx_text ltx_font_bold">Complexity</span></td>
<td id="A6.T5.1.1.1.3" class="ltx_td ltx_align_left ltx_border_tt"><span id="A6.T5.1.1.1.3.1" class="ltx_text ltx_font_bold">Diversity</span></td>
</tr>
<tr id="A6.T5.1.1.2" class="ltx_tr">
<td id="A6.T5.1.1.2.1" class="ltx_td ltx_align_left ltx_border_t">APPS <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib23" title="" class="ltx_ref">23</a>]</cite>
</td>
<td id="A6.T5.1.1.2.2" class="ltx_td ltx_align_left ltx_border_t">352.9</td>
<td id="A6.T5.1.1.2.3" class="ltx_td ltx_align_left ltx_border_t">137</td>
</tr>
<tr id="A6.T5.1.1.3" class="ltx_tr">
<td id="A6.T5.1.1.3.1" class="ltx_td ltx_align_left">DS-1000 <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib32" title="" class="ltx_ref">32</a>]</cite>
</td>
<td id="A6.T5.1.1.3.2" class="ltx_td ltx_align_left">138.1</td>
<td id="A6.T5.1.1.3.3" class="ltx_td ltx_align_left">328</td>
</tr>
<tr id="A6.T5.1.1.4" class="ltx_tr">
<td id="A6.T5.1.1.4.1" class="ltx_td ltx_align_left">ODEX <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib58" title="" class="ltx_ref">58</a>]</cite>
</td>
<td id="A6.T5.1.1.4.2" class="ltx_td ltx_align_left">50.4</td>
<td id="A6.T5.1.1.4.3" class="ltx_td ltx_align_left">230</td>
</tr>
<tr id="A6.T5.1.1.5" class="ltx_tr">
<td id="A6.T5.1.1.5.1" class="ltx_td ltx_align_left">APIBench <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib49" title="" class="ltx_ref">49</a>]</cite>
</td>
<td id="A6.T5.1.1.5.2" class="ltx_td ltx_align_left">77.5</td>
<td id="A6.T5.1.1.5.3" class="ltx_td ltx_align_left">171</td>
</tr>
<tr id="A6.T5.1.1.6" class="ltx_tr">
<td id="A6.T5.1.1.6.1" class="ltx_td ltx_align_left">MBPP <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib9" title="" class="ltx_ref">9</a>]</cite>
</td>
<td id="A6.T5.1.1.6.2" class="ltx_td ltx_align_left">181.1</td>
<td id="A6.T5.1.1.6.3" class="ltx_td ltx_align_left">51</td>
</tr>
<tr id="A6.T5.1.1.7" class="ltx_tr">
<td id="A6.T5.1.1.7.1" class="ltx_td ltx_align_left">NumpyEval <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib68" title="" class="ltx_ref">68</a>]</cite>
</td>
<td id="A6.T5.1.1.7.2" class="ltx_td ltx_align_left">30.1</td>
<td id="A6.T5.1.1.7.3" class="ltx_td ltx_align_left">52</td>
</tr>
<tr id="A6.T5.1.1.8" class="ltx_tr">
<td id="A6.T5.1.1.8.1" class="ltx_td ltx_align_left">PandasEval <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib68" title="" class="ltx_ref">68</a>]</cite>
</td>
<td id="A6.T5.1.1.8.2" class="ltx_td ltx_align_left">45.8</td>
<td id="A6.T5.1.1.8.3" class="ltx_td ltx_align_left">12</td>
</tr>
<tr id="A6.T5.1.1.9" class="ltx_tr">
<td id="A6.T5.1.1.9.1" class="ltx_td ltx_align_left">HumanEval</td>
<td id="A6.T5.1.1.9.2" class="ltx_td ltx_align_left">180.9</td>
<td id="A6.T5.1.1.9.3" class="ltx_td ltx_align_left">7</td>
</tr>
<tr id="A6.T5.1.1.10" class="ltx_tr">
<td id="A6.T5.1.1.10.1" class="ltx_td ltx_align_left">TorchDataEval <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib67" title="" class="ltx_ref">67</a>]</cite>
</td>
<td id="A6.T5.1.1.10.2" class="ltx_td ltx_align_left">52.8</td>
<td id="A6.T5.1.1.10.3" class="ltx_td ltx_align_left">6</td>
</tr>
<tr id="A6.T5.1.1.11" class="ltx_tr">
<td id="A6.T5.1.1.11.1" class="ltx_td ltx_align_left ltx_border_bb ltx_border_t">BigCodeBench</td>
<td id="A6.T5.1.1.11.2" class="ltx_td ltx_align_left ltx_border_bb ltx_border_t">426.0</td>
<td id="A6.T5.1.1.11.3" class="ltx_td ltx_align_left ltx_border_bb ltx_border_t">723</td>
</tr>
</table>
</span></div>
</figure>
</section>
<section id="A6.SS3" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">F.3 </span>Version Control</h4>

<div id="A6.SS3.p1" class="ltx_para ltx_noindent">
<div id="A6.SS3.p1.1" class="ltx_listing ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,cGFuZGFzPT0yLjAuMwpzY2lraXQtbGVhcm49PTEuMy4xCnJlcXVlc3RzPT0yLjMxLjAKbWF0cGxvdGxpYj09My43LjAKc2VhYm9ybj09MC4xMy4yCm51bXB5PT0xLjIxLjIKbnVtYmE9PTAuNTUuMApjcnlwdG9ncmFwaHk9PTM4LjAuMApzY2lweT09MS43LjIKbmx0az09My44CnB5dHo9PTIwMjMuMy5wb3N0MQpuZXR3b3JreD09Mi42LjMKc3RhdHNtb2RlbHM9PTAuMTQuMApseG1sPT00LjkuMwpwc3V0aWw9PTUuOS41CkRqYW5nbz09NC4yLjcKc2VsZW5pdW09PTQuMTUuClBpbGxvdz09MTAuMy4wCmJlYXV0aWZ1bHNvdXA0PT00LjguMgpkYXRldGltZT09NS41CnB5dGhvbi1kb2N4PT0xLjEuMApvcGVucHl4bD09My4xLjIKTGV2ZW5zaHRlaW49PTAuMjUuMApQeVlBTUw9PTYuMC4xCndvcmRuaW5qYT09Mi4wLjAKRmFrZXI9PTIwLjEuMAp0ZW5zb3JmbG93PT0yLjExLjEKd29yZGNsb3VkPT0xLjkuMwpweXRlc3NlcmFjdD09MC4zLjEwCmNoYXJkZXQ9PTUuMi4wCnB5dGhvbi1kYXRldXRpbD09Mi45LjAKYmxha2UzPT0wLjQuMQpkbnNweXRob249PTIuNi4xCmZsYXNrPT0zLjAuMwpGbGFzay1NYWlsPT0wLjkuMQpmbGFza19sb2dpbj09MC42LjMKZmxhc2tfcmVzdGZ1bD09MC4zLjEwCmZsYXNrX3d0Zj09MS4yLjEKZm9saXVtPT0wLjE2LjAKZ2VvcHk9PTIuNC4xCmtlcmFzPT0yLjExLjAKbGlicm9zYT09MC4xMC4xCm1lY2hhbml6ZT09MC40LjkKcHJldHR5dGFibGU9PTMuMTAuMApweWNyeXB0b2RvbWU9PTMuMTQuMQpweXRob25faHR0cF9jbGllbnQ9PTMuMy43ClJlcXVlc3RzPT0yLjMxLjAKcmVxdWVzdHNfbW9jaz09MS4xMS4wCnJzYT09NC45CnNlbmRncmlkPT02LjExLjAKc291bmRmaWxlPT0wLjEyLjEKdGV4dHRhYmxlPT0xLjcuMApXZXJremV1Zz09My4wLjEKV1RGb3Jtcz09My4xLjIKeGxyZD09Mi4wLjEKeGx3dD09MS4zLjAKeG1sdG9kaWN0PT0wLjEzLjAKcHl0aG9uLUxldmVuc2h0ZWluLXdoZWVscwpnZW5zaW09PTQuMy4yCnN5bXB5PT0xLjEyCnB5ZmFrZWZzPT01LjQuMQp0ZXh0YmxvYj09MC4xOC4wCmRvY3h0cGw9PTAuMTEuNQpzdGF0c21vZGVscz09MC4xNC4wCnB5cXVlcnk9PTEuNC4zCmhvbGlkYXlzPT0wLjI5CnNjaWtpdC1pbWFnZT09MC4xOC4wCm5hdHNvcnQ9PTcuMS4xCnNoYXBlbHk9PTIuMC40Cmdlb3BhbmRhcz09MC4xMy4yCm9wZW5jdi1weXRob24taGVhZGxlc3M9PTQuOS4wLjgwCnhscmQ9PTIuMC4xCnB5dGVzdD09OC4yLjAKd2lraXBlZGlhPT0xLjQuMA==" download="">⬇</a></div>
<div id="lstnumberx1" class="ltx_listingline">
<span id="lstnumberx1.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pandas</span><span id="lstnumberx1.2" class="ltx_text ltx_font_typewriter">==2.0.3</span>
</div>
<div id="lstnumberx2" class="ltx_listingline">
<span id="lstnumberx2.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scikit</span><span id="lstnumberx2.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx2.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">learn</span><span id="lstnumberx2.4" class="ltx_text ltx_font_typewriter">==1.3.1</span>
</div>
<div id="lstnumberx3" class="ltx_listingline">
<span id="lstnumberx3.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requests</span><span id="lstnumberx3.2" class="ltx_text ltx_font_typewriter">==2.31.0</span>
</div>
<div id="lstnumberx4" class="ltx_listingline">
<span id="lstnumberx4.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matplotlib</span><span id="lstnumberx4.2" class="ltx_text ltx_font_typewriter">==3.7.0</span>
</div>
<div id="lstnumberx5" class="ltx_listingline">
<span id="lstnumberx5.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seaborn</span><span id="lstnumberx5.2" class="ltx_text ltx_font_typewriter">==0.13.2</span>
</div>
<div id="lstnumberx6" class="ltx_listingline">
<span id="lstnumberx6.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numpy</span><span id="lstnumberx6.2" class="ltx_text ltx_font_typewriter">==1.21.2</span>
</div>
<div id="lstnumberx7" class="ltx_listingline">
<span id="lstnumberx7.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numba</span><span id="lstnumberx7.2" class="ltx_text ltx_font_typewriter">==0.55.0</span>
</div>
<div id="lstnumberx8" class="ltx_listingline">
<span id="lstnumberx8.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cryptography</span><span id="lstnumberx8.2" class="ltx_text ltx_font_typewriter">==38.0.0</span>
</div>
<div id="lstnumberx9" class="ltx_listingline">
<span id="lstnumberx9.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scipy</span><span id="lstnumberx9.2" class="ltx_text ltx_font_typewriter">==1.7.2</span>
</div>
<div id="lstnumberx10" class="ltx_listingline">
<span id="lstnumberx10.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">nltk</span><span id="lstnumberx10.2" class="ltx_text ltx_font_typewriter">==3.8</span>
</div>
<div id="lstnumberx11" class="ltx_listingline">
<span id="lstnumberx11.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytz</span><span id="lstnumberx11.2" class="ltx_text ltx_font_typewriter">==2023.3.</span><span id="lstnumberx11.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">post1</span>
</div>
<div id="lstnumberx12" class="ltx_listingline">
<span id="lstnumberx12.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">networkx</span><span id="lstnumberx12.2" class="ltx_text ltx_font_typewriter">==2.6.3</span>
</div>
<div id="lstnumberx13" class="ltx_listingline">
<span id="lstnumberx13.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">statsmodels</span><span id="lstnumberx13.2" class="ltx_text ltx_font_typewriter">==0.14.0</span>
</div>
<div id="lstnumberx14" class="ltx_listingline">
<span id="lstnumberx14.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">lxml</span><span id="lstnumberx14.2" class="ltx_text ltx_font_typewriter">==4.9.3</span>
</div>
<div id="lstnumberx15" class="ltx_listingline">
<span id="lstnumberx15.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">psutil</span><span id="lstnumberx15.2" class="ltx_text ltx_font_typewriter">==5.9.5</span>
</div>
<div id="lstnumberx16" class="ltx_listingline">
<span id="lstnumberx16.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Django</span><span id="lstnumberx16.2" class="ltx_text ltx_font_typewriter">==4.2.7</span>
</div>
<div id="lstnumberx17" class="ltx_listingline">
<span id="lstnumberx17.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">selenium</span><span id="lstnumberx17.2" class="ltx_text ltx_font_typewriter">==4.15.</span>
</div>
<div id="lstnumberx18" class="ltx_listingline">
<span id="lstnumberx18.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Pillow</span><span id="lstnumberx18.2" class="ltx_text ltx_font_typewriter">==10.3.0</span>
</div>
<div id="lstnumberx19" class="ltx_listingline">
<span id="lstnumberx19.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">beautifulsoup4</span><span id="lstnumberx19.2" class="ltx_text ltx_font_typewriter">==4.8.2</span>
</div>
<div id="lstnumberx20" class="ltx_listingline">
<span id="lstnumberx20.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">datetime</span><span id="lstnumberx20.2" class="ltx_text ltx_font_typewriter">==5.5</span>
</div>
<div id="lstnumberx21" class="ltx_listingline">
<span id="lstnumberx21.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">python</span><span id="lstnumberx21.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx21.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docx</span><span id="lstnumberx21.4" class="ltx_text ltx_font_typewriter">==1.1.0</span>
</div>
<div id="lstnumberx22" class="ltx_listingline">
<span id="lstnumberx22.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">openpyxl</span><span id="lstnumberx22.2" class="ltx_text ltx_font_typewriter">==3.1.2</span>
</div>
<div id="lstnumberx23" class="ltx_listingline">
<span id="lstnumberx23.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Levenshtein</span><span id="lstnumberx23.2" class="ltx_text ltx_font_typewriter">==0.25.0</span>
</div>
<div id="lstnumberx24" class="ltx_listingline">
<span id="lstnumberx24.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">PyYAML</span><span id="lstnumberx24.2" class="ltx_text ltx_font_typewriter">==6.0.1</span>
</div>
<div id="lstnumberx25" class="ltx_listingline">
<span id="lstnumberx25.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wordninja</span><span id="lstnumberx25.2" class="ltx_text ltx_font_typewriter">==2.0.0</span>
</div>
<div id="lstnumberx26" class="ltx_listingline">
<span id="lstnumberx26.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Faker</span><span id="lstnumberx26.2" class="ltx_text ltx_font_typewriter">==20.1.0</span>
</div>
<div id="lstnumberx27" class="ltx_listingline">
<span id="lstnumberx27.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tensorflow</span><span id="lstnumberx27.2" class="ltx_text ltx_font_typewriter">==2.11.1</span>
</div>
<div id="lstnumberx28" class="ltx_listingline">
<span id="lstnumberx28.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wordcloud</span><span id="lstnumberx28.2" class="ltx_text ltx_font_typewriter">==1.9.3</span>
</div>
<div id="lstnumberx29" class="ltx_listingline">
<span id="lstnumberx29.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytesseract</span><span id="lstnumberx29.2" class="ltx_text ltx_font_typewriter">==0.3.10</span>
</div>
<div id="lstnumberx30" class="ltx_listingline">
<span id="lstnumberx30.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">chardet</span><span id="lstnumberx30.2" class="ltx_text ltx_font_typewriter">==5.2.0</span>
</div>
<div id="lstnumberx31" class="ltx_listingline">
<span id="lstnumberx31.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">python</span><span id="lstnumberx31.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx31.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dateutil</span><span id="lstnumberx31.4" class="ltx_text ltx_font_typewriter">==2.9.0</span>
</div>
<div id="lstnumberx32" class="ltx_listingline">
<span id="lstnumberx32.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">blake3</span><span id="lstnumberx32.2" class="ltx_text ltx_font_typewriter">==0.4.1</span>
</div>
<div id="lstnumberx33" class="ltx_listingline">
<span id="lstnumberx33.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dnspython</span><span id="lstnumberx33.2" class="ltx_text ltx_font_typewriter">==2.6.1</span>
</div>
<div id="lstnumberx34" class="ltx_listingline">
<span id="lstnumberx34.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">flask</span><span id="lstnumberx34.2" class="ltx_text ltx_font_typewriter">==3.0.3</span>
</div>
<div id="lstnumberx35" class="ltx_listingline">
<span id="lstnumberx35.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Flask</span><span id="lstnumberx35.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx35.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Mail</span><span id="lstnumberx35.4" class="ltx_text ltx_font_typewriter">==0.9.1</span>
</div>
<div id="lstnumberx36" class="ltx_listingline">
<span id="lstnumberx36.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">flask_login</span><span id="lstnumberx36.2" class="ltx_text ltx_font_typewriter">==0.6.3</span>
</div>
<div id="lstnumberx37" class="ltx_listingline">
<span id="lstnumberx37.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">flask_restful</span><span id="lstnumberx37.2" class="ltx_text ltx_font_typewriter">==0.3.10</span>
</div>
<div id="lstnumberx38" class="ltx_listingline">
<span id="lstnumberx38.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">flask_wtf</span><span id="lstnumberx38.2" class="ltx_text ltx_font_typewriter">==1.2.1</span>
</div>
<div id="lstnumberx39" class="ltx_listingline">
<span id="lstnumberx39.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">folium</span><span id="lstnumberx39.2" class="ltx_text ltx_font_typewriter">==0.16.0</span>
</div>
<div id="lstnumberx40" class="ltx_listingline">
<span id="lstnumberx40.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">geopy</span><span id="lstnumberx40.2" class="ltx_text ltx_font_typewriter">==2.4.1</span>
</div>
<div id="lstnumberx41" class="ltx_listingline">
<span id="lstnumberx41.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">keras</span><span id="lstnumberx41.2" class="ltx_text ltx_font_typewriter">==2.11.0</span>
</div>
<div id="lstnumberx42" class="ltx_listingline">
<span id="lstnumberx42.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">librosa</span><span id="lstnumberx42.2" class="ltx_text ltx_font_typewriter">==0.10.1</span>
</div>
<div id="lstnumberx43" class="ltx_listingline">
<span id="lstnumberx43.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mechanize</span><span id="lstnumberx43.2" class="ltx_text ltx_font_typewriter">==0.4.9</span>
</div>
<div id="lstnumberx44" class="ltx_listingline">
<span id="lstnumberx44.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">prettytable</span><span id="lstnumberx44.2" class="ltx_text ltx_font_typewriter">==3.10.0</span>
</div>
<div id="lstnumberx45" class="ltx_listingline">
<span id="lstnumberx45.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pycryptodome</span><span id="lstnumberx45.2" class="ltx_text ltx_font_typewriter">==3.14.1</span>
</div>
<div id="lstnumberx46" class="ltx_listingline">
<span id="lstnumberx46.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">python_http_client</span><span id="lstnumberx46.2" class="ltx_text ltx_font_typewriter">==3.3.7</span>
</div>
<div id="lstnumberx47" class="ltx_listingline">
<span id="lstnumberx47.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Requests</span><span id="lstnumberx47.2" class="ltx_text ltx_font_typewriter">==2.31.0</span>
</div>
<div id="lstnumberx48" class="ltx_listingline">
<span id="lstnumberx48.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requests_mock</span><span id="lstnumberx48.2" class="ltx_text ltx_font_typewriter">==1.11.0</span>
</div>
<div id="lstnumberx49" class="ltx_listingline">
<span id="lstnumberx49.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">rsa</span><span id="lstnumberx49.2" class="ltx_text ltx_font_typewriter">==4.9</span>
</div>
<div id="lstnumberx50" class="ltx_listingline">
<span id="lstnumberx50.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sendgrid</span><span id="lstnumberx50.2" class="ltx_text ltx_font_typewriter">==6.11.0</span>
</div>
<div id="lstnumberx51" class="ltx_listingline">
<span id="lstnumberx51.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">soundfile</span><span id="lstnumberx51.2" class="ltx_text ltx_font_typewriter">==0.12.1</span>
</div>
<div id="lstnumberx52" class="ltx_listingline">
<span id="lstnumberx52.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">texttable</span><span id="lstnumberx52.2" class="ltx_text ltx_font_typewriter">==1.7.0</span>
</div>
<div id="lstnumberx53" class="ltx_listingline">
<span id="lstnumberx53.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Werkzeug</span><span id="lstnumberx53.2" class="ltx_text ltx_font_typewriter">==3.0.1</span>
</div>
<div id="lstnumberx54" class="ltx_listingline">
<span id="lstnumberx54.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">WTForms</span><span id="lstnumberx54.2" class="ltx_text ltx_font_typewriter">==3.1.2</span>
</div>
<div id="lstnumberx55" class="ltx_listingline">
<span id="lstnumberx55.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">xlrd</span><span id="lstnumberx55.2" class="ltx_text ltx_font_typewriter">==2.0.1</span>
</div>
<div id="lstnumberx56" class="ltx_listingline">
<span id="lstnumberx56.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">xlwt</span><span id="lstnumberx56.2" class="ltx_text ltx_font_typewriter">==1.3.0</span>
</div>
<div id="lstnumberx57" class="ltx_listingline">
<span id="lstnumberx57.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">xmltodict</span><span id="lstnumberx57.2" class="ltx_text ltx_font_typewriter">==0.13.0</span>
</div>
<div id="lstnumberx58" class="ltx_listingline">
<span id="lstnumberx58.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">python</span><span id="lstnumberx58.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx58.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Levenshtein</span><span id="lstnumberx58.4" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx58.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wheels</span>
</div>
<div id="lstnumberx59" class="ltx_listingline">
<span id="lstnumberx59.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">gensim</span><span id="lstnumberx59.2" class="ltx_text ltx_font_typewriter">==4.3.2</span>
</div>
<div id="lstnumberx60" class="ltx_listingline">
<span id="lstnumberx60.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sympy</span><span id="lstnumberx60.2" class="ltx_text ltx_font_typewriter">==1.12</span>
</div>
<div id="lstnumberx61" class="ltx_listingline">
<span id="lstnumberx61.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pyfakefs</span><span id="lstnumberx61.2" class="ltx_text ltx_font_typewriter">==5.4.1</span>
</div>
<div id="lstnumberx62" class="ltx_listingline">
<span id="lstnumberx62.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">textblob</span><span id="lstnumberx62.2" class="ltx_text ltx_font_typewriter">==0.18.0</span>
</div>
<div id="lstnumberx63" class="ltx_listingline">
<span id="lstnumberx63.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docxtpl</span><span id="lstnumberx63.2" class="ltx_text ltx_font_typewriter">==0.11.5</span>
</div>
<div id="lstnumberx64" class="ltx_listingline">
<span id="lstnumberx64.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">statsmodels</span><span id="lstnumberx64.2" class="ltx_text ltx_font_typewriter">==0.14.0</span>
</div>
<div id="lstnumberx65" class="ltx_listingline">
<span id="lstnumberx65.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pyquery</span><span id="lstnumberx65.2" class="ltx_text ltx_font_typewriter">==1.4.3</span>
</div>
<div id="lstnumberx66" class="ltx_listingline">
<span id="lstnumberx66.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">holidays</span><span id="lstnumberx66.2" class="ltx_text ltx_font_typewriter">==0.29</span>
</div>
<div id="lstnumberx67" class="ltx_listingline">
<span id="lstnumberx67.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scikit</span><span id="lstnumberx67.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx67.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">image</span><span id="lstnumberx67.4" class="ltx_text ltx_font_typewriter">==0.18.0</span>
</div>
<div id="lstnumberx68" class="ltx_listingline">
<span id="lstnumberx68.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">natsort</span><span id="lstnumberx68.2" class="ltx_text ltx_font_typewriter">==7.1.1</span>
</div>
<div id="lstnumberx69" class="ltx_listingline">
<span id="lstnumberx69.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">shapely</span><span id="lstnumberx69.2" class="ltx_text ltx_font_typewriter">==2.0.4</span>
</div>
<div id="lstnumberx70" class="ltx_listingline">
<span id="lstnumberx70.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">geopandas</span><span id="lstnumberx70.2" class="ltx_text ltx_font_typewriter">==0.13.2</span>
</div>
<div id="lstnumberx71" class="ltx_listingline">
<span id="lstnumberx71.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">opencv</span><span id="lstnumberx71.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx71.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">python</span><span id="lstnumberx71.4" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx71.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">headless</span><span id="lstnumberx71.6" class="ltx_text ltx_font_typewriter">==4.9.0.80</span>
</div>
<div id="lstnumberx72" class="ltx_listingline">
<span id="lstnumberx72.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">xlrd</span><span id="lstnumberx72.2" class="ltx_text ltx_font_typewriter">==2.0.1</span>
</div>
<div id="lstnumberx73" class="ltx_listingline">
<span id="lstnumberx73.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytest</span><span id="lstnumberx73.2" class="ltx_text ltx_font_typewriter">==8.2.0</span>
</div>
<div id="lstnumberx74" class="ltx_listingline">
<span id="lstnumberx74.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wikipedia</span><span id="lstnumberx74.2" class="ltx_text ltx_font_typewriter">==1.4.0</span>
</div>
</div>
</div>
</section>
<section id="A6.SS4" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">F.4 </span>Domain Classification</h4>

<div id="A6.SS4.p1" class="ltx_para ltx_noindent">
<div id="A6.SS4.p1.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,ewogICAgIkNyeXB0byI6ICJDcnlwdG9ncmFwaHkiLAogICAgIlBJTCI6ICJWaXN1YWxpemF0aW9uIiwKICAgICJhcnJheSI6ICJHZW5lcmFsIiwKICAgICJiYXNlNjQiOiAiQ3J5cHRvZ3JhcGh5IiwKICAgICJiaW5hc2NpaSI6ICJDcnlwdG9ncmFwaHkiLAogICAgImJpc2VjdCI6ICJHZW5lcmFsIiwKICAgICJibGFrZTMiOiAiQ3J5cHRvZ3JhcGh5IiwKICAgICJiczQiOiAiTmV0d29yayIsCiAgICAiY2FsZW5kYXIiOiAiVGltZSIsCiAgICAiY2dpIjogIk5ldHdvcmsiLAogICAgImNoYXJkZXQiOiAiTmV0d29yayIsCiAgICAiY21hdGgiOiAiQ29tcHV0YXRpb24iLAogICAgImNvZGVjcyI6ICJDcnlwdG9ncmFwaHkiLAogICAgImNvbGxlY3Rpb25zIjogIkdlbmVyYWwiLAogICAgImNyeXB0b2dyYXBoeSI6ICJDcnlwdG9ncmFwaHkiLAogICAgImNzdiI6ICJTeXN0ZW0iLAogICAgImN0eXBlcyI6ICJTeXN0ZW0iLAogICAgImRhdGV0aW1lIjogIlRpbWUiLAogICAgImRhdGV1dGlsIjogIlRpbWUiLAogICAgImRpZmZsaWIiOiAiR2VuZXJhbCIsCiAgICAiZGphbmdvIjogIk5ldHdvcmsiLAogICAgImRvY3giOiAiU3lzdGVtIiwKICAgICJlbWFpbCI6ICJOZXR3b3JrIiwKICAgICJmYWtlciI6ICJHZW5lcmFsIiwKICAgICJmbGFzayI6ICJOZXR3b3JrIiwKICAgICJmbGFza19sb2dpbiI6ICJOZXR3b3JrIiwKICAgICJmbGFza19tYWlsIjogIk5ldHdvcmsiLAogICAgImZsYXNrX3Jlc3RmdWwiOiAiTmV0d29yayIsCiAgICAiZm5tYXRjaCI6ICJHZW5lcmFsIiwKICAgICJmb2xpdW0iOiAiVmlzdWFsaXphdGlvbiIsCiAgICAiZnVuY3Rvb2xzIjogIkdlbmVyYWwiLAogICAgImdlb3B5IjogIk5ldHdvcmsiLAogICAgImdldHBhc3MiOiAiU3lzdGVtIiwKICAgICJnbG9iIjogIlN5c3RlbSIsCiAgICAiZ3ppcCI6ICJTeXN0ZW0iLAogICAgImhhc2hsaWIiOiAiQ3J5cHRvZ3JhcGh5IiwKICAgICJoZWFwcSI6ICJHZW5lcmFsIiwKICAgICJobWFjIjogIkNyeXB0b2dyYXBoeSIsCiAgICAiaHRtbCI6ICJOZXR3b3JrIiwKICAgICJodHRwIjogIk5ldHdvcmsiLAogICAgImltcG9ydGxpYiI6ICJHZW5lcmFsIiwKICAgICJpbnNwZWN0IjogIkdlbmVyYWwiLAogICAgImlvIjogIlN5c3RlbSIsCiAgICAiaXBhZGRyZXNzIjogIk5ldHdvcmsiLAogICAgIml0ZXJ0b29scyI6ICJHZW5lcmFsIiwKICAgICJqc29uIjogIlN5c3RlbSIsCiAgICAia2VyYXMiOiAiQ29tcHV0YXRpb24iLAogICAgImxpYnJvc2EiOiAiQ29tcHV0YXRpb24iLAogICAgImxvZ2dpbmciOiAiU3lzdGVtIiwKICAgICJseG1sIjogIk5ldHdvcmsiLAogICAgIm1hdGgiOiAiQ29tcHV0YXRpb24iLAogICAgIm1hdHBsb3RsaWIiOiAiVmlzdWFsaXphdGlvbiIsCiAgICAibWVjaGFuaXplIjogIk5ldHdvcmsiLAogICAgIm1pbWV0eXBlcyI6ICJOZXR3b3JrIiwKICAgICJtdWx0aXByb2Nlc3NpbmciOiAiU3lzdGVtIiwKICAgICJubHRrIjogIkNvbXB1dGF0aW9uIiwKICAgICJudW1weSI6ICJDb21wdXRhdGlvbiIsCiAgICAib3BlbnB5eGwiOiAiU3lzdGVtIiwKICAgICJvcGVyYXRvciI6ICJHZW5lcmFsIiwKICAgICJvcyI6ICJTeXN0ZW0iLAogICAgInBhbmRhcyI6ICJDb21wdXRhdGlvbiIsCiAgICAicGF0aGxpYiI6ICJTeXN0ZW0iLAogICAgInBpY2tsZSI6ICJTeXN0ZW0iLAogICAgInBrZ3V0aWwiOiAiR2VuZXJhbCIsCiAgICAicGxhdGZvcm0iOiAiU3lzdGVtIiwKICAgICJwcmV0dHl0YWJsZSI6ICJHZW5lcmFsIiwKICAgICJwc3V0aWwiOiAiU3lzdGVtIiwKICAgICJweXRlc3NlcmFjdCI6ICJDb21wdXRhdGlvbiIsCiAgICAicHl0eiI6ICJUaW1lIiwKICAgICJxdWV1ZSI6ICJHZW5lcmFsIiwKICAgICJyYW5kb20iOiAiR2VuZXJhbCIsCiAgICAicmUiOiAiR2VuZXJhbCIsCiAgICAicmVxdWVzdHMiOiAiTmV0d29yayIsCiAgICAicnNhIjogIkNyeXB0b2dyYXBoeSIsCiAgICAic2NpcHkiOiAiQ29tcHV0YXRpb24iLAogICAgInNlYWJvcm4iOiAiVmlzdWFsaXphdGlvbiIsCiAgICAic2VjcmV0cyI6ICJDcnlwdG9ncmFwaHkiLAogICAgInNlbGVjdCI6ICJTeXN0ZW0iLAogICAgInNlbmRncmlkIjogIk5ldHdvcmsiLAogICAgInNodXRpbCI6ICJTeXN0ZW0iLAogICAgInNrbGVhcm4iOiAiQ29tcHV0YXRpb24iLAogICAgInNtdHBsaWIiOiAiTmV0d29yayIsCiAgICAic29ja2V0IjogIk5ldHdvcmsiLAogICAgInNvdW5kZmlsZSI6ICJDb21wdXRhdGlvbiIsCiAgICAic3FsaXRlMyI6ICJTeXN0ZW0iLAogICAgInNzbCI6ICJOZXR3b3JrIiwKICAgICJzdGF0aXN0aWNzIjogIkNvbXB1dGF0aW9uIiwKICAgICJzdGF0c21vZGVscyI6ICJDb21wdXRhdGlvbiIsCiAgICAic3RyaW5nIjogIkdlbmVyYWwiLAogICAgInN0cnVjdCI6ICJTeXN0ZW0iLAogICAgInN1YnByb2Nlc3MiOiAiU3lzdGVtIiwKICAgICJzeXMiOiAiU3lzdGVtIiwKICAgICJ0YXJmaWxlIjogIlN5c3RlbSIsCiAgICAidGVuc29yZmxvdyI6ICJDb21wdXRhdGlvbiIsCiAgICAidGV4dHRhYmxlIjogIkdlbmVyYWwiLAogICAgInRleHR3cmFwIjogIkdlbmVyYWwiLAogICAgInRocmVhZGluZyI6ICJTeXN0ZW0iLAogICAgInRpbWUiOiAiVGltZSIsCiAgICAidHVydGxlIjogIlZpc3VhbGl6YXRpb24iLAogICAgInR5cGVzIjogIkdlbmVyYWwiLAogICAgInVuaWNvZGVkYXRhIjogIkdlbmVyYWwiLAogICAgInVybGxpYiI6ICJOZXR3b3JrIiwKICAgICJ1dWlkIjogIkdlbmVyYWwiLAogICAgIndhcm5pbmdzIjogIkdlbmVyYWwiLAogICAgIndlcmt6ZXVnIjogIk5ldHdvcmsiLAogICAgIndvcmRuaW5qYSI6ICJDb21wdXRhdGlvbiIsCiAgICAid3Rmb3JtcyI6ICJOZXR3b3JrIiwKICAgICJ4bHd0IjogIlN5c3RlbSIsCiAgICAieG1sIjogIk5ldHdvcmsiLAogICAgInhtbHRvZGljdCI6ICJOZXR3b3JrIiwKICAgICJ5YW1sIjogIlN5c3RlbSIsCiAgICAiemlwZmlsZSI6ICJTeXN0ZW0iLAogICAgIkxldmVuc2h0ZWluIjogIkNvbXB1dGF0aW9uIiwKICAgICJhc3QiOiAiR2VuZXJhbCIsCiAgICAiY29uZmlncGFyc2VyIjogIlN5c3RlbSIsCiAgICAiY3YyIjogIkNvbXB1dGF0aW9uIiwKICAgICJkZWNpbWFsIjogIkdlbmVyYWwiLAogICAgImVudW0iOiAiR2VuZXJhbCIsCiAgICAiZXJybm8iOiAiU3lzdGVtIiwKICAgICJmbGFza193dGYiOiAiTmV0d29yayIsCiAgICAiZnRwbGliIjogIk5ldHdvcmsiLAogICAgImdlbnNpbSI6ICJDb21wdXRhdGlvbiIsCiAgICAiZ2VvcGFuZGFzIjogIkNvbXB1dGF0aW9uIiwKICAgICJob2xpZGF5cyI6ICJUaW1lIiwKICAgICJtcGxfdG9vbGtpdHMiOiAiVmlzdWFsaXphdGlvbiIsCiAgICAibmF0c29ydCI6ICJHZW5lcmFsIiwKICAgICJweXF1ZXJ5IjogIk5ldHdvcmsiLAogICAgInB5dGhvbl9odHRwX2NsaWVudCI6ICJOZXR3b3JrIiwKICAgICJyZWdleCI6ICJHZW5lcmFsIiwKICAgICJzaGFwZWx5IjogIkNvbXB1dGF0aW9uIiwKICAgICJzaGxleCI6ICJTeXN0ZW0iLAogICAgInNpZ25hbCI6ICJTeXN0ZW0iLAogICAgInNraW1hZ2UiOiAiQ29tcHV0YXRpb24iLAogICAgInN5bXB5IjogIkNvbXB1dGF0aW9uIiwKICAgICJ0ZXh0YmxvYiI6ICJDb21wdXRhdGlvbiIsCiAgICAidHlwaW5nIjogIkdlbmVyYWwiLAogICAgIndpa2lwZWRpYSI6ICJOZXR3b3JrIiwKICAgICJ3b3JkY2xvdWQiOiAiVmlzdWFsaXphdGlvbiIsCiAgICAiemxpYiI6ICJTeXN0ZW0iLAogICAgImFzcG9zZSI6ICJTeXN0ZW0iLAogICAgImJ1aWx0aW5zIjogIkdlbmVyYWwiLAogICAgImxvY2FsZSI6ICJTeXN0ZW0iLAogICAgImltcCI6ICJTeXN0ZW0iLAogICAgImRvY3h0cGwiOiAiU3lzdGVtIiwKICAgICJzZWxlbml1bSI6ICJOZXR3b3JrIiwKICAgICJJUHl0aG9uIjogIkNvbXB1dGF0aW9uIiwKICAgICJmaWxlY21wIjogIlN5c3RlbSIsCiAgICAibXVsdGlkaWN0IjogIkdlbmVyYWwiLAogICAgInNxbGFsY2hlbXkiOiAiU3lzdGVtIiwKICAgICJvYnNweSI6ICJDb21wdXRhdGlvbiIsCiAgICAicHByaW50IjogIkdlbmVyYWwiLAogICAgInhscmQiOiAiU3lzdGVtIiwKICAgICJhcmdwYXJzZSI6ICJHZW5lcmFsIiwKICAgICJ0b3JjaCI6ICJDb21wdXRhdGlvbiIsCiAgICAiY29weSI6ICJHZW5lcmFsIgp9" download="">⬇</a></div>
<div id="lstnumberx75" class="ltx_listingline">
<span id="lstnumberx75.1" class="ltx_text ltx_font_typewriter">{</span>
</div>
<div id="lstnumberx76" class="ltx_listingline">
<span id="lstnumberx76.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx76.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Crypto"</span><span id="lstnumberx76.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx76.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx76.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx76.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx77" class="ltx_listingline">
<span id="lstnumberx77.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx77.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"PIL"</span><span id="lstnumberx77.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx77.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx77.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Visualization"</span><span id="lstnumberx77.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx78" class="ltx_listingline">
<span id="lstnumberx78.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx78.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"array"</span><span id="lstnumberx78.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx78.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx78.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx78.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx79" class="ltx_listingline">
<span id="lstnumberx79.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx79.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"base64"</span><span id="lstnumberx79.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx79.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx79.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx79.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx80" class="ltx_listingline">
<span id="lstnumberx80.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx80.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"binascii"</span><span id="lstnumberx80.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx80.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx80.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx80.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx81" class="ltx_listingline">
<span id="lstnumberx81.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx81.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"bisect"</span><span id="lstnumberx81.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx81.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx81.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx81.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx82" class="ltx_listingline">
<span id="lstnumberx82.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx82.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"blake3"</span><span id="lstnumberx82.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx82.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx82.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx82.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx83" class="ltx_listingline">
<span id="lstnumberx83.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx83.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"bs4"</span><span id="lstnumberx83.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx83.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx83.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx83.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx84" class="ltx_listingline">
<span id="lstnumberx84.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx84.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"calendar"</span><span id="lstnumberx84.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx84.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx84.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Time"</span><span id="lstnumberx84.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx85" class="ltx_listingline">
<span id="lstnumberx85.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx85.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"cgi"</span><span id="lstnumberx85.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx85.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx85.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx85.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx86" class="ltx_listingline">
<span id="lstnumberx86.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx86.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"chardet"</span><span id="lstnumberx86.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx86.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx86.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx86.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx87" class="ltx_listingline">
<span id="lstnumberx87.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx87.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"cmath"</span><span id="lstnumberx87.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx87.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx87.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx87.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx88" class="ltx_listingline">
<span id="lstnumberx88.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx88.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"codecs"</span><span id="lstnumberx88.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx88.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx88.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx88.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx89" class="ltx_listingline">
<span id="lstnumberx89.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx89.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"collections"</span><span id="lstnumberx89.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx89.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx89.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx89.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx90" class="ltx_listingline">
<span id="lstnumberx90.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx90.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"cryptography"</span><span id="lstnumberx90.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx90.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx90.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx90.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx91" class="ltx_listingline">
<span id="lstnumberx91.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx91.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"csv"</span><span id="lstnumberx91.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx91.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx91.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx91.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx92" class="ltx_listingline">
<span id="lstnumberx92.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx92.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"ctypes"</span><span id="lstnumberx92.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx92.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx92.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx92.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx93" class="ltx_listingline">
<span id="lstnumberx93.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx93.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"datetime"</span><span id="lstnumberx93.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx93.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx93.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Time"</span><span id="lstnumberx93.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx94" class="ltx_listingline">
<span id="lstnumberx94.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx94.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"dateutil"</span><span id="lstnumberx94.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx94.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx94.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Time"</span><span id="lstnumberx94.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx95" class="ltx_listingline">
<span id="lstnumberx95.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx95.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"difflib"</span><span id="lstnumberx95.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx95.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx95.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx95.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx96" class="ltx_listingline">
<span id="lstnumberx96.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx96.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"django"</span><span id="lstnumberx96.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx96.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx96.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx96.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx97" class="ltx_listingline">
<span id="lstnumberx97.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx97.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"docx"</span><span id="lstnumberx97.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx97.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx97.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx97.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx98" class="ltx_listingline">
<span id="lstnumberx98.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx98.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"email"</span><span id="lstnumberx98.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx98.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx98.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx98.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx99" class="ltx_listingline">
<span id="lstnumberx99.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx99.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"faker"</span><span id="lstnumberx99.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx99.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx99.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx99.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx100" class="ltx_listingline">
<span id="lstnumberx100.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx100.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"flask"</span><span id="lstnumberx100.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx100.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx100.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx100.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx101" class="ltx_listingline">
<span id="lstnumberx101.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx101.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"flask_login"</span><span id="lstnumberx101.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx101.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx101.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx101.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx102" class="ltx_listingline">
<span id="lstnumberx102.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx102.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"flask_mail"</span><span id="lstnumberx102.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx102.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx102.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx102.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx103" class="ltx_listingline">
<span id="lstnumberx103.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx103.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"flask_restful"</span><span id="lstnumberx103.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx103.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx103.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx103.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx104" class="ltx_listingline">
<span id="lstnumberx104.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx104.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"fnmatch"</span><span id="lstnumberx104.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx104.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx104.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx104.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx105" class="ltx_listingline">
<span id="lstnumberx105.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx105.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"folium"</span><span id="lstnumberx105.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx105.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx105.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Visualization"</span><span id="lstnumberx105.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx106" class="ltx_listingline">
<span id="lstnumberx106.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx106.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"functools"</span><span id="lstnumberx106.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx106.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx106.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx106.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx107" class="ltx_listingline">
<span id="lstnumberx107.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx107.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"geopy"</span><span id="lstnumberx107.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx107.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx107.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx107.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx108" class="ltx_listingline">
<span id="lstnumberx108.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx108.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"getpass"</span><span id="lstnumberx108.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx108.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx108.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx108.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx109" class="ltx_listingline">
<span id="lstnumberx109.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx109.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"glob"</span><span id="lstnumberx109.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx109.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx109.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx109.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx110" class="ltx_listingline">
<span id="lstnumberx110.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx110.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"gzip"</span><span id="lstnumberx110.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx110.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx110.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx110.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx111" class="ltx_listingline">
<span id="lstnumberx111.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx111.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"hashlib"</span><span id="lstnumberx111.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx111.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx111.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx111.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx112" class="ltx_listingline">
<span id="lstnumberx112.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx112.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"heapq"</span><span id="lstnumberx112.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx112.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx112.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx112.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx113" class="ltx_listingline">
<span id="lstnumberx113.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx113.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"hmac"</span><span id="lstnumberx113.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx113.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx113.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx113.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx114" class="ltx_listingline">
<span id="lstnumberx114.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx114.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"html"</span><span id="lstnumberx114.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx114.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx114.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx114.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx115" class="ltx_listingline">
<span id="lstnumberx115.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx115.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"http"</span><span id="lstnumberx115.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx115.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx115.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx115.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx116" class="ltx_listingline">
<span id="lstnumberx116.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx116.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"importlib"</span><span id="lstnumberx116.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx116.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx116.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx116.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx117" class="ltx_listingline">
<span id="lstnumberx117.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx117.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"inspect"</span><span id="lstnumberx117.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx117.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx117.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx117.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx118" class="ltx_listingline">
<span id="lstnumberx118.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx118.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"io"</span><span id="lstnumberx118.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx118.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx118.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx118.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx119" class="ltx_listingline">
<span id="lstnumberx119.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx119.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"ipaddress"</span><span id="lstnumberx119.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx119.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx119.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx119.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx120" class="ltx_listingline">
<span id="lstnumberx120.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx120.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"itertools"</span><span id="lstnumberx120.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx120.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx120.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx120.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx121" class="ltx_listingline">
<span id="lstnumberx121.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx121.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"json"</span><span id="lstnumberx121.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx121.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx121.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx121.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx122" class="ltx_listingline">
<span id="lstnumberx122.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx122.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"keras"</span><span id="lstnumberx122.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx122.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx122.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx122.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx123" class="ltx_listingline">
<span id="lstnumberx123.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx123.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"librosa"</span><span id="lstnumberx123.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx123.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx123.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx123.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx124" class="ltx_listingline">
<span id="lstnumberx124.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx124.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"logging"</span><span id="lstnumberx124.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx124.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx124.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx124.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx125" class="ltx_listingline">
<span id="lstnumberx125.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx125.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"lxml"</span><span id="lstnumberx125.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx125.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx125.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx125.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx126" class="ltx_listingline">
<span id="lstnumberx126.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx126.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"math"</span><span id="lstnumberx126.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx126.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx126.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx126.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx127" class="ltx_listingline">
<span id="lstnumberx127.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx127.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"matplotlib"</span><span id="lstnumberx127.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx127.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx127.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Visualization"</span><span id="lstnumberx127.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx128" class="ltx_listingline">
<span id="lstnumberx128.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx128.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"mechanize"</span><span id="lstnumberx128.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx128.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx128.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx128.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx129" class="ltx_listingline">
<span id="lstnumberx129.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx129.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"mimetypes"</span><span id="lstnumberx129.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx129.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx129.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx129.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx130" class="ltx_listingline">
<span id="lstnumberx130.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx130.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"multiprocessing"</span><span id="lstnumberx130.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx130.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx130.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx130.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx131" class="ltx_listingline">
<span id="lstnumberx131.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx131.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"nltk"</span><span id="lstnumberx131.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx131.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx131.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx131.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx132" class="ltx_listingline">
<span id="lstnumberx132.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx132.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"numpy"</span><span id="lstnumberx132.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx132.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx132.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx132.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx133" class="ltx_listingline">
<span id="lstnumberx133.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx133.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"openpyxl"</span><span id="lstnumberx133.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx133.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx133.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx133.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx134" class="ltx_listingline">
<span id="lstnumberx134.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx134.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"operator"</span><span id="lstnumberx134.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx134.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx134.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx134.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx135" class="ltx_listingline">
<span id="lstnumberx135.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx135.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"os"</span><span id="lstnumberx135.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx135.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx135.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx135.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx136" class="ltx_listingline">
<span id="lstnumberx136.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx136.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"pandas"</span><span id="lstnumberx136.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx136.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx136.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx136.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx137" class="ltx_listingline">
<span id="lstnumberx137.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx137.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"pathlib"</span><span id="lstnumberx137.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx137.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx137.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx137.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx138" class="ltx_listingline">
<span id="lstnumberx138.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx138.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"pickle"</span><span id="lstnumberx138.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx138.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx138.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx138.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx139" class="ltx_listingline">
<span id="lstnumberx139.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx139.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"pkgutil"</span><span id="lstnumberx139.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx139.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx139.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx139.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx140" class="ltx_listingline">
<span id="lstnumberx140.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx140.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"platform"</span><span id="lstnumberx140.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx140.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx140.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx140.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx141" class="ltx_listingline">
<span id="lstnumberx141.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx141.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"prettytable"</span><span id="lstnumberx141.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx141.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx141.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx141.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx142" class="ltx_listingline">
<span id="lstnumberx142.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx142.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"psutil"</span><span id="lstnumberx142.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx142.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx142.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx142.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx143" class="ltx_listingline">
<span id="lstnumberx143.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx143.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"pytesseract"</span><span id="lstnumberx143.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx143.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx143.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx143.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx144" class="ltx_listingline">
<span id="lstnumberx144.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx144.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"pytz"</span><span id="lstnumberx144.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx144.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx144.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Time"</span><span id="lstnumberx144.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx145" class="ltx_listingline">
<span id="lstnumberx145.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx145.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"queue"</span><span id="lstnumberx145.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx145.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx145.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx145.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx146" class="ltx_listingline">
<span id="lstnumberx146.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx146.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"random"</span><span id="lstnumberx146.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx146.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx146.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx146.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx147" class="ltx_listingline">
<span id="lstnumberx147.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx147.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"re"</span><span id="lstnumberx147.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx147.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx147.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx147.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx148" class="ltx_listingline">
<span id="lstnumberx148.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx148.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"requests"</span><span id="lstnumberx148.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx148.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx148.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx148.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx149" class="ltx_listingline">
<span id="lstnumberx149.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx149.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"rsa"</span><span id="lstnumberx149.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx149.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx149.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx149.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx150" class="ltx_listingline">
<span id="lstnumberx150.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx150.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"scipy"</span><span id="lstnumberx150.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx150.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx150.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx150.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx151" class="ltx_listingline">
<span id="lstnumberx151.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx151.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"seaborn"</span><span id="lstnumberx151.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx151.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx151.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Visualization"</span><span id="lstnumberx151.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx152" class="ltx_listingline">
<span id="lstnumberx152.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx152.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"secrets"</span><span id="lstnumberx152.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx152.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx152.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Cryptography"</span><span id="lstnumberx152.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx153" class="ltx_listingline">
<span id="lstnumberx153.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx153.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"select"</span><span id="lstnumberx153.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx153.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx153.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx153.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx154" class="ltx_listingline">
<span id="lstnumberx154.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx154.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"sendgrid"</span><span id="lstnumberx154.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx154.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx154.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx154.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx155" class="ltx_listingline">
<span id="lstnumberx155.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx155.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"shutil"</span><span id="lstnumberx155.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx155.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx155.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx155.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx156" class="ltx_listingline">
<span id="lstnumberx156.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx156.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"sklearn"</span><span id="lstnumberx156.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx156.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx156.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx156.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx157" class="ltx_listingline">
<span id="lstnumberx157.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx157.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"smtplib"</span><span id="lstnumberx157.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx157.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx157.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx157.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx158" class="ltx_listingline">
<span id="lstnumberx158.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx158.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"socket"</span><span id="lstnumberx158.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx158.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx158.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx158.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx159" class="ltx_listingline">
<span id="lstnumberx159.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx159.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"soundfile"</span><span id="lstnumberx159.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx159.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx159.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx159.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx160" class="ltx_listingline">
<span id="lstnumberx160.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx160.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"sqlite3"</span><span id="lstnumberx160.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx160.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx160.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx160.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx161" class="ltx_listingline">
<span id="lstnumberx161.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx161.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"ssl"</span><span id="lstnumberx161.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx161.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx161.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx161.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx162" class="ltx_listingline">
<span id="lstnumberx162.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx162.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"statistics"</span><span id="lstnumberx162.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx162.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx162.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx162.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx163" class="ltx_listingline">
<span id="lstnumberx163.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx163.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"statsmodels"</span><span id="lstnumberx163.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx163.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx163.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx163.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx164" class="ltx_listingline">
<span id="lstnumberx164.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx164.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"string"</span><span id="lstnumberx164.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx164.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx164.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx164.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx165" class="ltx_listingline">
<span id="lstnumberx165.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx165.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"struct"</span><span id="lstnumberx165.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx165.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx165.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx165.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx166" class="ltx_listingline">
<span id="lstnumberx166.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx166.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"subprocess"</span><span id="lstnumberx166.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx166.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx166.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx166.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx167" class="ltx_listingline">
<span id="lstnumberx167.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx167.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"sys"</span><span id="lstnumberx167.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx167.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx167.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx167.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx168" class="ltx_listingline">
<span id="lstnumberx168.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx168.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"tarfile"</span><span id="lstnumberx168.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx168.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx168.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx168.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx169" class="ltx_listingline">
<span id="lstnumberx169.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx169.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"tensorflow"</span><span id="lstnumberx169.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx169.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx169.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx169.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx170" class="ltx_listingline">
<span id="lstnumberx170.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx170.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"texttable"</span><span id="lstnumberx170.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx170.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx170.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx170.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx171" class="ltx_listingline">
<span id="lstnumberx171.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx171.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"textwrap"</span><span id="lstnumberx171.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx171.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx171.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx171.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx172" class="ltx_listingline">
<span id="lstnumberx172.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx172.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"threading"</span><span id="lstnumberx172.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx172.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx172.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx172.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx173" class="ltx_listingline">
<span id="lstnumberx173.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx173.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"time"</span><span id="lstnumberx173.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx173.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx173.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Time"</span><span id="lstnumberx173.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx174" class="ltx_listingline">
<span id="lstnumberx174.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx174.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"turtle"</span><span id="lstnumberx174.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx174.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx174.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Visualization"</span><span id="lstnumberx174.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx175" class="ltx_listingline">
<span id="lstnumberx175.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx175.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"types"</span><span id="lstnumberx175.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx175.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx175.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx175.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx176" class="ltx_listingline">
<span id="lstnumberx176.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx176.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"unicodedata"</span><span id="lstnumberx176.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx176.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx176.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx176.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx177" class="ltx_listingline">
<span id="lstnumberx177.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx177.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"urllib"</span><span id="lstnumberx177.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx177.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx177.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx177.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx178" class="ltx_listingline">
<span id="lstnumberx178.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx178.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"uuid"</span><span id="lstnumberx178.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx178.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx178.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx178.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx179" class="ltx_listingline">
<span id="lstnumberx179.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx179.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"warnings"</span><span id="lstnumberx179.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx179.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx179.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx179.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx180" class="ltx_listingline">
<span id="lstnumberx180.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx180.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"werkzeug"</span><span id="lstnumberx180.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx180.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx180.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx180.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx181" class="ltx_listingline">
<span id="lstnumberx181.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx181.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"wordninja"</span><span id="lstnumberx181.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx181.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx181.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx181.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx182" class="ltx_listingline">
<span id="lstnumberx182.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx182.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"wtforms"</span><span id="lstnumberx182.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx182.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx182.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx182.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx183" class="ltx_listingline">
<span id="lstnumberx183.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx183.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"xlwt"</span><span id="lstnumberx183.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx183.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx183.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx183.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx184" class="ltx_listingline">
<span id="lstnumberx184.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx184.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"xml"</span><span id="lstnumberx184.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx184.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx184.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx184.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx185" class="ltx_listingline">
<span id="lstnumberx185.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx185.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"xmltodict"</span><span id="lstnumberx185.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx185.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx185.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx185.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx186" class="ltx_listingline">
<span id="lstnumberx186.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx186.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"yaml"</span><span id="lstnumberx186.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx186.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx186.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx186.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx187" class="ltx_listingline">
<span id="lstnumberx187.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx187.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"zipfile"</span><span id="lstnumberx187.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx187.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx187.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx187.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx188" class="ltx_listingline">
<span id="lstnumberx188.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx188.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Levenshtein"</span><span id="lstnumberx188.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx188.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx188.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx188.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx189" class="ltx_listingline">
<span id="lstnumberx189.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx189.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"ast"</span><span id="lstnumberx189.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx189.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx189.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx189.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx190" class="ltx_listingline">
<span id="lstnumberx190.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx190.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"configparser"</span><span id="lstnumberx190.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx190.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx190.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx190.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx191" class="ltx_listingline">
<span id="lstnumberx191.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx191.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"cv2"</span><span id="lstnumberx191.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx191.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx191.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx191.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx192" class="ltx_listingline">
<span id="lstnumberx192.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx192.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"decimal"</span><span id="lstnumberx192.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx192.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx192.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx192.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx193" class="ltx_listingline">
<span id="lstnumberx193.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx193.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"enum"</span><span id="lstnumberx193.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx193.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx193.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx193.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx194" class="ltx_listingline">
<span id="lstnumberx194.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx194.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"errno"</span><span id="lstnumberx194.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx194.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx194.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx194.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx195" class="ltx_listingline">
<span id="lstnumberx195.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx195.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"flask_wtf"</span><span id="lstnumberx195.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx195.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx195.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx195.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx196" class="ltx_listingline">
<span id="lstnumberx196.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx196.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"ftplib"</span><span id="lstnumberx196.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx196.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx196.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx196.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx197" class="ltx_listingline">
<span id="lstnumberx197.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx197.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"gensim"</span><span id="lstnumberx197.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx197.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx197.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx197.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx198" class="ltx_listingline">
<span id="lstnumberx198.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx198.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"geopandas"</span><span id="lstnumberx198.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx198.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx198.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx198.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx199" class="ltx_listingline">
<span id="lstnumberx199.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx199.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"holidays"</span><span id="lstnumberx199.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx199.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx199.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Time"</span><span id="lstnumberx199.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx200" class="ltx_listingline">
<span id="lstnumberx200.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx200.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"mpl_toolkits"</span><span id="lstnumberx200.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx200.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx200.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Visualization"</span><span id="lstnumberx200.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx201" class="ltx_listingline">
<span id="lstnumberx201.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx201.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"natsort"</span><span id="lstnumberx201.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx201.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx201.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx201.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx202" class="ltx_listingline">
<span id="lstnumberx202.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx202.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"pyquery"</span><span id="lstnumberx202.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx202.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx202.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx202.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx203" class="ltx_listingline">
<span id="lstnumberx203.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx203.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"python_http_client"</span><span id="lstnumberx203.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx203.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx203.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx203.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx204" class="ltx_listingline">
<span id="lstnumberx204.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx204.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"regex"</span><span id="lstnumberx204.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx204.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx204.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx204.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx205" class="ltx_listingline">
<span id="lstnumberx205.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx205.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"shapely"</span><span id="lstnumberx205.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx205.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx205.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx205.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx206" class="ltx_listingline">
<span id="lstnumberx206.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx206.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"shlex"</span><span id="lstnumberx206.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx206.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx206.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx206.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx207" class="ltx_listingline">
<span id="lstnumberx207.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx207.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"signal"</span><span id="lstnumberx207.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx207.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx207.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx207.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx208" class="ltx_listingline">
<span id="lstnumberx208.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx208.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"skimage"</span><span id="lstnumberx208.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx208.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx208.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx208.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx209" class="ltx_listingline">
<span id="lstnumberx209.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx209.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"sympy"</span><span id="lstnumberx209.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx209.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx209.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx209.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx210" class="ltx_listingline">
<span id="lstnumberx210.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx210.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"textblob"</span><span id="lstnumberx210.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx210.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx210.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx210.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx211" class="ltx_listingline">
<span id="lstnumberx211.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx211.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"typing"</span><span id="lstnumberx211.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx211.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx211.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx211.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx212" class="ltx_listingline">
<span id="lstnumberx212.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx212.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"wikipedia"</span><span id="lstnumberx212.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx212.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx212.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx212.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx213" class="ltx_listingline">
<span id="lstnumberx213.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx213.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"wordcloud"</span><span id="lstnumberx213.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx213.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx213.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Visualization"</span><span id="lstnumberx213.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx214" class="ltx_listingline">
<span id="lstnumberx214.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx214.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"zlib"</span><span id="lstnumberx214.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx214.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx214.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx214.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx215" class="ltx_listingline">
<span id="lstnumberx215.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx215.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"aspose"</span><span id="lstnumberx215.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx215.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx215.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx215.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx216" class="ltx_listingline">
<span id="lstnumberx216.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx216.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"builtins"</span><span id="lstnumberx216.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx216.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx216.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx216.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx217" class="ltx_listingline">
<span id="lstnumberx217.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx217.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"locale"</span><span id="lstnumberx217.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx217.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx217.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx217.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx218" class="ltx_listingline">
<span id="lstnumberx218.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx218.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"imp"</span><span id="lstnumberx218.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx218.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx218.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx218.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx219" class="ltx_listingline">
<span id="lstnumberx219.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx219.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"docxtpl"</span><span id="lstnumberx219.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx219.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx219.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx219.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx220" class="ltx_listingline">
<span id="lstnumberx220.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx220.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"selenium"</span><span id="lstnumberx220.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx220.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx220.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Network"</span><span id="lstnumberx220.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx221" class="ltx_listingline">
<span id="lstnumberx221.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx221.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"IPython"</span><span id="lstnumberx221.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx221.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx221.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx221.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx222" class="ltx_listingline">
<span id="lstnumberx222.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx222.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"filecmp"</span><span id="lstnumberx222.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx222.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx222.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx222.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx223" class="ltx_listingline">
<span id="lstnumberx223.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx223.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"multidict"</span><span id="lstnumberx223.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx223.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx223.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx223.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx224" class="ltx_listingline">
<span id="lstnumberx224.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx224.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"sqlalchemy"</span><span id="lstnumberx224.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx224.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx224.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx224.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx225" class="ltx_listingline">
<span id="lstnumberx225.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx225.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"obspy"</span><span id="lstnumberx225.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx225.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx225.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx225.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx226" class="ltx_listingline">
<span id="lstnumberx226.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx226.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"pprint"</span><span id="lstnumberx226.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx226.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx226.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx226.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx227" class="ltx_listingline">
<span id="lstnumberx227.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx227.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"xlrd"</span><span id="lstnumberx227.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx227.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx227.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"System"</span><span id="lstnumberx227.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx228" class="ltx_listingline">
<span id="lstnumberx228.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx228.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"argparse"</span><span id="lstnumberx228.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx228.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx228.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span><span id="lstnumberx228.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx229" class="ltx_listingline">
<span id="lstnumberx229.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx229.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"torch"</span><span id="lstnumberx229.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx229.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx229.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Computation"</span><span id="lstnumberx229.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx230" class="ltx_listingline">
<span id="lstnumberx230.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx230.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"copy"</span><span id="lstnumberx230.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx230.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx230.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"General"</span>
</div>
<div id="lstnumberx231" class="ltx_listingline">
<span id="lstnumberx231.1" class="ltx_text ltx_font_typewriter">}</span>
</div>
</div>
</div>
</section>
</section>
<section id="A7" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix G </span>Detailed Benchmark Construction</h3>

<section id="A7.SS1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">G.1 </span>Data Synthesis Prompt</h4>

<div id="A7.SS1.p1" class="ltx_para ltx_noindent">
<div id="A7.SS1.p1.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,QmFzZWQgb24gdGhlIGZvbGxvd2luZyBzaW1wbGUgZXhhbXBsZSwgd3JpdGUgbW9yZSBjb21wbGV4IHNjZW5hcmlvcyBhbmQgaW52b2tlIG11bHRpcGxlIFB5dGhvbiBsaWJyYXJpZXMgdG8gc29sdmUgZWFjaCBwcm9ibGVtLgpUaGUgd3JpdHRlbiBpbnRlbnQgc2hvdWxkIGFsaWduIHdpdGggYSBtb3JlIHNwZWNpZmljIGFuZCBwcmFjdGljYWwgc2NlbmFyaW8sIGJ1dCBzaG91bGQgc3RpbGwgYmUgZWFzeSB0byBkbyBmdW5jdGlvbmFsIGNvcnJlY3RuZXNzIGFzc2VydGlvbi4KRm9yIGVhY2ggc2NlbmFyaW8sIHdyaXRlIGEgc2luZ2xlIFB5dGhvbiBmdW5jdGlvbiB3aXRoIHRoZSByZXdyaXR0ZW4gaW50ZW50LgpQbGVhc2UgaW5jbHVkZSByZXF1aXJlbWVudHMgYW5kIHRlcm1pbmFsLWJhc2VkIGlucHV0LW91dHB1dCBleGFtcGxlcyBpbiB0aGUgZnVuY3Rpb24gZG9jc3RyaW5nLgpUaGUgZnVuY3Rpb24gc2hvdWxkIGNvbnRhaW4gY29tcGxleCBsb2dpYyBsaWtlIGlmLWVsc2Ugc3RhdGVtZW50cyBhbmQgbG9vcHMuCllvdSBoYXZlIHRvIHVzZSBtb3JlIHRoYW4gdGhyZWUgUHl0aG9uIGxpYnJhcmllcyBmb3IgYSBzY2VuYXJpby4gV3JpdGUgaW1wb3J0cyBhbmQgdmFyaWFibGUgZGVmaW5pdGlvbnMgb3V0c2lkZSB0aGUgZnVuY3Rpb24uClRyeSB0byBhdm9pZCB1c2luZyB3ZWIgQVBJcyBpZiBwb3NzaWJsZS4KSWYgdGhlcmUgYXJlIGFueSBjb25zdGFudHMgKGUuZy4gc3RyaW5ncyBhbmQgbnVtZXJpYyB2YWx1ZXMpIHVzZWQgaW4gdGhlIGZ1bmN0aW9ucywgeW91IG5lZWQgdG8gZGVjbGFyZSB0aGVtIGJlZm9yZSB0aGUgZnVuY3Rpb24uCklmIGRhdGEgaXMgdXNlZCwgeW91IG5lZWQgdG8gcHJvdmlkZSBzYW1wbGUgZGF0YSBpbiB0aGUgY29tbWVudC4KVHJ5IHRvIHJldHVybiB2YWx1ZXMgZm9yIGNvcnJlY3RuZXNzIGFzc2VydGlvbi4KRWFjaCBwcm9ncmFtbWluZyBzY2VuYXJpbyBhbmQgaW50ZW50IHNob3VsZCBiZSBzZXBhcmF0ZWQgYnkgdGhlIHNwZWNpYWwgdG9rZW4gYEdQVF9PREVYX0JSRUFLYC4KCkdlbmVyYXRlIHR3byBleGFtcGxlcyB3aXRoIHR3byBzY2VuYXJpb3M6CnsidGFza19pZCI6IDQ1MzAwNjksICJwcm9tcHQiOiAiZGVmIGZfNDUzMDA2OSgpOlxuXHRyZXR1cm4gIiwgInN1ZmZpeCI6ICIiLCAiY2Fub25pY2FsX3NvbHV0aW9uIjogImRhdGV0aW1lLm5vdyhweXR6LnV0YykiLCAidGVzdF9zdGFydCI6ICJcbmltcG9ydCBweXR6XG5pbXBvcnQgdGltZVxuZnJvbSBkYXRldGltZSBpbXBvcnQgZGF0ZXRpbWUsIHRpbWV6b25lXG5cbmRlZiBjaGVjayhjYW5kaWRhdGUpOiIsICJ0ZXN0IjogWyJcbiAgICBhc3NlcnQgKGNhbmRpZGF0ZSgpIC0gZGF0ZXRpbWUoMTk3MCwgMSwgMSkucmVwbGFjZSh0emluZm89dGltZXpvbmUudXRjKSkudG90YWxfc2Vjb25kcygpIC0gdGltZS50aW1lKCkgPD0gMVxuIl0sICJlbnRyeV9wb2ludCI6ICJmXzQ1MzAwNjkiLCAiaW50ZW50IjogImdldCBhIHZhbHVlIG9mIGRhdGV0aW1lLnRvZGF5KCkgaW4gdGhlIFVUQyB0aW1lIHpvbmUiLCAibGlicmFyeSI6IFsiZGF0ZXRpbWUiLCAicHl0eiIsICJ0aW1lIl19CgpTY2VuYXJpbyAxOgpwYW5kYXMsIHB5dHosIGRhdGV0aW1lLCByYW5kb20sIG1hdHBsb3RsaWIKYGBgcHl0aG9uCmltcG9ydCBwYW5kYXMgYXMgcGQKaW1wb3J0IHB5dHoKZnJvbSBkYXRldGltZSBpbXBvcnQgZGF0ZXRpbWUKZnJvbSByYW5kb20gaW1wb3J0IHJhbmRpbnQKaW1wb3J0IG1hdHBsb3RsaWIucHlwbG90IGFzIHBsdAoKIyBDb25zdGFudHMKQ0lUSUVTID0gWydOZXcgWW9yaycsICdMb25kb24nLCAnQmVpamluZycsICdUb2t5bycsICdTeWRuZXknXQpXRUFUSEVSX0NPTkRJVElPTlMgPSBbJ1N1bm55JywgJ0Nsb3VkeScsICdSYWlueScsICdTbm93eScsICdTdG9ybXknXQoKIyBUaW1lIHpvbmVzIGZvciB0aGUgY2l0aWVzClRJTUVaT05FUyA9IHsKICAgICdOZXcgWW9yayc6ICdBbWVyaWNhL05ld19Zb3JrJywKICAgICdMb25kb24nOiAnRXVyb3BlL0xvbmRvbicsCiAgICAnQmVpamluZyc6ICdBc2lhL1NoYW5naGFpJywKICAgICdUb2t5byc6ICdBc2lhL1Rva3lvJywKICAgICdTeWRuZXknOiAnQXVzdHJhbGlhL1N5ZG5leScKfQoKZGVmIGdlbmVyYXRlX3dlYXRoZXJfcmVwb3J0KHV0Y19kYXRldGltZSk6CiAgICAiIiIKICAgIEdlbmVyYXRlIGEgcmVwb3J0IG9mIHdlYXRoZXIgY29uZGl0aW9ucyBmb3IgYSBsaXN0IG9mIGNpdGllcyBhY3Jvc3MgdmFyaW91cwogICAgdGltZSB6b25lcyBhdCBhIGdpdmVuIHRpbWUgKFVUQykuCgogICAgUGFyYW1ldGVyczoKICAgIHV0Y19kYXRldGltZSAoZGF0ZXRpbWUpOiBUaGUgZGF0ZXRpbWUgaW4gVVRDLgoKICAgIFJldHVybnM6CiAgICBEYXRhRnJhbWU6IEEgcGFuZGFzIERhdGFGcmFtZSB3aXRoIHdlYXRoZXIgY29uZGl0aW9ucyBmb3IgdGhlIGNpdGllcy4KCiAgICBSZXF1aXJlbWVudHM6CiAgICAtIHBhbmRhcwogICAgLSBweXR6CiAgICAtIGRhdGV0aW1lCiAgICAtIHJhbmRvbQogICAgLSBtYXRwbG90bGliLnB5cGxvdAoKICAgIEV4YW1wbGU6CiAgICA+Pj4gdXRjX3RpbWUgPSBkYXRldGltZSgyMDIzLCA2LCAxNSwgMTIsIDAsIDAsIHR6aW5mbz1weXR6LlVUQykKICAgID4+PiByZXBvcnQgPSBnZW5lcmF0ZV93ZWF0aGVyX3JlcG9ydCh1dGNfdGltZSkKICAgID4+PiBwcmludChyZXBvcnQpCiAgICA+Pj4gcmVwb3J0WydXZWF0aGVyIENvbmRpdGlvbiddLnZhbHVlX2NvdW50cygpLnBsb3Qoa2luZD0nYmFyJykKICAgICIiIgogICAgcmVwb3J0X2RhdGEgPSBbXQoKICAgIGZvciBjaXR5IGluIENJVElFUzoKICAgICAgICBjaXR5X3R6ID0gcHl0ei50aW1lem9uZShUSU1FWk9ORVNbY2l0eV0pCiAgICAgICAgY2l0eV90aW1lID0gdXRjX2RhdGV0aW1lLmFzdGltZXpvbmUoY2l0eV90eikKICAgICAgICB3ZWF0aGVyID0gV0VBVEhFUl9DT05ESVRJT05TW3JhbmRpbnQoMCwgbGVuKFdFQVRIRVJfQ09ORElUSU9OUyktMSldCiAgICAgICAgcmVwb3J0X2RhdGEuYXBwZW5kKFtjaXR5LCBjaXR5X3RpbWUsIHdlYXRoZXJdKQoKICAgIHJlcG9ydF9kZiA9IHBkLkRhdGFGcmFtZShyZXBvcnRfZGF0YSwgY29sdW1ucz1bJ0NpdHknLCAnTG9jYWwgVGltZScsICdXZWF0aGVyIENvbmRpdGlvbiddKQoKICAgIHJldHVybiByZXBvcnRfZGYKYGBgCmBHUFRfT0RFWF9CUkVBS2AKClNjZW5hcmlvIDI6CnB5dHosIGRhdGV0aW1lLCBudW1weSwgZGF0ZXV0aWwKYGBgcHl0aG9uCmltcG9ydCBweXR6CmZyb20gZGF0ZXRpbWUgaW1wb3J0IGRhdGV0aW1lCmltcG9ydCBudW1weSBhcyBucApmcm9tIGRhdGV1dGlsLnBhcnNlciBpbXBvcnQgcGFyc2UKCiMgQ29uc3RhbnRzCkxFQVBfU0VDT05EUyA9IG5wLmFycmF5KFsxOTcyLCAxOTczLCAxOTc0LCAxOTc1LCAxOTc2LCAxOTc3LCAxOTc4LCAxOTc5LCAxOTgwLAogICAgICAgICAgICAgICAgICAgICAgICAgMTk4MSwgMTk4MiwgMTk4MywgMTk4NSwgMTk4OCwgMTk5MCwgMTk5MywgMTk5NCwgMTk5NywKICAgICAgICAgICAgICAgICAgICAgICAgIDE5OTksIDIwMDYsIDIwMDksIDIwMTIsIDIwMTUsIDIwMTYsIDIwMjBdKQoKZGVmIHRvdGFsX3NlY29uZHNfc2luY2VfZGF0ZShkYXRlX3N0ciwgZnJvbV90eiwgdG9fdHopOgogICAgIiIiCiAgICBDYWxjdWxhdGUgdGhlIHRvdGFsIHNlY29uZHMgdGhhdCBoYXZlIHBhc3NlZCBzaW5jZSBhIGdpdmVuIGRhdGV0aW1lIGZyb20gdGhlIGN1cnJlbnQgdGltZQogICAgaW4gZGlmZmVyZW50IHRpbWV6b25lcyBjb25zaWRlcmluZyB0aGUgbGVhcCBzZWNvbmRzLgoKICAgIFBhcmFtZXRlcnM6CiAgICBkYXRlX3N0ciAoc3RyKTogVGhlIGRhdGUgc3RyaW5nIGluICJ5eXl5LW1tLWRkIGhoOm1tOnNzIiBmb3JtYXQuCiAgICBmcm9tX3R6IChzdHIpOiBUaGUgdGltZXpvbmUgb2YgdGhlIGdpdmVuIGRhdGUgc3RyaW5nLgogICAgdG9fdHogKHN0cik6IFRoZSB0aW1lem9uZSB0byB3aGljaCB0aGUgY3VycmVudCB0aW1lIHNob3VsZCBiZSBjb252ZXJ0ZWQuCgogICAgUmV0dXJuczoKICAgIGludDogVGhlIHRvdGFsIHNlY29uZHMuCgogICAgUmVxdWlyZW1lbnRzOgogICAgLSBkYXRldGltZQogICAgLSBweXR6CiAgICAtIG51bXB5CiAgICAtIGRhdGV1dGlsLnBhcnNlcgoKICAgIEV4YW1wbGU6CiAgICA+Pj4gdG90YWxfc2Vjb25kc19zaW5jZV9kYXRlKCcxOTcwLTAxLTAxIDAwOjAwOjAwJywgJ1VUQycsICdBbWVyaWNhL05ld19Zb3JrJykKICAgICIiIgogICAgZnJvbV90eiA9IHB5dHoudGltZXpvbmUoZnJvbV90eikKICAgIHRvX3R6ID0gcHl0ei50aW1lem9uZSh0b190eikKICAgIGdpdmVuX2RhdGUgPSBwYXJzZShkYXRlX3N0cikucmVwbGFjZSh0emluZm89ZnJvbV90eikKICAgIGN1cnJlbnRfZGF0ZSA9IGRhdGV0aW1lLm5vdygpLmFzdGltZXpvbmUodG9fdHopCgogICAgdG90YWxfc2Vjb25kcyA9IChjdXJyZW50X2RhdGUgLSBnaXZlbl9kYXRlKS50b3RhbF9zZWNvbmRzKCkKCiAgICBsZWFwX3llYXJzID0gTEVBUF9TRUNPTkRTW25wLmxvZ2ljYWxfYW5kKExFQVBfU0VDT05EUyA+PSBnaXZlbl9kYXRlLnllYXIsIExFQVBfU0VDT05EUyA8PSBjdXJyZW50X2RhdGUueWVhcildCiAgICBsZWFwX3NlY29uZHMgPSBsZW4obGVhcF95ZWFycykKCiAgICB0b3RhbF9zZWNvbmRzICs9IGxlYXBfc2Vjb25kcwoKICAgIHJldHVybiBpbnQodG90YWxfc2Vjb25kcykKYGBgCgpBYm92ZSBpcyB0aGUgaWxsdXN0cmF0aW9uLgoKR2VuZXJhdGUgZml2ZSBjb21wbGV4IHNjZW5hcmlvcyBiYXNlZCBvbiB0aGUgZm9sbG93aW5nIHNpbXBsZSBleGFtcGxlOg==" download="">⬇</a></div>
<div id="lstnumberx232" class="ltx_listingline">
<span id="lstnumberx232.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Based</span><span id="lstnumberx232.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">on</span><span id="lstnumberx232.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx232.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx232.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">simple</span><span id="lstnumberx232.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx232.12" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx232.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx232.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx232.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.18" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">complex</span><span id="lstnumberx232.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scenarios</span><span id="lstnumberx232.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.22" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">and</span><span id="lstnumberx232.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">invoke</span><span id="lstnumberx232.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">multiple</span><span id="lstnumberx232.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Python</span><span id="lstnumberx232.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx232.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx232.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">solve</span><span id="lstnumberx232.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">each</span><span id="lstnumberx232.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx232.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">problem</span><span id="lstnumberx232.39" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx233" class="ltx_listingline">
<span id="lstnumberx233.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx233.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">written</span><span id="lstnumberx233.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">intent</span><span id="lstnumberx233.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx233.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">align</span><span id="lstnumberx233.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx233.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx233.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx233.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">specific</span><span id="lstnumberx233.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.19" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">and</span><span id="lstnumberx233.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">practical</span><span id="lstnumberx233.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scenario</span><span id="lstnumberx233.24" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx233.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">but</span><span id="lstnumberx233.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx233.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">still</span><span id="lstnumberx233.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx233.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">easy</span><span id="lstnumberx233.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx233.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">do</span><span id="lstnumberx233.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functional</span><span id="lstnumberx233.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correctness</span><span id="lstnumberx233.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx233.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">assertion</span><span id="lstnumberx233.45" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx234" class="ltx_listingline">
<span id="lstnumberx234.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx234.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">each</span><span id="lstnumberx234.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scenario</span><span id="lstnumberx234.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx234.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx234.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx234.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">single</span><span id="lstnumberx234.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Python</span><span id="lstnumberx234.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx234.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx234.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx234.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">rewritten</span><span id="lstnumberx234.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx234.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">intent</span><span id="lstnumberx234.25" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx235" class="ltx_listingline">
<span id="lstnumberx235.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Please</span><span id="lstnumberx235.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">include</span><span id="lstnumberx235.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requirements</span><span id="lstnumberx235.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.7" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">and</span><span id="lstnumberx235.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">terminal</span><span id="lstnumberx235.10" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx235.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">based</span><span id="lstnumberx235.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.13" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">input</span><span id="lstnumberx235.14" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx235.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">output</span><span id="lstnumberx235.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">examples</span><span id="lstnumberx235.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.19" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx235.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx235.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx235.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx235.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docstring</span><span id="lstnumberx235.26" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx236" class="ltx_listingline">
<span id="lstnumberx236.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx236.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx236.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx236.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contain</span><span id="lstnumberx236.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.9" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">complex</span><span id="lstnumberx236.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">logic</span><span id="lstnumberx236.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">like</span><span id="lstnumberx236.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.15" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx236.16" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx236.17" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">else</span><span id="lstnumberx236.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">statements</span><span id="lstnumberx236.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.21" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">and</span><span id="lstnumberx236.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx236.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">loops</span><span id="lstnumberx236.24" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx237" class="ltx_listingline">
<span id="lstnumberx237.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx237.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">have</span><span id="lstnumberx237.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx237.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx237.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx237.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">than</span><span id="lstnumberx237.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">three</span><span id="lstnumberx237.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Python</span><span id="lstnumberx237.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx237.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.19" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx237.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx237.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scenario</span><span id="lstnumberx237.24" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx237.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Write</span><span id="lstnumberx237.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imports</span><span id="lstnumberx237.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.30" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">and</span><span id="lstnumberx237.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">variable</span><span id="lstnumberx237.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">definitions</span><span id="lstnumberx237.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">outside</span><span id="lstnumberx237.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx237.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx237.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx237.41" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx238" class="ltx_listingline">
<span id="lstnumberx238.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Try</span><span id="lstnumberx238.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx238.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx238.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx238.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">avoid</span><span id="lstnumberx238.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx238.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">using</span><span id="lstnumberx238.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx238.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">web</span><span id="lstnumberx238.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx238.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx238.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx238.13" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx238.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx238.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">possible</span><span id="lstnumberx238.16" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx239" class="ltx_listingline">
<span id="lstnumberx239.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx239.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">there</span><span id="lstnumberx239.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx239.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.7" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">any</span><span id="lstnumberx239.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">constants</span><span id="lstnumberx239.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx239.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">e</span><span id="lstnumberx239.13" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx239.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">g</span><span id="lstnumberx239.15" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx239.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">strings</span><span id="lstnumberx239.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.19" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">and</span><span id="lstnumberx239.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numeric</span><span id="lstnumberx239.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx239.24" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx239.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx239.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.28" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx239.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx239.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functions</span><span id="lstnumberx239.33" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx239.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx239.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx239.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx239.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">declare</span><span id="lstnumberx239.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx239.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">before</span><span id="lstnumberx239.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx239.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx239.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx239.50" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx240" class="ltx_listingline">
<span id="lstnumberx240.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx240.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx240.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.5" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">is</span><span id="lstnumberx240.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx240.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx240.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx240.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx240.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx240.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">provide</span><span id="lstnumberx240.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sample</span><span id="lstnumberx240.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx240.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.22" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx240.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx240.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx240.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">comment</span><span id="lstnumberx240.27" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx241" class="ltx_listingline">
<span id="lstnumberx241.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Try</span><span id="lstnumberx241.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx241.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx241.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx241.5" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx241.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx241.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx241.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx241.9" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx241.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx241.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correctness</span><span id="lstnumberx241.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx241.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">assertion</span><span id="lstnumberx241.14" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx242" class="ltx_listingline">
<span id="lstnumberx242.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Each</span><span id="lstnumberx242.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">programming</span><span id="lstnumberx242.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scenario</span><span id="lstnumberx242.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.7" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">and</span><span id="lstnumberx242.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">intent</span><span id="lstnumberx242.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx242.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx242.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">separated</span><span id="lstnumberx242.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">by</span><span id="lstnumberx242.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx242.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">special</span><span id="lstnumberx242.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">token</span><span id="lstnumberx242.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx242.25" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx242.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">GPT_ODEX_BREAK</span><span id="lstnumberx242.27" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx243" class="ltx_listingline">
</div>
<div id="lstnumberx244" class="ltx_listingline">
<span id="lstnumberx244.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Generate</span><span id="lstnumberx244.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx244.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">two</span><span id="lstnumberx244.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx244.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">examples</span><span id="lstnumberx244.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx244.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx244.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx244.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">two</span><span id="lstnumberx244.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx244.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scenarios</span><span id="lstnumberx244.12" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx245" class="ltx_listingline">
<span id="lstnumberx245.1" class="ltx_text ltx_font_typewriter">{</span><span id="lstnumberx245.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"task_id"</span><span id="lstnumberx245.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx245.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.5" class="ltx_text ltx_font_typewriter">4530069,</span><span id="lstnumberx245.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.7" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"prompt"</span><span id="lstnumberx245.8" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx245.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.10" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"def<span id="lstnumberx245.10.1" class="ltx_text ltx_lst_space"> </span>f_4530069():\n\treturn<span id="lstnumberx245.10.2" class="ltx_text ltx_lst_space"> </span>"</span><span id="lstnumberx245.11" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx245.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.13" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"suffix"</span><span id="lstnumberx245.14" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx245.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.16" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx245.17" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx245.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.19" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"canonical_solution"</span><span id="lstnumberx245.20" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx245.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.22" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"datetime.now(pytz.utc)"</span><span id="lstnumberx245.23" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx245.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.25" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"test_start"</span><span id="lstnumberx245.26" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx245.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.28" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"\nimport<span id="lstnumberx245.28.1" class="ltx_text ltx_lst_space"> </span>pytz\nimport<span id="lstnumberx245.28.2" class="ltx_text ltx_lst_space"> </span>time\nfrom<span id="lstnumberx245.28.3" class="ltx_text ltx_lst_space"> </span>datetime<span id="lstnumberx245.28.4" class="ltx_text ltx_lst_space"> </span>import<span id="lstnumberx245.28.5" class="ltx_text ltx_lst_space"> </span>datetime,<span id="lstnumberx245.28.6" class="ltx_text ltx_lst_space"> </span>timezone\n\ndef<span id="lstnumberx245.28.7" class="ltx_text ltx_lst_space"> </span>check(candidate):"</span><span id="lstnumberx245.29" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx245.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.31" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"test"</span><span id="lstnumberx245.32" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx245.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.34" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx245.35" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"\n<span id="lstnumberx245.35.1" class="ltx_text ltx_lst_space">    </span>assert<span id="lstnumberx245.35.2" class="ltx_text ltx_lst_space"> </span>(candidate()<span id="lstnumberx245.35.3" class="ltx_text ltx_lst_space"> </span>-<span id="lstnumberx245.35.4" class="ltx_text ltx_lst_space"> </span>datetime(1970,<span id="lstnumberx245.35.5" class="ltx_text ltx_lst_space"> </span>1,<span id="lstnumberx245.35.6" class="ltx_text ltx_lst_space"> </span>1).replace(tzinfo=timezone.utc)).total_seconds()<span id="lstnumberx245.35.7" class="ltx_text ltx_lst_space"> </span>-<span id="lstnumberx245.35.8" class="ltx_text ltx_lst_space"> </span>time.time()<span id="lstnumberx245.35.9" class="ltx_text ltx_lst_space"> </span>&lt;=<span id="lstnumberx245.35.10" class="ltx_text ltx_lst_space"> </span>1\n"</span><span id="lstnumberx245.36" class="ltx_text ltx_font_typewriter">],</span><span id="lstnumberx245.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.38" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"entry_point"</span><span id="lstnumberx245.39" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx245.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.41" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"f_4530069"</span><span id="lstnumberx245.42" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx245.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.44" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"intent"</span><span id="lstnumberx245.45" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx245.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.47" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"get<span id="lstnumberx245.47.1" class="ltx_text ltx_lst_space"> </span>a<span id="lstnumberx245.47.2" class="ltx_text ltx_lst_space"> </span>value<span id="lstnumberx245.47.3" class="ltx_text ltx_lst_space"> </span>of<span id="lstnumberx245.47.4" class="ltx_text ltx_lst_space"> </span>datetime.today()<span id="lstnumberx245.47.5" class="ltx_text ltx_lst_space"> </span>in<span id="lstnumberx245.47.6" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx245.47.7" class="ltx_text ltx_lst_space"> </span>UTC<span id="lstnumberx245.47.8" class="ltx_text ltx_lst_space"> </span>time<span id="lstnumberx245.47.9" class="ltx_text ltx_lst_space"> </span>zone"</span><span id="lstnumberx245.48" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx245.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.50" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"library"</span><span id="lstnumberx245.51" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx245.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.53" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx245.54" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"datetime"</span><span id="lstnumberx245.55" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx245.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.57" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"pytz"</span><span id="lstnumberx245.58" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx245.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx245.60" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"time"</span><span id="lstnumberx245.61" class="ltx_text ltx_font_typewriter">]}</span>
</div>
<div id="lstnumberx246" class="ltx_listingline">
</div>
<div id="lstnumberx247" class="ltx_listingline">
<span id="lstnumberx247.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Scenario</span><span id="lstnumberx247.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx247.3" class="ltx_text ltx_font_typewriter">1:</span>
</div>
<div id="lstnumberx248" class="ltx_listingline">
<span id="lstnumberx248.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pandas</span><span id="lstnumberx248.2" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx248.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx248.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytz</span><span id="lstnumberx248.5" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx248.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx248.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">datetime</span><span id="lstnumberx248.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx248.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx248.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx248.11" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx248.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx248.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matplotlib</span>
</div>
<div id="lstnumberx249" class="ltx_listingline">
<span id="lstnumberx249.1" class="ltx_text ltx_font_typewriter">‘‘‘</span><span id="lstnumberx249.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">python</span>
</div>
<div id="lstnumberx250" class="ltx_listingline">
<span id="lstnumberx250.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx250.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx250.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pandas</span><span id="lstnumberx250.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx250.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx250.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx250.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pd</span>
</div>
<div id="lstnumberx251" class="ltx_listingline">
<span id="lstnumberx251.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx251.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx251.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytz</span>
</div>
<div id="lstnumberx252" class="ltx_listingline">
<span id="lstnumberx252.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">from</span><span id="lstnumberx252.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx252.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">datetime</span><span id="lstnumberx252.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx252.5" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx252.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx252.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">datetime</span>
</div>
<div id="lstnumberx253" class="ltx_listingline">
<span id="lstnumberx253.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">from</span><span id="lstnumberx253.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx253.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx253.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx253.5" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx253.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx253.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">randint</span>
</div>
<div id="lstnumberx254" class="ltx_listingline">
<span id="lstnumberx254.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx254.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx254.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matplotlib</span><span id="lstnumberx254.4" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx254.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pyplot</span><span id="lstnumberx254.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx254.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx254.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx254.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plt</span>
</div>
<div id="lstnumberx255" class="ltx_listingline">
</div>
<div id="lstnumberx256" class="ltx_listingline">
<span id="lstnumberx256.1" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx256.1.1" class="ltx_text ltx_lst_space"> </span>Constants</span>
</div>
<div id="lstnumberx257" class="ltx_listingline">
<span id="lstnumberx257.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">CITIES</span><span id="lstnumberx257.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx257.3" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx257.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx257.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx257.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’New<span id="lstnumberx257.6.1" class="ltx_text ltx_lst_space"> </span>York’</span><span id="lstnumberx257.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx257.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx257.9" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’London’</span><span id="lstnumberx257.10" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx257.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx257.12" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Beijing’</span><span id="lstnumberx257.13" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx257.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx257.15" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Tokyo’</span><span id="lstnumberx257.16" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx257.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx257.18" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Sydney’</span><span id="lstnumberx257.19" class="ltx_text ltx_font_typewriter">]</span>
</div>
<div id="lstnumberx258" class="ltx_listingline">
<span id="lstnumberx258.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">WEATHER_CONDITIONS</span><span id="lstnumberx258.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx258.3" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx258.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx258.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx258.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Sunny’</span><span id="lstnumberx258.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx258.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx258.9" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Cloudy’</span><span id="lstnumberx258.10" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx258.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx258.12" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Rainy’</span><span id="lstnumberx258.13" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx258.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx258.15" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Snowy’</span><span id="lstnumberx258.16" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx258.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx258.18" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Stormy’</span><span id="lstnumberx258.19" class="ltx_text ltx_font_typewriter">]</span>
</div>
<div id="lstnumberx259" class="ltx_listingline">
</div>
<div id="lstnumberx260" class="ltx_listingline">
<span id="lstnumberx260.1" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx260.1.1" class="ltx_text ltx_lst_space"> </span>Time<span id="lstnumberx260.1.2" class="ltx_text ltx_lst_space"> </span>zones<span id="lstnumberx260.1.3" class="ltx_text ltx_lst_space"> </span>for<span id="lstnumberx260.1.4" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx260.1.5" class="ltx_text ltx_lst_space"> </span>cities</span>
</div>
<div id="lstnumberx261" class="ltx_listingline">
<span id="lstnumberx261.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TIMEZONES</span><span id="lstnumberx261.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx261.3" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx261.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx261.5" class="ltx_text ltx_font_typewriter">{</span>
</div>
<div id="lstnumberx262" class="ltx_listingline">
<span id="lstnumberx262.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx262.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’New<span id="lstnumberx262.2.1" class="ltx_text ltx_lst_space"> </span>York’</span><span id="lstnumberx262.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx262.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx262.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’America/New_York’</span><span id="lstnumberx262.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx263" class="ltx_listingline">
<span id="lstnumberx263.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx263.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’London’</span><span id="lstnumberx263.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx263.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx263.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Europe/London’</span><span id="lstnumberx263.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx264" class="ltx_listingline">
<span id="lstnumberx264.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx264.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Beijing’</span><span id="lstnumberx264.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx264.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx264.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Asia/Shanghai’</span><span id="lstnumberx264.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx265" class="ltx_listingline">
<span id="lstnumberx265.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx265.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Tokyo’</span><span id="lstnumberx265.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx265.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx265.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Asia/Tokyo’</span><span id="lstnumberx265.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx266" class="ltx_listingline">
<span id="lstnumberx266.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx266.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Sydney’</span><span id="lstnumberx266.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx266.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx266.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Australia/Sydney’</span>
</div>
<div id="lstnumberx267" class="ltx_listingline">
<span id="lstnumberx267.1" class="ltx_text ltx_font_typewriter">}</span>
</div>
<div id="lstnumberx268" class="ltx_listingline">
</div>
<div id="lstnumberx269" class="ltx_listingline">
<span id="lstnumberx269.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx269.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx269.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">generate_weather_report</span><span id="lstnumberx269.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx269.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">utc_datetime</span><span id="lstnumberx269.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx270" class="ltx_listingline">
<span id="lstnumberx270.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx270.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx270.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx271" class="ltx_listingline">
<span id="lstnumberx271.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx271.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Generate</span><span id="lstnumberx271.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx271.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">report</span><span id="lstnumberx271.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx271.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">weather</span><span id="lstnumberx271.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">conditions</span><span id="lstnumberx271.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">for</span><span id="lstnumberx271.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx271.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx271.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx271.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">cities</span><span id="lstnumberx271.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">across</span><span id="lstnumberx271.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx271.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">various</span>
</div>
<div id="lstnumberx272" class="ltx_listingline">
<span id="lstnumberx272.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx272.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">time</span><span id="lstnumberx272.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx272.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">zones</span><span id="lstnumberx272.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx272.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">at</span><span id="lstnumberx272.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx272.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx272.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx272.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">given</span><span id="lstnumberx272.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx272.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">time</span><span id="lstnumberx272.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx272.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(UTC).</span>
</div>
<div id="lstnumberx273" class="ltx_listingline">
</div>
<div id="lstnumberx274" class="ltx_listingline">
<span id="lstnumberx274.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx274.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx275" class="ltx_listingline">
<span id="lstnumberx275.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx275.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">utc_datetime</span><span id="lstnumberx275.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx275.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(datetime):</span><span id="lstnumberx275.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx275.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx275.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx275.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">datetime</span><span id="lstnumberx275.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx275.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx275.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx275.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">UTC.</span>
</div>
<div id="lstnumberx276" class="ltx_listingline">
</div>
<div id="lstnumberx277" class="ltx_listingline">
<span id="lstnumberx277.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx277.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx278" class="ltx_listingline">
<span id="lstnumberx278.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx278.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">DataFrame:</span><span id="lstnumberx278.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx278.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx278.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx278.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pandas</span><span id="lstnumberx278.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx278.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">DataFrame</span><span id="lstnumberx278.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx278.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx278.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx278.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">weather</span><span id="lstnumberx278.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx278.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">conditions</span><span id="lstnumberx278.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx278.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">for</span><span id="lstnumberx278.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx278.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx278.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx278.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">cities.</span>
</div>
<div id="lstnumberx279" class="ltx_listingline">
</div>
<div id="lstnumberx280" class="ltx_listingline">
<span id="lstnumberx280.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx280.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx281" class="ltx_listingline">
<span id="lstnumberx281.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx281.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx281.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx281.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pandas</span>
</div>
<div id="lstnumberx282" class="ltx_listingline">
<span id="lstnumberx282.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx282.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx282.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx282.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pytz</span>
</div>
<div id="lstnumberx283" class="ltx_listingline">
<span id="lstnumberx283.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx283.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx283.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx283.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">datetime</span>
</div>
<div id="lstnumberx284" class="ltx_listingline">
<span id="lstnumberx284.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx284.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx284.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx284.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">random</span>
</div>
<div id="lstnumberx285" class="ltx_listingline">
<span id="lstnumberx285.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx285.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx285.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx285.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matplotlib.pyplot</span>
</div>
<div id="lstnumberx286" class="ltx_listingline">
</div>
<div id="lstnumberx287" class="ltx_listingline">
<span id="lstnumberx287.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx287.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx288" class="ltx_listingline">
<span id="lstnumberx288.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx288.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx288.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx288.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">utc_time</span><span id="lstnumberx288.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx288.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx288.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx288.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">datetime(2023,</span><span id="lstnumberx288.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx288.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">6,</span><span id="lstnumberx288.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx288.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">15,</span><span id="lstnumberx288.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx288.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">12,</span><span id="lstnumberx288.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx288.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">0,</span><span id="lstnumberx288.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx288.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">0,</span><span id="lstnumberx288.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx288.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tzinfo=pytz.UTC)</span>
</div>
<div id="lstnumberx289" class="ltx_listingline">
<span id="lstnumberx289.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx289.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx289.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx289.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">report</span><span id="lstnumberx289.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx289.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx289.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx289.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">generate_weather_report(utc_time)</span>
</div>
<div id="lstnumberx290" class="ltx_listingline">
<span id="lstnumberx290.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx290.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx290.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx290.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">print(report)</span>
</div>
<div id="lstnumberx291" class="ltx_listingline">
<span id="lstnumberx291.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx291.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx291.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx291.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">report[’Weather</span><span id="lstnumberx291.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx291.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Condition’].value_counts().plot(kind=’bar’)</span>
</div>
<div id="lstnumberx292" class="ltx_listingline">
<span id="lstnumberx292.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx292.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx292.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx292.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx293" class="ltx_listingline">
<span id="lstnumberx293.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx293.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">report_data</span><span id="lstnumberx293.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx293.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx293.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx293.6" class="ltx_text ltx_font_typewriter">[]</span>
</div>
<div id="lstnumberx294" class="ltx_listingline">
</div>
<div id="lstnumberx295" class="ltx_listingline">
<span id="lstnumberx295.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx295.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx295.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx295.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">city</span><span id="lstnumberx295.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx295.6" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx295.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx295.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">CITIES</span><span id="lstnumberx295.9" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx296" class="ltx_listingline">
<span id="lstnumberx296.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx296.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">city_tz</span><span id="lstnumberx296.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx296.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx296.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx296.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytz</span><span id="lstnumberx296.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx296.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">timezone</span><span id="lstnumberx296.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx296.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TIMEZONES</span><span id="lstnumberx296.11" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx296.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">city</span><span id="lstnumberx296.13" class="ltx_text ltx_font_typewriter">])</span>
</div>
<div id="lstnumberx297" class="ltx_listingline">
<span id="lstnumberx297.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx297.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">city_time</span><span id="lstnumberx297.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx297.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx297.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx297.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">utc_datetime</span><span id="lstnumberx297.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx297.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">astimezone</span><span id="lstnumberx297.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx297.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">city_tz</span><span id="lstnumberx297.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx298" class="ltx_listingline">
<span id="lstnumberx298.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx298.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">weather</span><span id="lstnumberx298.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx298.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx298.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx298.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">WEATHER_CONDITIONS</span><span id="lstnumberx298.7" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx298.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">randint</span><span id="lstnumberx298.9" class="ltx_text ltx_font_typewriter">(0,</span><span id="lstnumberx298.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx298.11" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">len</span><span id="lstnumberx298.12" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx298.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">WEATHER_CONDITIONS</span><span id="lstnumberx298.14" class="ltx_text ltx_font_typewriter">)-1)]</span>
</div>
<div id="lstnumberx299" class="ltx_listingline">
<span id="lstnumberx299.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx299.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">report_data</span><span id="lstnumberx299.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx299.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">append</span><span id="lstnumberx299.5" class="ltx_text ltx_font_typewriter">([</span><span id="lstnumberx299.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">city</span><span id="lstnumberx299.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx299.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx299.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">city_time</span><span id="lstnumberx299.10" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx299.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx299.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">weather</span><span id="lstnumberx299.13" class="ltx_text ltx_font_typewriter">])</span>
</div>
<div id="lstnumberx300" class="ltx_listingline">
</div>
<div id="lstnumberx301" class="ltx_listingline">
<span id="lstnumberx301.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx301.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">report_df</span><span id="lstnumberx301.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx301.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx301.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx301.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pd</span><span id="lstnumberx301.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx301.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">DataFrame</span><span id="lstnumberx301.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx301.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">report_data</span><span id="lstnumberx301.11" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx301.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx301.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">columns</span><span id="lstnumberx301.14" class="ltx_text ltx_font_typewriter">=[</span><span id="lstnumberx301.15" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’City’</span><span id="lstnumberx301.16" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx301.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx301.18" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Local<span id="lstnumberx301.18.1" class="ltx_text ltx_lst_space"> </span>Time’</span><span id="lstnumberx301.19" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx301.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx301.21" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Weather<span id="lstnumberx301.21.1" class="ltx_text ltx_lst_space"> </span>Condition’</span><span id="lstnumberx301.22" class="ltx_text ltx_font_typewriter">])</span>
</div>
<div id="lstnumberx302" class="ltx_listingline">
</div>
<div id="lstnumberx303" class="ltx_listingline">
<span id="lstnumberx303.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx303.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx303.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx303.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">report_df</span>
</div>
<div id="lstnumberx304" class="ltx_listingline">
<span id="lstnumberx304.1" class="ltx_text ltx_font_typewriter">‘‘‘</span>
</div>
<div id="lstnumberx305" class="ltx_listingline">
<span id="lstnumberx305.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx305.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">GPT_ODEX_BREAK</span><span id="lstnumberx305.3" class="ltx_text ltx_font_typewriter">‘</span>
</div>
<div id="lstnumberx306" class="ltx_listingline">
</div>
<div id="lstnumberx307" class="ltx_listingline">
<span id="lstnumberx307.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Scenario</span><span id="lstnumberx307.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx307.3" class="ltx_text ltx_font_typewriter">2:</span>
</div>
<div id="lstnumberx308" class="ltx_listingline">
<span id="lstnumberx308.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytz</span><span id="lstnumberx308.2" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx308.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx308.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">datetime</span><span id="lstnumberx308.5" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx308.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx308.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numpy</span><span id="lstnumberx308.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx308.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx308.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dateutil</span>
</div>
<div id="lstnumberx309" class="ltx_listingline">
<span id="lstnumberx309.1" class="ltx_text ltx_font_typewriter">‘‘‘</span><span id="lstnumberx309.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">python</span>
</div>
<div id="lstnumberx310" class="ltx_listingline">
<span id="lstnumberx310.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx310.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx310.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytz</span>
</div>
<div id="lstnumberx311" class="ltx_listingline">
<span id="lstnumberx311.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">from</span><span id="lstnumberx311.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx311.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">datetime</span><span id="lstnumberx311.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx311.5" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx311.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx311.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">datetime</span>
</div>
<div id="lstnumberx312" class="ltx_listingline">
<span id="lstnumberx312.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx312.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx312.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numpy</span><span id="lstnumberx312.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx312.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx312.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx312.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span>
</div>
<div id="lstnumberx313" class="ltx_listingline">
<span id="lstnumberx313.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">from</span><span id="lstnumberx313.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx313.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dateutil</span><span id="lstnumberx313.4" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx313.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parser</span><span id="lstnumberx313.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx313.7" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx313.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx313.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parse</span>
</div>
<div id="lstnumberx314" class="ltx_listingline">
</div>
<div id="lstnumberx315" class="ltx_listingline">
<span id="lstnumberx315.1" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx315.1.1" class="ltx_text ltx_lst_space"> </span>Constants</span>
</div>
<div id="lstnumberx316" class="ltx_listingline">
<span id="lstnumberx316.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">LEAP_SECONDS</span><span id="lstnumberx316.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.3" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx316.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx316.6" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx316.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">array</span><span id="lstnumberx316.8" class="ltx_text ltx_font_typewriter">([1972,</span><span id="lstnumberx316.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.10" class="ltx_text ltx_font_typewriter">1973,</span><span id="lstnumberx316.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.12" class="ltx_text ltx_font_typewriter">1974,</span><span id="lstnumberx316.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.14" class="ltx_text ltx_font_typewriter">1975,</span><span id="lstnumberx316.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.16" class="ltx_text ltx_font_typewriter">1976,</span><span id="lstnumberx316.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.18" class="ltx_text ltx_font_typewriter">1977,</span><span id="lstnumberx316.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.20" class="ltx_text ltx_font_typewriter">1978,</span><span id="lstnumberx316.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.22" class="ltx_text ltx_font_typewriter">1979,</span><span id="lstnumberx316.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx316.24" class="ltx_text ltx_font_typewriter">1980,</span>
</div>
<div id="lstnumberx317" class="ltx_listingline">
<span id="lstnumberx317.1" class="ltx_text ltx_lst_space ltx_font_typewriter">                         </span><span id="lstnumberx317.2" class="ltx_text ltx_font_typewriter">1981,</span><span id="lstnumberx317.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx317.4" class="ltx_text ltx_font_typewriter">1982,</span><span id="lstnumberx317.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx317.6" class="ltx_text ltx_font_typewriter">1983,</span><span id="lstnumberx317.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx317.8" class="ltx_text ltx_font_typewriter">1985,</span><span id="lstnumberx317.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx317.10" class="ltx_text ltx_font_typewriter">1988,</span><span id="lstnumberx317.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx317.12" class="ltx_text ltx_font_typewriter">1990,</span><span id="lstnumberx317.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx317.14" class="ltx_text ltx_font_typewriter">1993,</span><span id="lstnumberx317.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx317.16" class="ltx_text ltx_font_typewriter">1994,</span><span id="lstnumberx317.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx317.18" class="ltx_text ltx_font_typewriter">1997,</span>
</div>
<div id="lstnumberx318" class="ltx_listingline">
<span id="lstnumberx318.1" class="ltx_text ltx_lst_space ltx_font_typewriter">                         </span><span id="lstnumberx318.2" class="ltx_text ltx_font_typewriter">1999,</span><span id="lstnumberx318.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx318.4" class="ltx_text ltx_font_typewriter">2006,</span><span id="lstnumberx318.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx318.6" class="ltx_text ltx_font_typewriter">2009,</span><span id="lstnumberx318.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx318.8" class="ltx_text ltx_font_typewriter">2012,</span><span id="lstnumberx318.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx318.10" class="ltx_text ltx_font_typewriter">2015,</span><span id="lstnumberx318.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx318.12" class="ltx_text ltx_font_typewriter">2016,</span><span id="lstnumberx318.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx318.14" class="ltx_text ltx_font_typewriter">2020])</span>
</div>
<div id="lstnumberx319" class="ltx_listingline">
</div>
<div id="lstnumberx320" class="ltx_listingline">
<span id="lstnumberx320.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx320.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx320.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">total_seconds_since_date</span><span id="lstnumberx320.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx320.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">date_str</span><span id="lstnumberx320.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx320.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx320.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">from_tz</span><span id="lstnumberx320.9" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx320.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx320.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to_tz</span><span id="lstnumberx320.12" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx321" class="ltx_listingline">
<span id="lstnumberx321.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx321.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx321.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx322" class="ltx_listingline">
<span id="lstnumberx322.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx322.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Calculate</span><span id="lstnumberx322.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx322.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">total</span><span id="lstnumberx322.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">seconds</span><span id="lstnumberx322.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">that</span><span id="lstnumberx322.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">have</span><span id="lstnumberx322.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">passed</span><span id="lstnumberx322.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">since</span><span id="lstnumberx322.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx322.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">given</span><span id="lstnumberx322.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">datetime</span><span id="lstnumberx322.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from</span><span id="lstnumberx322.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx322.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">current</span><span id="lstnumberx322.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx322.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">time</span>
</div>
<div id="lstnumberx323" class="ltx_listingline">
<span id="lstnumberx323.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx323.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx323.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx323.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">different</span><span id="lstnumberx323.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx323.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">timezones</span><span id="lstnumberx323.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx323.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">considering</span><span id="lstnumberx323.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx323.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx323.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx323.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">leap</span><span id="lstnumberx323.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx323.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">seconds.</span>
</div>
<div id="lstnumberx324" class="ltx_listingline">
</div>
<div id="lstnumberx325" class="ltx_listingline">
<span id="lstnumberx325.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx325.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx326" class="ltx_listingline">
<span id="lstnumberx326.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx326.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">date_str</span><span id="lstnumberx326.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx326.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(str):</span><span id="lstnumberx326.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx326.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx326.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx326.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">date</span><span id="lstnumberx326.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx326.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">string</span><span id="lstnumberx326.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx326.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx326.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx326.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx326.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">yyyy</span><span id="lstnumberx326.16" class="ltx_text ltx_font_typewriter">-<span id="lstnumberx326.16.1" class="ltx_text ltx_lst_identifier">mm</span>-<span id="lstnumberx326.16.2" class="ltx_text ltx_lst_identifier">dd</span><span id="lstnumberx326.16.3" class="ltx_text ltx_lst_space"> </span><span id="lstnumberx326.16.4" class="ltx_text ltx_lst_identifier">hh</span>:<span id="lstnumberx326.16.5" class="ltx_text ltx_lst_identifier">mm</span>:<span id="lstnumberx326.16.6" class="ltx_text ltx_lst_identifier">ss</span><span id="lstnumberx326.16.7" class="ltx_text ltx_lst_string"></span></span><span id="lstnumberx326.17" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx326.18" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx326.19" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">format.</span>
</div>
<div id="lstnumberx327" class="ltx_listingline">
<span id="lstnumberx327.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx327.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from_tz</span><span id="lstnumberx327.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx327.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(str):</span><span id="lstnumberx327.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx327.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx327.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx327.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">timezone</span><span id="lstnumberx327.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx327.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx327.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx327.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx327.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx327.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">given</span><span id="lstnumberx327.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx327.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">date</span><span id="lstnumberx327.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx327.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">string.</span>
</div>
<div id="lstnumberx328" class="ltx_listingline">
<span id="lstnumberx328.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx328.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to_tz</span><span id="lstnumberx328.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(str):</span><span id="lstnumberx328.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx328.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">timezone</span><span id="lstnumberx328.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx328.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">which</span><span id="lstnumberx328.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx328.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">current</span><span id="lstnumberx328.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">time</span><span id="lstnumberx328.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">should</span><span id="lstnumberx328.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx328.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx328.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">converted.</span>
</div>
<div id="lstnumberx329" class="ltx_listingline">
</div>
<div id="lstnumberx330" class="ltx_listingline">
<span id="lstnumberx330.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx330.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx331" class="ltx_listingline">
<span id="lstnumberx331.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx331.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">int:</span><span id="lstnumberx331.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx331.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx331.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx331.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">total</span><span id="lstnumberx331.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx331.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">seconds.</span>
</div>
<div id="lstnumberx332" class="ltx_listingline">
</div>
<div id="lstnumberx333" class="ltx_listingline">
<span id="lstnumberx333.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx333.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx334" class="ltx_listingline">
<span id="lstnumberx334.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx334.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx334.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx334.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">datetime</span>
</div>
<div id="lstnumberx335" class="ltx_listingline">
<span id="lstnumberx335.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx335.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx335.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx335.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pytz</span>
</div>
<div id="lstnumberx336" class="ltx_listingline">
<span id="lstnumberx336.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx336.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx336.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx336.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numpy</span>
</div>
<div id="lstnumberx337" class="ltx_listingline">
<span id="lstnumberx337.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx337.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx337.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx337.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dateutil.parser</span>
</div>
<div id="lstnumberx338" class="ltx_listingline">
</div>
<div id="lstnumberx339" class="ltx_listingline">
<span id="lstnumberx339.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx339.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx340" class="ltx_listingline">
<span id="lstnumberx340.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx340.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx340.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx340.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">total_seconds_since_date(’1970-01-01</span><span id="lstnumberx340.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx340.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">00:00:00’,</span><span id="lstnumberx340.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx340.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’UTC’,</span><span id="lstnumberx340.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx340.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’America/New_York’)</span>
</div>
<div id="lstnumberx341" class="ltx_listingline">
<span id="lstnumberx341.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx341.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx341.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx341.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx342" class="ltx_listingline">
<span id="lstnumberx342.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx342.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">from_tz</span><span id="lstnumberx342.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx342.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx342.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx342.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytz</span><span id="lstnumberx342.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx342.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">timezone</span><span id="lstnumberx342.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx342.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">from_tz</span><span id="lstnumberx342.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx343" class="ltx_listingline">
<span id="lstnumberx343.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx343.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to_tz</span><span id="lstnumberx343.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx343.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx343.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx343.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pytz</span><span id="lstnumberx343.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx343.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">timezone</span><span id="lstnumberx343.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx343.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to_tz</span><span id="lstnumberx343.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx344" class="ltx_listingline">
<span id="lstnumberx344.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx344.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given_date</span><span id="lstnumberx344.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx344.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx344.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx344.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parse</span><span id="lstnumberx344.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx344.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">date_str</span><span id="lstnumberx344.9" class="ltx_text ltx_font_typewriter">).</span><span id="lstnumberx344.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">replace</span><span id="lstnumberx344.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx344.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tzinfo</span><span id="lstnumberx344.13" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx344.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">from_tz</span><span id="lstnumberx344.15" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx345" class="ltx_listingline">
<span id="lstnumberx345.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx345.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">current_date</span><span id="lstnumberx345.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx345.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx345.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx345.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">datetime</span><span id="lstnumberx345.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx345.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">now</span><span id="lstnumberx345.9" class="ltx_text ltx_font_typewriter">().</span><span id="lstnumberx345.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">astimezone</span><span id="lstnumberx345.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx345.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to_tz</span><span id="lstnumberx345.13" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx346" class="ltx_listingline">
</div>
<div id="lstnumberx347" class="ltx_listingline">
<span id="lstnumberx347.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx347.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">total_seconds</span><span id="lstnumberx347.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx347.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx347.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx347.6" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx347.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">current_date</span><span id="lstnumberx347.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx347.9" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx347.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx347.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given_date</span><span id="lstnumberx347.12" class="ltx_text ltx_font_typewriter">).</span><span id="lstnumberx347.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">total_seconds</span><span id="lstnumberx347.14" class="ltx_text ltx_font_typewriter">()</span>
</div>
<div id="lstnumberx348" class="ltx_listingline">
</div>
<div id="lstnumberx349" class="ltx_listingline">
<span id="lstnumberx349.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx349.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">leap_years</span><span id="lstnumberx349.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx349.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx349.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx349.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">LEAP_SECONDS</span><span id="lstnumberx349.7" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx349.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx349.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx349.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">logical_and</span><span id="lstnumberx349.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx349.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">LEAP_SECONDS</span><span id="lstnumberx349.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx349.14" class="ltx_text ltx_font_typewriter">&gt;=</span><span id="lstnumberx349.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx349.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given_date</span><span id="lstnumberx349.17" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx349.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">year</span><span id="lstnumberx349.19" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx349.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx349.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">LEAP_SECONDS</span><span id="lstnumberx349.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx349.23" class="ltx_text ltx_font_typewriter">&lt;=</span><span id="lstnumberx349.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx349.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">current_date</span><span id="lstnumberx349.26" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx349.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">year</span><span id="lstnumberx349.28" class="ltx_text ltx_font_typewriter">)]</span>
</div>
<div id="lstnumberx350" class="ltx_listingline">
<span id="lstnumberx350.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx350.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">leap_seconds</span><span id="lstnumberx350.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx350.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx350.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx350.6" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">len</span><span id="lstnumberx350.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx350.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">leap_years</span><span id="lstnumberx350.9" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx351" class="ltx_listingline">
</div>
<div id="lstnumberx352" class="ltx_listingline">
<span id="lstnumberx352.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx352.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">total_seconds</span><span id="lstnumberx352.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx352.4" class="ltx_text ltx_font_typewriter">+=</span><span id="lstnumberx352.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx352.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">leap_seconds</span>
</div>
<div id="lstnumberx353" class="ltx_listingline">
</div>
<div id="lstnumberx354" class="ltx_listingline">
<span id="lstnumberx354.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx354.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx354.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx354.4" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">int</span><span id="lstnumberx354.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx354.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">total_seconds</span><span id="lstnumberx354.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx355" class="ltx_listingline">
<span id="lstnumberx355.1" class="ltx_text ltx_font_typewriter">‘‘‘</span>
</div>
<div id="lstnumberx356" class="ltx_listingline">
</div>
<div id="lstnumberx357" class="ltx_listingline">
<span id="lstnumberx357.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Above</span><span id="lstnumberx357.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx357.3" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">is</span><span id="lstnumberx357.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx357.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx357.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx357.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">illustration</span><span id="lstnumberx357.8" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx358" class="ltx_listingline">
</div>
<div id="lstnumberx359" class="ltx_listingline">
<span id="lstnumberx359.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Generate</span><span id="lstnumberx359.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx359.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">five</span><span id="lstnumberx359.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx359.5" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">complex</span><span id="lstnumberx359.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx359.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scenarios</span><span id="lstnumberx359.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx359.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">based</span><span id="lstnumberx359.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx359.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">on</span><span id="lstnumberx359.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx359.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx359.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx359.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx359.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx359.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">simple</span><span id="lstnumberx359.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx359.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx359.20" class="ltx_text ltx_font_typewriter">:</span>
</div>
</div>
</div>
</section>
<section id="A7.SS2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">G.2 </span>Semi-automatic Program Refactoring and Testing Case Generation</h4>

<section id="A7.SS2.SSS1" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">G.2.1 </span>Programming Task Classification Prompt</h5>

<div id="A7.SS2.SSS1.p1" class="ltx_para ltx_noindent">
<div id="A7.SS2.SSS1.p1.1" class="ltx_listing ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,IyBDaG9vc2UgdGhlIG1vc3Qgc3VpdGFibGUgbGFiZWxzIGZvciB0aGUgZ2l2ZW4gcHJvZ3JhbToKU1FMCkNTVgpEYXRhRnJhbWVzClRpbWUKSlNPTgpYTUwKSFRNTApJbWFnZQpUZXh0CkJ1aWx0LWluIERhdGEgU3RydWN0dXJlCkFuYWx5c2lzCk5ldHdvcmtpbmcKUHJvY2Vzc2luZwpWaXN1YWxpemF0aW9uCkZpbGUgU3RvcmFnZQpFbmNyeXB0aW9uCgojIFlvdSBzaG91bGQgb3V0cHV0IHRoZSBzdWl0YWJsZSBsYWJlbHMgaW4gYSBsaXN0IGZvcm1hdCwgc3VjaCBhcyBbIkNTViIsICJEYXRhRnJhbWVzIl0u" download="">⬇</a></div>
<div id="lstnumberx360" class="ltx_listingline">
<span id="lstnumberx360.1" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx360.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx360.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Choose</span><span id="lstnumberx360.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx360.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx360.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx360.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">most</span><span id="lstnumberx360.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx360.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">suitable</span><span id="lstnumberx360.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx360.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">labels</span><span id="lstnumberx360.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx360.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx360.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx360.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx360.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx360.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx360.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx360.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">program</span><span id="lstnumberx360.20" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx361" class="ltx_listingline">
<span id="lstnumberx361.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">SQL</span>
</div>
<div id="lstnumberx362" class="ltx_listingline">
<span id="lstnumberx362.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">CSV</span>
</div>
<div id="lstnumberx363" class="ltx_listingline">
<span id="lstnumberx363.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">DataFrames</span>
</div>
<div id="lstnumberx364" class="ltx_listingline">
<span id="lstnumberx364.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Time</span>
</div>
<div id="lstnumberx365" class="ltx_listingline">
<span id="lstnumberx365.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">JSON</span>
</div>
<div id="lstnumberx366" class="ltx_listingline">
<span id="lstnumberx366.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">XML</span>
</div>
<div id="lstnumberx367" class="ltx_listingline">
<span id="lstnumberx367.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">HTML</span>
</div>
<div id="lstnumberx368" class="ltx_listingline">
<span id="lstnumberx368.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Image</span>
</div>
<div id="lstnumberx369" class="ltx_listingline">
<span id="lstnumberx369.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Text</span>
</div>
<div id="lstnumberx370" class="ltx_listingline">
<span id="lstnumberx370.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Built</span><span id="lstnumberx370.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx370.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx370.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx370.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Data</span><span id="lstnumberx370.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx370.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Structure</span>
</div>
<div id="lstnumberx371" class="ltx_listingline">
<span id="lstnumberx371.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Analysis</span>
</div>
<div id="lstnumberx372" class="ltx_listingline">
<span id="lstnumberx372.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Networking</span>
</div>
<div id="lstnumberx373" class="ltx_listingline">
<span id="lstnumberx373.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Processing</span>
</div>
<div id="lstnumberx374" class="ltx_listingline">
<span id="lstnumberx374.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Visualization</span>
</div>
<div id="lstnumberx375" class="ltx_listingline">
<span id="lstnumberx375.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">File</span><span id="lstnumberx375.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx375.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Storage</span>
</div>
<div id="lstnumberx376" class="ltx_listingline">
<span id="lstnumberx376.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Encryption</span>
</div>
<div id="lstnumberx377" class="ltx_listingline">
</div>
<div id="lstnumberx378" class="ltx_listingline">
<span id="lstnumberx378.1" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx378.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx378.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx378.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">output</span><span id="lstnumberx378.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx378.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">suitable</span><span id="lstnumberx378.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">labels</span><span id="lstnumberx378.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx378.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx378.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list</span><span id="lstnumberx378.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">format</span><span id="lstnumberx378.22" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx378.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">such</span><span id="lstnumberx378.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx378.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.28" class="ltx_text ltx_font_typewriter">["</span><span id="lstnumberx378.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">CSV</span><span id="lstnumberx378.30" class="ltx_text ltx_font_typewriter">",</span><span id="lstnumberx378.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx378.32" class="ltx_text ltx_font_typewriter">"</span><span id="lstnumberx378.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">DataFrames</span><span id="lstnumberx378.34" class="ltx_text ltx_font_typewriter">"].</span>
</div>
</div>
</div>
</section>
<section id="A7.SS2.SSS2" class="ltx_subsubsection">
<h5 class="ltx_title ltx_title_subsubsection">
<span class="ltx_tag ltx_tag_subsubsection">G.2.2 </span>Guidelines</h5>

<div id="A7.SS2.SSS2.p1" class="ltx_para ltx_noindent">
<div id="A7.SS2.SSS2.p1.1" class="ltx_listing ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,CiMjIEFubm90YXRpb24gR3VpZGVsaW5lOgoKWW91IGFyZSBnaXZlbiBhIGZ1bmN0aW9uIGluc2lkZSAiZnVuY3Rpb24ucHkiLiBUaGUgZ29hbCBpcyB0bzoKMSkgcmVmaW5lIHRoZSBmdW5jdGlvbiBpbmNsdWRpbmcgaXRzIGRvY3N0cmluZ3MgaW4gb3JkZXIgdG8gbWFrZSB0aGUgZnVuY3Rpb24gbW9yZSByZWFsaXN0aWMgYW5kIGxlc3MgYW1iaWd1b3VzLiBUaGlzIG1lYW5zIHdoZW4geW91IHNlZSB0aGUgZnVuY3Rpb24gc3R1YiBhbmQgZG9jc3RyaW5nLCB5b3Ugc2hvdWxkIGJlIGFibGUgdG8gaW1wbGVtZW50IHdpdGggZXhhY3RseSB0aGUgc2FtZSBmdW5jdGlvbmFsaXR5IHdpdGggdGhlIGdpdmVuIGZ1bmN0aW9uIGJvZHk7CjIpIHdyaXRlIGJsYWNrYm94IHVuaXQgdGVzdHMgdG8gZW5zdXJlIHRoZSBmdW5jdGlvbmFsIGNvcnJlY3RuZXNzIG9mIHRoZSBnaXZlbiBmdW5jdGlvbi4gWW91IHNob3VsZCBhbHNvIG1ha2UgdGhlIGZ1bmN0aW9uIGVhc3kgdG8gdGVzdC4KCiMjIyBTdGVwMTpDaGVjayBMaWJyYXJ5IEltcG9ydHMKCiMjIyMgSW1wb3J0IFN0YXRlbWVudAoKLSBSZW1vdmUgdGhlIGxpYnJhcnkgaW1wb3J0cyB0aGF0IGFyZSBub3QgdXNlZCBpbiB0aGUgY29kZS4KLSBJbXBvcnQgbGlicmFyaWVzIGJlZm9yZSB0aGUgZnVuY3Rpb24gZGVjbGFyYXRpb24uCgojIyMjIExpYnJhcnkgVXNhZ2UKCi0gQ2hlY2sgaWYgdGhlIHVzYWdlIG9mIHRoZXNlIGxpYnJhcmllcyBpcyByZWFzb25hYmxlLiBGb3IgZXhhbXBsZSwgaWYgdGhlIGRlc2NyaXB0aW9uIGFza3MgdG8gY29tcGxldGUgYSBmdW5jdGlvbmFsaXR5IHRoYXQgY2FuIGJlIGltcGxlbWVudGVkIHdpdGhvdXQgYW55IG9mIHRoZXNlIGxpYnJhcmllcywgdGhlbiB0aGUgdXNhZ2Ugb2YgdGhlc2UgbGlicmFyaWVzIEFQSXMgaXMgbm90IHJlYXNvbmFibGUuIFlvdSBuZWVkIHRvIGNoZWNrIFN0ZXAgMiBmb3IgbW9yZSBkZXRhaWxzIHRvIG1vZGlmeSB0aGUgZGVzY3JpcHRpb24gc28gdGhhdCBpdCBjYW4gbWFrZSB1c2Ugb2YgdGhlIGltcG9ydGVkIGxpYnJhcmllcy4KCiMjIyBTdGVwMjogQ2hlY2sgRG9jc3RyaW5nCgojIyMjIERlc2NyaXB0aW9uCgotIENoZWNrIGlmIHRoZSBleHByZXNzaW9uIG9mIHRoZSBkZXNjcmlwdGlvbiBpcyBjbGVhciBhbmQgY29uY2lzZS4gSWYgbm90LCB5b3UgbmVlZCB0byBtb2RpZnkgdGhlIGRlc2NyaXB0aW9uIHRvIG1ha2UgaXQgY2xlYXIgYW5kIGNvbmNpc2UuCi0gVGhlIGRlc2NyaXB0aW9uIG11c3QgbWVudGlvbiB0aGUgZm9sbG93aW5nIGZpdmUgdGhpbmdzOgogIC0gRnVuY3Rpb25hbGl0eQogIC0gSW5wdXQKICAtIE91dHB1dCB0byBiZSByZXR1cm5lZAogIC0gUmVxdWlyZW1lbnRzIG9mIHRoZSBpbXBvcnRlZCBsaWJyYXJpZXMvbW9kdWxlcyB0byBiZSB1c2VkCiAgLSAxIG9yIDIgZXhhbXBsZXMgb2YgdGhlIGlucHV0IGFuZCBvdXRwdXQgb2YgdGhlIGZ1bmN0aW9uCiAgLSBNZW50aW9uIHRoZSBuZWNlc3NhcnkgZGF0YSBzdHJ1Y3R1cmUgaWYgdGhlIGZ1bmN0aW9uIHJlcXVpcmVzIGRhdGEgbWFuaXB1bGF0aW9uLgotIFlvdSBtdXN0IG5vdCBjaGFuZ2UgdGhlIG92ZXJhbGwgZnVuY3Rpb25hbGl0eSBvZiB0aGUgZnVuY3Rpb24sIGFuZCByZW1vdmUgYW55IGxpYnJhcmllcy9tb2R1bGVzIHRoYXQgYXJlIGltcG9ydGVkIGluIHRoZSBmdW5jdGlvbiB0byBhY2NvbW1vZGF0ZSB0aGUgYmxhY2tib3ggdGVzdGluZy4KCiMjIyMgSW5wdXQgUGFyYW1ldGVycwoKLSBDaGVjayBpZiB0aGUgZnVuY3Rpb24gdGFrZXMgaW5wdXQgcGFyYW1ldGVycy4gSWYgbm90LCB5b3UgbmVlZCB0byBtb2RpZnkgdGhlIGRlc2NyaXB0aW9uIGFuZCB0aGUgZnVuY3Rpb24gdG8gbWFrZSBpdCB0YWtlIGlucHV0IHBhcmFtZXRlcnMuCgojIyMjIEV4YW1wbGUKCi0gUHJvdmlkZSAxIG9yIDIgZXhhbXBsZXMgb2YgdGhlIGlucHV0IGFuZCBvdXRwdXQgb2YgdGhlIGZ1bmN0aW9uLgogIC0gYGBgYmFzaAogICAgPj4+IGZfMCgiaGVsbG8iKQogICAgImhlbGxvIHdvcmxkIgogICAgPj4+IGZfMCgiSSIpCiAgICAibG92ZSB5b3UiCiAgICBgYGAKICAtIGBgYGJhc2gKICAgID4+PiBmXzAoImltYWdlXzEuanBnIikKICAgIDxtb2R1bGUgJ21hdHBsb3RsaWIucHlwbG90Jz4KICAgID4+PiBmXzAoImltYWdlXzIuanBnIikKICAgIDxtb2R1bGUgJ21hdHBsb3RsaWIucHlwbG90Jz4KCiAgICBgYGAKCiMjIyBTdGVwIDM6IENoZWNrIEZ1bmN0aW9uIEltcGxlbWVudGF0aW9uCgotIENoZWNrIGlmIHRoZSBmdW5jdGlvbiBpbXBsZW1lbnRhdGlvbiBpcyBjb3JyZWN0LiBJZiBub3QsIHlvdSBuZWVkIHRvIHJlcGFpciB0aGUgZnVuY3Rpb24gaW1wbGVtZW50YXRpb24gdG8gbWFrZSBpdCBjb3JyZWN0LgotIENoZWNrIGlmIHRoZSBmdW5jdGlvbiB1c2VzIGFueSBjb25zdGFudHMuCiAgLSBJZiB5ZXMgYW5kIHRoZSBkZXNjcmlwdGlvbiBoYXMgbm90IG1lbnRpb25lZCBhbnkgb2YgdGhlbSwgeW91IG5lZWQgdG8gZWl0aGVyIGxlYXZlIG9mZiB0aGUgYXJndW1lbnQgc28gaXQgdGFrZXMgdGhlIGRlZmF1bHQgdmFsdWUsIG9yIG1vZGlmeSB0aGUgZGVzY3JpcHRpb24gdG8gbWVudGlvbiB0aGVtLgogICAgLSBGb3IgZXhhbXBsZSwgZm9yIHRoZSBgcGx0Lmhpc3QoY291bnRzLCBiaW5zPW5wLmFyYW5nZShsZW4oY291bnRzKSsxKS0wLjUsIHJ3aWR0aD0wLjgpYCBpbiBgZl8wYCwgdGhlIGRlc2NyaXB0aW9uIHNob3VsZCBtZW50aW9uIHRoZSBzcGVjaWZpYyB3YXkgdG8gY29tcHV0ZSB3aXRoIGBsZW4oY291bnRzKSsxKS0wLjVgIGFuZCB1c2UgYHJ3aWR0aD0wLjhgLgotIENoZWNrIGlmIHRoZSBmdW5jdGlvbiBoYXMgdGhlIHJldHVybiB2YWx1ZXMuIElmIG5vdCwgeW91IG5lZWQgdG8gbW9kaWZ5IHRoZSBmdW5jdGlvbiB0byBtYWtlIGl0IHJldHVybiB0aGUgdmFsdWVzIGZvciB0aGUgdGVzdCBjYXNlcyB0byBjaGVjay4KLSBJZiB0aGUgZnVuY3Rpb24gcmVxdWlyZXMgdG8gd3JpdGUgb3Igc2hvdyBzb21lIGRhdGEsIHlvdSBzaGFsbCBlaXRoZXIgcmV0dXJuIHRoZSBkYXRhIG9yIG1ha2UgdGhlIGZ1bmN0aW9uIHRha2UgYSBwYXRoIGZvciBmaWxlIHN0b3JhZ2Ugb3IgYSB2YXJpYWJsZSBmb3IgZGF0YSB2aXN1YWxpemF0aW9uLiBGb3IgZXhhbXBsZSwgaWYgdGhlIGZ1bmN0aW9uIHJlcXVpcmVzIHRvIHNob3cgYSBwbG90LCB5b3UgbXVzdCByZXR1cm4gdGhlIHBsb3QgKHZpYSBBeGVzKS4KLSBJZiB0aGUgZnVuY3Rpb24gcmVxdWlyZXMgY2hlY2tpbmcgc29tZSBwcm9wZXJ0aWVzIGFuZCB1c2VzIGBwcmludCgpYCB0byBzaG93IHRoZSByZXN1bHRzLCB5b3UgbmVlZCB0byBtb2RpZnkgdGhpcyBmdW5jdGlvbiB0byByZXR1cm4gdGhlc2UgcmVzdWx0cy4gVGhlIHJldmlzZWQgZnVuY3Rpb24gc2hvdWxkIGFtYWxnYW1hdGUgdGhlc2UgcHJvcGVydGllcyB3aXRoIHRoZSBwcmVleGlzdGluZyByZXR1cm4gdmFsdWVzLCB0aGVyZWJ5IGZhY2lsaXRhdGluZyBtb3JlIHZlcnNhdGlsZSB1dGlsaXphdGlvbiBvZiB0aGUgb3V0cHV0cyBpbiB0aGUgcmVzdCBvZiB5b3VyIGNvZGUuCgktIENvbnNpZGVyIHRoaXMgb3JpZ2luYWwgZnVuY3Rpb246CgpkZWYgY2hlY2tfcHJvcGVydGllcyhvcmlnaW5hbF9saXN0KToKICAgIGlzX2VtcHR5ID0gbm90IGJvb2wob3JpZ2luYWxfbGlzdCkKICAgIHByaW50KGYiSXMgdGhlIGxpc3QgZW1wdHk/IHtpc19lbXB0eX0iKQoKICAgIGxlbmd0aCA9IGxlbihvcmlnaW5hbF9saXN0KQogICAgcHJpbnQoZiJMZW5ndGggb2YgdGhlIGxpc3QgaXMge2xlbmd0aH0iKQoKY2hlY2tfcHJvcGVydGllcyhbMSwgMiwgMywgNF0pCgpUaGlzIGZ1bmN0aW9uIGNoZWNrcyB0d28gcHJvcGVydGllcyBvZiBhIGxpc3Q6IHdoZXRoZXIgaXQncyBlbXB0eSBhbmQgaXRzIGxlbmd0aC4gSXQgdGhlbiBwcmludHMgdGhlc2UgcmVzdWx0cy4gSG93ZXZlciwgdGhlc2UgcmVzdWx0cyBjYW4ndCBiZSB1c2VkIGVsc2V3aGVyZSBpbiB5b3VyIHByb2dyYW0uCgpOb3csIGxldCdzIG1vZGlmeSB0aGUgZnVuY3Rpb24gdG8gcmV0dXJuIHRoZXNlIHJlc3VsdHM6CgpkZWYgY2hlY2tfcHJvcGVydGllcyhvcmlnaW5hbF9saXN0KToKICAgIGlzX2VtcHR5ID0gbm90IGJvb2wob3JpZ2luYWxfbGlzdCkKICAgIGxlbmd0aCA9IGxlbihvcmlnaW5hbF9saXN0KQoKICAgIHJldHVybiBpc19lbXB0eSwgbGVuZ3RoCgpsaXN0X2VtcHR5LCBsaXN0X2xlbmd0aCA9IGNoZWNrX3Byb3BlcnRpZXMoWzEsIDIsIDMsIDRdKQoKcHJpbnQoZiJJcyB0aGUgbGlzdCBlbXB0eT8ge2xpc3RfZW1wdHl9IikKcHJpbnQoZiJMZW5ndGggb2YgdGhlIGxpc3QgaXMge2xpc3RfbGVuZ3RofSIpCgpJbiB0aGlzIG1vZGlmaWVkIHZlcnNpb24sIHRoZSBmdW5jdGlvbiByZXR1cm5zIHRoZSB0d28gcHJvcGVydGllcyBpbnN0ZWFkIG9mIHByaW50aW5nIHRoZW0uIFRoaXMgYWxsb3dzIHlvdSB0byBjYXB0dXJlIHRoZSByZXR1cm5lZCB2YWx1ZXMgaW4gbGlzdF9lbXB0eSBhbmQgbGlzdF9sZW5ndGggdmFyaWFibGVzIGFuZCB1c2UgdGhlbSBlbHNld2hlcmUgaW4geW91ciBwcm9ncmFtLgoKLSBJZiB5b3UgcmV0dXJuIGFueSBmb3JtYXRzIG9mIHZhbHVlcyhlLmcuIGBzdHJpbmdgKSwgbWFrZSBzdXJlIHRoYXQgeW91IG1lbnRpb24gdGhlIGZvcm1hdCBpbiB0aGUgZGVzY3JpcHRpb24uIEl0IGlzIGJldHRlciBmb3IgYXNzZXNzaW5nIHRoZSBjb3JyZWN0bmVzcyBvZiB0aGUgZnVuY3Rpb24gaW1wbGVtZW50YXRpb24uCgojIyMgU3RlcDQ6IFJ1biBUaGUgRnVuY3Rpb24gYW5kIFdyaXRlIEJsYWNrYm94IFRlc3QgQ2FzZXMKCi0gVGhlIGZ1bmN0aW9uIGlzIGNvbnRhaW5lZCBpbiBhIGZpbGUgbmFtZWQgYGZ1bmN0aW9uLnB5YCwgYW5kIHlvdSBhcmUgcmVxdWlyZWQgdG8gd3JpdGUgYSBibGFja2JveCB0ZXN0aW5nIGZ1bmN0aW9uIG5hbWVkIGBydW5fdGVzdHMoKWAgdGhhdCBjb250YWlucyBhc3NlcnRpb24tYmFzZWQgYmxhY2tib3ggdGVzdCBjYXNlcyBpbiBgdGVzdC5weWAuCi0gSWYgYW55IG9mIHRoZSBmb2xsb3dpbmcgZGF0YSB0eXBlcyBhcmUgdXNlZCBmb3IgbWFuaXB1bGF0aW9uLCB5b3UgbmVlZCB0byBtYW51YWxseSBkZXNpZ24gdGhlIGRhdGEgb3IgdXRpbGl6ZSAzcmQgcGFydHkgbGlicmFyaWVzIGFuZCB3ZWJzaXRlcyAoZS5nLiBgRmFrZXJgIGFuZCBgdW5pdHRlc3QubW9ja2ApIHRvIGdlbmVyYXRlIG9yIG1vY2sgdGhlIHRlc3QgZGF0YS4gWW91IGNhbiB1c2UgdGhlICJmaWxlOi8vIiBwcm90b2NvbCB0byBhY2Nlc3MgdGhlIGxvY2FsIEhUTUwgZmlsZXMsIGFuZCBhbnkgdXJsIHJlcXVlc3QgQVBJcyBzaG91bGQgd29yayBjb3JyZWN0bHkgd2l0aCB0aGlzIHByb3RvY29sLiAoU2VlIGh0dHBzOi8vY2hhdC5vcGVuYWkuY29tL3NoYXJlLzg0YmEwZGM5LTA2N2QtNGViMC1hNGQ0LWQ4ZjRhNzdmZjFhNSkKCiAgLSBodG1sICh3ZWJwYWdlLCBwYWdlIGxpbmspCiAgLSBjc3YKICAtIGpzb24KICAtIHhtbAogIC0gc3FsCiAgLSBpbWFnZQoKLSBZb3Ugc2hvdWxkIHRlc3QgdGhlIHBvc3NpYmxlIGF0dHJpYnV0ZXMgb2YgdGhhdCB3cml0dGVuIGRhdGEuIEZvciBleGFtcGxlLCBpZiB5b3UgcmV0dXJuIGEgcGxvdCwgeW91IG5lZWQgdG8gdGVzdCBpZiB0aGUgcGxvdCBjb250YWlucyB0aGUgY29ycmVjdCB0aXRsZSwgeC1heGlzLCB5LWF4aXMgYW5kIGRhdGEgcG9pbnRzLgoKLSBUbyBmb3JtYWxpemUgdGhlIHRlc3QgY2FzZSB3cml0aW5nLCB5b3UgbmVlZCB0byB3cml0ZSB3aXRoIHRoZSBmb2xsb3dpbmcgZnVuY3Rpb246CgpgYGBweXRob24KZGVmIHJ1bl90ZXN0cygpOgogICAgc3VpdGUgPSB1bml0dGVzdC5UZXN0U3VpdGUoKQogICAgc3VpdGUuYWRkVGVzdCh1bml0dGVzdC5tYWtlU3VpdGUoVGVzdENhc2VzKSkKICAgIHJ1bm5lciA9IHVuaXR0ZXN0LlRleHRUZXN0UnVubmVyKCkKICAgIHJ1bm5lci5ydW4oc3VpdGUpCgpjbGFzcyBUZXN0Q2FzZXModW5pdHRlc3QuVGVzdENhc2UpOgogICAgZGVmIHRlc3RfY2FzZV8xKHNlbGYpOgogICAgICAgICMgSW5wdXQgMTogd3JpdGUgeW91ciB0ZXN0IGNhc2UgaGVyZS4KICAgICAgICAjIHByb3ZpZGUgYSBzZXJpZXMgb2YgdW5pdCB0ZXN0cyB0byB0ZXN0IGFsbCBhdHRyaWJ1dGVzIG9mIHRoZSByZXR1cm5lZCB2YWx1ZXMKICAgICAgICBwYXNzCgogICAgZGVmIHRlc3RfY2FzZV8yKHNlbGYpOgogICAgICAgICMgSW5wdXQgMjogd3JpdGUgeW91ciB0ZXN0IGNhc2UgaGVyZS4KICAgICAgICAjIFByb3ZpZGUgYSBzZXJpZXMgb2YgdW5pdCB0ZXN0cyB0byB0ZXN0IGFsbCBhdHRyaWJ1dGVzIG9mIHRoZSByZXR1cm5lZCB2YWx1ZXMKICAgICAgICBwYXNzCgogICAgZGVmIHRlc3RfY2FzZV8zKHNlbGYpOgogICAgICAgICMgSW5wdXQgMzogd3JpdGUgeW91ciB0ZXN0IGNhc2UgaGVyZS4KICAgICAgICAjIFByb3ZpZGUgYSBzZXJpZXMgb2YgdW5pdCB0ZXN0cyB0byB0ZXN0IGFsbCBhdHRyaWJ1dGVzIG9mIHRoZSByZXR1cm5lZCB2YWx1ZXMKICAgICAgICBwYXNzCgogICAgIyB3cml0ZSBtb3JlIHRlc3RzIGhlcmUKYGBgCgotIEVhY2ggYmxhY2tib3ggdGVzdCBtZXRob2Qgc2hvdWxkIGJlIHRlc3RlZCB3aXRoIGEgdW5pcXVlIGlucHV0IHZhbHVlIGFuZCBhc3NlcnRlZCBmb3IgdGhlIHJldHVybiB2YWx1ZXMuCgojIyMgV29ya2luZwoKQWZ0ZXIgcmVhZGluZyB0aGUgZ3VpZGVsaW5lLCByZWZpbmUgYGZ1bmN0aW9uLnB5YCBhbmQgd3JpdGUgYSBzaW5nbGUgdGVzdCBwcm9ncmFtIG5hbWVkIGBydW5fdGVzdHMoKWAgaW4gYHRlc3QucHlgLCB3aGljaCBzaG91bGQgY29udGFpbiBhdCBsZWFzdCAqZml2ZSogZGlmZmVyZW50IGlucHV0IGNhc2VzLgoKV2hlbiB0ZXN0aW5nIHdpdGggZGF0YSwgeW91IG5lZWQgdG8gZ2VuZXJhdGUgdGhlIGRhdGEgYnkgeW91cnNlbGYgb3IgdXNlIDNyZCBwYXJ0eSBsaWJyYXJpZXMgYW5kIHdlYnNpdGVzIChlLmcuIGBGYWtlcmAgYW5kIGB1bml0dGVzdC5tb2NrYCkgdG8gZ2VuZXJhdGUgb3IgbW9jayB0aGUgdGVzdCBkYXRhLiBGb3IgZXhhbXBsZSwgeW91IHNob3VsZCBkZXNpZ24gdGhlIGh0bWwgd2VicGFnZSB0byBtZWV0IHRoZSBmdW5jdGlvbmFsaXR5IGFuZCB0ZXN0IHNjZW5hcmlvcy4gRm9yIGFueSBudW1lcmljIHZhbHVlcywgeW91IG5lZWQgdG8gcmVwcmVzZW50IHRoZW0gaW4gdGhlIGRhdGEuCgpNYWtlIHRoZSB0ZXN0IGRhdGEgYXMgY29tcGxleCBhcyBwb3NzaWJsZSB0byBtaW1pYyB0aGUgcmVhbC13b3JsZCBkYXRhLiBGb3IgZXhhbXBsZSwgaWYgdGhlIGZ1bmN0aW9uIHJlcXVpcmVzIHJlYWRpbmcgYSBjc3YgZmlsZSwgeW91IG5lZWQgdG8gZGVzaWduIHRoZSBjc3YgZmlsZSB0byBtZWV0IHRoZSBmdW5jdGlvbmFsaXR5IGFuZCB0ZXN0IHNjZW5hcmlvcy4KCllvdSBjYW4gbm90IHJlbW92ZSBhbnkgbGlicmFyaWVzIG9yIG1vZHVsZXMgdXNlZCBpbiB0aGUgb3JpZ2luYWwgZnVuY3Rpb24uIEhvd2V2ZXIsIHlvdSBjYW4gYWRkIG5ldyBsaWJyYXJpZXMgb3IgbW9kdWxlcyB0byB0aGUgZnVuY3Rpb24uCgpNYWtlIHN1cmUgeW91IGhhdmUgdGVzdGVkIGFsbCByZXR1cm4gdmFsdWVzIGFuZCB0aGUgcG9zc2libGUgYXR0cmlidXRlcyBvZiB0aGUgd3JpdHRlbiBkYXRhLgoKS2VlcCB0ZXN0aW5nIHRoZSBmdW5jdGlvbiB1bnRpbCB5b3UgYXJlIHNhdGlzZmllZCB3aXRoIHRoZSBmdW5jdGlvbiBpbXBsZW1lbnRhdGlvbiBhbmQgdGhlIHRlc3QgY2FzZXMuCgpJZiBhbnkgdGVzdGVkIHByb3BlcnRpZXMgYXJlIG5vdCBtZW50aW9uZWQgaW4gdGhlIGRlc2NyaXB0aW9uLCB5b3UgbmVlZCB0byBtb2RpZnkgdGhlIGRlc2NyaXB0aW9uIHRvIG1lbnRpb24gdGhlbS4KCkFzIHdlIHdpbGwgcHJvdmlkZSB0aGUgZnVuY3Rpb24gc3R1YiBmb3IgcHJvZ3JhbW1lcnMgdG8gaW1wbGVtZW50IGJ5IHRoZWlyIG93biwgcGxlYXNlIG1ha2Ugc3VyZSB0aGVyZSBpcyBubyBhbWJpZ3VpdHkgaW4gdGhlIGRlc2NyaXB0aW9uIGFuZCB0aGUgZnVuY3Rpb24gaW1wbGVtZW50YXRpb24uIElmIHRoZXJlIGlzIGFueSBhbWJpZ3VpdHksIHlvdSBuZWVkIHRvIG1vZGlmeSB0aGUgZGVzY3JpcHRpb24gYW5kIHRoZSBmdW5jdGlvbiBpbXBsZW1lbnRhdGlvbiB0byBtYWtlIGl0IGNsZWFyIGFuZCBjb25jaXNlLiBUaGluayBhYm91dCB0aGUgcG9zc2libGUgcXVlc3Rpb25zIHRoYXQgcHJvZ3JhbW1lcnMgbWF5IGFzayBhbmQgdHJ5IHRvIGFuc3dlciB0aGVtIGluIHRoZSBkZXNjcmlwdGlvbi4KCkV4ZWN1dGUgdG8gbWFrZSBzdXJlIGBmdW5jdGlvbi5weWAgd2lsbCBwYXNzIGFsbCBibGFja2JveCB0ZXN0IGNhc2VzLiBPdGhlcndpc2UsIHlvdSBuZWVkIHRvIG1vZGlmeSB0aGUgZnVuY3Rpb24gaW1wbGVtZW50YXRpb24gdG8gbWFrZSBpdCBwYXNzIGFsbCBibGFja2JveCB0ZXN0IGNhc2VzLgoKIyMjIFJlZmluZSBgZnVuY3Rpb24ucHlgIGFuZCB3cml0ZSBibGFja2JveCB0ZXN0cyBpbiBgdGVzdC5weWAKCk5vdGUgdGhhdCBgRmFrZXJgIGxpYnJhcnkgaGFzIGFscmVhZHkgYmVlbiBpbnN0YWxsZWQgaW4gdGhlIGVudmlyb25tZW50IGFuZCB5b3UgY2FuIHVzZSBpdCBmcmVlbHkuCgpEb3dubG9hZCByZWZpbmVkIGBmdW5jdGlvbi5weWAsIHdyaXR0ZW4gYHRlc3QucHlgIGFuZCBjcmVhdGVkIGB0ZXN0X2RhdGEuemlwYCBpZiB0aGVyZSBleGlzdHMuCg==" download="">⬇</a></div>
<div id="lstnumberx379" class="ltx_listingline">
</div>
<div id="lstnumberx380" class="ltx_listingline">
<span id="lstnumberx380.1" class="ltx_text ltx_font_typewriter">##</span><span id="lstnumberx380.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx380.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Annotation</span><span id="lstnumberx380.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx380.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Guideline</span><span id="lstnumberx380.6" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx381" class="ltx_listingline">
</div>
<div id="lstnumberx382" class="ltx_listingline">
<span id="lstnumberx382.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx382.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx382.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx382.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx382.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx382.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inside</span><span id="lstnumberx382.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.13" class="ltx_text ltx_font_typewriter">"</span><span id="lstnumberx382.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx382.15" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx382.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx382.17" class="ltx_text ltx_font_typewriter">".</span><span id="lstnumberx382.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx382.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">goal</span><span id="lstnumberx382.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx382.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx382.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx382.26" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx383" class="ltx_listingline">
<span id="lstnumberx383.1" class="ltx_text ltx_font_typewriter">1)</span><span id="lstnumberx383.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">refine</span><span id="lstnumberx383.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx383.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx383.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">including</span><span id="lstnumberx383.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">its</span><span id="lstnumberx383.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docstrings</span><span id="lstnumberx383.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx383.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">order</span><span id="lstnumberx383.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx383.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx383.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx383.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx383.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx383.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">realistic</span><span id="lstnumberx383.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx383.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">less</span><span id="lstnumberx383.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ambiguous</span><span id="lstnumberx383.36" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx383.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">This</span><span id="lstnumberx383.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">means</span><span id="lstnumberx383.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">when</span><span id="lstnumberx383.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx383.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">see</span><span id="lstnumberx383.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx383.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx383.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">stub</span><span id="lstnumberx383.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx383.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docstring</span><span id="lstnumberx383.57" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx383.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx383.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx383.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx383.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">able</span><span id="lstnumberx383.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx383.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implement</span><span id="lstnumberx383.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx383.72" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.73" class="ltx_text ltx_lst_identifier ltx_font_typewriter">exactly</span><span id="lstnumberx383.74" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.75" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx383.76" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.77" class="ltx_text ltx_lst_identifier ltx_font_typewriter">same</span><span id="lstnumberx383.78" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.79" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx383.80" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.81" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx383.82" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.83" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx383.84" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.85" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx383.86" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.87" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx383.88" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx383.89" class="ltx_text ltx_lst_identifier ltx_font_typewriter">body</span><span id="lstnumberx383.90" class="ltx_text ltx_font_typewriter">;</span>
</div>
<div id="lstnumberx384" class="ltx_listingline">
<span id="lstnumberx384.1" class="ltx_text ltx_font_typewriter">2)</span><span id="lstnumberx384.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx384.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">blackbox</span><span id="lstnumberx384.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unit</span><span id="lstnumberx384.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tests</span><span id="lstnumberx384.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx384.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx384.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx384.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functional</span><span id="lstnumberx384.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correctness</span><span id="lstnumberx384.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx384.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx384.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx384.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx384.28" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx384.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx384.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx384.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">also</span><span id="lstnumberx384.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx384.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx384.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx384.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">easy</span><span id="lstnumberx384.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx384.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx384.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx384.47" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx385" class="ltx_listingline">
</div>
<div id="lstnumberx386" class="ltx_listingline">
<span id="lstnumberx386.1" class="ltx_text ltx_font_typewriter">###</span><span id="lstnumberx386.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx386.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Step1</span><span id="lstnumberx386.4" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx386.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx386.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx386.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Library</span><span id="lstnumberx386.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx386.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Imports</span>
</div>
<div id="lstnumberx387" class="ltx_listingline">
</div>
<div id="lstnumberx388" class="ltx_listingline">
<span id="lstnumberx388.1" class="ltx_text ltx_font_typewriter">####</span><span id="lstnumberx388.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx388.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Import</span><span id="lstnumberx388.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx388.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Statement</span>
</div>
<div id="lstnumberx389" class="ltx_listingline">
</div>
<div id="lstnumberx390" class="ltx_listingline">
<span id="lstnumberx390.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx390.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Remove</span><span id="lstnumberx390.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx390.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">library</span><span id="lstnumberx390.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imports</span><span id="lstnumberx390.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx390.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx390.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx390.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx390.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx390.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx390.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx390.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx390.24" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx391" class="ltx_listingline">
<span id="lstnumberx391.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx391.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx391.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Import</span><span id="lstnumberx391.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx391.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx391.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx391.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">before</span><span id="lstnumberx391.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx391.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx391.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx391.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx391.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx391.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">declaration</span><span id="lstnumberx391.14" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx392" class="ltx_listingline">
</div>
<div id="lstnumberx393" class="ltx_listingline">
<span id="lstnumberx393.1" class="ltx_text ltx_font_typewriter">####</span><span id="lstnumberx393.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx393.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Library</span><span id="lstnumberx393.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx393.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Usage</span>
</div>
<div id="lstnumberx394" class="ltx_listingline">
</div>
<div id="lstnumberx395" class="ltx_listingline">
<span id="lstnumberx395.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx395.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx395.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx395.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx395.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">usage</span><span id="lstnumberx395.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx395.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx395.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx395.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx395.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">reasonable</span><span id="lstnumberx395.20" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx395.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx395.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx395.25" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx395.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx395.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx395.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx395.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">asks</span><span id="lstnumberx395.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx395.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complete</span><span id="lstnumberx395.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx395.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx395.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx395.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx395.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx395.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implemented</span><span id="lstnumberx395.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">without</span><span id="lstnumberx395.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx395.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx395.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx395.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx395.60" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx395.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">then</span><span id="lstnumberx395.63" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx395.65" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.66" class="ltx_text ltx_lst_identifier ltx_font_typewriter">usage</span><span id="lstnumberx395.67" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx395.69" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx395.71" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.72" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx395.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx395.75" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.76" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx395.77" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.78" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx395.79" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.80" class="ltx_text ltx_lst_identifier ltx_font_typewriter">reasonable</span><span id="lstnumberx395.81" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx395.82" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.83" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx395.84" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.85" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx395.86" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.87" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx395.88" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.89" class="ltx_text ltx_lst_identifier ltx_font_typewriter">check</span><span id="lstnumberx395.90" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.91" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Step</span><span id="lstnumberx395.92" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.93" class="ltx_text ltx_font_typewriter">2</span><span id="lstnumberx395.94" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.95" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx395.96" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.97" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx395.98" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.99" class="ltx_text ltx_lst_identifier ltx_font_typewriter">details</span><span id="lstnumberx395.100" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.101" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx395.102" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.103" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx395.104" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.105" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx395.106" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.107" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx395.108" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.109" class="ltx_text ltx_lst_identifier ltx_font_typewriter">so</span><span id="lstnumberx395.110" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.111" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx395.112" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.113" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx395.114" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.115" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx395.116" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.117" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx395.118" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.119" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx395.120" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.121" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx395.122" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.123" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx395.124" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.125" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx395.126" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx395.127" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx395.128" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx396" class="ltx_listingline">
</div>
<div id="lstnumberx397" class="ltx_listingline">
<span id="lstnumberx397.1" class="ltx_text ltx_font_typewriter">###</span><span id="lstnumberx397.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx397.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Step2</span><span id="lstnumberx397.4" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx397.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx397.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx397.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx397.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Docstring</span>
</div>
<div id="lstnumberx398" class="ltx_listingline">
</div>
<div id="lstnumberx399" class="ltx_listingline">
<span id="lstnumberx399.1" class="ltx_text ltx_font_typewriter">####</span><span id="lstnumberx399.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx399.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Description</span>
</div>
<div id="lstnumberx400" class="ltx_listingline">
</div>
<div id="lstnumberx401" class="ltx_listingline">
<span id="lstnumberx401.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx401.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx401.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx401.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx401.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expression</span><span id="lstnumberx401.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx401.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx401.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx401.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx401.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">clear</span><span id="lstnumberx401.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx401.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">concise</span><span id="lstnumberx401.24" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx401.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx401.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx401.29" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx401.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx401.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx401.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx401.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx401.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx401.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx401.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx401.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx401.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx401.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">clear</span><span id="lstnumberx401.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx401.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx401.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">concise</span><span id="lstnumberx401.54" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx402" class="ltx_listingline">
<span id="lstnumberx402.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx402.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx402.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx402.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx402.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx402.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx402.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">must</span><span id="lstnumberx402.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx402.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mention</span><span id="lstnumberx402.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx402.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx402.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx402.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx402.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx402.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">five</span><span id="lstnumberx402.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx402.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">things</span><span id="lstnumberx402.18" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx403" class="ltx_listingline">
<span id="lstnumberx403.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx403.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx403.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx403.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Functionality</span>
</div>
<div id="lstnumberx404" class="ltx_listingline">
<span id="lstnumberx404.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx404.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx404.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx404.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Input</span>
</div>
<div id="lstnumberx405" class="ltx_listingline">
<span id="lstnumberx405.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx405.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx405.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx405.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Output</span><span id="lstnumberx405.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx405.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx405.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx405.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx405.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx405.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span>
</div>
<div id="lstnumberx406" class="ltx_listingline">
<span id="lstnumberx406.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx406.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx406.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx406.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Requirements</span><span id="lstnumberx406.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx406.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx406.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx406.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx406.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx406.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx406.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx406.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx406.13" class="ltx_text ltx_font_typewriter">/</span><span id="lstnumberx406.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modules</span><span id="lstnumberx406.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx406.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx406.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx406.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx406.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx406.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span>
</div>
<div id="lstnumberx407" class="ltx_listingline">
<span id="lstnumberx407.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx407.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx407.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.4" class="ltx_text ltx_font_typewriter">1</span><span id="lstnumberx407.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx407.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.8" class="ltx_text ltx_font_typewriter">2</span><span id="lstnumberx407.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">examples</span><span id="lstnumberx407.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx407.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx407.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">input</span><span id="lstnumberx407.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx407.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">output</span><span id="lstnumberx407.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx407.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx407.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx407.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span>
</div>
<div id="lstnumberx408" class="ltx_listingline">
<span id="lstnumberx408.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx408.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx408.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Mention</span><span id="lstnumberx408.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx408.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">necessary</span><span id="lstnumberx408.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx408.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">structure</span><span id="lstnumberx408.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx408.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx408.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx408.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requires</span><span id="lstnumberx408.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx408.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx408.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">manipulation</span><span id="lstnumberx408.25" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx409" class="ltx_listingline">
<span id="lstnumberx409.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx409.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx409.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">must</span><span id="lstnumberx409.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx409.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">change</span><span id="lstnumberx409.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx409.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">overall</span><span id="lstnumberx409.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx409.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx409.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx409.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx409.22" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx409.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx409.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">remove</span><span id="lstnumberx409.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx409.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx409.31" class="ltx_text ltx_font_typewriter">/</span><span id="lstnumberx409.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modules</span><span id="lstnumberx409.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx409.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx409.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx409.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx409.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx409.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx409.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx409.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">accommodate</span><span id="lstnumberx409.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx409.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">blackbox</span><span id="lstnumberx409.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx409.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">testing</span><span id="lstnumberx409.55" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx410" class="ltx_listingline">
</div>
<div id="lstnumberx411" class="ltx_listingline">
<span id="lstnumberx411.1" class="ltx_text ltx_font_typewriter">####</span><span id="lstnumberx411.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx411.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Input</span><span id="lstnumberx411.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx411.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Parameters</span>
</div>
<div id="lstnumberx412" class="ltx_listingline">
</div>
<div id="lstnumberx413" class="ltx_listingline">
<span id="lstnumberx413.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx413.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx413.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx413.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx413.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx413.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">takes</span><span id="lstnumberx413.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">input</span><span id="lstnumberx413.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parameters</span><span id="lstnumberx413.16" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx413.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx413.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx413.21" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx413.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx413.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx413.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx413.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx413.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx413.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx413.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx413.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx413.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx413.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx413.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx413.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx413.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">take</span><span id="lstnumberx413.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">input</span><span id="lstnumberx413.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx413.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parameters</span><span id="lstnumberx413.52" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx414" class="ltx_listingline">
</div>
<div id="lstnumberx415" class="ltx_listingline">
<span id="lstnumberx415.1" class="ltx_text ltx_font_typewriter">####</span><span id="lstnumberx415.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx415.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Example</span>
</div>
<div id="lstnumberx416" class="ltx_listingline">
</div>
<div id="lstnumberx417" class="ltx_listingline">
<span id="lstnumberx417.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx417.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Provide</span><span id="lstnumberx417.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.5" class="ltx_text ltx_font_typewriter">1</span><span id="lstnumberx417.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx417.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.9" class="ltx_text ltx_font_typewriter">2</span><span id="lstnumberx417.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">examples</span><span id="lstnumberx417.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx417.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx417.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">input</span><span id="lstnumberx417.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx417.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">output</span><span id="lstnumberx417.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx417.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx417.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx417.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx417.28" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx418" class="ltx_listingline">
<span id="lstnumberx418.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx418.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx418.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx418.4" class="ltx_text ltx_font_typewriter">‘‘‘</span><span id="lstnumberx418.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bash</span>
</div>
<div id="lstnumberx419" class="ltx_listingline">
<span id="lstnumberx419.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx419.2" class="ltx_text ltx_font_typewriter">&gt;&gt;&gt;</span><span id="lstnumberx419.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx419.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f_0</span><span id="lstnumberx419.5" class="ltx_text ltx_font_typewriter">("</span><span id="lstnumberx419.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">hello</span><span id="lstnumberx419.7" class="ltx_text ltx_font_typewriter">")</span>
</div>
<div id="lstnumberx420" class="ltx_listingline">
<span id="lstnumberx420.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx420.2" class="ltx_text ltx_font_typewriter">"</span><span id="lstnumberx420.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">hello</span><span id="lstnumberx420.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx420.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">world</span><span id="lstnumberx420.6" class="ltx_text ltx_font_typewriter">"</span>
</div>
<div id="lstnumberx421" class="ltx_listingline">
<span id="lstnumberx421.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx421.2" class="ltx_text ltx_font_typewriter">&gt;&gt;&gt;</span><span id="lstnumberx421.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx421.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f_0</span><span id="lstnumberx421.5" class="ltx_text ltx_font_typewriter">("</span><span id="lstnumberx421.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">I</span><span id="lstnumberx421.7" class="ltx_text ltx_font_typewriter">")</span>
</div>
<div id="lstnumberx422" class="ltx_listingline">
<span id="lstnumberx422.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx422.2" class="ltx_text ltx_font_typewriter">"</span><span id="lstnumberx422.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">love</span><span id="lstnumberx422.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx422.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx422.6" class="ltx_text ltx_font_typewriter">"</span>
</div>
<div id="lstnumberx423" class="ltx_listingline">
<span id="lstnumberx423.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx423.2" class="ltx_text ltx_font_typewriter">‘‘‘</span>
</div>
<div id="lstnumberx424" class="ltx_listingline">
<span id="lstnumberx424.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx424.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx424.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx424.4" class="ltx_text ltx_font_typewriter">‘‘‘</span><span id="lstnumberx424.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bash</span>
</div>
<div id="lstnumberx425" class="ltx_listingline">
<span id="lstnumberx425.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx425.2" class="ltx_text ltx_font_typewriter">&gt;&gt;&gt;</span><span id="lstnumberx425.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx425.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f_0</span><span id="lstnumberx425.5" class="ltx_text ltx_font_typewriter">("</span><span id="lstnumberx425.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">image_1</span><span id="lstnumberx425.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx425.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">jpg</span><span id="lstnumberx425.9" class="ltx_text ltx_font_typewriter">")</span>
</div>
<div id="lstnumberx426" class="ltx_listingline">
<span id="lstnumberx426.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx426.2" class="ltx_text ltx_font_typewriter">&lt;</span><span id="lstnumberx426.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">module</span><span id="lstnumberx426.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx426.5" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx426.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matplotlib</span><span id="lstnumberx426.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx426.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pyplot</span><span id="lstnumberx426.9" class="ltx_text ltx_font_typewriter">’&gt;</span>
</div>
<div id="lstnumberx427" class="ltx_listingline">
<span id="lstnumberx427.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx427.2" class="ltx_text ltx_font_typewriter">&gt;&gt;&gt;</span><span id="lstnumberx427.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx427.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f_0</span><span id="lstnumberx427.5" class="ltx_text ltx_font_typewriter">("</span><span id="lstnumberx427.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">image_2</span><span id="lstnumberx427.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx427.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">jpg</span><span id="lstnumberx427.9" class="ltx_text ltx_font_typewriter">")</span>
</div>
<div id="lstnumberx428" class="ltx_listingline">
<span id="lstnumberx428.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx428.2" class="ltx_text ltx_font_typewriter">&lt;</span><span id="lstnumberx428.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">module</span><span id="lstnumberx428.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx428.5" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx428.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matplotlib</span><span id="lstnumberx428.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx428.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pyplot</span><span id="lstnumberx428.9" class="ltx_text ltx_font_typewriter">’&gt;</span>
</div>
<div id="lstnumberx429" class="ltx_listingline">
</div>
<div id="lstnumberx430" class="ltx_listingline">
<span id="lstnumberx430.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx430.2" class="ltx_text ltx_font_typewriter">‘‘‘</span>
</div>
<div id="lstnumberx431" class="ltx_listingline">
</div>
<div id="lstnumberx432" class="ltx_listingline">
<span id="lstnumberx432.1" class="ltx_text ltx_font_typewriter">###</span><span id="lstnumberx432.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx432.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Step</span><span id="lstnumberx432.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx432.5" class="ltx_text ltx_font_typewriter">3:</span><span id="lstnumberx432.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx432.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx432.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx432.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx432.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx432.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Implementation</span>
</div>
<div id="lstnumberx433" class="ltx_listingline">
</div>
<div id="lstnumberx434" class="ltx_listingline">
<span id="lstnumberx434.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx434.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx434.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx434.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx434.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx434.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx434.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx434.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correct</span><span id="lstnumberx434.16" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx434.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx434.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx434.21" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx434.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx434.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx434.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx434.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">repair</span><span id="lstnumberx434.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx434.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx434.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx434.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx434.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx434.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx434.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx434.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correct</span><span id="lstnumberx434.44" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx435" class="ltx_listingline">
<span id="lstnumberx435.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx435.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx435.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx435.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx435.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx435.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx435.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx435.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx435.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx435.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx435.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx435.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx435.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx435.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx435.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">constants</span><span id="lstnumberx435.16" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx436" class="ltx_listingline">
<span id="lstnumberx436.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx436.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx436.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx436.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">yes</span><span id="lstnumberx436.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx436.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx436.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx436.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">has</span><span id="lstnumberx436.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx436.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mentioned</span><span id="lstnumberx436.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx436.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx436.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx436.25" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx436.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx436.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx436.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx436.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">either</span><span id="lstnumberx436.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">leave</span><span id="lstnumberx436.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">off</span><span id="lstnumberx436.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx436.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">argument</span><span id="lstnumberx436.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">so</span><span id="lstnumberx436.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx436.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">takes</span><span id="lstnumberx436.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx436.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">default</span><span id="lstnumberx436.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">value</span><span id="lstnumberx436.54" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx436.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx436.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx436.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx436.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx436.63" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx436.65" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.66" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mention</span><span id="lstnumberx436.67" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx436.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx436.69" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx437" class="ltx_listingline">
<span id="lstnumberx437.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx437.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx437.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx437.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx437.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx437.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx437.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx437.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx437.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plt</span><span id="lstnumberx437.15" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx437.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">hist</span><span id="lstnumberx437.17" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx437.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">counts</span><span id="lstnumberx437.19" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx437.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bins</span><span id="lstnumberx437.22" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx437.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx437.24" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx437.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">arange</span><span id="lstnumberx437.26" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx437.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">len</span><span id="lstnumberx437.28" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx437.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">counts</span><span id="lstnumberx437.30" class="ltx_text ltx_font_typewriter">)+1)-0.5,</span><span id="lstnumberx437.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">rwidth</span><span id="lstnumberx437.33" class="ltx_text ltx_font_typewriter">=0.8)‘</span><span id="lstnumberx437.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx437.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.37" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx437.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f_0</span><span id="lstnumberx437.39" class="ltx_text ltx_font_typewriter">‘,</span><span id="lstnumberx437.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx437.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx437.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx437.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mention</span><span id="lstnumberx437.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx437.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">specific</span><span id="lstnumberx437.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">way</span><span id="lstnumberx437.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx437.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">compute</span><span id="lstnumberx437.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx437.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.61" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx437.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">len</span><span id="lstnumberx437.63" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx437.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">counts</span><span id="lstnumberx437.65" class="ltx_text ltx_font_typewriter">)+1)-0.5‘</span><span id="lstnumberx437.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx437.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx437.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx437.71" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx437.72" class="ltx_text ltx_lst_identifier ltx_font_typewriter">rwidth</span><span id="lstnumberx437.73" class="ltx_text ltx_font_typewriter">=0.8‘.</span>
</div>
<div id="lstnumberx438" class="ltx_listingline">
<span id="lstnumberx438.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx438.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx438.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx438.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx438.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx438.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">has</span><span id="lstnumberx438.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx438.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx438.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx438.18" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx438.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx438.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx438.23" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx438.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx438.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx438.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx438.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx438.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx438.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx438.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx438.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx438.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx438.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx438.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx438.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx438.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx438.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx438.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx438.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx438.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx438.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx438.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">check</span><span id="lstnumberx438.60" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx439" class="ltx_listingline">
<span id="lstnumberx439.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx439.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx439.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx439.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx439.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requires</span><span id="lstnumberx439.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx439.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx439.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx439.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">show</span><span id="lstnumberx439.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">some</span><span id="lstnumberx439.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx439.22" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx439.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx439.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">shall</span><span id="lstnumberx439.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">either</span><span id="lstnumberx439.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx439.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx439.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx439.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx439.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx439.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx439.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx439.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">take</span><span id="lstnumberx439.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx439.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">path</span><span id="lstnumberx439.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx439.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">file</span><span id="lstnumberx439.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">storage</span><span id="lstnumberx439.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx439.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx439.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">variable</span><span id="lstnumberx439.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx439.63" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx439.65" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.66" class="ltx_text ltx_lst_identifier ltx_font_typewriter">visualization</span><span id="lstnumberx439.67" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx439.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx439.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx439.72" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx439.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx439.75" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.76" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx439.77" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.78" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx439.79" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.80" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requires</span><span id="lstnumberx439.81" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.82" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx439.83" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.84" class="ltx_text ltx_lst_identifier ltx_font_typewriter">show</span><span id="lstnumberx439.85" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.86" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx439.87" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.88" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plot</span><span id="lstnumberx439.89" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx439.90" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.91" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx439.92" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.93" class="ltx_text ltx_lst_identifier ltx_font_typewriter">must</span><span id="lstnumberx439.94" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.95" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx439.96" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.97" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx439.98" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.99" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plot</span><span id="lstnumberx439.100" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.101" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx439.102" class="ltx_text ltx_lst_identifier ltx_font_typewriter">via</span><span id="lstnumberx439.103" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx439.104" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Axes</span><span id="lstnumberx439.105" class="ltx_text ltx_font_typewriter">).</span>
</div>
<div id="lstnumberx440" class="ltx_listingline">
<span id="lstnumberx440.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx440.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx440.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx440.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx440.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requires</span><span id="lstnumberx440.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">checking</span><span id="lstnumberx440.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">some</span><span id="lstnumberx440.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">properties</span><span id="lstnumberx440.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx440.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx440.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.21" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx440.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">print</span><span id="lstnumberx440.23" class="ltx_text ltx_font_typewriter">()‘</span><span id="lstnumberx440.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx440.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">show</span><span id="lstnumberx440.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx440.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx440.32" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx440.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx440.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx440.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx440.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx440.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">this</span><span id="lstnumberx440.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx440.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx440.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx440.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx440.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx440.53" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx440.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx440.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">revised</span><span id="lstnumberx440.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx440.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx440.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">amalgamate</span><span id="lstnumberx440.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx440.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">properties</span><span id="lstnumberx440.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx440.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx440.72" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.73" class="ltx_text ltx_lst_identifier ltx_font_typewriter">preexisting</span><span id="lstnumberx440.74" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.75" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx440.76" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.77" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx440.78" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx440.79" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.80" class="ltx_text ltx_lst_identifier ltx_font_typewriter">thereby</span><span id="lstnumberx440.81" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.82" class="ltx_text ltx_lst_identifier ltx_font_typewriter">facilitating</span><span id="lstnumberx440.83" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.84" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx440.85" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.86" class="ltx_text ltx_lst_identifier ltx_font_typewriter">versatile</span><span id="lstnumberx440.87" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.88" class="ltx_text ltx_lst_identifier ltx_font_typewriter">utilization</span><span id="lstnumberx440.89" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.90" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx440.91" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.92" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx440.93" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.94" class="ltx_text ltx_lst_identifier ltx_font_typewriter">outputs</span><span id="lstnumberx440.95" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.96" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx440.97" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.98" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx440.99" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.100" class="ltx_text ltx_lst_identifier ltx_font_typewriter">rest</span><span id="lstnumberx440.101" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.102" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx440.103" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.104" class="ltx_text ltx_lst_identifier ltx_font_typewriter">your</span><span id="lstnumberx440.105" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx440.106" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx440.107" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx441" class="ltx_listingline">
<span id="lstnumberx441.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx441.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx441.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx441.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Consider</span><span id="lstnumberx441.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx441.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">this</span><span id="lstnumberx441.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx441.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">original</span><span id="lstnumberx441.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx441.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx441.11" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx442" class="ltx_listingline">
</div>
<div id="lstnumberx443" class="ltx_listingline">
<span id="lstnumberx443.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">def</span><span id="lstnumberx443.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx443.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">check_properties</span><span id="lstnumberx443.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx443.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">original_list</span><span id="lstnumberx443.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx444" class="ltx_listingline">
<span id="lstnumberx444.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx444.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is_empty</span><span id="lstnumberx444.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx444.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx444.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx444.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx444.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx444.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bool</span><span id="lstnumberx444.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx444.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">original_list</span><span id="lstnumberx444.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx445" class="ltx_listingline">
<span id="lstnumberx445.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx445.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">print</span><span id="lstnumberx445.3" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx445.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx445.5" class="ltx_text ltx_font_typewriter">"</span><span id="lstnumberx445.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Is</span><span id="lstnumberx445.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx445.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx445.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx445.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list</span><span id="lstnumberx445.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx445.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">empty</span><span id="lstnumberx445.13" class="ltx_text ltx_font_typewriter">?</span><span id="lstnumberx445.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx445.15" class="ltx_text ltx_font_typewriter">{</span><span id="lstnumberx445.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is_empty</span><span id="lstnumberx445.17" class="ltx_text ltx_font_typewriter">}")</span>
</div>
<div id="lstnumberx446" class="ltx_listingline">
</div>
<div id="lstnumberx447" class="ltx_listingline">
<span id="lstnumberx447.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx447.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">length</span><span id="lstnumberx447.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx447.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx447.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx447.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">len</span><span id="lstnumberx447.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx447.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">original_list</span><span id="lstnumberx447.9" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx448" class="ltx_listingline">
<span id="lstnumberx448.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx448.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">print</span><span id="lstnumberx448.3" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx448.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx448.5" class="ltx_text ltx_font_typewriter">"</span><span id="lstnumberx448.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Length</span><span id="lstnumberx448.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx448.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx448.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx448.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx448.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx448.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list</span><span id="lstnumberx448.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx448.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx448.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx448.16" class="ltx_text ltx_font_typewriter">{</span><span id="lstnumberx448.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">length</span><span id="lstnumberx448.18" class="ltx_text ltx_font_typewriter">}")</span>
</div>
<div id="lstnumberx449" class="ltx_listingline">
</div>
<div id="lstnumberx450" class="ltx_listingline">
<span id="lstnumberx450.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">check_properties</span><span id="lstnumberx450.2" class="ltx_text ltx_font_typewriter">([1,</span><span id="lstnumberx450.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx450.4" class="ltx_text ltx_font_typewriter">2,</span><span id="lstnumberx450.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx450.6" class="ltx_text ltx_font_typewriter">3,</span><span id="lstnumberx450.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx450.8" class="ltx_text ltx_font_typewriter">4])</span>
</div>
<div id="lstnumberx451" class="ltx_listingline">
</div>
<div id="lstnumberx452" class="ltx_listingline">
<span id="lstnumberx452.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">This</span><span id="lstnumberx452.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx452.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">checks</span><span id="lstnumberx452.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">two</span><span id="lstnumberx452.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">properties</span><span id="lstnumberx452.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx452.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx452.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list</span><span id="lstnumberx452.16" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx452.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">whether</span><span id="lstnumberx452.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx452.21" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx452.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">s</span><span id="lstnumberx452.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">empty</span><span id="lstnumberx452.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx452.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">its</span><span id="lstnumberx452.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">length</span><span id="lstnumberx452.31" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx452.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">It</span><span id="lstnumberx452.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">then</span><span id="lstnumberx452.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">prints</span><span id="lstnumberx452.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx452.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx452.42" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx452.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">However</span><span id="lstnumberx452.45" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx452.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx452.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx452.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx452.52" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx452.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">t</span><span id="lstnumberx452.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx452.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx452.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">elsewhere</span><span id="lstnumberx452.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx452.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">your</span><span id="lstnumberx452.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx452.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">program</span><span id="lstnumberx452.66" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx453" class="ltx_listingline">
</div>
<div id="lstnumberx454" class="ltx_listingline">
<span id="lstnumberx454.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Now</span><span id="lstnumberx454.2" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx454.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx454.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">let</span><span id="lstnumberx454.5" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx454.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">s</span><span id="lstnumberx454.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx454.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx454.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx454.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx454.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx454.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx454.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx454.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx454.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx454.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx454.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx454.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx454.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx454.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx454.21" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx455" class="ltx_listingline">
</div>
<div id="lstnumberx456" class="ltx_listingline">
<span id="lstnumberx456.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">def</span><span id="lstnumberx456.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx456.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">check_properties</span><span id="lstnumberx456.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx456.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">original_list</span><span id="lstnumberx456.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx457" class="ltx_listingline">
<span id="lstnumberx457.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx457.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is_empty</span><span id="lstnumberx457.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx457.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx457.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx457.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx457.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx457.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bool</span><span id="lstnumberx457.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx457.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">original_list</span><span id="lstnumberx457.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx458" class="ltx_listingline">
<span id="lstnumberx458.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx458.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">length</span><span id="lstnumberx458.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx458.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx458.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx458.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">len</span><span id="lstnumberx458.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx458.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">original_list</span><span id="lstnumberx458.9" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx459" class="ltx_listingline">
</div>
<div id="lstnumberx460" class="ltx_listingline">
<span id="lstnumberx460.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx460.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx460.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx460.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is_empty</span><span id="lstnumberx460.5" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx460.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx460.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">length</span>
</div>
<div id="lstnumberx461" class="ltx_listingline">
</div>
<div id="lstnumberx462" class="ltx_listingline">
<span id="lstnumberx462.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list_empty</span><span id="lstnumberx462.2" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx462.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx462.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list_length</span><span id="lstnumberx462.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx462.6" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx462.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx462.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">check_properties</span><span id="lstnumberx462.9" class="ltx_text ltx_font_typewriter">([1,</span><span id="lstnumberx462.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx462.11" class="ltx_text ltx_font_typewriter">2,</span><span id="lstnumberx462.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx462.13" class="ltx_text ltx_font_typewriter">3,</span><span id="lstnumberx462.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx462.15" class="ltx_text ltx_font_typewriter">4])</span>
</div>
<div id="lstnumberx463" class="ltx_listingline">
</div>
<div id="lstnumberx464" class="ltx_listingline">
<span id="lstnumberx464.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">print</span><span id="lstnumberx464.2" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx464.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx464.4" class="ltx_text ltx_font_typewriter">"</span><span id="lstnumberx464.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Is</span><span id="lstnumberx464.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx464.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx464.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx464.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list</span><span id="lstnumberx464.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx464.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">empty</span><span id="lstnumberx464.12" class="ltx_text ltx_font_typewriter">?</span><span id="lstnumberx464.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx464.14" class="ltx_text ltx_font_typewriter">{</span><span id="lstnumberx464.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list_empty</span><span id="lstnumberx464.16" class="ltx_text ltx_font_typewriter">}")</span>
</div>
<div id="lstnumberx465" class="ltx_listingline">
<span id="lstnumberx465.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">print</span><span id="lstnumberx465.2" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx465.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx465.4" class="ltx_text ltx_font_typewriter">"</span><span id="lstnumberx465.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Length</span><span id="lstnumberx465.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx465.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx465.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx465.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx465.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx465.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list</span><span id="lstnumberx465.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx465.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx465.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx465.15" class="ltx_text ltx_font_typewriter">{</span><span id="lstnumberx465.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list_length</span><span id="lstnumberx465.17" class="ltx_text ltx_font_typewriter">}")</span>
</div>
<div id="lstnumberx466" class="ltx_listingline">
</div>
<div id="lstnumberx467" class="ltx_listingline">
<span id="lstnumberx467.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">In</span><span id="lstnumberx467.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">this</span><span id="lstnumberx467.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modified</span><span id="lstnumberx467.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">version</span><span id="lstnumberx467.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx467.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx467.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx467.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returns</span><span id="lstnumberx467.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx467.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">two</span><span id="lstnumberx467.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">properties</span><span id="lstnumberx467.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">instead</span><span id="lstnumberx467.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx467.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">printing</span><span id="lstnumberx467.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx467.29" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx467.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">This</span><span id="lstnumberx467.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">allows</span><span id="lstnumberx467.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx467.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx467.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">capture</span><span id="lstnumberx467.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx467.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span><span id="lstnumberx467.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx467.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx467.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list_empty</span><span id="lstnumberx467.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx467.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list_length</span><span id="lstnumberx467.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">variables</span><span id="lstnumberx467.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx467.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx467.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx467.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">elsewhere</span><span id="lstnumberx467.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx467.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">your</span><span id="lstnumberx467.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx467.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">program</span><span id="lstnumberx467.70" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx468" class="ltx_listingline">
</div>
<div id="lstnumberx469" class="ltx_listingline">
<span id="lstnumberx469.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx469.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx469.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx469.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx469.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx469.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">formats</span><span id="lstnumberx469.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx469.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx469.16" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx469.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">e</span><span id="lstnumberx469.18" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx469.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">g</span><span id="lstnumberx469.20" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx469.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.22" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx469.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">string</span><span id="lstnumberx469.24" class="ltx_text ltx_font_typewriter">‘),</span><span id="lstnumberx469.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx469.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sure</span><span id="lstnumberx469.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx469.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx469.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mention</span><span id="lstnumberx469.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx469.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">format</span><span id="lstnumberx469.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx469.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx469.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx469.45" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx469.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">It</span><span id="lstnumberx469.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx469.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">better</span><span id="lstnumberx469.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx469.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">assessing</span><span id="lstnumberx469.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx469.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correctness</span><span id="lstnumberx469.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx469.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx469.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx469.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx469.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx469.68" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx470" class="ltx_listingline">
</div>
<div id="lstnumberx471" class="ltx_listingline">
<span id="lstnumberx471.1" class="ltx_text ltx_font_typewriter">###</span><span id="lstnumberx471.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx471.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Step4</span><span id="lstnumberx471.4" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx471.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx471.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Run</span><span id="lstnumberx471.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx471.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx471.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx471.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx471.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx471.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx471.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx471.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Write</span><span id="lstnumberx471.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx471.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Blackbox</span><span id="lstnumberx471.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx471.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx471.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx471.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Cases</span>
</div>
<div id="lstnumberx472" class="ltx_listingline">
</div>
<div id="lstnumberx473" class="ltx_listingline">
<span id="lstnumberx473.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx473.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx473.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx473.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx473.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contained</span><span id="lstnumberx473.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx473.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx473.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">file</span><span id="lstnumberx473.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">named</span><span id="lstnumberx473.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.19" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx473.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx473.21" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx473.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx473.23" class="ltx_text ltx_font_typewriter">‘,</span><span id="lstnumberx473.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx473.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx473.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx473.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">required</span><span id="lstnumberx473.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx473.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx473.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx473.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">blackbox</span><span id="lstnumberx473.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">testing</span><span id="lstnumberx473.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx473.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">named</span><span id="lstnumberx473.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.47" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx473.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run_tests</span><span id="lstnumberx473.49" class="ltx_text ltx_font_typewriter">()‘</span><span id="lstnumberx473.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx473.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx473.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">assertion</span><span id="lstnumberx473.56" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx473.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">based</span><span id="lstnumberx473.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">blackbox</span><span id="lstnumberx473.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx473.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx473.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx473.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx473.67" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx473.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx473.69" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx473.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx473.71" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx474" class="ltx_listingline">
<span id="lstnumberx474.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx474.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx474.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx474.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx474.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx474.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx474.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx474.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">types</span><span id="lstnumberx474.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx474.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx474.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx474.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">manipulation</span><span id="lstnumberx474.24" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx474.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx474.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx474.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx474.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">manually</span><span id="lstnumberx474.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">design</span><span id="lstnumberx474.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx474.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx474.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx474.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">utilize</span><span id="lstnumberx474.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.44" class="ltx_text ltx_font_typewriter">3</span><span id="lstnumberx474.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">rd</span><span id="lstnumberx474.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">party</span><span id="lstnumberx474.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx474.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx474.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">websites</span><span id="lstnumberx474.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.55" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx474.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">e</span><span id="lstnumberx474.57" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx474.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">g</span><span id="lstnumberx474.59" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx474.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.61" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx474.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Faker</span><span id="lstnumberx474.63" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx474.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx474.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.67" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx474.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unittest</span><span id="lstnumberx474.69" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx474.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mock</span><span id="lstnumberx474.71" class="ltx_text ltx_font_typewriter">‘)</span><span id="lstnumberx474.72" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.73" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx474.74" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.75" class="ltx_text ltx_lst_identifier ltx_font_typewriter">generate</span><span id="lstnumberx474.76" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.77" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx474.78" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.79" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mock</span><span id="lstnumberx474.80" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.81" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx474.82" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.83" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx474.84" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.85" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx474.86" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx474.87" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.88" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx474.89" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.90" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx474.91" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.92" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx474.93" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.94" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx474.95" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.96" class="ltx_text ltx_font_typewriter">"</span><span id="lstnumberx474.97" class="ltx_text ltx_lst_identifier ltx_font_typewriter">file</span><span id="lstnumberx474.98" class="ltx_text ltx_font_typewriter">://"</span><span id="lstnumberx474.99" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.100" class="ltx_text ltx_lst_identifier ltx_font_typewriter">protocol</span><span id="lstnumberx474.101" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.102" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx474.103" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.104" class="ltx_text ltx_lst_identifier ltx_font_typewriter">access</span><span id="lstnumberx474.105" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.106" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx474.107" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.108" class="ltx_text ltx_lst_identifier ltx_font_typewriter">local</span><span id="lstnumberx474.109" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.110" class="ltx_text ltx_lst_identifier ltx_font_typewriter">HTML</span><span id="lstnumberx474.111" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.112" class="ltx_text ltx_lst_identifier ltx_font_typewriter">files</span><span id="lstnumberx474.113" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx474.114" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.115" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx474.116" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.117" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx474.118" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.119" class="ltx_text ltx_lst_identifier ltx_font_typewriter">url</span><span id="lstnumberx474.120" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.121" class="ltx_text ltx_lst_identifier ltx_font_typewriter">request</span><span id="lstnumberx474.122" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.123" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx474.124" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.125" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx474.126" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.127" class="ltx_text ltx_lst_identifier ltx_font_typewriter">work</span><span id="lstnumberx474.128" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.129" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correctly</span><span id="lstnumberx474.130" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.131" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx474.132" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.133" class="ltx_text ltx_lst_identifier ltx_font_typewriter">this</span><span id="lstnumberx474.134" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.135" class="ltx_text ltx_lst_identifier ltx_font_typewriter">protocol</span><span id="lstnumberx474.136" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx474.137" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.138" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx474.139" class="ltx_text ltx_lst_identifier ltx_font_typewriter">See</span><span id="lstnumberx474.140" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx474.141" class="ltx_text ltx_lst_identifier ltx_font_typewriter">https</span><span id="lstnumberx474.142" class="ltx_text ltx_font_typewriter">://</span><span id="lstnumberx474.143" class="ltx_text ltx_lst_identifier ltx_font_typewriter">chat</span><span id="lstnumberx474.144" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx474.145" class="ltx_text ltx_lst_identifier ltx_font_typewriter">openai</span><span id="lstnumberx474.146" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx474.147" class="ltx_text ltx_lst_identifier ltx_font_typewriter">com</span><span id="lstnumberx474.148" class="ltx_text ltx_font_typewriter">/</span><span id="lstnumberx474.149" class="ltx_text ltx_lst_identifier ltx_font_typewriter">share</span><span id="lstnumberx474.150" class="ltx_text ltx_font_typewriter">/84</span><span id="lstnumberx474.151" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ba0dc9</span><span id="lstnumberx474.152" class="ltx_text ltx_font_typewriter">-067</span><span id="lstnumberx474.153" class="ltx_text ltx_lst_identifier ltx_font_typewriter">d</span><span id="lstnumberx474.154" class="ltx_text ltx_font_typewriter">-4</span><span id="lstnumberx474.155" class="ltx_text ltx_lst_identifier ltx_font_typewriter">eb0</span><span id="lstnumberx474.156" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx474.157" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a4d4</span><span id="lstnumberx474.158" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx474.159" class="ltx_text ltx_lst_identifier ltx_font_typewriter">d8f4a77ff1a5</span><span id="lstnumberx474.160" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx475" class="ltx_listingline">
</div>
<div id="lstnumberx476" class="ltx_listingline">
<span id="lstnumberx476.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx476.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx476.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx476.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">html</span><span id="lstnumberx476.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx476.6" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx476.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">webpage</span><span id="lstnumberx476.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx476.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx476.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">page</span><span id="lstnumberx476.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx476.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">link</span><span id="lstnumberx476.13" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx477" class="ltx_listingline">
<span id="lstnumberx477.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx477.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx477.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx477.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">csv</span>
</div>
<div id="lstnumberx478" class="ltx_listingline">
<span id="lstnumberx478.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx478.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx478.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx478.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">json</span>
</div>
<div id="lstnumberx479" class="ltx_listingline">
<span id="lstnumberx479.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx479.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx479.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx479.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">xml</span>
</div>
<div id="lstnumberx480" class="ltx_listingline">
<span id="lstnumberx480.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx480.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx480.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx480.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sql</span>
</div>
<div id="lstnumberx481" class="ltx_listingline">
<span id="lstnumberx481.1" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx481.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx481.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx481.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">image</span>
</div>
<div id="lstnumberx482" class="ltx_listingline">
</div>
<div id="lstnumberx483" class="ltx_listingline">
<span id="lstnumberx483.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx483.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx483.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx483.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx483.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx483.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">possible</span><span id="lstnumberx483.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx483.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx483.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx483.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">written</span><span id="lstnumberx483.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx483.22" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx483.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx483.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx483.27" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx483.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx483.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx483.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx483.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx483.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plot</span><span id="lstnumberx483.38" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx483.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx483.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx483.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx483.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx483.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx483.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx483.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plot</span><span id="lstnumberx483.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx483.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx483.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correct</span><span id="lstnumberx483.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">title</span><span id="lstnumberx483.61" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx483.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">x</span><span id="lstnumberx483.64" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx483.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">axis</span><span id="lstnumberx483.66" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx483.67" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">y</span><span id="lstnumberx483.69" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx483.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">axis</span><span id="lstnumberx483.71" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.72" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx483.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx483.75" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx483.76" class="ltx_text ltx_lst_identifier ltx_font_typewriter">points</span><span id="lstnumberx483.77" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx484" class="ltx_listingline">
</div>
<div id="lstnumberx485" class="ltx_listingline">
<span id="lstnumberx485.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx485.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">To</span><span id="lstnumberx485.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">formalize</span><span id="lstnumberx485.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx485.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx485.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">case</span><span id="lstnumberx485.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">writing</span><span id="lstnumberx485.14" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx485.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx485.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx485.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx485.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx485.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx485.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx485.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx485.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx485.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx485.31" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx486" class="ltx_listingline">
</div>
<div id="lstnumberx487" class="ltx_listingline">
<span id="lstnumberx487.1" class="ltx_text ltx_font_typewriter">‘‘‘</span><span id="lstnumberx487.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">python</span>
</div>
<div id="lstnumberx488" class="ltx_listingline">
<span id="lstnumberx488.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">def</span><span id="lstnumberx488.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx488.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run_tests</span><span id="lstnumberx488.4" class="ltx_text ltx_font_typewriter">():</span>
</div>
<div id="lstnumberx489" class="ltx_listingline">
<span id="lstnumberx489.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx489.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">suite</span><span id="lstnumberx489.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx489.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx489.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx489.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unittest</span><span id="lstnumberx489.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx489.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestSuite</span><span id="lstnumberx489.9" class="ltx_text ltx_font_typewriter">()</span>
</div>
<div id="lstnumberx490" class="ltx_listingline">
<span id="lstnumberx490.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx490.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">suite</span><span id="lstnumberx490.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx490.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">addTest</span><span id="lstnumberx490.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx490.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unittest</span><span id="lstnumberx490.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx490.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">makeSuite</span><span id="lstnumberx490.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx490.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx490.11" class="ltx_text ltx_font_typewriter">))</span>
</div>
<div id="lstnumberx491" class="ltx_listingline">
<span id="lstnumberx491.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx491.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">runner</span><span id="lstnumberx491.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx491.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx491.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx491.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unittest</span><span id="lstnumberx491.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx491.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TextTestRunner</span><span id="lstnumberx491.9" class="ltx_text ltx_font_typewriter">()</span>
</div>
<div id="lstnumberx492" class="ltx_listingline">
<span id="lstnumberx492.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx492.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">runner</span><span id="lstnumberx492.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx492.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run</span><span id="lstnumberx492.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx492.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">suite</span><span id="lstnumberx492.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx493" class="ltx_listingline">
</div>
<div id="lstnumberx494" class="ltx_listingline">
<span id="lstnumberx494.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">class</span><span id="lstnumberx494.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx494.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx494.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx494.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unittest</span><span id="lstnumberx494.6" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx494.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCase</span><span id="lstnumberx494.8" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx495" class="ltx_listingline">
<span id="lstnumberx495.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx495.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">def</span><span id="lstnumberx495.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx495.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test_case_1</span><span id="lstnumberx495.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx495.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">self</span><span id="lstnumberx495.7" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx496" class="ltx_listingline">
<span id="lstnumberx496.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx496.2" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx496.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx496.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Input</span><span id="lstnumberx496.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx496.6" class="ltx_text ltx_font_typewriter">1:</span><span id="lstnumberx496.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx496.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx496.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx496.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">your</span><span id="lstnumberx496.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx496.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx496.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx496.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">case</span><span id="lstnumberx496.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx496.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">here</span><span id="lstnumberx496.17" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx497" class="ltx_listingline">
<span id="lstnumberx497.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx497.2" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx497.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">provide</span><span id="lstnumberx497.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx497.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">series</span><span id="lstnumberx497.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx497.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unit</span><span id="lstnumberx497.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tests</span><span id="lstnumberx497.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx497.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx497.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx497.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx497.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx497.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx497.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span><span id="lstnumberx497.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx497.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span>
</div>
<div id="lstnumberx498" class="ltx_listingline">
<span id="lstnumberx498.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx498.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pass</span>
</div>
<div id="lstnumberx499" class="ltx_listingline">
</div>
<div id="lstnumberx500" class="ltx_listingline">
<span id="lstnumberx500.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx500.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">def</span><span id="lstnumberx500.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx500.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test_case_2</span><span id="lstnumberx500.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx500.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">self</span><span id="lstnumberx500.7" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx501" class="ltx_listingline">
<span id="lstnumberx501.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx501.2" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx501.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx501.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Input</span><span id="lstnumberx501.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx501.6" class="ltx_text ltx_font_typewriter">2:</span><span id="lstnumberx501.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx501.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx501.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx501.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">your</span><span id="lstnumberx501.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx501.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx501.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx501.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">case</span><span id="lstnumberx501.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx501.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">here</span><span id="lstnumberx501.17" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx502" class="ltx_listingline">
<span id="lstnumberx502.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx502.2" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx502.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Provide</span><span id="lstnumberx502.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx502.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">series</span><span id="lstnumberx502.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx502.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unit</span><span id="lstnumberx502.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tests</span><span id="lstnumberx502.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx502.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx502.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx502.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx502.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx502.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx502.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span><span id="lstnumberx502.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx502.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span>
</div>
<div id="lstnumberx503" class="ltx_listingline">
<span id="lstnumberx503.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx503.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pass</span>
</div>
<div id="lstnumberx504" class="ltx_listingline">
</div>
<div id="lstnumberx505" class="ltx_listingline">
<span id="lstnumberx505.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx505.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">def</span><span id="lstnumberx505.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx505.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test_case_3</span><span id="lstnumberx505.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx505.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">self</span><span id="lstnumberx505.7" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx506" class="ltx_listingline">
<span id="lstnumberx506.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx506.2" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx506.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx506.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Input</span><span id="lstnumberx506.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx506.6" class="ltx_text ltx_font_typewriter">3:</span><span id="lstnumberx506.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx506.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx506.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx506.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">your</span><span id="lstnumberx506.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx506.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx506.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx506.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">case</span><span id="lstnumberx506.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx506.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">here</span><span id="lstnumberx506.17" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx507" class="ltx_listingline">
<span id="lstnumberx507.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx507.2" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx507.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Provide</span><span id="lstnumberx507.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx507.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">series</span><span id="lstnumberx507.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx507.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unit</span><span id="lstnumberx507.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tests</span><span id="lstnumberx507.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx507.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx507.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx507.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx507.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx507.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx507.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span><span id="lstnumberx507.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx507.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span>
</div>
<div id="lstnumberx508" class="ltx_listingline">
<span id="lstnumberx508.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx508.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pass</span>
</div>
<div id="lstnumberx509" class="ltx_listingline">
</div>
<div id="lstnumberx510" class="ltx_listingline">
<span id="lstnumberx510.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx510.2" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx510.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx510.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx510.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx510.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx510.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx510.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tests</span><span id="lstnumberx510.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx510.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">here</span>
</div>
<div id="lstnumberx511" class="ltx_listingline">
<span id="lstnumberx511.1" class="ltx_text ltx_font_typewriter">‘‘‘</span>
</div>
<div id="lstnumberx512" class="ltx_listingline">
</div>
<div id="lstnumberx513" class="ltx_listingline">
<span id="lstnumberx513.1" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx513.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Each</span><span id="lstnumberx513.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">blackbox</span><span id="lstnumberx513.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx513.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">method</span><span id="lstnumberx513.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx513.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx513.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tested</span><span id="lstnumberx513.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx513.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx513.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unique</span><span id="lstnumberx513.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">input</span><span id="lstnumberx513.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">value</span><span id="lstnumberx513.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx513.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">asserted</span><span id="lstnumberx513.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx513.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx513.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx513.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx513.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx513.38" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx514" class="ltx_listingline">
</div>
<div id="lstnumberx515" class="ltx_listingline">
<span id="lstnumberx515.1" class="ltx_text ltx_font_typewriter">###</span><span id="lstnumberx515.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx515.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Working</span>
</div>
<div id="lstnumberx516" class="ltx_listingline">
</div>
<div id="lstnumberx517" class="ltx_listingline">
<span id="lstnumberx517.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">After</span><span id="lstnumberx517.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">reading</span><span id="lstnumberx517.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx517.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">guideline</span><span id="lstnumberx517.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx517.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">refine</span><span id="lstnumberx517.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.12" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx517.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx517.14" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx517.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx517.16" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx517.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx517.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx517.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx517.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">single</span><span id="lstnumberx517.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx517.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">program</span><span id="lstnumberx517.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">named</span><span id="lstnumberx517.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.32" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx517.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run_tests</span><span id="lstnumberx517.34" class="ltx_text ltx_font_typewriter">()‘</span><span id="lstnumberx517.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx517.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.38" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx517.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx517.40" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx517.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx517.42" class="ltx_text ltx_font_typewriter">‘,</span><span id="lstnumberx517.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">which</span><span id="lstnumberx517.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx517.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contain</span><span id="lstnumberx517.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">at</span><span id="lstnumberx517.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">least</span><span id="lstnumberx517.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.54" class="ltx_text ltx_font_typewriter">*</span><span id="lstnumberx517.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">five</span><span id="lstnumberx517.56" class="ltx_text ltx_font_typewriter">*</span><span id="lstnumberx517.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">different</span><span id="lstnumberx517.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">input</span><span id="lstnumberx517.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx517.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx517.63" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx518" class="ltx_listingline">
</div>
<div id="lstnumberx519" class="ltx_listingline">
<span id="lstnumberx519.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">When</span><span id="lstnumberx519.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">testing</span><span id="lstnumberx519.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx519.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx519.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx519.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx519.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx519.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx519.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">generate</span><span id="lstnumberx519.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx519.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx519.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">by</span><span id="lstnumberx519.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">yourself</span><span id="lstnumberx519.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx519.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx519.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.30" class="ltx_text ltx_font_typewriter">3</span><span id="lstnumberx519.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">rd</span><span id="lstnumberx519.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">party</span><span id="lstnumberx519.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx519.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx519.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">websites</span><span id="lstnumberx519.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.41" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx519.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">e</span><span id="lstnumberx519.43" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx519.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">g</span><span id="lstnumberx519.45" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx519.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.47" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx519.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Faker</span><span id="lstnumberx519.49" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx519.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx519.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.53" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx519.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unittest</span><span id="lstnumberx519.55" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx519.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mock</span><span id="lstnumberx519.57" class="ltx_text ltx_font_typewriter">‘)</span><span id="lstnumberx519.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx519.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">generate</span><span id="lstnumberx519.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx519.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mock</span><span id="lstnumberx519.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx519.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx519.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx519.72" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx519.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx519.75" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.76" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx519.77" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx519.78" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.79" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx519.80" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.81" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx519.82" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.83" class="ltx_text ltx_lst_identifier ltx_font_typewriter">design</span><span id="lstnumberx519.84" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.85" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx519.86" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.87" class="ltx_text ltx_lst_identifier ltx_font_typewriter">html</span><span id="lstnumberx519.88" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.89" class="ltx_text ltx_lst_identifier ltx_font_typewriter">webpage</span><span id="lstnumberx519.90" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.91" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx519.92" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.93" class="ltx_text ltx_lst_identifier ltx_font_typewriter">meet</span><span id="lstnumberx519.94" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.95" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx519.96" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.97" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx519.98" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.99" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx519.100" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.101" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx519.102" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.103" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scenarios</span><span id="lstnumberx519.104" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx519.105" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.106" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx519.107" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.108" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx519.109" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.110" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numeric</span><span id="lstnumberx519.111" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.112" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx519.113" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx519.114" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.115" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx519.116" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.117" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx519.118" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.119" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx519.120" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.121" class="ltx_text ltx_lst_identifier ltx_font_typewriter">represent</span><span id="lstnumberx519.122" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.123" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx519.124" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.125" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx519.126" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.127" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx519.128" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx519.129" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx519.130" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx520" class="ltx_listingline">
</div>
<div id="lstnumberx521" class="ltx_listingline">
<span id="lstnumberx521.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Make</span><span id="lstnumberx521.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx521.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx521.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx521.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx521.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complex</span><span id="lstnumberx521.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx521.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">possible</span><span id="lstnumberx521.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx521.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mimic</span><span id="lstnumberx521.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx521.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">real</span><span id="lstnumberx521.24" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx521.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">world</span><span id="lstnumberx521.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx521.28" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx521.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx521.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx521.33" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx521.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx521.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx521.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx521.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requires</span><span id="lstnumberx521.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">reading</span><span id="lstnumberx521.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx521.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">csv</span><span id="lstnumberx521.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">file</span><span id="lstnumberx521.50" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx521.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx521.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx521.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx521.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">design</span><span id="lstnumberx521.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx521.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">csv</span><span id="lstnumberx521.63" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">file</span><span id="lstnumberx521.65" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.66" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx521.67" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">meet</span><span id="lstnumberx521.69" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx521.71" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.72" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx521.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx521.75" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.76" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx521.77" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx521.78" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scenarios</span><span id="lstnumberx521.79" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx522" class="ltx_listingline">
</div>
<div id="lstnumberx523" class="ltx_listingline">
<span id="lstnumberx523.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx523.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx523.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx523.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">remove</span><span id="lstnumberx523.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx523.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx523.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx523.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modules</span><span id="lstnumberx523.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx523.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx523.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx523.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">original</span><span id="lstnumberx523.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx523.26" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx523.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">However</span><span id="lstnumberx523.29" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx523.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx523.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx523.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">add</span><span id="lstnumberx523.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">new</span><span id="lstnumberx523.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx523.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx523.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modules</span><span id="lstnumberx523.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx523.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx523.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx523.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx523.50" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx524" class="ltx_listingline">
</div>
<div id="lstnumberx525" class="ltx_listingline">
<span id="lstnumberx525.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Make</span><span id="lstnumberx525.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sure</span><span id="lstnumberx525.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx525.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">have</span><span id="lstnumberx525.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tested</span><span id="lstnumberx525.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx525.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx525.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx525.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx525.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx525.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">possible</span><span id="lstnumberx525.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx525.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx525.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx525.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">written</span><span id="lstnumberx525.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx525.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx525.32" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx526" class="ltx_listingline">
</div>
<div id="lstnumberx527" class="ltx_listingline">
<span id="lstnumberx527.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Keep</span><span id="lstnumberx527.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">testing</span><span id="lstnumberx527.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx527.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx527.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">until</span><span id="lstnumberx527.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx527.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx527.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">satisfied</span><span id="lstnumberx527.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx527.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx527.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx527.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx527.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx527.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx527.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx527.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx527.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx527.32" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx528" class="ltx_listingline">
</div>
<div id="lstnumberx529" class="ltx_listingline">
<span id="lstnumberx529.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx529.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx529.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tested</span><span id="lstnumberx529.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">properties</span><span id="lstnumberx529.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx529.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx529.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mentioned</span><span id="lstnumberx529.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx529.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx529.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx529.20" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx529.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx529.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx529.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx529.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx529.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx529.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx529.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx529.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mention</span><span id="lstnumberx529.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx529.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx529.39" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx530" class="ltx_listingline">
</div>
<div id="lstnumberx531" class="ltx_listingline">
<span id="lstnumberx531.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">As</span><span id="lstnumberx531.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">we</span><span id="lstnumberx531.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">will</span><span id="lstnumberx531.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">provide</span><span id="lstnumberx531.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx531.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx531.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">stub</span><span id="lstnumberx531.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx531.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">programmers</span><span id="lstnumberx531.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx531.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implement</span><span id="lstnumberx531.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">by</span><span id="lstnumberx531.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">their</span><span id="lstnumberx531.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">own</span><span id="lstnumberx531.28" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx531.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">please</span><span id="lstnumberx531.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx531.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sure</span><span id="lstnumberx531.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">there</span><span id="lstnumberx531.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx531.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">no</span><span id="lstnumberx531.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ambiguity</span><span id="lstnumberx531.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx531.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx531.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx531.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx531.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx531.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx531.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx531.57" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx531.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx531.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">there</span><span id="lstnumberx531.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx531.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx531.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ambiguity</span><span id="lstnumberx531.68" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx531.69" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx531.71" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.72" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx531.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx531.75" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.76" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx531.77" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.78" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx531.79" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.80" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx531.81" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.82" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx531.83" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.84" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx531.85" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.86" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx531.87" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.88" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx531.89" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.90" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx531.91" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.92" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx531.93" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.94" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx531.95" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.96" class="ltx_text ltx_lst_identifier ltx_font_typewriter">clear</span><span id="lstnumberx531.97" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.98" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx531.99" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.100" class="ltx_text ltx_lst_identifier ltx_font_typewriter">concise</span><span id="lstnumberx531.101" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx531.102" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.103" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Think</span><span id="lstnumberx531.104" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.105" class="ltx_text ltx_lst_identifier ltx_font_typewriter">about</span><span id="lstnumberx531.106" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.107" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx531.108" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.109" class="ltx_text ltx_lst_identifier ltx_font_typewriter">possible</span><span id="lstnumberx531.110" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.111" class="ltx_text ltx_lst_identifier ltx_font_typewriter">questions</span><span id="lstnumberx531.112" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.113" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx531.114" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.115" class="ltx_text ltx_lst_identifier ltx_font_typewriter">programmers</span><span id="lstnumberx531.116" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.117" class="ltx_text ltx_lst_identifier ltx_font_typewriter">may</span><span id="lstnumberx531.118" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.119" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ask</span><span id="lstnumberx531.120" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.121" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx531.122" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.123" class="ltx_text ltx_lst_identifier ltx_font_typewriter">try</span><span id="lstnumberx531.124" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.125" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx531.126" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.127" class="ltx_text ltx_lst_identifier ltx_font_typewriter">answer</span><span id="lstnumberx531.128" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.129" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx531.130" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.131" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx531.132" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.133" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx531.134" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx531.135" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx531.136" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx532" class="ltx_listingline">
</div>
<div id="lstnumberx533" class="ltx_listingline">
<span id="lstnumberx533.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Execute</span><span id="lstnumberx533.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx533.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx533.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sure</span><span id="lstnumberx533.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.9" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx533.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx533.11" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx533.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx533.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx533.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">will</span><span id="lstnumberx533.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pass</span><span id="lstnumberx533.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx533.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">blackbox</span><span id="lstnumberx533.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx533.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx533.26" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx533.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Otherwise</span><span id="lstnumberx533.29" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx533.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx533.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx533.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx533.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx533.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx533.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx533.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx533.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx533.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx533.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx533.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pass</span><span id="lstnumberx533.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx533.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">blackbox</span><span id="lstnumberx533.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx533.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx533.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx533.60" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx534" class="ltx_listingline">
</div>
<div id="lstnumberx535" class="ltx_listingline">
<span id="lstnumberx535.1" class="ltx_text ltx_font_typewriter">###</span><span id="lstnumberx535.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx535.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Refine</span><span id="lstnumberx535.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx535.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx535.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx535.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx535.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx535.9" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx535.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx535.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx535.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx535.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx535.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx535.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">blackbox</span><span id="lstnumberx535.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx535.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tests</span><span id="lstnumberx535.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx535.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx535.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx535.21" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx535.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx535.23" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx535.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx535.25" class="ltx_text ltx_font_typewriter">‘</span>
</div>
<div id="lstnumberx536" class="ltx_listingline">
</div>
<div id="lstnumberx537" class="ltx_listingline">
<span id="lstnumberx537.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Note</span><span id="lstnumberx537.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx537.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx537.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Faker</span><span id="lstnumberx537.7" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx537.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">library</span><span id="lstnumberx537.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">has</span><span id="lstnumberx537.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">already</span><span id="lstnumberx537.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">been</span><span id="lstnumberx537.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">installed</span><span id="lstnumberx537.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx537.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx537.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">environment</span><span id="lstnumberx537.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx537.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx537.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx537.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx537.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx537.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx537.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">freely</span><span id="lstnumberx537.36" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx538" class="ltx_listingline">
</div>
<div id="lstnumberx539" class="ltx_listingline">
<span id="lstnumberx539.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Download</span><span id="lstnumberx539.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">refined</span><span id="lstnumberx539.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx539.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx539.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx539.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx539.9" class="ltx_text ltx_font_typewriter">‘,</span><span id="lstnumberx539.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">written</span><span id="lstnumberx539.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx539.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx539.15" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx539.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx539.17" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx539.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx539.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">created</span><span id="lstnumberx539.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.23" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx539.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test_data</span><span id="lstnumberx539.25" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx539.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">zip</span><span id="lstnumberx539.27" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx539.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx539.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">there</span><span id="lstnumberx539.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx539.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">exists</span><span id="lstnumberx539.34" class="ltx_text ltx_font_typewriter">.</span>
</div>
</div>
</div>
</section>
</section>
<section id="A7.SS3" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">G.3 </span>Human Curation Guidelines</h4>

<div id="A7.SS3.p1" class="ltx_para ltx_noindent">
<div id="A7.SS3.p1.1" class="ltx_listing ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,IyBBbm5vdGF0aW9uIEd1aWRlbGluZXMKCiMjIEVudmlyb25tZW50IFNldHVwCgpZb3UgYXJlIGdpdmVuIGEgZmlsZSBuYW1lZCBgcmVxdWlyZW1lbnRzLnR4dGAsIHBsZWFzZSBzZXQgdXAgYSBQeXRob24gZW52aXJvbm1lbnQgd2l0aCB2ZXJzaW9uIDMuOC4xMC4gWW91IGNhbiB1c2UgQW5hY29uZGEgb3IgUHl0aG9uIFZpcnR1YWwgRW52aXJvbm1lbnQgZm9yIHRoaXMgcHVycG9zZS4KClVzZSB0aGUgZm9sbG93aW5nIGNvbW1hbmQgdG8gaW5zdGFsbCBhbGwgcmVxdWlyZWQgbGlicmFyaWVzOgpgYGBzaApwaXAgaW5zdGFsbCAtVSAtciByZXF1aXJlbWVudHMudHh0CmBgYAoKUGxlYXNlIG5vdGUgdGhhdCB0aGlzIGVudmlyb25tZW50IHdpbGwgYmUgdGhlIHNhbWUgYXMgdGhlIG9uZSB1c2VkIGJ5IE9wZW5BSSBHUFQtNCBBZHZhbmNlZCBEYXRhIEFuYWx5c2lzIChvciBDb2RlIEludGVycHJldGVyKS4gQWx0aG91Z2ggaXQgaXMgZXhwZWN0ZWQgdGhhdCBtb3N0IEFQSXMgYXJlIHN0YWJsZSwgaXQgaXMgc2FmZXIgdG8gdXNlIGNvbnNpc3RlbnQgbGlicmFyeSB2ZXJzaW9ucy4gWW91IGFyZSBlbmNvdXJhZ2VkIHRvIHVzZSBtb3JlIGxpYnJhcmllcyBjb3ZlcmVkIGluIHRoZSByZXF1aXJlbWVudHMudHh0IHRvIGVucmljaCBlYWNoIHNhbXBsZS4KCiMjIEFubm90YXRpb24gR29hbAoKVGhlIGdvYWwgaXMgdG86ClJlZmluZSB0aGUgZnVuY3Rpb24sIGluY2x1ZGluZyBpdHMgZG9jc3RyaW5ncyBpbiBvcmRlciB0byBtYWtlIHRoZSBmdW5jdGlvbiBtb3JlIHJlYWxpc3RpYyBhbmQgbGVzcyBhbWJpZ3VvdXMuIFRoaXMgbWVhbnMgd2hlbiB5b3Ugc2VlIHRoZSBmdW5jdGlvbiBzdHViIGFuZCBkb2NzdHJpbmcsIHlvdSBzaG91bGQgYmUgYWJsZSB0byBpbXBsZW1lbnQgZXhhY3RseSB0aGUgc2FtZSBmdW5jdGlvbmFsaXR5IHdpdGggdGhlIGdpdmVuIGZ1bmN0aW9uIGJvZHkuIEFkZCBtb3JlIGxpYnJhcnkgQVBJcyBpZiBuZWNlc3Nhcnk7CiBXcml0ZSBhZGRpdGlvbmFsIGJsYWNrIGJveCB1bml0IHRlc3RzIHRvIGVuc3VyZSB0aGUgZnVuY3Rpb25hbCBjb3JyZWN0bmVzcyBvZiB0aGUgZ2l2ZW4gZnVuY3Rpb24uIFlvdSBzaG91bGQgY29uc2lkZXIgYXMgbWFueSBjb3JuZXIgY2FzZXMgYXMgcG9zc2libGUuCgojIyBFeHBlY3RlZCBBbm5vdGF0aW9uCgpZb3UgYXJlIGdpdmVuIGEgUHl0aG9uIHNjcmlwdCB0byBleGVjdXRlIGFuZCBhbm5vdGF0ZS4KCldlIGRlZmluZSB0aGUgZm9sbG93aW5nIHRlcm1zOgogYFByb2dyYW1taW5nIFByb2JsZW1gIGNvbnRhaW5zIHRocmVlIHBhcnRzOgpbU3RhbmRhbG9uZV0gYEltcG9ydCBTdGF0ZW1lbnRgClRoZSBpbXBvcnRlZCBsaWJyYXJpZXMsIHN1Ym1vZHVsZXMgb3IgZnVuY3Rpb25zIHNob3VsZCBiZSB1c2VkIGluIHRoZSBmb2xsb3dpbmcgZnVuY3Rpb24gaW1wbGVtZW50YXRpb24uCmFkZCBtaXNzaW5nIGxpYnJhcmllcywgc3VibW9kdWxlcyBvciBmdW5jdGlvbnMgaWYgb25lIGlzIHVzZWQgYnV0IG5vdCBpbXBvcnRlZC4KYFByb2JsZW0gRnVuY3Rpb25gCmBGdW5jdGlvbiBTaWduYXR1cmVgIGFuZCBpdHMgY29ycmVzcG9uZGluZyBgRG9jc3RyaW5nYApUaGUgYEZ1bmN0aW9uIE5hbWVgIHNob3VsZCBiZSBvYmZ1c2NhdGVkIGluIHRoZSBmb3JtYXQgb2YgYGZfW05VTUJFUl1gIHRvIGVuc3VyZSBhbm9ueW1pdHkuIFtOVU1CRVJdIHNob3VsZCBiZSB0aGUgb25lIGluc2lkZSB0aGUgZmlsZSBuYW1lLgpUaGUgZG9jc3RyaW5ncyAoZXhhbXBsZSBjYW4gYmUgZm91bmQgYXQgR29vZ2xlIFB5dGhvbiBTdHlsZSBHdWlkZSkgc2hvdWxkIGNvbnRhaW46CkEgYEZ1bmN0aW9uYWxpdHkgRGVzY3JpcHRpb25gLgpgRnVuY3Rpb24gUGFyYW1ldGVyc2AgYW5kIHRoZWlyIGBGdW5jdGlvbiBQYXJhbWV0ZXJzIERlc2NyaXB0aW9uc2AuCjItMyBgUnVubmluZyBFeGFtcGxlc2AgaW4gUHl0aG9uIEludGVycHJldGVyIGFuZCB0aGVpciBleHBlY3RlZCBvdXRwdXRzLgpgU29sdXRpb25gClRoZSBmdW5jdGlvbiBpbXBsZW1lbnRhdGlvbiB0byBmdWxmaWwgdGhlIGZ1bmN0aW9uYWxpdHkgZGVzY3JpYmVkIGluIHRoZSBgRG9jc3RyaW5nYC4KYFRlc3QgU3VpdGVgIGNvbnRhaW5zIHRocmVlIHBhcnRzOgpbU3RhbmRhbG9uZV0gYEltcG9ydCBTdGF0ZW1lbnRgClRoZSBpbXBvcnRlZCBsaWJyYXJpZXMsIHN1Ym1vZHVsZXMgb3IgZnVuY3Rpb25zIHNob3VsZCBiZSB1c2VkIGluIHRoZSBmb2xsb3dpbmcgdGVzdHMuCltTdGFuZGFsb25lXSBgVGVzdENhc2VzYCBjbGFzcwpUaGUgY2xhc3Mgc2hvdWxkIGNvbnRhaW4gYXQgbGVhc3QgZml2ZSBkaXN0aW5jdCB0ZXN0IGNhc2VzLgpUaGUgdGVzdCBjYXNlcyBzaG91bGQgYmUgYWxpZ25lZCB3aXRoIHRoZSBkb2NzdHJpbmcgZGVzY3JpcHRpb24uIFRlc3QgY2FzZXMgc2hvdWxkIG5vdCBhc3NlcnQgYW55IGF0dHJpYnV0ZXMgd2hpY2ggYXJlIG5vdCBzcGVjaWZpY2FsbHkgbWVudGlvbmVkLgpUaGUgdGVzdCBjYXNlcyBzaG91bGQgY292ZXIgYXMgbWFueSBicmFuY2hlcyBpbiB0aGUgYFByb2JsZW0gRnVuY3Rpb25gIGFzIHBvc3NpYmxlLiBJbiBvcmRlciB0byBnZXQgdGhlIGNvbXBsZXRlIGNvdmVyYWdlLCB5b3Ugc2hvdWxkIHVzZSB0aGUgY29tbWFuZCBgY292ZXJhZ2UgcnVuIC1tIHVuaXR0ZXN0IGZfW05VTUJFUl1fW05BTUVdLnB5ICYmIGNvdmVyYWdlIHJlcG9ydCAtbWAuIFJlcGxhY2UgdGhlIGBmX1tOVU1CRVJdX1tOQU1FXS5weWAgd2l0aCB0aGUgZmlsZSBuYW1lIHlvdSBhcmUgdGVzdGluZyB3aXRoLiBJZ25vcmUgdGhlIG1pc3NpbmcgbGluZXMgaW4gdGhlIGBUZXN0IFN1aXRlYC4KYFByb2dyYW1taW5nIFByb2JsZW1gIHNob3VsZCBiZSBhYmxlIHRvIHBhc3MgYWxsIHRoZXNlIHRlc3QgY2FzZXMuIFRoaXMgbWVhbnMgdGhlIHNjcmlwdHMgc2hvdWxkIHJ1biBzdWNjZXNzZnVsbHkgd2l0aG91dCBhbnkgZmFpbGVkIHRlc3QgY2FzZXMgd2hlbiB5b3UgcnVuIGBweXRob24gWFhYLnB5YCBpbiB0aGUgdGVybWluYWwuCltTdGFuZGFsb25lXSBgcnVuX3Rlc3RzYCBmdW5jdGlvbgpUaGUgZnVuY3Rpb24gc2hvdWxkIG9ubHkgY29udGFpbiB0aGUgY29kZSBoZWxwaW5nIHRvIGV4ZWN1dGUgdGhlIHRlc3QgY2FzZXMuCgojIyBJc3N1ZXMgVG8gQmUgQWRkcmVzc2VkCgpZb3UgbWF5IG5vdGljZSB0aGUgZXhpc3RlbmNlIG9mIHRoZSBmb2xsb3dpbmcgaXNzdWVzIGluIHRoZSBnaXZlbiBQeXRob24gc2NyaXB0OgpgRnVuY3Rpb24gTmFtZWAgaGFzIG5vdCBiZWVuIG9iZnVzY2F0ZWQuClJlcGxhY2UgdGhlIG5hbWUgd2l0aCBgZmAuCmBEb2NzdHJpbmdgIGlzIHVuY2xlYXIsIGFtYmlndW91cywgIGltcHJhY3RpY2FsIG9yIG5vdCB3ZWxsIGFsaWduZWQgd2l0aCBgU29sdXRpb25gLgpgRnVuY3Rpb24gRGVzY3JpcHRpb25gIHNob3VsZCBkZXNjcmliZSBhIHByYWN0aWNhbCBmdW5jdGlvbmFsaXR5LgpZb3Ugc2hvdWxkIGVpdGhlciByZWZpbmUgdGhlIGBGdW5jdGlvbiBEZXNjcmlwdGlvbmAgb3IgIGBTb2x1dGlvbmAuIENob29zZSB0aGUgb25lIG1vcmUgZmVhc2libGUgdG8gYmUgZG9uZS4KTWFrZSBzdXJlIGF0IGxlYXN0IDIgY29ycmVjdCBgUnVubmluZyBFeGFtcGxlc2AgYXJlIGluY2x1ZGVkLgpgU29sdXRpb25gIGRvZXMgbm90IHVzZSBhbGwgaW1wb3J0ZWQgbGlicmFyaWVzIG9yIEFQSXMuClRyeSB0byByZWZpbmUgdGhlIGBQcm9ncmFtbWluZyBQcm9ibGVtYCBzbyB0aGF0IHRoZSBgRnVuY3Rpb24gRGVzY3JpcHRpb25gIGltcGxpZXMgdGhlIGNvcnJlc3BvbmRpbmcgQVBJIHVzYWdlIGFuZCBzdWNoIEFQSXMgYXJlIGNvcnJlY3RseSBpbnZva2VkIGluIGBTb2x1dGlvbmAuCklmIChhKSBpcyBkaWZmaWN1bHQgdG8gY29tcGxldGUsIHJlbW92ZSB0aGUgdW51c2VkIGltcG9ydCBzdGF0ZW1lbnRzLgpgU29sdXRpb25gIHVzZXMgQVBJcyB0aGF0IGFyZSBub3QgaW5jbHVkZWQgaW4gYEltcG9ydCBTdGF0ZW1lbnRgLgpBZGQgdGhlIGNvcnJlc3BvbmRpbmcgaW1wb3J0IHN0YXRlbWVudHMgaWYgdGhlc2UgQVBJcyBhcmUgbmVjZXNzYXJ5IHRvIGNvbXBsZXRlIHRoZSBmdW5jdGlvbmFsaXR5LiBPdGhlcndpc2UsIHJlZmluZSBgRnVuY3Rpb24gRGVzY3JpcHRpb25gIHNvIHRoYXQgdGhlIGZ1bmN0aW9uYWxpdHkgd2lsbCByZXF1aXJlIHN1Y2ggQVBJcy4KYFNvbHV0aW9uYCB1c2VzIGxlc3MgdGhhbiAyIGxpYnJhcmllcy4KWW91IHNob3VsZCByZWZpbmUgYFByb2dyYW1taW5nIFByb2JsZW1gIHNvIHRoYXQgdGhlIGZ1bmN0aW9uYWxpdHkgbXVzdCByZXF1aXJlIHRoZSBBUEkgdXNhZ2UgYW5kIGludm9rZSBBUElzIGZyb20gYXQgbGVhc3QgMiBkaXN0aW5jdCBsaWJyYXJpZXMuIFlvdSBjYW4gdXNlIENoYXRHUFQgKEdQVC00KSBpbiBBZHZhbmNlZCBEYXRhIEFuYWx5c2lzIGZvciBpbnNwaXJhdGlvbi4KYFNvbHV0aW9uYCB1c2VzIEFQSXMgaW4gYHJhbmRvbWAgb3IgdGhlIHJhbmRvbSBmdW5jdGlvbmFsaXR5LgpJbml0aWFsaXplIHRoZSByYW5kb20gc2VlZCBmb3IgZWFjaCBgVGVzdENhc2VzYCB0byBjb250cm9sIHRoZSBiZWhhdmlvci4KYFNvbHV0aW9uYCBjb250YWlucyBkdW1teSBjb2RlLgpCYXNlZCBvbiB5b3VyIHVuZGVyc3RhbmRpbmcsIHJlcGxhY2UgdGhlIGR1bW15IGNvZGUgd2l0aCB0aGUgYWN0dWFsIGltcGxlbWVudGF0aW9uIG9mIGVhY2ggcGFydC4KYFNvbHV0aW9uYCBjb250YWlucyB0aGUgZGlzcGxheSBmdW5jdGlvbmFsaXR5LCBzdWNoIGFzIGBwcmludCgpYCBhbmQgYG1hdHBsb3RsaWIucHlwbHQuc2hvdygpYC4KSWYgdGhlIGZ1bmN0aW9uIHJlcXVpcmVzIHlvdSB0byB3cml0ZSBvciBzaG93IHNvbWUgZGF0YSwgeW91IHNoYWxsIGVpdGhlciByZXR1cm4gdGhlIGRhdGEgb3IgbWFrZSB0aGUgZnVuY3Rpb24gdGFrZSBhIHBhdGggZm9yIGZpbGUgc3RvcmFnZSBvciBhIHZhcmlhYmxlIGZvciBkYXRhIHZpc3VhbGl6YXRpb24uIEZvciBleGFtcGxlLCBpZiB0aGUgZnVuY3Rpb24gcmVxdWlyZXMgeW91IHRvIHNob3cgYSBwbG90LCB5b3UgbXVzdCByZXR1cm4gdGhlIHBsb3QgKHZpYSBBeGVzKS4gSWYgdGhlcmUgaXMgYSBzcGVjaWZpYyBhdHRyaWJ1dGUgaW5zaWRlIHRoZSBvYmplY3QsIHlvdSBzaG91bGQgbWVudGlvbiBpdCBpbiB0aGUgYERvY3N0cmluZ2AgYW5kIHRlc3QgaXQgaW5zaWRlIGBUZXN0Q2FzZXNgLiBGb3IgZXhhbXBsZSwgdGhlIHBsb3QgY29udGFpbnMgdGhlIHNwZWNpZmljIHRpdGxlIG9yIGxhYmVsIG5hbWVzLiBZb3Ugc2hvdWxkIG1ha2Ugc3VyZSB0aGF0IHRoZXNlIGF0dHJpYnV0ZXMgYXJlIGVpdGhlciBzdGF0ZWQgaW4gYERvY3N0cmluZ2Agb3IgaW1wbGllZCBieSBgRG9jc3RyaW5nYC4KSWYgdGhlIGZ1bmN0aW9uIHJlcXVpcmVzIGNoZWNraW5nIHNvbWUgcHJvcGVydGllcyBhbmQgdXNlcyBgcHJpbnQoKWAgdG8gc2hvdyB0aGUgcmVzdWx0cywgeW91IG5lZWQgdG8gbW9kaWZ5IHRoaXMgZnVuY3Rpb24gdG8gcmV0dXJuIHRoZXNlIHJlc3VsdHMuIFRoZSByZXZpc2VkIGZ1bmN0aW9uIHNob3VsZCBhbWFsZ2FtYXRlIHRoZXNlIHByb3BlcnRpZXMgd2l0aCB0aGUgcHJlZXhpc3RpbmcgcmV0dXJuIHZhbHVlcywgdGhlcmVieSBmYWNpbGl0YXRpbmcgbW9yZSB2ZXJzYXRpbGUgdXRpbGl6YXRpb24gb2YgdGhlIG91dHB1dHMgaW4gdGhlIHJlc3Qgb2YgeW91ciBjb2RlLgpSZWZlciB0byBTdGVwMyBpbiB0aGUgZ3VpZGVsaW5lcyBvZiB0aGUgcHJldmlvdXMgc3RhZ2UuCgpHbG9iYWwgY29uc3RhbnRzIGJlZm9yZSBgUHJvYmxlbSBGdW5jdGlvbmAuCklmIHRoZSBnbG9iYWwgY29uc3RhbnRzIGFyZSB1c2VkIGFzIHNhbXBsZSBpbnB1dHMgaW4gdGhlIGBTb2x1dGlvbmAsIHJlbW92ZSB0aGVtIGFuZCB3cml0ZSB5b3VyIG93biB0ZXN0IGlucHV0IGluIGBUZXN0Q2FzZXNgLgpJZiB0aGUgZ2xvYmFsIGNvbnN0YW50cyBhcmUgdW51c2VkLCByZW1vdmUgdGhlbSBkaXJlY3RseS4KIFRlc3QgY2FzZXMgaW5zaWRlIGBUZXN0Q2FzZXNgIG9ubHkgY2hlY2sgdGhlIHJhbmdlIG9mIHJldHVybmVkIHJlc3VsdHMgb3IgZmFpbCB0byB0ZXN0IGluIGEgc3BlY2lmaWMgd2F5LgpJdCBhc3N1bWVzIHRoYXQgeW91IG5vdyBoYXZlIGZ1bGwgY29udHJvbCBvZiBgUHJvZ3JhbW1pbmcgUHJvYmxlbWAuIFdyaXRlIHRoZSB0ZXN0IGNhc2VzIHRvIHZhbGlkYXRlIGlmIHRoZSByZXR1cm5lZCByZXN1bHRzIGFyZSBlcXVhbCB0byBjZXJ0YWluIHZhbHVlcy4gRm9yIHRoZSByZXR1cm5lZCBvYmplY3RzLCB2YWxpZGF0ZSBpZiB0aGUgYXR0cmlidXRlcyBhcmUgZXF1YWwgdG8gY2VydGFpbiB2YWx1ZXMuClRlc3QgY2FzZXMgZG8gbm90IHVzZSBhbnkgZGV0ZXJtaW5pc3RpYyB2YWx1ZXMgYXMgZXhwZWN0ZWQgb3V0cHV0cy4KQ29tZSB1cCB3aXRoIHRoZSBleHBlY3RlZCBvdXRwdXRzIGFmdGVyIHRlc3RpbmcuCmBUZXN0Q2FzZXNgIHVzZXMgbGlicmFyaWVzIG9yIEFQSXMgdGhhdCBhcmUgbm90IGluY2x1ZGVkIGluIGBJbXBvcnQgU3RhdGVtZW50YC4KQWRkIHRoZSBjb3JyZXNwb25kaW5nIGltcG9ydCBzdGF0ZW1lbnRzIGlmIHRoZXNlIEFQSXMgYXJlIG5lY2Vzc2FyeSB0byBjb21wbGV0ZSB0aGUgdGVzdGluZy4gT3RoZXJ3aXNlLCByZW1vdmUgc3VjaCBBUElzLgpgVGVzdENhc2VzYCBjb250YWlucyB0ZXN0IGNhc2VzIHRoYXQgZG8gbm90IHdvcmsgZm9yIGBTb2x1dGlvbmAuClJlcGFpciB0aGVzZSB0ZXN0IGNhc2VzIG9yIHJlcGxhY2UgdGhlbSB3aXRoIGJldHRlciBjYXNlcy4KIGBUZXN0Q2FzZXNgIGRvZXMgbm90IHRlc3QgYWxsIGF0dHJpYnV0ZXMgb2YgdGhlIHJldHVybmVkIG9iamVjdCwgd2hlcmUgdGhlc2UgYXR0cmlidXRlcyBhcmUgaW1wbGllZCBieSBgRnVuY3Rpb24gRGVzY3JpcHRpb25gIG9yIGNvbXBsZXRlZCBieSBgU29sdXRpb25gLgpBZGQgbGluZXMgb2YgY29kZSB0byB0ZXN0IHRoZXNlIGF0dHJpYnV0ZXMuCklmIHRoZXNlIGF0dHJpYnV0ZXMgYXJlIG5vdCBtZW50aW9uZWQgb3IgaW1wbGllZCBieSBgRnVuY3Rpb24gRGVzY3JpcHRpb25gLCB0cnkgdG8gZGVzY3JpYmUgdGhlbSBpbiBgRnVuY3Rpb24gRGVzY3JpcHRpb25gLgpgVGVzdENhc2VzYCBkb2VzIG5vdCB0ZXN0IHRoZSBmaWxlcyB0aGF0IHJlc3VsdCBpbiBgU29sdXRpb25gLgpTb21lIGZpbGVzIGFyZSBjcmVhdGVkIGR1cmluZyB0aGUgZXhlY3V0aW9uIG9mIGBQcm9ncmFtbWluZyBQcm9ibGVtYC4gQWRkIG5lY2Vzc2FyeSBsaW5lcyBvZiBjb2RlIHRvIHRlc3QgdGhlIGF0dHJpYnV0ZXMgb2YgdGhlc2UgZmlsZXMgaW4gZWFjaCB0ZXN0IGNhc2UuCiBgVGVzdENhc2VzYCBpcyB3cmFwcGVkIGluIGBydW5fdGVzdHNgLgpTZXBhcmF0ZSB0aGVzZSB0d28uCiBUZXN0IGNhc2VzIGluIGBUZXN0Q2FzZXNgIGFyZSBkdXBsaWNhdGVkIG9yIHVzZWQgdG8gdGVzdCB0aGUgc2FtZSBiZWhhdmlvci4KUmVtb3ZlIHRoZW0gaWYgdGhlcmUgaXMgYSBodWdlIG92ZXJsYXAuIFJlcGxhY2UgdGhlbSB3aXRoIG1vcmUgY29tcGxleCB0ZXN0IGNhc2VzLiBNYWtlIHN1cmUgdGhhdCBhdCBsZWFzdCBmaXZlIHRlc3QgY2FzZXMgYXJlIGluY2x1ZGVkLgogVGVzdCBkYXRhIHVzZWQgaW4gYFRlc3RDYXNlc2AgaXMgbWlzc2luZy4KWW91IG5lZWQgdG8gbWFudWFsbHkgZGVzaWduIHRoZSBkYXRhIG9yIHV0aWxpemUgM3JkIHBhcnR5IGxpYnJhcmllcyBhbmQgd2Vic2l0ZXMgKGUuZy4gYEZha2VyYCBhbmQgYHVuaXR0ZXN0Lm1vY2tgKSB0byBnZW5lcmF0ZSBvciBtb2NrIHRoZSB0ZXN0IGRhdGEuIFJlZmVyIHRvIFN0ZXA0IGluIHRoZSBndWlkZWxpbmVzIG9mIHByZXZpb3VzIHN0YWdlLgoKIExhY2sgb2YgcmV0dXJuIHZhbHVlLgpGdW5jdGlvbnMgc2hvdWxkIGhhdmUgY2xlYXIgcmV0dXJuIHZhbHVlcyB0byBpbmRpY2F0ZSB0aGUgcmVzdWx0LCBhbmQgdGhlc2Ugc2hvdWxkIGJlIHRlc3RlZCBpbiB0aGUgYFRlc3RDYXNlc2AuCiBMYWNrIG9mIGNvcm5lciBjYXNlcy4KQ29ybmVyIGNhc2VzIHNob3VsZCBiZSBjb25zaWRlcmVkIGluIHRoZSBmdW5jdGlvbiBvciBpbiB0aGUgdGVzdCBjYXNlcy4KIExhY2sgb2YgZXJyb3IgaGFuZGxpbmc6CllvdSBzaG91bGQgYWRkIG5lY2Vzc2FyeSBjaGVja3MgZm9yIG51bGwgaW5wdXRzLCBpbmNvcnJlY3QgZGF0YSB0eXBlcywgb3IgdmFsdWVzIG91dCBvZiBleHBlY3RlZCByYW5nZXMgdG8gZGVhbCB3aXRoIGluY29ycmVjdCBpbnB1dCBmb3JtYXQuCgojIyBGdXJ0aGVyIEV4cGxhbmF0aW9uIG9mIEVhY2ggSXNzdWUKCjEuIGBGdW5jdGlvbiBOYW1lYCBoYXMgbm90IGJlZW4gb2JmdXNjYXRlZDoKICAgIC0gVGhlIGdpdmVuIGZ1bmN0aW9uIHNob3VsZCBoYXZlIGEgZ2VuZXJpYyBuYW1lIHN1Y2ggYXMgYGZgIHRvIGVuc3VyZSBhbm9ueW1pdHkuIFRoaXMgcHJldmVudHMgdGhlIHVzZXIgZnJvbSBpbmZlcnJpbmcgdGhlIGZ1bmN0aW9uJ3MgcHVycG9zZSBiYXNlZCBvbiBpdHMgbmFtZS4KICAgIC0gRXhhbXBsZToKICAgICAgQmVmb3JlOiBgZGVmIGNhbGN1bGF0ZV9hdmVyYWdlKG51bXMpOmAKICAgICAgQWZ0ZXI6IGBkZWYgZihudW1zKTpgCgoyLiBgRG9jc3RyaW5nYCBpcyB1bmNsZWFyLCBhbWJpZ3VvdXMsIGltcHJhY3RpY2FsIG9yIG5vdCB3ZWxsIGFsaWduZWQgd2l0aCBgU29sdXRpb25gOgogICAgLSBUaGUgZnVuY3Rpb24ncyBkb2NzdHJpbmcgc2hvdWxkIHByb3ZpZGUgYSBjbGVhciBhbmQgY29uY2lzZSBkZXNjcmlwdGlvbiBvZiBpdHMgcHVycG9zZSwgZXhwZWN0ZWQgaW5wdXRzLCBvdXRwdXRzLCBhbmQgZXhhbXBsZXMgb2YgdXNhZ2UuIElmIHRoZSBkZXNjcmlwdGlvbiBpcyB2YWd1ZSBvciBkb2Vzbid0IG1hdGNoIHRoZSBmdW5jdGlvbidzIGJlaGF2aW9yLCBpdCBjYW4gbGVhZCB0byBjb25mdXNpb24uCiAgICAtIEV4YW1wbGU6CiAgICAgIEJlZm9yZTogYCIiIkNhbGN1bGF0ZXMgc29tZXRoaW5nLiIiImAKICAgICAgQWZ0ZXI6IGAiIiJDYWxjdWxhdGVzIHRoZSBhdmVyYWdlIG9mIGEgbGlzdCBvZiBudW1iZXJzLiIiImAKCjMuIGBTb2x1dGlvbmAgZG9lcyBub3QgdXNlIGFsbCBpbXBvcnRlZCBsaWJyYXJpZXMgb3IgQVBJczoKICAgIC0gSWYgbGlicmFyaWVzIGFyZSBpbXBvcnRlZCBidXQgbm90IHVzZWQgaW4gdGhlIGZ1bmN0aW9uLCBpdCBpbmRpY2F0ZXMgcmVkdW5kYW50IGNvZGUgb3IgYSBtaXNtYXRjaCBiZXR3ZWVuIHRoZSBwcm9ibGVtIGRlc2NyaXB0aW9uIGFuZCB0aGUgc29sdXRpb24uCiAgICAtIEV4YW1wbGU6CiAgICAgIEJlZm9yZTogYGltcG9ydCBtYXRoYCAoYnV0IG5vIHVzYWdlIG9mIGBtYXRoYCBpbiB0aGUgZnVuY3Rpb24pCiAgICAgIEFmdGVyOiBSZW1vdmUgYGltcG9ydCBtYXRoYCBvciBlbnN1cmUgaXQncyB1c2VkIGluIHRoZSBmdW5jdGlvbi4KCjQuIGBTb2x1dGlvbmAgdXNlcyBBUElzIHRoYXQgYXJlIG5vdCBpbmNsdWRlZCBpbiBgSW1wb3J0IFN0YXRlbWVudGA6CiAgICAtIEFsbCBleHRlcm5hbCBsaWJyYXJpZXMgb3IgZnVuY3Rpb25zIHVzZWQgaW4gdGhlIHNvbHV0aW9uIHNob3VsZCBiZSBpbXBvcnRlZCBhdCB0aGUgYmVnaW5uaW5nIG9mIHRoZSBzY3JpcHQgdG8gZW5zdXJlIHRoZSBjb2RlIHJ1bnMgd2l0aG91dCBlcnJvcnMuCiAgICAtIEV4YW1wbGU6CiAgICAgIElmIHVzaW5nIGBzcXJ0YCBmcm9tIGBtYXRoYCBsaWJyYXJ5IGluIHRoZSBmdW5jdGlvbiwgZW5zdXJlIGBmcm9tIG1hdGggaW1wb3J0IHNxcnRgIGlzIHByZXNlbnQgYXQgdGhlIGJlZ2lubmluZy4KCjUuIGBTb2x1dGlvbmAgZG9lcyBub3QgdXNlIGFueSBsaWJyYXJ5IEFQSXM6CiAgICAtIFRoZSBwcm9ibGVtIHNob3VsZCBiZSBkZXNpZ25lZCBpbiBhIHdheSB0aGF0IHJlcXVpcmVzIHRoZSB1c2FnZSBvZiBsaWJyYXJ5IEFQSXMgdG8gc29sdmUgaXQsIGVuc3VyaW5nIHRoZSBjaGFsbGVuZ2Ugb2YgaW50ZWdyYXRpbmcgZXh0ZXJuYWwgdG9vbHMuCiAgICAtIEV4YW1wbGU6CiAgICAgIElmIHRoZSBwcm9ibGVtIGlzIHRvIGNhbGN1bGF0ZSB0aGUgc3F1YXJlIHJvb3QsIHRoZSBzb2x1dGlvbiBzaG91bGQgbGV2ZXJhZ2UgdGhlIGBtYXRoLnNxcnRgIGZ1bmN0aW9uLgoKNi4gYFNvbHV0aW9uYCB1c2VzIEFQSXMgaW4gYHJhbmRvbWAsIGJ1dCBkb2VzIG5vdCBwYXNzIGEgcmFuZG9tIHNlZWQgdG8gYEZ1bmN0aW9uIFBhcmFtZXRlcnNgOgogICAgLSBXaGVuIHVzaW5nIHJhbmRvbSBmdW5jdGlvbmFsaXRpZXMsIGZvciByZXByb2R1Y2liaWxpdHksIGl0J3MgZ29vZCBwcmFjdGljZSB0byBhbGxvdyB0aGUgdXNlciB0byBzZXQgYSBzZWVkLgogICAgLSBFeGFtcGxlOgogICAgICBCZWZvcmU6IGByYW5kb20ucmFuZGludCgxLDEwKWAKICAgICAgQWZ0ZXI6IGByYW5kb20uc2VlZChzZWVkKTsgcmFuZG9tLnJhbmRpbnQoMSwxMClgCgo3LiBgU29sdXRpb25gIGNvbnRhaW5zIGR1bW15IGNvZGU6CiAgICAtIFBsYWNlaG9sZGVyIG9yIGR1bW15IGNvZGUgc2hvdWxkIGJlIHJlcGxhY2VkIHdpdGggYWN0dWFsIGltcGxlbWVudGF0aW9uIHRvIGVuc3VyZSB0aGUgZnVuY3Rpb24gd29ya3MgYXMgZXhwZWN0ZWQuCiAgICAtIEV4YW1wbGU6CiAgICAgIEJlZm9yZTogYCMgVE9ETzogSW1wbGVtZW50IHRoaXNgCiAgICAgIEFmdGVyOiBBY3R1YWwgaW1wbGVtZW50YXRpb24gb2YgdGhlIHJlcXVpcmVkIGxvZ2ljLgoKOC4gVW51c2VkIGdsb2JhbCBjb25zdGFudHMgYmVmb3JlIGBQcm9ibGVtIEZ1bmN0aW9uYDoKICAgIC0gQW55IGNvbnN0YW50cyBvciB2YXJpYWJsZXMgdGhhdCBhcmUgbm90IHVzZWQgaW4gdGhlIHNvbHV0aW9uIHNob3VsZCBiZSByZW1vdmVkIHRvIGNsZWFuIHVwIHRoZSBjb2RlLgoKOS4gYFRlc3RDYXNlc2AgdXNlcyBsaWJyYXJpZXMgb3IgQVBJcyB0aGF0IGFyZSBub3QgaW5jbHVkZWQgaW4gYEltcG9ydCBTdGF0ZW1lbnRgOgogICAgLSBTaW1pbGFyIHRvIHRoZSBzb2x1dGlvbiwgYWxsIGV4dGVybmFsIGxpYnJhcmllcyBvciBmdW5jdGlvbnMgdXNlZCBpbiB0aGUgdGVzdCBjYXNlcyBzaG91bGQgYmUgaW1wb3J0ZWQuCgoxMC4gYFRlc3RDYXNlc2AgY29udGFpbnMgdGVzdCBjYXNlcyB0aGF0IGRvIG5vdCB3b3JrIGZvciBgU29sdXRpb25gOgogICAgLSBBbGwgdGVzdCBjYXNlcyBzaG91bGQgYmUgYWxpZ25lZCB3aXRoIHRoZSBmdW5jdGlvbidzIGJlaGF2aW9yIHRvIGVuc3VyZSB0aGV5IHRlc3QgdGhlIGZ1bmN0aW9uIGNvcnJlY3RseS4KCjExLiBgVGVzdENhc2VzYCBkb2VzIG5vdCB0ZXN0IGFsbCBhdHRyaWJ1dGVzIG9mIHRoZSByZXR1cm5lZCBvYmplY3Q6CiAgICAtIElmIHRoZSBmdW5jdGlvbiByZXR1cm5zIGFuIG9iamVjdCB3aXRoIG11bHRpcGxlIGF0dHJpYnV0ZXMgb3IgbWV0aG9kcywgdGhlIHRlc3QgY2FzZXMgc2hvdWxkIHZhbGlkYXRlIGFsbCBvZiB0aGVtIHRvIGVuc3VyZSBjb21wbGV0ZSBjb3ZlcmFnZS4gRm9yIGV4YW1wbGUsIHdoZW4gcGxvdHRpbmcgZGF0YSBvbiBhIGdyYXBoLCB5b3UgbWlnaHQgZ2V0IGFuIGBBeGVzU3VicGxvdGAgb2JqZWN0IGluIHJldHVybi4gVGhpcyBvYmplY3QgaGFzIHZhcmlvdXMgYXR0cmlidXRlcywgbGlrZSB0aGUgdGl0bGUsIHgtbGFiZWwsIHktbGFiZWwsIGFuZCB0aGUgZGF0YSBwb2ludHMgdGhlbXNlbHZlcy4gWW91IHNob3VsZCB0ZXN0IGFsbCBvZiB0aGVzZSBhdHRyaWJ1dGVzIGlmIHRoZXkgYXJlIHJlcXVpcmVkIGluIHRoZSBmdW5jdGlvbmFsaXR5LgoKMTIuIGBUZXN0Q2FzZXNgIGRvZXMgbm90IHRlc3QgdGhlIGZpbGVzIHRoYXQgcmVzdWx0IGluIGBTb2x1dGlvbmA6CiAgICAtIElmIHRoZSBmdW5jdGlvbiBjcmVhdGVzIG9yIG1vZGlmaWVzIGZpbGVzLCB0aGUgdGVzdCBjYXNlcyBzaG91bGQgdmFsaWRhdGUgdGhlc2UgZmlsZXMgdG8gZW5zdXJlIHRoZSBmdW5jdGlvbiB3b3JrcyBhcyBleHBlY3RlZC4KCjEzLiBgVGVzdENhc2VzYCBpcyB3cmFwcGVkIGluIGBydW5fdGVzdHNgOgogICAgLSBUaGUgdGVzdCBjYXNlcyBhbmQgdGhlIGZ1bmN0aW9uIHRvIHJ1biB0aGVtIHNob3VsZCBiZSBzZXBhcmF0ZWQgZm9yIGNsYXJpdHkuCgoxNC4gVGVzdCBjYXNlcyBpbiBgVGVzdENhc2VzYCBhcmUgZHVwbGljYXRlZCBvciB1c2VkIHRvIHRlc3QgdGhlIHNhbWUgYmVoYXZpb3I6CiAgICAtIFJlZHVuZGFudCB0ZXN0IGNhc2VzIHNob3VsZCBiZSByZW1vdmVkIHRvIGtlZXAgdGhlIHRlc3Qgc3VpdGUgY29uY2lzZSBhbmQgZm9jdXNlZC4KCjE1LiBUZXN0IGRhdGEgdXNlZCBpbiBgVGVzdENhc2VzYCBpcyBtaXNzaW5nOgogICAgLSBBbGwgcmVxdWlyZWQgZGF0YSBmb3IgdGVzdGluZyBzaG91bGQgYmUgcHJvdmlkZWQgb3IgZ2VuZXJhdGVkIHRvIGVuc3VyZSB0aGUgdGVzdCBjYXNlcyBjYW4gcnVuIHdpdGhvdXQgaXNzdWVzLgo=" download="">⬇</a></div>
<div id="lstnumberx540" class="ltx_listingline">
<span id="lstnumberx540.1" class="ltx_text ltx_font_typewriter">#</span><span id="lstnumberx540.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx540.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Annotation</span><span id="lstnumberx540.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx540.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Guidelines</span>
</div>
<div id="lstnumberx541" class="ltx_listingline">
</div>
<div id="lstnumberx542" class="ltx_listingline">
<span id="lstnumberx542.1" class="ltx_text ltx_font_typewriter">##</span><span id="lstnumberx542.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx542.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Environment</span><span id="lstnumberx542.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx542.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Setup</span>
</div>
<div id="lstnumberx543" class="ltx_listingline">
</div>
<div id="lstnumberx544" class="ltx_listingline">
<span id="lstnumberx544.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx544.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx544.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx544.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx544.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">file</span><span id="lstnumberx544.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">named</span><span id="lstnumberx544.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx544.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requirements</span><span id="lstnumberx544.15" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx544.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">txt</span><span id="lstnumberx544.17" class="ltx_text ltx_font_typewriter">‘,</span><span id="lstnumberx544.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">please</span><span id="lstnumberx544.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">set</span><span id="lstnumberx544.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">up</span><span id="lstnumberx544.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx544.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Python</span><span id="lstnumberx544.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">environment</span><span id="lstnumberx544.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx544.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">version</span><span id="lstnumberx544.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.35" class="ltx_text ltx_font_typewriter">3.8.10.</span><span id="lstnumberx544.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx544.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx544.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx544.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Anaconda</span><span id="lstnumberx544.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx544.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Python</span><span id="lstnumberx544.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Virtual</span><span id="lstnumberx544.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Environment</span><span id="lstnumberx544.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx544.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">this</span><span id="lstnumberx544.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx544.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">purpose</span><span id="lstnumberx544.58" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx545" class="ltx_listingline">
</div>
<div id="lstnumberx546" class="ltx_listingline">
<span id="lstnumberx546.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Use</span><span id="lstnumberx546.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx546.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx546.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx546.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx546.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx546.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">command</span><span id="lstnumberx546.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx546.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx546.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx546.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">install</span><span id="lstnumberx546.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx546.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx546.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx546.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">required</span><span id="lstnumberx546.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx546.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx546.18" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx547" class="ltx_listingline">
<span id="lstnumberx547.1" class="ltx_text ltx_font_typewriter">‘‘‘</span><span id="lstnumberx547.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sh</span>
</div>
<div id="lstnumberx548" class="ltx_listingline">
<span id="lstnumberx548.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pip</span><span id="lstnumberx548.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx548.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">install</span><span id="lstnumberx548.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx548.5" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx548.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">U</span><span id="lstnumberx548.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx548.8" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx548.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">r</span><span id="lstnumberx548.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx548.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requirements</span><span id="lstnumberx548.12" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx548.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">txt</span>
</div>
<div id="lstnumberx549" class="ltx_listingline">
<span id="lstnumberx549.1" class="ltx_text ltx_font_typewriter">‘‘‘</span>
</div>
<div id="lstnumberx550" class="ltx_listingline">
</div>
<div id="lstnumberx551" class="ltx_listingline">
<span id="lstnumberx551.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Please</span><span id="lstnumberx551.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">note</span><span id="lstnumberx551.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx551.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">this</span><span id="lstnumberx551.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">environment</span><span id="lstnumberx551.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">will</span><span id="lstnumberx551.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx551.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx551.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">same</span><span id="lstnumberx551.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx551.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx551.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">one</span><span id="lstnumberx551.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx551.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">by</span><span id="lstnumberx551.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">OpenAI</span><span id="lstnumberx551.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">GPT</span><span id="lstnumberx551.32" class="ltx_text ltx_font_typewriter">-4</span><span id="lstnumberx551.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Advanced</span><span id="lstnumberx551.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Data</span><span id="lstnumberx551.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Analysis</span><span id="lstnumberx551.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.40" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx551.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx551.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Code</span><span id="lstnumberx551.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Interpreter</span><span id="lstnumberx551.46" class="ltx_text ltx_font_typewriter">).</span><span id="lstnumberx551.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Although</span><span id="lstnumberx551.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx551.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx551.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected</span><span id="lstnumberx551.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx551.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">most</span><span id="lstnumberx551.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx551.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx551.63" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">stable</span><span id="lstnumberx551.65" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx551.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx551.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx551.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">safer</span><span id="lstnumberx551.72" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.73" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx551.74" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.75" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx551.76" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.77" class="ltx_text ltx_lst_identifier ltx_font_typewriter">consistent</span><span id="lstnumberx551.78" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.79" class="ltx_text ltx_lst_identifier ltx_font_typewriter">library</span><span id="lstnumberx551.80" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.81" class="ltx_text ltx_lst_identifier ltx_font_typewriter">versions</span><span id="lstnumberx551.82" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx551.83" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.84" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx551.85" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.86" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx551.87" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.88" class="ltx_text ltx_lst_identifier ltx_font_typewriter">encouraged</span><span id="lstnumberx551.89" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.90" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx551.91" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.92" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx551.93" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.94" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx551.95" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.96" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx551.97" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.98" class="ltx_text ltx_lst_identifier ltx_font_typewriter">covered</span><span id="lstnumberx551.99" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.100" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx551.101" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.102" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx551.103" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.104" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requirements</span><span id="lstnumberx551.105" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx551.106" class="ltx_text ltx_lst_identifier ltx_font_typewriter">txt</span><span id="lstnumberx551.107" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.108" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx551.109" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.110" class="ltx_text ltx_lst_identifier ltx_font_typewriter">enrich</span><span id="lstnumberx551.111" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.112" class="ltx_text ltx_lst_identifier ltx_font_typewriter">each</span><span id="lstnumberx551.113" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx551.114" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sample</span><span id="lstnumberx551.115" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx552" class="ltx_listingline">
</div>
<div id="lstnumberx553" class="ltx_listingline">
<span id="lstnumberx553.1" class="ltx_text ltx_font_typewriter">##</span><span id="lstnumberx553.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx553.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Annotation</span><span id="lstnumberx553.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx553.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Goal</span>
</div>
<div id="lstnumberx554" class="ltx_listingline">
</div>
<div id="lstnumberx555" class="ltx_listingline">
<span id="lstnumberx555.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx555.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx555.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">goal</span><span id="lstnumberx555.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx555.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx555.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx555.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx555.8" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx556" class="ltx_listingline">
<span id="lstnumberx556.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Refine</span><span id="lstnumberx556.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx556.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx556.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx556.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">including</span><span id="lstnumberx556.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">its</span><span id="lstnumberx556.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docstrings</span><span id="lstnumberx556.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx556.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">order</span><span id="lstnumberx556.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx556.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx556.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx556.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx556.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx556.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">realistic</span><span id="lstnumberx556.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx556.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">less</span><span id="lstnumberx556.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ambiguous</span><span id="lstnumberx556.35" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx556.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">This</span><span id="lstnumberx556.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">means</span><span id="lstnumberx556.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">when</span><span id="lstnumberx556.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx556.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">see</span><span id="lstnumberx556.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx556.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx556.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">stub</span><span id="lstnumberx556.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx556.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docstring</span><span id="lstnumberx556.56" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx556.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx556.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx556.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx556.63" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">able</span><span id="lstnumberx556.65" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.66" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx556.67" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implement</span><span id="lstnumberx556.69" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">exactly</span><span id="lstnumberx556.71" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.72" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx556.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">same</span><span id="lstnumberx556.75" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.76" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx556.77" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.78" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx556.79" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.80" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx556.81" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.82" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx556.83" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.84" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx556.85" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.86" class="ltx_text ltx_lst_identifier ltx_font_typewriter">body</span><span id="lstnumberx556.87" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx556.88" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.89" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Add</span><span id="lstnumberx556.90" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.91" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx556.92" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.93" class="ltx_text ltx_lst_identifier ltx_font_typewriter">library</span><span id="lstnumberx556.94" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.95" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx556.96" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.97" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx556.98" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx556.99" class="ltx_text ltx_lst_identifier ltx_font_typewriter">necessary</span><span id="lstnumberx556.100" class="ltx_text ltx_font_typewriter">;</span>
</div>
<div id="lstnumberx557" class="ltx_listingline">
<span id="lstnumberx557.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Write</span><span id="lstnumberx557.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">additional</span><span id="lstnumberx557.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">black</span><span id="lstnumberx557.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">box</span><span id="lstnumberx557.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unit</span><span id="lstnumberx557.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tests</span><span id="lstnumberx557.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx557.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx557.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx557.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functional</span><span id="lstnumberx557.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correctness</span><span id="lstnumberx557.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx557.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx557.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx557.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx557.31" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx557.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx557.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx557.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">consider</span><span id="lstnumberx557.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx557.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">many</span><span id="lstnumberx557.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">corner</span><span id="lstnumberx557.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx557.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx557.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx557.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">possible</span><span id="lstnumberx557.50" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx558" class="ltx_listingline">
</div>
<div id="lstnumberx559" class="ltx_listingline">
<span id="lstnumberx559.1" class="ltx_text ltx_font_typewriter">##</span><span id="lstnumberx559.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx559.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Expected</span><span id="lstnumberx559.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx559.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Annotation</span>
</div>
<div id="lstnumberx560" class="ltx_listingline">
</div>
<div id="lstnumberx561" class="ltx_listingline">
<span id="lstnumberx561.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx561.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx561.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx561.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx561.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx561.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx561.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx561.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx561.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Python</span><span id="lstnumberx561.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx561.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">script</span><span id="lstnumberx561.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx561.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx561.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx561.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">execute</span><span id="lstnumberx561.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx561.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx561.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx561.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">annotate</span><span id="lstnumberx561.20" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx562" class="ltx_listingline">
</div>
<div id="lstnumberx563" class="ltx_listingline">
<span id="lstnumberx563.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">We</span><span id="lstnumberx563.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx563.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">define</span><span id="lstnumberx563.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx563.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx563.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx563.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx563.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx563.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">terms</span><span id="lstnumberx563.10" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx564" class="ltx_listingline">
<span id="lstnumberx564.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx564.2" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx564.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Programming</span><span id="lstnumberx564.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx564.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx564.6" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx564.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx564.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx564.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx564.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">three</span><span id="lstnumberx564.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx564.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parts</span><span id="lstnumberx564.13" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx565" class="ltx_listingline">
<span id="lstnumberx565.1" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx565.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Standalone</span><span id="lstnumberx565.3" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx565.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx565.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx565.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Import</span><span id="lstnumberx565.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx565.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Statement</span><span id="lstnumberx565.9" class="ltx_text ltx_font_typewriter">‘</span>
</div>
<div id="lstnumberx566" class="ltx_listingline">
<span id="lstnumberx566.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx566.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx566.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx566.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx566.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">submodules</span><span id="lstnumberx566.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx566.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functions</span><span id="lstnumberx566.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx566.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx566.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx566.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx566.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx566.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx566.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx566.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx566.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx566.29" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx567" class="ltx_listingline">
<span id="lstnumberx567.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">add</span><span id="lstnumberx567.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">missing</span><span id="lstnumberx567.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx567.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx567.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">submodules</span><span id="lstnumberx567.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx567.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functions</span><span id="lstnumberx567.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx567.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">one</span><span id="lstnumberx567.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx567.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx567.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">but</span><span id="lstnumberx567.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx567.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx567.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx567.27" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx568" class="ltx_listingline">
<span id="lstnumberx568.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx568.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx568.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx568.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx568.5" class="ltx_text ltx_font_typewriter">‘</span>
</div>
<div id="lstnumberx569" class="ltx_listingline">
<span id="lstnumberx569.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx569.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx569.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx569.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Signature</span><span id="lstnumberx569.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx569.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx569.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx569.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx569.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">its</span><span id="lstnumberx569.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx569.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">corresponding</span><span id="lstnumberx569.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx569.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx569.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Docstring</span><span id="lstnumberx569.15" class="ltx_text ltx_font_typewriter">‘</span>
</div>
<div id="lstnumberx570" class="ltx_listingline">
<span id="lstnumberx570.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx570.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx570.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx570.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Name</span><span id="lstnumberx570.7" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx570.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx570.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx570.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">obfuscated</span><span id="lstnumberx570.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx570.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx570.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">format</span><span id="lstnumberx570.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx570.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.23" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx570.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f_</span><span id="lstnumberx570.25" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx570.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">NUMBER</span><span id="lstnumberx570.27" class="ltx_text ltx_font_typewriter">]‘</span><span id="lstnumberx570.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx570.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx570.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">anonymity</span><span id="lstnumberx570.34" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx570.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.36" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx570.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">NUMBER</span><span id="lstnumberx570.38" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx570.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx570.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx570.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx570.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">one</span><span id="lstnumberx570.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inside</span><span id="lstnumberx570.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx570.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">file</span><span id="lstnumberx570.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx570.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">name</span><span id="lstnumberx570.55" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx571" class="ltx_listingline">
<span id="lstnumberx571.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx571.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docstrings</span><span id="lstnumberx571.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx571.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx571.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx571.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx571.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">found</span><span id="lstnumberx571.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">at</span><span id="lstnumberx571.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Google</span><span id="lstnumberx571.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Python</span><span id="lstnumberx571.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Style</span><span id="lstnumberx571.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Guide</span><span id="lstnumberx571.23" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx571.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx571.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx571.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contain</span><span id="lstnumberx571.28" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx572" class="ltx_listingline">
<span id="lstnumberx572.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">A</span><span id="lstnumberx572.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx572.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx572.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Functionality</span><span id="lstnumberx572.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx572.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Description</span><span id="lstnumberx572.7" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx573" class="ltx_listingline">
<span id="lstnumberx573.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx573.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx573.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx573.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Parameters</span><span id="lstnumberx573.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx573.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx573.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx573.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx573.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">their</span><span id="lstnumberx573.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx573.11" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx573.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx573.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx573.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Parameters</span><span id="lstnumberx573.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx573.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Descriptions</span><span id="lstnumberx573.17" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx574" class="ltx_listingline">
<span id="lstnumberx574.1" class="ltx_text ltx_font_typewriter">2-3</span><span id="lstnumberx574.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx574.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx574.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Running</span><span id="lstnumberx574.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx574.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Examples</span><span id="lstnumberx574.7" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx574.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx574.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx574.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx574.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Python</span><span id="lstnumberx574.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx574.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Interpreter</span><span id="lstnumberx574.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx574.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx574.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx574.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">their</span><span id="lstnumberx574.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx574.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected</span><span id="lstnumberx574.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx574.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">outputs</span><span id="lstnumberx574.22" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx575" class="ltx_listingline">
<span id="lstnumberx575.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx575.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx575.3" class="ltx_text ltx_font_typewriter">‘</span>
</div>
<div id="lstnumberx576" class="ltx_listingline">
<span id="lstnumberx576.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx576.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx576.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx576.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx576.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">fulfil</span><span id="lstnumberx576.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx576.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx576.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">described</span><span id="lstnumberx576.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx576.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx576.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx576.21" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx576.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Docstring</span><span id="lstnumberx576.23" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx577" class="ltx_listingline">
<span id="lstnumberx577.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx577.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx577.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx577.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Suite</span><span id="lstnumberx577.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx577.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx577.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx577.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx577.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">three</span><span id="lstnumberx577.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx577.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parts</span><span id="lstnumberx577.12" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx578" class="ltx_listingline">
<span id="lstnumberx578.1" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx578.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Standalone</span><span id="lstnumberx578.3" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx578.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx578.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx578.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Import</span><span id="lstnumberx578.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx578.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Statement</span><span id="lstnumberx578.9" class="ltx_text ltx_font_typewriter">‘</span>
</div>
<div id="lstnumberx579" class="ltx_listingline">
<span id="lstnumberx579.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx579.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx579.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx579.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx579.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">submodules</span><span id="lstnumberx579.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx579.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functions</span><span id="lstnumberx579.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx579.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx579.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx579.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx579.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx579.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx579.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx579.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tests</span><span id="lstnumberx579.27" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx580" class="ltx_listingline">
<span id="lstnumberx580.1" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx580.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Standalone</span><span id="lstnumberx580.3" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx580.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx580.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx580.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx580.7" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx580.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx580.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">class</span>
</div>
<div id="lstnumberx581" class="ltx_listingline">
<span id="lstnumberx581.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx581.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx581.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">class</span><span id="lstnumberx581.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx581.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx581.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx581.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contain</span><span id="lstnumberx581.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx581.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">at</span><span id="lstnumberx581.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx581.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">least</span><span id="lstnumberx581.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx581.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">five</span><span id="lstnumberx581.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx581.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">distinct</span><span id="lstnumberx581.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx581.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx581.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx581.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx581.20" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx582" class="ltx_listingline">
<span id="lstnumberx582.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx582.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx582.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx582.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx582.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx582.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">aligned</span><span id="lstnumberx582.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx582.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx582.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docstring</span><span id="lstnumberx582.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx582.20" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx582.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx582.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx582.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx582.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx582.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">assert</span><span id="lstnumberx582.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx582.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx582.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">which</span><span id="lstnumberx582.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx582.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx582.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">specifically</span><span id="lstnumberx582.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx582.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mentioned</span><span id="lstnumberx582.45" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx583" class="ltx_listingline">
<span id="lstnumberx583.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx583.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx583.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx583.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx583.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cover</span><span id="lstnumberx583.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx583.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">many</span><span id="lstnumberx583.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">branches</span><span id="lstnumberx583.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx583.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx583.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.21" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx583.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx583.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx583.25" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx583.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx583.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">possible</span><span id="lstnumberx583.30" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx583.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">In</span><span id="lstnumberx583.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">order</span><span id="lstnumberx583.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx583.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">get</span><span id="lstnumberx583.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx583.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complete</span><span id="lstnumberx583.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">coverage</span><span id="lstnumberx583.45" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx583.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx583.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx583.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx583.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx583.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">command</span><span id="lstnumberx583.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.57" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx583.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">coverage</span><span id="lstnumberx583.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run</span><span id="lstnumberx583.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.62" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx583.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">m</span><span id="lstnumberx583.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unittest</span><span id="lstnumberx583.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f_</span><span id="lstnumberx583.68" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx583.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">NUMBER</span><span id="lstnumberx583.70" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx583.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">_</span><span id="lstnumberx583.72" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx583.73" class="ltx_text ltx_lst_identifier ltx_font_typewriter">NAME</span><span id="lstnumberx583.74" class="ltx_text ltx_font_typewriter">].</span><span id="lstnumberx583.75" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx583.76" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.77" class="ltx_text ltx_font_typewriter">&amp;&amp;</span><span id="lstnumberx583.78" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.79" class="ltx_text ltx_lst_identifier ltx_font_typewriter">coverage</span><span id="lstnumberx583.80" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.81" class="ltx_text ltx_lst_identifier ltx_font_typewriter">report</span><span id="lstnumberx583.82" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.83" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx583.84" class="ltx_text ltx_lst_identifier ltx_font_typewriter">m</span><span id="lstnumberx583.85" class="ltx_text ltx_font_typewriter">‘.</span><span id="lstnumberx583.86" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.87" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Replace</span><span id="lstnumberx583.88" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.89" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx583.90" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.91" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx583.92" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f_</span><span id="lstnumberx583.93" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx583.94" class="ltx_text ltx_lst_identifier ltx_font_typewriter">NUMBER</span><span id="lstnumberx583.95" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx583.96" class="ltx_text ltx_lst_identifier ltx_font_typewriter">_</span><span id="lstnumberx583.97" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx583.98" class="ltx_text ltx_lst_identifier ltx_font_typewriter">NAME</span><span id="lstnumberx583.99" class="ltx_text ltx_font_typewriter">].</span><span id="lstnumberx583.100" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx583.101" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx583.102" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.103" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx583.104" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.105" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx583.106" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.107" class="ltx_text ltx_lst_identifier ltx_font_typewriter">file</span><span id="lstnumberx583.108" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.109" class="ltx_text ltx_lst_identifier ltx_font_typewriter">name</span><span id="lstnumberx583.110" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.111" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx583.112" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.113" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx583.114" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.115" class="ltx_text ltx_lst_identifier ltx_font_typewriter">testing</span><span id="lstnumberx583.116" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.117" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx583.118" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx583.119" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.120" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Ignore</span><span id="lstnumberx583.121" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.122" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx583.123" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.124" class="ltx_text ltx_lst_identifier ltx_font_typewriter">missing</span><span id="lstnumberx583.125" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.126" class="ltx_text ltx_lst_identifier ltx_font_typewriter">lines</span><span id="lstnumberx583.127" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.128" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx583.129" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.130" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx583.131" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.132" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx583.133" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx583.134" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx583.135" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Suite</span><span id="lstnumberx583.136" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx584" class="ltx_listingline">
<span id="lstnumberx584.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx584.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Programming</span><span id="lstnumberx584.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx584.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx584.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx584.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx584.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">able</span><span id="lstnumberx584.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx584.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pass</span><span id="lstnumberx584.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx584.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx584.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx584.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx584.24" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx584.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">This</span><span id="lstnumberx584.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">means</span><span id="lstnumberx584.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx584.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">scripts</span><span id="lstnumberx584.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx584.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run</span><span id="lstnumberx584.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">successfully</span><span id="lstnumberx584.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">without</span><span id="lstnumberx584.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx584.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">failed</span><span id="lstnumberx584.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx584.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx584.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">when</span><span id="lstnumberx584.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx584.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run</span><span id="lstnumberx584.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.56" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx584.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">python</span><span id="lstnumberx584.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">XXX</span><span id="lstnumberx584.60" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx584.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">py</span><span id="lstnumberx584.62" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx584.63" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx584.65" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.66" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx584.67" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx584.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">terminal</span><span id="lstnumberx584.69" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx585" class="ltx_listingline">
<span id="lstnumberx585.1" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx585.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Standalone</span><span id="lstnumberx585.3" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx585.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx585.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx585.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run_tests</span><span id="lstnumberx585.7" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx585.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx585.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span>
</div>
<div id="lstnumberx586" class="ltx_listingline">
<span id="lstnumberx586.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx586.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx586.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx586.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">only</span><span id="lstnumberx586.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contain</span><span id="lstnumberx586.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx586.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx586.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">helping</span><span id="lstnumberx586.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx586.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">execute</span><span id="lstnumberx586.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx586.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx586.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx586.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx586.26" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx587" class="ltx_listingline">
</div>
<div id="lstnumberx588" class="ltx_listingline">
<span id="lstnumberx588.1" class="ltx_text ltx_font_typewriter">##</span><span id="lstnumberx588.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx588.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Issues</span><span id="lstnumberx588.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx588.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">To</span><span id="lstnumberx588.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx588.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Be</span><span id="lstnumberx588.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx588.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Addressed</span>
</div>
<div id="lstnumberx589" class="ltx_listingline">
</div>
<div id="lstnumberx590" class="ltx_listingline">
<span id="lstnumberx590.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx590.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">may</span><span id="lstnumberx590.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">notice</span><span id="lstnumberx590.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx590.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">existence</span><span id="lstnumberx590.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx590.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx590.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">following</span><span id="lstnumberx590.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">issues</span><span id="lstnumberx590.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx590.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx590.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx590.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Python</span><span id="lstnumberx590.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx590.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">script</span><span id="lstnumberx590.28" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx591" class="ltx_listingline">
<span id="lstnumberx591.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx591.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx591.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx591.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Name</span><span id="lstnumberx591.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx591.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx591.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">has</span><span id="lstnumberx591.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx591.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx591.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx591.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">been</span><span id="lstnumberx591.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx591.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">obfuscated</span><span id="lstnumberx591.14" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx592" class="ltx_listingline">
<span id="lstnumberx592.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Replace</span><span id="lstnumberx592.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx592.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx592.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx592.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">name</span><span id="lstnumberx592.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx592.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx592.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx592.9" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx592.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx592.11" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx593" class="ltx_listingline">
<span id="lstnumberx593.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx593.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Docstring</span><span id="lstnumberx593.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx593.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx593.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx593.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx593.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unclear</span><span id="lstnumberx593.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx593.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx593.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ambiguous</span><span id="lstnumberx593.11" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx593.12" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx593.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">impractical</span><span id="lstnumberx593.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx593.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx593.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx593.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx593.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx593.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">well</span><span id="lstnumberx593.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx593.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">aligned</span><span id="lstnumberx593.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx593.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx593.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx593.25" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx593.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx593.27" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx594" class="ltx_listingline">
<span id="lstnumberx594.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx594.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx594.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx594.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Description</span><span id="lstnumberx594.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx594.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx594.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx594.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx594.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">describe</span><span id="lstnumberx594.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx594.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx594.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx594.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">practical</span><span id="lstnumberx594.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx594.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx594.16" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx595" class="ltx_listingline">
<span id="lstnumberx595.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx595.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx595.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">either</span><span id="lstnumberx595.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">refine</span><span id="lstnumberx595.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx595.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.11" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx595.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx595.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Description</span><span id="lstnumberx595.15" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx595.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx595.18" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx595.19" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx595.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx595.21" class="ltx_text ltx_font_typewriter">‘.</span><span id="lstnumberx595.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Choose</span><span id="lstnumberx595.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx595.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">one</span><span id="lstnumberx595.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx595.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">feasible</span><span id="lstnumberx595.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx595.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx595.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx595.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">done</span><span id="lstnumberx595.38" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx596" class="ltx_listingline">
<span id="lstnumberx596.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Make</span><span id="lstnumberx596.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx596.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sure</span><span id="lstnumberx596.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx596.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">at</span><span id="lstnumberx596.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx596.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">least</span><span id="lstnumberx596.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx596.9" class="ltx_text ltx_font_typewriter">2</span><span id="lstnumberx596.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx596.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correct</span><span id="lstnumberx596.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx596.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx596.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Running</span><span id="lstnumberx596.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx596.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Examples</span><span id="lstnumberx596.17" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx596.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx596.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx596.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx596.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">included</span><span id="lstnumberx596.22" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx597" class="ltx_listingline">
<span id="lstnumberx597.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx597.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx597.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx597.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx597.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">does</span><span id="lstnumberx597.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx597.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx597.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx597.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx597.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx597.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx597.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx597.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx597.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx597.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx597.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx597.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx597.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx597.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx597.20" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx598" class="ltx_listingline">
<span id="lstnumberx598.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Try</span><span id="lstnumberx598.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx598.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">refine</span><span id="lstnumberx598.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx598.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.9" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx598.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Programming</span><span id="lstnumberx598.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx598.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx598.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">so</span><span id="lstnumberx598.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx598.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx598.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.21" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx598.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx598.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Description</span><span id="lstnumberx598.25" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx598.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implies</span><span id="lstnumberx598.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx598.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">corresponding</span><span id="lstnumberx598.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">API</span><span id="lstnumberx598.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">usage</span><span id="lstnumberx598.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx598.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">such</span><span id="lstnumberx598.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx598.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx598.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correctly</span><span id="lstnumberx598.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">invoked</span><span id="lstnumberx598.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx598.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx598.51" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx598.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx598.53" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx599" class="ltx_listingline">
<span id="lstnumberx599.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx599.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.3" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx599.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx599.5" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx599.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx599.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">difficult</span><span id="lstnumberx599.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx599.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complete</span><span id="lstnumberx599.14" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx599.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">remove</span><span id="lstnumberx599.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx599.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unused</span><span id="lstnumberx599.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">import</span><span id="lstnumberx599.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx599.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">statements</span><span id="lstnumberx599.25" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx600" class="ltx_listingline">
<span id="lstnumberx600.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx600.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx600.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx600.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx600.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx600.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx600.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx600.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx600.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx600.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx600.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx600.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx600.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx600.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx600.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">included</span><span id="lstnumberx600.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx600.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx600.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx600.19" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx600.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Import</span><span id="lstnumberx600.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx600.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Statement</span><span id="lstnumberx600.23" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx601" class="ltx_listingline">
<span id="lstnumberx601.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Add</span><span id="lstnumberx601.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx601.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">corresponding</span><span id="lstnumberx601.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">import</span><span id="lstnumberx601.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">statements</span><span id="lstnumberx601.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx601.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx601.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx601.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx601.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">necessary</span><span id="lstnumberx601.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx601.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complete</span><span id="lstnumberx601.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx601.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx601.28" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx601.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Otherwise</span><span id="lstnumberx601.31" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx601.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">refine</span><span id="lstnumberx601.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.35" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx601.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx601.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Description</span><span id="lstnumberx601.39" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx601.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">so</span><span id="lstnumberx601.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx601.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx601.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx601.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">will</span><span id="lstnumberx601.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">require</span><span id="lstnumberx601.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">such</span><span id="lstnumberx601.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx601.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx601.56" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx602" class="ltx_listingline">
<span id="lstnumberx602.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx602.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx602.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx602.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx602.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx602.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx602.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">less</span><span id="lstnumberx602.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx602.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">than</span><span id="lstnumberx602.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx602.11" class="ltx_text ltx_font_typewriter">2</span><span id="lstnumberx602.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx602.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx602.14" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx603" class="ltx_listingline">
<span id="lstnumberx603.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx603.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx603.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">refine</span><span id="lstnumberx603.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.7" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx603.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Programming</span><span id="lstnumberx603.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx603.11" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx603.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">so</span><span id="lstnumberx603.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx603.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx603.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx603.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">must</span><span id="lstnumberx603.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">require</span><span id="lstnumberx603.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx603.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">API</span><span id="lstnumberx603.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">usage</span><span id="lstnumberx603.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx603.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">invoke</span><span id="lstnumberx603.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx603.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">from</span><span id="lstnumberx603.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">at</span><span id="lstnumberx603.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">least</span><span id="lstnumberx603.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.43" class="ltx_text ltx_font_typewriter">2</span><span id="lstnumberx603.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">distinct</span><span id="lstnumberx603.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx603.48" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx603.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx603.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx603.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx603.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ChatGPT</span><span id="lstnumberx603.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.58" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx603.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">GPT</span><span id="lstnumberx603.60" class="ltx_text ltx_font_typewriter">-4)</span><span id="lstnumberx603.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx603.63" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Advanced</span><span id="lstnumberx603.65" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.66" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Data</span><span id="lstnumberx603.67" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Analysis</span><span id="lstnumberx603.69" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx603.71" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx603.72" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inspiration</span><span id="lstnumberx603.73" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx604" class="ltx_listingline">
<span id="lstnumberx604.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx604.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx604.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx604.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx604.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx604.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx604.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx604.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx604.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx604.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx604.11" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx604.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx604.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx604.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx604.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx604.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx604.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx604.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx604.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx604.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx604.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx604.22" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx605" class="ltx_listingline">
<span id="lstnumberx605.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Initialize</span><span id="lstnumberx605.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx605.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx605.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx605.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx605.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">each</span><span id="lstnumberx605.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx605.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx605.15" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx605.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx605.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">control</span><span id="lstnumberx605.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx605.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx605.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">behavior</span><span id="lstnumberx605.24" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx606" class="ltx_listingline">
<span id="lstnumberx606.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx606.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx606.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx606.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx606.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx606.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx606.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dummy</span><span id="lstnumberx606.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx606.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx606.10" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx607" class="ltx_listingline">
<span id="lstnumberx607.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Based</span><span id="lstnumberx607.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">on</span><span id="lstnumberx607.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">your</span><span id="lstnumberx607.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">understanding</span><span id="lstnumberx607.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx607.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">replace</span><span id="lstnumberx607.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx607.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dummy</span><span id="lstnumberx607.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx607.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx607.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx607.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">actual</span><span id="lstnumberx607.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx607.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx607.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">each</span><span id="lstnumberx607.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx607.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">part</span><span id="lstnumberx607.31" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx608" class="ltx_listingline">
<span id="lstnumberx608.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx608.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx608.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx608.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx608.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx608.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx608.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx608.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx608.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">display</span><span id="lstnumberx608.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx608.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx608.12" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx608.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx608.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">such</span><span id="lstnumberx608.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx608.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx608.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx608.18" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx608.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">print</span><span id="lstnumberx608.20" class="ltx_text ltx_font_typewriter">()‘</span><span id="lstnumberx608.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx608.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx608.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx608.24" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx608.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matplotlib</span><span id="lstnumberx608.26" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx608.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pyplt</span><span id="lstnumberx608.28" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx608.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">show</span><span id="lstnumberx608.30" class="ltx_text ltx_font_typewriter">()‘.</span>
</div>
<div id="lstnumberx609" class="ltx_listingline">
<span id="lstnumberx609.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx609.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx609.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx609.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requires</span><span id="lstnumberx609.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx609.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx609.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx609.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx609.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">show</span><span id="lstnumberx609.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">some</span><span id="lstnumberx609.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx609.22" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx609.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx609.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">shall</span><span id="lstnumberx609.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">either</span><span id="lstnumberx609.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx609.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx609.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx609.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx609.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx609.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx609.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx609.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">take</span><span id="lstnumberx609.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx609.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">path</span><span id="lstnumberx609.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx609.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">file</span><span id="lstnumberx609.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">storage</span><span id="lstnumberx609.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx609.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx609.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">variable</span><span id="lstnumberx609.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx609.63" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx609.65" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.66" class="ltx_text ltx_lst_identifier ltx_font_typewriter">visualization</span><span id="lstnumberx609.67" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx609.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx609.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx609.72" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx609.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx609.75" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.76" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx609.77" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.78" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx609.79" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.80" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requires</span><span id="lstnumberx609.81" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.82" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx609.83" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.84" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx609.85" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.86" class="ltx_text ltx_lst_identifier ltx_font_typewriter">show</span><span id="lstnumberx609.87" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.88" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx609.89" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.90" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plot</span><span id="lstnumberx609.91" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx609.92" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.93" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx609.94" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.95" class="ltx_text ltx_lst_identifier ltx_font_typewriter">must</span><span id="lstnumberx609.96" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.97" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx609.98" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.99" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx609.100" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.101" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plot</span><span id="lstnumberx609.102" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.103" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx609.104" class="ltx_text ltx_lst_identifier ltx_font_typewriter">via</span><span id="lstnumberx609.105" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.106" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Axes</span><span id="lstnumberx609.107" class="ltx_text ltx_font_typewriter">).</span><span id="lstnumberx609.108" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.109" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx609.110" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.111" class="ltx_text ltx_lst_identifier ltx_font_typewriter">there</span><span id="lstnumberx609.112" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.113" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx609.114" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.115" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx609.116" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.117" class="ltx_text ltx_lst_identifier ltx_font_typewriter">specific</span><span id="lstnumberx609.118" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.119" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attribute</span><span id="lstnumberx609.120" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.121" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inside</span><span id="lstnumberx609.122" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.123" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx609.124" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.125" class="ltx_text ltx_lst_identifier ltx_font_typewriter">object</span><span id="lstnumberx609.126" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx609.127" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.128" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx609.129" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.130" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx609.131" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.132" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mention</span><span id="lstnumberx609.133" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.134" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx609.135" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.136" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx609.137" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.138" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx609.139" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.140" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx609.141" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Docstring</span><span id="lstnumberx609.142" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx609.143" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.144" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx609.145" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.146" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx609.147" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.148" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx609.149" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.150" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inside</span><span id="lstnumberx609.151" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.152" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx609.153" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx609.154" class="ltx_text ltx_font_typewriter">‘.</span><span id="lstnumberx609.155" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.156" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx609.157" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.158" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx609.159" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx609.160" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.161" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx609.162" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.163" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plot</span><span id="lstnumberx609.164" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.165" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx609.166" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.167" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx609.168" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.169" class="ltx_text ltx_lst_identifier ltx_font_typewriter">specific</span><span id="lstnumberx609.170" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.171" class="ltx_text ltx_lst_identifier ltx_font_typewriter">title</span><span id="lstnumberx609.172" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.173" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx609.174" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.175" class="ltx_text ltx_lst_identifier ltx_font_typewriter">label</span><span id="lstnumberx609.176" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.177" class="ltx_text ltx_lst_identifier ltx_font_typewriter">names</span><span id="lstnumberx609.178" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx609.179" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.180" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx609.181" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.182" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx609.183" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.184" class="ltx_text ltx_lst_identifier ltx_font_typewriter">make</span><span id="lstnumberx609.185" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.186" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sure</span><span id="lstnumberx609.187" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.188" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx609.189" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.190" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx609.191" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.192" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx609.193" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.194" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx609.195" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.196" class="ltx_text ltx_lst_identifier ltx_font_typewriter">either</span><span id="lstnumberx609.197" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.198" class="ltx_text ltx_lst_identifier ltx_font_typewriter">stated</span><span id="lstnumberx609.199" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.200" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx609.201" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.202" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx609.203" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Docstring</span><span id="lstnumberx609.204" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx609.205" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.206" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx609.207" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.208" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implied</span><span id="lstnumberx609.209" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.210" class="ltx_text ltx_lst_identifier ltx_font_typewriter">by</span><span id="lstnumberx609.211" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx609.212" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx609.213" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Docstring</span><span id="lstnumberx609.214" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx610" class="ltx_listingline">
<span id="lstnumberx610.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx610.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx610.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx610.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requires</span><span id="lstnumberx610.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">checking</span><span id="lstnumberx610.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">some</span><span id="lstnumberx610.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">properties</span><span id="lstnumberx610.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx610.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx610.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.19" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx610.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">print</span><span id="lstnumberx610.21" class="ltx_text ltx_font_typewriter">()‘</span><span id="lstnumberx610.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx610.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">show</span><span id="lstnumberx610.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx610.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx610.30" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx610.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx610.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx610.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx610.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modify</span><span id="lstnumberx610.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">this</span><span id="lstnumberx610.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx610.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx610.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx610.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx610.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx610.51" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx610.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx610.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">revised</span><span id="lstnumberx610.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx610.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx610.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">amalgamate</span><span id="lstnumberx610.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx610.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">properties</span><span id="lstnumberx610.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx610.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx610.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">preexisting</span><span id="lstnumberx610.72" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.73" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx610.74" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.75" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx610.76" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx610.77" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.78" class="ltx_text ltx_lst_identifier ltx_font_typewriter">thereby</span><span id="lstnumberx610.79" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.80" class="ltx_text ltx_lst_identifier ltx_font_typewriter">facilitating</span><span id="lstnumberx610.81" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.82" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx610.83" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.84" class="ltx_text ltx_lst_identifier ltx_font_typewriter">versatile</span><span id="lstnumberx610.85" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.86" class="ltx_text ltx_lst_identifier ltx_font_typewriter">utilization</span><span id="lstnumberx610.87" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.88" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx610.89" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.90" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx610.91" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.92" class="ltx_text ltx_lst_identifier ltx_font_typewriter">outputs</span><span id="lstnumberx610.93" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.94" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx610.95" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.96" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx610.97" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.98" class="ltx_text ltx_lst_identifier ltx_font_typewriter">rest</span><span id="lstnumberx610.99" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.100" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx610.101" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.102" class="ltx_text ltx_lst_identifier ltx_font_typewriter">your</span><span id="lstnumberx610.103" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx610.104" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx610.105" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx611" class="ltx_listingline">
<span id="lstnumberx611.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Refer</span><span id="lstnumberx611.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx611.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx611.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx611.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Step3</span><span id="lstnumberx611.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx611.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx611.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx611.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx611.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx611.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">guidelines</span><span id="lstnumberx611.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx611.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx611.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx611.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx611.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx611.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">previous</span><span id="lstnumberx611.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx611.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">stage</span><span id="lstnumberx611.20" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx612" class="ltx_listingline">
</div>
<div id="lstnumberx613" class="ltx_listingline">
<span id="lstnumberx613.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Global</span><span id="lstnumberx613.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx613.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">constants</span><span id="lstnumberx613.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx613.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">before</span><span id="lstnumberx613.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx613.7" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx613.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx613.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx613.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx613.11" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx614" class="ltx_listingline">
<span id="lstnumberx614.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx614.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx614.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">global</span><span id="lstnumberx614.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">constants</span><span id="lstnumberx614.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx614.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx614.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx614.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sample</span><span id="lstnumberx614.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inputs</span><span id="lstnumberx614.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx614.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx614.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.23" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx614.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx614.25" class="ltx_text ltx_font_typewriter">‘,</span><span id="lstnumberx614.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">remove</span><span id="lstnumberx614.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx614.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx614.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">write</span><span id="lstnumberx614.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">your</span><span id="lstnumberx614.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">own</span><span id="lstnumberx614.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx614.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">input</span><span id="lstnumberx614.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx614.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx614.45" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx614.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx614.47" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx615" class="ltx_listingline">
<span id="lstnumberx615.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx615.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx615.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx615.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx615.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">global</span><span id="lstnumberx615.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx615.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">constants</span><span id="lstnumberx615.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx615.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx615.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx615.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unused</span><span id="lstnumberx615.12" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx615.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx615.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">remove</span><span id="lstnumberx615.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx615.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx615.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx615.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">directly</span><span id="lstnumberx615.19" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx616" class="ltx_listingline">
<span id="lstnumberx616.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx616.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx616.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inside</span><span id="lstnumberx616.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.8" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx616.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx616.10" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx616.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">only</span><span id="lstnumberx616.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">check</span><span id="lstnumberx616.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx616.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">range</span><span id="lstnumberx616.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx616.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span><span id="lstnumberx616.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx616.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx616.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">fail</span><span id="lstnumberx616.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx616.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx616.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx616.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx616.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">specific</span><span id="lstnumberx616.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx616.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">way</span><span id="lstnumberx616.41" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx617" class="ltx_listingline">
<span id="lstnumberx617.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">It</span><span id="lstnumberx617.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">assumes</span><span id="lstnumberx617.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx617.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx617.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">now</span><span id="lstnumberx617.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">have</span><span id="lstnumberx617.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">full</span><span id="lstnumberx617.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">control</span><span id="lstnumberx617.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx617.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.19" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx617.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Programming</span><span id="lstnumberx617.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx617.23" class="ltx_text ltx_font_typewriter">‘.</span><span id="lstnumberx617.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Write</span><span id="lstnumberx617.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx617.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx617.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx617.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx617.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">validate</span><span id="lstnumberx617.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx617.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx617.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span><span id="lstnumberx617.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx617.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx617.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">equal</span><span id="lstnumberx617.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx617.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">certain</span><span id="lstnumberx617.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx617.54" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx617.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx617.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx617.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span><span id="lstnumberx617.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">objects</span><span id="lstnumberx617.63" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx617.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">validate</span><span id="lstnumberx617.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx617.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx617.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx617.72" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.73" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx617.74" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.75" class="ltx_text ltx_lst_identifier ltx_font_typewriter">equal</span><span id="lstnumberx617.76" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.77" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx617.78" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.79" class="ltx_text ltx_lst_identifier ltx_font_typewriter">certain</span><span id="lstnumberx617.80" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx617.81" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx617.82" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx618" class="ltx_listingline">
<span id="lstnumberx618.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx618.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx618.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">do</span><span id="lstnumberx618.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx618.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx618.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx618.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">deterministic</span><span id="lstnumberx618.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx618.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx618.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected</span><span id="lstnumberx618.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx618.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">outputs</span><span id="lstnumberx618.22" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx619" class="ltx_listingline">
<span id="lstnumberx619.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Come</span><span id="lstnumberx619.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx619.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">up</span><span id="lstnumberx619.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx619.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx619.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx619.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx619.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx619.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected</span><span id="lstnumberx619.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx619.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">outputs</span><span id="lstnumberx619.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx619.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">after</span><span id="lstnumberx619.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx619.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">testing</span><span id="lstnumberx619.16" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx620" class="ltx_listingline">
<span id="lstnumberx620.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx620.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx620.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx620.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx620.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx620.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx620.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx620.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx620.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx620.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx620.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">included</span><span id="lstnumberx620.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx620.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.23" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx620.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Import</span><span id="lstnumberx620.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx620.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Statement</span><span id="lstnumberx620.27" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx621" class="ltx_listingline">
<span id="lstnumberx621.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Add</span><span id="lstnumberx621.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx621.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">corresponding</span><span id="lstnumberx621.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">import</span><span id="lstnumberx621.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">statements</span><span id="lstnumberx621.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx621.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx621.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx621.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx621.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">necessary</span><span id="lstnumberx621.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx621.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complete</span><span id="lstnumberx621.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx621.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">testing</span><span id="lstnumberx621.28" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx621.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Otherwise</span><span id="lstnumberx621.31" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx621.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">remove</span><span id="lstnumberx621.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">such</span><span id="lstnumberx621.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx621.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx621.38" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx622" class="ltx_listingline">
<span id="lstnumberx622.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx622.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx622.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx622.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx622.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx622.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx622.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx622.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx622.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx622.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx622.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx622.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx622.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">do</span><span id="lstnumberx622.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx622.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx622.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx622.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">work</span><span id="lstnumberx622.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx622.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx622.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx622.21" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx622.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx622.23" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx623" class="ltx_listingline">
<span id="lstnumberx623.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Repair</span><span id="lstnumberx623.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx623.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx623.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx623.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx623.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx623.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx623.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx623.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx623.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx623.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">replace</span><span id="lstnumberx623.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx623.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx623.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx623.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx623.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx623.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">better</span><span id="lstnumberx623.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx623.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx623.20" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx624" class="ltx_listingline">
<span id="lstnumberx624.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.2" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx624.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx624.4" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx624.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">does</span><span id="lstnumberx624.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx624.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx624.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx624.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx624.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx624.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx624.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span><span id="lstnumberx624.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">object</span><span id="lstnumberx624.23" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx624.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">where</span><span id="lstnumberx624.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx624.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx624.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx624.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implied</span><span id="lstnumberx624.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">by</span><span id="lstnumberx624.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.37" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx624.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx624.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Description</span><span id="lstnumberx624.41" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx624.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx624.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">completed</span><span id="lstnumberx624.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">by</span><span id="lstnumberx624.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx624.49" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx624.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx624.51" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx625" class="ltx_listingline">
<span id="lstnumberx625.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Add</span><span id="lstnumberx625.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx625.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">lines</span><span id="lstnumberx625.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx625.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx625.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx625.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx625.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx625.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx625.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx625.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx625.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx625.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx625.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx625.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx625.16" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx626" class="ltx_listingline">
<span id="lstnumberx626.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx626.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx626.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx626.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx626.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx626.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mentioned</span><span id="lstnumberx626.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx626.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implied</span><span id="lstnumberx626.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">by</span><span id="lstnumberx626.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.19" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx626.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx626.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Description</span><span id="lstnumberx626.23" class="ltx_text ltx_font_typewriter">‘,</span><span id="lstnumberx626.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">try</span><span id="lstnumberx626.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx626.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">describe</span><span id="lstnumberx626.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx626.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx626.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.35" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx626.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx626.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx626.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Description</span><span id="lstnumberx626.39" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx627" class="ltx_listingline">
<span id="lstnumberx627.1" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx627.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx627.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx627.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx627.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">does</span><span id="lstnumberx627.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx627.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx627.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx627.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx627.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx627.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx627.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx627.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">files</span><span id="lstnumberx627.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx627.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx627.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx627.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">result</span><span id="lstnumberx627.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx627.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx627.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx627.21" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx627.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx627.23" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx628" class="ltx_listingline">
<span id="lstnumberx628.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Some</span><span id="lstnumberx628.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">files</span><span id="lstnumberx628.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx628.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">created</span><span id="lstnumberx628.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">during</span><span id="lstnumberx628.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx628.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">execution</span><span id="lstnumberx628.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx628.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.17" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx628.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Programming</span><span id="lstnumberx628.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx628.21" class="ltx_text ltx_font_typewriter">‘.</span><span id="lstnumberx628.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Add</span><span id="lstnumberx628.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">necessary</span><span id="lstnumberx628.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">lines</span><span id="lstnumberx628.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx628.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx628.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx628.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx628.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx628.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx628.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx628.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx628.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">files</span><span id="lstnumberx628.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx628.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">each</span><span id="lstnumberx628.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx628.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx628.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">case</span><span id="lstnumberx628.54" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx629" class="ltx_listingline">
<span id="lstnumberx629.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx629.2" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx629.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx629.4" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx629.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx629.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx629.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx629.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wrapped</span><span id="lstnumberx629.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx629.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx629.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx629.12" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx629.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run_tests</span><span id="lstnumberx629.14" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx630" class="ltx_listingline">
<span id="lstnumberx630.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Separate</span><span id="lstnumberx630.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx630.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx630.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx630.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">two</span><span id="lstnumberx630.6" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx631" class="ltx_listingline">
<span id="lstnumberx631.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx631.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx631.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx631.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.8" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx631.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx631.10" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx631.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx631.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">duplicated</span><span id="lstnumberx631.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx631.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx631.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx631.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx631.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx631.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">same</span><span id="lstnumberx631.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx631.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">behavior</span><span id="lstnumberx631.29" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx632" class="ltx_listingline">
<span id="lstnumberx632.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Remove</span><span id="lstnumberx632.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx632.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx632.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">there</span><span id="lstnumberx632.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx632.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx632.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">huge</span><span id="lstnumberx632.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">overlap</span><span id="lstnumberx632.16" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx632.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Replace</span><span id="lstnumberx632.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx632.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx632.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">more</span><span id="lstnumberx632.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complex</span><span id="lstnumberx632.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx632.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx632.31" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx632.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Make</span><span id="lstnumberx632.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sure</span><span id="lstnumberx632.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx632.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">at</span><span id="lstnumberx632.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">least</span><span id="lstnumberx632.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">five</span><span id="lstnumberx632.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx632.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx632.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx632.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx632.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">included</span><span id="lstnumberx632.52" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx633" class="ltx_listingline">
<span id="lstnumberx633.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx633.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx633.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx633.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx633.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx633.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx633.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx633.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx633.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx633.10" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx633.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx633.12" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx633.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx633.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx633.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx633.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">missing</span><span id="lstnumberx633.17" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx634" class="ltx_listingline">
<span id="lstnumberx634.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx634.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">need</span><span id="lstnumberx634.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx634.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">manually</span><span id="lstnumberx634.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">design</span><span id="lstnumberx634.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx634.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx634.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx634.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">utilize</span><span id="lstnumberx634.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.19" class="ltx_text ltx_font_typewriter">3</span><span id="lstnumberx634.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">rd</span><span id="lstnumberx634.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">party</span><span id="lstnumberx634.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx634.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx634.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">websites</span><span id="lstnumberx634.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.30" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx634.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">e</span><span id="lstnumberx634.32" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx634.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">g</span><span id="lstnumberx634.34" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx634.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.36" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx634.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Faker</span><span id="lstnumberx634.38" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx634.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx634.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.42" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx634.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unittest</span><span id="lstnumberx634.44" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx634.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mock</span><span id="lstnumberx634.46" class="ltx_text ltx_font_typewriter">‘)</span><span id="lstnumberx634.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx634.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">generate</span><span id="lstnumberx634.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx634.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mock</span><span id="lstnumberx634.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx634.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx634.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx634.61" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx634.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Refer</span><span id="lstnumberx634.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx634.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Step4</span><span id="lstnumberx634.68" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.69" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx634.70" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.71" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx634.72" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.73" class="ltx_text ltx_lst_identifier ltx_font_typewriter">guidelines</span><span id="lstnumberx634.74" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.75" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx634.76" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.77" class="ltx_text ltx_lst_identifier ltx_font_typewriter">previous</span><span id="lstnumberx634.78" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx634.79" class="ltx_text ltx_lst_identifier ltx_font_typewriter">stage</span><span id="lstnumberx634.80" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx635" class="ltx_listingline">
</div>
<div id="lstnumberx636" class="ltx_listingline">
<span id="lstnumberx636.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx636.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Lack</span><span id="lstnumberx636.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx636.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx636.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx636.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx636.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx636.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">value</span><span id="lstnumberx636.9" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx637" class="ltx_listingline">
<span id="lstnumberx637.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Functions</span><span id="lstnumberx637.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx637.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">have</span><span id="lstnumberx637.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">clear</span><span id="lstnumberx637.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx637.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx637.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx637.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">indicate</span><span id="lstnumberx637.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx637.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">result</span><span id="lstnumberx637.20" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx637.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx637.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx637.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx637.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx637.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tested</span><span id="lstnumberx637.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx637.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx637.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx637.36" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx637.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx637.38" class="ltx_text ltx_font_typewriter">‘.</span>
</div>
<div id="lstnumberx638" class="ltx_listingline">
<span id="lstnumberx638.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx638.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Lack</span><span id="lstnumberx638.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx638.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx638.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx638.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">corner</span><span id="lstnumberx638.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx638.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx638.9" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx639" class="ltx_listingline">
<span id="lstnumberx639.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Corner</span><span id="lstnumberx639.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx639.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx639.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx639.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">considered</span><span id="lstnumberx639.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx639.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx639.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx639.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx639.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx639.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx639.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx639.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx639.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx639.26" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx640" class="ltx_listingline">
<span id="lstnumberx640.1" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx640.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Lack</span><span id="lstnumberx640.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx640.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx640.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx640.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">error</span><span id="lstnumberx640.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx640.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">handling</span><span id="lstnumberx640.9" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx641" class="ltx_listingline">
<span id="lstnumberx641.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx641.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx641.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">add</span><span id="lstnumberx641.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">necessary</span><span id="lstnumberx641.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">checks</span><span id="lstnumberx641.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx641.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">null</span><span id="lstnumberx641.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inputs</span><span id="lstnumberx641.16" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx641.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">incorrect</span><span id="lstnumberx641.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx641.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">types</span><span id="lstnumberx641.23" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx641.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx641.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">values</span><span id="lstnumberx641.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">out</span><span id="lstnumberx641.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx641.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected</span><span id="lstnumberx641.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ranges</span><span id="lstnumberx641.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx641.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">deal</span><span id="lstnumberx641.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx641.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">incorrect</span><span id="lstnumberx641.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">input</span><span id="lstnumberx641.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx641.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">format</span><span id="lstnumberx641.48" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx642" class="ltx_listingline">
</div>
<div id="lstnumberx643" class="ltx_listingline">
<span id="lstnumberx643.1" class="ltx_text ltx_font_typewriter">##</span><span id="lstnumberx643.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx643.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Further</span><span id="lstnumberx643.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx643.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Explanation</span><span id="lstnumberx643.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx643.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx643.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx643.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Each</span><span id="lstnumberx643.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx643.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Issue</span>
</div>
<div id="lstnumberx644" class="ltx_listingline">
</div>
<div id="lstnumberx645" class="ltx_listingline">
<span id="lstnumberx645.1" class="ltx_text ltx_font_typewriter">1.</span><span id="lstnumberx645.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx645.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx645.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx645.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx645.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Name</span><span id="lstnumberx645.7" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx645.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx645.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">has</span><span id="lstnumberx645.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx645.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx645.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx645.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">been</span><span id="lstnumberx645.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx645.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">obfuscated</span><span id="lstnumberx645.16" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx646" class="ltx_listingline">
<span id="lstnumberx646.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx646.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx646.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx646.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">given</span><span id="lstnumberx646.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx646.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx646.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">have</span><span id="lstnumberx646.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx646.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">generic</span><span id="lstnumberx646.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">name</span><span id="lstnumberx646.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">such</span><span id="lstnumberx646.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx646.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.24" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx646.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx646.26" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx646.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx646.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx646.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">anonymity</span><span id="lstnumberx646.33" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx646.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">This</span><span id="lstnumberx646.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">prevents</span><span id="lstnumberx646.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx646.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">user</span><span id="lstnumberx646.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">from</span><span id="lstnumberx646.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inferring</span><span id="lstnumberx646.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx646.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx646.50" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx646.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">s</span><span id="lstnumberx646.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">purpose</span><span id="lstnumberx646.54" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.55" class="ltx_text ltx_lst_identifier ltx_font_typewriter">based</span><span id="lstnumberx646.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">on</span><span id="lstnumberx646.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">its</span><span id="lstnumberx646.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx646.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">name</span><span id="lstnumberx646.62" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx647" class="ltx_listingline">
<span id="lstnumberx647.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx647.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx647.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx647.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Example</span><span id="lstnumberx647.5" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx648" class="ltx_listingline">
<span id="lstnumberx648.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx648.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Before</span><span id="lstnumberx648.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx648.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx648.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx648.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">def</span><span id="lstnumberx648.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx648.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">calculate_average</span><span id="lstnumberx648.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx648.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">nums</span><span id="lstnumberx648.11" class="ltx_text ltx_font_typewriter">):‘</span>
</div>
<div id="lstnumberx649" class="ltx_listingline">
<span id="lstnumberx649.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx649.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">After</span><span id="lstnumberx649.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx649.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx649.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx649.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">def</span><span id="lstnumberx649.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx649.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx649.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx649.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">nums</span><span id="lstnumberx649.11" class="ltx_text ltx_font_typewriter">):‘</span>
</div>
<div id="lstnumberx650" class="ltx_listingline">
</div>
<div id="lstnumberx651" class="ltx_listingline">
<span id="lstnumberx651.1" class="ltx_text ltx_font_typewriter">2.</span><span id="lstnumberx651.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx651.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Docstring</span><span id="lstnumberx651.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx651.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx651.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unclear</span><span id="lstnumberx651.10" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx651.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ambiguous</span><span id="lstnumberx651.13" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx651.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">impractical</span><span id="lstnumberx651.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx651.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx651.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">well</span><span id="lstnumberx651.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">aligned</span><span id="lstnumberx651.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx651.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx651.27" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx651.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx651.29" class="ltx_text ltx_font_typewriter">‘:</span>
</div>
<div id="lstnumberx652" class="ltx_listingline">
<span id="lstnumberx652.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx652.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx652.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx652.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx652.7" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx652.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">s</span><span id="lstnumberx652.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">docstring</span><span id="lstnumberx652.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx652.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">provide</span><span id="lstnumberx652.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx652.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">clear</span><span id="lstnumberx652.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx652.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">concise</span><span id="lstnumberx652.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx652.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx652.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">its</span><span id="lstnumberx652.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">purpose</span><span id="lstnumberx652.31" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx652.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected</span><span id="lstnumberx652.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inputs</span><span id="lstnumberx652.36" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx652.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">outputs</span><span id="lstnumberx652.39" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx652.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx652.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">examples</span><span id="lstnumberx652.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx652.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">usage</span><span id="lstnumberx652.48" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx652.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx652.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx652.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx652.55" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.56" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx652.57" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.58" class="ltx_text ltx_lst_identifier ltx_font_typewriter">vague</span><span id="lstnumberx652.59" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.60" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx652.61" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.62" class="ltx_text ltx_lst_identifier ltx_font_typewriter">doesn</span><span id="lstnumberx652.63" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx652.64" class="ltx_text ltx_lst_identifier ltx_font_typewriter">t</span><span id="lstnumberx652.65" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.66" class="ltx_text ltx_lst_identifier ltx_font_typewriter">match</span><span id="lstnumberx652.67" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.68" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx652.69" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx652.71" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx652.72" class="ltx_text ltx_lst_identifier ltx_font_typewriter">s</span><span id="lstnumberx652.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">behavior</span><span id="lstnumberx652.75" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx652.76" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.77" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx652.78" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.79" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx652.80" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.81" class="ltx_text ltx_lst_identifier ltx_font_typewriter">lead</span><span id="lstnumberx652.82" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.83" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx652.84" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx652.85" class="ltx_text ltx_lst_identifier ltx_font_typewriter">confusion</span><span id="lstnumberx652.86" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx653" class="ltx_listingline">
<span id="lstnumberx653.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx653.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx653.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx653.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Example</span><span id="lstnumberx653.5" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx654" class="ltx_listingline">
<span id="lstnumberx654.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx654.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Before</span><span id="lstnumberx654.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx654.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx654.5" class="ltx_text ltx_font_typewriter">‘"""</span><span id="lstnumberx654.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Calculates</span><span id="lstnumberx654.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx654.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">something</span><span id="lstnumberx654.9" class="ltx_text ltx_font_typewriter">."""‘</span>
</div>
<div id="lstnumberx655" class="ltx_listingline">
<span id="lstnumberx655.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx655.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">After</span><span id="lstnumberx655.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx655.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx655.5" class="ltx_text ltx_font_typewriter">‘"""</span><span id="lstnumberx655.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Calculates</span><span id="lstnumberx655.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx655.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx655.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx655.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">average</span><span id="lstnumberx655.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx655.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx655.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx655.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx655.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx655.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">list</span><span id="lstnumberx655.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx655.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx655.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx655.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numbers</span><span id="lstnumberx655.21" class="ltx_text ltx_font_typewriter">."""‘</span>
</div>
<div id="lstnumberx656" class="ltx_listingline">
</div>
<div id="lstnumberx657" class="ltx_listingline">
<span id="lstnumberx657.1" class="ltx_text ltx_font_typewriter">3.</span><span id="lstnumberx657.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx657.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx657.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx657.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx657.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx657.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">does</span><span id="lstnumberx657.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx657.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx657.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx657.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx657.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx657.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx657.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx657.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx657.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx657.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx657.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx657.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx657.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx657.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx657.22" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx658" class="ltx_listingline">
<span id="lstnumberx658.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx658.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx658.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx658.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx658.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx658.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx658.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">but</span><span id="lstnumberx658.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx658.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx658.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx658.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx658.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx658.23" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx658.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx658.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">indicates</span><span id="lstnumberx658.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">redundant</span><span id="lstnumberx658.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx658.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx658.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx658.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mismatch</span><span id="lstnumberx658.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">between</span><span id="lstnumberx658.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx658.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">problem</span><span id="lstnumberx658.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">description</span><span id="lstnumberx658.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx658.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx658.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx658.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">solution</span><span id="lstnumberx658.52" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx659" class="ltx_listingline">
<span id="lstnumberx659.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx659.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx659.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx659.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Example</span><span id="lstnumberx659.5" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx660" class="ltx_listingline">
<span id="lstnumberx660.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx660.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Before</span><span id="lstnumberx660.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx660.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx660.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">import</span><span id="lstnumberx660.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">math</span><span id="lstnumberx660.9" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx660.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx660.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">but</span><span id="lstnumberx660.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">no</span><span id="lstnumberx660.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">usage</span><span id="lstnumberx660.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx660.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.20" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx660.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">math</span><span id="lstnumberx660.22" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx660.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx660.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx660.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx660.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx660.29" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx661" class="ltx_listingline">
<span id="lstnumberx661.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx661.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">After</span><span id="lstnumberx661.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx661.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Remove</span><span id="lstnumberx661.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.7" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx661.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">import</span><span id="lstnumberx661.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">math</span><span id="lstnumberx661.11" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx661.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx661.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx661.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx661.18" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx661.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">s</span><span id="lstnumberx661.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx661.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx661.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx661.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx661.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx661.28" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx662" class="ltx_listingline">
</div>
<div id="lstnumberx663" class="ltx_listingline">
<span id="lstnumberx663.1" class="ltx_text ltx_font_typewriter">4.</span><span id="lstnumberx663.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx663.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx663.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx663.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx663.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx663.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx663.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx663.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx663.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">included</span><span id="lstnumberx663.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx663.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.21" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx663.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Import</span><span id="lstnumberx663.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx663.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Statement</span><span id="lstnumberx663.25" class="ltx_text ltx_font_typewriter">‘:</span>
</div>
<div id="lstnumberx664" class="ltx_listingline">
<span id="lstnumberx664.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx664.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx664.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">All</span><span id="lstnumberx664.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">external</span><span id="lstnumberx664.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx664.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx664.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functions</span><span id="lstnumberx664.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx664.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx664.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx664.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">solution</span><span id="lstnumberx664.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx664.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx664.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx664.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">at</span><span id="lstnumberx664.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx664.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">beginning</span><span id="lstnumberx664.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx664.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx664.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">script</span><span id="lstnumberx664.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx664.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx664.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.44" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx664.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx664.47" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.48" class="ltx_text ltx_lst_identifier ltx_font_typewriter">runs</span><span id="lstnumberx664.49" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.50" class="ltx_text ltx_lst_identifier ltx_font_typewriter">without</span><span id="lstnumberx664.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx664.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">errors</span><span id="lstnumberx664.53" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx665" class="ltx_listingline">
<span id="lstnumberx665.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx665.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx665.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx665.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Example</span><span id="lstnumberx665.5" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx666" class="ltx_listingline">
<span id="lstnumberx666.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx666.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx666.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">using</span><span id="lstnumberx666.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.6" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx666.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sqrt</span><span id="lstnumberx666.8" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx666.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">from</span><span id="lstnumberx666.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.12" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx666.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">math</span><span id="lstnumberx666.14" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx666.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">library</span><span id="lstnumberx666.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx666.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx666.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx666.23" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx666.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx666.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.27" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx666.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">from</span><span id="lstnumberx666.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">math</span><span id="lstnumberx666.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">import</span><span id="lstnumberx666.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sqrt</span><span id="lstnumberx666.35" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx666.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx666.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">present</span><span id="lstnumberx666.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">at</span><span id="lstnumberx666.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx666.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx666.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">beginning</span><span id="lstnumberx666.46" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx667" class="ltx_listingline">
</div>
<div id="lstnumberx668" class="ltx_listingline">
<span id="lstnumberx668.1" class="ltx_text ltx_font_typewriter">5.</span><span id="lstnumberx668.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx668.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx668.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx668.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx668.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx668.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">does</span><span id="lstnumberx668.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx668.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx668.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx668.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">use</span><span id="lstnumberx668.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx668.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">any</span><span id="lstnumberx668.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx668.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">library</span><span id="lstnumberx668.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx668.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx668.18" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx669" class="ltx_listingline">
<span id="lstnumberx669.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx669.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx669.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx669.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">problem</span><span id="lstnumberx669.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx669.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx669.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">designed</span><span id="lstnumberx669.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx669.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx669.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">way</span><span id="lstnumberx669.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx669.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requires</span><span id="lstnumberx669.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx669.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">usage</span><span id="lstnumberx669.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx669.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">library</span><span id="lstnumberx669.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx669.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx669.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">solve</span><span id="lstnumberx669.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx669.39" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx669.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensuring</span><span id="lstnumberx669.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx669.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">challenge</span><span id="lstnumberx669.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx669.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">integrating</span><span id="lstnumberx669.50" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.51" class="ltx_text ltx_lst_identifier ltx_font_typewriter">external</span><span id="lstnumberx669.52" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx669.53" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tools</span><span id="lstnumberx669.54" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx670" class="ltx_listingline">
<span id="lstnumberx670.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx670.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx670.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx670.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Example</span><span id="lstnumberx670.5" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx671" class="ltx_listingline">
<span id="lstnumberx671.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx671.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx671.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx671.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">problem</span><span id="lstnumberx671.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx671.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx671.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">calculate</span><span id="lstnumberx671.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx671.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">square</span><span id="lstnumberx671.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">root</span><span id="lstnumberx671.19" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx671.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx671.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">solution</span><span id="lstnumberx671.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx671.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">leverage</span><span id="lstnumberx671.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx671.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.31" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx671.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">math</span><span id="lstnumberx671.33" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx671.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sqrt</span><span id="lstnumberx671.35" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx671.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx671.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx671.38" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx672" class="ltx_listingline">
</div>
<div id="lstnumberx673" class="ltx_listingline">
<span id="lstnumberx673.1" class="ltx_text ltx_font_typewriter">6.</span><span id="lstnumberx673.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx673.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx673.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx673.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx673.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx673.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx673.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx673.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx673.15" class="ltx_text ltx_font_typewriter">‘,</span><span id="lstnumberx673.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">but</span><span id="lstnumberx673.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">does</span><span id="lstnumberx673.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx673.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pass</span><span id="lstnumberx673.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx673.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx673.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx673.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx673.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.33" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx673.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx673.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx673.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Parameters</span><span id="lstnumberx673.37" class="ltx_text ltx_font_typewriter">‘:</span>
</div>
<div id="lstnumberx674" class="ltx_listingline">
<span id="lstnumberx674.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx674.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx674.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">When</span><span id="lstnumberx674.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">using</span><span id="lstnumberx674.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx674.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionalities</span><span id="lstnumberx674.11" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx674.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx674.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">reproducibility</span><span id="lstnumberx674.16" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx674.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">it</span><span id="lstnumberx674.19" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx674.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">s</span><span id="lstnumberx674.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">good</span><span id="lstnumberx674.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">practice</span><span id="lstnumberx674.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx674.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">allow</span><span id="lstnumberx674.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx674.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">user</span><span id="lstnumberx674.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx674.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">set</span><span id="lstnumberx674.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx674.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx674.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx674.41" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx675" class="ltx_listingline">
<span id="lstnumberx675.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx675.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx675.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx675.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Example</span><span id="lstnumberx675.5" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx676" class="ltx_listingline">
<span id="lstnumberx676.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx676.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Before</span><span id="lstnumberx676.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx676.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx676.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx676.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx676.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx676.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">randint</span><span id="lstnumberx676.9" class="ltx_text ltx_font_typewriter">(1,10)‘</span>
</div>
<div id="lstnumberx677" class="ltx_listingline">
<span id="lstnumberx677.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx677.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">After</span><span id="lstnumberx677.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx677.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx677.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx677.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx677.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx677.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx677.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx677.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx677.11" class="ltx_text ltx_font_typewriter">);</span><span id="lstnumberx677.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx677.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx677.14" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx677.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">randint</span><span id="lstnumberx677.16" class="ltx_text ltx_font_typewriter">(1,10)‘</span>
</div>
<div id="lstnumberx678" class="ltx_listingline">
</div>
<div id="lstnumberx679" class="ltx_listingline">
<span id="lstnumberx679.1" class="ltx_text ltx_font_typewriter">7.</span><span id="lstnumberx679.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx679.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx679.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx679.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx679.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx679.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx679.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx679.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dummy</span><span id="lstnumberx679.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx679.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx679.12" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx680" class="ltx_listingline">
<span id="lstnumberx680.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx680.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx680.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Placeholder</span><span id="lstnumberx680.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx680.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dummy</span><span id="lstnumberx680.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx680.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx680.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx680.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">replaced</span><span id="lstnumberx680.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx680.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">actual</span><span id="lstnumberx680.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx680.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx680.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx680.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx680.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx680.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">works</span><span id="lstnumberx680.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx680.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx680.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected</span><span id="lstnumberx680.37" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx681" class="ltx_listingline">
<span id="lstnumberx681.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx681.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx681.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx681.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Example</span><span id="lstnumberx681.5" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx682" class="ltx_listingline">
<span id="lstnumberx682.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx682.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Before</span><span id="lstnumberx682.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx682.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx682.5" class="ltx_text ltx_font_typewriter">‘#</span><span id="lstnumberx682.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx682.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TODO</span><span id="lstnumberx682.8" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx682.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx682.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Implement</span><span id="lstnumberx682.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx682.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">this</span><span id="lstnumberx682.13" class="ltx_text ltx_font_typewriter">‘</span>
</div>
<div id="lstnumberx683" class="ltx_listingline">
<span id="lstnumberx683.1" class="ltx_text ltx_lst_space ltx_font_typewriter">      </span><span id="lstnumberx683.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">After</span><span id="lstnumberx683.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx683.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx683.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Actual</span><span id="lstnumberx683.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx683.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">implementation</span><span id="lstnumberx683.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx683.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx683.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx683.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx683.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx683.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">required</span><span id="lstnumberx683.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx683.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">logic</span><span id="lstnumberx683.16" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx684" class="ltx_listingline">
</div>
<div id="lstnumberx685" class="ltx_listingline">
<span id="lstnumberx685.1" class="ltx_text ltx_font_typewriter">8.</span><span id="lstnumberx685.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx685.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Unused</span><span id="lstnumberx685.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx685.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">global</span><span id="lstnumberx685.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx685.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">constants</span><span id="lstnumberx685.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx685.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">before</span><span id="lstnumberx685.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx685.11" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx685.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Problem</span><span id="lstnumberx685.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx685.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Function</span><span id="lstnumberx685.15" class="ltx_text ltx_font_typewriter">‘:</span>
</div>
<div id="lstnumberx686" class="ltx_listingline">
<span id="lstnumberx686.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx686.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx686.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Any</span><span id="lstnumberx686.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">constants</span><span id="lstnumberx686.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx686.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">variables</span><span id="lstnumberx686.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx686.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx686.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx686.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx686.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx686.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx686.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">solution</span><span id="lstnumberx686.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx686.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx686.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">removed</span><span id="lstnumberx686.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx686.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">clean</span><span id="lstnumberx686.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">up</span><span id="lstnumberx686.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx686.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx686.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">code</span><span id="lstnumberx686.41" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx687" class="ltx_listingline">
</div>
<div id="lstnumberx688" class="ltx_listingline">
<span id="lstnumberx688.1" class="ltx_text ltx_font_typewriter">9.</span><span id="lstnumberx688.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx688.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx688.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx688.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">uses</span><span id="lstnumberx688.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx688.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx688.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">APIs</span><span id="lstnumberx688.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx688.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx688.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx688.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">included</span><span id="lstnumberx688.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx688.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.25" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx688.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Import</span><span id="lstnumberx688.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx688.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Statement</span><span id="lstnumberx688.29" class="ltx_text ltx_font_typewriter">‘:</span>
</div>
<div id="lstnumberx689" class="ltx_listingline">
<span id="lstnumberx689.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx689.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx689.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Similar</span><span id="lstnumberx689.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx689.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx689.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">solution</span><span id="lstnumberx689.11" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx689.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx689.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">external</span><span id="lstnumberx689.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">libraries</span><span id="lstnumberx689.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx689.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functions</span><span id="lstnumberx689.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx689.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx689.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx689.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx689.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx689.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx689.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx689.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx689.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imported</span><span id="lstnumberx689.38" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx690" class="ltx_listingline">
</div>
<div id="lstnumberx691" class="ltx_listingline">
<span id="lstnumberx691.1" class="ltx_text ltx_font_typewriter">10.</span><span id="lstnumberx691.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx691.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx691.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx691.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">contains</span><span id="lstnumberx691.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx691.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx691.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx691.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">do</span><span id="lstnumberx691.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx691.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">work</span><span id="lstnumberx691.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx691.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx691.23" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx691.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx691.25" class="ltx_text ltx_font_typewriter">‘:</span>
</div>
<div id="lstnumberx692" class="ltx_listingline">
<span id="lstnumberx692.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx692.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx692.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">All</span><span id="lstnumberx692.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx692.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx692.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx692.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx692.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">aligned</span><span id="lstnumberx692.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx692.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx692.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx692.21" class="ltx_text ltx_font_typewriter">’</span><span id="lstnumberx692.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">s</span><span id="lstnumberx692.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">behavior</span><span id="lstnumberx692.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx692.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx692.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">they</span><span id="lstnumberx692.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx692.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx692.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx692.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx692.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">correctly</span><span id="lstnumberx692.39" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx693" class="ltx_listingline">
</div>
<div id="lstnumberx694" class="ltx_listingline">
<span id="lstnumberx694.1" class="ltx_text ltx_font_typewriter">11.</span><span id="lstnumberx694.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx694.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx694.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx694.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">does</span><span id="lstnumberx694.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx694.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx694.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx694.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx694.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx694.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx694.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returned</span><span id="lstnumberx694.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx694.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">object</span><span id="lstnumberx694.24" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx695" class="ltx_listingline">
<span id="lstnumberx695.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx695.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx695.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx695.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx695.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx695.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">returns</span><span id="lstnumberx695.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">an</span><span id="lstnumberx695.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">object</span><span id="lstnumberx695.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx695.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">multiple</span><span id="lstnumberx695.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx695.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx695.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">methods</span><span id="lstnumberx695.25" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx695.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx695.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx695.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx695.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx695.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">validate</span><span id="lstnumberx695.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx695.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx695.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx695.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx695.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx695.46" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.47" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complete</span><span id="lstnumberx695.48" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.49" class="ltx_text ltx_lst_identifier ltx_font_typewriter">coverage</span><span id="lstnumberx695.50" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx695.51" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.52" class="ltx_text ltx_lst_identifier ltx_font_typewriter">For</span><span id="lstnumberx695.53" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.54" class="ltx_text ltx_lst_identifier ltx_font_typewriter">example</span><span id="lstnumberx695.55" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx695.56" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.57" class="ltx_text ltx_lst_identifier ltx_font_typewriter">when</span><span id="lstnumberx695.58" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.59" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plotting</span><span id="lstnumberx695.60" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.61" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx695.62" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.63" class="ltx_text ltx_lst_identifier ltx_font_typewriter">on</span><span id="lstnumberx695.64" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.65" class="ltx_text ltx_lst_identifier ltx_font_typewriter">a</span><span id="lstnumberx695.66" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.67" class="ltx_text ltx_lst_identifier ltx_font_typewriter">graph</span><span id="lstnumberx695.68" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx695.69" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.70" class="ltx_text ltx_lst_identifier ltx_font_typewriter">you</span><span id="lstnumberx695.71" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.72" class="ltx_text ltx_lst_identifier ltx_font_typewriter">might</span><span id="lstnumberx695.73" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.74" class="ltx_text ltx_lst_identifier ltx_font_typewriter">get</span><span id="lstnumberx695.75" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.76" class="ltx_text ltx_lst_identifier ltx_font_typewriter">an</span><span id="lstnumberx695.77" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.78" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx695.79" class="ltx_text ltx_lst_identifier ltx_font_typewriter">AxesSubplot</span><span id="lstnumberx695.80" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx695.81" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.82" class="ltx_text ltx_lst_identifier ltx_font_typewriter">object</span><span id="lstnumberx695.83" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.84" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx695.85" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.86" class="ltx_text ltx_lst_identifier ltx_font_typewriter">return</span><span id="lstnumberx695.87" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx695.88" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.89" class="ltx_text ltx_lst_identifier ltx_font_typewriter">This</span><span id="lstnumberx695.90" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.91" class="ltx_text ltx_lst_identifier ltx_font_typewriter">object</span><span id="lstnumberx695.92" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.93" class="ltx_text ltx_lst_identifier ltx_font_typewriter">has</span><span id="lstnumberx695.94" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.95" class="ltx_text ltx_lst_identifier ltx_font_typewriter">various</span><span id="lstnumberx695.96" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.97" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx695.98" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx695.99" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.100" class="ltx_text ltx_lst_identifier ltx_font_typewriter">like</span><span id="lstnumberx695.101" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.102" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx695.103" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.104" class="ltx_text ltx_lst_identifier ltx_font_typewriter">title</span><span id="lstnumberx695.105" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx695.106" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.107" class="ltx_text ltx_lst_identifier ltx_font_typewriter">x</span><span id="lstnumberx695.108" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx695.109" class="ltx_text ltx_lst_identifier ltx_font_typewriter">label</span><span id="lstnumberx695.110" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx695.111" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.112" class="ltx_text ltx_lst_identifier ltx_font_typewriter">y</span><span id="lstnumberx695.113" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx695.114" class="ltx_text ltx_lst_identifier ltx_font_typewriter">label</span><span id="lstnumberx695.115" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx695.116" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.117" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx695.118" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.119" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx695.120" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.121" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx695.122" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.123" class="ltx_text ltx_lst_identifier ltx_font_typewriter">points</span><span id="lstnumberx695.124" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.125" class="ltx_text ltx_lst_identifier ltx_font_typewriter">themselves</span><span id="lstnumberx695.126" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx695.127" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.128" class="ltx_text ltx_lst_identifier ltx_font_typewriter">You</span><span id="lstnumberx695.129" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.130" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx695.131" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.132" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx695.133" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.134" class="ltx_text ltx_lst_identifier ltx_font_typewriter">all</span><span id="lstnumberx695.135" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.136" class="ltx_text ltx_lst_identifier ltx_font_typewriter">of</span><span id="lstnumberx695.137" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.138" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx695.139" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.140" class="ltx_text ltx_lst_identifier ltx_font_typewriter">attributes</span><span id="lstnumberx695.141" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.142" class="ltx_text ltx_lst_identifier ltx_font_typewriter">if</span><span id="lstnumberx695.143" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.144" class="ltx_text ltx_lst_identifier ltx_font_typewriter">they</span><span id="lstnumberx695.145" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.146" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx695.147" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.148" class="ltx_text ltx_lst_identifier ltx_font_typewriter">required</span><span id="lstnumberx695.149" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.150" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx695.151" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.152" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx695.153" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx695.154" class="ltx_text ltx_lst_identifier ltx_font_typewriter">functionality</span><span id="lstnumberx695.155" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx696" class="ltx_listingline">
</div>
<div id="lstnumberx697" class="ltx_listingline">
<span id="lstnumberx697.1" class="ltx_text ltx_font_typewriter">12.</span><span id="lstnumberx697.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx697.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx697.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx697.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">does</span><span id="lstnumberx697.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">not</span><span id="lstnumberx697.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx697.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx697.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">files</span><span id="lstnumberx697.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">that</span><span id="lstnumberx697.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">result</span><span id="lstnumberx697.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx697.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx697.23" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx697.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Solution</span><span id="lstnumberx697.25" class="ltx_text ltx_font_typewriter">‘:</span>
</div>
<div id="lstnumberx698" class="ltx_listingline">
<span id="lstnumberx698.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx698.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx698.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">If</span><span id="lstnumberx698.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx698.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx698.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">creates</span><span id="lstnumberx698.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx698.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">modifies</span><span id="lstnumberx698.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">files</span><span id="lstnumberx698.17" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx698.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx698.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx698.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx698.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx698.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">validate</span><span id="lstnumberx698.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx698.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.31" class="ltx_text ltx_lst_identifier ltx_font_typewriter">files</span><span id="lstnumberx698.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx698.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx698.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx698.38" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.39" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx698.40" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.41" class="ltx_text ltx_lst_identifier ltx_font_typewriter">works</span><span id="lstnumberx698.42" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.43" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx698.44" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx698.45" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected</span><span id="lstnumberx698.46" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx699" class="ltx_listingline">
</div>
<div id="lstnumberx700" class="ltx_listingline">
<span id="lstnumberx700.1" class="ltx_text ltx_font_typewriter">13.</span><span id="lstnumberx700.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx700.3" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx700.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx700.5" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx700.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx700.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx700.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx700.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wrapped</span><span id="lstnumberx700.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx700.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx700.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx700.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx700.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run_tests</span><span id="lstnumberx700.15" class="ltx_text ltx_font_typewriter">‘:</span>
</div>
<div id="lstnumberx701" class="ltx_listingline">
<span id="lstnumberx701.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx701.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx701.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">The</span><span id="lstnumberx701.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx701.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx701.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx701.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx701.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">function</span><span id="lstnumberx701.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx701.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run</span><span id="lstnumberx701.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">them</span><span id="lstnumberx701.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx701.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx701.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">separated</span><span id="lstnumberx701.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx701.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx701.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">clarity</span><span id="lstnumberx701.31" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx702" class="ltx_listingline">
</div>
<div id="lstnumberx703" class="ltx_listingline">
<span id="lstnumberx703.1" class="ltx_text ltx_font_typewriter">14.</span><span id="lstnumberx703.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx703.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx703.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx703.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.9" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx703.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx703.11" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx703.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">are</span><span id="lstnumberx703.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">duplicated</span><span id="lstnumberx703.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx703.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx703.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx703.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx703.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx703.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.27" class="ltx_text ltx_lst_identifier ltx_font_typewriter">same</span><span id="lstnumberx703.28" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx703.29" class="ltx_text ltx_lst_identifier ltx_font_typewriter">behavior</span><span id="lstnumberx703.30" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx704" class="ltx_listingline">
<span id="lstnumberx704.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx704.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx704.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Redundant</span><span id="lstnumberx704.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx704.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx704.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx704.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx704.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">removed</span><span id="lstnumberx704.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx704.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">keep</span><span id="lstnumberx704.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx704.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx704.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">suite</span><span id="lstnumberx704.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">concise</span><span id="lstnumberx704.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">and</span><span id="lstnumberx704.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx704.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">focused</span><span id="lstnumberx704.31" class="ltx_text ltx_font_typewriter">.</span>
</div>
<div id="lstnumberx705" class="ltx_listingline">
</div>
<div id="lstnumberx706" class="ltx_listingline">
<span id="lstnumberx706.1" class="ltx_text ltx_font_typewriter">15.</span><span id="lstnumberx706.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx706.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Test</span><span id="lstnumberx706.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx706.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx706.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx706.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">used</span><span id="lstnumberx706.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx706.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">in</span><span id="lstnumberx706.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx706.11" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx706.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">TestCases</span><span id="lstnumberx706.13" class="ltx_text ltx_font_typewriter">‘</span><span id="lstnumberx706.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx706.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">is</span><span id="lstnumberx706.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx706.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">missing</span><span id="lstnumberx706.18" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx707" class="ltx_listingline">
<span id="lstnumberx707.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx707.2" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx707.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">All</span><span id="lstnumberx707.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">required</span><span id="lstnumberx707.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx707.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">for</span><span id="lstnumberx707.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">testing</span><span id="lstnumberx707.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">should</span><span id="lstnumberx707.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">be</span><span id="lstnumberx707.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">provided</span><span id="lstnumberx707.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">or</span><span id="lstnumberx707.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.22" class="ltx_text ltx_lst_identifier ltx_font_typewriter">generated</span><span id="lstnumberx707.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">to</span><span id="lstnumberx707.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ensure</span><span id="lstnumberx707.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">the</span><span id="lstnumberx707.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.30" class="ltx_text ltx_lst_identifier ltx_font_typewriter">test</span><span id="lstnumberx707.31" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.32" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cases</span><span id="lstnumberx707.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.34" class="ltx_text ltx_lst_identifier ltx_font_typewriter">can</span><span id="lstnumberx707.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.36" class="ltx_text ltx_lst_identifier ltx_font_typewriter">run</span><span id="lstnumberx707.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.38" class="ltx_text ltx_lst_identifier ltx_font_typewriter">without</span><span id="lstnumberx707.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx707.40" class="ltx_text ltx_lst_identifier ltx_font_typewriter">issues</span><span id="lstnumberx707.41" class="ltx_text ltx_font_typewriter">.</span>
</div>
</div>
</div>
</section>
</section>
<section id="A8" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix H </span>Evaluation Setup</h3>

<section id="A8.SS1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">H.1 </span>Inference</h4>

<div id="A8.SS1.p1" class="ltx_para ltx_noindent">
<p id="A8.SS1.p1.1" class="ltx_p">We perform all the model inference on A100 GPUs, except for the closed ones. For the closed models, we rely on their official APIs provided in the documents.</p>
</div>
</section>
<section id="A8.SS2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">H.2 </span>Execution</h4>

<div id="A8.SS2.p1" class="ltx_para ltx_noindent">
<p id="A8.SS2.p1.1" class="ltx_p">We conduct the execution mainly on the Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz, composed of 2 sockets, with 18 cores per socket.</p>
</div>
</section>
<section id="A8.SS3" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">H.3 </span>Prompt Template</h4>

<figure id="A8.F10" class="ltx_figure">
<p id="A8.F10.1" class="ltx_p">Please provide a self-contained Python script that solves the following problem in a markdown code block:

<br class="ltx_break"><span id="A8.F10.1.1" class="ltx_text ltx_font_typewriter">{prompt}</span></p>
<figcaption class="ltx_caption"><span class="ltx_tag ltx_tag_figure">Figure 10: </span>Prompt template for models supported by vLLM <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib31" title="" class="ltx_ref">31</a>]</cite>.</figcaption>
</figure>
<figure id="A8.F11" class="ltx_figure">
<p id="A8.F11.1" class="ltx_p">Please generate self-contained code to complete the following problem:

<br class="ltx_break"><span id="A8.F11.1.1" class="ltx_text ltx_font_typewriter">{prompt}</span></p>
<figcaption class="ltx_caption"><span class="ltx_tag ltx_tag_figure">Figure 11: </span>Prompt template for OpenAI/DeepSeek APIs.</figcaption>
</figure>
<figure id="A8.F12" class="ltx_figure">
<p id="A8.F12.1" class="ltx_p">Please generate self-contained code to solve the following problem in a Python markdown block:

<br class="ltx_break"><span id="A8.F12.1.1" class="ltx_text ltx_font_typewriter">{prompt}</span></p>
<figcaption class="ltx_caption"><span class="ltx_tag ltx_tag_figure">Figure 12: </span>Prompt template for Mistral model APIs.</figcaption>
</figure>
<figure id="A8.F13" class="ltx_figure">
<p id="A8.F13.1" class="ltx_p">Please generate self-contained code to complete the following problem wrapped in a Python markdown block:

<br class="ltx_break"><span id="A8.F13.1.1" class="ltx_text ltx_font_typewriter">{prompt}</span></p>
<figcaption class="ltx_caption"><span class="ltx_tag ltx_tag_figure">Figure 13: </span>Prompt template for Anthropic model APIs.</figcaption>
</figure>
</section>
</section>
<section id="A9" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix I </span>Detailed Benchmarking Results and Analysis</h3>

<section id="A9.SS1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">I.1 </span>Detailed Results</h4>

<figure id="A9.T6" class="ltx_table">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_table">Table 6: </span>Evaluating LLMs on <span id="A9.T6.5.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A9.T6.6.2" class="ltx_text ltx_font_typewriter">Complete</span>. Due to the training flaws in StarCoder2 and Granite-Code, we additionally strip the trailing newlines for model inference.</figcaption>
<div id="A9.T6.2" class="ltx_inline-block ltx_align_center ltx_transformed_outer" style="width:294.9pt;height:662.3pt;vertical-align:-0.0pt;"><span class="ltx_transformed_inner" style="transform:translate(-109.0pt,244.8pt) scale(0.574932681237758,0.574932681237758) ;">
<table id="A9.T6.2.2" class="ltx_tabular ltx_align_middle">
<tr id="A9.T6.2.2.3" class="ltx_tr">
<td id="A9.T6.2.2.3.1" class="ltx_td ltx_align_left ltx_border_tt" rowspan="2"><span id="A9.T6.2.2.3.1.1" class="ltx_text ltx_font_bold">Model</span></td>
<td id="A9.T6.2.2.3.2" class="ltx_td ltx_align_right ltx_border_tt" rowspan="2"><span id="A9.T6.2.2.3.2.1" class="ltx_text ltx_font_bold">Size / Checkpoint</span></td>
<td id="A9.T6.2.2.3.3" class="ltx_td ltx_align_center ltx_border_tt" colspan="2"><span id="A9.T6.2.2.3.3.1" class="ltx_text ltx_font_bold">Greedy Decoding</span></td>
<td id="A9.T6.2.2.3.4" class="ltx_td ltx_align_center ltx_border_tt" colspan="2"><span id="A9.T6.2.2.3.4.1" class="ltx_text ltx_font_bold">Random Sampling</span></td>
</tr>
<tr id="A9.T6.2.2.2" class="ltx_tr">
<td id="A9.T6.2.2.2.3" class="ltx_td ltx_align_center">Original</td>
<td id="A9.T6.2.2.2.4" class="ltx_td ltx_align_center">Calibrated</td>
<td id="A9.T6.1.1.1.1" class="ltx_td ltx_align_center"><math id="A9.T6.1.1.1.1.m1.1" class="ltx_Math" alttext="Pass@1" display="inline"><semantics id="A9.T6.1.1.1.1.m1.1a"><mrow id="A9.T6.1.1.1.1.m1.1.1" xref="A9.T6.1.1.1.1.m1.1.1.cmml"><mi id="A9.T6.1.1.1.1.m1.1.1.2" xref="A9.T6.1.1.1.1.m1.1.1.2.cmml">P</mi><mo lspace="0em" rspace="0em" id="A9.T6.1.1.1.1.m1.1.1.1" xref="A9.T6.1.1.1.1.m1.1.1.1.cmml">​</mo><mi id="A9.T6.1.1.1.1.m1.1.1.3" xref="A9.T6.1.1.1.1.m1.1.1.3.cmml">a</mi><mo lspace="0em" rspace="0em" id="A9.T6.1.1.1.1.m1.1.1.1a" xref="A9.T6.1.1.1.1.m1.1.1.1.cmml">​</mo><mi id="A9.T6.1.1.1.1.m1.1.1.4" xref="A9.T6.1.1.1.1.m1.1.1.4.cmml">s</mi><mo lspace="0em" rspace="0em" id="A9.T6.1.1.1.1.m1.1.1.1b" xref="A9.T6.1.1.1.1.m1.1.1.1.cmml">​</mo><mi id="A9.T6.1.1.1.1.m1.1.1.5" xref="A9.T6.1.1.1.1.m1.1.1.5.cmml">s</mi><mo lspace="0em" rspace="0em" id="A9.T6.1.1.1.1.m1.1.1.1c" xref="A9.T6.1.1.1.1.m1.1.1.1.cmml">​</mo><mi mathvariant="normal" id="A9.T6.1.1.1.1.m1.1.1.6" xref="A9.T6.1.1.1.1.m1.1.1.6.cmml">@</mi><mo lspace="0em" rspace="0em" id="A9.T6.1.1.1.1.m1.1.1.1d" xref="A9.T6.1.1.1.1.m1.1.1.1.cmml">​</mo><mn id="A9.T6.1.1.1.1.m1.1.1.7" xref="A9.T6.1.1.1.1.m1.1.1.7.cmml">1</mn></mrow><annotation-xml encoding="MathML-Content" id="A9.T6.1.1.1.1.m1.1b"><apply id="A9.T6.1.1.1.1.m1.1.1.cmml" xref="A9.T6.1.1.1.1.m1.1.1"><times id="A9.T6.1.1.1.1.m1.1.1.1.cmml" xref="A9.T6.1.1.1.1.m1.1.1.1"></times><ci id="A9.T6.1.1.1.1.m1.1.1.2.cmml" xref="A9.T6.1.1.1.1.m1.1.1.2">𝑃</ci><ci id="A9.T6.1.1.1.1.m1.1.1.3.cmml" xref="A9.T6.1.1.1.1.m1.1.1.3">𝑎</ci><ci id="A9.T6.1.1.1.1.m1.1.1.4.cmml" xref="A9.T6.1.1.1.1.m1.1.1.4">𝑠</ci><ci id="A9.T6.1.1.1.1.m1.1.1.5.cmml" xref="A9.T6.1.1.1.1.m1.1.1.5">𝑠</ci><ci id="A9.T6.1.1.1.1.m1.1.1.6.cmml" xref="A9.T6.1.1.1.1.m1.1.1.6">@</ci><cn type="integer" id="A9.T6.1.1.1.1.m1.1.1.7.cmml" xref="A9.T6.1.1.1.1.m1.1.1.7">1</cn></apply></annotation-xml><annotation encoding="application/x-tex" id="A9.T6.1.1.1.1.m1.1c">Pass@1</annotation></semantics></math></td>
<td id="A9.T6.2.2.2.2" class="ltx_td ltx_align_center"><math id="A9.T6.2.2.2.2.m1.1" class="ltx_Math" alttext="Pass@5" display="inline"><semantics id="A9.T6.2.2.2.2.m1.1a"><mrow id="A9.T6.2.2.2.2.m1.1.1" xref="A9.T6.2.2.2.2.m1.1.1.cmml"><mi id="A9.T6.2.2.2.2.m1.1.1.2" xref="A9.T6.2.2.2.2.m1.1.1.2.cmml">P</mi><mo lspace="0em" rspace="0em" id="A9.T6.2.2.2.2.m1.1.1.1" xref="A9.T6.2.2.2.2.m1.1.1.1.cmml">​</mo><mi id="A9.T6.2.2.2.2.m1.1.1.3" xref="A9.T6.2.2.2.2.m1.1.1.3.cmml">a</mi><mo lspace="0em" rspace="0em" id="A9.T6.2.2.2.2.m1.1.1.1a" xref="A9.T6.2.2.2.2.m1.1.1.1.cmml">​</mo><mi id="A9.T6.2.2.2.2.m1.1.1.4" xref="A9.T6.2.2.2.2.m1.1.1.4.cmml">s</mi><mo lspace="0em" rspace="0em" id="A9.T6.2.2.2.2.m1.1.1.1b" xref="A9.T6.2.2.2.2.m1.1.1.1.cmml">​</mo><mi id="A9.T6.2.2.2.2.m1.1.1.5" xref="A9.T6.2.2.2.2.m1.1.1.5.cmml">s</mi><mo lspace="0em" rspace="0em" id="A9.T6.2.2.2.2.m1.1.1.1c" xref="A9.T6.2.2.2.2.m1.1.1.1.cmml">​</mo><mi mathvariant="normal" id="A9.T6.2.2.2.2.m1.1.1.6" xref="A9.T6.2.2.2.2.m1.1.1.6.cmml">@</mi><mo lspace="0em" rspace="0em" id="A9.T6.2.2.2.2.m1.1.1.1d" xref="A9.T6.2.2.2.2.m1.1.1.1.cmml">​</mo><mn id="A9.T6.2.2.2.2.m1.1.1.7" xref="A9.T6.2.2.2.2.m1.1.1.7.cmml">5</mn></mrow><annotation-xml encoding="MathML-Content" id="A9.T6.2.2.2.2.m1.1b"><apply id="A9.T6.2.2.2.2.m1.1.1.cmml" xref="A9.T6.2.2.2.2.m1.1.1"><times id="A9.T6.2.2.2.2.m1.1.1.1.cmml" xref="A9.T6.2.2.2.2.m1.1.1.1"></times><ci id="A9.T6.2.2.2.2.m1.1.1.2.cmml" xref="A9.T6.2.2.2.2.m1.1.1.2">𝑃</ci><ci id="A9.T6.2.2.2.2.m1.1.1.3.cmml" xref="A9.T6.2.2.2.2.m1.1.1.3">𝑎</ci><ci id="A9.T6.2.2.2.2.m1.1.1.4.cmml" xref="A9.T6.2.2.2.2.m1.1.1.4">𝑠</ci><ci id="A9.T6.2.2.2.2.m1.1.1.5.cmml" xref="A9.T6.2.2.2.2.m1.1.1.5">𝑠</ci><ci id="A9.T6.2.2.2.2.m1.1.1.6.cmml" xref="A9.T6.2.2.2.2.m1.1.1.6">@</ci><cn type="integer" id="A9.T6.2.2.2.2.m1.1.1.7.cmml" xref="A9.T6.2.2.2.2.m1.1.1.7">5</cn></apply></annotation-xml><annotation encoding="application/x-tex" id="A9.T6.2.2.2.2.m1.1c">Pass@5</annotation></semantics></math></td>
</tr>
<tr id="A9.T6.2.2.4" class="ltx_tr">
<td id="A9.T6.2.2.4.1" class="ltx_td ltx_align_center ltx_border_t" colspan="6"><span id="A9.T6.2.2.4.1.1" class="ltx_text ltx_font_italic">Instruction-tuned LLMs</span></td>
</tr>
<tr id="A9.T6.2.2.5" class="ltx_tr">
<td id="A9.T6.2.2.5.1" class="ltx_td ltx_align_left ltx_border_t">GPT-4o <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib44" title="" class="ltx_ref">44</a>]</cite>
</td>
<td id="A9.T6.2.2.5.2" class="ltx_td ltx_align_right ltx_border_t">2024-05-13</td>
<td id="A9.T6.2.2.5.3" class="ltx_td ltx_align_center ltx_border_t">0.602</td>
<td id="A9.T6.2.2.5.4" class="ltx_td ltx_align_center ltx_border_t">0.611</td>
<td id="A9.T6.2.2.5.5" class="ltx_td ltx_align_center ltx_border_t">0.557</td>
<td id="A9.T6.2.2.5.6" class="ltx_td ltx_align_center ltx_border_t">0.711</td>
</tr>
<tr id="A9.T6.2.2.6" class="ltx_tr">
<td id="A9.T6.2.2.6.1" class="ltx_td ltx_align_left ltx_border_t">GPT-4-Turbo <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib43" title="" class="ltx_ref">43</a>]</cite>
</td>
<td id="A9.T6.2.2.6.2" class="ltx_td ltx_align_right ltx_border_t">2024-04-09</td>
<td id="A9.T6.2.2.6.3" class="ltx_td ltx_align_center ltx_border_t">0.582</td>
<td id="A9.T6.2.2.6.4" class="ltx_td ltx_align_center ltx_border_t">0.582</td>
<td id="A9.T6.2.2.6.5" class="ltx_td ltx_align_center ltx_border_t">0.563</td>
<td id="A9.T6.2.2.6.6" class="ltx_td ltx_align_center ltx_border_t">0.699</td>
</tr>
<tr id="A9.T6.2.2.7" class="ltx_tr">
<td id="A9.T6.2.2.7.1" class="ltx_td ltx_align_left ltx_border_t">GPT-4 <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib1" title="" class="ltx_ref">1</a>]</cite>
</td>
<td id="A9.T6.2.2.7.2" class="ltx_td ltx_align_right ltx_border_t">0613</td>
<td id="A9.T6.2.2.7.3" class="ltx_td ltx_align_center ltx_border_t">0.484</td>
<td id="A9.T6.2.2.7.4" class="ltx_td ltx_align_center ltx_border_t">0.572</td>
<td id="A9.T6.2.2.7.5" class="ltx_td ltx_align_center ltx_border_t">0.407</td>
<td id="A9.T6.2.2.7.6" class="ltx_td ltx_align_center ltx_border_t">0.682</td>
</tr>
<tr id="A9.T6.2.2.8" class="ltx_tr">
<td id="A9.T6.2.2.8.1" class="ltx_td ltx_align_left ltx_border_t">GPT-3.5-Turbo <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib42" title="" class="ltx_ref">42</a>]</cite>
</td>
<td id="A9.T6.2.2.8.2" class="ltx_td ltx_align_right ltx_border_t">0125</td>
<td id="A9.T6.2.2.8.3" class="ltx_td ltx_align_center ltx_border_t">0.506</td>
<td id="A9.T6.2.2.8.4" class="ltx_td ltx_align_center ltx_border_t">0.506</td>
<td id="A9.T6.2.2.8.5" class="ltx_td ltx_align_center ltx_border_t">0.504</td>
<td id="A9.T6.2.2.8.6" class="ltx_td ltx_align_center ltx_border_t">0.657</td>
</tr>
<tr id="A9.T6.2.2.9" class="ltx_tr">
<td id="A9.T6.2.2.9.1" class="ltx_td ltx_align_left ltx_border_t">Claude-3 <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib8" title="" class="ltx_ref">8</a>]</cite>
</td>
<td id="A9.T6.2.2.9.2" class="ltx_td ltx_align_right ltx_border_t">Opus</td>
<td id="A9.T6.2.2.9.3" class="ltx_td ltx_align_center ltx_border_t">0.568</td>
<td id="A9.T6.2.2.9.4" class="ltx_td ltx_align_center ltx_border_t">0.574</td>
<td id="A9.T6.2.2.9.5" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.9.6" class="ltx_td ltx_align_center ltx_border_t">—</td>
</tr>
<tr id="A9.T6.2.2.10" class="ltx_tr">
<td id="A9.T6.2.2.10.1" class="ltx_td"></td>
<td id="A9.T6.2.2.10.2" class="ltx_td ltx_align_right">Sonnet</td>
<td id="A9.T6.2.2.10.3" class="ltx_td ltx_align_center">0.534</td>
<td id="A9.T6.2.2.10.4" class="ltx_td ltx_align_center">0.538</td>
<td id="A9.T6.2.2.10.5" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.10.6" class="ltx_td ltx_align_center">—</td>
</tr>
<tr id="A9.T6.2.2.11" class="ltx_tr">
<td id="A9.T6.2.2.11.1" class="ltx_td"></td>
<td id="A9.T6.2.2.11.2" class="ltx_td ltx_align_right">Haiku</td>
<td id="A9.T6.2.2.11.3" class="ltx_td ltx_align_center">0.486</td>
<td id="A9.T6.2.2.11.4" class="ltx_td ltx_align_center">0.501</td>
<td id="A9.T6.2.2.11.5" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.11.6" class="ltx_td ltx_align_center">—</td>
</tr>
<tr id="A9.T6.2.2.12" class="ltx_tr">
<td id="A9.T6.2.2.12.1" class="ltx_td ltx_align_left ltx_border_t">Mistral <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib2" title="" class="ltx_ref">2</a>]</cite>
</td>
<td id="A9.T6.2.2.12.2" class="ltx_td ltx_align_right ltx_border_t">Large</td>
<td id="A9.T6.2.2.12.3" class="ltx_td ltx_align_center ltx_border_t">0.379</td>
<td id="A9.T6.2.2.12.4" class="ltx_td ltx_align_center ltx_border_t">0.383</td>
<td id="A9.T6.2.2.12.5" class="ltx_td ltx_align_center ltx_border_t">0.365</td>
<td id="A9.T6.2.2.12.6" class="ltx_td ltx_align_center ltx_border_t">0.539</td>
</tr>
<tr id="A9.T6.2.2.13" class="ltx_tr">
<td id="A9.T6.2.2.13.1" class="ltx_td"></td>
<td id="A9.T6.2.2.13.2" class="ltx_td ltx_align_right">Small</td>
<td id="A9.T6.2.2.13.3" class="ltx_td ltx_align_center">0.390</td>
<td id="A9.T6.2.2.13.4" class="ltx_td ltx_align_center">0.413</td>
<td id="A9.T6.2.2.13.5" class="ltx_td ltx_align_center">0.398</td>
<td id="A9.T6.2.2.13.6" class="ltx_td ltx_align_center">0.601</td>
</tr>
<tr id="A9.T6.2.2.14" class="ltx_tr">
<td id="A9.T6.2.2.14.1" class="ltx_td ltx_align_left ltx_border_t">DeepSeek-Chat <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib16" title="" class="ltx_ref">16</a>]</cite>
</td>
<td id="A9.T6.2.2.14.2" class="ltx_td ltx_align_right ltx_border_t">V2</td>
<td id="A9.T6.2.2.14.3" class="ltx_td ltx_align_center ltx_border_t">0.494</td>
<td id="A9.T6.2.2.14.4" class="ltx_td ltx_align_center ltx_border_t">0.494</td>
<td id="A9.T6.2.2.14.5" class="ltx_td ltx_align_center ltx_border_t">0.482</td>
<td id="A9.T6.2.2.14.6" class="ltx_td ltx_align_center ltx_border_t">0.596</td>
</tr>
<tr id="A9.T6.2.2.15" class="ltx_tr">
<td id="A9.T6.2.2.15.1" class="ltx_td ltx_align_left ltx_border_t">DeepSeek-Coder-instruct <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib22" title="" class="ltx_ref">22</a>]</cite>
</td>
<td id="A9.T6.2.2.15.2" class="ltx_td ltx_align_right ltx_border_t">33B</td>
<td id="A9.T6.2.2.15.3" class="ltx_td ltx_align_center ltx_border_t">0.511</td>
<td id="A9.T6.2.2.15.4" class="ltx_td ltx_align_center ltx_border_t">0.511</td>
<td id="A9.T6.2.2.15.5" class="ltx_td ltx_align_center ltx_border_t">0.491</td>
<td id="A9.T6.2.2.15.6" class="ltx_td ltx_align_center ltx_border_t">0.687</td>
</tr>
<tr id="A9.T6.2.2.16" class="ltx_tr">
<td id="A9.T6.2.2.16.1" class="ltx_td"></td>
<td id="A9.T6.2.2.16.2" class="ltx_td ltx_align_right">6.7B</td>
<td id="A9.T6.2.2.16.3" class="ltx_td ltx_align_center">0.432</td>
<td id="A9.T6.2.2.16.4" class="ltx_td ltx_align_center">0.438</td>
<td id="A9.T6.2.2.16.5" class="ltx_td ltx_align_center">0.426</td>
<td id="A9.T6.2.2.16.6" class="ltx_td ltx_align_center">0.624</td>
</tr>
<tr id="A9.T6.2.2.17" class="ltx_tr">
<td id="A9.T6.2.2.17.1" class="ltx_td"></td>
<td id="A9.T6.2.2.17.2" class="ltx_td ltx_align_right">1.3B</td>
<td id="A9.T6.2.2.17.3" class="ltx_td ltx_align_center">0.293</td>
<td id="A9.T6.2.2.17.4" class="ltx_td ltx_align_center">0.296</td>
<td id="A9.T6.2.2.17.5" class="ltx_td ltx_align_center">0.270</td>
<td id="A9.T6.2.2.17.6" class="ltx_td ltx_align_center">0.468</td>
</tr>
<tr id="A9.T6.2.2.18" class="ltx_tr">
<td id="A9.T6.2.2.18.1" class="ltx_td ltx_align_left ltx_border_t">CodeLlama-instruct <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib52" title="" class="ltx_ref">52</a>]</cite>
</td>
<td id="A9.T6.2.2.18.2" class="ltx_td ltx_align_right ltx_border_t">70B</td>
<td id="A9.T6.2.2.18.3" class="ltx_td ltx_align_center ltx_border_t">0.489</td>
<td id="A9.T6.2.2.18.4" class="ltx_td ltx_align_center ltx_border_t">0.496</td>
<td id="A9.T6.2.2.18.5" class="ltx_td ltx_align_center ltx_border_t">0.429</td>
<td id="A9.T6.2.2.18.6" class="ltx_td ltx_align_center ltx_border_t">0.681</td>
</tr>
<tr id="A9.T6.2.2.19" class="ltx_tr">
<td id="A9.T6.2.2.19.1" class="ltx_td"></td>
<td id="A9.T6.2.2.19.2" class="ltx_td ltx_align_right">34B</td>
<td id="A9.T6.2.2.19.3" class="ltx_td ltx_align_center">0.351</td>
<td id="A9.T6.2.2.19.4" class="ltx_td ltx_align_center">0.356</td>
<td id="A9.T6.2.2.19.5" class="ltx_td ltx_align_center">0.266</td>
<td id="A9.T6.2.2.19.6" class="ltx_td ltx_align_center">0.518</td>
</tr>
<tr id="A9.T6.2.2.20" class="ltx_tr">
<td id="A9.T6.2.2.20.1" class="ltx_td"></td>
<td id="A9.T6.2.2.20.2" class="ltx_td ltx_align_right">13B</td>
<td id="A9.T6.2.2.20.3" class="ltx_td ltx_align_center">0.297</td>
<td id="A9.T6.2.2.20.4" class="ltx_td ltx_align_center">0.317</td>
<td id="A9.T6.2.2.20.5" class="ltx_td ltx_align_center">0.247</td>
<td id="A9.T6.2.2.20.6" class="ltx_td ltx_align_center">0.470</td>
</tr>
<tr id="A9.T6.2.2.21" class="ltx_tr">
<td id="A9.T6.2.2.21.1" class="ltx_td"></td>
<td id="A9.T6.2.2.21.2" class="ltx_td ltx_align_right">7B</td>
<td id="A9.T6.2.2.21.3" class="ltx_td ltx_align_center">0.254</td>
<td id="A9.T6.2.2.21.4" class="ltx_td ltx_align_center">0.257</td>
<td id="A9.T6.2.2.21.5" class="ltx_td ltx_align_center">0.193</td>
<td id="A9.T6.2.2.21.6" class="ltx_td ltx_align_center">0.403</td>
</tr>
<tr id="A9.T6.2.2.22" class="ltx_tr">
<td id="A9.T6.2.2.22.1" class="ltx_td ltx_align_left ltx_border_t">Llama3-instruct <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib5" title="" class="ltx_ref">5</a>]</cite>
</td>
<td id="A9.T6.2.2.22.2" class="ltx_td ltx_align_right ltx_border_t">70B</td>
<td id="A9.T6.2.2.22.3" class="ltx_td ltx_align_center ltx_border_t">0.539</td>
<td id="A9.T6.2.2.22.4" class="ltx_td ltx_align_center ltx_border_t">0.545</td>
<td id="A9.T6.2.2.22.5" class="ltx_td ltx_align_center ltx_border_t">0.522</td>
<td id="A9.T6.2.2.22.6" class="ltx_td ltx_align_center ltx_border_t">0.650</td>
</tr>
<tr id="A9.T6.2.2.23" class="ltx_tr">
<td id="A9.T6.2.2.23.1" class="ltx_td"></td>
<td id="A9.T6.2.2.23.2" class="ltx_td ltx_align_right">8B</td>
<td id="A9.T6.2.2.23.3" class="ltx_td ltx_align_center">0.368</td>
<td id="A9.T6.2.2.23.4" class="ltx_td ltx_align_center">0.369</td>
<td id="A9.T6.2.2.23.5" class="ltx_td ltx_align_center">0.338</td>
<td id="A9.T6.2.2.23.6" class="ltx_td ltx_align_center">0.562</td>
</tr>
<tr id="A9.T6.2.2.24" class="ltx_tr">
<td id="A9.T6.2.2.24.1" class="ltx_td ltx_align_left ltx_border_t">Qwen2-Instruct <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib10" title="" class="ltx_ref">10</a>]</cite>
</td>
<td id="A9.T6.2.2.24.2" class="ltx_td ltx_align_right ltx_border_t">72B</td>
<td id="A9.T6.2.2.24.3" class="ltx_td ltx_align_center ltx_border_t">0.539</td>
<td id="A9.T6.2.2.24.4" class="ltx_td ltx_align_center ltx_border_t">0.540</td>
<td id="A9.T6.2.2.24.5" class="ltx_td ltx_align_center ltx_border_t">0.489</td>
<td id="A9.T6.2.2.24.6" class="ltx_td ltx_align_center ltx_border_t">0.682</td>
</tr>
<tr id="A9.T6.2.2.25" class="ltx_tr">
<td id="A9.T6.2.2.25.1" class="ltx_td"></td>
<td id="A9.T6.2.2.25.2" class="ltx_td ltx_align_right">57B-A14B</td>
<td id="A9.T6.2.2.25.3" class="ltx_td ltx_align_center">0.465</td>
<td id="A9.T6.2.2.25.4" class="ltx_td ltx_align_center">0.468</td>
<td id="A9.T6.2.2.25.5" class="ltx_td ltx_align_center">0.399</td>
<td id="A9.T6.2.2.25.6" class="ltx_td ltx_align_center">0.648</td>
</tr>
<tr id="A9.T6.2.2.26" class="ltx_tr">
<td id="A9.T6.2.2.26.1" class="ltx_td"></td>
<td id="A9.T6.2.2.26.2" class="ltx_td ltx_align_right">7B</td>
<td id="A9.T6.2.2.26.3" class="ltx_td ltx_align_center">0.407</td>
<td id="A9.T6.2.2.26.4" class="ltx_td ltx_align_center">0.421</td>
<td id="A9.T6.2.2.26.5" class="ltx_td ltx_align_center">0.329</td>
<td id="A9.T6.2.2.26.6" class="ltx_td ltx_align_center">0.577</td>
</tr>
<tr id="A9.T6.2.2.27" class="ltx_tr">
<td id="A9.T6.2.2.27.1" class="ltx_td ltx_align_left ltx_border_t">CodeQwen1.5-Chat <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib10" title="" class="ltx_ref">10</a>]</cite>
</td>
<td id="A9.T6.2.2.27.2" class="ltx_td ltx_align_right ltx_border_t">7B</td>
<td id="A9.T6.2.2.27.3" class="ltx_td ltx_align_center ltx_border_t">0.437</td>
<td id="A9.T6.2.2.27.4" class="ltx_td ltx_align_center ltx_border_t">0.443</td>
<td id="A9.T6.2.2.27.5" class="ltx_td ltx_align_center ltx_border_t">0.408</td>
<td id="A9.T6.2.2.27.6" class="ltx_td ltx_align_center ltx_border_t">0.632</td>
</tr>
<tr id="A9.T6.2.2.28" class="ltx_tr">
<td id="A9.T6.2.2.28.1" class="ltx_td ltx_align_left ltx_border_t">Qwen1.5-Chat <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib10" title="" class="ltx_ref">10</a>]</cite>
</td>
<td id="A9.T6.2.2.28.2" class="ltx_td ltx_align_right ltx_border_t">110B</td>
<td id="A9.T6.2.2.28.3" class="ltx_td ltx_align_center ltx_border_t">0.432</td>
<td id="A9.T6.2.2.28.4" class="ltx_td ltx_align_center ltx_border_t">0.444</td>
<td id="A9.T6.2.2.28.5" class="ltx_td ltx_align_center ltx_border_t">0.425</td>
<td id="A9.T6.2.2.28.6" class="ltx_td ltx_align_center ltx_border_t">0.590</td>
</tr>
<tr id="A9.T6.2.2.29" class="ltx_tr">
<td id="A9.T6.2.2.29.1" class="ltx_td"></td>
<td id="A9.T6.2.2.29.2" class="ltx_td ltx_align_right">72B</td>
<td id="A9.T6.2.2.29.3" class="ltx_td ltx_align_center">0.398</td>
<td id="A9.T6.2.2.29.4" class="ltx_td ltx_align_center">0.403</td>
<td id="A9.T6.2.2.29.5" class="ltx_td ltx_align_center">0.373</td>
<td id="A9.T6.2.2.29.6" class="ltx_td ltx_align_center">0.569</td>
</tr>
<tr id="A9.T6.2.2.30" class="ltx_tr">
<td id="A9.T6.2.2.30.1" class="ltx_td"></td>
<td id="A9.T6.2.2.30.2" class="ltx_td ltx_align_right">32B</td>
<td id="A9.T6.2.2.30.3" class="ltx_td ltx_align_center">0.410</td>
<td id="A9.T6.2.2.30.4" class="ltx_td ltx_align_center">0.420</td>
<td id="A9.T6.2.2.30.5" class="ltx_td ltx_align_center">0.375</td>
<td id="A9.T6.2.2.30.6" class="ltx_td ltx_align_center">0.557</td>
</tr>
<tr id="A9.T6.2.2.31" class="ltx_tr">
<td id="A9.T6.2.2.31.1" class="ltx_td ltx_align_left ltx_border_t">Yi-1.5-Chat <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib66" title="" class="ltx_ref">66</a>]</cite>
</td>
<td id="A9.T6.2.2.31.2" class="ltx_td ltx_align_right ltx_border_t">34B</td>
<td id="A9.T6.2.2.31.3" class="ltx_td ltx_align_center ltx_border_t">0.433</td>
<td id="A9.T6.2.2.31.4" class="ltx_td ltx_align_center ltx_border_t">0.428</td>
<td id="A9.T6.2.2.31.5" class="ltx_td ltx_align_center ltx_border_t">0.411</td>
<td id="A9.T6.2.2.31.6" class="ltx_td ltx_align_center ltx_border_t">0.622</td>
</tr>
<tr id="A9.T6.2.2.32" class="ltx_tr">
<td id="A9.T6.2.2.32.1" class="ltx_td"></td>
<td id="A9.T6.2.2.32.2" class="ltx_td ltx_align_right">9B</td>
<td id="A9.T6.2.2.32.3" class="ltx_td ltx_align_center">0.422</td>
<td id="A9.T6.2.2.32.4" class="ltx_td ltx_align_center">0.424</td>
<td id="A9.T6.2.2.32.5" class="ltx_td ltx_align_center">0.379</td>
<td id="A9.T6.2.2.32.6" class="ltx_td ltx_align_center">0.601</td>
</tr>
<tr id="A9.T6.2.2.33" class="ltx_tr">
<td id="A9.T6.2.2.33.1" class="ltx_td"></td>
<td id="A9.T6.2.2.33.2" class="ltx_td ltx_align_right">6B</td>
<td id="A9.T6.2.2.33.3" class="ltx_td ltx_align_center">0.338</td>
<td id="A9.T6.2.2.33.4" class="ltx_td ltx_align_center">0.339</td>
<td id="A9.T6.2.2.33.5" class="ltx_td ltx_align_center">0.290</td>
<td id="A9.T6.2.2.33.6" class="ltx_td ltx_align_center">0.496</td>
</tr>
<tr id="A9.T6.2.2.34" class="ltx_tr">
<td id="A9.T6.2.2.34.1" class="ltx_td ltx_align_left ltx_border_t">Mixtral-instruct <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib3" title="" class="ltx_ref">3</a>]</cite>
</td>
<td id="A9.T6.2.2.34.2" class="ltx_td ltx_align_right ltx_border_t">8x22B</td>
<td id="A9.T6.2.2.34.3" class="ltx_td ltx_align_center ltx_border_t">0.496</td>
<td id="A9.T6.2.2.34.4" class="ltx_td ltx_align_center ltx_border_t">0.502</td>
<td id="A9.T6.2.2.34.5" class="ltx_td ltx_align_center ltx_border_t">0.458</td>
<td id="A9.T6.2.2.34.6" class="ltx_td ltx_align_center ltx_border_t">0.677</td>
</tr>
<tr id="A9.T6.2.2.35" class="ltx_tr">
<td id="A9.T6.2.2.35.1" class="ltx_td ltx_align_left ltx_border_t">Magicoder-S-DS <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib59" title="" class="ltx_ref">59</a>]</cite>
</td>
<td id="A9.T6.2.2.35.2" class="ltx_td ltx_align_right ltx_border_t">6.7B</td>
<td id="A9.T6.2.2.35.3" class="ltx_td ltx_align_center ltx_border_t">0.475</td>
<td id="A9.T6.2.2.35.4" class="ltx_td ltx_align_center ltx_border_t">0.476</td>
<td id="A9.T6.2.2.35.5" class="ltx_td ltx_align_center ltx_border_t">0.424</td>
<td id="A9.T6.2.2.35.6" class="ltx_td ltx_align_center ltx_border_t">0.643</td>
</tr>
<tr id="A9.T6.2.2.36" class="ltx_tr">
<td id="A9.T6.2.2.36.1" class="ltx_td ltx_align_left ltx_border_t">CodeGemma-instruct <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib55" title="" class="ltx_ref">55</a>]</cite>
</td>
<td id="A9.T6.2.2.36.2" class="ltx_td ltx_align_right ltx_border_t">7B</td>
<td id="A9.T6.2.2.36.3" class="ltx_td ltx_align_center ltx_border_t">0.383</td>
<td id="A9.T6.2.2.36.4" class="ltx_td ltx_align_center ltx_border_t">0.393</td>
<td id="A9.T6.2.2.36.5" class="ltx_td ltx_align_center ltx_border_t">0.334</td>
<td id="A9.T6.2.2.36.6" class="ltx_td ltx_align_center ltx_border_t">0.568</td>
</tr>
<tr id="A9.T6.2.2.37" class="ltx_tr">
<td id="A9.T6.2.2.37.1" class="ltx_td ltx_align_left ltx_border_t">StarCoder2-Instruct <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib12" title="" class="ltx_ref">12</a>]</cite>
</td>
<td id="A9.T6.2.2.37.2" class="ltx_td ltx_align_right ltx_border_t">15B</td>
<td id="A9.T6.2.2.37.3" class="ltx_td ltx_align_center ltx_border_t">0.437</td>
<td id="A9.T6.2.2.37.4" class="ltx_td ltx_align_center ltx_border_t">0.451</td>
<td id="A9.T6.2.2.37.5" class="ltx_td ltx_align_center ltx_border_t">0.404</td>
<td id="A9.T6.2.2.37.6" class="ltx_td ltx_align_center ltx_border_t">0.610</td>
</tr>
<tr id="A9.T6.2.2.38" class="ltx_tr">
<td id="A9.T6.2.2.38.1" class="ltx_td ltx_align_left ltx_border_t">Granite-Code-Instruct <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib39" title="" class="ltx_ref">39</a>]</cite>
</td>
<td id="A9.T6.2.2.38.2" class="ltx_td ltx_align_right ltx_border_t">34B</td>
<td id="A9.T6.2.2.38.3" class="ltx_td ltx_align_center ltx_border_t">0.438</td>
<td id="A9.T6.2.2.38.4" class="ltx_td ltx_align_center ltx_border_t">0.444</td>
<td id="A9.T6.2.2.38.5" class="ltx_td ltx_align_center ltx_border_t">0.399</td>
<td id="A9.T6.2.2.38.6" class="ltx_td ltx_align_center ltx_border_t">0.613</td>
</tr>
<tr id="A9.T6.2.2.39" class="ltx_tr">
<td id="A9.T6.2.2.39.1" class="ltx_td"></td>
<td id="A9.T6.2.2.39.2" class="ltx_td ltx_align_right">20B</td>
<td id="A9.T6.2.2.39.3" class="ltx_td ltx_align_center">0.421</td>
<td id="A9.T6.2.2.39.4" class="ltx_td ltx_align_center">0.421</td>
<td id="A9.T6.2.2.39.5" class="ltx_td ltx_align_center">0.375</td>
<td id="A9.T6.2.2.39.6" class="ltx_td ltx_align_center">0.600</td>
</tr>
<tr id="A9.T6.2.2.40" class="ltx_tr">
<td id="A9.T6.2.2.40.1" class="ltx_td"></td>
<td id="A9.T6.2.2.40.2" class="ltx_td ltx_align_right">8B</td>
<td id="A9.T6.2.2.40.3" class="ltx_td ltx_align_center">0.392</td>
<td id="A9.T6.2.2.40.4" class="ltx_td ltx_align_center">0.397</td>
<td id="A9.T6.2.2.40.5" class="ltx_td ltx_align_center">0.367</td>
<td id="A9.T6.2.2.40.6" class="ltx_td ltx_align_center">0.581</td>
</tr>
<tr id="A9.T6.2.2.41" class="ltx_tr">
<td id="A9.T6.2.2.41.1" class="ltx_td"></td>
<td id="A9.T6.2.2.41.2" class="ltx_td ltx_align_right">3B</td>
<td id="A9.T6.2.2.41.3" class="ltx_td ltx_align_center">0.315</td>
<td id="A9.T6.2.2.41.4" class="ltx_td ltx_align_center">0.315</td>
<td id="A9.T6.2.2.41.5" class="ltx_td ltx_align_center">0.250</td>
<td id="A9.T6.2.2.41.6" class="ltx_td ltx_align_center">0.466</td>
</tr>
<tr id="A9.T6.2.2.42" class="ltx_tr">
<td id="A9.T6.2.2.42.1" class="ltx_td ltx_align_center ltx_border_t" colspan="6"><span id="A9.T6.2.2.42.1.1" class="ltx_text ltx_font_italic">Base LLMs</span></td>
</tr>
<tr id="A9.T6.2.2.43" class="ltx_tr">
<td id="A9.T6.2.2.43.1" class="ltx_td ltx_align_left ltx_border_t">CodeLlama <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib52" title="" class="ltx_ref">52</a>]</cite>
</td>
<td id="A9.T6.2.2.43.2" class="ltx_td ltx_align_right ltx_border_t">70B</td>
<td id="A9.T6.2.2.43.3" class="ltx_td ltx_align_center ltx_border_t">0.443</td>
<td id="A9.T6.2.2.43.4" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.43.5" class="ltx_td ltx_align_center ltx_border_t">0.364</td>
<td id="A9.T6.2.2.43.6" class="ltx_td ltx_align_center ltx_border_t">0.639</td>
</tr>
<tr id="A9.T6.2.2.44" class="ltx_tr">
<td id="A9.T6.2.2.44.1" class="ltx_td"></td>
<td id="A9.T6.2.2.44.2" class="ltx_td ltx_align_right">34B</td>
<td id="A9.T6.2.2.44.3" class="ltx_td ltx_align_center">0.371</td>
<td id="A9.T6.2.2.44.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.44.5" class="ltx_td ltx_align_center">0.297</td>
<td id="A9.T6.2.2.44.6" class="ltx_td ltx_align_center">0.570</td>
</tr>
<tr id="A9.T6.2.2.45" class="ltx_tr">
<td id="A9.T6.2.2.45.1" class="ltx_td"></td>
<td id="A9.T6.2.2.45.2" class="ltx_td ltx_align_right">13B</td>
<td id="A9.T6.2.2.45.3" class="ltx_td ltx_align_center">0.320</td>
<td id="A9.T6.2.2.45.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.45.5" class="ltx_td ltx_align_center">0.243</td>
<td id="A9.T6.2.2.45.6" class="ltx_td ltx_align_center">0.527</td>
</tr>
<tr id="A9.T6.2.2.46" class="ltx_tr">
<td id="A9.T6.2.2.46.1" class="ltx_td"></td>
<td id="A9.T6.2.2.46.2" class="ltx_td ltx_align_right">7B</td>
<td id="A9.T6.2.2.46.3" class="ltx_td ltx_align_center">0.287</td>
<td id="A9.T6.2.2.46.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.46.5" class="ltx_td ltx_align_center">0.207</td>
<td id="A9.T6.2.2.46.6" class="ltx_td ltx_align_center">0.457</td>
</tr>
<tr id="A9.T6.2.2.47" class="ltx_tr">
<td id="A9.T6.2.2.47.1" class="ltx_td ltx_align_left ltx_border_t">Llama3-base <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib5" title="" class="ltx_ref">5</a>]</cite>
</td>
<td id="A9.T6.2.2.47.2" class="ltx_td ltx_align_right ltx_border_t">70B</td>
<td id="A9.T6.2.2.47.3" class="ltx_td ltx_align_center ltx_border_t">0.433</td>
<td id="A9.T6.2.2.47.4" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.47.5" class="ltx_td ltx_align_center ltx_border_t">0.375</td>
<td id="A9.T6.2.2.47.6" class="ltx_td ltx_align_center ltx_border_t">0.625</td>
</tr>
<tr id="A9.T6.2.2.48" class="ltx_tr">
<td id="A9.T6.2.2.48.1" class="ltx_td"></td>
<td id="A9.T6.2.2.48.2" class="ltx_td ltx_align_right">8B</td>
<td id="A9.T6.2.2.48.3" class="ltx_td ltx_align_center">0.288</td>
<td id="A9.T6.2.2.48.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.48.5" class="ltx_td ltx_align_center">0.223</td>
<td id="A9.T6.2.2.48.6" class="ltx_td ltx_align_center">0.466</td>
</tr>
<tr id="A9.T6.2.2.49" class="ltx_tr">
<td id="A9.T6.2.2.49.1" class="ltx_td ltx_align_left ltx_border_t">DeepSeek-Coder-base <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib22" title="" class="ltx_ref">22</a>]</cite>
</td>
<td id="A9.T6.2.2.49.2" class="ltx_td ltx_align_right ltx_border_t">33B</td>
<td id="A9.T6.2.2.49.3" class="ltx_td ltx_align_center ltx_border_t">0.466</td>
<td id="A9.T6.2.2.49.4" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.49.5" class="ltx_td ltx_align_center ltx_border_t">0.401</td>
<td id="A9.T6.2.2.49.6" class="ltx_td ltx_align_center ltx_border_t">0.661</td>
</tr>
<tr id="A9.T6.2.2.50" class="ltx_tr">
<td id="A9.T6.2.2.50.1" class="ltx_td"></td>
<td id="A9.T6.2.2.50.2" class="ltx_td ltx_align_right">6.7B</td>
<td id="A9.T6.2.2.50.3" class="ltx_td ltx_align_center">0.418</td>
<td id="A9.T6.2.2.50.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.50.5" class="ltx_td ltx_align_center">0.343</td>
<td id="A9.T6.2.2.50.6" class="ltx_td ltx_align_center">0.599</td>
</tr>
<tr id="A9.T6.2.2.51" class="ltx_tr">
<td id="A9.T6.2.2.51.1" class="ltx_td"></td>
<td id="A9.T6.2.2.51.2" class="ltx_td ltx_align_right">1.3B</td>
<td id="A9.T6.2.2.51.3" class="ltx_td ltx_align_center">0.223</td>
<td id="A9.T6.2.2.51.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.51.5" class="ltx_td ltx_align_center">0.174</td>
<td id="A9.T6.2.2.51.6" class="ltx_td ltx_align_center">0.412</td>
</tr>
<tr id="A9.T6.2.2.52" class="ltx_tr">
<td id="A9.T6.2.2.52.1" class="ltx_td ltx_align_left ltx_border_t">CodeQwen1.5 <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib10" title="" class="ltx_ref">10</a>]</cite>
</td>
<td id="A9.T6.2.2.52.2" class="ltx_td ltx_align_right ltx_border_t">7B</td>
<td id="A9.T6.2.2.52.3" class="ltx_td ltx_align_center ltx_border_t">0.456</td>
<td id="A9.T6.2.2.52.4" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.52.5" class="ltx_td ltx_align_center ltx_border_t">0.411</td>
<td id="A9.T6.2.2.52.6" class="ltx_td ltx_align_center ltx_border_t">0.650</td>
</tr>
<tr id="A9.T6.2.2.53" class="ltx_tr">
<td id="A9.T6.2.2.53.1" class="ltx_td ltx_align_left ltx_border_t">Yi-1.5 <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib66" title="" class="ltx_ref">66</a>]</cite>
</td>
<td id="A9.T6.2.2.53.2" class="ltx_td ltx_align_right ltx_border_t">34B</td>
<td id="A9.T6.2.2.53.3" class="ltx_td ltx_align_center ltx_border_t">0.400</td>
<td id="A9.T6.2.2.53.4" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.53.5" class="ltx_td ltx_align_center ltx_border_t">0.302</td>
<td id="A9.T6.2.2.53.6" class="ltx_td ltx_align_center ltx_border_t">0.575</td>
</tr>
<tr id="A9.T6.2.2.54" class="ltx_tr">
<td id="A9.T6.2.2.54.1" class="ltx_td"></td>
<td id="A9.T6.2.2.54.2" class="ltx_td ltx_align_right">9B</td>
<td id="A9.T6.2.2.54.3" class="ltx_td ltx_align_center">0.355</td>
<td id="A9.T6.2.2.54.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.54.5" class="ltx_td ltx_align_center">0.295</td>
<td id="A9.T6.2.2.54.6" class="ltx_td ltx_align_center">0.563</td>
</tr>
<tr id="A9.T6.2.2.55" class="ltx_tr">
<td id="A9.T6.2.2.55.1" class="ltx_td"></td>
<td id="A9.T6.2.2.55.2" class="ltx_td ltx_align_right">6B</td>
<td id="A9.T6.2.2.55.3" class="ltx_td ltx_align_center">0.274</td>
<td id="A9.T6.2.2.55.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.55.5" class="ltx_td ltx_align_center">0.201</td>
<td id="A9.T6.2.2.55.6" class="ltx_td ltx_align_center">0.435</td>
</tr>
<tr id="A9.T6.2.2.56" class="ltx_tr">
<td id="A9.T6.2.2.56.1" class="ltx_td ltx_align_left ltx_border_t">Mixtral-base <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib4" title="" class="ltx_ref">4</a>]</cite>
</td>
<td id="A9.T6.2.2.56.2" class="ltx_td ltx_align_right ltx_border_t">8x22B</td>
<td id="A9.T6.2.2.56.3" class="ltx_td ltx_align_center ltx_border_t">0.455</td>
<td id="A9.T6.2.2.56.4" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.56.5" class="ltx_td ltx_align_center ltx_border_t">0.355</td>
<td id="A9.T6.2.2.56.6" class="ltx_td ltx_align_center ltx_border_t">0.633</td>
</tr>
<tr id="A9.T6.2.2.57" class="ltx_tr">
<td id="A9.T6.2.2.57.1" class="ltx_td ltx_align_left ltx_border_t">CodeGemma <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib55" title="" class="ltx_ref">55</a>]</cite>
</td>
<td id="A9.T6.2.2.57.2" class="ltx_td ltx_align_right ltx_border_t">7B</td>
<td id="A9.T6.2.2.57.3" class="ltx_td ltx_align_center ltx_border_t">0.373</td>
<td id="A9.T6.2.2.57.4" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.57.5" class="ltx_td ltx_align_center ltx_border_t">0.295</td>
<td id="A9.T6.2.2.57.6" class="ltx_td ltx_align_center ltx_border_t">0.557</td>
</tr>
<tr id="A9.T6.2.2.58" class="ltx_tr">
<td id="A9.T6.2.2.58.1" class="ltx_td"></td>
<td id="A9.T6.2.2.58.2" class="ltx_td ltx_align_right">2B</td>
<td id="A9.T6.2.2.58.3" class="ltx_td ltx_align_center">0.239</td>
<td id="A9.T6.2.2.58.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.58.5" class="ltx_td ltx_align_center">0.153</td>
<td id="A9.T6.2.2.58.6" class="ltx_td ltx_align_center">0.375</td>
</tr>
<tr id="A9.T6.2.2.59" class="ltx_tr">
<td id="A9.T6.2.2.59.1" class="ltx_td ltx_align_left ltx_border_t">StarCoder2 <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib36" title="" class="ltx_ref">36</a>]</cite>
</td>
<td id="A9.T6.2.2.59.2" class="ltx_td ltx_align_right ltx_border_t">15B</td>
<td id="A9.T6.2.2.59.3" class="ltx_td ltx_align_center ltx_border_t">0.383</td>
<td id="A9.T6.2.2.59.4" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.59.5" class="ltx_td ltx_align_center ltx_border_t">0.332</td>
<td id="A9.T6.2.2.59.6" class="ltx_td ltx_align_center ltx_border_t">0.609</td>
</tr>
<tr id="A9.T6.2.2.60" class="ltx_tr">
<td id="A9.T6.2.2.60.1" class="ltx_td"></td>
<td id="A9.T6.2.2.60.2" class="ltx_td ltx_align_right">7B</td>
<td id="A9.T6.2.2.60.3" class="ltx_td ltx_align_center">0.285</td>
<td id="A9.T6.2.2.60.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.60.5" class="ltx_td ltx_align_center">0.232</td>
<td id="A9.T6.2.2.60.6" class="ltx_td ltx_align_center">0.514</td>
</tr>
<tr id="A9.T6.2.2.61" class="ltx_tr">
<td id="A9.T6.2.2.61.1" class="ltx_td"></td>
<td id="A9.T6.2.2.61.2" class="ltx_td ltx_align_right">3B</td>
<td id="A9.T6.2.2.61.3" class="ltx_td ltx_align_center">0.214</td>
<td id="A9.T6.2.2.61.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.61.5" class="ltx_td ltx_align_center">0.178</td>
<td id="A9.T6.2.2.61.6" class="ltx_td ltx_align_center">0.416</td>
</tr>
<tr id="A9.T6.2.2.62" class="ltx_tr">
<td id="A9.T6.2.2.62.1" class="ltx_td ltx_align_left ltx_border_t">Granite-Code <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib39" title="" class="ltx_ref">39</a>]</cite>
</td>
<td id="A9.T6.2.2.62.2" class="ltx_td ltx_align_right ltx_border_t">34B</td>
<td id="A9.T6.2.2.62.3" class="ltx_td ltx_align_center ltx_border_t">0.385</td>
<td id="A9.T6.2.2.62.4" class="ltx_td ltx_align_center ltx_border_t">—</td>
<td id="A9.T6.2.2.62.5" class="ltx_td ltx_align_center ltx_border_t">0.333</td>
<td id="A9.T6.2.2.62.6" class="ltx_td ltx_align_center ltx_border_t">0.582</td>
</tr>
<tr id="A9.T6.2.2.63" class="ltx_tr">
<td id="A9.T6.2.2.63.1" class="ltx_td"></td>
<td id="A9.T6.2.2.63.2" class="ltx_td ltx_align_right">20B</td>
<td id="A9.T6.2.2.63.3" class="ltx_td ltx_align_center">0.258</td>
<td id="A9.T6.2.2.63.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.63.5" class="ltx_td ltx_align_center">0.286</td>
<td id="A9.T6.2.2.63.6" class="ltx_td ltx_align_center">0.552</td>
</tr>
<tr id="A9.T6.2.2.64" class="ltx_tr">
<td id="A9.T6.2.2.64.1" class="ltx_td"></td>
<td id="A9.T6.2.2.64.2" class="ltx_td ltx_align_right">8B</td>
<td id="A9.T6.2.2.64.3" class="ltx_td ltx_align_center">0.356</td>
<td id="A9.T6.2.2.64.4" class="ltx_td ltx_align_center">—</td>
<td id="A9.T6.2.2.64.5" class="ltx_td ltx_align_center">0.287</td>
<td id="A9.T6.2.2.64.6" class="ltx_td ltx_align_center">0.536</td>
</tr>
<tr id="A9.T6.2.2.65" class="ltx_tr">
<td id="A9.T6.2.2.65.1" class="ltx_td ltx_border_bb"></td>
<td id="A9.T6.2.2.65.2" class="ltx_td ltx_align_right ltx_border_bb">3B</td>
<td id="A9.T6.2.2.65.3" class="ltx_td ltx_align_center ltx_border_bb">0.202</td>
<td id="A9.T6.2.2.65.4" class="ltx_td ltx_align_center ltx_border_bb">—</td>
<td id="A9.T6.2.2.65.5" class="ltx_td ltx_align_center ltx_border_bb">0.177</td>
<td id="A9.T6.2.2.65.6" class="ltx_td ltx_align_center ltx_border_bb">0.406</td>
</tr>
</table>
</span></div>
</figure>
<figure id="A9.T7" class="ltx_table">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_table">Table 7: </span>Evaluating instruction-tuned LLMs on <span id="A9.T7.10.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A9.T7.11.2" class="ltx_text ltx_font_typewriter">Instruct</span>. We report the results of greedy decoding, paired with calibrated results. To understand the performance difference between <span id="A9.T7.12.3" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A9.T7.13.4" class="ltx_text ltx_font_typewriter">Complete</span> and <span id="A9.T7.14.5" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A9.T7.15.6" class="ltx_text ltx_font_typewriter">Instruct</span>, we compute <math id="A9.T7.2.m1.1" class="ltx_Math" alttext="\Delta(NL2C-C2C)" display="inline"><semantics id="A9.T7.2.m1.1b"><mrow id="A9.T7.2.m1.1.1" xref="A9.T7.2.m1.1.1.cmml"><mi mathvariant="normal" id="A9.T7.2.m1.1.1.3" xref="A9.T7.2.m1.1.1.3.cmml">Δ</mi><mo lspace="0em" rspace="0em" id="A9.T7.2.m1.1.1.2" xref="A9.T7.2.m1.1.1.2.cmml">​</mo><mrow id="A9.T7.2.m1.1.1.1.1" xref="A9.T7.2.m1.1.1.1.1.1.cmml"><mo stretchy="false" id="A9.T7.2.m1.1.1.1.1.2" xref="A9.T7.2.m1.1.1.1.1.1.cmml">(</mo><mrow id="A9.T7.2.m1.1.1.1.1.1" xref="A9.T7.2.m1.1.1.1.1.1.cmml"><mrow id="A9.T7.2.m1.1.1.1.1.1.2" xref="A9.T7.2.m1.1.1.1.1.1.2.cmml"><mi id="A9.T7.2.m1.1.1.1.1.1.2.2" xref="A9.T7.2.m1.1.1.1.1.1.2.2.cmml">N</mi><mo lspace="0em" rspace="0em" id="A9.T7.2.m1.1.1.1.1.1.2.1" xref="A9.T7.2.m1.1.1.1.1.1.2.1.cmml">​</mo><mi id="A9.T7.2.m1.1.1.1.1.1.2.3" xref="A9.T7.2.m1.1.1.1.1.1.2.3.cmml">L</mi><mo lspace="0em" rspace="0em" id="A9.T7.2.m1.1.1.1.1.1.2.1b" xref="A9.T7.2.m1.1.1.1.1.1.2.1.cmml">​</mo><mn id="A9.T7.2.m1.1.1.1.1.1.2.4" xref="A9.T7.2.m1.1.1.1.1.1.2.4.cmml">2</mn><mo lspace="0em" rspace="0em" id="A9.T7.2.m1.1.1.1.1.1.2.1c" xref="A9.T7.2.m1.1.1.1.1.1.2.1.cmml">​</mo><mi id="A9.T7.2.m1.1.1.1.1.1.2.5" xref="A9.T7.2.m1.1.1.1.1.1.2.5.cmml">C</mi></mrow><mo id="A9.T7.2.m1.1.1.1.1.1.1" xref="A9.T7.2.m1.1.1.1.1.1.1.cmml">−</mo><mrow id="A9.T7.2.m1.1.1.1.1.1.3" xref="A9.T7.2.m1.1.1.1.1.1.3.cmml"><mi id="A9.T7.2.m1.1.1.1.1.1.3.2" xref="A9.T7.2.m1.1.1.1.1.1.3.2.cmml">C</mi><mo lspace="0em" rspace="0em" id="A9.T7.2.m1.1.1.1.1.1.3.1" xref="A9.T7.2.m1.1.1.1.1.1.3.1.cmml">​</mo><mn id="A9.T7.2.m1.1.1.1.1.1.3.3" xref="A9.T7.2.m1.1.1.1.1.1.3.3.cmml">2</mn><mo lspace="0em" rspace="0em" id="A9.T7.2.m1.1.1.1.1.1.3.1b" xref="A9.T7.2.m1.1.1.1.1.1.3.1.cmml">​</mo><mi id="A9.T7.2.m1.1.1.1.1.1.3.4" xref="A9.T7.2.m1.1.1.1.1.1.3.4.cmml">C</mi></mrow></mrow><mo stretchy="false" id="A9.T7.2.m1.1.1.1.1.3" xref="A9.T7.2.m1.1.1.1.1.1.cmml">)</mo></mrow></mrow><annotation-xml encoding="MathML-Content" id="A9.T7.2.m1.1c"><apply id="A9.T7.2.m1.1.1.cmml" xref="A9.T7.2.m1.1.1"><times id="A9.T7.2.m1.1.1.2.cmml" xref="A9.T7.2.m1.1.1.2"></times><ci id="A9.T7.2.m1.1.1.3.cmml" xref="A9.T7.2.m1.1.1.3">Δ</ci><apply id="A9.T7.2.m1.1.1.1.1.1.cmml" xref="A9.T7.2.m1.1.1.1.1"><minus id="A9.T7.2.m1.1.1.1.1.1.1.cmml" xref="A9.T7.2.m1.1.1.1.1.1.1"></minus><apply id="A9.T7.2.m1.1.1.1.1.1.2.cmml" xref="A9.T7.2.m1.1.1.1.1.1.2"><times id="A9.T7.2.m1.1.1.1.1.1.2.1.cmml" xref="A9.T7.2.m1.1.1.1.1.1.2.1"></times><ci id="A9.T7.2.m1.1.1.1.1.1.2.2.cmml" xref="A9.T7.2.m1.1.1.1.1.1.2.2">𝑁</ci><ci id="A9.T7.2.m1.1.1.1.1.1.2.3.cmml" xref="A9.T7.2.m1.1.1.1.1.1.2.3">𝐿</ci><cn type="integer" id="A9.T7.2.m1.1.1.1.1.1.2.4.cmml" xref="A9.T7.2.m1.1.1.1.1.1.2.4">2</cn><ci id="A9.T7.2.m1.1.1.1.1.1.2.5.cmml" xref="A9.T7.2.m1.1.1.1.1.1.2.5">𝐶</ci></apply><apply id="A9.T7.2.m1.1.1.1.1.1.3.cmml" xref="A9.T7.2.m1.1.1.1.1.1.3"><times id="A9.T7.2.m1.1.1.1.1.1.3.1.cmml" xref="A9.T7.2.m1.1.1.1.1.1.3.1"></times><ci id="A9.T7.2.m1.1.1.1.1.1.3.2.cmml" xref="A9.T7.2.m1.1.1.1.1.1.3.2">𝐶</ci><cn type="integer" id="A9.T7.2.m1.1.1.1.1.1.3.3.cmml" xref="A9.T7.2.m1.1.1.1.1.1.3.3">2</cn><ci id="A9.T7.2.m1.1.1.1.1.1.3.4.cmml" xref="A9.T7.2.m1.1.1.1.1.1.3.4">𝐶</ci></apply></apply></apply></annotation-xml><annotation encoding="application/x-tex" id="A9.T7.2.m1.1d">\Delta(NL2C-C2C)</annotation></semantics></math> for each model. We do not include the results of Granite-Code-Instruct 8B &amp; 3B as they constantly have empty outputs.</figcaption>
<div id="A9.T7.3" class="ltx_inline-block ltx_align_center ltx_transformed_outer" style="width:325.2pt;height:508.5pt;vertical-align:-0.0pt;"><span class="ltx_transformed_inner" style="transform:translate(-50.4pt,78.8pt) scale(0.763463996748597,0.763463996748597) ;">
<table id="A9.T7.3.1" class="ltx_tabular ltx_align_middle">
<tr id="A9.T7.3.1.1" class="ltx_tr">
<td id="A9.T7.3.1.1.2" class="ltx_td ltx_align_left ltx_border_tt" rowspan="2"><span id="A9.T7.3.1.1.2.1" class="ltx_text ltx_font_bold">Model</span></td>
<td id="A9.T7.3.1.1.3" class="ltx_td ltx_align_right ltx_border_tt" rowspan="2"><span id="A9.T7.3.1.1.3.1" class="ltx_text ltx_font_bold">Size / Checkpoint</span></td>
<td id="A9.T7.3.1.1.4" class="ltx_td ltx_align_center ltx_border_tt" colspan="2"><span id="A9.T7.3.1.1.4.1" class="ltx_text ltx_font_bold">Greedy Decoding</span></td>
<td id="A9.T7.3.1.1.1" class="ltx_td ltx_align_center ltx_border_tt" colspan="2"><math id="A9.T7.3.1.1.1.m1.1" class="ltx_Math" alttext="\Delta(NL2C-C2C)" display="inline"><semantics id="A9.T7.3.1.1.1.m1.1a"><mrow id="A9.T7.3.1.1.1.m1.1.1" xref="A9.T7.3.1.1.1.m1.1.1.cmml"><mi mathvariant="normal" id="A9.T7.3.1.1.1.m1.1.1.3" xref="A9.T7.3.1.1.1.m1.1.1.3.cmml">Δ</mi><mo lspace="0em" rspace="0em" id="A9.T7.3.1.1.1.m1.1.1.2" xref="A9.T7.3.1.1.1.m1.1.1.2.cmml">​</mo><mrow id="A9.T7.3.1.1.1.m1.1.1.1.1" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.cmml"><mo stretchy="false" id="A9.T7.3.1.1.1.m1.1.1.1.1.2" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.cmml">(</mo><mrow id="A9.T7.3.1.1.1.m1.1.1.1.1.1" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.cmml"><mrow id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.cmml"><mi id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.2" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.2.cmml">N</mi><mo lspace="0em" rspace="0em" id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.1" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.1.cmml">​</mo><mi id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.3" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.3.cmml">L</mi><mo lspace="0em" rspace="0em" id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.1a" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.1.cmml">​</mo><mn id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.4" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.4.cmml">2</mn><mo lspace="0em" rspace="0em" id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.1b" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.1.cmml">​</mo><mi id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.5" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.5.cmml">C</mi></mrow><mo id="A9.T7.3.1.1.1.m1.1.1.1.1.1.1" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.1.cmml">−</mo><mrow id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.cmml"><mi id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.2" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.2.cmml">C</mi><mo lspace="0em" rspace="0em" id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.1" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.1.cmml">​</mo><mn id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.3" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.3.cmml">2</mn><mo lspace="0em" rspace="0em" id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.1a" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.1.cmml">​</mo><mi id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.4" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.4.cmml">C</mi></mrow></mrow><mo stretchy="false" id="A9.T7.3.1.1.1.m1.1.1.1.1.3" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.cmml">)</mo></mrow></mrow><annotation-xml encoding="MathML-Content" id="A9.T7.3.1.1.1.m1.1b"><apply id="A9.T7.3.1.1.1.m1.1.1.cmml" xref="A9.T7.3.1.1.1.m1.1.1"><times id="A9.T7.3.1.1.1.m1.1.1.2.cmml" xref="A9.T7.3.1.1.1.m1.1.1.2"></times><ci id="A9.T7.3.1.1.1.m1.1.1.3.cmml" xref="A9.T7.3.1.1.1.m1.1.1.3">Δ</ci><apply id="A9.T7.3.1.1.1.m1.1.1.1.1.1.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1"><minus id="A9.T7.3.1.1.1.m1.1.1.1.1.1.1.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.1"></minus><apply id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2"><times id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.1.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.1"></times><ci id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.2.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.2">𝑁</ci><ci id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.3.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.3">𝐿</ci><cn type="integer" id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.4.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.4">2</cn><ci id="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.5.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.2.5">𝐶</ci></apply><apply id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3"><times id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.1.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.1"></times><ci id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.2.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.2">𝐶</ci><cn type="integer" id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.3.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.3">2</cn><ci id="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.4.cmml" xref="A9.T7.3.1.1.1.m1.1.1.1.1.1.3.4">𝐶</ci></apply></apply></apply></annotation-xml><annotation encoding="application/x-tex" id="A9.T7.3.1.1.1.m1.1c">\Delta(NL2C-C2C)</annotation></semantics></math></td>
</tr>
<tr id="A9.T7.3.1.2" class="ltx_tr">
<td id="A9.T7.3.1.2.1" class="ltx_td ltx_align_center">Original</td>
<td id="A9.T7.3.1.2.2" class="ltx_td ltx_align_center">Calibrated</td>
<td id="A9.T7.3.1.2.3" class="ltx_td ltx_align_center">Original</td>
<td id="A9.T7.3.1.2.4" class="ltx_td ltx_align_center">Calibrated</td>
</tr>
<tr id="A9.T7.3.1.3" class="ltx_tr">
<td id="A9.T7.3.1.3.1" class="ltx_td ltx_align_left ltx_border_t">GPT-4o</td>
<td id="A9.T7.3.1.3.2" class="ltx_td ltx_align_right ltx_border_t">2024-05-13</td>
<td id="A9.T7.3.1.3.3" class="ltx_td ltx_align_center ltx_border_t">0.499</td>
<td id="A9.T7.3.1.3.4" class="ltx_td ltx_align_center ltx_border_t">0.511</td>
<td id="A9.T7.3.1.3.5" class="ltx_td ltx_align_center ltx_border_t">-0.103</td>
<td id="A9.T7.3.1.3.6" class="ltx_td ltx_align_center ltx_border_t">-0.100</td>
</tr>
<tr id="A9.T7.3.1.4" class="ltx_tr">
<td id="A9.T7.3.1.4.1" class="ltx_td ltx_align_left ltx_border_t">GPT-4-Turbo</td>
<td id="A9.T7.3.1.4.2" class="ltx_td ltx_align_right ltx_border_t">2024-04-09</td>
<td id="A9.T7.3.1.4.3" class="ltx_td ltx_align_center ltx_border_t">0.480</td>
<td id="A9.T7.3.1.4.4" class="ltx_td ltx_align_center ltx_border_t">0.482</td>
<td id="A9.T7.3.1.4.5" class="ltx_td ltx_align_center ltx_border_t">-0.102</td>
<td id="A9.T7.3.1.4.6" class="ltx_td ltx_align_center ltx_border_t">-0.100</td>
</tr>
<tr id="A9.T7.3.1.5" class="ltx_tr">
<td id="A9.T7.3.1.5.1" class="ltx_td ltx_align_left ltx_border_t">GPT-4</td>
<td id="A9.T7.3.1.5.2" class="ltx_td ltx_align_right ltx_border_t">0613</td>
<td id="A9.T7.3.1.5.3" class="ltx_td ltx_align_center ltx_border_t">0.459</td>
<td id="A9.T7.3.1.5.4" class="ltx_td ltx_align_center ltx_border_t">0.460</td>
<td id="A9.T7.3.1.5.5" class="ltx_td ltx_align_center ltx_border_t">-0.025</td>
<td id="A9.T7.3.1.5.6" class="ltx_td ltx_align_center ltx_border_t">-0.112</td>
</tr>
<tr id="A9.T7.3.1.6" class="ltx_tr">
<td id="A9.T7.3.1.6.1" class="ltx_td ltx_align_left ltx_border_t">GPT-3.5-Turbo</td>
<td id="A9.T7.3.1.6.2" class="ltx_td ltx_align_right ltx_border_t">0125</td>
<td id="A9.T7.3.1.6.3" class="ltx_td ltx_align_center ltx_border_t">0.382</td>
<td id="A9.T7.3.1.6.4" class="ltx_td ltx_align_center ltx_border_t">0.391</td>
<td id="A9.T7.3.1.6.5" class="ltx_td ltx_align_center ltx_border_t">-0.124</td>
<td id="A9.T7.3.1.6.6" class="ltx_td ltx_align_center ltx_border_t">-0.115</td>
</tr>
<tr id="A9.T7.3.1.7" class="ltx_tr">
<td id="A9.T7.3.1.7.1" class="ltx_td ltx_align_left ltx_border_t">Claude-3</td>
<td id="A9.T7.3.1.7.2" class="ltx_td ltx_align_right ltx_border_t">Opus</td>
<td id="A9.T7.3.1.7.3" class="ltx_td ltx_align_center ltx_border_t">0.452</td>
<td id="A9.T7.3.1.7.4" class="ltx_td ltx_align_center ltx_border_t">0.455</td>
<td id="A9.T7.3.1.7.5" class="ltx_td ltx_align_center ltx_border_t">-0.116</td>
<td id="A9.T7.3.1.7.6" class="ltx_td ltx_align_center ltx_border_t">-0.119</td>
</tr>
<tr id="A9.T7.3.1.8" class="ltx_tr">
<td id="A9.T7.3.1.8.1" class="ltx_td"></td>
<td id="A9.T7.3.1.8.2" class="ltx_td ltx_align_right">Sonnet</td>
<td id="A9.T7.3.1.8.3" class="ltx_td ltx_align_center">0.425</td>
<td id="A9.T7.3.1.8.4" class="ltx_td ltx_align_center">0.427</td>
<td id="A9.T7.3.1.8.5" class="ltx_td ltx_align_center">-0.109</td>
<td id="A9.T7.3.1.8.6" class="ltx_td ltx_align_center">-0.111</td>
</tr>
<tr id="A9.T7.3.1.9" class="ltx_tr">
<td id="A9.T7.3.1.9.1" class="ltx_td"></td>
<td id="A9.T7.3.1.9.2" class="ltx_td ltx_align_right">Haiku</td>
<td id="A9.T7.3.1.9.3" class="ltx_td ltx_align_center">0.392</td>
<td id="A9.T7.3.1.9.4" class="ltx_td ltx_align_center">0.394</td>
<td id="A9.T7.3.1.9.5" class="ltx_td ltx_align_center">-0.094</td>
<td id="A9.T7.3.1.9.6" class="ltx_td ltx_align_center">-0.107</td>
</tr>
<tr id="A9.T7.3.1.10" class="ltx_tr">
<td id="A9.T7.3.1.10.1" class="ltx_td ltx_align_left ltx_border_t">DeepSeek-Chat</td>
<td id="A9.T7.3.1.10.2" class="ltx_td ltx_align_right ltx_border_t">V2</td>
<td id="A9.T7.3.1.10.3" class="ltx_td ltx_align_center ltx_border_t">0.404</td>
<td id="A9.T7.3.1.10.4" class="ltx_td ltx_align_center ltx_border_t">0.404</td>
<td id="A9.T7.3.1.10.5" class="ltx_td ltx_align_center ltx_border_t">-0.090</td>
<td id="A9.T7.3.1.10.6" class="ltx_td ltx_align_center ltx_border_t">-0.090</td>
</tr>
<tr id="A9.T7.3.1.11" class="ltx_tr">
<td id="A9.T7.3.1.11.1" class="ltx_td ltx_align_left ltx_border_t">DeepSeek-Coder-instruct</td>
<td id="A9.T7.3.1.11.2" class="ltx_td ltx_align_right ltx_border_t">33B</td>
<td id="A9.T7.3.1.11.3" class="ltx_td ltx_align_center ltx_border_t">0.418</td>
<td id="A9.T7.3.1.11.4" class="ltx_td ltx_align_center ltx_border_t">0.420</td>
<td id="A9.T7.3.1.11.5" class="ltx_td ltx_align_center ltx_border_t">-0.093</td>
<td id="A9.T7.3.1.11.6" class="ltx_td ltx_align_center ltx_border_t">-0.091</td>
</tr>
<tr id="A9.T7.3.1.12" class="ltx_tr">
<td id="A9.T7.3.1.12.1" class="ltx_td"></td>
<td id="A9.T7.3.1.12.2" class="ltx_td ltx_align_right">6.7B</td>
<td id="A9.T7.3.1.12.3" class="ltx_td ltx_align_center">0.353</td>
<td id="A9.T7.3.1.12.4" class="ltx_td ltx_align_center">0.355</td>
<td id="A9.T7.3.1.12.5" class="ltx_td ltx_align_center">-0.079</td>
<td id="A9.T7.3.1.12.6" class="ltx_td ltx_align_center">-0.083</td>
</tr>
<tr id="A9.T7.3.1.13" class="ltx_tr">
<td id="A9.T7.3.1.13.1" class="ltx_td"></td>
<td id="A9.T7.3.1.13.2" class="ltx_td ltx_align_right">1.3B</td>
<td id="A9.T7.3.1.13.3" class="ltx_td ltx_align_center">0.227</td>
<td id="A9.T7.3.1.13.4" class="ltx_td ltx_align_center">0.228</td>
<td id="A9.T7.3.1.13.5" class="ltx_td ltx_align_center">-0.066</td>
<td id="A9.T7.3.1.13.6" class="ltx_td ltx_align_center">-0.068</td>
</tr>
<tr id="A9.T7.3.1.14" class="ltx_tr">
<td id="A9.T7.3.1.14.1" class="ltx_td ltx_align_left ltx_border_t">CodeLlama-instruct</td>
<td id="A9.T7.3.1.14.2" class="ltx_td ltx_align_right ltx_border_t">70B</td>
<td id="A9.T7.3.1.14.3" class="ltx_td ltx_align_center ltx_border_t">0.405</td>
<td id="A9.T7.3.1.14.4" class="ltx_td ltx_align_center ltx_border_t">0.407</td>
<td id="A9.T7.3.1.14.5" class="ltx_td ltx_align_center ltx_border_t">-0.084</td>
<td id="A9.T7.3.1.14.6" class="ltx_td ltx_align_center ltx_border_t">-0.089</td>
</tr>
<tr id="A9.T7.3.1.15" class="ltx_tr">
<td id="A9.T7.3.1.15.1" class="ltx_td"></td>
<td id="A9.T7.3.1.15.2" class="ltx_td ltx_align_right">34B</td>
<td id="A9.T7.3.1.15.3" class="ltx_td ltx_align_center">0.289</td>
<td id="A9.T7.3.1.15.4" class="ltx_td ltx_align_center">0.290</td>
<td id="A9.T7.3.1.15.5" class="ltx_td ltx_align_center">-0.062</td>
<td id="A9.T7.3.1.15.6" class="ltx_td ltx_align_center">-0.066</td>
</tr>
<tr id="A9.T7.3.1.16" class="ltx_tr">
<td id="A9.T7.3.1.16.1" class="ltx_td"></td>
<td id="A9.T7.3.1.16.2" class="ltx_td ltx_align_right">13B</td>
<td id="A9.T7.3.1.16.3" class="ltx_td ltx_align_center">0.282</td>
<td id="A9.T7.3.1.16.4" class="ltx_td ltx_align_center">0.285</td>
<td id="A9.T7.3.1.16.5" class="ltx_td ltx_align_center">-0.015</td>
<td id="A9.T7.3.1.16.6" class="ltx_td ltx_align_center">-0.032</td>
</tr>
<tr id="A9.T7.3.1.17" class="ltx_tr">
<td id="A9.T7.3.1.17.1" class="ltx_td"></td>
<td id="A9.T7.3.1.17.2" class="ltx_td ltx_align_right">7B</td>
<td id="A9.T7.3.1.17.3" class="ltx_td ltx_align_center">0.218</td>
<td id="A9.T7.3.1.17.4" class="ltx_td ltx_align_center">0.219</td>
<td id="A9.T7.3.1.17.5" class="ltx_td ltx_align_center">-0.036</td>
<td id="A9.T7.3.1.17.6" class="ltx_td ltx_align_center">-0.038</td>
</tr>
<tr id="A9.T7.3.1.18" class="ltx_tr">
<td id="A9.T7.3.1.18.1" class="ltx_td ltx_align_left ltx_border_t">Llama3-instruct</td>
<td id="A9.T7.3.1.18.2" class="ltx_td ltx_align_right ltx_border_t">70B</td>
<td id="A9.T7.3.1.18.3" class="ltx_td ltx_align_center ltx_border_t">0.432</td>
<td id="A9.T7.3.1.18.4" class="ltx_td ltx_align_center ltx_border_t">0.436</td>
<td id="A9.T7.3.1.18.5" class="ltx_td ltx_align_center ltx_border_t">0.107</td>
<td id="A9.T7.3.1.18.6" class="ltx_td ltx_align_center ltx_border_t">-0.109</td>
</tr>
<tr id="A9.T7.3.1.19" class="ltx_tr">
<td id="A9.T7.3.1.19.1" class="ltx_td"></td>
<td id="A9.T7.3.1.19.2" class="ltx_td ltx_align_right">8B</td>
<td id="A9.T7.3.1.19.3" class="ltx_td ltx_align_center">0.317</td>
<td id="A9.T7.3.1.19.4" class="ltx_td ltx_align_center">0.319</td>
<td id="A9.T7.3.1.19.5" class="ltx_td ltx_align_center">-0.051</td>
<td id="A9.T7.3.1.19.6" class="ltx_td ltx_align_center">-0.050</td>
</tr>
<tr id="A9.T7.3.1.20" class="ltx_tr">
<td id="A9.T7.3.1.20.1" class="ltx_td ltx_align_left ltx_border_t">Qwen2-Instruct</td>
<td id="A9.T7.3.1.20.2" class="ltx_td ltx_align_right ltx_border_t">72B</td>
<td id="A9.T7.3.1.20.3" class="ltx_td ltx_align_center ltx_border_t">0.382</td>
<td id="A9.T7.3.1.20.4" class="ltx_td ltx_align_center ltx_border_t">0.385</td>
<td id="A9.T7.3.1.20.5" class="ltx_td ltx_align_center ltx_border_t">-0.157</td>
<td id="A9.T7.3.1.20.6" class="ltx_td ltx_align_center ltx_border_t">-0.155</td>
</tr>
<tr id="A9.T7.3.1.21" class="ltx_tr">
<td id="A9.T7.3.1.21.1" class="ltx_td"></td>
<td id="A9.T7.3.1.21.2" class="ltx_td ltx_align_right">57B-A14B</td>
<td id="A9.T7.3.1.21.3" class="ltx_td ltx_align_center">0.357</td>
<td id="A9.T7.3.1.21.4" class="ltx_td ltx_align_center">0.361</td>
<td id="A9.T7.3.1.21.5" class="ltx_td ltx_align_center">-0.108</td>
<td id="A9.T7.3.1.21.6" class="ltx_td ltx_align_center">-0.060</td>
</tr>
<tr id="A9.T7.3.1.22" class="ltx_tr">
<td id="A9.T7.3.1.22.1" class="ltx_td"></td>
<td id="A9.T7.3.1.22.2" class="ltx_td ltx_align_right">7B</td>
<td id="A9.T7.3.1.22.3" class="ltx_td ltx_align_center">0.280</td>
<td id="A9.T7.3.1.22.4" class="ltx_td ltx_align_center">0.291</td>
<td id="A9.T7.3.1.22.5" class="ltx_td ltx_align_center">-0.127</td>
<td id="A9.T7.3.1.22.6" class="ltx_td ltx_align_center">-0.130</td>
</tr>
<tr id="A9.T7.3.1.23" class="ltx_tr">
<td id="A9.T7.3.1.23.1" class="ltx_td ltx_align_left ltx_border_t">CodeQwen1.5-Chat</td>
<td id="A9.T7.3.1.23.2" class="ltx_td ltx_align_right ltx_border_t">7B</td>
<td id="A9.T7.3.1.23.3" class="ltx_td ltx_align_center ltx_border_t">0.393</td>
<td id="A9.T7.3.1.23.4" class="ltx_td ltx_align_center ltx_border_t">0.396</td>
<td id="A9.T7.3.1.23.5" class="ltx_td ltx_align_center ltx_border_t">-0.044</td>
<td id="A9.T7.3.1.23.6" class="ltx_td ltx_align_center ltx_border_t">-0.047</td>
</tr>
<tr id="A9.T7.3.1.24" class="ltx_tr">
<td id="A9.T7.3.1.24.1" class="ltx_td ltx_align_left ltx_border_t">Qwen1.5-Chat</td>
<td id="A9.T7.3.1.24.2" class="ltx_td ltx_align_right ltx_border_t">110B</td>
<td id="A9.T7.3.1.24.3" class="ltx_td ltx_align_center ltx_border_t">0.336</td>
<td id="A9.T7.3.1.24.4" class="ltx_td ltx_align_center ltx_border_t">0.350</td>
<td id="A9.T7.3.1.24.5" class="ltx_td ltx_align_center ltx_border_t">-0.096</td>
<td id="A9.T7.3.1.24.6" class="ltx_td ltx_align_center ltx_border_t">-0.094</td>
</tr>
<tr id="A9.T7.3.1.25" class="ltx_tr">
<td id="A9.T7.3.1.25.1" class="ltx_td"></td>
<td id="A9.T7.3.1.25.2" class="ltx_td ltx_align_right">72B</td>
<td id="A9.T7.3.1.25.3" class="ltx_td ltx_align_center">0.326</td>
<td id="A9.T7.3.1.25.4" class="ltx_td ltx_align_center">0.332</td>
<td id="A9.T7.3.1.25.5" class="ltx_td ltx_align_center">-0.072</td>
<td id="A9.T7.3.1.25.6" class="ltx_td ltx_align_center">-0.071</td>
</tr>
<tr id="A9.T7.3.1.26" class="ltx_tr">
<td id="A9.T7.3.1.26.1" class="ltx_td"></td>
<td id="A9.T7.3.1.26.2" class="ltx_td ltx_align_right">32B</td>
<td id="A9.T7.3.1.26.3" class="ltx_td ltx_align_center">0.318</td>
<td id="A9.T7.3.1.26.4" class="ltx_td ltx_align_center">0.323</td>
<td id="A9.T7.3.1.26.5" class="ltx_td ltx_align_center">-0.092</td>
<td id="A9.T7.3.1.26.6" class="ltx_td ltx_align_center">-0.097</td>
</tr>
<tr id="A9.T7.3.1.27" class="ltx_tr">
<td id="A9.T7.3.1.27.1" class="ltx_td ltx_align_left ltx_border_t">Yi-1.5-Chat</td>
<td id="A9.T7.3.1.27.2" class="ltx_td ltx_align_right ltx_border_t">34B</td>
<td id="A9.T7.3.1.27.3" class="ltx_td ltx_align_center ltx_border_t">0.335</td>
<td id="A9.T7.3.1.27.4" class="ltx_td ltx_align_center ltx_border_t">0.339</td>
<td id="A9.T7.3.1.27.5" class="ltx_td ltx_align_center ltx_border_t">-0.098</td>
<td id="A9.T7.3.1.27.6" class="ltx_td ltx_align_center ltx_border_t">-0.089</td>
</tr>
<tr id="A9.T7.3.1.28" class="ltx_tr">
<td id="A9.T7.3.1.28.1" class="ltx_td"></td>
<td id="A9.T7.3.1.28.2" class="ltx_td ltx_align_right">9B</td>
<td id="A9.T7.3.1.28.3" class="ltx_td ltx_align_center">0.343</td>
<td id="A9.T7.3.1.28.4" class="ltx_td ltx_align_center">0.345</td>
<td id="A9.T7.3.1.28.5" class="ltx_td ltx_align_center">-0.079</td>
<td id="A9.T7.3.1.28.6" class="ltx_td ltx_align_center">-0.079</td>
</tr>
<tr id="A9.T7.3.1.29" class="ltx_tr">
<td id="A9.T7.3.1.29.1" class="ltx_td"></td>
<td id="A9.T7.3.1.29.2" class="ltx_td ltx_align_right">6B</td>
<td id="A9.T7.3.1.29.3" class="ltx_td ltx_align_center">0.255</td>
<td id="A9.T7.3.1.29.4" class="ltx_td ltx_align_center">0.256</td>
<td id="A9.T7.3.1.29.5" class="ltx_td ltx_align_center">-0.083</td>
<td id="A9.T7.3.1.29.6" class="ltx_td ltx_align_center">-0.083</td>
</tr>
<tr id="A9.T7.3.1.30" class="ltx_tr">
<td id="A9.T7.3.1.30.1" class="ltx_td ltx_align_left ltx_border_t">Mistral</td>
<td id="A9.T7.3.1.30.2" class="ltx_td ltx_align_right ltx_border_t">Large</td>
<td id="A9.T7.3.1.30.3" class="ltx_td ltx_align_center ltx_border_t">0.296</td>
<td id="A9.T7.3.1.30.4" class="ltx_td ltx_align_center ltx_border_t">0.300</td>
<td id="A9.T7.3.1.30.5" class="ltx_td ltx_align_center ltx_border_t">-0.083</td>
<td id="A9.T7.3.1.30.6" class="ltx_td ltx_align_center ltx_border_t">-0.083</td>
</tr>
<tr id="A9.T7.3.1.31" class="ltx_tr">
<td id="A9.T7.3.1.31.1" class="ltx_td"></td>
<td id="A9.T7.3.1.31.2" class="ltx_td ltx_align_right">Small</td>
<td id="A9.T7.3.1.31.3" class="ltx_td ltx_align_center">0.318</td>
<td id="A9.T7.3.1.31.4" class="ltx_td ltx_align_center">0.321</td>
<td id="A9.T7.3.1.31.5" class="ltx_td ltx_align_center">-0.072</td>
<td id="A9.T7.3.1.31.6" class="ltx_td ltx_align_center">-0.092</td>
</tr>
<tr id="A9.T7.3.1.32" class="ltx_tr">
<td id="A9.T7.3.1.32.1" class="ltx_td ltx_align_left ltx_border_t">Mixtral</td>
<td id="A9.T7.3.1.32.2" class="ltx_td ltx_align_right ltx_border_t">8x22B</td>
<td id="A9.T7.3.1.32.3" class="ltx_td ltx_align_center ltx_border_t">0.404</td>
<td id="A9.T7.3.1.32.4" class="ltx_td ltx_align_center ltx_border_t">0.406</td>
<td id="A9.T7.3.1.32.5" class="ltx_td ltx_align_center ltx_border_t">-0.092</td>
<td id="A9.T7.3.1.32.6" class="ltx_td ltx_align_center ltx_border_t">-0.096</td>
</tr>
<tr id="A9.T7.3.1.33" class="ltx_tr">
<td id="A9.T7.3.1.33.1" class="ltx_td ltx_align_left ltx_border_t">Magicoder-S-DS</td>
<td id="A9.T7.3.1.33.2" class="ltx_td ltx_align_right ltx_border_t">6.7B</td>
<td id="A9.T7.3.1.33.3" class="ltx_td ltx_align_center ltx_border_t">0.360</td>
<td id="A9.T7.3.1.33.4" class="ltx_td ltx_align_center ltx_border_t">0.362</td>
<td id="A9.T7.3.1.33.5" class="ltx_td ltx_align_center ltx_border_t">-0.115</td>
<td id="A9.T7.3.1.33.6" class="ltx_td ltx_align_center ltx_border_t">-0.114</td>
</tr>
<tr id="A9.T7.3.1.34" class="ltx_tr">
<td id="A9.T7.3.1.34.1" class="ltx_td ltx_align_left ltx_border_t">CodeGemma-instruct</td>
<td id="A9.T7.3.1.34.2" class="ltx_td ltx_align_right ltx_border_t">7B</td>
<td id="A9.T7.3.1.34.3" class="ltx_td ltx_align_center ltx_border_t">0.321</td>
<td id="A9.T7.3.1.34.4" class="ltx_td ltx_align_center ltx_border_t">0.323</td>
<td id="A9.T7.3.1.34.5" class="ltx_td ltx_align_center ltx_border_t">-0.062</td>
<td id="A9.T7.3.1.34.6" class="ltx_td ltx_align_center ltx_border_t">-0.070</td>
</tr>
<tr id="A9.T7.3.1.35" class="ltx_tr">
<td id="A9.T7.3.1.35.1" class="ltx_td ltx_align_left ltx_border_t">StarCoder2-Instruct</td>
<td id="A9.T7.3.1.35.2" class="ltx_td ltx_align_right ltx_border_t">15B</td>
<td id="A9.T7.3.1.35.3" class="ltx_td ltx_align_center ltx_border_t">0.367</td>
<td id="A9.T7.3.1.35.4" class="ltx_td ltx_align_center ltx_border_t">0.376</td>
<td id="A9.T7.3.1.35.5" class="ltx_td ltx_align_center ltx_border_t">-0.070</td>
<td id="A9.T7.3.1.35.6" class="ltx_td ltx_align_center ltx_border_t">-0.075</td>
</tr>
<tr id="A9.T7.3.1.36" class="ltx_tr">
<td id="A9.T7.3.1.36.1" class="ltx_td ltx_align_left ltx_border_t">Granite-Code-Instruct</td>
<td id="A9.T7.3.1.36.2" class="ltx_td ltx_align_right ltx_border_t">34B</td>
<td id="A9.T7.3.1.36.3" class="ltx_td ltx_align_center ltx_border_t">0.358</td>
<td id="A9.T7.3.1.36.4" class="ltx_td ltx_align_center ltx_border_t">0.361</td>
<td id="A9.T7.3.1.36.5" class="ltx_td ltx_align_center ltx_border_t">-0.080</td>
<td id="A9.T7.3.1.36.6" class="ltx_td ltx_align_center ltx_border_t">-0.083</td>
</tr>
<tr id="A9.T7.3.1.37" class="ltx_tr">
<td id="A9.T7.3.1.37.1" class="ltx_td ltx_border_bb"></td>
<td id="A9.T7.3.1.37.2" class="ltx_td ltx_align_right ltx_border_bb">20B</td>
<td id="A9.T7.3.1.37.3" class="ltx_td ltx_align_center ltx_border_bb">0.337</td>
<td id="A9.T7.3.1.37.4" class="ltx_td ltx_align_center ltx_border_bb">0.340</td>
<td id="A9.T7.3.1.37.5" class="ltx_td ltx_align_center ltx_border_bb">-0.084</td>
<td id="A9.T7.3.1.37.6" class="ltx_td ltx_align_center ltx_border_bb">-0.081</td>
</tr>
</table>
</span></div>
</figure>
</section>
<section id="A9.SS2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">I.2 </span>Further Analysis</h4>

<section id="A9.SS2.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Bigger models yield better programming performance</h6>

<div id="A9.SS2.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="A9.SS2.SSS0.Px1.p1.1" class="ltx_p">The performance on <span id="A9.SS2.SSS0.Px1.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> displays signs of scaling laws, where the models with more parameters generally solve more programming tasks. While the scaling laws hold for most instruction-tuned and base LLMs, Mistral-Large appears less capable than Mistral-Small on both <span id="A9.SS2.SSS0.Px1.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A9.SS2.SSS0.Px1.p1.1.3" class="ltx_text ltx_font_typewriter">Complete</span> and <span id="A9.SS2.SSS0.Px1.p1.1.4" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A9.SS2.SSS0.Px1.p1.1.5" class="ltx_text ltx_font_typewriter">Instruct</span>, implying that Mistral-Large may be under-fitting. Our findings are consistent with <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib63" title="" class="ltx_ref">63</a>]</cite>.</p>
</div>
</section>
<section id="A9.SS2.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Closed LLMs perform better than open LLMs</h6>

<div id="A9.SS2.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="A9.SS2.SSS0.Px2.p1.1" class="ltx_p">We notice that most strong LLMs on <span id="A9.SS2.SSS0.Px2.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> are non-permissive, led by the models from OpenAI and Anthropic. Among the open LLMs, the best model, Llama3-instruct-70B, slightly outperforms Claude-3-Sonnet and ranks 5th on both <span id="A9.SS2.SSS0.Px2.p1.1.2" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A9.SS2.SSS0.Px2.p1.1.3" class="ltx_text ltx_font_typewriter">Complete</span> and <span id="A9.SS2.SSS0.Px2.p1.1.4" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A9.SS2.SSS0.Px2.p1.1.5" class="ltx_text ltx_font_typewriter">Instruct</span>. The most permissive LLMs are relatively small and, hence, remain in a gap from the non-permissive ones.</p>
</div>
</section>
<section id="A9.SS2.SSS0.Px3" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">Jack of all trades, master of most</h6>

<div id="A9.SS2.SSS0.Px3.p1" class="ltx_para ltx_noindent">
<p id="A9.SS2.SSS0.Px3.p1.1" class="ltx_p"><a href="#S4.F7" title="Figure 7 ‣ LLMs are sensitive to the verbosity of programming instructions ‣ 4.1 Measuring Task-Level Performance ‣ 4 Evaluation ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Figure 7</span></a> shows the top 5 for instruction-tuned ranked on <span id="A9.SS2.SSS0.Px3.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>-<span id="A9.SS2.SSS0.Px3.p1.1.2" class="ltx_text ltx_font_typewriter">Complete</span>. Best overall base LLMs like Dpsk-Coder-Base-6.7B excel in most domains but still fall short in certain ones. We suggest that the domain-specific specialty will likely result from the training data.</p>
</div>
<figure id="A9.F14" class="ltx_figure ltx_align_floatright"><img src="/html/2406.15877/assets/x19.png" id="A9.F14.g1" class="ltx_graphics ltx_centering ltx_img_landscape" width="207" height="164" alt="Refer to caption">
<figcaption class="ltx_caption ltx_centering"><span class="ltx_tag ltx_tag_figure">Figure 14: </span>Top 5 base LLMs</figcaption>
</figure>
</section>
<section id="A9.SS2.SSS0.Px4" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">LLMs are better at computation, cryptography, and general domains</h6>

<div id="A9.SS2.SSS0.Px4.p1" class="ltx_para ltx_noindent">
<p id="A9.SS2.SSS0.Px4.p1.1" class="ltx_p">We further investigate the performance among different domains and find that models tend to be more capable of the tools in computation, cryptography, and general domains. On the other hand, models frequently fail when the tasks involve network tools. Therefore, we encourage the development of models specializing in such low-performing domains. A few examples of failures in the network domain can be found in <a href="#A10" title="Appendix J Qualitative Studies ‣ BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions" class="ltx_ref ltx_refmacro_autoref"><span class="ltx_text ltx_ref_tag">Appendix J</span></a> Examples 6, 7, and 8.</p>
</div>
</section>
</section>
</section>
<section id="A10" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix J </span>Qualitative Studies</h3>

<div id="A10.p1" class="ltx_para ltx_noindent">
<p id="A10.p1.1" class="ltx_p">Our benchmark exposes instances where even the strongest models struggle to use APIs, which may not be exposed by simple benchmarks like HumanEval. Here, we show some examples with GPT-4o.</p>
</div>
<div id="A10.p2" class="ltx_para ltx_noindent">
<p id="A10.p2.1" class="ltx_p"><span id="A10.p2.1.1" class="ltx_text ltx_font_bold">Example 1</span>: In the following example, the model fails to use <span id="A10.p2.1.2" class="ltx_text ltx_font_typewriter">itertools.cycle</span> correctly, producing an infinite loop.</p>
</div>
<div id="A10.p3" class="ltx_para ltx_noindent">
<div id="A10.p3.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,ZnJvbSBjb2xsZWN0aW9ucyBpbXBvcnQgQ291bnRlcgppbXBvcnQgcmFuZG9tCmZyb20gaXRlcnRvb2xzIGltcG9ydCBjeWNsZQoKIyBDb25zdGFudHMKRUxFTUVOVFMgPSBbJ0EnLCAnQicsICdDJywgJ0QnLCAnRScsICdGJywgJ0cnLCAnSCcsICdJJywgJ0onXQoKZGVmIHRhc2tfZnVuYyhsKToKICAgICIiIgogICAgQ3JlYXRlIGEgY291bnRlciBmcm9tIGEgbGlzdCAibCIgYW5kIG1vdmUgdGhlIGZpcnN0IDMgZWxlbWVudHMgdG8gdGhlIGVuZCBvZiB0aGUgbGlzdC4KCiAgICBQYXJhbWV0ZXJzOgogICAgLSBsIChsaXN0KTogQSBsaXN0IG9mIGVsZW1lbnRzIHRoYXQgdGhlIGZ1bmN0aW9uIHdpbGwgcHJvY2Vzcy4KCiAgICBSZXR1cm5zOgogICAgLSBjb3VudGVyIChjb2xsZWN0aW9ucy5Db3VudGVyKTogQSBmcmVxdWVuY3kgY291bnRlciB0aGF0IG1hcHMgZWxlbWVudHMgZnJvbSB0aGUgaW5wdXQgbGlzdCB0byB0aGVpciBmcmVxdWVuY2llcyBpbiB0aGUgZmlyc3QgMzAgZWxlbWVudHMgb2YgdGhlIGN5Y2xlZCwgc2h1ZmZsZWQgbGlzdC4KCiAgICBSZXF1aXJlbWVudHM6CiAgICAtIGNvbGxlY3Rpb25zCiAgICAtIHJhbmRvbQogICAgLSBpdGVydG9vbHMKCiAgICBFeGFtcGxlOgogICAgPj4+IHJhbmRvbS5zZWVkKDQyKQogICAgPj4+IHRhc2tfZnVuYyhFTEVNRU5UUykKICAgIENvdW50ZXIoeydJJzogMywgJ0YnOiAzLCAnRyc6IDMsICdKJzogMywgJ0UnOiAzLCAnQSc6IDMsICdCJzogMywgJ0gnOiAzLCAnRCc6IDMsICdDJzogM30pCiAgICAiIiIKICAgICMgTW92ZSB0aGUgZmlyc3QgMyBlbGVtZW50cyB0byB0aGUgZW5kIG9mIHRoZSBsaXN0CiAgICBsID0gbFszOl0gKyBsWzozXQoKICAgICMgQ3JlYXRlIGEgY3ljbGVkLCBzaHVmZmxlZCBsaXN0CiAgICBjeWNsZWRfbGlzdCA9IGxpc3QoY3ljbGUobCkpCiAgICAuLi4=" download="">⬇</a></div>
<div id="lstnumberx708" class="ltx_listingline">
<span id="lstnumberx708.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">from</span><span id="lstnumberx708.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx708.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">collections</span><span id="lstnumberx708.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx708.5" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx708.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx708.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Counter</span>
</div>
<div id="lstnumberx709" class="ltx_listingline">
<span id="lstnumberx709.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx709.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx709.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span>
</div>
<div id="lstnumberx710" class="ltx_listingline">
<span id="lstnumberx710.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">from</span><span id="lstnumberx710.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx710.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">itertools</span><span id="lstnumberx710.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx710.5" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx710.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx710.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cycle</span>
</div>
<div id="lstnumberx711" class="ltx_listingline">
</div>
<div id="lstnumberx712" class="ltx_listingline">
<span id="lstnumberx712.1" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx712.1.1" class="ltx_text ltx_lst_space"> </span>Constants</span>
</div>
<div id="lstnumberx713" class="ltx_listingline">
<span id="lstnumberx713.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ELEMENTS</span><span id="lstnumberx713.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.3" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx713.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx713.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’A’</span><span id="lstnumberx713.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx713.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.9" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’B’</span><span id="lstnumberx713.10" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx713.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.12" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’C’</span><span id="lstnumberx713.13" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx713.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.15" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’D’</span><span id="lstnumberx713.16" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx713.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.18" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’E’</span><span id="lstnumberx713.19" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx713.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.21" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’F’</span><span id="lstnumberx713.22" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx713.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.24" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’G’</span><span id="lstnumberx713.25" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx713.26" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.27" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’H’</span><span id="lstnumberx713.28" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx713.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.30" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’I’</span><span id="lstnumberx713.31" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx713.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx713.33" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’J’</span><span id="lstnumberx713.34" class="ltx_text ltx_font_typewriter">]</span>
</div>
<div id="lstnumberx714" class="ltx_listingline">
</div>
<div id="lstnumberx715" class="ltx_listingline">
<span id="lstnumberx715.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx715.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx715.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx715.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx715.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">l</span><span id="lstnumberx715.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx716" class="ltx_listingline">
<span id="lstnumberx716.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx716.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx716.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx717" class="ltx_listingline">
<span id="lstnumberx717.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx717.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Create</span><span id="lstnumberx717.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx717.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">counter</span><span id="lstnumberx717.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from</span><span id="lstnumberx717.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx717.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx717.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx717.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">l</span><span id="lstnumberx717.16" class="ltx_text ltx_lst_string"></span><span id="lstnumberx717.17" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx717.18" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.19" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx717.20" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.21" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">move</span><span id="lstnumberx717.22" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.23" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx717.24" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.25" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">first</span><span id="lstnumberx717.26" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.27" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3</span><span id="lstnumberx717.28" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.29" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">elements</span><span id="lstnumberx717.30" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.31" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx717.32" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.33" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx717.34" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.35" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">end</span><span id="lstnumberx717.36" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.37" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx717.38" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.39" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx717.40" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx717.41" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list.</span>
</div>
<div id="lstnumberx718" class="ltx_listingline">
</div>
<div id="lstnumberx719" class="ltx_listingline">
<span id="lstnumberx719.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx719.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx720" class="ltx_listingline">
<span id="lstnumberx720.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx720.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx720.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">l</span><span id="lstnumberx720.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(list):</span><span id="lstnumberx720.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx720.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx720.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx720.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">elements</span><span id="lstnumberx720.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">that</span><span id="lstnumberx720.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx720.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">function</span><span id="lstnumberx720.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">will</span><span id="lstnumberx720.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx720.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">process.</span>
</div>
<div id="lstnumberx721" class="ltx_listingline">
</div>
<div id="lstnumberx722" class="ltx_listingline">
<span id="lstnumberx722.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx722.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx723" class="ltx_listingline">
<span id="lstnumberx723.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx723.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx723.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">counter</span><span id="lstnumberx723.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(collections.Counter):</span><span id="lstnumberx723.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx723.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">frequency</span><span id="lstnumberx723.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">counter</span><span id="lstnumberx723.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">that</span><span id="lstnumberx723.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">maps</span><span id="lstnumberx723.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">elements</span><span id="lstnumberx723.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from</span><span id="lstnumberx723.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx723.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">input</span><span id="lstnumberx723.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx723.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx723.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">their</span><span id="lstnumberx723.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">frequencies</span><span id="lstnumberx723.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx723.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx723.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">first</span><span id="lstnumberx723.39" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.40" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">30</span><span id="lstnumberx723.41" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.42" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">elements</span><span id="lstnumberx723.43" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.44" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx723.45" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.46" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx723.47" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.48" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">cycled,</span><span id="lstnumberx723.49" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.50" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">shuffled</span><span id="lstnumberx723.51" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx723.52" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list.</span>
</div>
<div id="lstnumberx724" class="ltx_listingline">
</div>
<div id="lstnumberx725" class="ltx_listingline">
<span id="lstnumberx725.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx725.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx726" class="ltx_listingline">
<span id="lstnumberx726.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx726.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx726.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx726.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">collections</span>
</div>
<div id="lstnumberx727" class="ltx_listingline">
<span id="lstnumberx727.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx727.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx727.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx727.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">random</span>
</div>
<div id="lstnumberx728" class="ltx_listingline">
<span id="lstnumberx728.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx728.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx728.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx728.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">itertools</span>
</div>
<div id="lstnumberx729" class="ltx_listingline">
</div>
<div id="lstnumberx730" class="ltx_listingline">
<span id="lstnumberx730.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx730.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx731" class="ltx_listingline">
<span id="lstnumberx731.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx731.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx731.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx731.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">random.seed(42)</span>
</div>
<div id="lstnumberx732" class="ltx_listingline">
<span id="lstnumberx732.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx732.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx732.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx732.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(ELEMENTS)</span>
</div>
<div id="lstnumberx733" class="ltx_listingline">
<span id="lstnumberx733.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx733.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Counter({’I’:</span><span id="lstnumberx733.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx733.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’F’:</span><span id="lstnumberx733.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx733.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’G’:</span><span id="lstnumberx733.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx733.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’J’:</span><span id="lstnumberx733.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx733.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’E’:</span><span id="lstnumberx733.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx733.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’A’:</span><span id="lstnumberx733.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx733.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’B’:</span><span id="lstnumberx733.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx733.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’H’:</span><span id="lstnumberx733.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx733.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’D’:</span><span id="lstnumberx733.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx733.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’C’:</span><span id="lstnumberx733.39" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx733.40" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3})</span>
</div>
<div id="lstnumberx734" class="ltx_listingline">
<span id="lstnumberx734.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx734.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx734.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx734.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx735" class="ltx_listingline">
<span id="lstnumberx735.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx735.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx735.2.1" class="ltx_text ltx_lst_space"> </span>Move<span id="lstnumberx735.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx735.2.3" class="ltx_text ltx_lst_space"> </span>first<span id="lstnumberx735.2.4" class="ltx_text ltx_lst_space"> </span>3<span id="lstnumberx735.2.5" class="ltx_text ltx_lst_space"> </span>elements<span id="lstnumberx735.2.6" class="ltx_text ltx_lst_space"> </span>to<span id="lstnumberx735.2.7" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx735.2.8" class="ltx_text ltx_lst_space"> </span>end<span id="lstnumberx735.2.9" class="ltx_text ltx_lst_space"> </span>of<span id="lstnumberx735.2.10" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx735.2.11" class="ltx_text ltx_lst_space"> </span>list</span>
</div>
<div id="lstnumberx736" class="ltx_listingline">
<span id="lstnumberx736.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx736.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">l</span><span id="lstnumberx736.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx736.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx736.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx736.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">l</span><span id="lstnumberx736.7" class="ltx_text ltx_font_typewriter">[3:]</span><span id="lstnumberx736.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx736.9" class="ltx_text ltx_font_typewriter">+</span><span id="lstnumberx736.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx736.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">l</span><span id="lstnumberx736.12" class="ltx_text ltx_font_typewriter">[:3]</span>
</div>
<div id="lstnumberx737" class="ltx_listingline">
</div>
<div id="lstnumberx738" class="ltx_listingline">
<span id="lstnumberx738.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx738.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx738.2.1" class="ltx_text ltx_lst_space"> </span>Create<span id="lstnumberx738.2.2" class="ltx_text ltx_lst_space"> </span>a<span id="lstnumberx738.2.3" class="ltx_text ltx_lst_space"> </span>cycled,<span id="lstnumberx738.2.4" class="ltx_text ltx_lst_space"> </span>shuffled<span id="lstnumberx738.2.5" class="ltx_text ltx_lst_space"> </span>list</span>
</div>
<div id="lstnumberx739" class="ltx_listingline">
<span id="lstnumberx739.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx739.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cycled_list</span><span id="lstnumberx739.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx739.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx739.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx739.6" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">list</span><span id="lstnumberx739.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx739.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">cycle</span><span id="lstnumberx739.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx739.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">l</span><span id="lstnumberx739.11" class="ltx_text ltx_font_typewriter">))</span>
</div>
<div id="lstnumberx740" class="ltx_listingline">
<span id="lstnumberx740.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx740.2" class="ltx_text ltx_font_typewriter">...</span>
</div>
</div>
</div>
<div id="A10.p4" class="ltx_para ltx_noindent">
<p id="A10.p4.1" class="ltx_p"><span id="A10.p4.1.1" class="ltx_text ltx_font_bold">Example 2</span>: In this example, the model uses the semantics of <span id="A10.p4.1.2" class="ltx_text ltx_font_typewriter">instanceof</span> incorrectly. Here, <span id="A10.p4.1.3" class="ltx_text ltx_font_typewriter">isinstance(j, (int, float))</span> does not actually check if <math id="A10.p4.1.m1.1" class="ltx_Math" alttext="j" display="inline"><semantics id="A10.p4.1.m1.1a"><mi id="A10.p4.1.m1.1.1" xref="A10.p4.1.m1.1.1.cmml">j</mi><annotation-xml encoding="MathML-Content" id="A10.p4.1.m1.1b"><ci id="A10.p4.1.m1.1.1.cmml" xref="A10.p4.1.m1.1.1">𝑗</ci></annotation-xml><annotation encoding="application/x-tex" id="A10.p4.1.m1.1c">j</annotation></semantics></math> is an int or float, but rather the type <span id="A10.p4.1.4" class="ltx_text ltx_font_typewriter">(int, float)</span>.</p>
</div>
<div id="A10.p5" class="ltx_para ltx_noindent">
<div id="A10.p5.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,aW1wb3J0IHBhbmRhcyBhcyBwZAppbXBvcnQgc2VhYm9ybiBhcyBzbnMKCmRlZiB0YXNrX2Z1bmMoZGF0YSk6CiAgICAiIiIKICAgIEFuYWx5emUgYSBkYXRhc2V0IGJ5IGNhbGN1bGF0aW5nIHRoZSBhdmVyYWdlIG9mIHZhbHVlcyBhY3Jvc3MgZWFjaCByb3cgYW5kIHZpc3VhbGl6aW5nIHRoZSBjb3JyZWxhdGlvbiBtYXRyaXggYXMgYQogICAgaGVhdG1hcC4KCiAgICBQYXJhbWV0ZXJzOgogICAgZGF0YSAobnVtcHkuYXJyYXkpOiAyRCBhcnJheSB3aGVyZSBlYWNoIHJvdyByZXByZXNlbnRzIGEgcmVjb3JkIGFuZCBlYWNoIGNvbHVtbiByZXByZXNlbnRzIGEgZmVhdHVyZQoKICAgIFJldHVybnM6CiAgICB0dXBsZTogQSB0dXBsZSBjb250YWluaW5nOgogICAgICAgIC0gRGF0YUZyYW1lOiBBIHBhbmRhcyBEYXRhRnJhbWUgZW5oYW5jZWQgd2l0aCBhbiAnQXZlcmFnZScgY29sdW1uIHRoYXQgcmVwcmVzZW50cyB0aGUgbWVhbiBhY3Jvc3MgZWFjaCByb3cuCiAgICAgICAgLSBBeGVzOiBUaGUgbWF0cGxvdGxpYiBBeGVzIG9iamVjdCBzaG93aW5nIHRoZSBoZWF0bWFwIG9mIHRoZSBjb3JyZWxhdGlvbnMuCgogICAgUmVxdWlyZW1lbnRzOgogICAgLSBwYW5kYXMKICAgIC0gbnVtcHkKICAgIC0gc2VhYm9ybgoKICAgIFJhaXNlczoKICAgIFZhbHVlRXJyb3I6IElmIHRoZSBpbnB1dCBkYXRhIGlzIG5vdCBhIDJEIGFycmF5IG9yIGlmIGl0IGNvbnRhaW5zIG5vbi1udW1lcmljIGRhdGEuCgogICAgRXhhbXBsZToKICAgID4+PiBkYXRhID0gbnAuYXJyYXkoW1sxLCAyLCAzLCA0LCA1LCA2LCA3LCA4XSwgWzgsIDcsIDYsIDUsIDQsIDMsIDIsIDFdXSkKICAgID4+PiBkZiwgYXggPSB0YXNrX2Z1bmMoZGF0YSkKICAgID4+PiBwcmludChkZlsnQXZlcmFnZSddLnRvX3N0cmluZyhpbmRleD1GYWxzZSkpCiAgICA0LjUKICAgIDQuNQogICAgIiIiCiAgICAjIENoZWNrIGlmIGRhdGEgaXMgYSAyRCBhcnJheQogICAgaWYgbm90IGlzaW5zdGFuY2UoZGF0YSwgKGxpc3QsIG5wLm5kYXJyYXkpKSBvciBub3QgYWxsKGlzaW5zdGFuY2UoaSwgKGxpc3QsIG5wLm5kYXJyYXkpKSBmb3IgaSBpbiBkYXRhKToKICAgICAgICByYWlzZSBWYWx1ZUVycm9yKCJJbnB1dCBkYXRhIGlzIG5vdCBhIDJEIGFycmF5IikKICAgICMgQ2hlY2sgaWYgZGF0YSBjb250YWlucyBvbmx5IG51bWVyaWMgdmFsdWVzCiAgICBpZiBub3QgYWxsKGFsbChpc2luc3RhbmNlKGosIChpbnQsIGZsb2F0KSkgZm9yIGogaW4gaSkgZm9yIGkgaW4gZGF0YSk6CiAgICAgICAgcmFpc2UgVmFsdWVFcnJvcigiSW5wdXQgZGF0YSBjb250YWlucyBub24tbnVtZXJpYyBkYXRhIikKICAgIC4uLg==" download="">⬇</a></div>
<div id="lstnumberx741" class="ltx_listingline">
<span id="lstnumberx741.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx741.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx741.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pandas</span><span id="lstnumberx741.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx741.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx741.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx741.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pd</span>
</div>
<div id="lstnumberx742" class="ltx_listingline">
<span id="lstnumberx742.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx742.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx742.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seaborn</span><span id="lstnumberx742.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx742.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx742.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx742.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sns</span>
</div>
<div id="lstnumberx743" class="ltx_listingline">
</div>
<div id="lstnumberx744" class="ltx_listingline">
<span id="lstnumberx744.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx744.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx744.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx744.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx744.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx744.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx745" class="ltx_listingline">
<span id="lstnumberx745.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx745.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx745.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx746" class="ltx_listingline">
<span id="lstnumberx746.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx746.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Analyze</span><span id="lstnumberx746.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx746.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dataset</span><span id="lstnumberx746.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">by</span><span id="lstnumberx746.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">calculating</span><span id="lstnumberx746.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx746.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">average</span><span id="lstnumberx746.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx746.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx746.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">across</span><span id="lstnumberx746.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx746.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">row</span><span id="lstnumberx746.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx746.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">visualizing</span><span id="lstnumberx746.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx746.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">correlation</span><span id="lstnumberx746.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matrix</span><span id="lstnumberx746.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">as</span><span id="lstnumberx746.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx746.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span>
</div>
<div id="lstnumberx747" class="ltx_listingline">
<span id="lstnumberx747.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx747.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">heatmap.</span>
</div>
<div id="lstnumberx748" class="ltx_listingline">
</div>
<div id="lstnumberx749" class="ltx_listingline">
<span id="lstnumberx749.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx749.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx750" class="ltx_listingline">
<span id="lstnumberx750.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx750.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx750.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(numpy.array):</span><span id="lstnumberx750.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2D</span><span id="lstnumberx750.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">array</span><span id="lstnumberx750.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">where</span><span id="lstnumberx750.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx750.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">row</span><span id="lstnumberx750.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">represents</span><span id="lstnumberx750.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx750.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">record</span><span id="lstnumberx750.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx750.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx750.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">column</span><span id="lstnumberx750.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">represents</span><span id="lstnumberx750.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx750.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx750.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">feature</span>
</div>
<div id="lstnumberx751" class="ltx_listingline">
</div>
<div id="lstnumberx752" class="ltx_listingline">
<span id="lstnumberx752.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx752.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx753" class="ltx_listingline">
<span id="lstnumberx753.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx753.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuple:</span><span id="lstnumberx753.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx753.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx753.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx753.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuple</span><span id="lstnumberx753.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx753.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">containing:</span>
</div>
<div id="lstnumberx754" class="ltx_listingline">
<span id="lstnumberx754.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">        </span><span id="lstnumberx754.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx754.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">DataFrame:</span><span id="lstnumberx754.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx754.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pandas</span><span id="lstnumberx754.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">DataFrame</span><span id="lstnumberx754.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">enhanced</span><span id="lstnumberx754.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx754.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">an</span><span id="lstnumberx754.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’Average’</span><span id="lstnumberx754.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">column</span><span id="lstnumberx754.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">that</span><span id="lstnumberx754.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">represents</span><span id="lstnumberx754.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx754.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">mean</span><span id="lstnumberx754.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">across</span><span id="lstnumberx754.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx754.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx754.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">row.</span>
</div>
<div id="lstnumberx755" class="ltx_listingline">
<span id="lstnumberx755.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">        </span><span id="lstnumberx755.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx755.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Axes:</span><span id="lstnumberx755.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx755.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matplotlib</span><span id="lstnumberx755.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Axes</span><span id="lstnumberx755.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">object</span><span id="lstnumberx755.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">showing</span><span id="lstnumberx755.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx755.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">heatmap</span><span id="lstnumberx755.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx755.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx755.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx755.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">correlations.</span>
</div>
<div id="lstnumberx756" class="ltx_listingline">
</div>
<div id="lstnumberx757" class="ltx_listingline">
<span id="lstnumberx757.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx757.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx758" class="ltx_listingline">
<span id="lstnumberx758.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx758.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx758.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx758.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pandas</span>
</div>
<div id="lstnumberx759" class="ltx_listingline">
<span id="lstnumberx759.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx759.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx759.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx759.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numpy</span>
</div>
<div id="lstnumberx760" class="ltx_listingline">
<span id="lstnumberx760.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx760.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx760.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx760.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">seaborn</span>
</div>
<div id="lstnumberx761" class="ltx_listingline">
</div>
<div id="lstnumberx762" class="ltx_listingline">
<span id="lstnumberx762.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx762.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Raises:</span>
</div>
<div id="lstnumberx763" class="ltx_listingline">
<span id="lstnumberx763.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx763.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ValueError:</span><span id="lstnumberx763.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx763.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx763.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">input</span><span id="lstnumberx763.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx763.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx763.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">not</span><span id="lstnumberx763.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx763.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2D</span><span id="lstnumberx763.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">array</span><span id="lstnumberx763.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">or</span><span id="lstnumberx763.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx763.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">it</span><span id="lstnumberx763.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">contains</span><span id="lstnumberx763.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">non-numeric</span><span id="lstnumberx763.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx763.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data.</span>
</div>
<div id="lstnumberx764" class="ltx_listingline">
</div>
<div id="lstnumberx765" class="ltx_listingline">
<span id="lstnumberx765.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx765.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx766" class="ltx_listingline">
<span id="lstnumberx766.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx766.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx766.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx766.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx766.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">np.array([[1,</span><span id="lstnumberx766.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2,</span><span id="lstnumberx766.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx766.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4,</span><span id="lstnumberx766.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">5,</span><span id="lstnumberx766.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">6,</span><span id="lstnumberx766.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">7,</span><span id="lstnumberx766.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">8],</span><span id="lstnumberx766.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">[8,</span><span id="lstnumberx766.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">7,</span><span id="lstnumberx766.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">6,</span><span id="lstnumberx766.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">5,</span><span id="lstnumberx766.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4,</span><span id="lstnumberx766.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx766.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2,</span><span id="lstnumberx766.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx766.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">1]])</span>
</div>
<div id="lstnumberx767" class="ltx_listingline">
<span id="lstnumberx767.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx767.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx767.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx767.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">df,</span><span id="lstnumberx767.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx767.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ax</span><span id="lstnumberx767.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx767.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx767.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx767.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(data)</span>
</div>
<div id="lstnumberx768" class="ltx_listingline">
<span id="lstnumberx768.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx768.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx768.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx768.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">print(df[’Average’].to_string(index=False))</span>
</div>
<div id="lstnumberx769" class="ltx_listingline">
<span id="lstnumberx769.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx769.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4.5</span>
</div>
<div id="lstnumberx770" class="ltx_listingline">
<span id="lstnumberx770.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx770.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4.5</span>
</div>
<div id="lstnumberx771" class="ltx_listingline">
<span id="lstnumberx771.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx771.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx771.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx771.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx772" class="ltx_listingline">
<span id="lstnumberx772.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx772.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx772.2.1" class="ltx_text ltx_lst_space"> </span>Check<span id="lstnumberx772.2.2" class="ltx_text ltx_lst_space"> </span>if<span id="lstnumberx772.2.3" class="ltx_text ltx_lst_space"> </span>data<span id="lstnumberx772.2.4" class="ltx_text ltx_lst_space"> </span>is<span id="lstnumberx772.2.5" class="ltx_text ltx_lst_space"> </span>a<span id="lstnumberx772.2.6" class="ltx_text ltx_lst_space"> </span>2D<span id="lstnumberx772.2.7" class="ltx_text ltx_lst_space"> </span>array</span>
</div>
<div id="lstnumberx773" class="ltx_listingline">
<span id="lstnumberx773.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx773.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx773.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.4" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">not</span><span id="lstnumberx773.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.6" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">isinstance</span><span id="lstnumberx773.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx773.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx773.9" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx773.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx773.12" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">list</span><span id="lstnumberx773.13" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx773.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx773.16" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx773.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ndarray</span><span id="lstnumberx773.18" class="ltx_text ltx_font_typewriter">))</span><span id="lstnumberx773.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.20" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">or</span><span id="lstnumberx773.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.22" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">not</span><span id="lstnumberx773.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.24" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">all</span><span id="lstnumberx773.25" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx773.26" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">isinstance</span><span id="lstnumberx773.27" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx773.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">i</span><span id="lstnumberx773.29" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx773.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.31" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx773.32" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">list</span><span id="lstnumberx773.33" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx773.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.35" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx773.36" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx773.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ndarray</span><span id="lstnumberx773.38" class="ltx_text ltx_font_typewriter">))</span><span id="lstnumberx773.39" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.40" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx773.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.42" class="ltx_text ltx_lst_identifier ltx_font_typewriter">i</span><span id="lstnumberx773.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.44" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx773.45" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx773.46" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx773.47" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx774" class="ltx_listingline">
<span id="lstnumberx774.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx774.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">raise</span><span id="lstnumberx774.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx774.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ValueError</span><span id="lstnumberx774.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx774.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Input<span id="lstnumberx774.6.1" class="ltx_text ltx_lst_space"> </span>data<span id="lstnumberx774.6.2" class="ltx_text ltx_lst_space"> </span>is<span id="lstnumberx774.6.3" class="ltx_text ltx_lst_space"> </span>not<span id="lstnumberx774.6.4" class="ltx_text ltx_lst_space"> </span>a<span id="lstnumberx774.6.5" class="ltx_text ltx_lst_space"> </span>2D<span id="lstnumberx774.6.6" class="ltx_text ltx_lst_space"> </span>array"</span><span id="lstnumberx774.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx775" class="ltx_listingline">
<span id="lstnumberx775.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx775.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx775.2.1" class="ltx_text ltx_lst_space"> </span>Check<span id="lstnumberx775.2.2" class="ltx_text ltx_lst_space"> </span>if<span id="lstnumberx775.2.3" class="ltx_text ltx_lst_space"> </span>data<span id="lstnumberx775.2.4" class="ltx_text ltx_lst_space"> </span>contains<span id="lstnumberx775.2.5" class="ltx_text ltx_lst_space"> </span>only<span id="lstnumberx775.2.6" class="ltx_text ltx_lst_space"> </span>numeric<span id="lstnumberx775.2.7" class="ltx_text ltx_lst_space"> </span>values</span>
</div>
<div id="lstnumberx776" class="ltx_listingline">
<span id="lstnumberx776.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx776.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx776.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.4" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">not</span><span id="lstnumberx776.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.6" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">all</span><span id="lstnumberx776.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx776.8" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">all</span><span id="lstnumberx776.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx776.10" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">isinstance</span><span id="lstnumberx776.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx776.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">j</span><span id="lstnumberx776.13" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx776.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.15" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx776.16" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">int</span><span id="lstnumberx776.17" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx776.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.19" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">float</span><span id="lstnumberx776.20" class="ltx_text ltx_font_typewriter">))</span><span id="lstnumberx776.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.22" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx776.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.24" class="ltx_text ltx_lst_identifier ltx_font_typewriter">j</span><span id="lstnumberx776.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.26" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx776.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.28" class="ltx_text ltx_lst_identifier ltx_font_typewriter">i</span><span id="lstnumberx776.29" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx776.30" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.31" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx776.32" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.33" class="ltx_text ltx_lst_identifier ltx_font_typewriter">i</span><span id="lstnumberx776.34" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.35" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx776.36" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx776.37" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx776.38" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx777" class="ltx_listingline">
<span id="lstnumberx777.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx777.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">raise</span><span id="lstnumberx777.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx777.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ValueError</span><span id="lstnumberx777.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx777.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Input<span id="lstnumberx777.6.1" class="ltx_text ltx_lst_space"> </span>data<span id="lstnumberx777.6.2" class="ltx_text ltx_lst_space"> </span>contains<span id="lstnumberx777.6.3" class="ltx_text ltx_lst_space"> </span>non-numeric<span id="lstnumberx777.6.4" class="ltx_text ltx_lst_space"> </span>data"</span><span id="lstnumberx777.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx778" class="ltx_listingline">
<span id="lstnumberx778.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx778.2" class="ltx_text ltx_font_typewriter">...</span>
</div>
</div>
</div>
<div id="A10.p6" class="ltx_para ltx_noindent">
<p id="A10.p6.1" class="ltx_p"><span id="A10.p6.1.1" class="ltx_text ltx_font_bold">Example 3</span>: Here, the model mishandles the case where the directory does not exist with incorrect use of <span id="A10.p6.1.2" class="ltx_text ltx_font_typewriter">os.path.dirname</span>.</p>
<div id="A10.p6.2" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,aW1wb3J0IHBpY2tsZQppbXBvcnQgb3MKCmRlZiB0YXNrX2Z1bmMoZmlsZW5hbWUsIGRhdGEpOgogICAgIiIiCiAgICBTZXJpYWxpemUgYW4gb2JqZWN0IHVzaW5nIHBpY2tsZSBhbmQgb3ZlcndyaXRlIHRoZSBzcGVjaWZpZWQgZmlsZSB3aXRoIHRoaXMgc2VyaWFsaXplZCBkYXRhLgogICAgQmVmb3JlIHdyaXRpbmcsIGNoZWNrcyBpZiB0aGUgZGlyZWN0b3J5IGV4aXN0cywgY3JlYXRpbmcgaXQgaWYgbmVjZXNzYXJ5LgoKICAgIFBhcmFtZXRlcnM6CiAgICAtIGZpbGVuYW1lIChzdHIpOiBUaGUgcGF0aCBvZiB0aGUgZmlsZSB0byBiZSBvdmVyd3JpdHRlbiB3aXRoIHNlcmlhbGl6ZWQgZGF0YS4KICAgIC0gZGF0YSAob2JqZWN0KTogVGhlIG9iamVjdCB0byBzZXJpYWxpemUgYW5kIHdyaXRlIHRvIHRoZSBmaWxlLgoKICAgIFJldHVybnM6CiAgICAtIGJvb2w6IFRydWUgaWYgdGhlIG9wZXJhdGlvbiBpcyBzdWNjZXNzZnVsLCBGYWxzZSBvdGhlcndpc2UuCgogICAgUmVxdWlyZW1lbnRzOgogICAgLSBwaWNrbGUKICAgIC0gb3MKCiAgICBFeGFtcGxlOgogICAgPj4+IHJlc3VsdCA9IHRhc2tfZnVuYygnZGF0YS5wa2wnLCB7J2tleSc6ICd2YWx1ZSd9KQogICAgPj4+IHByaW50KHJlc3VsdCkKICAgIFRydWUKICAgICIiIgogICAgdHJ5OgogICAgICAgICMgQ2hlY2sgaWYgdGhlIGRpcmVjdG9yeSBleGlzdHMKICAgICAgICBkaXJfbmFtZSA9IG9zLnBhdGguZGlybmFtZShmaWxlbmFtZSkKICAgICAgICBpZiBub3Qgb3MucGF0aC5leGlzdHMoZGlyX25hbWUpOgogICAgICAgICAgICAjIENyZWF0ZSBkaXJlY3RvcnkgaWYgaXQgZG9lcyBub3QgZXhpc3QKICAgICAgICAgICAgb3MubWFrZWRpcnMoZGlyX25hbWUpCgogICAgICAgICMgT3BlbiB0aGUgZmlsZSBpbiB3cml0ZSBtb2RlCiAgICAgICAgd2l0aCBvcGVuKGZpbGVuYW1lLCAnd2InKSBhcyBmaWxlOgogICAgICAgICAgICAjIFNlcmlhbGl6ZSB0aGUgb2JqZWN0IGFuZCB3cml0ZSBpdCB0byB0aGUgZmlsZQogICAgICAgICAgICBwaWNrbGUuZHVtcChkYXRhLCBmaWxlKQoKICAgICAgICByZXR1cm4gVHJ1ZQogICAgZXhjZXB0IEV4Y2VwdGlvbiBhcyBlOgogICAgICAgIHByaW50KGYiQW4gZXJyb3Igb2NjdXJyZWQ6IHtlfSIpCiAgICAgICAgcmV0dXJuIEZhbHNl" download="">⬇</a></div>
<div id="lstnumberx779" class="ltx_listingline">
<span id="lstnumberx779.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx779.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx779.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pickle</span>
</div>
<div id="lstnumberx780" class="ltx_listingline">
<span id="lstnumberx780.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx780.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx780.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">os</span>
</div>
<div id="lstnumberx781" class="ltx_listingline">
</div>
<div id="lstnumberx782" class="ltx_listingline">
<span id="lstnumberx782.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx782.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx782.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx782.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx782.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">filename</span><span id="lstnumberx782.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx782.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx782.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx782.9" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx783" class="ltx_listingline">
<span id="lstnumberx783.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx783.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx783.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx784" class="ltx_listingline">
<span id="lstnumberx784.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx784.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Serialize</span><span id="lstnumberx784.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">an</span><span id="lstnumberx784.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">object</span><span id="lstnumberx784.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">using</span><span id="lstnumberx784.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pickle</span><span id="lstnumberx784.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx784.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">overwrite</span><span id="lstnumberx784.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx784.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">specified</span><span id="lstnumberx784.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">file</span><span id="lstnumberx784.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx784.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">this</span><span id="lstnumberx784.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">serialized</span><span id="lstnumberx784.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx784.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data.</span>
</div>
<div id="lstnumberx785" class="ltx_listingline">
<span id="lstnumberx785.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx785.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Before</span><span id="lstnumberx785.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">writing,</span><span id="lstnumberx785.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">checks</span><span id="lstnumberx785.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx785.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx785.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">directory</span><span id="lstnumberx785.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">exists,</span><span id="lstnumberx785.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">creating</span><span id="lstnumberx785.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">it</span><span id="lstnumberx785.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx785.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx785.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">necessary.</span>
</div>
<div id="lstnumberx786" class="ltx_listingline">
</div>
<div id="lstnumberx787" class="ltx_listingline">
<span id="lstnumberx787.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx787.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx788" class="ltx_listingline">
<span id="lstnumberx788.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx788.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx788.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">filename</span><span id="lstnumberx788.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(str):</span><span id="lstnumberx788.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx788.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">path</span><span id="lstnumberx788.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx788.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx788.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">file</span><span id="lstnumberx788.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx788.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx788.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">overwritten</span><span id="lstnumberx788.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx788.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">serialized</span><span id="lstnumberx788.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx788.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data.</span>
</div>
<div id="lstnumberx789" class="ltx_listingline">
<span id="lstnumberx789.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx789.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx789.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx789.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(object):</span><span id="lstnumberx789.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx789.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">object</span><span id="lstnumberx789.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx789.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">serialize</span><span id="lstnumberx789.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx789.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">write</span><span id="lstnumberx789.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx789.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx789.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx789.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">file.</span>
</div>
<div id="lstnumberx790" class="ltx_listingline">
</div>
<div id="lstnumberx791" class="ltx_listingline">
<span id="lstnumberx791.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx791.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx792" class="ltx_listingline">
<span id="lstnumberx792.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx792.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx792.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx792.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">bool:</span><span id="lstnumberx792.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx792.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">True</span><span id="lstnumberx792.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx792.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx792.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx792.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx792.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx792.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">operation</span><span id="lstnumberx792.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx792.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx792.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx792.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">successful,</span><span id="lstnumberx792.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx792.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">False</span><span id="lstnumberx792.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx792.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">otherwise.</span>
</div>
<div id="lstnumberx793" class="ltx_listingline">
</div>
<div id="lstnumberx794" class="ltx_listingline">
<span id="lstnumberx794.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx794.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx795" class="ltx_listingline">
<span id="lstnumberx795.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx795.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx795.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx795.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pickle</span>
</div>
<div id="lstnumberx796" class="ltx_listingline">
<span id="lstnumberx796.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx796.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx796.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx796.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">os</span>
</div>
<div id="lstnumberx797" class="ltx_listingline">
</div>
<div id="lstnumberx798" class="ltx_listingline">
<span id="lstnumberx798.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx798.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx799" class="ltx_listingline">
<span id="lstnumberx799.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx799.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx799.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx799.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">result</span><span id="lstnumberx799.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx799.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx799.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx799.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(’data.pkl’,</span><span id="lstnumberx799.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx799.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">{’key’:</span><span id="lstnumberx799.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx799.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’value’})</span>
</div>
<div id="lstnumberx800" class="ltx_listingline">
<span id="lstnumberx800.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx800.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx800.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx800.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">print(result)</span>
</div>
<div id="lstnumberx801" class="ltx_listingline">
<span id="lstnumberx801.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx801.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">True</span>
</div>
<div id="lstnumberx802" class="ltx_listingline">
<span id="lstnumberx802.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx802.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx802.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx802.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx803" class="ltx_listingline">
<span id="lstnumberx803.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx803.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">try</span><span id="lstnumberx803.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx804" class="ltx_listingline">
<span id="lstnumberx804.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx804.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx804.2.1" class="ltx_text ltx_lst_space"> </span>Check<span id="lstnumberx804.2.2" class="ltx_text ltx_lst_space"> </span>if<span id="lstnumberx804.2.3" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx804.2.4" class="ltx_text ltx_lst_space"> </span>directory<span id="lstnumberx804.2.5" class="ltx_text ltx_lst_space"> </span>exists</span>
</div>
<div id="lstnumberx805" class="ltx_listingline">
<span id="lstnumberx805.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx805.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dir_name</span><span id="lstnumberx805.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx805.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx805.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx805.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">os</span><span id="lstnumberx805.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx805.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">path</span><span id="lstnumberx805.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx805.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dirname</span><span id="lstnumberx805.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx805.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">filename</span><span id="lstnumberx805.13" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx806" class="ltx_listingline">
<span id="lstnumberx806.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx806.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx806.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx806.4" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">not</span><span id="lstnumberx806.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx806.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">os</span><span id="lstnumberx806.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx806.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">path</span><span id="lstnumberx806.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx806.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">exists</span><span id="lstnumberx806.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx806.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dir_name</span><span id="lstnumberx806.13" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx807" class="ltx_listingline">
<span id="lstnumberx807.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx807.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx807.2.1" class="ltx_text ltx_lst_space"> </span>Create<span id="lstnumberx807.2.2" class="ltx_text ltx_lst_space"> </span>directory<span id="lstnumberx807.2.3" class="ltx_text ltx_lst_space"> </span>if<span id="lstnumberx807.2.4" class="ltx_text ltx_lst_space"> </span>it<span id="lstnumberx807.2.5" class="ltx_text ltx_lst_space"> </span>does<span id="lstnumberx807.2.6" class="ltx_text ltx_lst_space"> </span>not<span id="lstnumberx807.2.7" class="ltx_text ltx_lst_space"> </span>exist</span>
</div>
<div id="lstnumberx808" class="ltx_listingline">
<span id="lstnumberx808.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx808.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">os</span><span id="lstnumberx808.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx808.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">makedirs</span><span id="lstnumberx808.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx808.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dir_name</span><span id="lstnumberx808.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx809" class="ltx_listingline">
</div>
<div id="lstnumberx810" class="ltx_listingline">
<span id="lstnumberx810.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx810.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx810.2.1" class="ltx_text ltx_lst_space"> </span>Open<span id="lstnumberx810.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx810.2.3" class="ltx_text ltx_lst_space"> </span>file<span id="lstnumberx810.2.4" class="ltx_text ltx_lst_space"> </span>in<span id="lstnumberx810.2.5" class="ltx_text ltx_lst_space"> </span>write<span id="lstnumberx810.2.6" class="ltx_text ltx_lst_space"> </span>mode</span>
</div>
<div id="lstnumberx811" class="ltx_listingline">
<span id="lstnumberx811.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx811.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">with</span><span id="lstnumberx811.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx811.4" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">open</span><span id="lstnumberx811.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx811.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">filename</span><span id="lstnumberx811.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx811.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx811.9" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’wb’</span><span id="lstnumberx811.10" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx811.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx811.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx811.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx811.14" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">file</span><span id="lstnumberx811.15" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx812" class="ltx_listingline">
<span id="lstnumberx812.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx812.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx812.2.1" class="ltx_text ltx_lst_space"> </span>Serialize<span id="lstnumberx812.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx812.2.3" class="ltx_text ltx_lst_space"> </span>object<span id="lstnumberx812.2.4" class="ltx_text ltx_lst_space"> </span>and<span id="lstnumberx812.2.5" class="ltx_text ltx_lst_space"> </span>write<span id="lstnumberx812.2.6" class="ltx_text ltx_lst_space"> </span>it<span id="lstnumberx812.2.7" class="ltx_text ltx_lst_space"> </span>to<span id="lstnumberx812.2.8" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx812.2.9" class="ltx_text ltx_lst_space"> </span>file</span>
</div>
<div id="lstnumberx813" class="ltx_listingline">
<span id="lstnumberx813.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx813.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pickle</span><span id="lstnumberx813.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx813.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dump</span><span id="lstnumberx813.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx813.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx813.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx813.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx813.9" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">file</span><span id="lstnumberx813.10" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx814" class="ltx_listingline">
</div>
<div id="lstnumberx815" class="ltx_listingline">
<span id="lstnumberx815.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx815.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx815.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx815.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">True</span>
</div>
<div id="lstnumberx816" class="ltx_listingline">
<span id="lstnumberx816.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx816.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">except</span><span id="lstnumberx816.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx816.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Exception</span><span id="lstnumberx816.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx816.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx816.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx816.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">e</span><span id="lstnumberx816.9" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx817" class="ltx_listingline">
<span id="lstnumberx817.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx817.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">print</span><span id="lstnumberx817.3" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx817.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx817.5" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"An<span id="lstnumberx817.5.1" class="ltx_text ltx_lst_space"> </span>error<span id="lstnumberx817.5.2" class="ltx_text ltx_lst_space"> </span>occurred:<span id="lstnumberx817.5.3" class="ltx_text ltx_lst_space"> </span>{e}"</span><span id="lstnumberx817.6" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx818" class="ltx_listingline">
<span id="lstnumberx818.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx818.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx818.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx818.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">False</span>
</div>
</div>
</div>
<div id="A10.p7" class="ltx_para ltx_noindent">
<p id="A10.p7.1" class="ltx_p"><span id="A10.p7.1.1" class="ltx_text ltx_font_bold">Example 4</span>: In this example, the model misunderstands how to use the <span id="A10.p7.1.2" class="ltx_text ltx_font_typewriter">itertools.zip_longest</span> method. The arguments must be iterable, but the written function feeds single values.</p>
<div id="A10.p7.2" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,aW1wb3J0IG51bXB5IGFzIG5wCmltcG9ydCBpdGVydG9vbHMKCmRlZiB0YXNrX2Z1bmMoZGF0YV9saXN0KToKICAgICIiIgogICAgVW56aXBzIGEgbGlzdCBvZiB0dXBsZXMgYW5kIGNhbGN1bGF0ZXMgdGhlIG1lYW4gb2YgdGhlIG51bWVyaWMgdmFsdWVzIGZvcgogICAgZWFjaCBwb3NpdGlvbi4KCiAgICBUaGUgZnVuY3Rpb24gYWNjZXB0cyBhIGxpc3Qgb2YgdHVwbGVzLCB3aGVyZSBlYWNoIHR1cGxlIGNvbnNpc3RzIG9mCiAgICBhbHBoYW51bWVyaWMgdmFsdWVzLiBJdCB1bnppcHMgdGhlIHR1cGxlcywgYW5kIGNhbGN1bGF0ZXMgdGhlIG1lYW4gb2YKICAgIG51bWVyaWMgdmFsdWVzIGF0IGVhY2ggcG9zaXRpb24gdXNpbmcgbnVtcHksIHdoZXJlIG5vbiBudW1lcmljIHZhbHVlcyBhcmUKICAgIGlnbm9yZXMuIElmIGFsbCB2YWx1ZXMgYXQgYSBwb3NpdGlvbiBhcmUgbm9uIG51bWVyaWMsIHRoZSBtZWFuIGF0IHRoaXMKICAgIHBvc2l0aW9uIGlzIHNldCB0byBiZSBucC5uYW4uCiAgICBJZiB0aGUgcHJvdmlkZWQgdHVwbGVzIGhhdmUgZGlmZmVyZW50IG51bWJlciBvZiBlbnRyaWVzLCBtaXNzaW5nIHZhbHVlcyBhcmUKICAgIHRyZWF0ZWQgYXMgemVyb3MuCgogICAgUGFyYW1ldGVyczoKICAgIC0gZGF0YV9saXN0IChsaXN0IG9mIHR1cGxlcyk6IFRoZSBkYXRhIHRvIHByb2Nlc3MsIHN0cnVjdHVyZWQgYXMgYSBsaXN0IG9mIHR1cGxlcy4gRWFjaCB0dXBsZSBjYW4gY29udGFpbiBhbHBoYW51bWVyaWMgdmFsdWVzLgoKICAgIFJldHVybnM6CiAgICAtIGxpc3Q6IEEgbGlzdCBvZiBtZWFuIHZhbHVlcyBmb3IgZWFjaCBudW1lcmljIHBvc2l0aW9uIGFjcm9zcyB0aGUgdHVwbGVzLiBOb24tbnVtZXJpYyBwb3NpdGlvbnMgYXJlIGlnbm9yZWQuCiAgICAgICAgICAgIEFuIGVtcHR5IGxpc3QgaXMgcmV0dXJuZWQgaWYgdGhlIGlucHV0IGxpc3QgKGRhdGFfbGlzdCkgaXMgZW1wdHkuCgogICAgUmVxdWlyZW1lbnRzOgogICAgLSBudW1weQogICAgLSBpdGVydG9vbHMKCiAgICBFeGFtcGxlOgogICAgPj4+IHRhc2tfZnVuYyhbKCdhJywgMSwgMiksICgnYicsIDIsIDMpLCAoJ2MnLCAzLCA0KSwgKCdkJywgNCwgNSksICgnZScsIDUsIDYpXSkKICAgIFtuYW4sIDMuMCwgNC4wXQogICAgPj4+IHRhc2tfZnVuYyhbKDEsICdhJywgMiksICgnYScsIDMsIDUpLCAoJ2MnLCAxLCAtMildKQogICAgWzEuMCwgMi4wLCAxLjY2NjY2NjY2NjY2NjY2NjddCiAgICAiIiIKICAgIGlmIG5vdCBkYXRhX2xpc3Q6CiAgICAgICAgcmV0dXJuIFtdCgogICAgbWF4X2xlbiA9IG1heChsZW4odCkgZm9yIHQgaW4gZGF0YV9saXN0KQogICAgZGF0YV9saXN0ID0gW2xpc3QoaXRlcnRvb2xzLnppcF9sb25nZXN0KCp0LCBmaWxsdmFsdWU9MCkpIGZvciB0IGluIGRhdGFfbGlzdF0KICAgIC4uLg==" download="">⬇</a></div>
<div id="lstnumberx819" class="ltx_listingline">
<span id="lstnumberx819.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx819.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx819.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numpy</span><span id="lstnumberx819.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx819.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx819.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx819.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span>
</div>
<div id="lstnumberx820" class="ltx_listingline">
<span id="lstnumberx820.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx820.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx820.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">itertools</span>
</div>
<div id="lstnumberx821" class="ltx_listingline">
</div>
<div id="lstnumberx822" class="ltx_listingline">
<span id="lstnumberx822.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx822.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx822.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx822.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx822.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx822.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx823" class="ltx_listingline">
<span id="lstnumberx823.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx823.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx823.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx824" class="ltx_listingline">
<span id="lstnumberx824.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx824.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Unzips</span><span id="lstnumberx824.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx824.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx824.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx824.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples</span><span id="lstnumberx824.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx824.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">calculates</span><span id="lstnumberx824.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx824.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">mean</span><span id="lstnumberx824.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx824.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx824.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numeric</span><span id="lstnumberx824.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx824.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx824.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">for</span>
</div>
<div id="lstnumberx825" class="ltx_listingline">
<span id="lstnumberx825.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx825.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx825.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx825.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">position.</span>
</div>
<div id="lstnumberx826" class="ltx_listingline">
</div>
<div id="lstnumberx827" class="ltx_listingline">
<span id="lstnumberx827.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx827.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx827.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">function</span><span id="lstnumberx827.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">accepts</span><span id="lstnumberx827.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx827.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx827.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx827.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples,</span><span id="lstnumberx827.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">where</span><span id="lstnumberx827.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx827.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuple</span><span id="lstnumberx827.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">consists</span><span id="lstnumberx827.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx827.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span>
</div>
<div id="lstnumberx828" class="ltx_listingline">
<span id="lstnumberx828.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx828.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">alphanumeric</span><span id="lstnumberx828.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values.</span><span id="lstnumberx828.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">It</span><span id="lstnumberx828.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">unzips</span><span id="lstnumberx828.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx828.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples,</span><span id="lstnumberx828.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx828.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">calculates</span><span id="lstnumberx828.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx828.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">mean</span><span id="lstnumberx828.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx828.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span>
</div>
<div id="lstnumberx829" class="ltx_listingline">
<span id="lstnumberx829.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx829.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numeric</span><span id="lstnumberx829.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx829.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">at</span><span id="lstnumberx829.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx829.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">position</span><span id="lstnumberx829.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">using</span><span id="lstnumberx829.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numpy,</span><span id="lstnumberx829.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">where</span><span id="lstnumberx829.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">non</span><span id="lstnumberx829.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numeric</span><span id="lstnumberx829.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx829.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx829.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">are</span>
</div>
<div id="lstnumberx830" class="ltx_listingline">
<span id="lstnumberx830.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx830.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ignores.</span><span id="lstnumberx830.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx830.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">all</span><span id="lstnumberx830.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx830.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">at</span><span id="lstnumberx830.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx830.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">position</span><span id="lstnumberx830.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">are</span><span id="lstnumberx830.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">non</span><span id="lstnumberx830.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numeric,</span><span id="lstnumberx830.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx830.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">mean</span><span id="lstnumberx830.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">at</span><span id="lstnumberx830.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx830.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">this</span>
</div>
<div id="lstnumberx831" class="ltx_listingline">
<span id="lstnumberx831.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx831.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">position</span><span id="lstnumberx831.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx831.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx831.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx831.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">set</span><span id="lstnumberx831.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx831.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx831.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx831.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx831.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx831.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">np.nan.</span>
</div>
<div id="lstnumberx832" class="ltx_listingline">
<span id="lstnumberx832.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx832.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx832.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx832.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">provided</span><span id="lstnumberx832.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples</span><span id="lstnumberx832.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">have</span><span id="lstnumberx832.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">different</span><span id="lstnumberx832.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">number</span><span id="lstnumberx832.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx832.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">entries,</span><span id="lstnumberx832.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">missing</span><span id="lstnumberx832.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx832.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx832.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">are</span>
</div>
<div id="lstnumberx833" class="ltx_listingline">
<span id="lstnumberx833.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx833.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">treated</span><span id="lstnumberx833.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx833.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">as</span><span id="lstnumberx833.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx833.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">zeros.</span>
</div>
<div id="lstnumberx834" class="ltx_listingline">
</div>
<div id="lstnumberx835" class="ltx_listingline">
<span id="lstnumberx835.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx835.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx836" class="ltx_listingline">
<span id="lstnumberx836.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx836.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx836.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data_list</span><span id="lstnumberx836.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(list</span><span id="lstnumberx836.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx836.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples):</span><span id="lstnumberx836.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx836.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx836.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx836.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">process,</span><span id="lstnumberx836.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">structured</span><span id="lstnumberx836.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">as</span><span id="lstnumberx836.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx836.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx836.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx836.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples.</span><span id="lstnumberx836.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Each</span><span id="lstnumberx836.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuple</span><span id="lstnumberx836.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">can</span><span id="lstnumberx836.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">contain</span><span id="lstnumberx836.39" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.40" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">alphanumeric</span><span id="lstnumberx836.41" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx836.42" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values.</span>
</div>
<div id="lstnumberx837" class="ltx_listingline">
</div>
<div id="lstnumberx838" class="ltx_listingline">
<span id="lstnumberx838.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx838.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx839" class="ltx_listingline">
<span id="lstnumberx839.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx839.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx839.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list:</span><span id="lstnumberx839.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx839.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx839.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx839.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">mean</span><span id="lstnumberx839.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx839.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">for</span><span id="lstnumberx839.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx839.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numeric</span><span id="lstnumberx839.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">position</span><span id="lstnumberx839.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">across</span><span id="lstnumberx839.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx839.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples.</span><span id="lstnumberx839.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Non-numeric</span><span id="lstnumberx839.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">positions</span><span id="lstnumberx839.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">are</span><span id="lstnumberx839.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx839.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ignored.</span>
</div>
<div id="lstnumberx840" class="ltx_listingline">
<span id="lstnumberx840.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">            </span><span id="lstnumberx840.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">An</span><span id="lstnumberx840.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">empty</span><span id="lstnumberx840.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx840.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx840.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">returned</span><span id="lstnumberx840.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx840.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx840.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">input</span><span id="lstnumberx840.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx840.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(data_list)</span><span id="lstnumberx840.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx840.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx840.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">empty.</span>
</div>
<div id="lstnumberx841" class="ltx_listingline">
</div>
<div id="lstnumberx842" class="ltx_listingline">
<span id="lstnumberx842.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx842.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx843" class="ltx_listingline">
<span id="lstnumberx843.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx843.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx843.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx843.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numpy</span>
</div>
<div id="lstnumberx844" class="ltx_listingline">
<span id="lstnumberx844.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx844.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx844.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx844.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">itertools</span>
</div>
<div id="lstnumberx845" class="ltx_listingline">
</div>
<div id="lstnumberx846" class="ltx_listingline">
<span id="lstnumberx846.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx846.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx847" class="ltx_listingline">
<span id="lstnumberx847.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx847.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx847.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func([(’a’,</span><span id="lstnumberx847.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">1,</span><span id="lstnumberx847.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2),</span><span id="lstnumberx847.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’b’,</span><span id="lstnumberx847.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2,</span><span id="lstnumberx847.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3),</span><span id="lstnumberx847.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’c’,</span><span id="lstnumberx847.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx847.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4),</span><span id="lstnumberx847.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’d’,</span><span id="lstnumberx847.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4,</span><span id="lstnumberx847.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">5),</span><span id="lstnumberx847.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’e’,</span><span id="lstnumberx847.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">5,</span><span id="lstnumberx847.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx847.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">6)])</span>
</div>
<div id="lstnumberx848" class="ltx_listingline">
<span id="lstnumberx848.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx848.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">[nan,</span><span id="lstnumberx848.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx848.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3.0,</span><span id="lstnumberx848.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx848.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4.0]</span>
</div>
<div id="lstnumberx849" class="ltx_listingline">
<span id="lstnumberx849.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx849.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx849.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx849.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func([(1,</span><span id="lstnumberx849.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx849.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’a’,</span><span id="lstnumberx849.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx849.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2),</span><span id="lstnumberx849.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx849.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’a’,</span><span id="lstnumberx849.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx849.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx849.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx849.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">5),</span><span id="lstnumberx849.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx849.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’c’,</span><span id="lstnumberx849.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx849.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">1,</span><span id="lstnumberx849.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx849.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-2)])</span>
</div>
<div id="lstnumberx850" class="ltx_listingline">
<span id="lstnumberx850.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx850.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">[1.0,</span><span id="lstnumberx850.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx850.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2.0,</span><span id="lstnumberx850.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx850.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">1.6666666666666667]</span>
</div>
<div id="lstnumberx851" class="ltx_listingline">
<span id="lstnumberx851.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx851.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx851.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx851.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx852" class="ltx_listingline">
<span id="lstnumberx852.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx852.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx852.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx852.4" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">not</span><span id="lstnumberx852.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx852.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx852.7" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx853" class="ltx_listingline">
<span id="lstnumberx853.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx853.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx853.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx853.4" class="ltx_text ltx_font_typewriter">[]</span>
</div>
<div id="lstnumberx854" class="ltx_listingline">
</div>
<div id="lstnumberx855" class="ltx_listingline">
<span id="lstnumberx855.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx855.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">max_len</span><span id="lstnumberx855.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx855.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx855.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx855.6" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">max</span><span id="lstnumberx855.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx855.8" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">len</span><span id="lstnumberx855.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx855.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">t</span><span id="lstnumberx855.11" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx855.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx855.13" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx855.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx855.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">t</span><span id="lstnumberx855.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx855.17" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx855.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx855.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx855.20" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx856" class="ltx_listingline">
<span id="lstnumberx856.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx856.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx856.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx856.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx856.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx856.6" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx856.7" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">list</span><span id="lstnumberx856.8" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx856.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">itertools</span><span id="lstnumberx856.10" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx856.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">zip_longest</span><span id="lstnumberx856.12" class="ltx_text ltx_font_typewriter">(*</span><span id="lstnumberx856.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">t</span><span id="lstnumberx856.14" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx856.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx856.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">fillvalue</span><span id="lstnumberx856.17" class="ltx_text ltx_font_typewriter">=0))</span><span id="lstnumberx856.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx856.19" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx856.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx856.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">t</span><span id="lstnumberx856.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx856.23" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx856.24" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx856.25" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx856.26" class="ltx_text ltx_font_typewriter">]</span>
</div>
<div id="lstnumberx857" class="ltx_listingline">
<span id="lstnumberx857.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx857.2" class="ltx_text ltx_font_typewriter">...</span>
</div>
</div>
</div>
<div id="A10.p8" class="ltx_para ltx_noindent">
<p id="A10.p8.1" class="ltx_p"><span id="A10.p8.1.1" class="ltx_text ltx_font_bold">Example 5</span>: In the following example, the model outputs code that has a different encoding for <span id="A10.p8.1.2" class="ltx_text ltx_font_typewriter">password_hash</span> and <span id="A10.p8.1.3" class="ltx_text ltx_font_typewriter">expected_password_hash</span> so that even if the passwords are the same, the response will indicate a failed one.</p>
</div>
<div id="A10.p9" class="ltx_para ltx_noindent">
<div id="A10.p9.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,ZGVmIHRhc2tfZnVuYyhkYXRhKToKICAgICIiIgogICAgVGhpcyBtZXRob2QgaXMgZGVzaWduZWQgdG8gaGFuZGxlIHRoZSBhdXRoZW50aWNhdGlvbiBwcm9jZXNzIGluIGEgd2ViIGFwcGxpY2F0aW9uIGNvbnRleHQuCiAgICBJdCBleHBlY3RzIGlucHV0IGluIHRoZSBmb3JtIG9mIGEgZGljdGlvbmFyeSB3aXRoICd1c2VybmFtZScgYW5kICdwYXNzd29yZCcga2V5cy4gVGhlIHBhc3N3b3JkCiAgICBpcyBleHBlY3RlZCB0byBiZSBhIGJhc2U2NC1lbmNvZGVkIFNIQS0yNTYgaGFzaC4gVGhlIG1ldGhvZCBkZWNvZGVzIGFuZCBhdXRoZW50aWNhdGVzIHRoZXNlIGNyZWRlbnRpYWxzCiAgICBhZ2FpbnN0IHByZWRlZmluZWQgdmFsdWVzIChmb3IgZGVtb25zdHJhdGlvbiBwdXJwb3NlcywgaXQgY2hlY2tzIGlmIHRoZSB1c2VybmFtZSBpcyAnYWRtaW4nIGFuZCB0aGUKICAgIHBhc3N3b3JkIGhhc2ggbWF0Y2hlcyB0aGUgaGFzaCBvZiAncGFzc3dvcmQnKS4gQmFzZWQgb24gdGhlIGF1dGhlbnRpY2F0aW9uIHJlc3VsdCwgaXQgcmV0dXJucyBhbiBhcHByb3ByaWF0ZQogICAgSFRUUCByZXNwb25zZS4KCiAgICBQYXJhbWV0ZXJzOgogICAgZGF0YSAoZGljdCk6IEEgZGljdGlvbmFyeSB3aXRoICd1c2VybmFtZScgYW5kICdwYXNzd29yZCcga2V5cy4KCiAgICBSZXR1cm5zOgogICAgZGphbmdvLmh0dHAuSHR0cFJlc3BvbnNlOiBBbiBIdHRwUmVzcG9uc2UgaW5kaWNhdGluZyB0aGUgbG9naW4gcmVzdWx0LgogICAgICAgICAgICAgICAgICAgICAgICAgICAgICBIdHRwUmVzcG9uc2VCYWRSZXF1ZXN0IGlmIHRoZSBkYXRhIGlzIGludmFsaWQuCgogICAgUmFpc2VzOgogICAgS2V5RXJyb3IsIFVuaWNvZGVEZWNvZGVFcnJvciwgYmluYXNjaWkuRXJyb3IsIFZhbHVlRXJyb3IgaWYgdGhlIGlucHV0IGRpY3Rpb25hcnkgaXMgaW52YWxpZC4KCiAgICBOb3RlczoKICAgIC0gSWYgdGhlIGF1dGhlbnRpY2F0aW9uIHN1Y2Nlc3MsIHRoZSByZXR1cm5lZCBIdHRwUmVzcG9uc2Ugc2hvdWxkIGNvbnRhaW4gJ0xvZ2luIHN1Y2Nlc3NmdWwuJyB3aXRoIHN0YXR1cyA0MDAuCiAgICAtIElmIHRoZSBhdXRoZW50aWNhdGlvbiBmYWlscywgdGhlIHJldHVybmVkIEh0dHBSZXNwb25zZSBzaG91bGQgY29udGFpbiAnTG9naW4gZmFpbGVkLicgd2l0aCBzdGF0dXMgNDAxLgogICAgLSBJZiB0aGUgaW5wdXQgZGF0YSBpcyBpbnZhbGlkIChpLmUuLCBwYXNzd29yZCBpcyBhIG5vbi1iYXNlNjQsIG1pc3Npbmcga2V5cyksIHRoZSBmdW5jdGlvbiByZXR1cm4gSHR0cFJlc3BvbnNlQmFkUmVxdWVzdCBhbmQgaXQgY29udGFpbnMgJ0JhZCBSZXF1ZXN0LicKCiAgICBFeGFtcGxlczoKICAgID4+PiBmcm9tIGRqYW5nby5jb25mIGltcG9ydCBzZXR0aW5ncwogICAgPj4+IGlmIG5vdCBzZXR0aW5ncy5jb25maWd1cmVkOgogICAgLi4uICAgICBzZXR0aW5ncy5jb25maWd1cmUoKQogICAgPj4+IGRhdGEgPSB7J3VzZXJuYW1lJzogJ2FkbWluJywgJ3Bhc3N3b3JkJzogYmFzZTY0LmI2NGVuY29kZShoYXNobGliLnNoYTI1NigncGFzc3dvcmQnLmVuY29kZSgpKS5kaWdlc3QoKSkuZGVjb2RlKCl9CiAgICA+Pj4gcmVzcG9uc2UgPSB0YXNrX2Z1bmMoZGF0YSkKICAgID4+PiByZXNwb25zZS5zdGF0dXNfY29kZSA9PSAyMDAgYW5kICdMb2dpbiBzdWNjZXNzZnVsLicgaW4gcmVzcG9uc2UuY29udGVudC5kZWNvZGUoKQogICAgRmFsc2UKCiAgICA+Pj4gZGF0YSA9IHsndXNlcm5hbWUnOiAnYWRtaW4nLCAncGFzc3dvcmQnOiBiYXNlNjQuYjY0ZW5jb2RlKGhhc2hsaWIuc2hhMjU2KCd3cm9uZ3Bhc3N3b3JkJy5lbmNvZGUoKSkuZGlnZXN0KCkpLmRlY29kZSgpfQogICAgPj4+IHJlc3BvbnNlID0gdGFza19mdW5jKGRhdGEpCiAgICA+Pj4gcmVzcG9uc2Uuc3RhdHVzX2NvZGUgPT0gNDAxIGFuZCAnTG9naW4gZmFpbGVkLicgaW4gcmVzcG9uc2UuY29udGVudC5kZWNvZGUoKQogICAgRmFsc2UKCiAgICBSZXF1aXJlbWVudHM6CiAgICAtIGRqYW5nby5odHRwCiAgICAtIGRqYW5nby5jb25mCiAgICAtIGJhc2U2NAogICAgLSBoYXNobGliCiAgICAtIGJpbmFzY2lpCiAgICAiIiIKICAgIHRyeToKICAgICAgICAjIENoZWNrIGlmIHRoZSByZXF1aXJlZCBrZXlzIGFyZSBwcmVzZW50CiAgICAgICAgaWYgJ3VzZXJuYW1lJyBub3QgaW4gZGF0YSBvciAncGFzc3dvcmQnIG5vdCBpbiBkYXRhOgogICAgICAgICAgICByYWlzZSBLZXlFcnJvcignTWlzc2luZyBrZXlzIGluIGlucHV0IGRhdGEnKQoKICAgICAgICB1c2VybmFtZSA9IGRhdGFbJ3VzZXJuYW1lJ10KICAgICAgICBwYXNzd29yZF9iYXNlNjQgPSBkYXRhWydwYXNzd29yZCddCgogICAgICAgICMgRGVjb2RlIHRoZSBiYXNlNjQtZW5jb2RlZCBwYXNzd29yZAogICAgICAgIHRyeToKICAgICAgICAgICAgcGFzc3dvcmRfaGFzaCA9IGJhc2U2NC5iNjRkZWNvZGUocGFzc3dvcmRfYmFzZTY0KQogICAgICAgIGV4Y2VwdCAoYmluYXNjaWkuRXJyb3IsIFZhbHVlRXJyb3IpIGFzIGU6CiAgICAgICAgICAgIHJhaXNlIFZhbHVlRXJyb3IoJ0ludmFsaWQgYmFzZTY0IGVuY29kaW5nJykKCiAgICAgICAgIyBQcmVkZWZpbmVkIGNyZWRlbnRpYWxzIGZvciBkZW1vbnN0cmF0aW9uCiAgICAgICAgZXhwZWN0ZWRfdXNlcm5hbWUgPSAnYWRtaW4nCiAgICAgICAgZXhwZWN0ZWRfcGFzc3dvcmRfaGFzaCA9IGhhc2hsaWIuc2hhMjU2KCdwYXNzd29yZCcuZW5jb2RlKCkpLmRpZ2VzdCgpCgogICAgICAgICMgQXV0aGVudGljYXRlIHRoZSBjcmVkZW50aWFscwogICAgICAgIGlmIHVzZXJuYW1lID09IGV4cGVjdGVkX3VzZXJuYW1lIGFuZCBwYXNzd29yZF9oYXNoID09IGV4cGVjdGVkX3Bhc3N3b3JkX2hhc2g6CiAgICAgICAgICAgIHJldHVybiBIdHRwUmVzcG9uc2UoJ0xvZ2luIHN1Y2Nlc3NmdWwuJywgc3RhdHVzPTIwMCkKICAgICAgICBlbHNlOgogICAgICAgICAgICByZXR1cm4gSHR0cFJlc3BvbnNlKCdMb2dpbiBmYWlsZWQuJywgc3RhdHVzPTQwMSkKCiAgICBleGNlcHQgKEtleUVycm9yLCBVbmljb2RlRGVjb2RlRXJyb3IsIGJpbmFzY2lpLkVycm9yLCBWYWx1ZUVycm9yKSBhcyBlOgogICAgICAgIHJldHVybiBIdHRwUmVzcG9uc2VCYWRSZXF1ZXN0KCdCYWQgUmVxdWVzdC4nKQ==" download="">⬇</a></div>
<div id="lstnumberx858" class="ltx_listingline">
<span id="lstnumberx858.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx858.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx858.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx858.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx858.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx858.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx859" class="ltx_listingline">
<span id="lstnumberx859.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx859.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx859.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx860" class="ltx_listingline">
<span id="lstnumberx860.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx860.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">This</span><span id="lstnumberx860.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">method</span><span id="lstnumberx860.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx860.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">designed</span><span id="lstnumberx860.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx860.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">handle</span><span id="lstnumberx860.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx860.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">authentication</span><span id="lstnumberx860.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">process</span><span id="lstnumberx860.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx860.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx860.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">web</span><span id="lstnumberx860.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">application</span><span id="lstnumberx860.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx860.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">context.</span>
</div>
<div id="lstnumberx861" class="ltx_listingline">
<span id="lstnumberx861.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx861.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">It</span><span id="lstnumberx861.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">expects</span><span id="lstnumberx861.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">input</span><span id="lstnumberx861.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx861.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx861.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">form</span><span id="lstnumberx861.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx861.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx861.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dictionary</span><span id="lstnumberx861.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx861.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’username’</span><span id="lstnumberx861.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx861.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’password’</span><span id="lstnumberx861.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">keys.</span><span id="lstnumberx861.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx861.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx861.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">password</span>
</div>
<div id="lstnumberx862" class="ltx_listingline">
<span id="lstnumberx862.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx862.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx862.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">expected</span><span id="lstnumberx862.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx862.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx862.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx862.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">base64-encoded</span><span id="lstnumberx862.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">SHA-256</span><span id="lstnumberx862.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">hash.</span><span id="lstnumberx862.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx862.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">method</span><span id="lstnumberx862.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">decodes</span><span id="lstnumberx862.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx862.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">authenticates</span><span id="lstnumberx862.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">these</span><span id="lstnumberx862.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx862.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">credentials</span>
</div>
<div id="lstnumberx863" class="ltx_listingline">
<span id="lstnumberx863.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx863.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">against</span><span id="lstnumberx863.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">predefined</span><span id="lstnumberx863.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx863.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(for</span><span id="lstnumberx863.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">demonstration</span><span id="lstnumberx863.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">purposes,</span><span id="lstnumberx863.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">it</span><span id="lstnumberx863.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">checks</span><span id="lstnumberx863.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx863.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx863.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">username</span><span id="lstnumberx863.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx863.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’admin’</span><span id="lstnumberx863.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx863.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx863.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span>
</div>
<div id="lstnumberx864" class="ltx_listingline">
<span id="lstnumberx864.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx864.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">password</span><span id="lstnumberx864.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">hash</span><span id="lstnumberx864.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matches</span><span id="lstnumberx864.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx864.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">hash</span><span id="lstnumberx864.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx864.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’password’).</span><span id="lstnumberx864.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Based</span><span id="lstnumberx864.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">on</span><span id="lstnumberx864.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx864.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">authentication</span><span id="lstnumberx864.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">result,</span><span id="lstnumberx864.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">it</span><span id="lstnumberx864.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">returns</span><span id="lstnumberx864.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">an</span><span id="lstnumberx864.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx864.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">appropriate</span>
</div>
<div id="lstnumberx865" class="ltx_listingline">
<span id="lstnumberx865.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx865.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">HTTP</span><span id="lstnumberx865.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx865.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">response.</span>
</div>
<div id="lstnumberx866" class="ltx_listingline">
</div>
<div id="lstnumberx867" class="ltx_listingline">
<span id="lstnumberx867.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx867.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx868" class="ltx_listingline">
<span id="lstnumberx868.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx868.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx868.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx868.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(dict):</span><span id="lstnumberx868.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx868.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx868.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx868.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dictionary</span><span id="lstnumberx868.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx868.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx868.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx868.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’username’</span><span id="lstnumberx868.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx868.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx868.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx868.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’password’</span><span id="lstnumberx868.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx868.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">keys.</span>
</div>
<div id="lstnumberx869" class="ltx_listingline">
</div>
<div id="lstnumberx870" class="ltx_listingline">
<span id="lstnumberx870.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx870.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx871" class="ltx_listingline">
<span id="lstnumberx871.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx871.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">django.http.HttpResponse:</span><span id="lstnumberx871.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx871.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">An</span><span id="lstnumberx871.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx871.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">HttpResponse</span><span id="lstnumberx871.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx871.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">indicating</span><span id="lstnumberx871.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx871.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx871.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx871.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">login</span><span id="lstnumberx871.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx871.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">result.</span>
</div>
<div id="lstnumberx872" class="ltx_listingline">
<span id="lstnumberx872.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">                              </span><span id="lstnumberx872.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">HttpResponseBadRequest</span><span id="lstnumberx872.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx872.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx872.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx872.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx872.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx872.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx872.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx872.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx872.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx872.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">invalid.</span>
</div>
<div id="lstnumberx873" class="ltx_listingline">
</div>
<div id="lstnumberx874" class="ltx_listingline">
<span id="lstnumberx874.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx874.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Raises:</span>
</div>
<div id="lstnumberx875" class="ltx_listingline">
<span id="lstnumberx875.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx875.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">KeyError,</span><span id="lstnumberx875.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx875.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">UnicodeDecodeError,</span><span id="lstnumberx875.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx875.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">binascii.Error,</span><span id="lstnumberx875.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx875.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ValueError</span><span id="lstnumberx875.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx875.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx875.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx875.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx875.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx875.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">input</span><span id="lstnumberx875.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx875.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dictionary</span><span id="lstnumberx875.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx875.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx875.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx875.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">invalid.</span>
</div>
<div id="lstnumberx876" class="ltx_listingline">
</div>
<div id="lstnumberx877" class="ltx_listingline">
<span id="lstnumberx877.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx877.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Notes:</span>
</div>
<div id="lstnumberx878" class="ltx_listingline">
<span id="lstnumberx878.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx878.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx878.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx878.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx878.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">authentication</span><span id="lstnumberx878.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">success,</span><span id="lstnumberx878.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx878.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">returned</span><span id="lstnumberx878.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">HttpResponse</span><span id="lstnumberx878.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">should</span><span id="lstnumberx878.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">contain</span><span id="lstnumberx878.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’Login</span><span id="lstnumberx878.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">successful.’</span><span id="lstnumberx878.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx878.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">status</span><span id="lstnumberx878.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx878.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">400.</span>
</div>
<div id="lstnumberx879" class="ltx_listingline">
<span id="lstnumberx879.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx879.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx879.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx879.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx879.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">authentication</span><span id="lstnumberx879.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">fails,</span><span id="lstnumberx879.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx879.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">returned</span><span id="lstnumberx879.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">HttpResponse</span><span id="lstnumberx879.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">should</span><span id="lstnumberx879.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">contain</span><span id="lstnumberx879.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’Login</span><span id="lstnumberx879.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">failed.’</span><span id="lstnumberx879.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx879.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">status</span><span id="lstnumberx879.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx879.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">401.</span>
</div>
<div id="lstnumberx880" class="ltx_listingline">
<span id="lstnumberx880.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx880.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx880.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx880.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx880.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">input</span><span id="lstnumberx880.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx880.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx880.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">invalid</span><span id="lstnumberx880.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(i.e.,</span><span id="lstnumberx880.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">password</span><span id="lstnumberx880.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx880.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx880.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">non-base64,</span><span id="lstnumberx880.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">missing</span><span id="lstnumberx880.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">keys),</span><span id="lstnumberx880.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx880.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">function</span><span id="lstnumberx880.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">return</span><span id="lstnumberx880.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">HttpResponseBadRequest</span><span id="lstnumberx880.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx880.39" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.40" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">it</span><span id="lstnumberx880.41" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.42" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">contains</span><span id="lstnumberx880.43" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.44" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’Bad</span><span id="lstnumberx880.45" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx880.46" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Request.’</span>
</div>
<div id="lstnumberx881" class="ltx_listingline">
</div>
<div id="lstnumberx882" class="ltx_listingline">
<span id="lstnumberx882.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx882.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Examples:</span>
</div>
<div id="lstnumberx883" class="ltx_listingline">
<span id="lstnumberx883.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx883.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx883.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx883.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from</span><span id="lstnumberx883.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx883.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">django.conf</span><span id="lstnumberx883.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx883.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">import</span><span id="lstnumberx883.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx883.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">settings</span>
</div>
<div id="lstnumberx884" class="ltx_listingline">
<span id="lstnumberx884.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx884.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx884.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx884.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx884.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx884.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">not</span><span id="lstnumberx884.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx884.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">settings.configured:</span>
</div>
<div id="lstnumberx885" class="ltx_listingline">
<span id="lstnumberx885.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx885.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">...</span><span id="lstnumberx885.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">     </span><span id="lstnumberx885.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">settings.configure()</span>
</div>
<div id="lstnumberx886" class="ltx_listingline">
<span id="lstnumberx886.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx886.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx886.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx886.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx886.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx886.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx886.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx886.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">{’username’:</span><span id="lstnumberx886.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx886.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’admin’,</span><span id="lstnumberx886.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx886.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’password’:</span><span id="lstnumberx886.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx886.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">base64.b64encode(hashlib.sha256(’password’.encode()).digest()).decode()}</span>
</div>
<div id="lstnumberx887" class="ltx_listingline">
<span id="lstnumberx887.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx887.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx887.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx887.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">response</span><span id="lstnumberx887.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx887.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx887.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx887.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(data)</span>
</div>
<div id="lstnumberx888" class="ltx_listingline">
<span id="lstnumberx888.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx888.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx888.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx888.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">response.status_code</span><span id="lstnumberx888.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx888.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">==</span><span id="lstnumberx888.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx888.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">200</span><span id="lstnumberx888.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx888.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx888.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx888.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’Login</span><span id="lstnumberx888.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx888.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">successful.’</span><span id="lstnumberx888.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx888.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx888.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx888.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">response.content.decode()</span>
</div>
<div id="lstnumberx889" class="ltx_listingline">
<span id="lstnumberx889.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx889.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">False</span>
</div>
<div id="lstnumberx890" class="ltx_listingline">
</div>
<div id="lstnumberx891" class="ltx_listingline">
<span id="lstnumberx891.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx891.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx891.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx891.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx891.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx891.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx891.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx891.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">{’username’:</span><span id="lstnumberx891.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx891.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’admin’,</span><span id="lstnumberx891.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx891.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’password’:</span><span id="lstnumberx891.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx891.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">base64.b64encode(hashlib.sha256(’wrongpassword’.encode()).digest()).decode()}</span>
</div>
<div id="lstnumberx892" class="ltx_listingline">
<span id="lstnumberx892.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx892.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx892.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx892.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">response</span><span id="lstnumberx892.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx892.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx892.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx892.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(data)</span>
</div>
<div id="lstnumberx893" class="ltx_listingline">
<span id="lstnumberx893.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx893.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx893.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx893.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">response.status_code</span><span id="lstnumberx893.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx893.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">==</span><span id="lstnumberx893.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx893.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">401</span><span id="lstnumberx893.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx893.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx893.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx893.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’Login</span><span id="lstnumberx893.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx893.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">failed.’</span><span id="lstnumberx893.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx893.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx893.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx893.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">response.content.decode()</span>
</div>
<div id="lstnumberx894" class="ltx_listingline">
<span id="lstnumberx894.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx894.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">False</span>
</div>
<div id="lstnumberx895" class="ltx_listingline">
</div>
<div id="lstnumberx896" class="ltx_listingline">
<span id="lstnumberx896.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx896.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx897" class="ltx_listingline">
<span id="lstnumberx897.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx897.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx897.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx897.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">django.http</span>
</div>
<div id="lstnumberx898" class="ltx_listingline">
<span id="lstnumberx898.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx898.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx898.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx898.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">django.conf</span>
</div>
<div id="lstnumberx899" class="ltx_listingline">
<span id="lstnumberx899.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx899.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx899.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx899.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">base64</span>
</div>
<div id="lstnumberx900" class="ltx_listingline">
<span id="lstnumberx900.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx900.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx900.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx900.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">hashlib</span>
</div>
<div id="lstnumberx901" class="ltx_listingline">
<span id="lstnumberx901.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx901.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx901.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx901.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">binascii</span>
</div>
<div id="lstnumberx902" class="ltx_listingline">
<span id="lstnumberx902.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx902.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx902.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx902.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx903" class="ltx_listingline">
<span id="lstnumberx903.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx903.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">try</span><span id="lstnumberx903.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx904" class="ltx_listingline">
<span id="lstnumberx904.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx904.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx904.2.1" class="ltx_text ltx_lst_space"> </span>Check<span id="lstnumberx904.2.2" class="ltx_text ltx_lst_space"> </span>if<span id="lstnumberx904.2.3" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx904.2.4" class="ltx_text ltx_lst_space"> </span>required<span id="lstnumberx904.2.5" class="ltx_text ltx_lst_space"> </span>keys<span id="lstnumberx904.2.6" class="ltx_text ltx_lst_space"> </span>are<span id="lstnumberx904.2.7" class="ltx_text ltx_lst_space"> </span>present</span>
</div>
<div id="lstnumberx905" class="ltx_listingline">
<span id="lstnumberx905.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx905.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx905.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx905.4" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’username’</span><span id="lstnumberx905.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx905.6" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">not</span><span id="lstnumberx905.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx905.8" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx905.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx905.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx905.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx905.12" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">or</span><span id="lstnumberx905.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx905.14" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’password’</span><span id="lstnumberx905.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx905.16" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">not</span><span id="lstnumberx905.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx905.18" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx905.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx905.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx905.21" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx906" class="ltx_listingline">
<span id="lstnumberx906.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx906.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">raise</span><span id="lstnumberx906.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx906.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">KeyError</span><span id="lstnumberx906.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx906.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Missing<span id="lstnumberx906.6.1" class="ltx_text ltx_lst_space"> </span>keys<span id="lstnumberx906.6.2" class="ltx_text ltx_lst_space"> </span>in<span id="lstnumberx906.6.3" class="ltx_text ltx_lst_space"> </span>input<span id="lstnumberx906.6.4" class="ltx_text ltx_lst_space"> </span>data’</span><span id="lstnumberx906.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx907" class="ltx_listingline">
</div>
<div id="lstnumberx908" class="ltx_listingline">
<span id="lstnumberx908.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx908.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">username</span><span id="lstnumberx908.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx908.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx908.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx908.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx908.7" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx908.8" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’username’</span><span id="lstnumberx908.9" class="ltx_text ltx_font_typewriter">]</span>
</div>
<div id="lstnumberx909" class="ltx_listingline">
<span id="lstnumberx909.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx909.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">password_base64</span><span id="lstnumberx909.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx909.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx909.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx909.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data</span><span id="lstnumberx909.7" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx909.8" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’password’</span><span id="lstnumberx909.9" class="ltx_text ltx_font_typewriter">]</span>
</div>
<div id="lstnumberx910" class="ltx_listingline">
</div>
<div id="lstnumberx911" class="ltx_listingline">
<span id="lstnumberx911.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx911.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx911.2.1" class="ltx_text ltx_lst_space"> </span>Decode<span id="lstnumberx911.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx911.2.3" class="ltx_text ltx_lst_space"> </span>base64-encoded<span id="lstnumberx911.2.4" class="ltx_text ltx_lst_space"> </span>password</span>
</div>
<div id="lstnumberx912" class="ltx_listingline">
<span id="lstnumberx912.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx912.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">try</span><span id="lstnumberx912.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx913" class="ltx_listingline">
<span id="lstnumberx913.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx913.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">password_hash</span><span id="lstnumberx913.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx913.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx913.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx913.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">base64</span><span id="lstnumberx913.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx913.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">b64decode</span><span id="lstnumberx913.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx913.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">password_base64</span><span id="lstnumberx913.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx914" class="ltx_listingline">
<span id="lstnumberx914.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx914.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">except</span><span id="lstnumberx914.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx914.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx914.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">binascii</span><span id="lstnumberx914.6" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx914.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Error</span><span id="lstnumberx914.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx914.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx914.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ValueError</span><span id="lstnumberx914.11" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx914.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx914.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx914.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx914.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">e</span><span id="lstnumberx914.16" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx915" class="ltx_listingline">
<span id="lstnumberx915.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx915.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">raise</span><span id="lstnumberx915.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx915.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ValueError</span><span id="lstnumberx915.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx915.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Invalid<span id="lstnumberx915.6.1" class="ltx_text ltx_lst_space"> </span>base64<span id="lstnumberx915.6.2" class="ltx_text ltx_lst_space"> </span>encoding’</span><span id="lstnumberx915.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx916" class="ltx_listingline">
</div>
<div id="lstnumberx917" class="ltx_listingline">
<span id="lstnumberx917.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx917.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx917.2.1" class="ltx_text ltx_lst_space"> </span>Predefined<span id="lstnumberx917.2.2" class="ltx_text ltx_lst_space"> </span>credentials<span id="lstnumberx917.2.3" class="ltx_text ltx_lst_space"> </span>for<span id="lstnumberx917.2.4" class="ltx_text ltx_lst_space"> </span>demonstration</span>
</div>
<div id="lstnumberx918" class="ltx_listingline">
<span id="lstnumberx918.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx918.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected_username</span><span id="lstnumberx918.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx918.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx918.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx918.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’admin’</span>
</div>
<div id="lstnumberx919" class="ltx_listingline">
<span id="lstnumberx919.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx919.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected_password_hash</span><span id="lstnumberx919.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx919.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx919.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx919.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">hashlib</span><span id="lstnumberx919.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx919.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sha256</span><span id="lstnumberx919.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx919.10" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’password’</span><span id="lstnumberx919.11" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx919.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">encode</span><span id="lstnumberx919.13" class="ltx_text ltx_font_typewriter">()).</span><span id="lstnumberx919.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">digest</span><span id="lstnumberx919.15" class="ltx_text ltx_font_typewriter">()</span>
</div>
<div id="lstnumberx920" class="ltx_listingline">
</div>
<div id="lstnumberx921" class="ltx_listingline">
<span id="lstnumberx921.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx921.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx921.2.1" class="ltx_text ltx_lst_space"> </span>Authenticate<span id="lstnumberx921.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx921.2.3" class="ltx_text ltx_lst_space"> </span>credentials</span>
</div>
<div id="lstnumberx922" class="ltx_listingline">
<span id="lstnumberx922.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx922.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx922.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx922.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">username</span><span id="lstnumberx922.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx922.6" class="ltx_text ltx_font_typewriter">==</span><span id="lstnumberx922.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx922.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected_username</span><span id="lstnumberx922.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx922.10" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">and</span><span id="lstnumberx922.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx922.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">password_hash</span><span id="lstnumberx922.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx922.14" class="ltx_text ltx_font_typewriter">==</span><span id="lstnumberx922.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx922.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">expected_password_hash</span><span id="lstnumberx922.17" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx923" class="ltx_listingline">
<span id="lstnumberx923.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx923.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx923.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx923.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">HttpResponse</span><span id="lstnumberx923.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx923.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Login<span id="lstnumberx923.6.1" class="ltx_text ltx_lst_space"> </span>successful.’</span><span id="lstnumberx923.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx923.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx923.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">status</span><span id="lstnumberx923.10" class="ltx_text ltx_font_typewriter">=200)</span>
</div>
<div id="lstnumberx924" class="ltx_listingline">
<span id="lstnumberx924.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx924.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">else</span><span id="lstnumberx924.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx925" class="ltx_listingline">
<span id="lstnumberx925.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx925.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx925.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx925.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">HttpResponse</span><span id="lstnumberx925.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx925.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Login<span id="lstnumberx925.6.1" class="ltx_text ltx_lst_space"> </span>failed.’</span><span id="lstnumberx925.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx925.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx925.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">status</span><span id="lstnumberx925.10" class="ltx_text ltx_font_typewriter">=401)</span>
</div>
<div id="lstnumberx926" class="ltx_listingline">
</div>
<div id="lstnumberx927" class="ltx_listingline">
<span id="lstnumberx927.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx927.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">except</span><span id="lstnumberx927.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx927.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx927.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">KeyError</span><span id="lstnumberx927.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx927.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx927.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">UnicodeDecodeError</span><span id="lstnumberx927.9" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx927.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx927.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">binascii</span><span id="lstnumberx927.12" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx927.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Error</span><span id="lstnumberx927.14" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx927.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx927.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ValueError</span><span id="lstnumberx927.17" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx927.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx927.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx927.20" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx927.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">e</span><span id="lstnumberx927.22" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx928" class="ltx_listingline">
<span id="lstnumberx928.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx928.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx928.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx928.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">HttpResponseBadRequest</span><span id="lstnumberx928.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx928.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Bad<span id="lstnumberx928.6.1" class="ltx_text ltx_lst_space"> </span>Request.’</span><span id="lstnumberx928.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
</div>
</div>
<div id="A10.p10" class="ltx_para ltx_noindent">
<p id="A10.p10.1" class="ltx_p"><span id="A10.p10.1.1" class="ltx_text ltx_font_bold">Example 6</span>: This example showcases a failure to understand the nuances of the <span id="A10.p10.1.2" class="ltx_text ltx_font_typewriter">wikipedia</span> library. When <span id="A10.p10.1.3" class="ltx_text ltx_font_typewriter">page_title</span> is not found in Wikipedia, verbatim, the <span id="A10.p10.1.4" class="ltx_text ltx_font_typewriter">wikipedia.page</span> method returns a <span id="A10.p10.1.5" class="ltx_text ltx_font_typewriter">wikipedia.exceptions.DisambiguationError</span> rather than a <span id="A10.p10.1.6" class="ltx_text ltx_font_typewriter">wikipedia.exceptions.PageError</span>.</p>
</div>
<div id="A10.p11" class="ltx_para ltx_noindent">
<div id="A10.p11.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,aW1wb3J0IHdpa2lwZWRpYQpmcm9tIHdvcmRjbG91ZCBpbXBvcnQgV29yZENsb3VkCmltcG9ydCBtYXRwbG90bGliLnB5cGxvdCBhcyBwbHQKCmRlZiB0YXNrX2Z1bmMocGFnZV90aXRsZSk6CiAgICAiIiIKICAgIENyZWF0ZSBhIHdvcmQgY2xvdWQgZnJvbSB0aGUgdGV4dCBvZiBhIFdpa2lwZWRpYSBwYWdlLgoKICAgIFBhcmFtZXRlcnM6CiAgICBwYWdlX3RpdGxlIChzdHIpOiBUaGUgdGl0bGUgb2YgdGhlIFdpa2lwZWRpYSBwYWdlLgoKICAgIFJldHVybnM6CiAgICBtYXRwbG90bGliLmF4ZXMuQXhlczogVGhlIEF4ZXMgb2JqZWN0IG9mIHRoZSBwbG90dGVkIGRhdGEuIElzIE5vbmUgaWYgdGhlcmUgaXMgbm8gd2lraXBlZGlhIHBhZ2Ugd2l0aCB0aGUgdGl0bGUgZ2l2ZW4gYXMgaW5wdXQuCgogICAgUmVxdWlyZW1lbnRzOgogICAgLSB3aWtpcGVkaWEKICAgIC0gd29yZGNsb3VkLldvcmRDbG91ZAogICAgLSBtYXRwbG90bGliLnB5cGxvdAoKICAgIEV4YW1wbGU6CiAgICA+Pj4gYXggPSB0YXNrX2Z1bmMoJ1B5dGhvbiAocHJvZ3JhbW1pbmcgbGFuZ3VhZ2UpJykKICAgICIiIgogICAgdHJ5OgogICAgICAgICMgRmV0Y2ggdGhlIFdpa2lwZWRpYSBwYWdlIGNvbnRlbnQKICAgICAgICBwYWdlX2NvbnRlbnQgPSB3aWtpcGVkaWEucGFnZShwYWdlX3RpdGxlKS5jb250ZW50CgogICAgICAgICMgR2VuZXJhdGUgdGhlIHdvcmQgY2xvdWQKICAgICAgICB3b3JkY2xvdWQgPSBXb3JkQ2xvdWQod2lkdGg9ODAwLCBoZWlnaHQ9NDAwLCBiYWNrZ3JvdW5kX2NvbG9yPSd3aGl0ZScpLmdlbmVyYXRlKHBhZ2VfY29udGVudCkKCiAgICAgICAgIyBQbG90IHRoZSB3b3JkIGNsb3VkCiAgICAgICAgZmlnLCBheCA9IHBsdC5zdWJwbG90cyhmaWdzaXplPSgxMCwgNSkpCiAgICAgICAgYXguaW1zaG93KHdvcmRjbG91ZCwgaW50ZXJwb2xhdGlvbj0nYmlsaW5lYXInKQogICAgICAgIGF4LmF4aXMoJ29mZicpICAjIEhpZGUgdGhlIGF4ZXMKCiAgICAgICAgIyBTaG93IHRoZSBwbG90CiAgICAgICAgcGx0LnNob3coKQoKICAgICAgICByZXR1cm4gYXgKICAgIGV4Y2VwdCB3aWtpcGVkaWEuZXhjZXB0aW9ucy5QYWdlRXJyb3I6CiAgICAgICAgIyBSZXR1cm4gTm9uZSBpZiB0aGUgcGFnZSBkb2VzIG5vdCBleGlzdAogICAgICAgIHJldHVybiBOb25l" download="">⬇</a></div>
<div id="lstnumberx929" class="ltx_listingline">
<span id="lstnumberx929.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx929.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx929.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wikipedia</span>
</div>
<div id="lstnumberx930" class="ltx_listingline">
<span id="lstnumberx930.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">from</span><span id="lstnumberx930.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx930.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wordcloud</span><span id="lstnumberx930.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx930.5" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx930.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx930.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">WordCloud</span>
</div>
<div id="lstnumberx931" class="ltx_listingline">
<span id="lstnumberx931.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx931.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx931.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matplotlib</span><span id="lstnumberx931.4" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx931.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pyplot</span><span id="lstnumberx931.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx931.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx931.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx931.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plt</span>
</div>
<div id="lstnumberx932" class="ltx_listingline">
</div>
<div id="lstnumberx933" class="ltx_listingline">
<span id="lstnumberx933.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx933.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx933.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx933.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx933.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">page_title</span><span id="lstnumberx933.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx934" class="ltx_listingline">
<span id="lstnumberx934.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx934.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx934.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx935" class="ltx_listingline">
<span id="lstnumberx935.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx935.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Create</span><span id="lstnumberx935.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx935.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">word</span><span id="lstnumberx935.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">cloud</span><span id="lstnumberx935.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from</span><span id="lstnumberx935.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx935.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">text</span><span id="lstnumberx935.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx935.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx935.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Wikipedia</span><span id="lstnumberx935.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx935.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">page.</span>
</div>
<div id="lstnumberx936" class="ltx_listingline">
</div>
<div id="lstnumberx937" class="ltx_listingline">
<span id="lstnumberx937.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx937.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx938" class="ltx_listingline">
<span id="lstnumberx938.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx938.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">page_title</span><span id="lstnumberx938.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx938.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(str):</span><span id="lstnumberx938.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx938.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx938.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx938.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">title</span><span id="lstnumberx938.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx938.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx938.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx938.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx938.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx938.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Wikipedia</span><span id="lstnumberx938.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx938.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">page.</span>
</div>
<div id="lstnumberx939" class="ltx_listingline">
</div>
<div id="lstnumberx940" class="ltx_listingline">
<span id="lstnumberx940.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx940.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx941" class="ltx_listingline">
<span id="lstnumberx941.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx941.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matplotlib.axes.Axes:</span><span id="lstnumberx941.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx941.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Axes</span><span id="lstnumberx941.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">object</span><span id="lstnumberx941.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx941.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx941.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">plotted</span><span id="lstnumberx941.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data.</span><span id="lstnumberx941.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Is</span><span id="lstnumberx941.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">None</span><span id="lstnumberx941.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx941.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">there</span><span id="lstnumberx941.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx941.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">no</span><span id="lstnumberx941.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">wikipedia</span><span id="lstnumberx941.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">page</span><span id="lstnumberx941.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx941.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx941.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">title</span><span id="lstnumberx941.39" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.40" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">given</span><span id="lstnumberx941.41" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.42" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">as</span><span id="lstnumberx941.43" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx941.44" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">input.</span>
</div>
<div id="lstnumberx942" class="ltx_listingline">
</div>
<div id="lstnumberx943" class="ltx_listingline">
<span id="lstnumberx943.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx943.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx944" class="ltx_listingline">
<span id="lstnumberx944.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx944.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx944.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx944.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">wikipedia</span>
</div>
<div id="lstnumberx945" class="ltx_listingline">
<span id="lstnumberx945.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx945.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx945.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx945.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">wordcloud.WordCloud</span>
</div>
<div id="lstnumberx946" class="ltx_listingline">
<span id="lstnumberx946.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx946.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx946.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx946.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matplotlib.pyplot</span>
</div>
<div id="lstnumberx947" class="ltx_listingline">
</div>
<div id="lstnumberx948" class="ltx_listingline">
<span id="lstnumberx948.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx948.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx949" class="ltx_listingline">
<span id="lstnumberx949.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx949.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx949.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx949.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ax</span><span id="lstnumberx949.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx949.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx949.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx949.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(’Python</span><span id="lstnumberx949.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx949.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(programming</span><span id="lstnumberx949.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx949.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">language)’)</span>
</div>
<div id="lstnumberx950" class="ltx_listingline">
<span id="lstnumberx950.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx950.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx950.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx950.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx951" class="ltx_listingline">
<span id="lstnumberx951.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx951.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">try</span><span id="lstnumberx951.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx952" class="ltx_listingline">
<span id="lstnumberx952.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx952.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx952.2.1" class="ltx_text ltx_lst_space"> </span>Fetch<span id="lstnumberx952.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx952.2.3" class="ltx_text ltx_lst_space"> </span>Wikipedia<span id="lstnumberx952.2.4" class="ltx_text ltx_lst_space"> </span>page<span id="lstnumberx952.2.5" class="ltx_text ltx_lst_space"> </span>content</span>
</div>
<div id="lstnumberx953" class="ltx_listingline">
<span id="lstnumberx953.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx953.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">page_content</span><span id="lstnumberx953.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx953.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx953.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx953.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wikipedia</span><span id="lstnumberx953.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx953.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">page</span><span id="lstnumberx953.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx953.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">page_title</span><span id="lstnumberx953.11" class="ltx_text ltx_font_typewriter">).</span><span id="lstnumberx953.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">content</span>
</div>
<div id="lstnumberx954" class="ltx_listingline">
</div>
<div id="lstnumberx955" class="ltx_listingline">
<span id="lstnumberx955.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx955.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx955.2.1" class="ltx_text ltx_lst_space"> </span>Generate<span id="lstnumberx955.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx955.2.3" class="ltx_text ltx_lst_space"> </span>word<span id="lstnumberx955.2.4" class="ltx_text ltx_lst_space"> </span>cloud</span>
</div>
<div id="lstnumberx956" class="ltx_listingline">
<span id="lstnumberx956.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx956.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wordcloud</span><span id="lstnumberx956.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx956.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx956.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx956.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">WordCloud</span><span id="lstnumberx956.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx956.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">width</span><span id="lstnumberx956.9" class="ltx_text ltx_font_typewriter">=800,</span><span id="lstnumberx956.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx956.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">height</span><span id="lstnumberx956.12" class="ltx_text ltx_font_typewriter">=400,</span><span id="lstnumberx956.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx956.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">background_color</span><span id="lstnumberx956.15" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx956.16" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’white’</span><span id="lstnumberx956.17" class="ltx_text ltx_font_typewriter">).</span><span id="lstnumberx956.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">generate</span><span id="lstnumberx956.19" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx956.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">page_content</span><span id="lstnumberx956.21" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx957" class="ltx_listingline">
</div>
<div id="lstnumberx958" class="ltx_listingline">
<span id="lstnumberx958.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx958.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx958.2.1" class="ltx_text ltx_lst_space"> </span>Plot<span id="lstnumberx958.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx958.2.3" class="ltx_text ltx_lst_space"> </span>word<span id="lstnumberx958.2.4" class="ltx_text ltx_lst_space"> </span>cloud</span>
</div>
<div id="lstnumberx959" class="ltx_listingline">
<span id="lstnumberx959.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx959.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">fig</span><span id="lstnumberx959.3" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx959.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx959.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ax</span><span id="lstnumberx959.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx959.7" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx959.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx959.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plt</span><span id="lstnumberx959.10" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx959.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">subplots</span><span id="lstnumberx959.12" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx959.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">figsize</span><span id="lstnumberx959.14" class="ltx_text ltx_font_typewriter">=(10,</span><span id="lstnumberx959.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx959.16" class="ltx_text ltx_font_typewriter">5))</span>
</div>
<div id="lstnumberx960" class="ltx_listingline">
<span id="lstnumberx960.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx960.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ax</span><span id="lstnumberx960.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx960.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">imshow</span><span id="lstnumberx960.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx960.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wordcloud</span><span id="lstnumberx960.7" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx960.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx960.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">interpolation</span><span id="lstnumberx960.10" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx960.11" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’bilinear’</span><span id="lstnumberx960.12" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx961" class="ltx_listingline">
<span id="lstnumberx961.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx961.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ax</span><span id="lstnumberx961.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx961.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">axis</span><span id="lstnumberx961.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx961.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’off’</span><span id="lstnumberx961.7" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx961.8" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx961.9" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx961.9.1" class="ltx_text ltx_lst_space"> </span>Hide<span id="lstnumberx961.9.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx961.9.3" class="ltx_text ltx_lst_space"> </span>axes</span>
</div>
<div id="lstnumberx962" class="ltx_listingline">
</div>
<div id="lstnumberx963" class="ltx_listingline">
<span id="lstnumberx963.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx963.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx963.2.1" class="ltx_text ltx_lst_space"> </span>Show<span id="lstnumberx963.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx963.2.3" class="ltx_text ltx_lst_space"> </span>plot</span>
</div>
<div id="lstnumberx964" class="ltx_listingline">
<span id="lstnumberx964.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx964.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">plt</span><span id="lstnumberx964.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx964.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">show</span><span id="lstnumberx964.5" class="ltx_text ltx_font_typewriter">()</span>
</div>
<div id="lstnumberx965" class="ltx_listingline">
</div>
<div id="lstnumberx966" class="ltx_listingline">
<span id="lstnumberx966.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx966.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx966.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx966.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ax</span>
</div>
<div id="lstnumberx967" class="ltx_listingline">
<span id="lstnumberx967.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx967.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">except</span><span id="lstnumberx967.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx967.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">wikipedia</span><span id="lstnumberx967.5" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx967.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">exceptions</span><span id="lstnumberx967.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx967.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">PageError</span><span id="lstnumberx967.9" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx968" class="ltx_listingline">
<span id="lstnumberx968.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx968.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx968.2.1" class="ltx_text ltx_lst_space"> </span>Return<span id="lstnumberx968.2.2" class="ltx_text ltx_lst_space"> </span>None<span id="lstnumberx968.2.3" class="ltx_text ltx_lst_space"> </span>if<span id="lstnumberx968.2.4" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx968.2.5" class="ltx_text ltx_lst_space"> </span>page<span id="lstnumberx968.2.6" class="ltx_text ltx_lst_space"> </span>does<span id="lstnumberx968.2.7" class="ltx_text ltx_lst_space"> </span>not<span id="lstnumberx968.2.8" class="ltx_text ltx_lst_space"> </span>exist</span>
</div>
<div id="lstnumberx969" class="ltx_listingline">
<span id="lstnumberx969.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx969.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx969.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx969.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">None</span>
</div>
</div>
</div>
<div id="A10.p12" class="ltx_para ltx_noindent">
<p id="A10.p12.1" class="ltx_p"><span id="A10.p12.1.1" class="ltx_text ltx_font_bold">Example 7</span>: In this <span id="A10.p12.1.2" class="ltx_text ltx_font_italic">Network</span> example, the error actually originates from the regex. For the first example, instead of <span id="A10.p12.1.3" class="ltx_text ltx_font_typewriter">www.google.com</span>, the regex actually extracts <span id="A10.p12.1.4" class="ltx_text ltx_font_typewriter">www.google.com,</span>, which leads to errors down the line.</p>
</div>
<div id="A10.p13" class="ltx_para ltx_noindent">
<div id="A10.p13.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,aW1wb3J0IHJlCmltcG9ydCBzb2NrZXQKaW1wb3J0IHVybGxpYi5wYXJzZQpkZWYgdGFza19mdW5jKG15U3RyaW5nKToKICAgICIiIgogICAgRXh0cmFjdHMgYWxsIFVSTHMgZnJvbSBhIGdpdmVuIHN0cmluZywgYW5hbHl6ZXMgZWFjaCBVUkwgdG8gZXh0cmFjdCB0aGUgZG9tYWluLCBhbmQgcmV0cmlldmVzIHRoZSBJUCBhZGRyZXNzIG9mIGVhY2ggZG9tYWluLgoKICAgIFBhcmFtZXRlcnM6CiAgICBteVN0cmluZyAoc3RyKTogVGhlIHN0cmluZyBmcm9tIHdoaWNoIFVSTHMgYXJlIGV4dHJhY3RlZC4gVGhlIHN0cmluZyBzaG91bGQgY29udGFpbiB2YWxpZCBVUkxzIHN0YXJ0aW5nIHdpdGggaHR0cCBvciBodHRwcy4KCiAgICBSZXR1cm5zOgogICAgZGljdDogQSBkaWN0aW9uYXJ5IHdpdGggZG9tYWlucyBhcyBrZXlzIGFuZCB0aGVpciByZXNwZWN0aXZlIElQIGFkZHJlc3NlcyAoSVB2NCkgYXMgdmFsdWVzLiBJZiBhIGRvbWFpbiBjYW5ub3QgYmUgcmVzb2x2ZWQsIHRoZSBJUCBhZGRyZXNzIHdpbGwgYmUgTm9uZS4KCiAgICBSZXF1aXJlbWVudHM6CiAgICAtIHJlCiAgICAtIHVybGxpYi5wYXJzZQogICAgLSBzb2NrZXQKCiAgICBSYWlzZXM6CiAgICBzb2NrZXQuZ2FpZXJyb3IgaWYgdGhlIGRvbWFpbiBjYW5ub3QgYmUgcmVzb2x2ZWQKCiAgICBFeGFtcGxlOgogICAgPj4+IHRhc2tfZnVuYygiQ2hlY2sgdGhlc2UgbGlua3M6IGh0dHA6Ly93d3cuZ29vZ2xlLmNvbSwgaHR0cHM6Ly93d3cucHl0aG9uLm9yZyIpCiAgICB7J3d3dy5nb29nbGUuY29tJzogJzE3Mi4yMTcuMTIuMTQyJywgJ3d3dy5weXRob24ub3JnJzogJzE1MS4xMDEuMTkzLjIyMyd9CiAgICAiIiIKCiAgICAjIFJlZ3VsYXIgZXhwcmVzc2lvbiB0byBmaW5kIFVSTHMKICAgIHVybF9wYXR0ZXJuID0gcmUuY29tcGlsZShyJ2h0dHBzPzovL1teXHMvJC4/I10uW15cc10qJykKICAgIHVybHMgPSB1cmxfcGF0dGVybi5maW5kYWxsKG15U3RyaW5nKQoKICAgICMgRGljdGlvbmFyeSB0byBzdG9yZSBkb21haW4gYW5kIElQIGFkZHJlc3MKICAgIGRvbWFpbl9pcF9tYXAgPSB7fQoKICAgIGZvciB1cmwgaW4gdXJsczoKICAgICAgICAjIFBhcnNlIHRoZSBVUkwgdG8gZXh0cmFjdCB0aGUgZG9tYWluCiAgICAgICAgcGFyc2VkX3VybCA9IHVybGxpYi5wYXJzZS51cmxwYXJzZSh1cmwpCiAgICAgICAgZG9tYWluID0gcGFyc2VkX3VybC5uZXRsb2MKCiAgICAgICAgIyBHZXQgdGhlIElQIGFkZHJlc3Mgb2YgdGhlIGRvbWFpbgogICAgICAgIHRyeToKICAgICAgICAgICAgaXBfYWRkcmVzcyA9IHNvY2tldC5nZXRob3N0YnluYW1lKGRvbWFpbikKICAgICAgICBleGNlcHQgc29ja2V0LmdhaWVycm9yOgogICAgICAgICAgICBpcF9hZGRyZXNzID0gTm9uZQoKICAgICAgICAjIEFkZCB0aGUgZG9tYWluIGFuZCBJUCBhZGRyZXNzIHRvIHRoZSBkaWN0aW9uYXJ5CiAgICAgICAgZG9tYWluX2lwX21hcFtkb21haW5dID0gaXBfYWRkcmVzcwoKICAgIHJldHVybiBkb21haW5faXBfbWFw" download="">⬇</a></div>
<div id="lstnumberx970" class="ltx_listingline">
<span id="lstnumberx970.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx970.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx970.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">re</span>
</div>
<div id="lstnumberx971" class="ltx_listingline">
<span id="lstnumberx971.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx971.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx971.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">socket</span>
</div>
<div id="lstnumberx972" class="ltx_listingline">
<span id="lstnumberx972.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx972.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx972.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">urllib</span><span id="lstnumberx972.4" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx972.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parse</span>
</div>
<div id="lstnumberx973" class="ltx_listingline">
<span id="lstnumberx973.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx973.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx973.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx973.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx973.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">myString</span><span id="lstnumberx973.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx974" class="ltx_listingline">
<span id="lstnumberx974.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx974.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx974.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx975" class="ltx_listingline">
<span id="lstnumberx975.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx975.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Extracts</span><span id="lstnumberx975.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">all</span><span id="lstnumberx975.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">URLs</span><span id="lstnumberx975.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from</span><span id="lstnumberx975.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx975.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">given</span><span id="lstnumberx975.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">string,</span><span id="lstnumberx975.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">analyzes</span><span id="lstnumberx975.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx975.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">URL</span><span id="lstnumberx975.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx975.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">extract</span><span id="lstnumberx975.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx975.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">domain,</span><span id="lstnumberx975.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx975.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">retrieves</span><span id="lstnumberx975.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx975.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">IP</span><span id="lstnumberx975.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">address</span><span id="lstnumberx975.39" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.40" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx975.41" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.42" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx975.43" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx975.44" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">domain.</span>
</div>
<div id="lstnumberx976" class="ltx_listingline">
</div>
<div id="lstnumberx977" class="ltx_listingline">
<span id="lstnumberx977.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx977.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx978" class="ltx_listingline">
<span id="lstnumberx978.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx978.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">myString</span><span id="lstnumberx978.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(str):</span><span id="lstnumberx978.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx978.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">string</span><span id="lstnumberx978.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from</span><span id="lstnumberx978.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">which</span><span id="lstnumberx978.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">URLs</span><span id="lstnumberx978.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">are</span><span id="lstnumberx978.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">extracted.</span><span id="lstnumberx978.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx978.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">string</span><span id="lstnumberx978.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">should</span><span id="lstnumberx978.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">contain</span><span id="lstnumberx978.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">valid</span><span id="lstnumberx978.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">URLs</span><span id="lstnumberx978.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">starting</span><span id="lstnumberx978.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx978.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">http</span><span id="lstnumberx978.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">or</span><span id="lstnumberx978.39" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx978.40" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">https.</span>
</div>
<div id="lstnumberx979" class="ltx_listingline">
</div>
<div id="lstnumberx980" class="ltx_listingline">
<span id="lstnumberx980.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx980.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx981" class="ltx_listingline">
<span id="lstnumberx981.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx981.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dict:</span><span id="lstnumberx981.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx981.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dictionary</span><span id="lstnumberx981.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx981.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">domains</span><span id="lstnumberx981.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">as</span><span id="lstnumberx981.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">keys</span><span id="lstnumberx981.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx981.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">their</span><span id="lstnumberx981.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">respective</span><span id="lstnumberx981.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">IP</span><span id="lstnumberx981.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">addresses</span><span id="lstnumberx981.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(IPv4)</span><span id="lstnumberx981.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">as</span><span id="lstnumberx981.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values.</span><span id="lstnumberx981.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx981.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx981.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">domain</span><span id="lstnumberx981.37" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.38" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">cannot</span><span id="lstnumberx981.39" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.40" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx981.41" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.42" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">resolved,</span><span id="lstnumberx981.43" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.44" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx981.45" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.46" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">IP</span><span id="lstnumberx981.47" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.48" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">address</span><span id="lstnumberx981.49" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.50" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">will</span><span id="lstnumberx981.51" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.52" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx981.53" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx981.54" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">None.</span>
</div>
<div id="lstnumberx982" class="ltx_listingline">
</div>
<div id="lstnumberx983" class="ltx_listingline">
<span id="lstnumberx983.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx983.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx984" class="ltx_listingline">
<span id="lstnumberx984.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx984.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx984.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx984.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">re</span>
</div>
<div id="lstnumberx985" class="ltx_listingline">
<span id="lstnumberx985.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx985.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx985.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx985.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">urllib.parse</span>
</div>
<div id="lstnumberx986" class="ltx_listingline">
<span id="lstnumberx986.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx986.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx986.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx986.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">socket</span>
</div>
<div id="lstnumberx987" class="ltx_listingline">
</div>
<div id="lstnumberx988" class="ltx_listingline">
<span id="lstnumberx988.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx988.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Raises:</span>
</div>
<div id="lstnumberx989" class="ltx_listingline">
<span id="lstnumberx989.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx989.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">socket.gaierror</span><span id="lstnumberx989.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx989.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx989.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx989.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx989.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx989.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">domain</span><span id="lstnumberx989.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx989.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">cannot</span><span id="lstnumberx989.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx989.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx989.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx989.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">resolved</span>
</div>
<div id="lstnumberx990" class="ltx_listingline">
</div>
<div id="lstnumberx991" class="ltx_listingline">
<span id="lstnumberx991.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx991.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx992" class="ltx_listingline">
<span id="lstnumberx992.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx992.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx992.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx992.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func("</span><span id="lstnumberx992.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">Check</span><span id="lstnumberx992.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx992.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">these</span><span id="lstnumberx992.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx992.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">links</span><span id="lstnumberx992.10" class="ltx_text ltx_font_typewriter">:<span id="lstnumberx992.10.1" class="ltx_text ltx_lst_space"> </span><span id="lstnumberx992.10.2" class="ltx_text ltx_lst_identifier">http</span>://<span id="lstnumberx992.10.3" class="ltx_text ltx_lst_identifier">www</span>.<span id="lstnumberx992.10.4" class="ltx_text ltx_lst_identifier">google</span>.<span id="lstnumberx992.10.5" class="ltx_text ltx_lst_identifier">com</span>,<span id="lstnumberx992.10.6" class="ltx_text ltx_lst_space"> </span><span id="lstnumberx992.10.7" class="ltx_text ltx_lst_identifier">https</span>://<span id="lstnumberx992.10.8" class="ltx_text ltx_lst_identifier">www</span>.<span id="lstnumberx992.10.9" class="ltx_text ltx_lst_identifier">python</span>.<span id="lstnumberx992.10.10" class="ltx_text ltx_lst_identifier">org</span><span id="lstnumberx992.10.11" class="ltx_text ltx_lst_string"></span></span><span id="lstnumberx992.11" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">")</span>
</div>
<div id="lstnumberx993" class="ltx_listingline">
<span id="lstnumberx993.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx993.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">{’www.google.com’:</span><span id="lstnumberx993.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx993.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’172.217.12.142’,</span><span id="lstnumberx993.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx993.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’www.python.org’:</span><span id="lstnumberx993.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx993.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’151.101.193.223’}</span>
</div>
<div id="lstnumberx994" class="ltx_listingline">
<span id="lstnumberx994.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx994.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx994.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx994.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx995" class="ltx_listingline">
</div>
<div id="lstnumberx996" class="ltx_listingline">
<span id="lstnumberx996.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx996.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx996.2.1" class="ltx_text ltx_lst_space"> </span>Regular<span id="lstnumberx996.2.2" class="ltx_text ltx_lst_space"> </span>expression<span id="lstnumberx996.2.3" class="ltx_text ltx_lst_space"> </span>to<span id="lstnumberx996.2.4" class="ltx_text ltx_lst_space"> </span>find<span id="lstnumberx996.2.5" class="ltx_text ltx_lst_space"> </span>URLs</span>
</div>
<div id="lstnumberx997" class="ltx_listingline">
<span id="lstnumberx997.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx997.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">url_pattern</span><span id="lstnumberx997.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx997.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx997.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx997.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">re</span><span id="lstnumberx997.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx997.8" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">compile</span><span id="lstnumberx997.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx997.10" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">r’https?://[^\s/$.?#].[^\s]*’</span><span id="lstnumberx997.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx998" class="ltx_listingline">
<span id="lstnumberx998.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx998.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">urls</span><span id="lstnumberx998.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx998.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx998.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx998.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">url_pattern</span><span id="lstnumberx998.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx998.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">findall</span><span id="lstnumberx998.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx998.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">myString</span><span id="lstnumberx998.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx999" class="ltx_listingline">
</div>
<div id="lstnumberx1000" class="ltx_listingline">
<span id="lstnumberx1000.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1000.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1000.2.1" class="ltx_text ltx_lst_space"> </span>Dictionary<span id="lstnumberx1000.2.2" class="ltx_text ltx_lst_space"> </span>to<span id="lstnumberx1000.2.3" class="ltx_text ltx_lst_space"> </span>store<span id="lstnumberx1000.2.4" class="ltx_text ltx_lst_space"> </span>domain<span id="lstnumberx1000.2.5" class="ltx_text ltx_lst_space"> </span>and<span id="lstnumberx1000.2.6" class="ltx_text ltx_lst_space"> </span>IP<span id="lstnumberx1000.2.7" class="ltx_text ltx_lst_space"> </span>address</span>
</div>
<div id="lstnumberx1001" class="ltx_listingline">
<span id="lstnumberx1001.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1001.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">domain_ip_map</span><span id="lstnumberx1001.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1001.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1001.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1001.6" class="ltx_text ltx_font_typewriter">{}</span>
</div>
<div id="lstnumberx1002" class="ltx_listingline">
</div>
<div id="lstnumberx1003" class="ltx_listingline">
<span id="lstnumberx1003.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1003.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx1003.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1003.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">url</span><span id="lstnumberx1003.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1003.6" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx1003.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1003.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">urls</span><span id="lstnumberx1003.9" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1004" class="ltx_listingline">
<span id="lstnumberx1004.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1004.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1004.2.1" class="ltx_text ltx_lst_space"> </span>Parse<span id="lstnumberx1004.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1004.2.3" class="ltx_text ltx_lst_space"> </span>URL<span id="lstnumberx1004.2.4" class="ltx_text ltx_lst_space"> </span>to<span id="lstnumberx1004.2.5" class="ltx_text ltx_lst_space"> </span>extract<span id="lstnumberx1004.2.6" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1004.2.7" class="ltx_text ltx_lst_space"> </span>domain</span>
</div>
<div id="lstnumberx1005" class="ltx_listingline">
<span id="lstnumberx1005.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1005.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parsed_url</span><span id="lstnumberx1005.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1005.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1005.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1005.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">urllib</span><span id="lstnumberx1005.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1005.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parse</span><span id="lstnumberx1005.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1005.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">urlparse</span><span id="lstnumberx1005.11" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1005.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">url</span><span id="lstnumberx1005.13" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1006" class="ltx_listingline">
<span id="lstnumberx1006.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1006.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">domain</span><span id="lstnumberx1006.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1006.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1006.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1006.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">parsed_url</span><span id="lstnumberx1006.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1006.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">netloc</span>
</div>
<div id="lstnumberx1007" class="ltx_listingline">
</div>
<div id="lstnumberx1008" class="ltx_listingline">
<span id="lstnumberx1008.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1008.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1008.2.1" class="ltx_text ltx_lst_space"> </span>Get<span id="lstnumberx1008.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1008.2.3" class="ltx_text ltx_lst_space"> </span>IP<span id="lstnumberx1008.2.4" class="ltx_text ltx_lst_space"> </span>address<span id="lstnumberx1008.2.5" class="ltx_text ltx_lst_space"> </span>of<span id="lstnumberx1008.2.6" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1008.2.7" class="ltx_text ltx_lst_space"> </span>domain</span>
</div>
<div id="lstnumberx1009" class="ltx_listingline">
<span id="lstnumberx1009.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1009.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">try</span><span id="lstnumberx1009.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1010" class="ltx_listingline">
<span id="lstnumberx1010.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx1010.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ip_address</span><span id="lstnumberx1010.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1010.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1010.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1010.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">socket</span><span id="lstnumberx1010.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1010.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">gethostbyname</span><span id="lstnumberx1010.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1010.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">domain</span><span id="lstnumberx1010.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1011" class="ltx_listingline">
<span id="lstnumberx1011.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1011.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">except</span><span id="lstnumberx1011.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1011.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">socket</span><span id="lstnumberx1011.5" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1011.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">gaierror</span><span id="lstnumberx1011.7" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1012" class="ltx_listingline">
<span id="lstnumberx1012.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx1012.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ip_address</span><span id="lstnumberx1012.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1012.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1012.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1012.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">None</span>
</div>
<div id="lstnumberx1013" class="ltx_listingline">
</div>
<div id="lstnumberx1014" class="ltx_listingline">
<span id="lstnumberx1014.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1014.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1014.2.1" class="ltx_text ltx_lst_space"> </span>Add<span id="lstnumberx1014.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1014.2.3" class="ltx_text ltx_lst_space"> </span>domain<span id="lstnumberx1014.2.4" class="ltx_text ltx_lst_space"> </span>and<span id="lstnumberx1014.2.5" class="ltx_text ltx_lst_space"> </span>IP<span id="lstnumberx1014.2.6" class="ltx_text ltx_lst_space"> </span>address<span id="lstnumberx1014.2.7" class="ltx_text ltx_lst_space"> </span>to<span id="lstnumberx1014.2.8" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1014.2.9" class="ltx_text ltx_lst_space"> </span>dictionary</span>
</div>
<div id="lstnumberx1015" class="ltx_listingline">
<span id="lstnumberx1015.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1015.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">domain_ip_map</span><span id="lstnumberx1015.3" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1015.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">domain</span><span id="lstnumberx1015.5" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1015.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1015.7" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1015.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1015.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ip_address</span>
</div>
<div id="lstnumberx1016" class="ltx_listingline">
</div>
<div id="lstnumberx1017" class="ltx_listingline">
<span id="lstnumberx1017.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1017.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx1017.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1017.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">domain_ip_map</span>
</div>
</div>
</div>
<div id="A10.p14" class="ltx_para ltx_noindent">
<p id="A10.p14.1" class="ltx_p"><span id="A10.p14.1.1" class="ltx_text ltx_font_bold">Example 8</span>: In this example, the model misunderstands the host naming structures. The issue is in the line <span id="A10.p14.1.2" class="ltx_text ltx_font_typewriter">response = requests.get(f"https://ipinfo.io/ip_address/json")</span>, where the <span id="A10.p14.1.3" class="ltx_text ltx_font_typewriter">/json</span> should not be present. This leads to a <span id="A10.p14.1.4" class="ltx_text ltx_font_typewriter">hostname not found</span> error.</p>
</div>
<div id="A10.p15" class="ltx_para ltx_noindent">
<div id="A10.p15.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,aW1wb3J0IHNvY2tldAppbXBvcnQgcmVxdWVzdHMKZGVmIHRhc2tfZnVuYyhob3N0KToKICAgICIiIgogICAgVGhpcyBmdW5jdGlvbiByZXNvbHZlcyB0aGUgSVAgYWRkcmVzcyBvZiB0aGUgZ2l2ZW4gaG9zdCBhbmQgdGhlbiB1c2VzIHRoZSBJUCBhZGRyZXNzCiAgICB0byBmZXRjaCBnZW9sb2NhdGlvbiBpbmZvcm1hdGlvbiBmcm9tIHRoZSBpcGluZm8uaW8gQVBJLiBUaGUgZnVuY3Rpb24gaXMgcm9idXN0IGFnYWluc3QKICAgIHZhcmlvdXMgY29tbW9uIGVycm9ycywgc3VjaCBhcyBpbnZhbGlkIGhvc3RuYW1lcywgbmV0d29yayBpc3N1ZXMsIG9yIHByb2JsZW1zIHdpdGggdGhlCiAgICBnZW9sb2NhdGlvbiBzZXJ2aWNlLgoKICAgIFBhcmFtZXRlcnM6CiAgICBob3N0IChzdHIpOiBUaGUgaG9zdG5hbWUgdG8gYmUgcmVzb2x2ZWQuCgogICAgUmV0dXJuczoKICAgIGRpY3Q6IEEgZGljdGlvbmFyeSBjb250YWluaW5nIHRoZSBJUCBhZGRyZXNzIGFuZCBnZW9sb2NhdGlvbiBpbmZvcm1hdGlvbiBpZiBzdWNjZXNzZnVsLgoKICAgIFJhaXNlczoKICAgIFZhbHVlRXJyb3I6IElmICdob3N0JyBpcyBOb25lIG9yIGFuIGVtcHR5IHN0cmluZy4KICAgIENvbm5lY3Rpb25FcnJvcjogSWYgdGhlcmUgaXMgYSBwcm9ibGVtIGNvbm5lY3RpbmcgdG8gdGhlIGdlb2xvY2F0aW9uIHNlcnZpY2UuCgogICAgRXhhbXBsZToKICAgID4+PiByZXN1bHQgPSB0YXNrX2Z1bmMoJ2dvb2dsZS5jb20nKQogICAgPj4+ICdpcF9hZGRyZXNzJyBpbiByZXN1bHQgYW5kICdnZW9sb2NhdGlvbicgaW4gcmVzdWx0CiAgICBUcnVlCiAgICA+Pj4gdGFza19mdW5jKCcnKQogICAgVHJhY2ViYWNrIChtb3N0IHJlY2VudCBjYWxsIGxhc3QpOgogICAgICAgLi4uCiAgICBWYWx1ZUVycm9yOiBIb3N0IG11c3QgYmUgYSBub24tZW1wdHkgc3RyaW5nLgoKICAgIFJlcXVpcmVtZW50czoKICAgIC0gc29ja2V0CiAgICAtIHJlcXVlc3RzCiAgICAiIiIKICAgIGlmIG5vdCBob3N0OgogICAgICAgIHJhaXNlIFZhbHVlRXJyb3IoIkhvc3QgbXVzdCBiZSBhIG5vbi1lbXB0eSBzdHJpbmcuIikKCiAgICB0cnk6CiAgICAgICAgaXBfYWRkcmVzcyA9IHNvY2tldC5nZXRob3N0YnluYW1lKGhvc3QpCiAgICBleGNlcHQgc29ja2V0LmdhaWVycm9yOgogICAgICAgIHJhaXNlIFZhbHVlRXJyb3IoIkludmFsaWQgaG9zdG5hbWUuIikKCiAgICB0cnk6CiAgICAgICAgcmVzcG9uc2UgPSByZXF1ZXN0cy5nZXQoZiJodHRwczovL2lwaW5mby5pby97aXBfYWRkcmVzc30vanNvbiIpCiAgICAgICAgcmVzcG9uc2UucmFpc2VfZm9yX3N0YXR1cygpCiAgICAgICAgZ2VvbG9jYXRpb24gPSByZXNwb25zZS5qc29uKCkKICAgIGV4Y2VwdCByZXF1ZXN0cy5SZXF1ZXN0RXhjZXB0aW9uIGFzIGU6CiAgICAgICAgcmFpc2UgQ29ubmVjdGlvbkVycm9yKGYiRXJyb3IgY29ubmVjdGluZyB0byB0aGUgZ2VvbG9jYXRpb24gc2VydmljZToge2V9IikKCiAgICByZXR1cm4gewogICAgICAgICJpcF9hZGRyZXNzIjogaXBfYWRkcmVzcywKICAgICAgICAiZ2VvbG9jYXRpb24iOiBnZW9sb2NhdGlvbgogICAgfQ==" download="">⬇</a></div>
<div id="lstnumberx1018" class="ltx_listingline">
<span id="lstnumberx1018.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx1018.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1018.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">socket</span>
</div>
<div id="lstnumberx1019" class="ltx_listingline">
<span id="lstnumberx1019.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx1019.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1019.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requests</span>
</div>
<div id="lstnumberx1020" class="ltx_listingline">
<span id="lstnumberx1020.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx1020.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1020.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx1020.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1020.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">host</span><span id="lstnumberx1020.6" class="ltx_text ltx_font_typewriter">):</span>
</div>
<div id="lstnumberx1021" class="ltx_listingline">
<span id="lstnumberx1021.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1021.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx1021.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx1022" class="ltx_listingline">
<span id="lstnumberx1022.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1022.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">This</span><span id="lstnumberx1022.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">function</span><span id="lstnumberx1022.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">resolves</span><span id="lstnumberx1022.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1022.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">IP</span><span id="lstnumberx1022.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">address</span><span id="lstnumberx1022.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1022.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1022.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">given</span><span id="lstnumberx1022.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">host</span><span id="lstnumberx1022.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx1022.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">then</span><span id="lstnumberx1022.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">uses</span><span id="lstnumberx1022.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1022.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">IP</span><span id="lstnumberx1022.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1022.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">address</span>
</div>
<div id="lstnumberx1023" class="ltx_listingline">
<span id="lstnumberx1023.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1023.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx1023.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">fetch</span><span id="lstnumberx1023.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">geolocation</span><span id="lstnumberx1023.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">information</span><span id="lstnumberx1023.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from</span><span id="lstnumberx1023.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1023.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ipinfo.io</span><span id="lstnumberx1023.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">API.</span><span id="lstnumberx1023.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx1023.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">function</span><span id="lstnumberx1023.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx1023.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">robust</span><span id="lstnumberx1023.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1023.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">against</span>
</div>
<div id="lstnumberx1024" class="ltx_listingline">
<span id="lstnumberx1024.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1024.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">various</span><span id="lstnumberx1024.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">common</span><span id="lstnumberx1024.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">errors,</span><span id="lstnumberx1024.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">such</span><span id="lstnumberx1024.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">as</span><span id="lstnumberx1024.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">invalid</span><span id="lstnumberx1024.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">hostnames,</span><span id="lstnumberx1024.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">network</span><span id="lstnumberx1024.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">issues,</span><span id="lstnumberx1024.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">or</span><span id="lstnumberx1024.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">problems</span><span id="lstnumberx1024.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx1024.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1024.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span>
</div>
<div id="lstnumberx1025" class="ltx_listingline">
<span id="lstnumberx1025.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1025.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">geolocation</span><span id="lstnumberx1025.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1025.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">service.</span>
</div>
<div id="lstnumberx1026" class="ltx_listingline">
</div>
<div id="lstnumberx1027" class="ltx_listingline">
<span id="lstnumberx1027.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1027.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx1028" class="ltx_listingline">
<span id="lstnumberx1028.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1028.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">host</span><span id="lstnumberx1028.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1028.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(str):</span><span id="lstnumberx1028.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1028.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx1028.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1028.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">hostname</span><span id="lstnumberx1028.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1028.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx1028.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1028.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx1028.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1028.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">resolved.</span>
</div>
<div id="lstnumberx1029" class="ltx_listingline">
</div>
<div id="lstnumberx1030" class="ltx_listingline">
<span id="lstnumberx1030.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1030.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx1031" class="ltx_listingline">
<span id="lstnumberx1031.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1031.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dict:</span><span id="lstnumberx1031.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx1031.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dictionary</span><span id="lstnumberx1031.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">containing</span><span id="lstnumberx1031.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1031.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">IP</span><span id="lstnumberx1031.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">address</span><span id="lstnumberx1031.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx1031.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">geolocation</span><span id="lstnumberx1031.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">information</span><span id="lstnumberx1031.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">if</span><span id="lstnumberx1031.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1031.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">successful.</span>
</div>
<div id="lstnumberx1032" class="ltx_listingline">
</div>
<div id="lstnumberx1033" class="ltx_listingline">
<span id="lstnumberx1033.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1033.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Raises:</span>
</div>
<div id="lstnumberx1034" class="ltx_listingline">
<span id="lstnumberx1034.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1034.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ValueError:</span><span id="lstnumberx1034.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1034.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx1034.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1034.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’host’</span><span id="lstnumberx1034.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1034.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx1034.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1034.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">None</span><span id="lstnumberx1034.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1034.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">or</span><span id="lstnumberx1034.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1034.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">an</span><span id="lstnumberx1034.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1034.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">empty</span><span id="lstnumberx1034.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1034.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">string.</span>
</div>
<div id="lstnumberx1035" class="ltx_listingline">
<span id="lstnumberx1035.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1035.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ConnectionError:</span><span id="lstnumberx1035.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx1035.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">there</span><span id="lstnumberx1035.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx1035.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx1035.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">problem</span><span id="lstnumberx1035.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">connecting</span><span id="lstnumberx1035.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx1035.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1035.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">geolocation</span><span id="lstnumberx1035.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1035.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">service.</span>
</div>
<div id="lstnumberx1036" class="ltx_listingline">
</div>
<div id="lstnumberx1037" class="ltx_listingline">
<span id="lstnumberx1037.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1037.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx1038" class="ltx_listingline">
<span id="lstnumberx1038.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1038.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1038.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1038.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">result</span><span id="lstnumberx1038.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1038.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx1038.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1038.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(’google.com’)</span>
</div>
<div id="lstnumberx1039" class="ltx_listingline">
<span id="lstnumberx1039.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1039.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1039.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1039.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’ip_address’</span><span id="lstnumberx1039.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1039.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx1039.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1039.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">result</span><span id="lstnumberx1039.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1039.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx1039.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1039.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’geolocation’</span><span id="lstnumberx1039.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1039.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx1039.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1039.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">result</span>
</div>
<div id="lstnumberx1040" class="ltx_listingline">
<span id="lstnumberx1040.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1040.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">True</span>
</div>
<div id="lstnumberx1041" class="ltx_listingline">
<span id="lstnumberx1041.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1041.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1041.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1041.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(’’)</span>
</div>
<div id="lstnumberx1042" class="ltx_listingline">
<span id="lstnumberx1042.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1042.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Traceback</span><span id="lstnumberx1042.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1042.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(most</span><span id="lstnumberx1042.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1042.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">recent</span><span id="lstnumberx1042.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1042.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">call</span><span id="lstnumberx1042.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1042.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">last):</span>
</div>
<div id="lstnumberx1043" class="ltx_listingline">
<span id="lstnumberx1043.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">       </span><span id="lstnumberx1043.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">...</span>
</div>
<div id="lstnumberx1044" class="ltx_listingline">
<span id="lstnumberx1044.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1044.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ValueError:</span><span id="lstnumberx1044.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1044.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Host</span><span id="lstnumberx1044.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1044.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">must</span><span id="lstnumberx1044.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1044.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx1044.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1044.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx1044.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1044.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">non-empty</span><span id="lstnumberx1044.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1044.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">string.</span>
</div>
<div id="lstnumberx1045" class="ltx_listingline">
</div>
<div id="lstnumberx1046" class="ltx_listingline">
<span id="lstnumberx1046.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1046.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx1047" class="ltx_listingline">
<span id="lstnumberx1047.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1047.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1047.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1047.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">socket</span>
</div>
<div id="lstnumberx1048" class="ltx_listingline">
<span id="lstnumberx1048.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1048.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1048.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1048.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">requests</span>
</div>
<div id="lstnumberx1049" class="ltx_listingline">
<span id="lstnumberx1049.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1049.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx1049.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx1049.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx1050" class="ltx_listingline">
<span id="lstnumberx1050.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1050.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx1050.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1050.4" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">not</span><span id="lstnumberx1050.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1050.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">host</span><span id="lstnumberx1050.7" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1051" class="ltx_listingline">
<span id="lstnumberx1051.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1051.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">raise</span><span id="lstnumberx1051.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1051.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ValueError</span><span id="lstnumberx1051.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1051.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Host<span id="lstnumberx1051.6.1" class="ltx_text ltx_lst_space"> </span>must<span id="lstnumberx1051.6.2" class="ltx_text ltx_lst_space"> </span>be<span id="lstnumberx1051.6.3" class="ltx_text ltx_lst_space"> </span>a<span id="lstnumberx1051.6.4" class="ltx_text ltx_lst_space"> </span>non-empty<span id="lstnumberx1051.6.5" class="ltx_text ltx_lst_space"> </span>string."</span><span id="lstnumberx1051.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1052" class="ltx_listingline">
</div>
<div id="lstnumberx1053" class="ltx_listingline">
<span id="lstnumberx1053.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1053.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">try</span><span id="lstnumberx1053.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1054" class="ltx_listingline">
<span id="lstnumberx1054.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1054.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ip_address</span><span id="lstnumberx1054.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1054.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1054.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1054.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">socket</span><span id="lstnumberx1054.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1054.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">gethostbyname</span><span id="lstnumberx1054.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1054.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">host</span><span id="lstnumberx1054.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1055" class="ltx_listingline">
<span id="lstnumberx1055.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1055.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">except</span><span id="lstnumberx1055.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1055.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">socket</span><span id="lstnumberx1055.5" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1055.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">gaierror</span><span id="lstnumberx1055.7" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1056" class="ltx_listingline">
<span id="lstnumberx1056.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1056.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">raise</span><span id="lstnumberx1056.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1056.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ValueError</span><span id="lstnumberx1056.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1056.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Invalid<span id="lstnumberx1056.6.1" class="ltx_text ltx_lst_space"> </span>hostname."</span><span id="lstnumberx1056.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1057" class="ltx_listingline">
</div>
<div id="lstnumberx1058" class="ltx_listingline">
<span id="lstnumberx1058.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1058.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">try</span><span id="lstnumberx1058.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1059" class="ltx_listingline">
<span id="lstnumberx1059.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1059.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">response</span><span id="lstnumberx1059.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1059.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1059.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1059.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requests</span><span id="lstnumberx1059.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1059.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">get</span><span id="lstnumberx1059.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1059.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx1059.11" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"https://ipinfo.io/{ip_address}/json"</span><span id="lstnumberx1059.12" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1060" class="ltx_listingline">
<span id="lstnumberx1060.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1060.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">response</span><span id="lstnumberx1060.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1060.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">raise_for_status</span><span id="lstnumberx1060.5" class="ltx_text ltx_font_typewriter">()</span>
</div>
<div id="lstnumberx1061" class="ltx_listingline">
<span id="lstnumberx1061.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1061.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">geolocation</span><span id="lstnumberx1061.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1061.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1061.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1061.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">response</span><span id="lstnumberx1061.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1061.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">json</span><span id="lstnumberx1061.9" class="ltx_text ltx_font_typewriter">()</span>
</div>
<div id="lstnumberx1062" class="ltx_listingline">
<span id="lstnumberx1062.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1062.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">except</span><span id="lstnumberx1062.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1062.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">requests</span><span id="lstnumberx1062.5" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1062.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">RequestException</span><span id="lstnumberx1062.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1062.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx1062.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1062.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">e</span><span id="lstnumberx1062.11" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1063" class="ltx_listingline">
<span id="lstnumberx1063.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1063.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">raise</span><span id="lstnumberx1063.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1063.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ConnectionError</span><span id="lstnumberx1063.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1063.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx1063.7" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"Error<span id="lstnumberx1063.7.1" class="ltx_text ltx_lst_space"> </span>connecting<span id="lstnumberx1063.7.2" class="ltx_text ltx_lst_space"> </span>to<span id="lstnumberx1063.7.3" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1063.7.4" class="ltx_text ltx_lst_space"> </span>geolocation<span id="lstnumberx1063.7.5" class="ltx_text ltx_lst_space"> </span>service:<span id="lstnumberx1063.7.6" class="ltx_text ltx_lst_space"> </span>{e}"</span><span id="lstnumberx1063.8" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1064" class="ltx_listingline">
</div>
<div id="lstnumberx1065" class="ltx_listingline">
<span id="lstnumberx1065.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1065.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx1065.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1065.4" class="ltx_text ltx_font_typewriter">{</span>
</div>
<div id="lstnumberx1066" class="ltx_listingline">
<span id="lstnumberx1066.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1066.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"ip_address"</span><span id="lstnumberx1066.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx1066.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1066.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ip_address</span><span id="lstnumberx1066.6" class="ltx_text ltx_font_typewriter">,</span>
</div>
<div id="lstnumberx1067" class="ltx_listingline">
<span id="lstnumberx1067.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1067.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"geolocation"</span><span id="lstnumberx1067.3" class="ltx_text ltx_font_typewriter">:</span><span id="lstnumberx1067.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1067.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">geolocation</span>
</div>
<div id="lstnumberx1068" class="ltx_listingline">
<span id="lstnumberx1068.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1068.2" class="ltx_text ltx_font_typewriter">}</span>
</div>
</div>
</div>
<div id="A10.p16" class="ltx_para ltx_noindent">
<p id="A10.p16.1" class="ltx_p"><span id="A10.p16.1.1" class="ltx_text ltx_font_bold">Example 9</span>: This example shows an example where there is a simple solution using <span id="A10.p16.1.2" class="ltx_text ltx_font_typewriter">flatten</span>, but the generated solution does not use this function and therefore gets the function incorrect.</p>
</div>
<div id="A10.p17" class="ltx_para ltx_noindent">
<div id="A10.p17.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,ZGVmIHRhc2tfZnVuYyhkaW1lbnNpb24sIHNlZWQ9NDIpOgogICAgIiIiCiAgICBDcmVhdGUgYSAyRCBudW1lcmljIGFycmF5IChtYXRyaXgpIG9mIGEgZ2l2ZW4gZGltZW5zaW9uIHdpdGggcmFuZG9tIGludGVnZXJzIGJldHdlZW4gMSBhbmQgMTAwLAogICAgYW5kIGEgZmxhdCBsaXN0IG9mIGFsbCBlbGVtZW50cyBpbiB0aGUgbWF0cml4LgoKICAgIFBhcmFtZXRlcnM6CiAgICAtIGRpbWVuc2lvbiAoaW50KTogVGhlIGRpbWVuc2lvbiBvZiB0aGUgc3F1YXJlIG1hdHJpeCB0byBiZSBjcmVhdGVkLiBJdCBtdXN0IGJlIGEgcG9zaXRpdmUgaW50ZWdlci4KCiAgICBSZXR1cm5zOgogICAgdHVwbGU6IEEgdHVwbGUgY29udGFpbmluZzoKICAgICAgICAtIEEgMkQgbnVtcHkgYXJyYXkgb2YgdGhlIGdpdmVuIGRpbWVuc2lvbiB3aXRoIHJhbmRvbSBpbnRlZ2VycyBiZXR3ZWVuIDEgYW5kIDEwMC4KICAgICAgICAtIEEgZmxhdCBsaXN0IG9mIGFsbCBlbGVtZW50cyBpbiB0aGUgbWF0cml4LgoKICAgIFJlcXVpcmVtZW50czoKICAgIC0gbnVtcHkKICAgIC0gaXRlcnRvb2xzCgogICAgRXhhbXBsZToKICAgID4+PiBtYXRyaXgsIGZsYXRfbGlzdCA9IHRhc2tfZnVuYygzKQogICAgPj4+IHByaW50KG1hdHJpeCkKICAgIFtbNTIgOTMgMTVdCiAgICAgWzcyIDYxIDIxXQogICAgIFs4MyA4NyA3NV1dCiAgICA+Pj4gcHJpbnQoZmxhdF9saXN0KQogICAgWzUyLCA5MywgMTUsIDcyLCA2MSwgMjEsIDgzLCA4NywgNzVdCiAgICAiIiIKICAgICMgU2V0IHRoZSByYW5kb20gc2VlZCBmb3IgcmVwcm9kdWNpYmlsaXR5CiAgICBucC5yYW5kb20uc2VlZChzZWVkKQoKICAgICMgR2VuZXJhdGUgYSAyRCBudW1weSBhcnJheSB3aXRoIHJhbmRvbSBpbnRlZ2VycyBiZXR3ZWVuIDEgYW5kIDEwMAogICAgbWF0cml4ID0gbnAucmFuZG9tLnJhbmRpbnQoMSwgMTAxLCBzaXplPShkaW1lbnNpb24sIGRpbWVuc2lvbikpCgogICAgIyBGbGF0dGVuIHRoZSBtYXRyaXggdG8gYSBsaXN0CiAgICBmbGF0X2xpc3QgPSBsaXN0KGl0ZXJ0b29scy5jaGFpbi5mcm9tX2l0ZXJhYmxlKG1hdHJpeCkpCgogICAgcmV0dXJuIG1hdHJpeCwgZmxhdF9saXN0CgojIEdyb3VuZCBUcnV0aApkZWYgdGFza19mdW5jKGRpbWVuc2lvbiwgc2VlZD00Mik6CiAgICBucC5yYW5kb20uc2VlZChzZWVkKSAgIyBFbnN1cmUgcmVwcm9kdWNpYmxlIHJlc3VsdHMKICAgIGlmIGRpbWVuc2lvbiA8PSAwOgogICAgICAgIHJhaXNlIFZhbHVlRXJyb3IoIlRoZSBkaW1lbnNpb24gbXVzdCBiZSBhIHBvc2l0aXZlIGludGVnZXIiKQogICAgbWF0cml4ID0gbnAucmFuZG9tLnJhbmRpbnQoMSwgMTAxLCBzaXplPShkaW1lbnNpb24sIGRpbWVuc2lvbikpCiAgICBmbGF0X2xpc3QgPSBtYXRyaXguZmxhdHRlbigpLnRvbGlzdCgpCiAgICByZXR1cm4gbWF0cml4LCBmbGF0X2xpc3Q=" download="">⬇</a></div>
<div id="lstnumberx1069" class="ltx_listingline">
<span id="lstnumberx1069.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx1069.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1069.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx1069.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1069.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dimension</span><span id="lstnumberx1069.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1069.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1069.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx1069.9" class="ltx_text ltx_font_typewriter">=42):</span>
</div>
<div id="lstnumberx1070" class="ltx_listingline">
<span id="lstnumberx1070.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1070.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx1070.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx1071" class="ltx_listingline">
<span id="lstnumberx1071.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1071.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Create</span><span id="lstnumberx1071.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx1071.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2D</span><span id="lstnumberx1071.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numeric</span><span id="lstnumberx1071.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">array</span><span id="lstnumberx1071.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(matrix)</span><span id="lstnumberx1071.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1071.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx1071.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">given</span><span id="lstnumberx1071.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dimension</span><span id="lstnumberx1071.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx1071.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">random</span><span id="lstnumberx1071.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">integers</span><span id="lstnumberx1071.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">between</span><span id="lstnumberx1071.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">1</span><span id="lstnumberx1071.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx1071.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1071.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">100,</span>
</div>
<div id="lstnumberx1072" class="ltx_listingline">
<span id="lstnumberx1072.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1072.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx1072.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1072.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx1072.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1072.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">flat</span><span id="lstnumberx1072.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1072.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx1072.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1072.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1072.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1072.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">all</span><span id="lstnumberx1072.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1072.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">elements</span><span id="lstnumberx1072.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1072.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx1072.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1072.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1072.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1072.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matrix.</span>
</div>
<div id="lstnumberx1073" class="ltx_listingline">
</div>
<div id="lstnumberx1074" class="ltx_listingline">
<span id="lstnumberx1074.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1074.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx1075" class="ltx_listingline">
<span id="lstnumberx1075.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1075.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1075.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dimension</span><span id="lstnumberx1075.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(int):</span><span id="lstnumberx1075.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx1075.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dimension</span><span id="lstnumberx1075.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1075.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1075.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">square</span><span id="lstnumberx1075.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matrix</span><span id="lstnumberx1075.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx1075.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx1075.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">created.</span><span id="lstnumberx1075.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">It</span><span id="lstnumberx1075.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">must</span><span id="lstnumberx1075.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">be</span><span id="lstnumberx1075.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx1075.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">positive</span><span id="lstnumberx1075.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1075.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">integer.</span>
</div>
<div id="lstnumberx1076" class="ltx_listingline">
</div>
<div id="lstnumberx1077" class="ltx_listingline">
<span id="lstnumberx1077.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1077.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx1078" class="ltx_listingline">
<span id="lstnumberx1078.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1078.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuple:</span><span id="lstnumberx1078.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1078.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx1078.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1078.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuple</span><span id="lstnumberx1078.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1078.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">containing:</span>
</div>
<div id="lstnumberx1079" class="ltx_listingline">
<span id="lstnumberx1079.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">        </span><span id="lstnumberx1079.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1079.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx1079.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2D</span><span id="lstnumberx1079.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numpy</span><span id="lstnumberx1079.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">array</span><span id="lstnumberx1079.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1079.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1079.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">given</span><span id="lstnumberx1079.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">dimension</span><span id="lstnumberx1079.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx1079.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">random</span><span id="lstnumberx1079.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">integers</span><span id="lstnumberx1079.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">between</span><span id="lstnumberx1079.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">1</span><span id="lstnumberx1079.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx1079.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1079.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">100.</span>
</div>
<div id="lstnumberx1080" class="ltx_listingline">
<span id="lstnumberx1080.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">        </span><span id="lstnumberx1080.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1080.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1080.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx1080.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1080.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">flat</span><span id="lstnumberx1080.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1080.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx1080.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1080.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1080.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1080.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">all</span><span id="lstnumberx1080.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1080.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">elements</span><span id="lstnumberx1080.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1080.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx1080.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1080.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1080.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1080.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matrix.</span>
</div>
<div id="lstnumberx1081" class="ltx_listingline">
</div>
<div id="lstnumberx1082" class="ltx_listingline">
<span id="lstnumberx1082.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1082.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx1083" class="ltx_listingline">
<span id="lstnumberx1083.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1083.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1083.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1083.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numpy</span>
</div>
<div id="lstnumberx1084" class="ltx_listingline">
<span id="lstnumberx1084.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1084.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1084.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1084.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">itertools</span>
</div>
<div id="lstnumberx1085" class="ltx_listingline">
</div>
<div id="lstnumberx1086" class="ltx_listingline">
<span id="lstnumberx1086.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1086.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx1087" class="ltx_listingline">
<span id="lstnumberx1087.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1087.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1087.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1087.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">matrix,</span><span id="lstnumberx1087.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1087.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">flat_list</span><span id="lstnumberx1087.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1087.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx1087.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1087.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(3)</span>
</div>
<div id="lstnumberx1088" class="ltx_listingline">
<span id="lstnumberx1088.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1088.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1088.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1088.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">print(matrix)</span>
</div>
<div id="lstnumberx1089" class="ltx_listingline">
<span id="lstnumberx1089.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1089.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">[[52</span><span id="lstnumberx1089.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1089.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">93</span><span id="lstnumberx1089.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1089.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">15]</span>
</div>
<div id="lstnumberx1090" class="ltx_listingline">
<span id="lstnumberx1090.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">     </span><span id="lstnumberx1090.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">[72</span><span id="lstnumberx1090.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1090.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">61</span><span id="lstnumberx1090.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1090.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">21]</span>
</div>
<div id="lstnumberx1091" class="ltx_listingline">
<span id="lstnumberx1091.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">     </span><span id="lstnumberx1091.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">[83</span><span id="lstnumberx1091.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1091.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">87</span><span id="lstnumberx1091.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1091.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">75]]</span>
</div>
<div id="lstnumberx1092" class="ltx_listingline">
<span id="lstnumberx1092.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1092.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1092.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1092.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">print(flat_list)</span>
</div>
<div id="lstnumberx1093" class="ltx_listingline">
<span id="lstnumberx1093.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1093.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">[52,</span><span id="lstnumberx1093.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1093.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">93,</span><span id="lstnumberx1093.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1093.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">15,</span><span id="lstnumberx1093.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1093.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">72,</span><span id="lstnumberx1093.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1093.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">61,</span><span id="lstnumberx1093.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1093.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">21,</span><span id="lstnumberx1093.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1093.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">83,</span><span id="lstnumberx1093.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1093.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">87,</span><span id="lstnumberx1093.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1093.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">75]</span>
</div>
<div id="lstnumberx1094" class="ltx_listingline">
<span id="lstnumberx1094.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1094.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx1094.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx1094.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx1095" class="ltx_listingline">
<span id="lstnumberx1095.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1095.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1095.2.1" class="ltx_text ltx_lst_space"> </span>Set<span id="lstnumberx1095.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1095.2.3" class="ltx_text ltx_lst_space"> </span>random<span id="lstnumberx1095.2.4" class="ltx_text ltx_lst_space"> </span>seed<span id="lstnumberx1095.2.5" class="ltx_text ltx_lst_space"> </span>for<span id="lstnumberx1095.2.6" class="ltx_text ltx_lst_space"> </span>reproducibility</span>
</div>
<div id="lstnumberx1096" class="ltx_listingline">
<span id="lstnumberx1096.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1096.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1096.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1096.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx1096.5" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1096.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx1096.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1096.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx1096.9" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1097" class="ltx_listingline">
</div>
<div id="lstnumberx1098" class="ltx_listingline">
<span id="lstnumberx1098.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1098.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1098.2.1" class="ltx_text ltx_lst_space"> </span>Generate<span id="lstnumberx1098.2.2" class="ltx_text ltx_lst_space"> </span>a<span id="lstnumberx1098.2.3" class="ltx_text ltx_lst_space"> </span>2D<span id="lstnumberx1098.2.4" class="ltx_text ltx_lst_space"> </span>numpy<span id="lstnumberx1098.2.5" class="ltx_text ltx_lst_space"> </span>array<span id="lstnumberx1098.2.6" class="ltx_text ltx_lst_space"> </span>with<span id="lstnumberx1098.2.7" class="ltx_text ltx_lst_space"> </span>random<span id="lstnumberx1098.2.8" class="ltx_text ltx_lst_space"> </span>integers<span id="lstnumberx1098.2.9" class="ltx_text ltx_lst_space"> </span>between<span id="lstnumberx1098.2.10" class="ltx_text ltx_lst_space"> </span>1<span id="lstnumberx1098.2.11" class="ltx_text ltx_lst_space"> </span>and<span id="lstnumberx1098.2.12" class="ltx_text ltx_lst_space"> </span>100</span>
</div>
<div id="lstnumberx1099" class="ltx_listingline">
<span id="lstnumberx1099.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1099.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matrix</span><span id="lstnumberx1099.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1099.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1099.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1099.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1099.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1099.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx1099.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1099.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">randint</span><span id="lstnumberx1099.11" class="ltx_text ltx_font_typewriter">(1,</span><span id="lstnumberx1099.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1099.13" class="ltx_text ltx_font_typewriter">101,</span><span id="lstnumberx1099.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1099.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">size</span><span id="lstnumberx1099.16" class="ltx_text ltx_font_typewriter">=(</span><span id="lstnumberx1099.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dimension</span><span id="lstnumberx1099.18" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1099.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1099.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dimension</span><span id="lstnumberx1099.21" class="ltx_text ltx_font_typewriter">))</span>
</div>
<div id="lstnumberx1100" class="ltx_listingline">
</div>
<div id="lstnumberx1101" class="ltx_listingline">
<span id="lstnumberx1101.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1101.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1101.2.1" class="ltx_text ltx_lst_space"> </span>Flatten<span id="lstnumberx1101.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1101.2.3" class="ltx_text ltx_lst_space"> </span>matrix<span id="lstnumberx1101.2.4" class="ltx_text ltx_lst_space"> </span>to<span id="lstnumberx1101.2.5" class="ltx_text ltx_lst_space"> </span>a<span id="lstnumberx1101.2.6" class="ltx_text ltx_lst_space"> </span>list</span>
</div>
<div id="lstnumberx1102" class="ltx_listingline">
<span id="lstnumberx1102.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1102.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">flat_list</span><span id="lstnumberx1102.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1102.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1102.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1102.6" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">list</span><span id="lstnumberx1102.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1102.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">itertools</span><span id="lstnumberx1102.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1102.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">chain</span><span id="lstnumberx1102.11" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1102.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">from_iterable</span><span id="lstnumberx1102.13" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1102.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matrix</span><span id="lstnumberx1102.15" class="ltx_text ltx_font_typewriter">))</span>
</div>
<div id="lstnumberx1103" class="ltx_listingline">
</div>
<div id="lstnumberx1104" class="ltx_listingline">
<span id="lstnumberx1104.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1104.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx1104.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1104.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matrix</span><span id="lstnumberx1104.5" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1104.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1104.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">flat_list</span>
</div>
<div id="lstnumberx1105" class="ltx_listingline">
</div>
<div id="lstnumberx1106" class="ltx_listingline">
<span id="lstnumberx1106.1" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1106.1.1" class="ltx_text ltx_lst_space"> </span>Ground<span id="lstnumberx1106.1.2" class="ltx_text ltx_lst_space"> </span>Truth</span>
</div>
<div id="lstnumberx1107" class="ltx_listingline">
<span id="lstnumberx1107.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx1107.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1107.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx1107.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1107.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dimension</span><span id="lstnumberx1107.6" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1107.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1107.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx1107.9" class="ltx_text ltx_font_typewriter">=42):</span>
</div>
<div id="lstnumberx1108" class="ltx_listingline">
<span id="lstnumberx1108.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1108.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1108.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1108.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx1108.5" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1108.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx1108.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1108.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">seed</span><span id="lstnumberx1108.9" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx1108.10" class="ltx_text ltx_lst_space ltx_font_typewriter">  </span><span id="lstnumberx1108.11" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1108.11.1" class="ltx_text ltx_lst_space"> </span>Ensure<span id="lstnumberx1108.11.2" class="ltx_text ltx_lst_space"> </span>reproducible<span id="lstnumberx1108.11.3" class="ltx_text ltx_lst_space"> </span>results</span>
</div>
<div id="lstnumberx1109" class="ltx_listingline">
<span id="lstnumberx1109.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1109.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx1109.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1109.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dimension</span><span id="lstnumberx1109.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1109.6" class="ltx_text ltx_font_typewriter">&lt;=</span><span id="lstnumberx1109.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1109.8" class="ltx_text ltx_font_typewriter">0:</span>
</div>
<div id="lstnumberx1110" class="ltx_listingline">
<span id="lstnumberx1110.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1110.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">raise</span><span id="lstnumberx1110.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1110.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">ValueError</span><span id="lstnumberx1110.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1110.6" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"The<span id="lstnumberx1110.6.1" class="ltx_text ltx_lst_space"> </span>dimension<span id="lstnumberx1110.6.2" class="ltx_text ltx_lst_space"> </span>must<span id="lstnumberx1110.6.3" class="ltx_text ltx_lst_space"> </span>be<span id="lstnumberx1110.6.4" class="ltx_text ltx_lst_space"> </span>a<span id="lstnumberx1110.6.5" class="ltx_text ltx_lst_space"> </span>positive<span id="lstnumberx1110.6.6" class="ltx_text ltx_lst_space"> </span>integer"</span><span id="lstnumberx1110.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1111" class="ltx_listingline">
<span id="lstnumberx1111.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1111.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matrix</span><span id="lstnumberx1111.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1111.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1111.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1111.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1111.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1111.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">random</span><span id="lstnumberx1111.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1111.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">randint</span><span id="lstnumberx1111.11" class="ltx_text ltx_font_typewriter">(1,</span><span id="lstnumberx1111.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1111.13" class="ltx_text ltx_font_typewriter">101,</span><span id="lstnumberx1111.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1111.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">size</span><span id="lstnumberx1111.16" class="ltx_text ltx_font_typewriter">=(</span><span id="lstnumberx1111.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dimension</span><span id="lstnumberx1111.18" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1111.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1111.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dimension</span><span id="lstnumberx1111.21" class="ltx_text ltx_font_typewriter">))</span>
</div>
<div id="lstnumberx1112" class="ltx_listingline">
<span id="lstnumberx1112.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1112.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">flat_list</span><span id="lstnumberx1112.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1112.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1112.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1112.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matrix</span><span id="lstnumberx1112.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1112.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">flatten</span><span id="lstnumberx1112.9" class="ltx_text ltx_font_typewriter">().</span><span id="lstnumberx1112.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tolist</span><span id="lstnumberx1112.11" class="ltx_text ltx_font_typewriter">()</span>
</div>
<div id="lstnumberx1113" class="ltx_listingline">
<span id="lstnumberx1113.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1113.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx1113.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1113.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">matrix</span><span id="lstnumberx1113.5" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1113.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1113.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">flat_list</span>
</div>
</div>
</div>
<div id="A10.p18" class="ltx_para ltx_noindent">
<p id="A10.p18.1" class="ltx_p"><span id="A10.p18.1.1" class="ltx_text ltx_font_bold">Example 10</span>: This is another example where the model chooses to use the wrong function. Here, it uses <span id="A10.p18.1.2" class="ltx_text ltx_font_typewriter">np.mean</span> instead of <span id="A10.p18.1.3" class="ltx_text ltx_font_typewriter">np.nanmean</span> (which the ground truth solution uses). This leads to the failure of a test with incomplete data.</p>
</div>
<div id="A10.p19" class="ltx_para ltx_noindent">
<div id="A10.p19.1" class="ltx_listing ltx_lst_language_python ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,aW1wb3J0IHBhbmRhcyBhcyBwZAppbXBvcnQgbnVtcHkgYXMgbnAKaW1wb3J0IGl0ZXJ0b29scwpkZWYgdGFza19mdW5jKGRhdGFfbGlzdD1bKCdhJywgMSwgMi4xKSwgKCdiJywgMiwgMy4yKSwgKCdjJywgMywgNC4zKSwgKCdkJywgNCwgNS40KSwgKCdlJywgNSwgNi41KV0pOgogICAgIiIiCiAgICBDYWxjdWxhdGUgdGhlIG1lYW4gb2YgbnVtZXJpY2FsIHZhbHVlcyBpbiBlYWNoIHBvc2l0aW9uIGFjcm9zcyB0dXBsZXMgaW4gYSBsaXN0LgogICAgTm9uLW51bWVyaWMgdmFsdWVzIGFyZSBpZ25vcmVkLCBhbmQgbWVhbnMgYXJlIGNvbXB1dGVkIG9ubHkgZnJvbSBhdmFpbGFibGUgZGF0YS4KICAgIFRoYXQgbWVhbnMgdGhhdCBtaXNzaW5nIGRhdGEgaW4gc29tZSBvZiB0aGUgdHVwbGVzIGlzIHNpbXBseSBpZ25vcmVkLgoKICAgIEEgRGF0YUZyYW1lIHdpdGggb25lIGNvbHVtbnMgbmFtZWQgJ01lYW4gVmFsdWUnIHdoaWNoIGNvbnRhaW5zIHRoZSBtZWFuIHZhbHVlcyBmb3IgYWxsIHR1cGxlIHBvc2l0aW9ucy4KICAgIFRoZSBpbmRleCBpcyBhY2NvcmRpbmcgdG8gdGhpcyBzY2hlbWU6ICdQb3NpdGlvbiBpJyB3aGVyZSBpIGlzIHRoZSBjdXJyZW50IHBvc2l0aW9uLgogICAgSWYgYW4gZW1wdHkgbGlzdCBpcyBwYXNzZWQsIHRoZW4gYW4gZW1wdHkgRGF0YUZyYW1lIGlzIHJldHVybmVkLgoKICAgIFBhcmFtZXRlcnM6CiAgICBkYXRhX2xpc3QgKGxpc3Qgb2YgdHVwbGVzKTogQSBsaXN0IGNvbnRhaW5pbmcgdHVwbGVzIG9mIG1peGVkIGRhdGEgdHlwZXMgKHN0cmluZywgaW50LCBmbG9hdCwgZXRjLikuCiAgICAgICAgRGVmYXVsdHMgdG8gWygnYScsIDEsIDIuMSksICgnYicsIDIsIDMuMiksICgnYycsIDMsIDQuMyksICgnZCcsIDQsIDUuNCksICgnZScsIDUsIDYuNSldCgogICAgUmV0dXJuczoKICAgIERhdGFGcmFtZTogQSBwYW5kYXMgRGF0YUZyYW1lIHdpdGggdGhlIG1lYW4gdmFsdWVzIG9mIHRoZSBudW1lcmljYWwgZGF0YSBhdCBlYWNoIHBvc2l0aW9uLgoKICAgIFJlcXVpcmVtZW50czoKICAgIC0gcGFuZGFzCiAgICAtIG51bXB5CiAgICAtIGl0ZXJ0b29scwoKICAgIEV4YW1wbGU6CiAgICA+Pj4gZGYgPSB0YXNrX2Z1bmMoKQogICAgPj4+IHByaW50KGRmKQogICAgICAgICAgICAgICAgTWVhbiBWYWx1ZQogICAgUG9zaXRpb24gMCAgICAgICAgIE5hTgogICAgUG9zaXRpb24gMSAgICAgICAgIDMuMAogICAgUG9zaXRpb24gMiAgICAgICAgIDQuMwoKICAgID4+PiBkYXRhID0gWygnYScsICcxJywgMi4xKSwgKCdiJywgMjEsICdjJyksICgxMiwgMywgNC4zKSwgKFsnZCddLCA0LCA1LjQpLCAoJ2UnLCA1LCA2LjUpXQogICAgPj4+IGRmID0gdGFza19mdW5jKGRhdGEpCiAgICA+Pj4gcHJpbnQoZGYpCiAgICAgICAgICAgICAgICBNZWFuIFZhbHVlCiAgICBQb3NpdGlvbiAwICAgICAgICAgTmFOCiAgICBQb3NpdGlvbiAxICAgICAgICAgOC4yNQogICAgUG9zaXRpb24gMiAgICAgICAgIDQuMwogICAgIiIiCiAgICBpZiBub3QgZGF0YV9saXN0OgogICAgICAgIHJldHVybiBwZC5EYXRhRnJhbWUoY29sdW1ucz1bJ01lYW4gVmFsdWUnXSkKCiAgICAjIFRyYW5zcG9zZSB0aGUgbGlzdCBvZiB0dXBsZXMgdG8gZ2V0IGNvbHVtbnMKICAgIHRyYW5zcG9zZWQgPSBsaXN0KGl0ZXJ0b29scy56aXBfbG9uZ2VzdCgqZGF0YV9saXN0LCBmaWxsdmFsdWU9bnAubmFuKSkKCiAgICBtZWFucyA9IFtdCiAgICBmb3IgY29sIGluIHRyYW5zcG9zZWQ6CiAgICAgICAgIyBGaWx0ZXIgb3V0IG5vbi1udW1lcmljIHZhbHVlcwogICAgICAgIG51bWVyaWNfdmFsdWVzID0gW3ggZm9yIHggaW4gY29sIGlmIGlzaW5zdGFuY2UoeCwgKGludCwgZmxvYXQpKV0KICAgICAgICBpZiBudW1lcmljX3ZhbHVlczoKICAgICAgICAgICAgbWVhbl92YWx1ZSA9IG5wLm1lYW4obnVtZXJpY192YWx1ZXMpCiAgICAgICAgZWxzZToKICAgICAgICAgICAgbWVhbl92YWx1ZSA9IG5wLm5hbgogICAgICAgIG1lYW5zLmFwcGVuZChtZWFuX3ZhbHVlKQoKICAgICMgQ3JlYXRlIHRoZSBEYXRhRnJhbWUKICAgIGluZGV4ID0gW2YnUG9zaXRpb24ge2l9JyBmb3IgaSBpbiByYW5nZShsZW4obWVhbnMpKV0KICAgIGRmID0gcGQuRGF0YUZyYW1lKG1lYW5zLCBpbmRleD1pbmRleCwgY29sdW1ucz1bJ01lYW4gVmFsdWUnXSkKCiAgICByZXR1cm4gZGYKCiMgR3JvdW5kIFRydXRoIFNvbHV0aW9uCmRlZiB0YXNrX2Z1bmMoZGF0YV9saXN0PVsoJ2EnLCAxLCAyLjEpLCAoJ2InLCAyLCAzLjIpLCAoJ2MnLCAzLCA0LjMpLCAoJ2QnLCA0LCA1LjQpLCAoJ2UnLCA1LCA2LjUpXSk6CiAgICB1bnppcHBlZF9kYXRhID0gbGlzdChpdGVydG9vbHMuemlwX2xvbmdlc3QoKmRhdGFfbGlzdCwgZmlsbHZhbHVlPW5wLm5hbikpCiAgICBtZWFuX3ZhbHVlcyA9IFtdCiAgICBmb3IgY29sdW1uIGluIHVuemlwcGVkX2RhdGFbOl06CiAgICAgICAgbnVtZXJpY192YWx1ZXMgPSBbdmFsIGZvciB2YWwgaW4gY29sdW1uIGlmIGlzaW5zdGFuY2UodmFsLCAoaW50LCBmbG9hdCkpXQogICAgICAgIGlmIG51bWVyaWNfdmFsdWVzOgogICAgICAgICAgICBtZWFuX3ZhbHVlcy5hcHBlbmQobnAubmFubWVhbihudW1lcmljX3ZhbHVlcykpCiAgICAgICAgZWxzZToKICAgICAgICAgICAgbWVhbl92YWx1ZXMuYXBwZW5kKG5wLm5hbikKICAgIGRmID0gcGQuRGF0YUZyYW1lKG1lYW5fdmFsdWVzLCBjb2x1bW5zPVsnTWVhbiBWYWx1ZSddLAogICAgICAgICAgICAgICAgICAgICAgaW5kZXg9WydQb3NpdGlvbiB7fScuZm9ybWF0KGkpIGZvciBpIGluIHJhbmdlKGxlbihtZWFuX3ZhbHVlcykpXSkKICAgIHJldHVybiBkZg==" download="">⬇</a></div>
<div id="lstnumberx1114" class="ltx_listingline">
<span id="lstnumberx1114.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx1114.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1114.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pandas</span><span id="lstnumberx1114.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1114.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx1114.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1114.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pd</span>
</div>
<div id="lstnumberx1115" class="ltx_listingline">
<span id="lstnumberx1115.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx1115.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1115.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numpy</span><span id="lstnumberx1115.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1115.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">as</span><span id="lstnumberx1115.6" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1115.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span>
</div>
<div id="lstnumberx1116" class="ltx_listingline">
<span id="lstnumberx1116.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">import</span><span id="lstnumberx1116.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1116.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">itertools</span>
</div>
<div id="lstnumberx1117" class="ltx_listingline">
<span id="lstnumberx1117.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx1117.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx1117.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1117.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx1117.6" class="ltx_text ltx_font_typewriter">=[(</span><span id="lstnumberx1117.7" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’a’</span><span id="lstnumberx1117.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1117.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.10" class="ltx_text ltx_font_typewriter">1,</span><span id="lstnumberx1117.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.12" class="ltx_text ltx_font_typewriter">2.1),</span><span id="lstnumberx1117.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.14" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1117.15" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’b’</span><span id="lstnumberx1117.16" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1117.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.18" class="ltx_text ltx_font_typewriter">2,</span><span id="lstnumberx1117.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.20" class="ltx_text ltx_font_typewriter">3.2),</span><span id="lstnumberx1117.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.22" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1117.23" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’c’</span><span id="lstnumberx1117.24" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1117.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.26" class="ltx_text ltx_font_typewriter">3,</span><span id="lstnumberx1117.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.28" class="ltx_text ltx_font_typewriter">4.3),</span><span id="lstnumberx1117.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.30" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1117.31" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’d’</span><span id="lstnumberx1117.32" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1117.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.34" class="ltx_text ltx_font_typewriter">4,</span><span id="lstnumberx1117.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.36" class="ltx_text ltx_font_typewriter">5.4),</span><span id="lstnumberx1117.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.38" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1117.39" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’e’</span><span id="lstnumberx1117.40" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1117.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.42" class="ltx_text ltx_font_typewriter">5,</span><span id="lstnumberx1117.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1117.44" class="ltx_text ltx_font_typewriter">6.5)]):</span>
</div>
<div id="lstnumberx1118" class="ltx_listingline">
<span id="lstnumberx1118.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1118.2" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">""</span><span id="lstnumberx1118.3" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">"</span>
</div>
<div id="lstnumberx1119" class="ltx_listingline">
<span id="lstnumberx1119.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1119.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Calculate</span><span id="lstnumberx1119.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1119.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">mean</span><span id="lstnumberx1119.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1119.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numerical</span><span id="lstnumberx1119.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx1119.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx1119.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx1119.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">position</span><span id="lstnumberx1119.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">across</span><span id="lstnumberx1119.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples</span><span id="lstnumberx1119.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx1119.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">a</span><span id="lstnumberx1119.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1119.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list.</span>
</div>
<div id="lstnumberx1120" class="ltx_listingline">
<span id="lstnumberx1120.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1120.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Non-numeric</span><span id="lstnumberx1120.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx1120.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">are</span><span id="lstnumberx1120.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ignored,</span><span id="lstnumberx1120.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">and</span><span id="lstnumberx1120.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">means</span><span id="lstnumberx1120.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">are</span><span id="lstnumberx1120.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">computed</span><span id="lstnumberx1120.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">only</span><span id="lstnumberx1120.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">from</span><span id="lstnumberx1120.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">available</span><span id="lstnumberx1120.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1120.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data.</span>
</div>
<div id="lstnumberx1121" class="ltx_listingline">
<span id="lstnumberx1121.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1121.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">That</span><span id="lstnumberx1121.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">means</span><span id="lstnumberx1121.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">that</span><span id="lstnumberx1121.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">missing</span><span id="lstnumberx1121.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx1121.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">in</span><span id="lstnumberx1121.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">some</span><span id="lstnumberx1121.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1121.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1121.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples</span><span id="lstnumberx1121.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx1121.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">simply</span><span id="lstnumberx1121.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1121.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">ignored.</span>
</div>
<div id="lstnumberx1122" class="ltx_listingline">
</div>
<div id="lstnumberx1123" class="ltx_listingline">
<span id="lstnumberx1123.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1123.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx1123.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">DataFrame</span><span id="lstnumberx1123.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx1123.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">one</span><span id="lstnumberx1123.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">columns</span><span id="lstnumberx1123.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">named</span><span id="lstnumberx1123.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’Mean</span><span id="lstnumberx1123.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Value’</span><span id="lstnumberx1123.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">which</span><span id="lstnumberx1123.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">contains</span><span id="lstnumberx1123.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1123.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">mean</span><span id="lstnumberx1123.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx1123.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">for</span><span id="lstnumberx1123.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">all</span><span id="lstnumberx1123.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuple</span><span id="lstnumberx1123.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1123.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">positions.</span>
</div>
<div id="lstnumberx1124" class="ltx_listingline">
<span id="lstnumberx1124.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1124.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">The</span><span id="lstnumberx1124.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">index</span><span id="lstnumberx1124.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx1124.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">according</span><span id="lstnumberx1124.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx1124.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">this</span><span id="lstnumberx1124.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">scheme:</span><span id="lstnumberx1124.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’Position</span><span id="lstnumberx1124.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">i’</span><span id="lstnumberx1124.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">where</span><span id="lstnumberx1124.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">i</span><span id="lstnumberx1124.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx1124.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1124.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">current</span><span id="lstnumberx1124.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1124.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">position.</span>
</div>
<div id="lstnumberx1125" class="ltx_listingline">
<span id="lstnumberx1125.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1125.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">If</span><span id="lstnumberx1125.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">an</span><span id="lstnumberx1125.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">empty</span><span id="lstnumberx1125.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx1125.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx1125.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">passed,</span><span id="lstnumberx1125.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">then</span><span id="lstnumberx1125.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">an</span><span id="lstnumberx1125.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">empty</span><span id="lstnumberx1125.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">DataFrame</span><span id="lstnumberx1125.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">is</span><span id="lstnumberx1125.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1125.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">returned.</span>
</div>
<div id="lstnumberx1126" class="ltx_listingline">
</div>
<div id="lstnumberx1127" class="ltx_listingline">
<span id="lstnumberx1127.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1127.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Parameters:</span>
</div>
<div id="lstnumberx1128" class="ltx_listingline">
<span id="lstnumberx1128.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1128.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data_list</span><span id="lstnumberx1128.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(list</span><span id="lstnumberx1128.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1128.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples):</span><span id="lstnumberx1128.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx1128.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">list</span><span id="lstnumberx1128.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">containing</span><span id="lstnumberx1128.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">tuples</span><span id="lstnumberx1128.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1128.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">mixed</span><span id="lstnumberx1128.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx1128.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">types</span><span id="lstnumberx1128.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(string,</span><span id="lstnumberx1128.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">int,</span><span id="lstnumberx1128.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">float,</span><span id="lstnumberx1128.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1128.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">etc.).</span>
</div>
<div id="lstnumberx1129" class="ltx_listingline">
<span id="lstnumberx1129.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">        </span><span id="lstnumberx1129.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Defaults</span><span id="lstnumberx1129.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">to</span><span id="lstnumberx1129.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">[(’a’,</span><span id="lstnumberx1129.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">1,</span><span id="lstnumberx1129.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2.1),</span><span id="lstnumberx1129.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’b’,</span><span id="lstnumberx1129.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2,</span><span id="lstnumberx1129.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3.2),</span><span id="lstnumberx1129.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’c’,</span><span id="lstnumberx1129.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx1129.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4.3),</span><span id="lstnumberx1129.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’d’,</span><span id="lstnumberx1129.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4,</span><span id="lstnumberx1129.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">5.4),</span><span id="lstnumberx1129.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’e’,</span><span id="lstnumberx1129.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">5,</span><span id="lstnumberx1129.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1129.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">6.5)]</span>
</div>
<div id="lstnumberx1130" class="ltx_listingline">
</div>
<div id="lstnumberx1131" class="ltx_listingline">
<span id="lstnumberx1131.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1131.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Returns:</span>
</div>
<div id="lstnumberx1132" class="ltx_listingline">
<span id="lstnumberx1132.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1132.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">DataFrame:</span><span id="lstnumberx1132.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">A</span><span id="lstnumberx1132.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pandas</span><span id="lstnumberx1132.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">DataFrame</span><span id="lstnumberx1132.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">with</span><span id="lstnumberx1132.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1132.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">mean</span><span id="lstnumberx1132.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">values</span><span id="lstnumberx1132.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">of</span><span id="lstnumberx1132.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">the</span><span id="lstnumberx1132.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numerical</span><span id="lstnumberx1132.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx1132.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">at</span><span id="lstnumberx1132.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">each</span><span id="lstnumberx1132.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1132.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">position.</span>
</div>
<div id="lstnumberx1133" class="ltx_listingline">
</div>
<div id="lstnumberx1134" class="ltx_listingline">
<span id="lstnumberx1134.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1134.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Requirements:</span>
</div>
<div id="lstnumberx1135" class="ltx_listingline">
<span id="lstnumberx1135.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1135.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1135.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1135.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">pandas</span>
</div>
<div id="lstnumberx1136" class="ltx_listingline">
<span id="lstnumberx1136.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1136.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1136.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1136.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">numpy</span>
</div>
<div id="lstnumberx1137" class="ltx_listingline">
<span id="lstnumberx1137.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1137.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">-</span><span id="lstnumberx1137.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1137.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">itertools</span>
</div>
<div id="lstnumberx1138" class="ltx_listingline">
</div>
<div id="lstnumberx1139" class="ltx_listingline">
<span id="lstnumberx1139.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1139.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Example:</span>
</div>
<div id="lstnumberx1140" class="ltx_listingline">
<span id="lstnumberx1140.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1140.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1140.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1140.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">df</span><span id="lstnumberx1140.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1140.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx1140.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1140.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func()</span>
</div>
<div id="lstnumberx1141" class="ltx_listingline">
<span id="lstnumberx1141.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1141.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1141.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1141.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">print(df)</span>
</div>
<div id="lstnumberx1142" class="ltx_listingline">
<span id="lstnumberx1142.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">                </span><span id="lstnumberx1142.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Mean</span><span id="lstnumberx1142.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1142.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Value</span>
</div>
<div id="lstnumberx1143" class="ltx_listingline">
<span id="lstnumberx1143.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1143.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Position</span><span id="lstnumberx1143.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1143.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">0</span><span id="lstnumberx1143.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">         </span><span id="lstnumberx1143.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">NaN</span>
</div>
<div id="lstnumberx1144" class="ltx_listingline">
<span id="lstnumberx1144.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1144.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Position</span><span id="lstnumberx1144.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1144.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">1</span><span id="lstnumberx1144.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">         </span><span id="lstnumberx1144.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3.0</span>
</div>
<div id="lstnumberx1145" class="ltx_listingline">
<span id="lstnumberx1145.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1145.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Position</span><span id="lstnumberx1145.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1145.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2</span><span id="lstnumberx1145.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">         </span><span id="lstnumberx1145.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4.3</span>
</div>
<div id="lstnumberx1146" class="ltx_listingline">
</div>
<div id="lstnumberx1147" class="ltx_listingline">
<span id="lstnumberx1147.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1147.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1147.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">data</span><span id="lstnumberx1147.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx1147.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">[(’a’,</span><span id="lstnumberx1147.9" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.10" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’1’,</span><span id="lstnumberx1147.11" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.12" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2.1),</span><span id="lstnumberx1147.13" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.14" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’b’,</span><span id="lstnumberx1147.15" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.16" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">21,</span><span id="lstnumberx1147.17" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.18" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">’c’),</span><span id="lstnumberx1147.19" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.20" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(12,</span><span id="lstnumberx1147.21" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.22" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">3,</span><span id="lstnumberx1147.23" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.24" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4.3),</span><span id="lstnumberx1147.25" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.26" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">([’d’],</span><span id="lstnumberx1147.27" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.28" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4,</span><span id="lstnumberx1147.29" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.30" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">5.4),</span><span id="lstnumberx1147.31" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.32" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">(’e’,</span><span id="lstnumberx1147.33" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.34" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">5,</span><span id="lstnumberx1147.35" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1147.36" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">6.5)]</span>
</div>
<div id="lstnumberx1148" class="ltx_listingline">
<span id="lstnumberx1148.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1148.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1148.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1148.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">df</span><span id="lstnumberx1148.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1148.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">=</span><span id="lstnumberx1148.7" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1148.8" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">task_func(data)</span>
</div>
<div id="lstnumberx1149" class="ltx_listingline">
<span id="lstnumberx1149.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1149.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">&gt;&gt;&gt;</span><span id="lstnumberx1149.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1149.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">print(df)</span>
</div>
<div id="lstnumberx1150" class="ltx_listingline">
<span id="lstnumberx1150.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">                </span><span id="lstnumberx1150.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Mean</span><span id="lstnumberx1150.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1150.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Value</span>
</div>
<div id="lstnumberx1151" class="ltx_listingline">
<span id="lstnumberx1151.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1151.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Position</span><span id="lstnumberx1151.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1151.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">0</span><span id="lstnumberx1151.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">         </span><span id="lstnumberx1151.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">NaN</span>
</div>
<div id="lstnumberx1152" class="ltx_listingline">
<span id="lstnumberx1152.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1152.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Position</span><span id="lstnumberx1152.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1152.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">1</span><span id="lstnumberx1152.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">         </span><span id="lstnumberx1152.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">8.25</span>
</div>
<div id="lstnumberx1153" class="ltx_listingline">
<span id="lstnumberx1153.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1153.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">Position</span><span id="lstnumberx1153.3" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;"> </span><span id="lstnumberx1153.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">2</span><span id="lstnumberx1153.5" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">         </span><span id="lstnumberx1153.6" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">4.3</span>
</div>
<div id="lstnumberx1154" class="ltx_listingline">
<span id="lstnumberx1154.1" class="ltx_text ltx_lst_space ltx_font_typewriter" style="color:#9400D1;">    </span><span id="lstnumberx1154.2" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">"</span><span id="lstnumberx1154.3" class="ltx_text ltx_lst_string"></span><span id="lstnumberx1154.4" class="ltx_text ltx_font_typewriter" style="color:#9400D1;">""</span>
</div>
<div id="lstnumberx1155" class="ltx_listingline">
<span id="lstnumberx1155.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1155.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx1155.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1155.4" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">not</span><span id="lstnumberx1155.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1155.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx1155.7" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1156" class="ltx_listingline">
<span id="lstnumberx1156.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1156.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx1156.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1156.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pd</span><span id="lstnumberx1156.5" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1156.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">DataFrame</span><span id="lstnumberx1156.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1156.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">columns</span><span id="lstnumberx1156.9" class="ltx_text ltx_font_typewriter">=[</span><span id="lstnumberx1156.10" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Mean<span id="lstnumberx1156.10.1" class="ltx_text ltx_lst_space"> </span>Value’</span><span id="lstnumberx1156.11" class="ltx_text ltx_font_typewriter">])</span>
</div>
<div id="lstnumberx1157" class="ltx_listingline">
</div>
<div id="lstnumberx1158" class="ltx_listingline">
<span id="lstnumberx1158.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1158.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1158.2.1" class="ltx_text ltx_lst_space"> </span>Transpose<span id="lstnumberx1158.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1158.2.3" class="ltx_text ltx_lst_space"> </span>list<span id="lstnumberx1158.2.4" class="ltx_text ltx_lst_space"> </span>of<span id="lstnumberx1158.2.5" class="ltx_text ltx_lst_space"> </span>tuples<span id="lstnumberx1158.2.6" class="ltx_text ltx_lst_space"> </span>to<span id="lstnumberx1158.2.7" class="ltx_text ltx_lst_space"> </span>get<span id="lstnumberx1158.2.8" class="ltx_text ltx_lst_space"> </span>columns</span>
</div>
<div id="lstnumberx1159" class="ltx_listingline">
<span id="lstnumberx1159.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1159.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">transposed</span><span id="lstnumberx1159.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1159.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1159.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1159.6" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">list</span><span id="lstnumberx1159.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1159.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">itertools</span><span id="lstnumberx1159.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1159.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">zip_longest</span><span id="lstnumberx1159.11" class="ltx_text ltx_font_typewriter">(*</span><span id="lstnumberx1159.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx1159.13" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1159.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1159.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">fillvalue</span><span id="lstnumberx1159.16" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1159.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1159.18" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1159.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">nan</span><span id="lstnumberx1159.20" class="ltx_text ltx_font_typewriter">))</span>
</div>
<div id="lstnumberx1160" class="ltx_listingline">
</div>
<div id="lstnumberx1161" class="ltx_listingline">
<span id="lstnumberx1161.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1161.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">means</span><span id="lstnumberx1161.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1161.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1161.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1161.6" class="ltx_text ltx_font_typewriter">[]</span>
</div>
<div id="lstnumberx1162" class="ltx_listingline">
<span id="lstnumberx1162.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1162.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx1162.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1162.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">col</span><span id="lstnumberx1162.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1162.6" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx1162.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1162.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">transposed</span><span id="lstnumberx1162.9" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1163" class="ltx_listingline">
<span id="lstnumberx1163.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1163.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1163.2.1" class="ltx_text ltx_lst_space"> </span>Filter<span id="lstnumberx1163.2.2" class="ltx_text ltx_lst_space"> </span>out<span id="lstnumberx1163.2.3" class="ltx_text ltx_lst_space"> </span>non-numeric<span id="lstnumberx1163.2.4" class="ltx_text ltx_lst_space"> </span>values</span>
</div>
<div id="lstnumberx1164" class="ltx_listingline">
<span id="lstnumberx1164.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1164.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numeric_values</span><span id="lstnumberx1164.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1164.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.6" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1164.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">x</span><span id="lstnumberx1164.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.9" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx1164.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">x</span><span id="lstnumberx1164.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.13" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx1164.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">col</span><span id="lstnumberx1164.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.17" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx1164.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.19" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">isinstance</span><span id="lstnumberx1164.20" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1164.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">x</span><span id="lstnumberx1164.22" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1164.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.24" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1164.25" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">int</span><span id="lstnumberx1164.26" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1164.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1164.28" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">float</span><span id="lstnumberx1164.29" class="ltx_text ltx_font_typewriter">))]</span>
</div>
<div id="lstnumberx1165" class="ltx_listingline">
<span id="lstnumberx1165.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1165.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx1165.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1165.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numeric_values</span><span id="lstnumberx1165.5" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1166" class="ltx_listingline">
<span id="lstnumberx1166.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx1166.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mean_value</span><span id="lstnumberx1166.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1166.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1166.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1166.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1166.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1166.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mean</span><span id="lstnumberx1166.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1166.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numeric_values</span><span id="lstnumberx1166.11" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1167" class="ltx_listingline">
<span id="lstnumberx1167.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1167.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">else</span><span id="lstnumberx1167.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1168" class="ltx_listingline">
<span id="lstnumberx1168.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx1168.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mean_value</span><span id="lstnumberx1168.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1168.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1168.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1168.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1168.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1168.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">nan</span>
</div>
<div id="lstnumberx1169" class="ltx_listingline">
<span id="lstnumberx1169.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1169.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">means</span><span id="lstnumberx1169.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1169.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">append</span><span id="lstnumberx1169.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1169.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mean_value</span><span id="lstnumberx1169.7" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1170" class="ltx_listingline">
</div>
<div id="lstnumberx1171" class="ltx_listingline">
<span id="lstnumberx1171.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1171.2" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1171.2.1" class="ltx_text ltx_lst_space"> </span>Create<span id="lstnumberx1171.2.2" class="ltx_text ltx_lst_space"> </span>the<span id="lstnumberx1171.2.3" class="ltx_text ltx_lst_space"> </span>DataFrame</span>
</div>
<div id="lstnumberx1172" class="ltx_listingline">
<span id="lstnumberx1172.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1172.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">index</span><span id="lstnumberx1172.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1172.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1172.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1172.6" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1172.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">f</span><span id="lstnumberx1172.8" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Position<span id="lstnumberx1172.8.1" class="ltx_text ltx_lst_space"> </span>{i}’</span><span id="lstnumberx1172.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1172.10" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx1172.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1172.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">i</span><span id="lstnumberx1172.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1172.14" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx1172.15" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1172.16" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">range</span><span id="lstnumberx1172.17" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1172.18" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">len</span><span id="lstnumberx1172.19" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1172.20" class="ltx_text ltx_lst_identifier ltx_font_typewriter">means</span><span id="lstnumberx1172.21" class="ltx_text ltx_font_typewriter">))]</span>
</div>
<div id="lstnumberx1173" class="ltx_listingline">
<span id="lstnumberx1173.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1173.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">df</span><span id="lstnumberx1173.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1173.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1173.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1173.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pd</span><span id="lstnumberx1173.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1173.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">DataFrame</span><span id="lstnumberx1173.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1173.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">means</span><span id="lstnumberx1173.11" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1173.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1173.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">index</span><span id="lstnumberx1173.14" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1173.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">index</span><span id="lstnumberx1173.16" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1173.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1173.18" class="ltx_text ltx_lst_identifier ltx_font_typewriter">columns</span><span id="lstnumberx1173.19" class="ltx_text ltx_font_typewriter">=[</span><span id="lstnumberx1173.20" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Mean<span id="lstnumberx1173.20.1" class="ltx_text ltx_lst_space"> </span>Value’</span><span id="lstnumberx1173.21" class="ltx_text ltx_font_typewriter">])</span>
</div>
<div id="lstnumberx1174" class="ltx_listingline">
</div>
<div id="lstnumberx1175" class="ltx_listingline">
<span id="lstnumberx1175.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1175.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx1175.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1175.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">df</span>
</div>
<div id="lstnumberx1176" class="ltx_listingline">
</div>
<div id="lstnumberx1177" class="ltx_listingline">
<span id="lstnumberx1177.1" class="ltx_text ltx_lst_comment ltx_font_typewriter" style="color:#009900;">#<span id="lstnumberx1177.1.1" class="ltx_text ltx_lst_space"> </span>Ground<span id="lstnumberx1177.1.2" class="ltx_text ltx_lst_space"> </span>Truth<span id="lstnumberx1177.1.3" class="ltx_text ltx_lst_space"> </span>Solution</span>
</div>
<div id="lstnumberx1178" class="ltx_listingline">
<span id="lstnumberx1178.1" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">def</span><span id="lstnumberx1178.2" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">task_func</span><span id="lstnumberx1178.4" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1178.5" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx1178.6" class="ltx_text ltx_font_typewriter">=[(</span><span id="lstnumberx1178.7" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’a’</span><span id="lstnumberx1178.8" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1178.9" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.10" class="ltx_text ltx_font_typewriter">1,</span><span id="lstnumberx1178.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.12" class="ltx_text ltx_font_typewriter">2.1),</span><span id="lstnumberx1178.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.14" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1178.15" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’b’</span><span id="lstnumberx1178.16" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1178.17" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.18" class="ltx_text ltx_font_typewriter">2,</span><span id="lstnumberx1178.19" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.20" class="ltx_text ltx_font_typewriter">3.2),</span><span id="lstnumberx1178.21" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.22" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1178.23" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’c’</span><span id="lstnumberx1178.24" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1178.25" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.26" class="ltx_text ltx_font_typewriter">3,</span><span id="lstnumberx1178.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.28" class="ltx_text ltx_font_typewriter">4.3),</span><span id="lstnumberx1178.29" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.30" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1178.31" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’d’</span><span id="lstnumberx1178.32" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1178.33" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.34" class="ltx_text ltx_font_typewriter">4,</span><span id="lstnumberx1178.35" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.36" class="ltx_text ltx_font_typewriter">5.4),</span><span id="lstnumberx1178.37" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.38" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1178.39" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’e’</span><span id="lstnumberx1178.40" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1178.41" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.42" class="ltx_text ltx_font_typewriter">5,</span><span id="lstnumberx1178.43" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1178.44" class="ltx_text ltx_font_typewriter">6.5)]):</span>
</div>
<div id="lstnumberx1179" class="ltx_listingline">
<span id="lstnumberx1179.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1179.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unzipped_data</span><span id="lstnumberx1179.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1179.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1179.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1179.6" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">list</span><span id="lstnumberx1179.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1179.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">itertools</span><span id="lstnumberx1179.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1179.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">zip_longest</span><span id="lstnumberx1179.11" class="ltx_text ltx_font_typewriter">(*</span><span id="lstnumberx1179.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">data_list</span><span id="lstnumberx1179.13" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1179.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1179.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">fillvalue</span><span id="lstnumberx1179.16" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1179.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1179.18" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1179.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">nan</span><span id="lstnumberx1179.20" class="ltx_text ltx_font_typewriter">))</span>
</div>
<div id="lstnumberx1180" class="ltx_listingline">
<span id="lstnumberx1180.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1180.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mean_values</span><span id="lstnumberx1180.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1180.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1180.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1180.6" class="ltx_text ltx_font_typewriter">[]</span>
</div>
<div id="lstnumberx1181" class="ltx_listingline">
<span id="lstnumberx1181.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1181.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx1181.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1181.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">column</span><span id="lstnumberx1181.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1181.6" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx1181.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1181.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">unzipped_data</span><span id="lstnumberx1181.9" class="ltx_text ltx_font_typewriter">[:]:</span>
</div>
<div id="lstnumberx1182" class="ltx_listingline">
<span id="lstnumberx1182.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1182.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numeric_values</span><span id="lstnumberx1182.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1182.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.6" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1182.7" class="ltx_text ltx_lst_identifier ltx_font_typewriter">val</span><span id="lstnumberx1182.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.9" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx1182.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">val</span><span id="lstnumberx1182.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.13" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx1182.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">column</span><span id="lstnumberx1182.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.17" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx1182.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.19" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">isinstance</span><span id="lstnumberx1182.20" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1182.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">val</span><span id="lstnumberx1182.22" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1182.23" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.24" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1182.25" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">int</span><span id="lstnumberx1182.26" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1182.27" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1182.28" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">float</span><span id="lstnumberx1182.29" class="ltx_text ltx_font_typewriter">))]</span>
</div>
<div id="lstnumberx1183" class="ltx_listingline">
<span id="lstnumberx1183.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1183.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">if</span><span id="lstnumberx1183.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1183.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numeric_values</span><span id="lstnumberx1183.5" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1184" class="ltx_listingline">
<span id="lstnumberx1184.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx1184.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mean_values</span><span id="lstnumberx1184.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1184.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">append</span><span id="lstnumberx1184.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1184.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1184.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1184.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">nanmean</span><span id="lstnumberx1184.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1184.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">numeric_values</span><span id="lstnumberx1184.11" class="ltx_text ltx_font_typewriter">))</span>
</div>
<div id="lstnumberx1185" class="ltx_listingline">
<span id="lstnumberx1185.1" class="ltx_text ltx_lst_space ltx_font_typewriter">        </span><span id="lstnumberx1185.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">else</span><span id="lstnumberx1185.3" class="ltx_text ltx_font_typewriter">:</span>
</div>
<div id="lstnumberx1186" class="ltx_listingline">
<span id="lstnumberx1186.1" class="ltx_text ltx_lst_space ltx_font_typewriter">            </span><span id="lstnumberx1186.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mean_values</span><span id="lstnumberx1186.3" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1186.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">append</span><span id="lstnumberx1186.5" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1186.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">np</span><span id="lstnumberx1186.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1186.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">nan</span><span id="lstnumberx1186.9" class="ltx_text ltx_font_typewriter">)</span>
</div>
<div id="lstnumberx1187" class="ltx_listingline">
<span id="lstnumberx1187.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1187.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">df</span><span id="lstnumberx1187.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1187.4" class="ltx_text ltx_font_typewriter">=</span><span id="lstnumberx1187.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1187.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">pd</span><span id="lstnumberx1187.7" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1187.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">DataFrame</span><span id="lstnumberx1187.9" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1187.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mean_values</span><span id="lstnumberx1187.11" class="ltx_text ltx_font_typewriter">,</span><span id="lstnumberx1187.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1187.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">columns</span><span id="lstnumberx1187.14" class="ltx_text ltx_font_typewriter">=[</span><span id="lstnumberx1187.15" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Mean<span id="lstnumberx1187.15.1" class="ltx_text ltx_lst_space"> </span>Value’</span><span id="lstnumberx1187.16" class="ltx_text ltx_font_typewriter">],</span>
</div>
<div id="lstnumberx1188" class="ltx_listingline">
<span id="lstnumberx1188.1" class="ltx_text ltx_lst_space ltx_font_typewriter">                      </span><span id="lstnumberx1188.2" class="ltx_text ltx_lst_identifier ltx_font_typewriter">index</span><span id="lstnumberx1188.3" class="ltx_text ltx_font_typewriter">=[</span><span id="lstnumberx1188.4" class="ltx_text ltx_lst_string ltx_font_typewriter" style="color:#9400D1;">’Position<span id="lstnumberx1188.4.1" class="ltx_text ltx_lst_space"> </span>{}’</span><span id="lstnumberx1188.5" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1188.6" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">format</span><span id="lstnumberx1188.7" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1188.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">i</span><span id="lstnumberx1188.9" class="ltx_text ltx_font_typewriter">)</span><span id="lstnumberx1188.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1188.11" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">for</span><span id="lstnumberx1188.12" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1188.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">i</span><span id="lstnumberx1188.14" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1188.15" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx1188.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1188.17" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">range</span><span id="lstnumberx1188.18" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1188.19" class="ltx_text ltx_lst_keyword ltx_lst_keywords2 ltx_font_typewriter" style="color:#FF00FF;">len</span><span id="lstnumberx1188.20" class="ltx_text ltx_font_typewriter">(</span><span id="lstnumberx1188.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mean_values</span><span id="lstnumberx1188.22" class="ltx_text ltx_font_typewriter">))])</span>
</div>
<div id="lstnumberx1189" class="ltx_listingline">
<span id="lstnumberx1189.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1189.2" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">return</span><span id="lstnumberx1189.3" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1189.4" class="ltx_text ltx_lst_identifier ltx_font_typewriter">df</span>
</div>
</div>
</div>
</section>
<section id="A11" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix K </span><span id="A11.1.1" class="ltx_text ltx_font_typewriter">bigcodebench</span>: A Viable Evaluation Tool</h3>

<div id="A11.p1" class="ltx_para ltx_noindent">
<p id="A11.p1.1" class="ltx_p">In this section, we document the usage of <a target="_blank" href="https://github.com/bigcode-project/bigcodebench" title="" class="ltx_ref ltx_href ltx_font_typewriter">bigcodebench</a>, a viable evaluation tool for <span id="A11.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span>. We note that the prototype of <span id="A11.p1.1.2" class="ltx_text ltx_font_typewriter">bigcodebench</span> is based on EvalPlus <cite class="ltx_cite ltx_citemacro_cite">[<a href="#bib.bib35" title="" class="ltx_ref">35</a>]</cite>.</p>
</div>
<section id="A11.SS1" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">K.1 </span>Model Inference</h4>

<div id="A11.SS1.p1" class="ltx_para ltx_noindent">
<div id="A11.SS1.p1.1" class="ltx_listing ltx_lst_language_bash ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,YmlnY29kZWJlbmNoLmdlbmVyYXRlIFwKICAgIC0tbW9kZWwgW21vZGVsX25hbWVdIFwKICAgIC0tc3Vic2V0IFtjb21wbGV0ZXxpbnN0cnVjdF0gXAogICAgLS1ncmVlZHkgXAogICAgLS1icyBbYnNdIFwKICAgIC0tdGVtcGVyYXR1cmUgW3RlbXBdIFwKICAgIC0tbl9zYW1wbGVzIFtuX3NhbXBsZXNdIFwKICAgIC0tcmVzdW1lIFwKICAgIC0tYmFja2VuZCBbdmxsbXxoZnxvcGVuYWl8bWlzdHJhbHxhbnRocm9waWN8Z29vZ2xlXSBcCiAgICAtLXRwIFtncHVfbnVtYmVyXSBcCiAgICBbLS10cnVzdF9yZW1vdGVfY29kZV0gXAogICAgWy0tYmFzZV91cmwgW2Jhc2VfdXJsXV0=" download="">⬇</a></div>
<div id="lstnumberx1190" class="ltx_listingline">
<span id="lstnumberx1190.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bigcodebench</span><span id="lstnumberx1190.2" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1190.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">generate</span><span id="lstnumberx1190.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1190.5" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1191" class="ltx_listingline">
<span id="lstnumberx1191.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1191.2" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1191.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">model</span><span id="lstnumberx1191.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1191.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1191.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">model_name</span><span id="lstnumberx1191.7" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1191.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1191.9" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1192" class="ltx_listingline">
<span id="lstnumberx1192.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1192.2" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1192.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">subset</span><span id="lstnumberx1192.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1192.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1192.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complete</span><span id="lstnumberx1192.7" class="ltx_text ltx_font_typewriter">|</span><span id="lstnumberx1192.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">instruct</span><span id="lstnumberx1192.9" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1192.10" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1192.11" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1193" class="ltx_listingline">
<span id="lstnumberx1193.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1193.2" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1193.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">greedy</span><span id="lstnumberx1193.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1193.5" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1194" class="ltx_listingline">
<span id="lstnumberx1194.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1194.2" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1194.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bs</span><span id="lstnumberx1194.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1194.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1194.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bs</span><span id="lstnumberx1194.7" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1194.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1194.9" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1195" class="ltx_listingline">
<span id="lstnumberx1195.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1195.2" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1195.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">temperature</span><span id="lstnumberx1195.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1195.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1195.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">temp</span><span id="lstnumberx1195.7" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1195.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1195.9" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1196" class="ltx_listingline">
<span id="lstnumberx1196.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1196.2" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1196.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">n_samples</span><span id="lstnumberx1196.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1196.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1196.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">n_samples</span><span id="lstnumberx1196.7" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1196.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1196.9" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1197" class="ltx_listingline">
<span id="lstnumberx1197.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1197.2" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1197.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">resume</span><span id="lstnumberx1197.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1197.5" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1198" class="ltx_listingline">
<span id="lstnumberx1198.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1198.2" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1198.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">backend</span><span id="lstnumberx1198.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1198.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1198.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">vllm</span><span id="lstnumberx1198.7" class="ltx_text ltx_font_typewriter">|</span><span id="lstnumberx1198.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">hf</span><span id="lstnumberx1198.9" class="ltx_text ltx_font_typewriter">|</span><span id="lstnumberx1198.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">openai</span><span id="lstnumberx1198.11" class="ltx_text ltx_font_typewriter">|</span><span id="lstnumberx1198.12" class="ltx_text ltx_lst_identifier ltx_font_typewriter">mistral</span><span id="lstnumberx1198.13" class="ltx_text ltx_font_typewriter">|</span><span id="lstnumberx1198.14" class="ltx_text ltx_lst_identifier ltx_font_typewriter">anthropic</span><span id="lstnumberx1198.15" class="ltx_text ltx_font_typewriter">|</span><span id="lstnumberx1198.16" class="ltx_text ltx_lst_identifier ltx_font_typewriter">google</span><span id="lstnumberx1198.17" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1198.18" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1198.19" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1199" class="ltx_listingline">
<span id="lstnumberx1199.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1199.2" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1199.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">tp</span><span id="lstnumberx1199.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1199.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1199.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">gpu_number</span><span id="lstnumberx1199.7" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1199.8" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1199.9" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1200" class="ltx_listingline">
<span id="lstnumberx1200.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1200.2" class="ltx_text ltx_font_typewriter">[--</span><span id="lstnumberx1200.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">trust_remote_code</span><span id="lstnumberx1200.4" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1200.5" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1200.6" class="ltx_text ltx_font_typewriter">\</span>
</div>
<div id="lstnumberx1201" class="ltx_listingline">
<span id="lstnumberx1201.1" class="ltx_text ltx_lst_space ltx_font_typewriter">    </span><span id="lstnumberx1201.2" class="ltx_text ltx_font_typewriter">[--</span><span id="lstnumberx1201.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">base_url</span><span id="lstnumberx1201.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1201.5" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1201.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">base_url</span><span id="lstnumberx1201.7" class="ltx_text ltx_font_typewriter">]]</span>
</div>
</div>
</div>
</section>
<section id="A11.SS2" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">K.2 </span>Output Sanitizing</h4>

<div id="A11.SS2.p1" class="ltx_para ltx_noindent">
<div id="A11.SS2.p1.1" class="ltx_listing ltx_lst_language_bash ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,YmlnY29kZWJlbmNoLnNhbml0aXplIC0tc2FtcGxlcyBzYW1wbGVzLmpzb25sIFstLWNhbGlicmF0ZV0=" download="">⬇</a></div>
<div id="lstnumberx1202" class="ltx_listingline">
<span id="lstnumberx1202.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bigcodebench</span><span id="lstnumberx1202.2" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1202.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sanitize</span><span id="lstnumberx1202.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1202.5" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1202.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">samples</span><span id="lstnumberx1202.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1202.8" class="ltx_text ltx_lst_identifier ltx_font_typewriter">samples</span><span id="lstnumberx1202.9" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1202.10" class="ltx_text ltx_lst_identifier ltx_font_typewriter">jsonl</span><span id="lstnumberx1202.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1202.12" class="ltx_text ltx_font_typewriter">[--</span><span id="lstnumberx1202.13" class="ltx_text ltx_lst_identifier ltx_font_typewriter">calibrate</span><span id="lstnumberx1202.14" class="ltx_text ltx_font_typewriter">]</span>
</div>
</div>
</div>
</section>
<section id="A11.SS3" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">K.3 </span>Execution-based Evaluation</h4>

<div id="A11.SS3.p1" class="ltx_para ltx_noindent">
<div id="A11.SS3.p1.1" class="ltx_listing ltx_lst_language_bash ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,YmlnY29kZWJlbmNoLmV2YWx1YXRlIC0tc3Vic2V0IFtjb21wbGV0ZXxpbnN0cnVjdF0gLS1zYW1wbGVzIHNhbXBsZXMtc2FuaXRpemVkLWNhbGlicmF0ZWQuanNvbmw=" download="">⬇</a></div>
<div id="lstnumberx1203" class="ltx_listingline">
<span id="lstnumberx1203.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bigcodebench</span><span id="lstnumberx1203.2" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1203.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">evaluate</span><span id="lstnumberx1203.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1203.5" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1203.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">subset</span><span id="lstnumberx1203.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1203.8" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1203.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">complete</span><span id="lstnumberx1203.10" class="ltx_text ltx_font_typewriter">|</span><span id="lstnumberx1203.11" class="ltx_text ltx_lst_identifier ltx_font_typewriter">instruct</span><span id="lstnumberx1203.12" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1203.13" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1203.14" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1203.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">samples</span><span id="lstnumberx1203.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1203.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">samples</span><span id="lstnumberx1203.18" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx1203.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sanitized</span><span id="lstnumberx1203.20" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx1203.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">calibrated</span><span id="lstnumberx1203.22" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1203.23" class="ltx_text ltx_lst_identifier ltx_font_typewriter">jsonl</span>
</div>
</div>
</div>
</section>
<section id="A11.SS4" class="ltx_subsection">
<h4 class="ltx_title ltx_title_subsection">
<span class="ltx_tag ltx_tag_subsection">K.4 </span>Result Inspection</h4>

<div id="A11.SS4.p1" class="ltx_para ltx_noindent">
<div id="A11.SS4.p1.1" class="ltx_listing ltx_lst_language_bash ltx_lstlisting ltx_framed ltx_framed_rectangle ltx_listing" style="background-color:#F2F2EB;">
<div class="ltx_listing_data"><a href="data:text/plain;base64,YmlnY29kZWJlbmNoLmluc3BlY3QgLS1kYXRhc2V0IFtiaWdjb2RlYmVuY2hdIC0tZXZhbC1yZXN1bHRzIHNhbXBsZXMtc2FuaXRpemVkX2V2YWxfcmVzdWx0cy5qc29uIFstLWluLXBsYWNlXQ==" download="">⬇</a></div>
<div id="lstnumberx1204" class="ltx_listingline">
<span id="lstnumberx1204.1" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bigcodebench</span><span id="lstnumberx1204.2" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1204.3" class="ltx_text ltx_lst_identifier ltx_font_typewriter">inspect</span><span id="lstnumberx1204.4" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1204.5" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1204.6" class="ltx_text ltx_lst_identifier ltx_font_typewriter">dataset</span><span id="lstnumberx1204.7" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1204.8" class="ltx_text ltx_font_typewriter">[</span><span id="lstnumberx1204.9" class="ltx_text ltx_lst_identifier ltx_font_typewriter">bigcodebench</span><span id="lstnumberx1204.10" class="ltx_text ltx_font_typewriter">]</span><span id="lstnumberx1204.11" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1204.12" class="ltx_text ltx_font_typewriter">--</span><span id="lstnumberx1204.13" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">eval</span><span id="lstnumberx1204.14" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx1204.15" class="ltx_text ltx_lst_identifier ltx_font_typewriter">results</span><span id="lstnumberx1204.16" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1204.17" class="ltx_text ltx_lst_identifier ltx_font_typewriter">samples</span><span id="lstnumberx1204.18" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx1204.19" class="ltx_text ltx_lst_identifier ltx_font_typewriter">sanitized_eval_results</span><span id="lstnumberx1204.20" class="ltx_text ltx_font_typewriter">.</span><span id="lstnumberx1204.21" class="ltx_text ltx_lst_identifier ltx_font_typewriter">json</span><span id="lstnumberx1204.22" class="ltx_text ltx_lst_space ltx_font_typewriter"> </span><span id="lstnumberx1204.23" class="ltx_text ltx_font_typewriter">[--</span><span id="lstnumberx1204.24" class="ltx_text ltx_lst_keyword ltx_font_typewriter" style="color:#FF00FF;">in</span><span id="lstnumberx1204.25" class="ltx_text ltx_font_typewriter">-</span><span id="lstnumberx1204.26" class="ltx_text ltx_lst_identifier ltx_font_typewriter">place</span><span id="lstnumberx1204.27" class="ltx_text ltx_font_typewriter">]</span>
</div>
</div>
</div>
</section>
</section>
<section id="A12" class="ltx_appendix">
<h3 class="ltx_title ltx_title_appendix">
<span class="ltx_tag ltx_tag_appendix">Appendix L </span>Development Timeline</h3>

<section id="A12.SS0.SSS0.Px1" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">04/2023 - 05/2023</h6>

<div id="A12.SS0.SSS0.Px1.p1" class="ltx_para ltx_noindent">
<p id="A12.SS0.SSS0.Px1.p1.1" class="ltx_p">Project Initiation.</p>
</div>
</section>
<section id="A12.SS0.SSS0.Px2" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">06/2023 - 07/2023</h6>

<div id="A12.SS0.SSS0.Px2.p1" class="ltx_para ltx_noindent">
<p id="A12.SS0.SSS0.Px2.p1.1" class="ltx_p">Benchmark Construction — Data Synthesis.</p>
</div>
</section>
<section id="A12.SS0.SSS0.Px3" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">07/2023 - 11/2023</h6>

<div id="A12.SS0.SSS0.Px3.p1" class="ltx_para ltx_noindent">
<p id="A12.SS0.SSS0.Px3.p1.1" class="ltx_p">Benchmark Construction — Semi-automatic Program Refactoring and Testing Case Generation.</p>
</div>
</section>
<section id="A12.SS0.SSS0.Px4" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">12/2023 - 04/2024</h6>

<div id="A12.SS0.SSS0.Px4.p1" class="ltx_para ltx_noindent">
<p id="A12.SS0.SSS0.Px4.p1.1" class="ltx_p">Benchmark Construction — Human Curation; <span id="A12.SS0.SSS0.Px4.p1.1.1" class="ltx_text ltx_font_typewriter">bigcodebench</span> Evaluation Tool Development.</p>
</div>
</section>
<section id="A12.SS0.SSS0.Px5" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">04/2024 - 05/2024</h6>

<div id="A12.SS0.SSS0.Px5.p1" class="ltx_para ltx_noindent">
<p id="A12.SS0.SSS0.Px5.p1.1" class="ltx_p">Benchmark Finalization; Experiment; Analysis; Drafting; Code-Eval Development.</p>
</div>
</section>
<section id="A12.SS0.SSS0.Px6" class="ltx_paragraph">
<h6 class="ltx_title ltx_title_paragraph">06/2024</h6>

<div id="A12.SS0.SSS0.Px6.p1" class="ltx_para ltx_noindent">
<p id="A12.SS0.SSS0.Px6.p1.1" class="ltx_p">Initial <span id="A12.SS0.SSS0.Px6.p1.1.1" class="ltx_text ltx_font_typewriter">BigCodeBench</span> Release.</p>
</div>
<div class="ltx_pagination ltx_role_newpage"></div>
</section>
</section>
</section>
</article>
</div>
<div class="ar5iv-footer"><a href="/html/2406.15876" class="ar5iv-nav-button ar5iv-nav-button-prev">◄</a>
    <a class="ar5iv-home-button" href="/"><img height="40" alt="ar5iv homepage" src="/assets/ar5iv.png"></a>
    <a href="/feeling_lucky" class="ar5iv-text-button">Feeling<br>lucky?</a>
    <a href="/log/2406.15877" class="ar5iv-text-button ar5iv-severity-error">Conversion<br>report</a>
    <a class="ar5iv-text-button" target="_blank" href="https://github.com/dginev/ar5iv/issues/new?template=improve-article--arxiv-id-.md&title=Improve+article+2406.15877">Report<br>an issue</a>
    <a href="https://arxiv.org/abs/2406.15877" class="ar5iv-text-button arxiv-ui-theme">View&nbsp;original<br>on&nbsp;arXiv</a><a href="/html/2406.15878" class="ar5iv-nav-button ar5iv-nav-button-next">►</a>
</div><footer class="ltx_page_footer">
<a class="ar5iv-toggle-color-scheme" href="javascript:toggleColorScheme()" title="Toggle ar5iv color scheme"><span class="color-scheme-icon"></span></a>
<a class="ar5iv-footer-button" href="https://arxiv.org/help/license" target="_blank">Copyright</a>
<a class="ar5iv-footer-button" href="https://arxiv.org/help/policies/privacy_policy" target="_blank">Privacy Policy</a>

<div class="ltx_page_logo">Generated  on Fri Jul  5 18:08:09 2024 by <a target="_blank" href="http://dlmf.nist.gov/LaTeXML/" class="ltx_LaTeXML_logo"><span style="letter-spacing:-0.2em; margin-right:0.1em;">L<span class="ltx_font_smallcaps" style="position:relative; bottom:2.2pt;">a</span>T<span class="ltx_font_smallcaps" style="font-size:120%;position:relative; bottom:-0.2ex;">e</span></span><span style="font-size:90%; position:relative; bottom:-0.2ex;">XML</span><img src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAsAAAAOCAYAAAD5YeaVAAAAAXNSR0IArs4c6QAAAAZiS0dEAP8A/wD/oL2nkwAAAAlwSFlzAAALEwAACxMBAJqcGAAAAAd0SU1FB9wKExQZLWTEaOUAAAAddEVYdENvbW1lbnQAQ3JlYXRlZCB3aXRoIFRoZSBHSU1Q72QlbgAAAdpJREFUKM9tkL+L2nAARz9fPZNCKFapUn8kyI0e4iRHSR1Kb8ng0lJw6FYHFwv2LwhOpcWxTjeUunYqOmqd6hEoRDhtDWdA8ApRYsSUCDHNt5ul13vz4w0vWCgUnnEc975arX6ORqN3VqtVZbfbTQC4uEHANM3jSqXymFI6yWazP2KxWAXAL9zCUa1Wy2tXVxheKA9YNoR8Pt+aTqe4FVVVvz05O6MBhqUIBGk8Hn8HAOVy+T+XLJfLS4ZhTiRJgqIoVBRFIoric47jPnmeB1mW/9rr9ZpSSn3Lsmir1fJZlqWlUonKsvwWwD8ymc/nXwVBeLjf7xEKhdBut9Hr9WgmkyGEkJwsy5eHG5vN5g0AKIoCAEgkEkin0wQAfN9/cXPdheu6P33fBwB4ngcAcByHJpPJl+fn54mD3Gg0NrquXxeLRQAAwzAYj8cwTZPwPH9/sVg8PXweDAauqqr2cDjEer1GJBLBZDJBs9mE4zjwfZ85lAGg2+06hmGgXq+j3+/DsixYlgVN03a9Xu8jgCNCyIegIAgx13Vfd7vdu+FweG8YRkjXdWy329+dTgeSJD3ieZ7RNO0VAXAPwDEAO5VKndi2fWrb9jWl9Esul6PZbDY9Go1OZ7PZ9z/lyuD3OozU2wAAAABJRU5ErkJggg==" alt="Mascot Sammy"></a>
</div></footer>
</div>

    <script>
      var canMathML = typeof(MathMLElement) == "function";
      if (!canMathML) {
        var body = document.querySelector("body");
        body.firstElementChild.setAttribute('style', 'opacity: 0;');
        var loading = document.createElement("div");
        loading.setAttribute("id", "mathjax-loading-spinner");
        var message = document.createElement("div");
        message.setAttribute("id", "mathjax-loading-message");
        message.innerText = "Typesetting Equations...";
        body.prepend(loading);
        body.prepend(message);

        var el = document.createElement("script");
        el.src = "https://cdn.jsdelivr.net/npm/mathjax@3/es5/tex-mml-chtml.js";
        document.querySelector("head").appendChild(el);

        window.MathJax = {
          startup: {
            pageReady: () => {
              return MathJax.startup.defaultPageReady().then(() => {
                body.removeChild(loading);
                body.removeChild(message);
                body.firstElementChild.removeAttribute('style');
              }); } } };
      }
    </script>
    <script>
    // Auxiliary function, building the preview feature when
    // an inline citation is clicked
    function clicked_cite(e) {
      e.preventDefault();
      let cite = this.closest('.ltx_cite');
      let next = cite.nextSibling;
      if (next && next.nodeType == Node.ELEMENT_NODE && next.getAttribute('class') == "ar5iv-bibitem-preview") {
        next.remove();
        return; }
      // Before adding a preview modal,
      // cleanup older previews, in case they're still open
      document.querySelectorAll('span.ar5iv-bibitem-preview').forEach(function(node) {
        node.remove();
      })

      // Create the preview
      preview = document.createElement('span');
      preview.setAttribute('class','ar5iv-bibitem-preview');
      let target = document.getElementById(this.getAttribute('href').slice(1));
      target.childNodes.forEach(function (child) {
        preview.append(child.cloneNode(true));
      });
      let close_x = document.createElement('button');
      close_x.setAttribute("aria-label","Close modal for bibliography item preview");
      close_x.textContent = "×";
      close_x.setAttribute('class', 'ar5iv-button-close-preview');
      close_x.setAttribute('onclick','this.parentNode.remove()');
      preview.append(close_x);
      preview.querySelectorAll('.ltx_tag_bibitem').forEach(function(node) {
        node.remove();
      });
      cite.parentNode.insertBefore(preview, cite.nextSibling);
      return;
    }
    // Global Document initialization:
    // - assign the preview feature to all inline citation links
    document.querySelectorAll(".ltx_cite .ltx_ref").forEach(function (link) {
      link.addEventListener("click", clicked_cite);
    });
    </script>
    </body>
</html>

2406.15877
Automated software engineering has been greatly empowered by the recent advances in Large Language Models (LLMs)  for programming. While current benchmarks have shown that LLMs can perform various software engineering tasks like human developers, the majority of their evaluations are limited to short and self-contained algorithmic tasks.
Solving challenging and practical programming tasks requires the capability of utilizingdiverse function calls as toolsto efficiently implement functionalities like data analysis and web development.
In addition, using multiple tools to solve a task needs compositional reasoning by accurately understandingcomplex instructions. Fulfilling both of these characteristics can pose a great challenge for LLMs.
To assess how well LLMs can solve challenging and practical programming tasks, we introduceBigCodeBench, a benchmark that challenges LLMs to invoke multiple function calls as tools from 139 libraries and 7 domains for 1,140 fine-grained programming tasks.
To evaluate LLMs rigorously, each programming task encompasses 5.6 test cases with an average branch coverage of 99%.
In addition, we propose a natural-language-oriented variant ofBigCodeBench,BigCodeBench-Instruct, that automatically transforms the original docstrings into short instructions only with essential information. Our extensive evaluation of 60 LLMs shows thatLLMs are not yet capable of following complex instructions to use function calls precisely, with scores up to 60%, significantly lower than the human performance of 97%. The results underscore the need for further advancements in this area.
abstract
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Abstract
2406.15877
1IntroductionAutomated software engineering, like code generation and repair, has attracted significant interest from academia and industry to facilitate the development of advanced models. With recent advances in data-centric deep learning techniques, large language models (LLMs)  trained on large-scale corpora have shown superior capabilities of generating syntactically correct and functional programs.
However, widely-used benchmarks like HumanEvaland MBPPonly contain short, self-contained, and algorithm-focused programming tasks and have been saturated by recent model releases.
In this work, we aim to close the evaluation gap between these isolated coding exercises and realistic software engineering problems, askingCan LLMs solve more challenging and more practical programming tasks?Solving programming tasksin real-world scenarios typically has two main characteristics: (1) Diverse Function Calls as Tools.111In this work, we refer to “tools” as library-oriented but non-object-oriented Code Function Call APIs, which are discussed inGorilla OpenFunctionsThe Code Function Calling APIs are typically seen in common external Python packages like Numpy, Sklearn, and Pandas.A complex programming task often requires the invocation of diverse function call sequences as tools.
To avoid reinventing the wheel, domain-specific libraries are designed to cover function calls (or APIs)  with comprehensive functionalities; and
(2) Complex Instructions. Due to the complexity of software development, instructions may require compositional reasoning ability to perform a sequence of functionalities in the correct order (e.g., input data manipulation, error message handling, and specific output formatting) . For instance, creating a network application that includes functionality for retrieving responses from an HTTPS server (Figure 1)  requires integrating several components with multiple function calls, such as managing SSL contexts, handling socket connections, and ensuring the response is returned in the specific format.Building a high-quality execution-based benchmark that simulates aforementioned programming tasks with practical and challenging constraints is non-trivial.
First, it is hard to naturally source self-contained programming tasks with complex instructions, unlike the short code exercises in HumanEval.
Although most GitHub repositories contain realistic source code, the functions inside these repositories often require cross-file information.
Second, real-world programming scenarios are extremely diverse. Existing benchmarksonly focus on popular scenarios like data science.
Third, mainstream programming benchmarks have a significant number of ambiguous or under-specified specifications, resulting in inaccurate evaluation results. While there have been attempts to improve the data quality with LLMs, LLMs have their own bias and cannot reliably perform refinement.To construct massive high-quality programming tasks, we propose a novel framework (Figure 2)  that uses collaboration between LLMs and human experts to build a rigorous execution-based benchmark,BigCodeBench. Particularly, we utilize LLMs to source programming tasks, refactor programs, and add test cases, under constant human supervision.
Our benchmark contains 1,140 rich-context and multi-tool-use programming tasks, covering 723 function calls from 139 popular libraries across 7 domains.
As we aim to let models reason any suitable function calls to complete the tasks, we design the test cases in an open-ended manner and examine certain behaviors based on different inputs. We assess two common programming scenarios: (1)  Code Completion (BigCodeBench-Complete) , which evaluates the capability of code generation based on the structured docstrings; and (2)  Instruction to Code (BigCodeBench-Instruct) , which evaluates the ability to complete programming tasks based on natural-language-oriented (NL-oriented)  instructions. WhileBigCodeBench-Completeemphasizes structured docstring prompts,BigCodeBench-Instructchallenges LLMs to generate precise code without relying on non-essential details likeinteractive Python examples.Through extensive studies on 60 models, we find that LLMs still struggle to invoke multiple function calls from cross-domain libraries and follow complex instructions to solve programming tasks. Specifically, the best performing LLM, GPT-4o, solves merely 60% of tasks onBigCodeBench-Completeand less than 50% onBigCodeBench-Instruct, indicating that LLMs themselves lack the ability to align with human expectations when instructions are more natural. Interestingly, we find that some instruction-tuned LLMs like GPT-4 constantly refuse to follow long instructions to repeat essential context and thus fail the test cases.
Furthermore, LLMs perform differently when using domain-specific function calls as tools.
We also demonstrate the strongly positive correlations between mainstream benchmarks andBigCodeBench, validating our evaluation results.
introduction
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Section 1
2406.15877
2Benchmark ConstructionIn this section, we introduce our human-LLM-collaboration framework for theBigCodeBenchconstruction. As shown inFigure 2, the process ofBigCodeBench-Completeencompasses three stages: Data Synthesis, Semi-automatic Program Refactoring and Testing Case Generation, and Human Curation. In addition, we constructBigCodeBench-InstructinSection 2.4, an NL-oriented benchmark for programming-task solving. Further information is available inAppendix BandAppendix G. The construction is progressively contributed by 20 authors as annotators for one year in total, with 75% of them having more than 5 years of experience in Python programming. The progress is continually managed by the lead annotator to control the data quality. Each constructed programming task is expected to: (1)  have clear instructions insidePEP-257-structured docstrings; (2)  use multiple libraries as tools to solve the problem; and (3)  be paired with at least five test cases encapsulated in theunittestframework, with a complex test setup (e.g., database connection, and directory creation) , to verify program behaviors instead of relying on simple input-output assertions.Figure 2:Each programming task inBigCodeBenchis created through a three-stage construction process. The task quality is controlled by the human-LLM collaboration.2.1Data SynthesisOne intuitive method would be to rely on source code repositories to construct the function-level programming tasks. However, most repository-level functions require cross-file information, such as customized modules, which are hard to self-contain and document. We argue that leveraging LLMs to synthesize customized programming tasks can be more viable, especially when overseen by humans.
Given a code snippet of API usage with a brief human instruction as the seed example (Figure 2) , an LLM is instructed to enrich the programming intent and refine the corresponding implementation by using diverse libraries. Specifically, we use seed examples from ODEX, a benchmark containing intent-paired code skeletons from Stack Overflow. We use the GPT-4 API,222We use the model versiongpt-4-0613.the strongest LLM at the time of data sourcing, to synthesize the programming tasks. To help the LLM synthesize self-contained and relevant programming tasks based on the seed example, we instruct the model with a 2-shot in-context demonstration (AppendixG.1)  crafted by the lead annotator.As previous studies have shown that LLMs favor their own generations, such phenomena can make the model evaluation unfair.
We mitigate the model biases with an obfuscation and perturbation process. We first replace the semantic-rich program entry points with dummy function names. In addition, we perturb the natural language descriptions in docstrings with the back-translation method of NL-Augmenter, inspired by ReCode. After validating the post-processed programs with an abstract syntax tree parser, we collected 4,718 function-level programming samples.2.2Semi-automatic Program Refactoring and Testing Case GenerationPrograms synthesized by LLMs may contain various issues, such as undeclared variables and runtime bugs. Without proper verification, the implementation cannot directly serve as a ground-truth solution. To construct a high-quality execution-based benchmark, we need to add test cases that can rigorously verify the correctness of programs and identify any bugs.
However, it takes non-trivial effort for human developers to understand synthesized programs and properly refactor them with thorough testing. To improve the program quality and ease human annotation, we propose a conversion-driven framework for program refactoring and test case generations inspired by. Specifically, we utilize theCode Interpretersession in the web-based GPT-4, which is back-ended by a Linux-based virtual environment with pre-installed Python packages. We engage 13 authors as human annotators (including the lead annotator)  for this step, assigning each annotator 100 randomly sampled programming tasks based on their preferences of code topics (AppendixG.2.1) . We detail the design of this human-in-the-loop framework from human and LLM aspects as follows:Human AspectHuman developers possess varying preferences and levels of familiarity with specific data types and programming scenarios. To aid human annotators in providing more precise feedback for refining programs with GPT-4, we have defined 10 data types (e.g., SQL, CSV, and Python built-in types)  and task scenarios (e.g., data analysis, networking, and visualization) . GPT-4 API is utilized to automatically classify each program according to these categories, with detailed descriptions available inAppendixG.2.1. The annotators’ role is to continually instruct GPT-4 to refractor the programs and to provide continuous feedback to guide the model whenever it fails to self-debug or incorrectly refactor the program.LLM AspectTo effectively guide GPT-4 in the iterative refinement of programs and test cases, we provide detailed annotation guidelines inAppendixG.2.2as an initial prompt. These guidelines encompass two high-level instructions: (1)  Refine the function, including its docstrings, to enhance realism and reduce ambiguity; and (2)  Write unit tests to ensure the functional correctness of the given program description. Specifically, the model is taught to follow a step-by-step refinement process: (1)  Remove unused libraries and add necessary libraries if they are missing in the code snippet; (2)  Reformat docstrings to adhere toPEP-257conventions; (3)  Align program implementations with the instructions inside docstrings; (4)  Write and execute unit tests to ensure they pass; and (5)  Add refined programs and test cases to files for downloading.During interactions with GPT-4, we identify two main drawbacks in the Code Interpreter session. First, GPT-4 struggles to write proper test cases when mocking tests are employed. While the model can generate high-level designs of mocking tests, it often fails to understand how test cases should be constructed based on execution feedback. Second, GPT-4 can become stuck while resolving runtime bugs, leading to iterative refinement until the session times out. Continuous human feedback on viable solutions is essential to address these issues and ensure the model stays on track.During the post-processing of the annotated data, we observe that a significant number of test cases were incomplete. This issue arises because GPT-4 often omits partial content when writing long contexts into files. After removing all invalid programs via program analysis, we end up with 1,223 refactored programming tasks with paired test cases.2.3Human CurationTo enhance the benchmark quality, we implement a three-fold human curation process:ExaminationWe first perform a rigorous manual examination of the benchmarks, guided by a set of detailed guidelines (AppendixG.3)  to add more test cases and resolve a list of runtime issues due to the LLM-generated flaky tests. In addition, we aim to formalize further the programming tasks based on the following criteria: (1)  The task should utilize at least two libraries to enrich the task scopes; (2)  Import statements should be limited to those used in the task implementations and be natural based on human understanding; (3)  The docstring should follow PEP-257 to ensure consistent styles; (4)  Both the task implementation and test cases should be clearly aligned with the task docstrings, based on human understanding; and (5)  Required library modules in the docstrings should be aligned with the import statements.
For test case construction, the criteria are as follows: (1)  Test cases should be encapsulated by theunittestframework, making thempytest-compatible; and (2)  Test cases need to be deterministic, asserting expected program behaviors based on the inputs.Pre-EvaluationTo enhance the benchmark quality, we perform a dry run to pre-evaluate an LLM other than GPT-4 used in previous steps. We choose GPT-3.5-Turbo API333We use model versiongpt-3.5-turbo-1106.to generate solutions based on the examined task prompts. By understanding how the model fails on the tasks, annotators may add essential details to the docstrings to clarify the task instructions but avoid describing step-by-step implementations.Cross-CheckingTo further validate data quality and ensure consistency across all programming tasks in the testing environment, 7 additional annotators refine and finalize the data annotated by others. This round focuses on the utility of docstrings and test cases. We automatically parse the docstrings and ask annotators to manually correct the docstring structures, specifically addressing task descriptions, function parameters, expected returns, exception handling, required modules, and interactive examples. Additionally, we remove unused imported modules via program analysis. For the interactive examples, we ensure their correctness viadoctest, except for those requiring system and network access.
The confirmed programming tasks are finally validated by the automated test workflows inGitHub Container Registry, where the test cases are automatically run against the task implementations in a configured sandbox environment. To ensure the finalized data quality, we randomly assign 33 finalized task prompts to the 11 annotators (the lead annotator was excluded; one annotator was unavailable at the time) , to write the solutions. The lead annotator conducts the evaluation of the solutions, finding that 97% (32 out of 33)  of sampled tasks can pass all test cases.Figure 3:Each task prompt inBigCodeBench-Instructare transformed fromBigCodeBench-Completevia the pre-defined rules. We omit non-essential details during the transformation.2.4Benchmarking NL-oriented Instructions to Code GenerationWhen instruction tuning LLMs using NL data, the input is mainly an NL instruction, and the target output is the NL or source code for completion. This training objective aligns with the downstream applications such as multi-turn dialogue, where users ask questions or provide task-specific instructions to the models. While existing programming benchmarks commonly format the verbose instructions in docstrings, users may instruct the models to generate code samples with the less verbose NL context. Despite that there have been similar attempts like HumanEvalPackaddressing this limitation, their inputs still lack some naturalness. Generally, users tend to describe the high-level idea of functionalities and avoid redundant information (e.g., parameters)  or too-specific details (e.g., interactive examples) . Thus, we createBigCodeBench-Instruct, a benchmark variant that prompts LLMs to solve programming tasks with more NL-oriented instructions, assessing the model’s ability to understand human requirements correctly.
Based on the task prompts created inBigCodeBench-Complete, we design a set of parsing rules and transform them into more natural instructions (Figure 3) . For quality control, 5 authors who do not participate in previous stages inspect the randomly sampled prompts and their corresponding ground-truth solutions and reach an agreement on the alignment between the instruction prompts and task implementations.
body
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Section 2
2406.15877
3Benchmark StatisticsFigure 4:Examples of tools inBigCodeBenchare illustrated. Each function call belongs to a domain-specific library. The distribution of each domain is computed based on the frequency of domain-specific libraries appearing per task. For example, “63%” in “Computation” means that there are 63% tasks inBigCodeBenchusing at least one computation library.Table 1:Summarized statistics of representative function-level Python programming benchmarks
, partially inspired by.BigCodeBenchare more complex regarding the depth of task complexity and breadth of tool-use knowledge.PL.: Programming Language.Cov.: Branch Coverage.Char.: Characters.C.C.: Cyclomatic Complexity (starting from 0, higher values indicate more complex code) .Lib.: Library.Dom.: Domain.Std.:Python Standard Library.Ext.:Python External Library.Overall StatisticsBenchmark# TaskTest(Avg.) Prompt(Avg.) Solution(Avg.) #Cov.Char. (Code) LineChar.LineC.C.HumanEval1647.898%450.6 (450.6) 13.7180.96.83.6DS-10001,0001.698%871.8 (193.9) 29.1138.15.11.6DS-1000 (Orig.) 4521.598%831.4 (201.2) 26.2115.54.21.4ODEX9451.896%87.5 (87.5) 1.050.41.91.4BigCodeBench-Complete1,1405.699%1112.5 (1112.5) 33.5426.010.03.1BigCodeBench-Instruct663.2 (124.0) 11.7Tool StatisticsBenchmark# Dom.# Lib.# CallTasks(Avg.) CombinationStd. / Ext.Std. / Ext.# Lib.# Call# Lib.# Calls# Dom.HumanEval34 / 07 / 00.10.1685DS-100045 / 97 / 3210.81.16633124DS-1000 (Orig.) 44 / 95 / 2890.91.35926023ODEX740 / 26128 / 1020.60.510520220BigCodeBench777 / 62281 / 4422.84.7577104556Overall StatisticsThe first part ofTable 1presents an overview comparison betweenBigCodeBenchand other mainstream function-level Python programming benchmarks. We note that the full DS-1000 dataset emphasizes the perturbed tasks to avoid model memorization and thus includes an original subset for reference.
Therefore, we also include statistics for non-perturbed problems (DS-1000 Orig.) . As the provided statistics suggest,BigCodeBenchcontains much more rigorous execution-based evaluation and has longer task prompts that contain complex instructions. The ground-truth solutions are also longer than in prior benchmarks, indicating that the tasks insideBigCodeBenchrequire more complex implementation logic. To illustrate the programming complexity, we measure cyclomatic complexity, which is the number of independent paths through the task solution. We notice thatBigCodeBenchhas a similar complexity to HumanEval, much higher than DS-1000 and ODEX. The high cyclomatic complexity indicates that solving the tasks inBigCodeBenchrequires non-trivial reasoning ability from the programming perspective.Figure 5:Complexity - tool comparisons with various benchmarks.Tool StatisticsIn this work, we highlight any libraries and function calls from these libraries as program-based tools for LLMs. Therefore, we compare the tools used among the mainstream benchmarks in the second part ofTable 1. First,BigCodeBenchcovers 281 function calls from 77 standard libraries and 442 from 62 external libraries, which is far more diverse than the other benchmarks. The examples of these tools are shown inFigure 4.
Based on thePyPIdownload statistics, the mean download counts of the recent 30 days are 56.9M+ for the 62 external libraries, suggesting their high popularity in real-world software development.
Second,BigCodeBenchfrequently invokes a sequence of function calls from multiple libraries to solve a single task, requiring significant compositional reasoning ability for task-solving. Third,BigCodeBenchhas more diverse combinations among libraries, function calls, and domains in the ground-truth solutions.
We visualize the library and function call density used by different benchmarks inAppendixF.1, showing the even broader tool-use diversity inBigCodeBench.
To better understand solution complexity (measured by characters)  and tool-use diversity (measured by distinct function calls) , we compare the tasks in BigCodeBench with those in representative benchmarks inFigure 5(details are provided inAppendixF.2) . We find that BigCodeBench requires more complex reasoning and problem-solving skills to implement comprehensive functionalities.
body
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Section 3
2406.15877
4EvaluationOur evaluation uses the unbiased version of Pass@to accurately assess the functional correctness of generated code snippets by LLMs. To make general observations, we extensively evaluate 60 state-of-the-art LLMs onBigCodeBench-Completeand 35 instruction-tuned LLMs onBigCodeBench-Instruct. Specifically, following prior works, we report Pass@1 with greedy decoding for the main experiments in the zero-shot setting. To investigate more thoroughly, we compute Pass@1 and Pass@5 results with random sampling to generate(=5)  samples with a temperature of 0.8 and top-p of 0.95 inAppendix I. While it is encouraged to generate much more ()  samples to avoid bias, we take the lower bound due to limited computational resources. We use the same prompts for code generation from, given inAppendix H.4.1Measuring Task-Level PerformanceWe first evaluate the task-solving performance of each LLM and summarize the findings as follows. We show the main results inFigure 6. As models constantly omit the essential code in the generation and hence fail the tests, we calibrate the generation quality by adding the missing setup. The Pearson’scorrelation between the model ranks onBigCodeBench-CompleteandBigCodeBench-Instructis 0.982, indicating a strong alignment. In addition, model rankings show the signs of scaling laws, where bigger models can solve more tasks. We also observe that there is still some performance gap between the top closed models and open ones. Detailed studies can be found inAppendix J. We highlight a few findings as follows:Figure 6:Pass@1 results of instruction-tuned LLMs onBigCodeBench-Complete(Top)  andBigCodeBench-Instruct(Bottom) . We only highlight the calibrated results having at least a difference of 1% from the original Pass@1.Instruction-tuned LLMs omit essential details of long code promptsInterestingly, we observe that instruction-tuned LLMs can omit the essential import statements of the given prompts inBigCodeBench-Complete, which can lead to task failure due to the lack of proper module and constant definitions. The omission is likely to happen when models need to repeat the long context in the response. Such behaviors are denoted as “model laziness” in long-context interactions, similar to the observations inSection 2.2. Due to the limited prompt length of existing programming benchmarks (Table 1) , there is no quantitative evidence of the laziness phenomenon in prior code generation benchmarks. To understand how laziness can affect the model performance, we calibrate the generation quality by adding the missing setup (e.g., import statements and global constants) . When comparing the calibrated Pass@1 and the original ones in the top figure ofFigure 6andAppendix I, we find that GPT-4 tends to omit much more context and perform poorly onBigCodeBench-Complete, consistent with the previous community discussion444https://community.openai.com/t/why-i-think-gpt-is-now-lazyand confirmed by OpenAI. While instruction-tuned LLMs have an average performance degradation of 0.8% onBigCodeBench-Complete, there is a less than 0.3% difference onBigCodeBench-Instruct, which validates the hypothesis that models omit more information of longer inputs.Instruction tuning helps to follow programming constraintsWhen comparing instruction-tuned LLMs with their base ones (Appendix I) , we observe that instruction tuning can improve the capability of following complex constraints of the prompts. The mean calibrated Pass@1 onBigCodeBench-Completefor instruction-tuned LLMs and paired base LLMs are 40.7% and 35.7%, respectively, indicating the great performance gap. The performance disparity is further magnified when the instruction-tuned LLMs are calibrated. We also note that the task performance of CodeQwen1.5-7B is not enhanced by instruction tuning, possibly due to the lack of fine-grained data during training.LLMs are sensitive to the verbosity of programming instructionsFrom the bottom figure ofFigure 6, we notice that LLMs perform much worse onBigCodeBench-InstructthanBigCodeBench-Completewith an average decrease of 8.5% on Pass@1, while maintaining similar rankings. This observation indicates that LLMs still lack the proper understanding of condensed human requirements since the task instructions ofBigCodeBench-Instructare less verbose. While it is possible that the lower verbosity may introduce more ambiguity, we make sure that the instructions transformed fromBigCodeBench-Completedo not lose the key information from the human perspective. In addition, we find that models with lower scores onBigCodeBench-Completedegrade less onBigCodeBench-Instruct, limited by their programming capability.Figure 7:Top 5 instruction-tuned LLMs onBigCodeBench-Complete.4.2Measuring Tool-Level PerformanceBesides evaluating task completion performance, we try to understand how well LLMs can use tools for task-solving. As it is hard to evaluate the accuracy of each independent function call regardless of the correctness of the model solutions, we rely on the calibrated greedy decoding results onBigCodeBench-Completeand deem the use of the associated library correct if the task is passed by all test cases.Jack of all trades, master of most.Figure 7shows the top 5 calibrated instruction-tuned LLMs ranked onBigCodeBench-Complete. The best overall performing LLMs, like GPT-4o, excel in most domains but still fall short in certain ones. We suggest that domain specialization can result from the training data. Similar findings can be found in the base models, which are visualized inAppendixI.2.Table 2:Tool-use comparisons between all generated solutions (Sol.)  and ground truths (GT.)  onBigCodeBench-Complete.Library(%) Function Call(%) Pass79.8420.1640.4659.54Fail71.7828.2222.4777.53LLMs use different function calls to solve tasks.We assess how all 60 calibrated models use tools onBigCodeBench-Completeand report the mean statistics inTable 2. By inspecting the library usage, we find that models use imported libraries in more than 70% of tasks. For the remaining 20%, we notice that models tend to import additional libraries to solve the tasks. After some inspection, we notice that most of these added libraries are standard, explaining why they can still pass the tests. When analyzing the function calls, we find that models tend to use different function calls from the ones in ground truths.
Due to the open-endedness of the programming tasks, the invocation of function calls is expected to be flexible. However, using more diverse function calls is more likely to introduce task failures. We provide several examples where the model-generated solution contains function calls different from the ground truth inAppendix J, Examples 9 and 10.
body
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Section 4
2406.15877
5Comparison to Existing Programming BenchmarksTable 3:Correlation coefficients measured by Pearson’sand Spearman’s. against HumanEval+ and LiveCodeBench.BigCodeBench-CompleteBigCodeBench-InstructHumanEval+0.8490.8610.8640.894LiveCodeBench0.8530.8980.7780.815We compare model performances onBigCodeBench-Completeagainst existing benchmarks like HumanEval+and LiveCodeBenchused for evaluating the coding capabilities of LLMs. We compute the Pearson and Spearman correlation coefficients for the calibrated model ranks onBigCodeBench-CompleteandBigCodeBench-Instructagainst HumanEval+ and LiveCodeBench. FromTable 3, we observe the strong correlations for both coefficients, suggesting thatBigCodeBenchis well aligned with the mainstream evaluation trend. However, asBigCodeBenchmeasures the different aspects from HumanEval+ and LiveCodeBench, some models are expected to have various ranks among these benchmarks. In addition, we note that models which have saturated HumanEval like GPT-4o, still have room for improvement onBigCodeBenchin comparison to human performance.
body
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Section 5
2406.15877
6Related WorkLarge Language Models for CodeWith the rise of LLMs, there have been various models trained on code. Codexmarks the first base LLM pre-trained on code, which was used as the backbone model for GitHub Copilot. More recently, pre-trained base code modelshave been built to perform accurate code completion.
Later, with the advance in instruction tuning, LLMs can generate the code snippet that aligns with the given NL instruction.
Instruction-tuned code models, are generally better at programming than their base ones.Programming BenchmarksTo assess the programming capability of LLMs, researchers have proposed many programming benchmarks. Most existing benchmarks focus on short, self-contained, and algorithm-specific programming tasks, such as HumanEvaland MBPP.
Recently, open-domain coding benchmarkshave been built to challenge code LLMs on application-specific scenarios by using specific sets of tools and libraries.
However, they focus on simple intents and use limited specific function calls per programming task, making their evaluation less challenging and realistic.
Benchmarks like SWE-benchare built to evaluate the performance of a code agent framework (e.g., iterated prompting, real-time environment interaction, and long-context exploration) .
OurBigCodeBenchfocuses on evaluating the fundamental code generation capability of LLMs, which is also an essential path toward strong code agents.
In addition, SWE-Bench is constructed from GitHub repositories with existing test cases — which limits the diversity of the tasks considered. In contrast, our collaborative LLM-human annotator procedure allows generating tasks from seed queries from StackOverflow (collected in) , tackling a broader range of software tasks.
body
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Section 6
2406.15877
7ConclusionWe introduceBigCodeBench, a new high-quality programming benchmark constructed via the collaboration between human experts and LLMs, assessing the capability of tool use and complex instruction following. Through the extensive evaluation of 60 LLMs, we find that there is a long way for models to achieve perfection on this benchmark and share a few findings that can potentially improve the performance. We urge the community to work on more advanced LLMs for code and continually build upon our benchmark as discussed in our long-term roadmap (Appendix D) .
body
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Section 7
2406.15877
AcknowledgementsWe truly appreciate BigCode making many great works happen, including The Stack, SantaCoder, StarCoder, OctoPack, Astraios, StarCoder2, and StarCoder2-Instruct.BigCodeBenchcannot be built without the support of the BigCode community. We thank Sea AI Lab and MASSIVE for providing the computational resources. The project is also partially supported by Terry Yue Zhuo’s CSIRO’s Data61 PhD Scholarships and Xiaoning Du’s Google Research Scholar Program Award. For the benchmark, we particularly thank Xiangru Tang, Dmitry Abulkhanov, Noah Ziems, Chengran Yang, Jiamou Sun, Nickil Maveli, and Lili Bo for their eagerness to participate. We are extremely grateful to the EvalPlus team for their open-source evaluation framework. We also thank Loubna Ben Allal, Zhiruo Wang, Zhensu Sun, Sean Hughes, and Zhou Yang for their valuable comments.
conclusion
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Section 8