import textwrap EXAMPLES = [ { "label": "Drew on democratic elections", "inputs": textwrap.dedent(""" Elizabeth Drew: "Can We Have a Democratic Election?" (2012) A simple, stylized reconstruction: ```argdown (1) The power of organized moneyed interests in the electoral system (in which the presidential election will take place) is growing. {formalization: "F(a)", declarations: {"a": "the presidential election", "F": "will take place in an electoral system where the power of organized moneyed interests is growing"}} (2) If the power of organized moneyed interests in the electoral system (in which a given election will take place) is growing, then that very election will be subjected to seriously self-interested contortions. {formalization: "all x.(F(x) -> G(x))", declarations: {"G": "will be subjected to seriously self-interested contortions"}} -- {from: ["1","2"]} -- (3) The presidential election will be subjected to seriously self-interested contortions. {formalization: "G(a)"} ``` """), "verifier_id": "log_reco", }, { "label": "Krugman on planet to exploit", "inputs": textwrap.dedent(""" An argument from Paul Krugman's NYT column: "Running Out of Planet to Exploit" (April 28 2008) ```argdown (1) Either supply for oil (and natural resources) will increase in the near term or the era of cheap resources is over for good. {formalization: "p or q", declarations: {"p": "supply will increase in the near term", "q": "the era of cheap resources is over for good"}} (2) Supply for oil (and natural resources) will not increase in the near term. {formalization: "-p"} -- {from: ["1","2"]} -- (3) The era of cheap resources is over for good. {formalization: "q"} (4) Cheap natural resources are required for raising living standards. {formalization: "r", declarations: {"r": "cheap natural resources are required for raising living standards"}} (5) If cheap resources are required for raising living standards, but there will be no cheap resources in the future, then it will be harder for all countries to further raise their standard of living. {formalization: "r -> s", declarations: {"s": "it will be harder for all countries to further raise their standard of living"}} // FLAWED FORMALIZATION here renders first sub-argument irrelevant, change this to "(q & r) -> s" -- {from: ["3","4","5"]} -- (6) It will be harder for all countries to further raise their standard of living. {formalization: "s"} (7) If it becomes harder, for all countries, to further raise their standard of living, then some poor countries face the serious risk of collapse into anarchy. {formalization: "s -> t", declarations: {"t": "some poor countries face the serious risk of collapse into anarchy"}} -- {from: ["6","7"]} -- (8) It will be harder for rich countries to further raise their standard of living, and some poor countries face the serious risk of collapse into anarchy. {formalization: "s and t"} ``` """), "verifier_id": "log_reco", }, ] def get_examples(): return [ [example["inputs"], example["verifier_id"]] for example in EXAMPLES ] def get_example_labels(): return [ example["label"] for example in EXAMPLES ]