Philosophy

23 Foundations of Science The official Journal of the Association for Foundations of Science, Language and Cognition ISSN 1233-1821 Volume 24 Number 1 Found Sci (2019) 24:171-195 DOI 10.1007/s10699-018-9563-1 The Origins of Life: The ManagedMetabolism Hypothesis John E. Stewart 1 23 Your article is published under the Creative Commons Attribution license which allows users to read, copy, distribute and make derivative works, as long as the author of the original work is cited. You may selfarchive this article on your own website, an institutional repository or funder's repository and make it publicly available immediately. Vol.:(0123456789) Foundations of Science (2019) 24:171–195 https://doi.org/10.1007/s10699-018-9563-1 1 3 The Origins of Life: The Managed‐Metabolism Hypothesis John E. Stewart1 Published online: 27 July 2018 © The Author(s) 2018 Abstract The 'managed-metabolism' hypothesis suggests that a 'cooperation barrier' must be overcome if self-producing chemical organizations are to undergo the transition from non-life to life. This dynamical barrier prevents un-managed autocatalytic networks of molecular species from individuating into complex, cooperative organizations. The barrier arises because molecular species that could otherwise make significant cooperative contributions to the success of an organization will often not be supported within the organization, and because side reactions and other 'free-riding' processes will undermine cooperation. As a result, the barrier seriously impedes the emergence of individuality, complex functionality and the transition to life. This barrier is analogous to the cooperation barrier that also impedes the emergence of complex cooperation at all levels of living organization. As has been shown at other levels of organization, the barrier can be overcome comprehensively by appropriate 'management'. Management implements a system of evolvable constraints that can overcome the cooperation barrier by ensuring that beneficial co-operators are supported within the organization and by suppressing free-riders. In this way, management can control and manipulate the chemical processes of a collectively autocatalytic organization, producing novel processes that serve the interests of the organization as a whole and that could not arise and persist in an un-managed chemical organization. Management self-organizes because it is able to capture some of the benefits that are produced when its interventions promote cooperation, thereby enhancing productivity. Selection will therefore favour the emergence of managers that take over and manage chemical organizations so as to overcome the cooperation barrier. The managed-metabolism hypothesis demonstrates that if management is to overcome the cooperation barrier comprehensively, its interventions must be digitally coded. In this way, the hypothesis accounts for the twotiered structure of all living cells in which a digitally-coded genetic apparatus manages an analogically-informed metabolism. * John E. Stewart firstname.lastname@example.com 1 Evolution, Complexity and Cognition Group, Center Leo Apostel, Vrije Universiteit Brussel, Brussels, Belgium 172 J. E. Stewart 1 3 Graphical Abstract Keywords Managed-metabolism * Origins of life * Cooperation barrier * Chemical evolution * Autocatalytic organization * Evolutionary transitions 1 Introduction and Conceptual Overview This is the first detailed presentation of the 'managed-metabolism' hypothesis of the transition from non-life to life. The hypothesis is best understood in the context of the two classes of competing hypotheses of the origins of life that each currently are supported by numbers of researchers. These are the 'gene-first/RNA world' hypotheses; and the 'metabolism-first' hypotheses. For this reason, I will begin by outlining both these morefamiliar hypotheses, and identify the main reasons why each have failed to attract general acceptance by researchers. Then I will outline the main conceptual features of the managed-metabolism hypothesis and show how it overcomes the deficiencies of the existing hypotheses. In the remainder of the article, I will set out to substantiate the key elements of the managed-metabolism hypothesis in detail. 1.1 Gene‐First/RNA World Hypotheses Gene-first hypotheses about the origins of life appear to continue to have significant support amongst many researchers (Woese 1967; Orgel 1968; Gilbert 1986; Pross 2004; Robertson and Joyce 2012; Higgs and Lehman 2015). Broadly, these hypotheses suggest that life began with the emergence of RNA molecules that had two critical capacities: an ability for template-based self-replication and an ability to catalyse other reactions. As such, these molecules were capable of undergoing the standard evolutionary process: errors arising 173The Origins of Life: The Managed-Metabolism Hypothesis 1 3 during copying of the molecules produced variant molecules; and variants that went on to reproduce more successfully tended to increase their representation in the population of molecules (e.g. by using their catalytic capacity to catalyse reactions that enhanced their own replication). According to these hypotheses, nothing more was needed: once RNA with these two capacities emerged, life as we know it was up and running. On the surface, these hypotheses do not seem to demand anything more of the first genes than is currently achieved by familiar gene-based evolutionary processes. It seems reasonable to assume that evolving RNA self-replicators would progressively discover and accumulate beneficial adaptations, just as organisms do now when they evolve. The hypotheses go on to propose that the RNA replicators would progressively build around themselves increasingly complex metabolisms that would enhance the RNA's capacity to reproduce and survive. Gene-first hypotheses also seem to be consistent with the view that self-replicating genes specify the 'blueprint' for the cell that contains them. If this 'blueprint' metaphor accurately reflects the role of genes in a cell, it is easy to see how natural selection operating on variation in genes could gradually adapt and improve the blueprint to specify arrangements that are more adaptive. However, on closer examination it is highly implausible that this proposed process could somehow clothe 'naked' self-replicating RNA molecules in a highly complex, dynamical metabolism, starting with nothing. It is particularly implausible that this could be achieved by an evolutionary mechanism that operates 'top down' through variation in RNA and that generally makes only one small change at a time. No one has yet demonstrated in theory or practice that this is possible for a replicator that starts out 'naked' (Baum 2015). It is true that existing organisms (including simple cells) that contain genetic replicators are able to respond to selection with long sequences of adaptive change. But they already have a supporting metabolism which includes complex machinery that potentially enables genes to have adaptive and sustainable effects in the cells that contain them. They don't start with nothing and build this complex enabling machinery from scratch. In this respect, the genefirst hypothesis seems even less plausible than an analogous 'government first' hypothesis of the origins of hierarchical human societies i.e. the proposition that these societies began with the emergence of 'naked' governments that then proceeded to somehow create around themselves all the rest of society (including economic and agricultural systems), starting from scratch. Such a hypothesis about human societies would be even more difficult to accept if governments were only able to establish and adapt governance through blind trial and error. Evidence from modern cells supports the view that RNA did not create from scratch its associated metabolism. If RNA had done so, the genetic apparatus of modern cells would be expected to contain all the information needed to reconstruct the cell and all its contents, including its metabolism. The genetic apparatus would include a blueprint for the building of a cell from scratch (Feitelson and Treinin 2002). But there is strong evidence that the genetic apparatus of modern cells does not contain all this information. In particular, it is evident that the processes and structures that are produced by a particular protein which is encoded by the genetic apparatus are not determined by the nature of the protein alone. Instead, they are determined by the interactions between the protein and the existing contents, processes and spatial structures of the cytoplasm. Cytoplasmic context is critically important in co-determining the effects of any protein coded by the genetic apparatus (Hoffmeyer and Emmeche 1991). Information in the cell is therefore contained in both the genetic apparatus and cytoplasm. This would not be such a problem for 'gene-first' hypotheses if the genetic apparatus produces the cytoplasm from scratch. But it does not. Nor is it capable of doing so. In 174 J. E. Stewart 1 3 particular, there are many examples of super-molecular structures within cells that are never re-created from scratch within the cell. Instead they are replicated only by processes in which existing structures serve as scaffolding and templates for the production of new structures. In the absence of this scaffolding, the genetic apparatus cannot recreate the structures. Examples where this has been established include organelles within the cells such as the endoplasmic reticulum, cilia, mitochondria and the membranes that are part of many other structures (Nanney 1968; Yaffe 1999; Roth 1999; Cavalier-Smith 2004). It is clear that the genetic material in the cell is not at all like a blueprint for a building that specifies the location and structure of walls, windows, roof and floor and the spatial relations between them (Feitelson and Treinin 2002). It is now widely accepted in relation to eukaryote cells that some cellular organelles such as mitochondria had an evolutionary origin and history independent of the cells that now contain them (Margulis 1981). It seems likely that other super-molecular structures now found in the simplest of know cells also had an evolutionary origin and history independent of the genetic apparatus. What about other components of the metabolisms now embodied in the cytoplasm of cells, such as metabolic cycles and processes? Could they have also emerged and evolved to some extent independent of any self-replicating RNA? Whether they could is an issue of critical importance for understanding the origins of life. This is not just because it points to a viable alternative to the implausible proposition that metabolisms were progressively created from scratch by RNA. It is because even if naked genes were somehow capable of building metabolisms, they would have been highly unlikely to do so if they could instead simply take over and manage metabolisms that had already emerged and evolved. We will see in Sect. 1.2 below that metabolism-first hypotheses suggest that metabolisms emerged and evolved before the advent of self-replicating RNA. The other major difficulty with gene-first hypotheses is the failure of attempts to demonstrate that a suitable self-replicating RNA molecule could arise from some plausible organic soup. This is proving to be a major challenge: so far, suitable RNA replicators have not been shown to emerge even in organic soups that are designed, structured, manipulated and carefully constrained by teams of highly-qualified human chemists (e.g. see Bernhardt 2012). 1.2 Metabolism‐First Hypotheses According to 'metabolism-first' hypotheses of the origins of life, proto-metabolisms in the form of organizations of molecular species emerged and evolved first without any involvement of self-replicating RNA (Oparin 1957; Dyson 1985; Bagley and Farmer 1991; Kauffman 1993; Trefil et al. 2009; Vasas et al. 2012; Virgo and Ikegami 2013; Nighe et al. 2015). These proto-metabolisms are postulated as being self-producing and self-amplifying because the formation of each and every member of the metabolism is catalysed by at least one other member of the metabolism, and because they have access to a suitable source of free energy and other necessary resources. Collectively such a network of molecular species is autocatalytic. The constituents of the proto-metabolism cooperate together to amplify each other's formation. Such a metabolic organization can include catalytic polymers and small-molecule autocatalytic cycles and processes. The strength of metabolism-first hypotheses is that they can account for the emergence of proto-metabolisms without relying on the implausible assumption that metabolisms can be created from scratch by self-replication RNA molecules. A strong case can be made that simple, self-producing cooperative organizations of molecular species can emerge readily 175The Origins of Life: The Managed-Metabolism Hypothesis 1 3 under suitable conditions (Kauffman 1993). However, the key weakness of metabolismfirst hypotheses is that the extent to which simpler organizations can evolve into highly complex, dynamical metabolisms is seriously limited (Stewart 1995, 1997, 2000; Vasas et al. 2012; Nighe et al. 2015). The reason for this is analogous to the existence of the 'cooperation barrier' that impedes the emergence of cooperative organizations at all levels of living organization, including amongst humans. First, cooperation in a molecular organization will tend to be undermined by free-riding. This occurs where a molecular species takes resources from the cooperative metabolism without contributing anything in return. Second, and more significantly, there are likely to be many cooperative molecular species that could contribute significantly to the survivability of the organization, but are not themselves supported catalytically within the organization. No matter how much these cooperative molecular species might contribute to a metabolic organization, they will not be able to persist within the organization. The possibility space that can be explored by organizations will not include organizations that contain any of these cooperative molecular species. It is evident that collectively-autocatalytic organizations of molecular species were not capable on their own of evolving into complex cooperative metabolisms. Something additional was needed. 1.3 The Managed‐Metabolism hypothesis The managed-metabolism hypothesis demonstrates that particular kinds of self-producing organizations can emerge that are not restricted by the cooperation barrier (Stewart 1995, 1997, 2000, 2014). Unlike the self-producing proto-metabolisms envisaged by metabolismfirst hypotheses, the proto-metabolisms envisaged by the managed-metabolism hypothesis are eventually able to evolve complex functionality and individuality. The managed-metabolism hypothesis shows how this can be achieved through the emergence of 'management' which can govern self-producing cooperative proto-metabolisms. This management is constituted by self-replicating RNA or similar self-replicating polymers. Management can overcome the cooperation barrier which besets self-producing proto-metabolisms. It can do so by using its catalytic power to suppress free-riders and to support cooperative molecular species that would not otherwise persist in the protometabolism. Ideally management is able to catalytically support beneficial co-operators at whatever levels are optimal in order to achieve stability and effectiveness as circumstances change. As a result, the possibility space that can be explored by managed metabolisms is much greater than that available to un-managed metabolisms. This much-expanded possibility space includes forms of cooperative organization that can include combinations of all the cooperative molecular species that would contribute significantly to the survivability of the organization, but that would not otherwise be supported catalytically within the protometabolism. With the emergence of managed metabolisms, novel chemical processes could be constructed that would not arise spontaneously in un-managed proto-metabolisms. These novel processes did not arise previously on Earth. A new chemistry, 'managed chemistry', emerged for the first time. But why would self-replicating RNA use its power to manage self-producing protometabolisms in ways that tend to overcome the cooperation barrier? Why would it not just use its power to plunder from metabolisms whatever resources it could use to facilitate its own replication? The managed-metabolism hypothesis suggests that RNA which could 176 J. E. Stewart 1 3 harvest an on-going stream of benefits from a particular proto-metabolism could do better in some circumstances than RNA that plundered and moved on. Importantly, this stream of benefits could be greatly enhanced if the RNA used its power to overcome the cooperation barrier, thereby increase the productivity of the proto-metabolism. In this way, selection operating on the RNA could favour the emergence of managers that 'farm' a metabolism and use their power to enhance its productivity. To provide a broad understanding of the managed-metabolism hypothesis, it is useful to explore an analogy at the human level that will be more familiar to many. Complex human societies can come into existence only if two components operate together. One is a social and economic system that uses materials, energy and other resources to produce itself through time. The other is a powerful government that organises and coordinates that system. Without government, simple social systems cannot evolve into the complex, cooperative systems that characterise modern societies. As Hobbes and others have demonstrated, without government (i.e. without 'The Leviathan'), the life of man will be 'solitary, poor, nasty, brutish and short' (Hobbes 1651). However, powerful governance changes everything. It can suppress the free-riding and thieving that otherwise prevents complex cooperation, and can actively support co-operators to ensure that cooperation pays (e.g. it can raise taxes to fund an army or an education system). The managed-metabolism hypothesis argues that the transition to life also required the co-evolution of two analogous components. The autocatalytic organizations of chemical species that gave rise to metabolisms equate to the economic and social systems in human societies. The RNA equates to the powerful Government that manages human societies (the RNA apparatus is 'The Leviathan' of the early cell). Just as powerful governance is essential if complex social and economic systems are to emerge, powerful RNA was essential to enable simple chemical organizations to evolve into complex, cooperative metabolisms. RNA achieved this by suppressing the free-riders that would otherwise undermine complex cooperation, and by supporting co-operators to ensure cooperation paid. It was in the evolutionary interests of RNA to govern metabolisms in this way because it could capture some of the increased productivity that was produced by its governance. The rest is evolution. It is also worth emphasising at this point that the managed-metabolism hypothesis is founded on a relational perspective about the nature of living processes: the hypothesis suggests that the dynamical relationships between the constituents of living processes are of paramount importance for understanding life (e.g. see Razeto-Barry 2012). In the main, the specific nature of the entities that constitute living organizations is significant only insofar as it influences the dynamical relationships that the entities can enter into, and the forms of organization in which they can participate. This relational perspective recognizes that there are a huge number of ways of organizing and combining the constituents of living processes that will not qualify as life. And there is only a comparatively infinitesimal number of ways of organizing them that will constitute life. A key goal of this article is to identify the particular forms of organization that were able to transition from non-life to life. The remainder of this article will substantiate more rigorously and in greater detail the managed-metabolism hypothesis that has been sketched conceptually here. Section 2 of this article demonstrates in detail that metabolic organizations would have encountered a 'cooperation barrier'. This barrier would prevent them from developing the complex individuality that arguably is essential to the transition from non-life to life. This is analogous to the 'cooperation barrier' that is faced by cooperative organizations when they emerge at any level of organization of living processes. Section 3 examines the nature of the 177The Origins of Life: The Managed-Metabolism Hypothesis 1 3 cooperation barrier that arises at these other levels, and Sect. 4 identifies how it has typically been overcome through the emergence of systems of evolvable constraints that are termed 'management' in this paper. Section 5 of the paper applies this understanding of management to the evolution of chemical organizations. It identifies how evolution is likely to have overcome the cooperation barrier facing proto-metabolisms by favouring the emergence of management in the form of RNA, thereby enabling the transition from non-life to life. Section 6 examines the relationship between the managed-metabolism hypothesis and other hypotheses about the origin of life. It also considers how the managed-metabolism hypothesis could be developed further and tested. 2 The Cooperation Barrier and the Evolution of Metabolic Organizations Reaction networks of molecular species that are self-producing because of their cooperative catalytic activity have been shown theoretically to exhibit some evolvability (Vasas et al. 2012; Virgo and Ikegami 2013; Nighe et al. 2015; Hordijk and Steel 2017). Simulations have shown that alternative autocatalytic reaction networks of organic polymers that coexist in the same environment can compete and undergo a form of natural selection. The heritable component of these reaction networks comprise viable cores which are self-sustaining collections of molecular species that catalyse each other's formation (Vasas et al. 2012). Competition and selection can occur between viable cores within a network as well as between networks that contain various combinations of different viable cores. Novel variation can arise between reaction networks in relation to viable cores through a number of processes, including by the acquisition of new cores through rare chemical events (Vasas et al. 2012; Virgo and Ikegami 2013). Compartmentalisation of reaction networks can enhance selection between networks and the accumulation of adaptations. Self-sustaining cooperative networks of organic polymers together with food sources and small-molecule autocatalytic cycles (e.g. pre-cursors of the reductive citric acid cycle with polymers catalysing steps in the autocatalytic cycle (Virgo and Ikegami 2013) could conceivably evolve by these processes as proto-metabolisms. However, the evolvability of these cooperative reaction networks is seriously limited by what I refer to as a 'cooperation barrier'. As I will show in more detail in the next section, this dynamical barrier is analogous to the cooperation barrier that impedes the evolution of cooperative organization at all levels or organization, including amongst human and other multicellular organisms (Stewart 1995, 2000, 2014). It turns out that the cooperation barrier facing self-producing organizations of molecular species must be overcome if the organizations are to make the transition from non-living chemical processes to life. The nature of this barrier can be understood by considering an organization of molecular species that is self-producing because it is collectively autocatalytic-i.e. the formation of every species in the organization is catalysed by at least one other species (directly or indirectly), and the organization has access to appropriate sources of free energy and 'food' molecules. The organization contains a number of viable cores in which the formation of all molecular species is catalysed by all other members of the core. The cooperation barrier arises because molecular species that could contribute cooperatively to the survivability of a core and the organization as a whole may not be produced and sustained at an optimal level within the organization. This can be the case irrespective of the significance of the contribution that these species could make to the success of the organization. 178 J. E. Stewart 1 3 How does such a barrier arise out of the dynamics of autocatalytic organizations? First, the formation of a beneficial molecular species might not happen to be catalysed by any other member of the organization (or it may not be catalysed at a level that is optimal for the organization). This is not likely to be uncommon-there is nothing at all in the nature of autocatalytic organization that guarantees that any particular molecular species that contributes positively to the organization will be catalysed in return. Second, it might occur where 'free-rider' molecular species and associated 'side reactions' take resources from the organization but do not contribute anything (or sufficient) in return (e.g. they do not catalyse the formation of other members of the organization). Free-riders can reduce the catalytic support, energy and material resources that might otherwise be available to members of the organization, undermining their ability to persist and contribute to the organization. Because free-riders do not use their resources to contribute to the organization, they may also out-compete those that do. The susceptibility of an organization to be undermined by free-riders is likely to increase as its complexity increases (Szathmáry et al. 2005). It is worth indicating here in more detail what is meant by the terms 'co-operator', 'unsupported co-operator' and 'free-rider' at the level of chemical organisation. It is particularly useful to relate these terms to the use of similar terms at the level of biological organisation. At the biological level, a co-operator organism is one which interacts with other organisms in ways which provide the others with fitness benefits e.g. by increasing the capacity of the others to reproduce successfully. Analogously, a co-operator molecular species is one which increases the rate at which other molecular species are produced in a chemical system by, for example, catalysing the formation of those molecular species. At the biological level, a supported (or non-altruistic) co-operator is one which can reproduce successfully in the population because it benefits sufficiently from its cooperative interactions with others (i.e. the benefits it captures outweigh the fitness costs of its own cooperative actions). And an unsupported (or altruistic) co-operator is one which does not obtain sufficient benefits to reproduce successfully. Analogously, a molecular species which is a supported (non-altruistic) co-operator is one whose formation (reproduction) is supported sufficiently within the organisation (e.g. by catalysis from other molecular species) for it to be sustainable within the organisation. An unsupported (altruistic) molecular species is one which does not receive sufficient support within the organisation to be sustainable. At the biological level, a free-rider organism is one which receives fitness benefits from co-operator organisms, but does not provide fitness benefits in return. Analogously, a free-riding molecular species has its formation enhanced by co-operator molecular species (e.g. the co-operators might catalyse the formation of the free-rider), but does not provide benefits to the co-operators in return (e.g. it does not catalyse the formation of other co-operators). Figure 1 is a schematic depiction of the architecture of a simple catalytic reaction network of molecular species which includes un-supported co-operators and free-riders. In Fig. 1, each molecular species is represented by a circle containing a letter. The organizational architecture (excluding free-riders) is enclosed by a dotted line. The arrows between molecular species represent catalysis. The architecture shows that the formation of each member of the autocatalytic organization is catalysed by at least one other member. Molecular species J and X are unsupported (altruistic) co-operators: they contribute to the organization by catalysing the formation of members of the organization, but their own formation is not catalysed by any member of the organization. Molecular species K and R are freeriders: their formation is catalysed by members of the organization, but they don't contribute anything in return to the organization. The cooperation barrier significantly limits the evolvability of autocatalytic organizations of chemical species. Organizations that are self-producing cannot include 179The Origins of Life: The Managed-Metabolism Hypothesis 1 3 molecular species that could contribute significantly to the survivability of the organization but are not supported adequately within the organization. Such altruistically cooperative molecular species would not be produced within the organization and cannot persist as part of it (they are not dynamical attractors). Organizations that contain such species cannot be sustained or called into existence by selection, no matter how powerful the selection is, or how much the species would increase the competitiveness of the organization as a whole. Complex cooperative arrangements amongst molecular species that would produce highly advantageous supra-molecular structures, processes, and sub-systems could not evolve if any of the molecular species or processes that constitute them were unable to persist and be reproduced within the organization. As a consequence, molecular organizations that are subject to the cooperation barrier are able to explore only a tiny proportion of the possibility space of logically conceivable organizations. This seriously impedes the ability of catalytic reaction networks of molecular species to evolve into complex, cooperative organizations. As we shall see in Sect. 4 below, group selection and compartmentalization are unable to overcome the cooperation barrier sufficiently. Organizations that were restricted by the cooperation barrier would not have been able to evolve the complex adaptive functionality that characterises all know living cells and constitutes their individuality [this paper takes the position that self-producing organizations do not qualify as living unless they exhibit individuality supported by complex functionality. For detailed discussion of the basis of this position, see Stewart (2000) and Maynard Smith and Szathmáry (1995)]. The chemistry that operates within the kinds of autocatalytic reaction networks that have been conceived of to date cannot produce the complex cooperative Fig. 1 The architecture of a collectively autocatalytic chemical organization 180 J. E. Stewart 1 3 organization that characterises life. For the transition to life, a new kind of chemistry was needed. 3 The Cooperation Barrier and Other Major Evolutionary Transitions It is not only molecular organizations whose ability to explore the space of organizational possibilities is limited by a cooperation barrier. Cooperation barriers also impede the emergence of complex cooperative organization at each and every level of living organization. For example, the cooperation barrier impeded the emergence of the cooperative organizations of eukaryote cells that became multicellular organisms, the organizations of organisms that became animal societies, the organizations of humans that became tribal societies, the organizations of human groups that became nation states, and is currently impeding the emergence of a complex, cooperative planetary entity. It should be noted that these emergences include many but not all of the major evolutionary transitions identified by Maynard Smith and Szathmáry (1995) (e.g. it does not include sexual reproduction), and includes emergences that they do not (e.g. the emergence of a cooperative global organization [Stewart 2014]). In order to work out how the cooperation barrier could have been overcome in the transition from non-life to life, it is useful to draw on the large body of research that has contributed to understanding why a cooperation barrier arises at other levels of organization and how it has been overcome at those levels. A generalized agent-based approach can be used to understand how the cooperation barrier arises out of the dynamics of cooperative organizations at all levels (Stewart 2016). Using this approach, the entities at each particular level are represented as agents (e.g. agents can be prokaryote cells, eukaryotes, multicellular organisms [including humans], tribes, nations etc.). Agents are capable of adaptation. Adaptation tends to maximize a function such as fitness or psychological utility. Agents may adapt by any process (e.g. including by processes as disparate as gene-based natural selection or psychological mechanisms). Agents are able to interact with each other in ways that may be adaptively advantageous. Cooperative organizations of agents will emerge where adaptations that constitute cooperative relationships between agents are also sufficiently beneficial to the individual agents themselves (e.g. where the adaptations provide net fitness or utility benefits to the individual agents that exhibit them). Where this condition is met, the relationships and the organization they constitute can persist and be reproduced through time [Ulanowicz (2009) demonstrates convincingly that this can lead to the emergence of simple self-producing organizations at all levels of organization]. However, if agents fail to benefit sufficiently from cooperative interactions, the adaptations that underpin the cooperation will not be reproduced and persist, no matter how much the cooperation benefits the organization as a whole. In many circumstances, individual agents will not benefit sufficiently from advantageous cooperative interactions, despite the potential of many forms of cooperation to significantly increase the net benefits available to the organization. This will be the case if co-operators fail to capture enough of the benefits they produce to outweigh the costs of their cooperation. As the huge body of research on cooperation referred to below has demonstrated, this failure is commonplace. There is nothing in simple, unstructured forms of organization which guarantees that co-operator agents will always capture sufficient of the benefits they create. To the contrary, agents that support co-operators will tend to be 181The Origins of Life: The Managed-Metabolism Hypothesis 1 3 outcompeted by agents that use resources only for their own benefit, without providing sufficient benefits to the organization in return (e.g. free-rider agents, including parasites, cheats and thieves). Free-riders will also tend to out-compete the co-operator agents themselves, and take resources that might otherwise support co-operators. Furthermore, there is nothing that guarantees that free-rider agents will always capture the 'harms' that they visit on the organization. For all these reasons, free-rider agents will tend to undermine complex cooperative organization. As a consequence, the cooperation barrier will seriously restrict the possibility space of complex cooperative organization that can be explored at any level of organization. All forms of organization that include agents that provide significant net benefits to the organization but fail to capture sufficient of those benefits will not be able to persist (the sustained existence of their organizations will not be dynamical attractors). 4 Mechanisms that Can Overcome the Cooperation Barrier A huge literature attempts to identify particular mechanisms which enable co-operator agents to capture sufficient of the benefits they create to enable the emergence of some form of cooperative organization [e.g. see Stewart (2014) for a brief overview]. These mechanisms generally rely on co-operators capturing a disproportionate share of the benefits of cooperation because of the existence of circumstances which ensure they are disproportionately likely to interact with other co-operators. These biased patterns of interaction are typically produced by constraints that manifest as, for example: particular dispersal patterns; kin selection; group formation; compartmentalization; stochastic correction; other forms of population structure; pre-dispositions to cooperate preferentially with other cooperators; and pre-dispositions to punish and exclude free-riders. However, in general this body of research confirms the reality of the cooperation barrier. It has demonstrated that complex cooperative organization does not evolve readily. It has shown that simple cooperative relationships can emerge, but only in limited circumstances. Most researchers in this field would accept that the research has so far been unable to identify a general mechanism that could operate at all levels of organization and that would enable complex cooperative organization to emerge readily [e.g. see Maynard Smith and Szathmáry (1995) and Calcott and Sterelny (2011)]. It has been shown that compartmentalization and group selection operating at the level of compartments can facilitate the emergence of some cooperation at the molecular level, particularly by the suppression of free-riders [e.g. see Szathmáry and Demeter (1987) and Maynard Smith and Szathmáry (1995)]. But it has not been demonstrated that this mechanism can account for the emergence of the complex cooperative organization that characterizes life. Primarily this is because group selection by itself cannot account for the emergence of altruistic molecular species that contribute significantly to the success of the organization as a whole, but don't receive any support in return. This holds true despite that fact that models of group selection at higher levels of organization have been shown to be capable of accounting for the emergence of co-operation to some degree in some circumstances [e.g. see Okasha (2006)]. These models have been able to do so only because they assume that co-operators capture benefits from cooperative interactions with other co-operators. This allows co-operators to capture a disproportionate share of the benefits of cooperation where the population structure facilitates this. However, this mechanism 182 J. E. Stewart 1 3 cannot account for the emergence of molecular species that are altruistic co-operators and therefore are unsupported within the organization. This is because these altruistic molecular species will fail to capture any benefits through interactions with other co-operators, no matter how disproportionately they interact with them. The assumption that co-operators will benefit from interactions with other co-operators is a reasonable one where agents are organisms, but not where they are altruistic molecular species. But the cooperation barrier has been overcome repeatedly and comprehensively during the actual evolution of life on this planet, enabling the emergence of complex cooperative organization at various levels. What mechanism(s) have enabled this? It is clear from the agent-based perspective sketched above that agents who provide significant net benefits to an organization would be able to persist if 'consequence-capture' applies-i.e. if agents capture sufficient of the benefits (and harms) they produce to sustain them at an optimal level in the organization. Comprehensive consequence-capture would massively expand the possibility space that can be explored by organizations at any level (Stewart 2016). But what can enable consequence-capture? The emergence of what have been termed 'managers' can enable comprehensive consequence-capture within the organizations they manage (Stewart 1995, 2000, 2014, 2016). Managers are powerful, evolvable agents (or coalitions of agents) that can control an organization to support co-operators and to suppress free-riders. Managers control an organization by applying constraints. Constraints can influence the dynamical behaviour within the organization without being influenced in return [this is the essence of control (Salthe 1985)]. Constraints can operate to direct resources preferentially to co-operator agents that would otherwise be altruistic, and can punish or suppress free-riders. In order to apply constraints, managers must function independently of the dynamical interactions within the organization proper. They must be able to stand outside and be able to act across the dynamic. The dynamical separation of a manager from an organization often results from the fact that the processes that constitute managers are larger in scale, involve slower rate processes and/or are relatively more stable than the processes that constitute the organization proper. Managers do not depend for their success on participation in exchange relations and other dynamical interactions within the organization they manage. If they did, they could not act independently of the organization. Instead, managers can use their constraining power to appropriate whatever resources they need from the organization. For a more detailed discussion of constraints and how they arise at any level of organization, see Salthe (1985). Without the capacity to constrain, any attempt by managers to appropriate resources for themselves or to distribute resources to particular agents could be undermined by other agents, and free-riders could escape control. Just as powerless members of a human organization are unable to control or manage the organization, powerless agents within an organization cannot apply constraints to it or begin to manage it-they cannot influence without being influenced in return. Because Ryan et al. (2016) fail to take into account this relationship between power and constraints, they fail in their attempt to provide a comprehensive explanation of how the major evolutionary transitions in individuality were enabled. In particular, they fail to justify the feasibility of their key assumption: they assume that a single allele could somehow empower otherwise ordinary members of a population to apply pro-social constraints that suppress free-riders (including by punishing them), and then maintain cooperation in the face of thieving and other forms of free-riding. Furthermore, they fail to justify their highly questionable assumption that selection would favour individuals who use power pro-socially, rather than individuals who use their power to increase their fitness in more direct ways e.g. by simply appropriating benefits produced by others. 183The Origins of Life: The Managed-Metabolism Hypothesis 1 3 Figure 2 is a schematic representation of the architecture of an externally-managed organization of agents. In Fig. 2, each agent is represented by a circle containing a letter. The organizational architecture is enclosed by a dotted line. M represents the powerful, evolvable manager. The part of the organization that does not include the manager is comparable to the autocatalytic architecture depicted in Fig. 1. The two agents marked 'F' are free-riders on that autocatalytic organization, and the two agents marked 'C' are co-operators that contribute to the autocatalytic organization but are not supported in return. The normal arrows represent the flow of benefits within the organization. The bolded arrows originating from the manager represent support by the manager for the two co-operators (C) that are not otherwise supported within the organization. The two dashed and bolded arrows originating from the manager represent the suppression by the manager of free-riders (F). Finally, the heavily bolded arrows that point towards the manager represent the unilateral appropriation by the manager of benefits from the organization. Selection can be expected to favour management that adapts its controls more or less continually as circumstances change to ensure that members of the organization are maintained at optimal levels. Moreover, where management itself is comprised of a coalition of agents, it will encounter its own cooperation barrier. This barrier can be overcome by constraints that suppress competition within management. The constraints applied by management can be more or less enabling or more or less prescriptive. Furthermore, management can be external to the agents that are being managed, or can be internal to the agents and distributed across them. Examples of 'external management' Fig. 2 The architecture of an externally-managed organization 184 J. E. Stewart 1 3 include: RNA/DNA management of the metabolism of a cell; management of a human society by its government; and management of the employees of a corporation by the board of directors (in these three examples, the managers may appear to be integrated parts of the organization. However, on closer examination the power relationships between the manager and other members of the organization are unmistakeable). Examples of 'distributed internal management' include: a multi-cellular organism in which the behaviour of cells is controlled across the organization by genetic constraints that are reproduced in each cell; and a human tribal society in which the behaviour of each member is constrained by internalized norms as well as genetic constraints that are reproduced in each member. In the case of internal distributed management, the behaviour of every agent in the organization is controlled and coordinated by a system of constraints that is reproduced within each and every agent. As such, the constraints reach across the entire organization, and also capture the benefits (and harms) produced by their impacts on the organization as a whole. Distributed internal management can be as effective at controlling an organization as external control. But where it operates, it is often mistaken for an absence of control [e.g. see Ostrom (1990)]. Stewart (1997, 2000, 2014) examines in some detail how the coincidence of interests between management and the organization as a whole drives the self-organization and emergence of management (management can appropriate greater resources from an organization that is managed in ways that overcome the cooperation barrier). From the broader perspective developed here, the huge literature on the emergence of cooperation can be seen as a search for particular circumstances in which constraints that allow some degree of consequence-capture just happen to exist. But 'nature' has not limited itself to producing advantageous cooperative organization only in those special circumstances where suitable constraints exist as 'happy accidents'. Instead, in the transition to life and in all subsequent major transitions, 'nature' has incorporated within organizations a mechanism that has the capacity to search for and implement whatever systems of constraints will enable consequence-capture and the emergence of complex cooperative organizations. Evolvable management enables the discovery and implementation of whatever sets of constraints will maximize appropriate consequence-capture in any organization in any situation. 5 The Managed‐Metabolism Hypothesis and the Origins of Life 5.1 The Emergence of Management As was the case at other levels of organization, appropriate management had the potential to overcome the cooperation barrier which was faced by self-producing organizations of molecular species. But what would have driven the emergence of management in the transition from non-life to life? And what characteristics would management need to have in order to manage molecular organizations effectively? The prime candidates for early managers are evolvable coalitions of polymers such as RNA that had the power to intervene catalytically in organizations of molecular species (Stewart 1995, 2000, 2014). Initially, RNA or other coalitions might simply have plundered the contents of collectively autocatalytic organizations, using them to assist their own reproduction and then moving on to plunder other organizations (e.g. by using as 'food' the contents of an autocatalytic organization that include constituents of the RNA molecules). 185The Origins of Life: The Managed-Metabolism Hypothesis 1 3 Importantly, these coalitions would not have participated in the internal catalytic interactions and relationships that occurred within the organizations they exploited. The coalitions would have stood outside the organizations dynamically and appropriated the resources they needed [for more detail on the nature of this relationship, see Salthe (1985)]. The capacity to do this, together with their evolvability and their potential to catalytically intervene in organizations unilaterally, would have given them the potential to control and manage an organization as a proto-metabolism. What would cause these RNA or other coalitions to realize their potential to become managers? Why would they use their power to overcome the cooperation barrier? What would drive the transition from plunderers to managers? Coalitions could achieve an advantage if they discovered ways to use their evolvable catalytic capacities to enhance the productivity of an organization and manage it as a proto-metabolism. This is because coalitions that could increase the productivity of organizations could be able to harvest greater benefits from them for their own use. The existence of the cooperation barrier provided an enormous potential for coalitions to increase their fitness by doing just this. The coalitions could discover ways to intervene in organizations to support cooperative molecular species that contributed to the productivity of the organization, but would not be supported otherwise. Furthermore, they could suppress side-reactions and other free-riders that impede productivity (e.g. by degrading the first catalyst in a chain of side reactions, or by preferentially supporting alternative processes within the organization that did not produce side reactions). Selection would favour coalitions of RNA that managed chemical organizations in ways that increased the benefits they could harvest from the organizations. As a result, coalitions would increasingly move away from just plundering and destroying organizations. Coalitions would progressively become more effective managers, with each coalition managing a particular organization as a proto-metabolism, enhancing the productivity of the organization and increasing the resources that the coalition could harvest on an on-going basis. A coincidence of interests would arise between the coalition and the proto-metabolism it managed. This evolutionary sequence is broadly analogous to the historical transition which was undergone by Mongol tribes: they began as plunderers that destroyed other societies and then moved on to new conquests and pillaging. But eventually the Mongols became rulers of the societies they conquered, introducing systems of governance (management) that enhanced the productivity of the societies. Rather than plunder a society once, they could harvest an enhanced stream of benefits from it on an on-going basis. The development of management capabilities gave RNA 'the power of life and death' over proteins that were supported or inhibited by its catalytic capacities. RNA had the power to determine whether or not these proteins could exist as members of the organization. Maynard Smith and Szathmáry's (1995) seminal book on evolutionary transitions failed to recognise the critical importance of the use of power by managers to enable major evolutionary transitions, including the transition from non-life to life. Maynard Smith and Szathmáry instead argued that the use of power in this way is largely restricted to the human level of organization in the form of armed force and/or a consensus imposed by a majority. Although it is true that RNA was not armed, it nonetheless could develop considerable power over an organization. It was this power that enabled RNA to overcome the cooperation barrier. 186 J. E. Stewart 1 3 5.2 The Transition from Chemistry to Life Effective, evolvable management (whether RNA or otherwise) would have enabled selfproducing organizations to transition from non-living chemistry to life. As we have seen, un-managed, self-producing chemical organizations were only able to explore a possibility space that is seriously limited. But effective, evolvable management would have changed everything. It opened up enormous new areas of possibility space to self-producing organizations, enabling them to go far beyond what is possible through un-managed chemical interactions and processes. Management opened the door to entirely novel and hitherto unknown arrangements of matter that were self-producing. It did so by controlling and manipulating chemical processes so that they served the organization's functions and purposes. The nature and functioning of the constituents of the organization were no longer determined by chemistry alone. They were now dictated by the evolutionary needs of the organization as a whole. With comprehensive consequence-capture, the constituents of self-producing organizations would tend to adapt in ways that served the interests of the organization. As a consequence, managed organizations would tend to evolve and adapt as coherent wholes that could develop all the characteristics of individuality. In contrast, un-managed autocatalytic organizations were like ecosystems-they could contain autocatalytic cycles and processes but would not evolve as individuals (comprehensive management and consequence-capture are prerequisites for the full emergence of individuality). In the service of their individuality, managed organizations could explore an extensive new space of possible organizational forms, relationships, processes and subsystems. These could not arise through normal chemical processes in the absence of management. With the transition to life, a new kind of chemistry emerged on the planet: managed chemistry. Management was the key to the transition from non-life to life. From a thermodynamical perspective, management enabled the emergence within chemical organizations of entirely new kinds of material processes that were able to dissipate energy gradients more effectively. The same applied to the emergence of each subsequent level of living organization: the management that enabled wider-scale cooperation at each level enabled the construction of novel, coordinated processes that enhanced the dissipation of energy gradients. The culmination of this series of emergences is likely to be the emergence of a cooperative global entity. If it arises, it will be enabled by management that spans the planet (Stewart 2014). Combined with the hierarchy of management operating at lower levels, this global management will organize the biosphere as a whole to produce novel processes on the scale of the planet that dissipate energy gradients more effectively. Many of these processes will be driven by human and technological agency. It is also worth noting here that the central function of the DNA apparatus (and RNA before it) was not the storage of information. Its primary significance in the evolution of life was to serve as management that enabled the cooperation barrier that separates chemistry from life to be overcome. The storage of information is incidental to the primary function of the DNA/RNA apparatus which is to manage. Effective management requires memory. 5.3 What Kind of Management Would Be Favoured by Selection? As we have seen, individual selection operating on managers would tend to have favoured management that overcame the cooperation barrier facing proto-metabolisms. But what 187The Origins of Life: The Managed-Metabolism Hypothesis 1 3 were the particular characteristics that management would need to enable it to overcome the barrier as fully as possible and be favoured by selection? What were the forms of management that would have had the potential to manage most effectively? 5.3.1 The Limitations of Managers Comprised Only of Autocatalytic Networks The primary function of management is to overcome the cooperation barrier by supporting molecular species and processes that are beneficial to the organization and by suppressing side reactions and other free-riding processes that are not. Selection would favour management that adapted its controls to ensure that relevant molecular species are maintained at an optimal level so as to ensure stability and efficiency as circumstances change. Ideally, effective managers would need to be able to catalyse the formation of any metabolic polymer that could benefit the organization. Managers that were limited in their capacity to catalyse useful reactions in a metabolism would tend to be less effective than those that were not so limited. How effective would managers be if they were comprised only of autocatalytic networks of polymers in which the polymers did not self-replicate through a template-based process (i.e. managers that were comprised only of networks of polymers that were replicated/reproduced only through collective autocatalysis)? It is conceivable that suitable autocatalytic networks of such 'managerial polymers' might have some capacity to manage a proto-metabolism. Consider a proto-metabolism comprising networks of other polymers (metabolic polymers) and small-molecule autocatalytic cycles and processes. Conceivably, some of the members of the managerial autocatalytic network could catalyse at least some beneficial reactions in the proto-metabolism. However, such autocatalytic networks would be very limited in their management capabilities. This is because their evolvability would be severely restricted for two reasons: first, they would not be able to evolve and explore possibility space through a 'copying-witherrors' process. Second, like all un-managed autocatalytic networks, they would encounter a cooperation barrier in full. This cooperation barrier would limit them to exploring only a small proportion of the space of catalytic possibilities and therefore of the space of beneficial management interventions. There would be many conceivable managerial polymers that could catalyse beneficial reactions in the proto-metabolism that would not be sustainable in the autocatalytic network due to the cooperation barrier. Because such managerial networks would not be able to catalyse the formation of many potentially useful metabolic polymers, they would be incapable of implementing many beneficial management controls. For example, consider a manager constituted by an autocatalytic network (coalition) of RNA molecules that do not self-replicate individually by a template-based process. The RNA manages a protein-catalysed proto-metabolism. Because of the cooperation barrier faced by this managerial network, there would be many RNA molecular species that would not be sustainable in the network-their formation would not be catalysed by other members of the network. This would be likely to include many RNA molecules that could catalyse the formation of particular proteins that would be useful in the proto-metabolism, but that are not sustainable within the proto-metabolism because of the cooperation barrier the metabolism faces. These metabolic proteins might, for example, catalyse beneficial reactions or help constitute useful structures, if they were able to persist in the proto-metabolism due to support by appropriate managerial RNA. For these reasons, managers constituted only by autocatalytic networks of RNA or other polymers are unable to overcome comprehensively the cooperation barrier faced by proto-metabolisms. 188 J. E. Stewart 1 3 5.3.2 The Superiority of Digitally‐Coded Management Given the seriously restricted management capabilities of managers comprised only of autocatalytic networks, is there a different kind of molecular system that does not share these limitations? We will see that if a molecular system is to manage proto-metabolisms comprehensively, it must have at least two characteristics: (a) In principle, it must have the potential to generate a relatively unlimited range of interventions in the organization it manages. (b) The success of any given variant intervention must depend only on its contribution to the organization as a whole and not, for example, on its ability to compete internally with other variants. As we have seen, the first of these requirements cannot be met by managers comprised only of autocatalytic networks of managerial polymers that are replicated only collectively and are incapable of template-based self-replication. However, it could be satisfied by a managerial polymer that self-replicates individually through a copying process that produces occasional errors. In principle, the replication and mutation of such a managerial polymer would be able to explore fully the space of all possible combinations of monomers that could be included in that kind of managerial polymer (this assumes that the managerial polymer is associated with catalytic arrangements that enable all variant polymers to also self-replicate individually. However, although the relaxation of this assumption changes the details of the argument advanced below, it does not change its conclusions about the advantages of digitally-coded management). Because such a managerial polymer could (in principle) give rise to any possible polymer of its kind by sequences of mutation, it would have the potential to discover and exploit all possible catalytic effects that could be produced by that kind of polymer. For example, such a manager comprising RNA polymers would (in principle) be able to discover and utilize any RNA polymer that had a beneficial catalytic effect on some aspect of the proto-metabolism it manages e.g. by catalysing the formation of a useful protein enzyme. Of course, in practice, many polymers would not be discovered in any particular population of managed proto-metabolisms. This is because, for example, relevant mutations might never arise, or because a particular managerial polymer may only be able to be reached through a sequence of mutations that are not each viable. Again, however, this does not disturb the central thrust of the argument being advanced in this section. Would such an ability to produce any kind of managerial polymer enable comprehensive management, at least in principle? Consider a metabolism that includes an autocatalytic network of metabolic polymers such as proteins. Would a manager comprising self-replicating RNA polymers be able to comprehensively overcome the cooperation barrier for the network of those metabolic polymers? To do so, the manager would have to be able to catalyse at an optimal level the formation of any possible metabolic polymer. But it would be unable to do this. Although the manager could (in principle) produce any possible molecule of the managerial polymers that constitute it, there might be useful metabolic polymers whose formation was not catalysed by any of these. How might a manager be constituted so that it could catalyse the production of any possible metabolic polymer, in principle? The manager could do so if managerial polymers served as templates for the production of metabolic polymers such that the 189The Origins of Life: The Managed-Metabolism Hypothesis 1 3 sequence of monomers was determined by the sequence of monomers in the managerial polymers. Since the mode of reproduction of managerial polymers (copyingwith-errors) could, in principle, produce any variant of managerial polymer with any sequence and length of monomers, such a translation process could (in principle) produce any possible metabolic polymer (assuming that all metabolic monomers are coded by managerial polymers). Consider again the example of a manager comprised of RNA polymers that self-replicate and serve as templates for the production of protein metabolic polymers. In this arrangement, the sequence of monomers in the RNA polymer would act as a digital code for the sequence of monomers in the proteins (Wilden 1980; Hoffmeyer and Emmeche 1991). In principle, it could provide the basis for a system that is able to produce any feasible protein at an optimal level through time. The second requirement for comprehensive management is that the success of any variant intervention must depend only on its contribution to the organization. This condition would be violated if the managerial polymers could self-replicate independently and therefore compete with each other. If this occurred, a variant that produced a metabolic polymer that was highly beneficial to the organization might be out-competed and unable to persist within the manager or unable to produce the metabolic polymer at an optimal level. This is a much more limited version of the cooperation barrier that is faced by autocatalytic networks, and it could be overcome far more simply. In particular, competition between managerial polymers could be prevented if all the polymers were constrained so that they were only able to replicate together, as a unity. For example, all managerial polymers could be bound together to form a single entity (e.g. a single chromosome) that replicates as a unit (Maynard Smith and Szathmáry 1993) [this is analogous at the level of human organization to a single king who rules a society and is bound by strict succession arrangements (Stewart 2000)]. As a further example which encompasses standard mitosis and meiosis, managerial polymers might be bound together to form a small number of entities (again, for example, chromosomes) that are then constrained by additional arrangements which ensure that they replicate together only when the cell reproduces, and then only as a unit (Ettinger 1986) [this is analogous at the level of human societies to the constitution and associated arrangements that constrain a parliament (Stewart 2000)]. In summary, managers constituted only by autocatalytic networks of non-self-replicating polymers would be unable to overcome the cooperation barrier faced by proto-metabolisms that they manage. This is because the cooperation barrier encountered by the managerial network itself would prevent it supporting many processes that would be highly beneficial to the proto-metabolism. However, this limitation would not apply to a manager constituted by self-replicating polymers which were themselves able to catalyse metabolic polymers such as proteins. In principle, such a manager would be able to explore the space of all possible managerial self-replicators. But there is no guarantee that the managerial self-replicators would have the potential to catalyse all possible metabolic polymers (e.g. RNA falls far short of having the potential to catalyse the formation of all possible proteins). Only a manager constituted by self-replicating polymers whose sequence of monomers serves to specify the sequence of monomers in metabolic polymers could achieve this (in principle). Hence managers must utilize a digital code if they are to overcome comprehensively the cooperation barrier faced by 'analogical' proto-metabolisms of molecular species. 'Analogical' managers are unable to do so. Furthermore, additional arrangements are necessary to constrain managerial self-replicators to prevent competition between them on the basis of criteria other than the success of the interventions they initiate. 190 J. E. Stewart 1 3 For these reasons, the transition from non-life to life had to await the emergence of management that embodied such a digital code. Before digitally-coded management emerged, layers of less effective and less evolvable forms of 'analogically-informed' management was likely to have emerged, forming hierarchies of management (this may have included layers of management constituted by autocatalytic networks of non-self-replicating RNA as well as networks of peptides/proteins or other polymers). The eventual takeover of analogically-informed metabolisms by digitally-informed management is analogous at the human level to the procedural redescription that occurs during human development in which procedural knowledge is re-described and extended by declarative knowledge (KarmiloffSmith 1992). The digitally-informed arrangements embodied in the genetic apparatus were subsequently co-opted by evolution to overcome the cooperation barrier at other levels of organization e.g. to provide the distributed internal management that underpinned the emergence of multi-cellular organizations and that also underpinned the emergence of organizations of multi-cellular organisms such as insect societies. It was not until the emergence of complex human societies that a new kind of digital code evolved in the form of language (Hoffmeyer and Emmeche 1991). 6 Relationship Between the Managed‐Metabolism Hypothesis and Other Hypotheses About the Origins of Life 6.1 Other Hypotheses The managed-metabolism hypothesis incorporates a number of the key elements of other major hypotheses about the origins of life and combines these with new features which overcome the deficiencies of these other hypotheses. In particular, like gene-first hypotheses, the managed-metabolism hypothesis relies upon the emergence of self-replicating RNA molecules. But unlike gene-first hypotheses, it does so far more plausibly. Many versions of the gene-first hypothesis postulate that RNA arose spontaneously from an unstructured organic-rich soup. In contrast, the managed-metabolism hypothesis proposes that the emergence of RNA molecules (or other potential managers) was scaffolded by the prior emergence of an 'ecosystem' of autocatalytic networks and cycles of molecular species [for a discussion about the likely emergence of a community of proto-organizations, see Woese (2004)]. As these networks and cycles self-organized and evolved, they are likely to have built up chemical processes and species that significantly increased the likelihood that RNA could emerge. Dyson (1985) outlines one specific process by which this might have occurred. Of course, even though the first RNA molecules might have emerged from self-producing chemical organizations of other molecular species, this does not mean that RNA would have always thereafter been dependent upon those organizations for its survival and reproduction. Rather, as discussed above, its evolvable catalytic capacity gave it the potential to unilaterally appropriate resources from other organizations and eventually to develop the capacity to manage them. In another major difference from most gene-first hypotheses, the managed-metabolism hypothesis does not propose that 'naked' self-replicating RNA molecules proceeded to progressively create around themselves a complex, supporting metabolism, starting from scratch. Instead, it argues that potential managers are much more likely to have taken over 191The Origins of Life: The Managed-Metabolism Hypothesis 1 3 and managed pre-existing organizations that emerged in the chemical 'ecosystem', rather than to have created them afresh (particularly given the difficulties of building highly complex, dynamical organizations from scratch using an evolutionary mechanism that operates 'top down' and generally makes only one small change at a time). Like metabolism-first hypotheses about the origin of life, the managed-metabolism hypothesis also relies on the emergence of autocatalytic networks of molecular species. But current metabolism-first hypotheses do not include any mechanism that would overcome the cooperation barrier and enable the emergence of highly complex metabolisms (as we have seen in Sect. 4 above, compartmentalization and group selection does not provide such a mechanism). A widely considered hypothesis that has some surface similarities to the managedmetabolism hypothesis is Dyson's parasite/symbiosis hypothesis of the origins of life (Dyson 1985). Dyson suggests that RNA emerged first within self-producing chemical organizations and developed a parasitic relationship with them. He goes on to argue that this relationship eventually co-evolved into a mutually-beneficial symbiotic relationship [he suggests that this parallels the later symbiotic origin of the eukaryote cell identified by Margulis (1981)]. However, Dyson's hypothesis misses both the fundamental reason why evolution favours the role played by RNA in the transition to life as well as the very nature of that role. More specifically, he does not recognise the existence of a cooperation barrier that has two critically important characteristics: (a) the barrier seriously limits the ability of self-producing proto-metabolisms to develop advantageous cooperative arrangements and (b) the barrier creates the potential for RNA to advantage itself and the organization it manages by overcoming the barrier (these are absences that are shared by all other hypotheses that postulate an RNA or DNA takeover of metabolisms). Dyson did raise the possibility that autocatalytic metabolisms may encounter some of the 'catastrophes' that have been shown by simulations to beset RNA quasi-species and hypercycles (Niesert et al. 1981). These catastrophes include elements of the cooperation barrier that I have described. However, Dyson left to future simulations an assessment of whether any of these catastrophes would indeed apply to proto-metabolisms. His hypothesis therefore did not come close to recognising the role that RNA had in overcoming these and other instances of the cooperation barrier, or how the significant benefits that flow from this could drive the comprehensive take-over of proto-metabolisms by RNA. Because Dyson's hypothesis misses the role of RNA in overcoming the cooperation barrier, it also misses: (a) the critically important power relationship between RNA and protometabolisms that enables RNA to emerge as an evolvable manager; (b) that the power of RNA management to apply constraints across a proto-metabolism enables it to progressively overcome the cooperation barrier [the RNA apparatus becomes 'the Leviathan' of the proto-cell. For more about how 'the Leviathan' overcomes the cooperation barrier in human societies, see Hobbes (1651)]; and (c) that the integration of simple cells into eukaryote cells is, in fact, an example of the capacity of powerful management to overcome the cooperation barrier (as are all other relevant major evolutionary transitions). It is not an example of mutually-beneficial symbiosis between equals [the genetic apparatus of the emerging eukaryote cell manages/enslaves the simple cells that are incorporated into it. For detailed discussions of this issue, see Maynard Smith and Szathmáry (1995) and Stewart (2000)]. It is therefore the managed-metabolism hypothesis that is consistent with the other relevant major evolutionary transitions, not the parasite/symbiosis hypothesis. Ganti's 'Chemoton Model' of a simple cell also has some superficial similarities to elements of the managed-metabolism hypothesis. Like the managed metabolism hypothesis, the Chemoton Model includes a 'genetic subsystem' that controls and regulates the 192 J. E. Stewart 1 3 dynamics of the system as a whole [e.g. see Ganti (2003)]. However, like Dyson, Ganti does not recognize anything like the cooperation barrier which, according to the managedmetabolism hypothesis, is the key driver of the emergence and evolution of management. Also, unlike the managed-metabolism hypothesis, Ganti's approach does not suggest that the Chemoton's genetic subsystem emerges to support co-operators and suppress side reactions and other free-riders. In their extensive discussion of the Chemoton Model, Griesemer and Szathmáry (2009) acknowledge that it does not provide a solution to the sidereaction problem. The most common view of the role of regulation and control in early living systems is exemplified by Smith and Morowitz (2016). In their extensive treatment of this area, they draw on the engineering paradigm of optimal control theory. Consistent with this theory, they focus on two functions of control in early life. Firstly, they demonstrate that control fulfils an error-correction role which ensures the stability and viability of the organization. Secondly, it adapts sub-systems to changing contexts at or above the scale of the controller. This conventional view focuses primarily on the role of control in regulating a system that is given. Perhaps because of its origins in standard engineering control theory, it misses the role of control and power in constructing and maintaining organizations that would not persist otherwise. Their approach does not recognise the critically important function of control in supporting co-operators and suppressing free-riders to overcome the cooperation barrier. In contrast, the concept of management developed in this paper includes this constructive function as well as the functions identified by Smith and Morowitz (2016). 6.2 Testing the Hypothesis The managed-metabolism hypothesis makes testable predictions about the emulation of the origins of life in vitro and in silico. In particular, it predicts that attempts to emulate the transition from non-life to life with un-managed autocatalytic networks will fail. Furthermore, it predicts that complex cooperative organization will not emerge in such networks while they remain un-managed. However, these predictions are not yet able to be tested by current attempts to instantiate or simulate autocatalytic networks [see Hordijk and Steel (2017) for a recent review]. Until progress is made in making these emulations more realistic, the testing of aspects of the managed-metabolism hypothesis can take advantage of the fact that the hypothesis includes elements that are also part of other hypotheses about the origins of life. As a consequence, empirical work on these elements of other hypotheses will also assist in testing and developing aspects of the managed-metabolism hypothesis. For example, simulations and laboratory studies that demonstrate the plausibility of the self-organization of self-producing organizations of molecular species will be highly relevant to the plausibility of comparable aspects of the managed-metabolism hypothesis. The same applies to demonstrations that the evolvability of molecular organizations is impeded by a cooperation barrier. Any laboratory demonstration that adds to the plausibility of the view that RNA could emerge 'spontaneously' in particular circumstances will also significantly strengthen the managed-metabolism hypothesis. But unlike many 'gene-first' scenarios, the plausibility of the managed-metabolism hypothesis would be even more significantly enhanced by any demonstration that the emergence of RNA is far more likely if it could be scaffolded by the kinds of chemical processes that are likely to have arisen only in self-producing proto-metabolisms. 193The Origins of Life: The Managed-Metabolism Hypothesis 1 3 However, any testing of the hypothesised emergence of management and its potential to overcome the cooperation barrier is likely to require theoretical and experimental work that is specifically focused on the managed-metabolism hypothesis. It seems likely that this work would need to begin with attempts to simulate the emergence of management and its take-over of proto-metabolisms, rather than through laboratory work. Until un-managed proto-metabolisms can be produced in the laboratory, attempts to produce actual managed proto-metabolisms is likely to be premature. Theoretical and laboratory work on the emergence of management at the level of chemical organizations can also be informed and enhanced by work on the emergence of management at other levels of organization, including at the level of human organizations [e.g. see Stewart (2000) and Turchin (2015)]. 7 Conclusions Un-managed organizations of autocatalytic networks of molecular species can be selfproducing and can also evolve by natural selection to a limited extent. But un-managed organizations encounter a cooperation barrier. The barrier limits their capacity to develop complex cooperative arrangements within the organization. This in turn seriously limits the emergence within organizations of complex functionality that serves the interests of the organization as a whole and enables it to function and adapt as a coherent entity. Complex individuality therefore cannot emerge. All known living cells exhibit individuality supported by complex functionality. If we take this to be an essential criterion for life, un-managed self-producing organizations are unable to make the transition from non-life to life. For complex individuality to evolve, digitally-coded management is necessary to overcome the cooperation barrier. If the cooperation barrier did not exist and if unmanaged self-producing autocatalytic organizations of molecular species were somehow able to evolve complex functionality, living processes would be organized entirely differently to the way they are: organizations of molecular species would be able to individuate fully and transition from non-life to life without the emergence of management. If this were the case, living cells would not have their distinctive two-tiered structure comprising an analogically-informed metabolism governed by a digitally-coded management. However, the cooperation barrier does exist. Management was essential for the transition from non-life to life. Effective management unleashed the cooperative creativity that produced 'endless forms most beautiful and most wonderful'. Without management, natural selection would have been incapable of producing or shaping life of any form. The relational perspective that underpins the managed-metabolism hypothesis recognises that there may be many chemical species and processes other than those found in life on earth that can constitute life. This is because these alternatives are capable of engaging in the cooperative relationships and forms of organization that qualify as life-i.e. they can constitute organizations that are self-producing, digitally-managed and capable of developing individuality supported by complex functionality (provided, of course, they have access to suitable sources of free energy and other necessary resources). On this planet, proteins, RNA and DNA play key roles in living processes. Metabolisms in cellular forms of life are constituted by particular chemical cycles and processes that are catalysed primarily by proteins, and digitally-coded management is constituted 194 J. E. Stewart 1 3 by particular forms of RNA and DNA. At higher levels of organization on this planet, self-producing organizations and digitally-coded management are constituted by largerscale entities (e.g. by humans that use language and by organizations of humans at the level of societies). On other planets and in other circumstances, the actual constituents of the simplest living processes may be quite different to those on Earth. But they are likely to be organized into the two-tiered structure we find here: a cooperative metabolism organized by digitally-coded management. Acknowledgements The author acknowledges the benefit of useful discussions with David Richards, Clement Vidal and Wilson Kennel and the comments of two reviewers. Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creat iveco mmons .org/licen ses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. References Bagley, R. J., & Farmer, J. D. (1991). Spontaneous emergence of a metabolism. In C. Langton, T. Taylor, & S. Rasmussen (Eds.), Artificial life II (pp. 93–141). New York: Addison and Wesley. Baum, D. A. (2015). Selection and the origin of cells. BioScience, 65(7), 678–684. Bernhardt, H. S. (2012). The RNA world hypothesis: The worst theory of the early evolution of life (except for all the others). Biology Direct, 7, 23. https ://doi.org/10.1186/1745-6150-7-23. Calcott, B., & Sterelny, K. (Eds.). (2011). The major transitions in evolution revisited. Cambridge: The MIT Press. Cavalier-Smith, T. (2004). The membranome and membrane heredity in development and evolution. In D. S. Horner & R. P. Hirt (Eds.), Organelles, genomes and eukaryote phylogeny: An evolutionary synthesis in the age of genomics (pp. 335–351). Boca Raton, FL: CRC Press. Dyson, F. J. (1985). Origins of life. Cambridge: Cambridge University Press. Ettinger, L. (1986). Meiosis: A selection stage preserving the genome's pattern of organisation. Evolutionary Theory, 8, 17–26. Feitelson, D., & Treinin, M. (2002). The blueprint for life? Computer, 35, 34–40. Ganti, T. (2003). The principles of life. Oxford: Oxford University Press. Gilbert, W. (1986). Origin of life: The RNA world. Nature, 319, 618. Griesemer, J., & Szathmáry, E. (2009). Ganti's Chemoton model and life criteria. In S. Rasmussen, M. Bedau, L. Chen, D. Deamer, D. C. Krakauer, N. H. Packard, & P. F. Stadler (Eds.), Protocells. Bridging nonliving and living matter (pp. 481–513). Cambridge, MA: MIT Press. Higgs, P. G., & Lehman, N. (2015). The RNA World: Molecular cooperation at the origins of life. Nature Reviews Genetics, 16, 7–17. Hoffmeyer, J., & Emmeche, C. (1991). Code-duality and the semiotics of nature. In M. Anderson & F. Merrell (Eds.), On semiotic modeling (pp. 116–117). New York: Grutyer. Hordijk, W., & Steel, W. (2017). Chasing the tail: The emergence of autocatalytic networks. Biosystems, 152, 1–10. Karmiloff-Smith, A. (1992). Beyond modularity: A developmental perspective on cognitive science. Cambridge MA: MIT Press. Kauffman, S. A. (1993). The origins of order: Self-organization and selection in evolution. New York: Oxford University Press. Margulis, L. (1981). Symbiosis in cell evolution. San Francisco: W.H. Freeman and Company. Maynard Smith, J., & Szathmáry, E. (1993). The origin of chromosomes I. Selection for linkage. Journal of Theoretical Biology, 164, 437–446. Maynard Smith, J., & Szathmáry, E. (1995). The major transitions in evolution. Oxford: Freeman. Nanney, D. L. (1968). Cortical patterns in cellular morphogenesis. Science, 160, 469–502. Niesert, U., Harnasch, D., & Bresch, C. (1981). Origin of life between Scylla and Charybdis. Journal of Molecular Evolution, 17, 348–353. 195The Origins of Life: The Managed-Metabolism Hypothesis 1 3 Nighe, P., Hordijk, W., Kauffman, S. A., Walker, S. I., Schmidt, F. J., Kemble, H. A., et al. (2015). Prebiotic network evolution: Six key parameters. Molecular BioSystems, 11, 3206–3217. Okasha, O. (2006). Evolution and the levels of selection. Oxford: Clarendon Press. Oparin, A. I. (1957). The origin of life on earth (3rd ed.). Edinburgh: Oliver and Boyd. Orgel, L. E. (1968). Evolution of the genetic apparatus. Journal of Molecular Biology, 38, 381–393. Ostrom, E. (1990). Governing the commons: The evolution of institutions for collective action. Cambridge: Cambridge University Press. Pross, A. (2004). Causation and the origin of life. Metabolism or replication first? Origins of Life and Evolution of Biospheres, 34, 307–321. Razeto-Barry, P. (2012). Autopoiesis 40 years later. A review and a reformulation. Origins of Life and Evolution of Biospheres, 42, 6543–6567. Robertson, M. P., & Joyce, G. F. (2012). The origins of the RNA world. Cold Spring Harbor Perspectives in Biology, 4, a003608. Roth, M. G. (1999). Inheriting the Golgi. Cell, 99, 559–562. Ryan, P. A., Powers, S. T., & Watson, R. A. (2016). Social niche construction and evolutionary transitions in individuality. Biology and Philosophy, 31, 59–79. Salthe, S. (1985). Evolving hierarchical systems. Columbia: Columbia University Press. Smith, E., & Morowitz, H. J. (2016). The origin and nature of life on earth. Cambridge: Cambridge University Press. Stewart, J. E. (1995). Metaevolution. Journal of Social and Evolutionary Systems, 18, 113–114. Stewart, J. E. (1997). Evolutionary transitions and artificial life. Artificial Life, 3, 101–120. Stewart, J. E. (2000). Evolution's Arrow: The direction of evolution and the future of humanity. Canberra: The Chapman Press. Stewart, J. E. (2014). The direction of evolution: The rise of cooperative organization. BioSystems, 123, 27–36. Stewart, J. E. (2016). The self-organizing society: The role of institutions. https ://doi.org/10.2139/ssrn.28406 37. Szathmáry, E., & Demeter, L. (1987). Group selection of early replicators and the origin of life. Journal of Theoretical Biology, 128(4), 463–486. Szathmáry, E., Santos, M., & Fernando, C. (2005). Evolutionary potential and requirements for minimal protocells. Topics in Current Chemistry, 259, 167–211. Trefil, J., Morowitz, H. J., & Smith, E. (2009). The origin of life: A case is made for the descent of electrons. American Scientist, 97, 206–213. Turchin, P. (2015). Ultrasociety: How 10,000 years of war made humans the greatest cooperators on Earth. LCC, CT: Beresta Books. Ulanowicz, R. E. (2009). A third window: Natural life beyond Newton and Darwin. West Conshohocken, PA: Templeton Foundation Press. Vasas, V., Fernando, C., Santos, M., Kauffman, S. A., & Szathmáry, E. (2012). Evolution before genes. Biology Direct, 7, 1. https ://doi.org/10.1186/1745-6150-7-1. Virgo, N., & Ikegami, T. (2013). Autocatalysis before enzymes: the emergence of prebiotic chain reactions. Advances in Artificial Life, ECAL, 12, 240–247. Wilden, A. (1980). System and structure. New York: Tavistock. Woese, C. R. (Ed.) (1967). The evolution of the genetic code. In The genetic code (pp. 179–195). New York: Harper and Row. Woese, C. R. (2004). A new biology for a new century. Microbiology and Molecular Biology Reviews, 68, 173–186. Yaffe, M. P. (1999). The machinery of mitochondrial inheritance and behavior. Science, 283, 1493–1497. John E. Stewart is an Australian-based member of the Evolution of Complexity and Cognition (ECCO) Research Group of the Free University of Brussels (VUB). His main interest is in the development of an evolutionary worldview that reveals to us who we are and what we should be doing with our lives. His work on the directionality of evolution and its implications for humanity has been published in key papers in international science journals. A number of his recent papers have focused on psychological development, including the future evolution of consciousness. He is the author of the book 'Evolution's Arrow: the direction of evolution and the future of humanity'. More recently he has finalized 'The Evolutionary Manifesto'. The Manifesto outlines an evolutionary worldview and explores its relevance to humanity. It is at http:// www.evolu tiona ryman ifest o.com.