# Abstract

Network-based intervention strategies can be effective and cost-efficient approaches to curtailing harmful contagions in myriad settings. As studied, these strategies are often impractical to implement, as they typically assume complete knowledge of the network structure, which is unusual in practice. In this paper, we investigate how different immunization strategies perform under realistic conditions — where the strategies are informed by partially-observed network data. Our results suggest that global immunization strategies, like degree immunization, are optimal in most cases; the exception is at very high levels of missing data, where stochastic strategies, like acquaintance immunization, begin to outstrip them in minimizing outbreaks. Stochastic strategies are more robust in some cases due to the different ways in which they can be affected by missing data. In fact, one of our proposed variants of acquaintance immunization leverages a logistically-realistic ongoing survey-intervention process as a form of targeted data-recovery to improve with increasing levels of missing data. These results support the effectiveness of targeted immunization as a general practice. They also highlight the risks of considering networks as idealized mathematical objects: overestimating the accuracy of network data and foregoing the rewards of additional inquiry.

# Author summary

It is often useful to track how epidemics spread through populations by mapping transmissions between people, communities, and cities. This consideration of a population as a network can reveal the critical players, locations, or events driving epidemics. Similarly, by mapping the network of possible transmissions before an outbreak occurs, we can identify potentially critical actors on which public health interventions should focus. Unfortunately, the data collection process required to map all possible interactions of a population is difficult— fraught with possible error and unlikely to be complete. To understand the role of data quality in network-based interventions, we apply different strategies to partially-observed networks with controllable amounts of missing data. Our results suggest that intervention strategies which require full network information remain fairly effective up to high levels of missing data. However, local strategies which rely only on small data samples can outperform the more data-expensive benchmark strategies when little data is available. Surprisingly, we also propose an intervention that improves in effectiveness with less data by coupling targeted immunization with targeted data recovery. These results show that insights from network science can be robust to missing data, but that their implementation should be adjusted for noisy real-world applications.

# Introduction

The spread of infectious diseases , computer viruses , and "fake news" pose serious threats to the health and well-being of an increasingly connected society. Thus, one of the most important questions in public health and network science is how to curtail contagions. If dangerous contagious pathogens or content spread over network connections, what kinds of interventions will be most effective at inhibiting outbreak size ? For example, prior work has shown that when the population's contact structure can be modeled as a complex network, immunization (broadly defined) of certain actors can prevent contagion considerably more effectively than randomized immunization . With targeted immunization, actors are immunized based on their potential role in future outbreaks, which is determined by their position in a contact network . More applied work has demonstrated the utility of network based intervention . For example, researchers have leveraged network properties to maximize the impact of their interventions in a diverse set of contexts including smoking interventions in schools , HIV spread among men who have sex with men (MSM) , and disease spread in needle sharing networks .

Here, the term "immunization" refers to anything that reduces the probability of infection to zero for a particular actor for the entire duration of a particular "contagion". In practice, this could be a vaccine, but other interventions, such as rehabilitation or pre-exposure prophylaxis, could also conceivably permanently reduce risk of infection at near 100% effectiveness. Targeted immunization is particularly attractive in cases where resources, like vaccines, are limited, as only a small proportion of the population must be immunized to effectively reduce wider contagion .

An extensive literature on networks and immunizations has focused on evaluating selection strategies . The basic question is how to pick which actors in the network should be treated. A common choice is to evaluate immunization strategies using simulation (as we do in this paper), where a researcher stochastically spreads an infection through the treated network, recording the outbreak size under different strategies of node-immunization. The goal is to identify immunization strategies that will reduce the spread of infection the most, given the number of actors that can be treated (with limited time, money and so on).

One potential complication to identifying important actors is missing data. Many of the network-based immunization strategies suggested by existing research rely on global network measures, like betweenness and degree centrality, which assume that a researcher can map out the full network of relations on the population of interest. This is often not realized in practice, as studies are often subject to missing data . Missing data will potentially alter the measurement of the network , and consequently, the identification of important actors .

This article addresses the effectiveness of different targeted immunization strategies under conditions of missing data, see Refs. and for recent calls to address related problems. This is a pressing problem as some of the best immunization strategies in fully-observed networks are based on measures that are sensitive to missing data . For example, past work has found that measures like betweenness, which are dependent on the full network structure, are often badly biased when nodes are missing . Thus, we may think that betweenness will be effective at finding important actors to immunize when missing data is low, but may not fare so well when levels of missing data are high. Alternatively, a strategy that is less effective in a true (completely observed) network may be robust to missing data, making it a potentially attractive option when missing data is a known problem. A strategy is effective to the extent that it reduces outbreak size at a given level of missing data. A strategy is robust to the extent that its effectiveness is not reduced with increasing levels of missing data. Thus, we suggest that most researchers 'on the ground' face a tradeoff between effectiveness and robustness. This tradeoff has been largely downplayed by past work, which has focused on the effectiveness of different options under the assumption of complete (or full) network information. In this article, we address the tradeoff between robustness and effectiveness directly by examining the robustness of different immunization strategies to varying levels of missing data.

We begin the article by discussing the existing research on targeted immunization strategies. We then turn to a simulation-based test of immunization strategies under conditions of missing data.

## Network-based immunization strategies

Immunization strategies work by identifying key nodes and immunizing them against infection (thereby preventing them from infecting others). Different strategies use different criteria to select the nodes to immunize. The question is which strategies are most effective in terms of preventing, or mitigating outbreaks of contagion on a population.

Two of the most commonly evaluated immunization strategies are degree and betweenness immunization. With degree immunization, nodes are immunized if they have many connections, or high degree centrality, and thus a higher chance of spreading the infection to their neighbors . Betweenness immunization selects actors for removal based on how crucial the actor is in connecting different communities (or groups), directly measuring how many shortest transmission chains can be broken via immunization .

Other studies have explored the effectiveness of stochastic approaches to identifying important actors in the network. Stochastic immunization algorithms rely on the local network, or neighborhood, of sampled nodes, rather than on global network data . One commonly tested stochastic strategy is acquaintance immunization, which immunizes those nodes frequently found to be neighbors of randomly selected nodes . This strategy locates high degree nodes by relying on the proportional relationship between the degree of a node and the probability that it will be the randomly selected neighbor of a randomly selected node . Acquaintance immunization is thus useful as it allows the researcher to find hubs in the network without a costly and sometimes infeasible network census.

## The problem of missing data in choosing an immunization strategy

Past tests of these immunization strategies have almost uniformly assumed ideal conditions, where there is no missing data. In the case of global network measures like betweenness, this means having information on all nodes and all ties between nodes. In the case of stochastic processes, like acquaintance immunization, this means having a complete sampling frame and complete local network information for each sampled node. However, in many cases it will be difficult to obtain complete network data. Missing data can arise for a number of reasons. For example, a researcher may not have sufficient time or resources to find and gather information about everyone in the network, particularly if the network is large. Even respondents that are interviewed may offer incomplete information about their social contacts, being prone to forgetfulness and fatigue . These issues are amplified in hidden, difficult to reach populations, such as a network of drug users or sex workers .

Missing data may have important consequences for choosing an immunization strategy. First, missing nodes will generally be unavailable for immunization, even if they could be identified (which would be difficult for most strategies). This is a problem endemic to network intervention studies and is built in to our exploration of the effect of missing data on immunization effectiveness. Second, missing data can affect the measurement of network properties, like degree and betweenness . The rank order of nodes (from least to most important) may deviate from the true rank order on the complete, but unknown, network . Thus, among the set of nodes that can be immunized (i.e., those who actually participate) one runs the risk of picking a sub-optimal target set to be immunized.

We see similar issues with the stochastic strategies, like acquaintance immunization. While stochastic strategies do not require global network data, and are thus often touted as robust to missing data , implementing these algorithms in practice still requires a comprehensive list of nodes from which to sample, as well as perfect local information about the neighborhood of each sampled node. Thus, critical nodes that would be selected by these local strategies can still be overlooked either because they are missing from the local information of sampled nodes (and thus undiscoverable) or because some of their neighborhood is missing and they are thus less likely to be identified as critical compared to nodes whose neighborhoods are more heavily represented. Therefore, even a "robust" strategy, like acquaintance immunization is potentially affected by missing data.

These two ways that missing data may appear need not occur together. In certain data collection scenarios, it may be be feasible to obtain a complete sampling frame and accurate local information; in others, it may be possible to obtain one of these but not the other, and in some scenarios it may impossible to obtain complete data for either one. We will explore the effectiveness (in terms of reduction in outbreak size) of this approach under different assumptions about data availability.

## Accounting for missing data in immunization strategies

A limited number of studies have considered missing data problems related to network contagion and immunization. Most of these studies have not tackled the problem of targeted immunization problems directly, however. Hébert-Dufresne et al. \[12\], for example, investigate the effectiveness of immunization strategies and their robustness separately, testing effectiveness under the assumption of perfect data, and using the Jaccard coefficient to test robustness of targeting. Gong et al. address how the effectiveness of an immunization strategy is affected by random network changes, but still assumes perfect data about the modified network when calculating immunization targets.

Another line of work examines the effect of missing data on objectives and metrics related, but not equivalent to, targeted immunization. These include attack robustness of networks , influence maximization , and identification of influential spreaders . See Ref. for a discussion on the differences between influence maximization and targeted immunization.

The two studies that are most closely related to our own both investigate the effectiveness of targeted immunization strategies under specific sampling schemes. The first is a study by Yang et al. who examine the potential of immunization strategies in the case of Fixed Choice Design (FCD) sampling. Fixed Choice Design puts limits on the number of neighbors a node can have, creating bias in the observed network. Measurement error of this sort can affect the targeting strategies, but only in a limited way, as all nodes in the network are still assumed to be present and available for immunization. In this way, Yang et al. capture the effect of missing edges but not missing nodes, the focus of this study.

Chen and Lu similarly consider immunization strategies under a particular sampling scheme, Respondent Driven Sampling (RDS) . With RDS, a set of initial seeds are recruited into the study; these initial seeds recruit others into the study, who recruit others into the study and so on. Chen and Lu develop an algorithm to identify which actors should be immunized under such sampling conditions. The analysis is limited, however, to data collected via RDS, which does not cover the more general problem of missing network data; additionally, they assume rather ideal conditions of the RDS chain, where there is wide coverage of the population and no actors refuse to participate.

In sum, past work has focused on specific sampling schemes, while relying on the complete portion of the data to originate from an accurate process free from complications. In this article, we move past previous research by directly examining the effectiveness of targeted immunization strategies in reducing outbreak size under conditions of missing data. We allow the missing data to exist anywhere in the network, mimicking the scenario where pieces of the network are unobserved as actors are unwilling or unable to participate in the study — rather than consider data based on well-behaved sampling schemes. We also extend past work by considering the mechanisms under which stochastic strategies are subject to missing data. More substantively, we focus on the effectiveness/robustness tradeoff of different immunization strategies, making it possible to see under what conditions different strategies will be most effective at reducing outbreak size.

We now turn to testing the robustness and effectiveness of different immunization strategies. We consider a range of missing data scenarios, from the ideal case of complete information to more difficult cases where much of the network is not available.

# Materials and methods

There are six basic steps to testing the robustness of different immunization strategies: 1) select a known, true network as a test case; 2) remove nodes from the network to simulate conditions of missing data; 3) take partially-observed networks (from step 2) and identify nodes to immunize under different strategies; 4) run multiple outbreak simulations through the true network (from step 1) with selected nodes immunized (from step 3); 5) repeat steps 1-4 many times for each condition of interest. 6) compare the resulting estimates of outbreak size under each immunization strategy and level of missing data.

## Select known network as test case

Following past work on epidemics , we use synthetic networks to test the validity of different immunization strategies. We consider synthetic (generated) networks with similar properties as the well known Colorado Springs high risk network . The population of interest in the Colorado Springs network included at-risk individuals for HIV and HCV transmission, including drug injectors and sex workers. Researchers attempted to identify the entire at-risk population in the city and include them in their study. Ties are defined across several relationships: including close friendship, sexual contact, and drug co-use . Disease risk networks of persons who inject drugs are of particular interest for several reasons. The sharing of injection drug apparatus is one of the most prevalent transmission routes for HIV both in terms of transmission rate and also in terms of incidence rate among persons who inject drugs (PWID) . Therefore, the threat to life caused by outbreaks within these populations is greater than for many other types of outbreaks in other populations. Additionally, PWID are known to be a hidden population , thus the missing data treatment approach we present here is of special interest in regards to immunizations within these populations.

In addition, we replicate our analyses using synthetic school networks. We generated these school networks to have properties that match the friendship network structure of a typical school collected as part of the well known National Longitudinal Study of Adolescent to Adult Health (Add Health). Ties are based on self-reported friendship nominations that were collected in the classroom. The Add Health network provides a case where the pathogen of interest requires close social contact, like drink sharing or hand holding; this would fit infections like streptococcus or mononucleosis.

We use synthetic networks to control relevant features, while systematically varying key network properties. From the Colorado Springs data, we generate three sets of networks sharing some basic features (e.g., composition, degree distribution, strength of homophily on key attributes like gender and race), but each with different levels of transitivity between sets. Transitivity is defined as the proportion of two-paths ($i \rightarrow j \rightarrow k$) that also have a direct path ($i\rightarrow k$). Transitivity is negatively related to contagion potential and the Colorado Springs network we set out to emulate has particularly high transitivity. We generate five thousand "high" transitivity networks, each with transitivity constrained around 0.30, close to the true Colorado Springs network, five thousand "medium" transitivity networks, with transitivity constrained around 0.155, and five thousand "low" transitivity networks with transitivity constrained around 0.01.

Synthetic networks are generated using exponential random graph models (ERGM) . All networks are undirected, unweighted, and have 1000 nodes. In each case, the degree distribution is pulled from the original network, plotted in Fig. . For each of the three network types ("low", "medium" and "high" transitivity), we generate 5000 networks from the underlying model. In the Supporting Information (SI), we replicate our analysis with other classes of synthetic networks selected from the targeted immunization literature, to demonstrate comparable results and exemplify the generality of our methodology.

## Remove nodes to simulate conditions of missing data

To simulate conditions of missing data, we followed the standard procedure in the literature: for each true network, $G$ (five thousand per transitivity level), we removed a portion of the nodes at random to form the observed network, G'. The removed nodes were not present in the observed network . The observed network ($G'$) is the network from the point of view of the researcher and serves as input into the immunization strategies.

## Identify nodes to immunize under different strategies

In general, an immunization algorithm works by identifying the nodes which are most central to the network or have a particular structural position which is considered to be important for the flow of contagion. The nodes identified with the highest scores will be the ones targeted for immunization in the subsequent outbreak simulations (with ties broken randomly). We considered eight different immunization strategies. There were three global strategies — degree, self-reported degree and betweenness — and one stochastic strategy, acquaintance immunization, was used in four different variants. We also considered random immunization as a baseline, where nodes were randomly selected to be immunized. In addition, we also run simulations with no immunization, to provide another point of comparison.

#### **Random Immunization:**

Random immunization selects nodes at random from the given node list of $G'$, which, from the perspective of an interventionist, should be considered the sampling frame. Since nodes are missing from G' at random, and random immunization selects a random selection of nodes to immunize from the random sample of observed nodes, random immunization of nodes from G' is equivalent to random immunization of nodes from the true network, $G$. Note that this would not be the case with a non-random sample of observed nodes.

#### **Degree Immunization:**

Degree immunization selects nodes based on their network degree in $G'$ — the number of ties each node receives/sends according to observed network data.

#### **Betweenness Immunization:**

Betweenness immunization targets nodes with the highest betweenness centrality in $G'$. Betweenness centrality is the proportion of the shortest paths between nodes in the network (geodesics) upon which a node lies (counting as fractions of paths when there are multiple shortest paths between the same pairs of nodes) . This can be formally written as:

$$BC(v) = \sum_ {\{u,w \,  \epsilon  \, V | \; u \neq v, w
    \neq v\}}  \frac{\sigma_{u,v,w}}{\sigma_{u,w}}$$

where $v$ is an arbitrary node, $\{u,w \,  \epsilon  \, V | \; u \neq v, w
    \neq v\}$ is the set of all pairs of nodes $u, w$ where neither $u$ nor $w$ equals $v$, $\sigma_{u,w}$ is the total number of shortest paths between $u$ and $w$, and $\sigma_{u,v,w}$ is the number of those paths which pass through $v$

#### **Self-Reported Degree Immunization:**

Self-reported degree is an obvious strategy that is frequently overlooked, yet it can often be straightforwardly implemented and can directly tackle missing data in degree immunization. Self-reported degree immunization targets nodes in the sample (the node list of $G'$) based on their true degree (their degree in $G$), assuming nodes know their neighbors and faithfully report their number of connections. This describes a scenario, where by survey or other query, a limited amount of accurate egocentric data on a sampled subset of nodes can be collected. This is a common assumption among most social network studies, including those which explicitly acknowledge the difficulty of obtaining a network census and thus do not presuppose complete network data, such as RDS studies and egocentric studies . With complete data, this strategy is perfectly equivalent to the degree immunization described above. With missing data, we do not have access to the nodes outside of the sampling frame (and thus cannot immunize them) but missing nodes are still counted as connections by their neighbors (as they would be on a personal survey). Note also that access to this information does not require any contact with nor information about the sampled nodes' neighbors other than their existence.

#### **Acquaintance Immunization:**

We used acquaintance immunization to test stochastic immunization strategies. We offered a test with four different versions of acquaintance immunization, with different assumptions about the information available to the researcher. Each variant makes different assumptions about the completeness of the sampling frame ($G$ for true graph and $G'$ for known graph), as well as the level of local information (again, $G$ for true graph and $G'$ for known graph).

Acquaintance immunization operates under the "friendship paradox", the principle that if one randomly samples the network, nodes that are highly connected are more likely to be neighbors of randomly sampled individuals . Consequently, to identify important nodes, the algorithm randomly samples a node, $r$, then randomly samples a neighbor of $r$, node $n$, and adds one to the acquaintance score of $n$. If this score increment causes $n$'s acquaintance score to go above some chosen threshold (usually 1 or 2), then n is added to the list of structurally important nodes to immunize. This process is iterated until $v$% of nodes have been identified as structurally important, where $v$ is the desired immunization level . Following previous research , we used a threshold of 2 for adding nodes to the list of nodes to immunize.

#### $(G, G)$ Variant:

We defined the $(G, G)$ version of acquaintance immunization as the case where both the node set for sampling and the local neighborhood information for each sampled node come from the true network, $G$. The $(G, G)$ version of the algorithm is directly comparable to those used in existing literature without consideration of missing data. The $(G, G)$ version is applicable in certain limited cases where missing data is a problem for global strategies, when there is neither the time nor resources to conduct collect fully saturated network data, but a complete sampling frame exists and a limited number of surveys can be conducted accurately, such as in a school or a small government with an accurate census. Regardless, including this variant allows us to compare the best-case scenario of stochastic strategies to the global strategies.

#### $(G', G')$ Variant:

In the $(G', G')$ variant, both the randomly sampled nodes and their local neighborhood information come from the observed, incomplete network, $G'$ (not the true network, $G$). Thus, only nodes in the observed network, $G'$, are available to be sampled and are listed as neighbors of the sampled nodes. This also means that only nodes in the observed network are able to be immunized. The $(G', G')$ variant is the most comparable to the global algorithms, as the process only depends on information from the observed network data. More generally, we see the $(G', G')$ variant as the most realistic version of acquaintance immunization, especially with hidden populations.

#### $(G', G)$ Variant:

The $(G', G)$ version tests the scenario where no complete sampling frame exists, but perfect local information is attainable. Thus, the node set for a $(G', G)$ version is incomplete, but the local information about the sampled nodes' neighborhood comes from the true network, $G$, which has complete information. This means that the researcher is able to identify and immunize any neighbor of nodes in the sampling frame, even if that node is not in the observed network, $G'$ (meaning no refusal of treatment). This scenario exemplifies an ideal, theoretical case of using acquaintance immunization for hidden or hard to reach populations. For instance, settings where the neighbors for each node can be uniquely identified (even if they are not initially in the study, e.g. with a phone number), where the sampled nodes' trust, memory, and knowledge does not restrict information about their neighbors, and where the locatability and trust of the sampled nodes' neighbors does not restrict the ability to treat those neighbors (neither through absence nor refusal).

#### $(\overline{G}, G)$ Variant:

The $(\overline{G}, G)$ variant is similar in concept to the $(G', G)$ version above and assumes that the researcher's sampling frame is initially incomplete, but since their network information is valid it can be used to supplement the sampling frame. For example, a researcher following an acquaintance immunization scheme is initially limited to the incomplete sampling frame when selecting a random node, but that node (who is undergoing a surveying process already) can inform the researchers of their neighbors. In the $(\overline{G}, G)$ variant, we allowed nodes queried in the process to add their neighbors to the sampling frame for the subsequent discoveries and immunizations. This variant therefore leverages the immunization procedure to continue data collection and continuously uncover missing data (if any).

## Immunization and SIR infection model

The next step in the test took each version of the true network, $G$ (from step 1), immunized the nodes identified by each strategy for that version of $G$ (from step 3) and simulated epidemic dynamics through the treated (static) network. We considered 3 immunization levels: 5%, 10%, and 15%. For example, with the 10% immunization level, 100 people in a network with 1000 nodes were immunized, determined by the rank ordering of important actors specific to that immunization strategy (if global), or the selection of important nodes through random exploration (if stochastic). This immunization is assumed to be 100% effective on the single contagion being modeled.

Once the important actors were immunized in their own copies of the original network, we used Monte Carlo calculations of the Susceptible-Infectious-Recovered (SIR) model to estimate the final outbreak size for each immunization strategy (for a particular parameter set) by running multiple groups of simple SIR simulations through the treated networks. In SIR simulations, every infected node infect their susceptible neighbours at rate $\beta$ and recover at rate $\gamma$. The SIR model runs until there are no longer any infected nodes. We assume the infection runs its course without further intervention. This model was chosen for its simplicity and applicability to varied scenarios.

For our simulations, we made use of the exceptionally fast implementation by St-Onge et al. . For simplicity, we set time units to be equal to the expected recovery time (such that $\gamma =1$) and vary $\beta$ over a large enough range to explore outbreaks of varied sizes. In addition to these parameters, we also report the corresponding $R_0$ values defined as the average number of secondary cases by an infectious individual in an otherwise susceptible population (the simulation software uses the average number of secondary cases caused by the second infectious individual).

More generally, the goal of our analysis is to examine the effect of missing data on immunization strategies for a generalized outbreak model. Thus, our results are not based on a single infection (e.g., HIV) but instead, we look at a range of cases where each case could be thought of as a different type of infection, with its own infectiousness and recovery rate. The epidemiological case could thus be anything transmitted over network connections. The input parameters in the simulation are consistent with a range of infections, such as HCV and HIV (lower infection potential) to varicella or mumps (higher infection potential).

One common approach in the targeted-immunization literature is to consider only large-scale outbreaks during this simulation process . This method avoids issues related to the frequently bimodal nature of SIR outbreak distributions, see Ref. and the SI, but fails close to the epidemic threshold when there is no systematic threshold to be used. Instead, we were able to reach a tight confidence bound on the mean outbreak size for each set of parameters we tested, despite the extreme variability of many outbreak size distributions, by using $10^7$ Monte Carlo simulations for each parameter set. We spread these $10^7$ simulations out over 5000 separate networks that we generated with similar characteristics to reduce the risk of spurious results that can occur from only testing on a single network or a small number of individual networks. Each of these 5000 networks was sampled to simulate missing data before removing nodes for each strategy and for every immunization level; 2000 SIR simulations were then run for each of these treated networks and the mean of these 2000 simulations was recorded and placed in a distribution of means over all 5000 networks. The values we report are the grand mean of these 5000 means. We separately recorded the size of each individual outbreak and display some of these in the SI. We ran this process with the SIR model for each new level of missing data, recalculation of centrality (or relevant measure), and immunized target nodes, each time recording the size of the SIR outbreak. The means are then compared between strategies at given levels of missing data to determine their relative effectiveness. All comparisons discussed in the results were verified with t-tests using the distributions of means (full significance tests in the SI).

# Results

## Simulations on the Colorado Springs network

Our first set of results is based on the synthetic "medium transitivity" Colorado Springs network. We found unsurprisingly that random immunization was the worst strategy at every level of missing data and immunization coverage (see Fig. ). All targeted strategies reduce outbreak size further than random immunization, despite random immunization being perfectly robust to missing data (as a random choice of nodes to immunize from a random sample of nodes is still perfectly random). This is an important finding: even at extremely high levels of missing nodes (e.g., 80% missing), targeted immunization was still preferable to random immunization by a considerable margin. In fact, random immunization had significantly higher outbreak levels than every other strategy, under every possible condition.

Degree, self-reported degree, and betweenness immunization all outperformed random immunization, but also showed deteriorating effectiveness as missing data levels increased. These strategies were effective (i.e., low outbreak size) when missing data were low, with worse performance as missing data increased (see panel i or ii in Fig. ). For example, at 5% immunization, the expected outbreak size under degree immunization went from around 17% with no missing data to 26% with 80% missing; with 10% immunization, the outbreak size increased from 4% to 24%. This also meant that the benefit of increasing immunization coverage (e.g., moving from 5% to 10% coverage) were higher when missing data were low.

The global strategies of betweenness, degree and self-reported degree outperformed the stochastic strategies, based on acquaintance immunization, only at low levels of missing data. Indeed, the global strategies were initially superior relative to acquaintance immunization, but rapidly became less effective as missing data increased, whereas $(G', G)$ lost its effectiveness more slowly, the $(G, G)$ lines were flat and $(\overline{G}, G)$ strategy actually improved slightly. The crossover point differed across the different values of immunization coverage, but all fell between 50% and 80% missing data. As the proportion of immunization coverage was reduced, the stochastic measures did not surpass the global strategies until higher levels of missing data were reached since the effect of missing data on the global strategies was weaker. In general, however, we saw that the relative ranking of the strategies was quite consistent at the highest and lowest levels of missing data.

Figure also highlights a more surprising result: $(\overline{G}, G)$, which starts with an initially incomplete sampling frame but updates it when acquaintance immunization leads to the discovery of new nodes, was as effective or better than $(G, G)$, the equivalent strategy with complete information. This result held even at extremely high levels of missing data and low levels of immunizations. In fact, the $(\overline{G}, G)$ variant was found to actually increase in effectiveness as levels of missing data increase. This most likely stems from the fact that, by coupling data discovery with acquaintance immunization, $(\overline{G}, G)$ discovers important nodes that were initially missed while ignoring lower degree nodes. Indeed, if the initial data collection missed a central node of high degree, the acquaintance immunization is likely to find that node even when starting with an incomplete sampling frame. Therefore, while an updating $(\overline{G}, G)$ with 5% level of immunization is unlikely to fully recover an 80% level of missing data, it will recover the most important pieces of missing data. For example, with the medium transitivity networks at 80% missing data, we observed that by the point in the $(\overline{G}, G)$ acquaintance process where the desired 10% of nodes to target had been identified, the sample of nodes had become positively biased towards high degree nodes, with a mean degree of 9.7 compared to the overall mean degree of the network of 8.46.

The results for the low and high transitivity networks, presented in Figs. , were generally consistent with the medium transitivity results. One key difference was that $(\overline{G}, G)$ did not improve with missing data on networks with low transitivity, suggesting the relevance of transitivity and/or outbreak size for targeted data recovery. Still, all targeted strategies outperformed random immunization, while degree and betweenness were the optimal strategies up to a threshold of missing data between 40% and 80%, where acquaintance immunization, $(G', G)$, $(G, G)$, or $(\overline{G}, G)$, became the best choice.

Altogether, the results so far summarize two of our main findings. First, there exists a threshold of missing data over which local stochastic strategies like acquaintance immunization outperformed global strategies based on network centrality metrics. Second, acquaintance immunization strategies which discover missing nodes adaptively are just as effective or better than equivalent strategies with complete data.

## Additional analyses

Our first set of additional analyses studied the low, medium, and high transitivity variants of the Colorado Springs network over a wide range of input parameters. We systematically varied the level of transmissibility in the simulation, allowing $\beta$ to range from $0.2$ to $1.7$, a range of values higher and lower than that used in the main results ($0.95$). These $\beta$ values lead to $R_0$ values in line with infections as diverse as Hepatitis C to mumps. The results, presented in the SI, suggest that the level of infectiousness does not dramatically affect the relative ranking of the immunization strategies.

The second set of additional analyses extends the results using the Add Health network of friendships between adolescents in school. The analysis allows us to generalize the results to networks with very different structural features, and where different kinds of pathogens (such as mononucleosis) might spread. As shown in Fig. , the Add Health networks lack a long tail for the degree distribution; unlike the Colorado Springs networks, a few actors do not disproportionately determine the structure of the school networks.

Results using the Add Health network are shown in Fig.  and feature some important differences from our previous results. The targeted immunization strategies still all improved on the performance of random immunization, but here the reduction in outbreak size was smaller than in the Colorado Springs networks. For example, in the Add Health network with 10% immunized, 40% missing and $\beta$ set to 0.95, degree centrality yielded a 5% lower final outbreak size than random immunization; compare this to a 14% difference in the Colorado Springs network (medium transitivity). This is the case, in part, because the Add Health network has few (or no) extremely central nodes. This means that the most central nodes have only marginally higher centrality than less central nodes. Thus it can be harder to select who should be immunized (especially with missing data), reducing the returns to targeted immunization in such cases.

The structure of the Add Health network also affected some of the specific findings related to $(\overline{G}, G)$. In the Add Health network, the $(\overline{G}, G)$ strategy sometimes performed worse than $(G, G)$, specifically at higher levels of infectiousness. This observation again suggests that low infectiousness might be a key criteria for the targeted $(\overline{G}, G)$ to outperform the complete information of $(G, G)$, but also stresses the importance of central hubs and degree heterogeneity.

Finally, an extensive comparison of the relative performance of $(\overline{G}, G)$ and $(G, G)$ under different values of infectiousness and under different network structures is shown in Fig. . These results confirmed our previous observations: The targeted data recovery scheme implemented by $(\overline{G}, G)$ performed better when infectiousness was low and the network structure featured significant degree heterogeneity. Most likely, this stems from the fact that targeted data recovery will find central nodes if those are also high-degree nodes, and that weak epidemics will be concentrated around these central hubs. When facing an outbreak close to its epidemic threshold on heterogeneous networks, we therefore expect that an intervention using an incomplete sampling frame and the targeted data recovery scheme of $(\overline{G}, G)$ would outperform an equivalent intervention using a known and complete census. That being said, at extremely low transmission rate ($\beta \rightarrow 0$) both strategies must be equivalent since outbreaks are simply impossible.

To summarize our results, the rank ordering of the strategies at different levels of missing data was found to be mostly independent of network structure and transmission rate. Similarly, acquaintance immunization strategies were found to be significantly more robust to missing data than the typical benchmark strategies requiring global information. In particular, acquaintance immunization that leverage the intervention for targeted data recovery were found to improve with higher levels of missing data, unlike any other approaches.

# Discussion

In this paper, we have produced and implemented a method of comparing both global and stochastic targeted immunization strategies under conditions of imperfect data. Nearly two decades of research suggest that these types of strategies would be of considerable help in reducing the spread of contagion. Our research represents an important step in reconciling past research with the common reality of imperfect network census coverage — introducing a method to formally examine the intuitive notion that strategies which perform well under perfect conditions may be ineffective when there is missing data. While missing data is ubiquitous in network science, this reconciliation is especially important in contexts where data collection is difficult, such as when dealing with vulnerable hidden populations, networks based on unobtrusive observation, and in projects with limited resources.

Our most consistent finding is the clear superiority of targeted immunization over random immunization, even at very high levels of missing data (e.g., 80% missing nodes). This suggests that targeted immunization strategies are useful even in cases where the prospects for complete network data are relatively poor — a positive sign for the applicability of targeted immunization strategies.

We also find that missing data generally leads to higher outbreak levels, with some strategies more affected by missing data than others. For example, betweenness and both degree strategies perform best at low levels of missing data, but tend to converge with other strategies as missing data increases. Additionally, at very high levels of missing data, our three variants of acquaintance immunization — $(G', G)$, $(G, G)$ and $(\overline{G}, G)$ — outstrip both degree strategies and betweenness immunization and have the lowest outbreak sizes relative to other strategies.

Importantly, the variant $(\overline{G}, G)$ which couples immunization with additional data collection, often performs as well or better than acquaintance immunization with complete data $(G, G)$, while relying on nodes in the incomplete sampling frame. This important result stems from the fact that the targeted immunization procedure is leveraged by $(\overline{G}, G)$ as a targeted data recovery scheme. Moreover, this strategy was the only one that was able to perform better with higher levels of missing data. This result opens up a promising new avenue of research for targeted data recovery in networks with missing data, an idea which could be powerful even beyond immunization problems. And at the very least, this idea stresses the importance of at least acknowledging that the available data might be incomplete.

Overall, while some strategies are more sensitive to missing data, they still may be an optimal choice over more robust strategies. This is the case as the less robust strategies tended to be more effective when missing data were low. We claim the following. First, the relative effectiveness of an immunization strategy with full network knowledge does not accurately predict its relative effectiveness with incomplete data. Second, immunization strategies which do not need global data may still be affected by incomplete sampling frames and local data. Third, even when stochastic strategies use perfect information, a less robust strategy, like betweenness, may be more effective at many levels of missing data and immunization coverage. Finally, the relative effectiveness of a robust strategy compared to a non-robust strategy is context specific. The choice is rarely so simple as global versus stochastic, with the optimal strategy depending heavily on the level of missing data and the immunization coverage.

Our results are based on a wide range of scenarios, but we hope to see future work extend our analysis, considering other immunization strategies, different network topologies, different outbreak models, coevolution of outbreaks and interventions, missing data related to the infection status of participants, and other different types of missing data including non-random missing nodes and edges . Our method is designed with versatility in mind, and can be easily generalized to have the complete portion of the data originate from any sampling process. It is also easy to accommodate a wide variety of biases and other complications. This allows our method to address the larger problem of immunization of partially-observed networks. Betweenness centrality, for example, is difficult to measure accurately when the network is small and the missing nodes are central to the network , and may prove ineffective as an immunization strategy under such conditions. Future work should thus consider the effect of missing central nodes on the effectiveness of different immunization strategies.

There are a number of practical implications for our study. Researchers "in the field" should, ideally, pay attention to both the effectiveness and robustness of the proposed immunization strategy. A researcher should not necessarily avoid a strategy that is affected by missing data (like degree or betweenness) as it still may be the best overall choice, better than more robust strategies. While our model still involves a number of simplifications, a researcher could use our results as a rough guide to consider this tradeoff. Armed with local knowledge of their particular population, sampling methods, and immunization logistics, including how the contagion spreads, the nature of the missing data, and the nature of what constitutes an immunization, one could adapt our methodology with more specific models for the outbreak (e.g. Refs. ), for the missing data (e.g. types or estimates ), and for an immunization campaign (e.g. incorporating imperfect immunization and ongoing immunization during an epidemic) to determine an optimized subset of nodes to immunize. The hope, more generally, is that a team designing an intervention in a real-world scenario could use our results (and similar/future work) to inform both the data collection and intervention campaign. To this end we have made the code used to produce these simulations publicly available.

# Data availability

Data and codes are available at: <https://github.com/sfrosenb/sfrosenb-Immunization_Strategies_in_Networks_with_Missing_Data>.

# Acknowledgments

This work was supported by the National Institute of General Medical Sciences of the National Institutes of Health (Grant No. P20 GM130461), the National Institutes of Health 1P20 GM125498-01 Centers of Biomedical Research Excellence Award, and the Rural Drug Addiction Research Center at the University of Nebraska-Lincoln. S.F.R. is supported as a Fellow of the National Science Foundation under NRT award DGE-1735316. The authors acknowledge the Vermont Advanced Computing Core at the University of Vermont for providing High Performance Computing resources, Guillaume St-Onge for providing the simulation software as well as Andrew Becker and Jane Adams for their useful comments. The primary author would also like to thank a number of mentors for early guidance in this project including Patrick Habecker, Elspeth Ready, Kirk Dombrowski, Alan Jamieson, and Andrew Cognard-Black.


abstract: A new account of parameter setting during grammatical acquisition is presented in terms of Generalized Categorial Grammar embedded in a default inheritance hierarchy, providing a natural partial ordering on the setting of parameters. Experiments show that several experimentally effective learners can be defined in this framework. Evolutionary simulations suggest that a learner with default initial settings for parameters will emerge, provided that learning is memory limited and the environment of linguistic adaptation contains an appropriate language.
author: Ted Briscoe
`firstname.lastname@example.com`
Computer Laboratory
University of Cambridge
Pembroke Street
Cambridge CB2 3QG, UK
title: Co-evolution of Language and of the Language Acquisition Device

# Theoretical Background

Grammatical acquisition proceeds on the basis of a partial genotypic specification of (universal) grammar (UG) complemented with a learning procedure enabling the child to complete this specification appropriately. The parameter setting framework of Chomsky (1981) claims that learning involves fixing the values of a finite set of finite-valued parameters to select a single fully-specified grammar from within the space defined by the genotypic specification of UG. Formal accounts of parameter setting have been developed for small fragments but even in these search spaces contain local maxima and subset-superset relations which may cause a learner to converge to an incorrect grammar (Clark, 1992; Gibson and Wexler, 1994; Niyogi and Berwick, 1995). The solution to these problems involves defining default, unmarked initial values for (some) parameters and/or ordering the setting of parameters during learning.

Bickerton (1984) argues for the Bioprogram Hypothesis as an explanation for universal similarities between historically unrelated creoles, and for the rapid increase in grammatical complexity accompanying the transition from pidgin to creole languages. From the perspective of the parameters framework, the Bioprogram Hypothesis claims that children are endowed genetically with a UG which, by default, specifies the stereotypical core creole grammar, with right-branching syntax and subject-verb-object order, as in Saramaccan. Others working within the parameters framework have proposed unmarked, default parameters (e.g. Lightfoot, 1991), but the Bioprogram Hypothesis can be interpreted as towards one end of a continuum of proposals ranging from all parameters initially unset to all set to default values.

# The Language Acquisition Device

A model of the Language Acquisition Device (LAD) incorporates a UG with associated parameters, a parser, and an algorithm for updating initial parameter settings on parse failure during learning.

## The Grammar (set)

Basic categorial grammar (CG) uses one rule of application which combines a functor category (containing a slash) with an argument category to form a derived category (with one less slashed argument category). Grammatical constraints of order and agreement are captured by only allowing directed application to adjacent matching categories. Generalized Categorial Grammar (GCG) extends CG with further rule schemata.[^1] The rules of FA, BA, generalized weak permutation (P) and backward and forward composition (FC, BC) are given in Figure  (where X, Y and Z are category variables, $\mid$ is a variable over slash and backslash, and $\ldots$ denotes zero or more further functor arguments). Once permutation is included, several semantically equivalent derivations for *Kim loves Sandy* become available, Figure  shows the non-conventional left-branching one. Composition also allows alternative non-conventional semantically equivalent (left-branching) derivations.

```latex
\begin{figure*}
\begin{center}
\begin{tabular}{|ll|}
\hline
\hline
\multicolumn{2}{|c|}{Forward Application:} \\[0.2cm]
X/Y Y $\Rightarrow$\ X & $\lambda$ y [X(y)] (y) $\Rightarrow$\ X(y)\\[0.3cm]
\multicolumn{2}{|c|}{Backward Application:} \\[0.2cm]
Y X$\backslash$Y $\Rightarrow$\ X & $\lambda$ y [X(y)] (y) $\Rightarrow$\ X(y)\\[0.2cm]
\hline
\hline
\multicolumn{2}{|c|}{Forward Composition:} \\[0.2cm]
X/Y Y/Z $\Rightarrow$\ X/Z & $\lambda$ y [X(y)] $\lambda$ z [Y(z)] $\Rightarrow$\ $\lambda$ z [X(Y(z))]\\[0.2cm]
\multicolumn{2}{|c|}{Backward Composition:} \\[0.2cm]
Y$\backslash$Z X$\backslash$Y $\Rightarrow$\ X$\backslash$Z & $\lambda$ z [Y(z)] $\lambda$ y [X(y)] $\Rightarrow$\ $\lambda$ z [X(Y(z))]\\[0.2cm]
\hline
\hline
\multicolumn{2}{|c|}{(Generalized Weak) Permutation:} \\[0.2cm]
(X$\mid$Y$_{1}$)$\ldots\mid$Y$_{n}$ $\Rightarrow$\
(X$\mid$Y$_{n}$)$\mid$Y$_{1}\ldots$ & $\lambda$ y$_{n}\ldots$,y$_{1}$ [X(y$_{1}\ldots$,y$_{n}$)] $\Rightarrow$\  $\lambda$ y$_{1}$,y$_{n}\ldots$ [X(y$_{1}\ldots$,y$_{n}$)]\\[0.2cm]
\hline
\hline
\end{tabular}
\caption{GCG Rule Schemata}
\label{rules}
\end{center}
\end{figure*}
```

GCG as presented is inadequate as an account of UG or of any individual grammar. In particular, the definition of atomic categories needs extending to deal with featural variation (e.g. Bouma and van Noord, 1994), and the rule schemata, especially composition and weak permutation, must be restricted in various parametric ways so that overgeneration is prevented for specific languages. Nevertheless, GCG does represent a plausible kernel of UG; Hoffman (1995, 1996) explores the descriptive power of a very similar system, in which generalized weak permutation is not required because functor arguments are interpreted as multisets. She demonstrates that this system can handle (long-distance) scrambling elegantly and generates mildly context-sensitive languages (Joshi *et al*, 1991).

The relationship between GCG as a theory of UG (GCUG) and as a the specification of a particular grammar is captured by embedding the theory in a default inheritance hierarchy. This is represented as a lattice of typed default feature structures (TDFSs) representing subsumption and default inheritance relationships (Lascarides *et al*, 1996; Lascarides and Copestake, 1996). The lattice defines intensionally the set of possible categories and rule schemata via type declarations on nodes. For example, an intransitive verb might be treated as a subtype of verb, inheriting subject directionality by default from a type **gendir** (for general direction). For English, **gendir** is default **right** but the node of the (intransitive) functor category, where the directionality of subject arguments is specified, overrides this to **left**, reflecting the fact that English is predominantly right-branching, though subjects appear to the left of the verb. A transitive verb would inherit structure from the type for intransitive verbs and an extra NP argument with default directionality specified by **gendir**, and so forth.[^2]

For the purposes of the evolutionary simulation described in §3, GC(U)Gs are represented as a sequence of *p-settings* (where *p* denotes principles or parameters) based on a flat (ternary) sequential encoding of such default inheritance lattices. The inheritance hierarchy provides a partial ordering on parameters, which is exploited in the learning procedure. For example, the atomic categories, **N**, **NP** and **S** are each represented by a parameter encoding the presence/absence or lack of specification (T/F/?) of the category in the (U)G. Since they will be unordered in the lattice their ordering in the sequential coding is arbitrary. However, the ordering of the directional types **gendir** and **subjdir** (with values L/R) is significant as the latter is a more specific type. The distinctions between absolute, default or unset specifications also form part of the encoding (A/D/?). Figure  shows several equivalent and equally correct sequential encodings of the fragment of the English type system outlined above.

```latex
\begin{figure*}
\begin{center}
\begin{tabular}{|llllll|}
\hline
{\bf NP} & {\bf N} & {\bf S} & {\bf gen-dir} & {\bf subj-dir} & {\bf applic}\\
A T     & A T     & A T     & D R           & D L             & D T\\
\hline
{\bf NP} & {\bf gendir} & {\bf applic} & {\bf S} & {\bf N} & {\bf subj-dir} \\
A T     & D R            & D T           & A T     & A T     & D L \\
\hline
{\bf applic} & {\bf NP} & {\bf N} & {\bf gen-dir} & {\bf subj-dir} & {\bf S} \\
D T          & A T     & A T     & D R             & D L          & A T \\
\hline
\ldots &&&&& \\
\hline
\end{tabular}
\end{center}
\caption{Sequential encodings of the grammar fragment}
\label{binencoding}
\end{figure*}
```

A set of grammars based on typological distinctions defined by basic constituent order (e.g. Greenberg, 1966; Hawkins, 1994) was constructed as a (partial) GCUG with independently varying binary-valued parameters. The eight basic language families are defined in terms of the unmarked order of verb (V), subject (S) and objects (O) in clauses. Languages within families further specify the order of modifiers and specifiers in phrases, the order of adpositions and further phrasal-level ordering parameters. Figure  list the language-specific ordering parameters used to define the full set of grammars in (partial) order of generality, and gives examples of settings based on familiar languages such as "English", "German" and "Japanese".[^3]

```latex
\begin{figure*}
\begin{center}
\begin{tabular}{|l|lllllllllll|}
\hline
& {\bf gen} & {\bf v1} & {\bf n} & {\bf subj} & {\bf obj} & {\bf v2}
& {\bf mod} & {\bf spec} & {\bf relcl} & {\bf adpos} & {\bf compl}\\
\hline
Engl & R   & F        & R       & L           & R        & F
& R         & R          & R           & R           & R\\
Ger  & R   & F        & R       & L           & L        & T
& R         & R          & R           & R           & R\\
Jap  & L   & F        & L       & L           & L        & F
& L         & L          & L           & L           & ?\\
\hline
\end{tabular}
\end{center}
\caption{The Grammar Set -- Ordering Parameters}
\label{lgset}
\end{figure*}
```

"English" defines an SVO language, with prepositions in which specifiers, complementizers and some modifiers precede heads of phrases. There are other grammars in the SVO family in which all modifers follow heads, there are postpositions, and so forth. Not all combinations of parameter settings correspond to attested languages and one entire language family (OVS) is unattested. "Japanese" is an SOV language with postpositions in which specifiers and modifiers follow heads. There are other languages in the SOV family with less consistent left-branching syntax in which specifiers and/or modifiers precede phrasal heads, some of which are attested. "German" is a more complex SOV language in which the parameter verb-second (v2) ensures that the surface order in main clauses is usually SVO.[^4]

There are 20 p-settings which determine the rule schemata available, the atomic category set, and so forth. In all, this CGUG defines just under 300 grammars. Not all of the resulting languages are (stringset) distinct and some are proper subsets of other languages. "English" without the rule of permutation results in a stringset-identical language, but the grammar assigns different derivations to some strings, though the associated logical forms are identical. "English" without composition results in a subset language. Some combinations of p-settings result in 'impossible' grammars (or UGs). Others yield equivalent grammars, for example, different combinations of default settings (for types and their subtypes) can define an identical category set.

The grammars defined generate (usually infinite) stringsets of lexical syntactic categories. These strings are sentence types since each is equivalent to a finite set of grammatical sentences formed by selecting a lexical instance of each lexical category. Languages are represented as a finite subset of sentence types generated by the associated grammar. These represent a sample of degree-1 learning triggers for the language (e.g. Lightfoot, 1991). Subset languages are represented by 3-9 sentence types and 'full' languages by 12 sentence types. The constructions exemplified by each sentence type and their length are equivalent across all the languages defined by the grammar set, but the sequences of lexical categories can differ. For example, two SOV language renditions of *The man who Bill likes gave Fred a present*, one with premodifying and the other postmodifying relative clauses, both with a relative pronoun at the right boundary of the relative clause, are shown below with the differing category highlighted.
Bill likes who the-man a-present Fred gave
NP$_{s}$ (S$\backslash$NP$_{s}$)$\backslash$NP$_{o}$ Rc$\backslash$(S$\backslash$NP$_{o}$) **NP$_{s}\backslash$Rc** NP$_{o2}$ NP$_{o1}$ ((S$\backslash$NP$_{s}$)$\backslash$NP$_{o2}$)$\backslash$NP$_{o1}$
The-man Bill likes who a-present Fred gave
**NP$_{s}$/Rc** NP$_{s}$ (S$\backslash$NP$_{s}$)$\backslash$NP$_{o}$ Rc$\backslash$(S$\backslash$NP$_{o}$) NP$_{o2}$ NP$_{o1}$ ((S$\backslash$NP$_{s}$)$\backslash$NP$_{o2}$)$\backslash$NP$_{o1}$

## The Parser

The parser is a deterministic, bounded-context stack-based shift-reduce algorithm. The parser operates on two data structures, an input buffer or queue, and a stack or push down store. The algorithm for the parser working with a GCG which includes application, composition and permutation is given in Figure .

This algorithm finds the most left-branching derivation for a sentence type because Reduce is ordered before Shift. The category sequences representing the sentence types in the data for the entire language set are designed to be unambiguous relative to this 'greedy', deterministic algorithm, so it will always assign the appropriate logical form to each sentence type. However, there are frequently alternative less left-branching derivations of the same logical form.

The parser is augmented with an algorithm which computes working memory load during an analysis (e.g. Baddeley, 1992). Limitations of working memory are modelled in the parser by associating a cost with each stack cell occupied during each step of a derivation, and recency and depth of processing effects are modelled by resetting this cost each time a reduction occurs: the working memory load (WML) algorithm is given in Figure . Figure  gives the right-branching derivation for *Kim loves Sandy*, found by the parser utilising a grammar without permutation. The WML at each step is shown for this derivation. The overall WML (16) is higher than for the left-branching derivation (9).

```latex
\begin{figure*}
\begin{center}
\begin{tabular}{|lllll|}
\hline
Stack                            & Input Buffer       & Operation & Step & WML\\
\hline
                                 & Kim loves Sandy    &           & 0 & 0 \\
\hline
Kim:NP:kim$'$                    & loves Sandy        & Shift     & 1 & 1\\
\hline
loves:(S$\backslash$NP)/NP:$\lambda$ y,x(love$'$ x, y) & Sandy   & Shift     & 2 & 3\\
Kim:NP:kim$'$                    & & & &\\
\hline
Sandy:NP:sandy$'$                           &         & Shift     & 3 & 6\\
loves:(S$\backslash$NP)/NP:$\lambda$ y,x(love$'$ x, y) & & & &\\
Kim:NP:kim$'$                    & & & &\\
\hline
loves Sandy:S/NP:$\lambda$ x(love$'$ x, sandy$'$) &    & Reduce (A) & 4 & 5\\
Kim:NP:kim$'$                    & & & &\\
\hline
Kim loves Sandy:S:(love$'$ kim$'$, sandy$'$)  &       & Reduce (A) & 5 & 1\\
\hline
\end{tabular}
\end{center}
\caption{WML for {\it Kim loves Sandy}}
\label{Kim2}
\end{figure*}
```

The WML algorithm ranks sentence types, and thus indirectly languages, by parsing each sentence type from the exemplifying data with the associated grammar and then taking the mean of the WML obtained for these sentence types. "English" with Permutation has a lower mean WML than "English" without Permutation, though they are stringset-identical, whilst a hypothetical mixture of "Japanese" SOV clausal order with "English" phrasal syntax has a mean WML which is 25% worse than that for "English". The WML algorithm is in accord with existing (psycholinguistically-motivated) theories of parsing complexity (e.g. Gibson, 1991; Hawkins, 1994; Rambow and Joshi, 1994).

## The Parameter Setting Algorithm

The parameter setting algorithm is an extension of Gibson and Wexler's (1994) Trigger Learning Algorithm (TLA) to take account of the inheritance-based partial ordering and the role of memory in learning. The TLA is error-driven – parameter settings are altered in constrained ways when a learner cannot parse trigger input. Trigger input is defined as primary linguistic data which, because of its structure or context of use, is determinately unparsable with the correct interpretation (e.g. Lightfoot, 1991). In this model, the issue of ambiguity and triggers does not arise because all sentence types are treated as triggers represented by p-setting schemata. The TLA is memoryless in the sense that a history of parameter (re)settings is not maintained, in principle, allowing the learner to revisit previous hypotheses. This is what allows Niyogi and Berwick (1995) to formalize parameter setting as a Markov process. However, as Brent (1996) argues, the psychological plausibility of this algorithm is doubtful – there is no evidence that children (randomly) move between neighbouring grammars along paths that revisit previous hypotheses. Therefore, each parameter can only be reset once during the learning process. Each step for a learner can be defined in terms of three functions: p-setting, grammar and parser, as:
parser$_{i}$(grammar$_{i}$(p-setting$_{i}$(Sentence$_{j}$)))
A p-setting defines a grammar which in turn defines a parser (where the subscripts indicate the output of each function given the previous trigger). A parameter is updated on parse failure and, if this results in a parse, the new setting is retained. The algorithm is summarized in Figure .

Working memory grows through childhood (e.g. Baddeley, 1992), and this may assist learning by ensuring that trigger sentences gradually increase in complexity through the acquisition period (e.g. Elman, 1993) by forcing the learner to ignore more complex potential triggers that occur early in the learning process. The WML of a sentence type can be used to determine whether it can function as a trigger at a particular stage in learning.

# The Simulation Model

The computational simulation supports the evolution of a population of Language Agents (LAgts), similar to Holland's (1993) Echo agents. LAgts generate and parse sentences compatible with their current p-setting. They participate in linguistic interactions which are successful if their p-settings are compatible. The relative fitness of a LAgt is a function of the proportion of its linguistic interactions which have been successful, the expressivity of the language(s) spoken, and, optionally, of the mean WML for parsing during a cycle of interactions. An interaction cycle consists of a prespecified number of individual random interactions between LAgts, with generating and parsing agents also selected randomly. LAgts which have a history of mutually successful interaction and high fitness can 'reproduce'. A LAgt can 'live' for up to ten interaction cycles, but may 'die' earlier if its fitness is relatively low. It is possible for a population to become extinct (for example, if all the initial LAgts go through ten interaction cycles without any successful interaction occurring), and successful populations tend to grow at a modest rate (to ensure a reasonable proportion of adult speakers is always present). LAgts learn during a critical period from ages 1-3 and reproduce from 4-10, parsing and/or generating any language learnt throughout their life.

During learning a LAgt can reset genuine parameters which either were unset or had default settings 'at birth'. However, p-settings with an absolute value (principles) cannot be altered during the lifetime of an LAgt. Successful LAgts reproduce at the end of interaction cycles by one-point crossover of (and, optionally, single point mutation of) their *initial* p-settings, ensuring neo-Darwinian rather than Lamarckian inheritance. The encoding of p-settings allows the deterministic recovery of the initial setting. Fitness-based reproduction ensures that successful and somewhat compatible p-settings are preserved in the population and randomly sampled in the search for better versions of universal grammar, including better initial settings of genuine parameters. Thus, although the learning algorithm *per se* is fixed, a range of alternative learning procedures can be explored based on the definition of the inital set of parameters and their initial settings. Figure  summarizes crucial options in the simulation giving the values used in the experiments reported in §4 and Figure  shows the fitness functions.

# Experimental Results

## Effectiveness of Learning Procedures

Two learning procedures were predefined – a default learner and an unset learner. These LAgts were initialized with p-settings consistent with a minimal inherited CGUG consisting of application with NP and S atomic categories. All the remaining p-settings were genuine parameters for both learners. The unset learner was initialized with all unset, whilst the default learner had default settings for the parameters **gendir** and **subjdir** and **argorder** which specify a minimal SVO right-branching grammar, as well as default (off) settings for **comp** and **perm** which determine the availability of Composition and Permutation, respectively. The unset learner represents a 'pure' principles-and-parameters learner. The default learner is modelled on Bickerton's bioprogram learner.

Each learner was tested against an adult LAgt initialized to generate one of seven full languages in the set which are close to an attested language; namely, "English" (SVO, predominantly right-branching), "Welsh" (SVOv1, mixed order), "Malagasy" (VOS, right-branching), "Tagalog" (VSO, right-branching), "Japanese" (SOV, left-branching), "German" (SOVv2, predominantly right-branching), "Hixkaryana" (OVS, mixed order), and an unattested full OSV language with left-branching syntax. In these tests, a single learner interacted with a single adult. After every ten interactions, in which the adult randomly generated a sentence type and the learner attempted to parse and learn from it, the state of the learner's p-settings was examined to determine whether the learner had converged on the same grammar as the adult. Table  shows the number of such interaction cycles (i.e. the number of input sentences to within ten) required by each type of learner to converge on each of the eight languages.

```latex
\begin{table*}
\begin{center}
\begin{tabular}{|l|llllllll|}
\hline
{\bf Learner} & \multicolumn{8}{c|}{{\bf Language}} \\
\hline
        & SVO & SVOv1 & VOS & VSO & SOV & SOVv2 & OVS & OSV\\
\hline
Unset   & 60  & 80    & 70  & 80  & 70  & 70    & 70  & 70\\
Default & 60  & 60    & 60  & 60  & 60  & 60    & 80  & 70\\
\hline
\end{tabular}
\end{center}
\caption{Effectiveness of Two Learning Procedures}
\label{learneffect}
\end{table*}
```

These figures are each calculated from 100 trials to a 1% error rate; they suggest that, in general, the default learner is more effective than the unset learner. However, for the OVS language (OVS languages represent 1.24% of the world's languages, Tomlin, 1986), and for the unattested OSV language, the default (SVO) learner is less effective. So, there are at least two learning procedures in the space defined by the model which can converge with some presentation orders on some of the grammars in this set. Stronger conclusions require either exhaustive experimentation or theoretical analysis of the model of the type undertaken by Gibson and Wexler (1994) and Niyogi and Berwick (1995).

## Evolution of Learning Procedures

In order to test the preference for default versus unset parameters under different conditions, the five parameters which define the difference between the two learning procedures were tracked through another series of 50 cycle runs initialized with either 16 default learning adult speakers and 16 unset learning adult speakers, with or without memory-limitations during learning and parsing, speaking one of the eight languages described above. Each condition was run ten times. In the memory limited runs, default parameters came to dominate some but not all populations.

In a few runs all unset parameters disappeared altogether. In all runs with populations initialized to speak "English" (SVO) or "Malagasy" (VOS) the preference for default settings was 100%. In 8 runs with "Tagalog" (VSO) the same preference emerged, in one there was a preference for unset parameters and in the other no clear preference. However, for the remaining five languages there was no strong preference.

The results for the runs without memory limitations are different, with an increased preference for unset parameters across all languages but no clear 100% preference for any individual language. Table  shows the pattern of preferences which emerged across 160 runs and how this was affected by the presence or absence of memory limitations.

|           | Unset | Default | None |
|----------:|:------|:--------|:-----|
|       WML | 15    | 39      | 26   |
| $\neg$WML | 34    | 17      | 29   |

Overall preferences for parameter types

To test whether it was memory limitations during learning or during parsing which were affecting the results, another series of runs for "English" was performed with either memory limitations during learning but not parsing enabled, or vice versa. Memory limitations during learning are creating the bulk of the preference for a default learner, though there appears to be an additive effect. In seven of the ten runs with memory limitations only in learning, a clear preference for default learners emerged. In five of the runs with memory limitations only in parsing there appeared to be a slight preference for defaults emerging. Default learners may have a fitness advantage when the number of interactions required to learn successfully is greater because they will tend to converge faster, at least to a subset language. This will tend to increase their fitness over unset learners who do not speak any language until further into the learning period.

The precise linguistic environment of adaptation determines the initial values of default parameters which evolve. For example, in the runs initialized with 16 unset learning "Malagasy" VOS adults and 16 default (SVO) learning VOS adults, the learning procedure which dominated the population was a variant VOS default learner in which the value for **subjdir** was reversed to reflect the position of the subject in this language. In some of these runs, the entire population evolved a default **subjdir** 'right' setting, though some LAgts always retained unset settings for the other two ordering parameters, **gendir** and **argo**, as is illustrated in Figure . This suggests that if the human language faculty has evolved to be a right-branching SVO default learner, then the environment of linguistic adaptation must have contained a dominant language fully compatible with this (minimal) grammar.

## Emergence of Language and Learners

To explore the emergence and persistence of structured language, and consequently the emergence of effective learners, (pseudo) random initialization was used. A series of simulation runs of 500 cycles were performed with random initialization of 32 LAgts' p-settings for any combination of p-setting values, with a probability of 0.25 that a setting would be an absolute principle, and 0.75 a parameter with unbiased allocation for default or unset parameters and for values of all settings. All LAgts were initialized to be age 1 with a critical period of 3 interaction cycles of 2000 random interactions for learning, a maximum age of 10, and the ability to reproduce by crossover (0.9 probability) and mutation (0.01 probability) from 4-10. In around 5% of the runs, language(s) emerged and persisted to the end of the run.

Languages with close to optimal WML scores typically came to dominate the population quite rapidly. However, sometimes sub-optimal languages were initially selected and occasionally these persisted despite the later appearance of a more optimal language, but with few speakers. Typically, a minimal subset language dominated – although full and intermediate languages did appear briefly, they did not survive against less expressive subset languages with a lower mean WML. Figure  is a typical plot of the emergence (and extinction) of languages in one of these runs. In this run, around 10 of the initial population converged on a minimal OVS language and 3 others on a VOS language. The latter is more optimal with respect to WML and both are of equal expressivity so, as expected, the VOS language acquired more speakers over the next few cycles. A few speakers also converged on VOS-N, a more expressive but higher WML extension of VSO-N-GWP-COMP. However, neither this nor the OVS language survived beyond cycle 14. Instead a VSO language emerged at cycle 10, which has the same minimal expressivity of the VOS language but a lower WML (by virtue of placing the subject before the object) and this language dominated rapidly and eclipsed all others by cycle 40.

In all these runs, the population settled on subset languages of low expressivity, whilst the percentage of absolute principles and default parameters increased relative to that of unset parameters (mean % change from beginning to end of runs: +4.7, +1.5 and -6.2, respectively). So a second identical set of ten was undertaken, except that the initial population now contained two SOV-V2 "German" speaking unset learner LAgts. In seven of these runs, the population fixed on a full SOV-V2 language, in two on the intermediate subset language SOV-V2-N, and in one on the minimal subset language SOV-V2-N-GWP-COMP. These runs suggest that if a full language defines the environment of adaptation then a population of randomly initialized LAgts is more likely to converge on a (related) full language. Thus, although the simulation does not model the development of expressivity well, it does appear that it can model the emergence of effective learning procedures for (some) full languages. The pattern of language emergence and extinction followed that of the previous series of runs: lower mean WML languages were selected from those that emerged during the run. However, often the initial optimal SVO-V2 itself was lost before enough LAgts evolved capable of learning this language. In these runs, changes in the percentages of absolute, default or unset p-settings in the population show a marked difference: the mean number of absolute principles declined by 6.1% and unset parameters by 17.8%, so the number of default parameters rose by 23.9% on average between the beginning and end of the 10 runs. This may reflect the more complex linguistic environment in which (incorrect) absolute settings are more likely to handicap, rather than simply be irrelevant to, the performance of the LAgt.

# Conclusions

Partially ordering the updating of parameters can result in (experimentally) effective learners with a more complex parameter system than that studied previously. Experimental comparison of the default (SVO) learner and the unset learner suggests that the default learner is more efficient on typologically more common constituent orders. Evolutionary simulation predicts that a learner with default parameters is likely to emerge, though this is dependent both on the type of language spoken and the presence of memory limitations during learning and parsing. Moreover, a SVO bioprogram learner is only likely to evolve if the environment contains a dominant SVO language.

The evolution of a bioprogram learner is a manifestation of the Baldwin Effect (Baldwin, 1896) – genetic assimilation of aspects of the linguistic environment during the period of evolutionary adaptation of the language learning procedure. In the case of grammar learning this is a co-evolutionary process in which languages (and their associated grammars) are also undergoing selection. The WML account of parsing complexity predicts that a right-branching SVO language would be a near optimal selection at a stage in grammatical development when complex rules of reordering such as extraposition, scrambling or mixed order strategies such as v1 and v2 had not evolved. Briscoe (1997a) reports further experiments which demonstrate language selection in the model.

Though, simulation can expose likely evolutionary pathways under varying conditions, these might have been blocked by accidental factors, such as genetic drift or bottlenecks, causing premature fixation of alleles in the genotype (roughly corresponding to certain p-setting values). The value of the simulation is to, firstly, show that a bioprogram learner could have emerged via adaptation, and secondly, to clarify experimentally the precise conditions required for its emergence. Since in many cases these conditions will include the presence of constraints (working memory limitations, expressivity, the learning algorithm etc.) which will remain causally manifest, further testing of any conclusions drawn must concentrate on demonstrating the accuracy of the assumptions made about such constraints. Briscoe (1997b) evaluates the psychological plausibility of the account of parsing and working memory.

# References

[^1]: Wood (1993) is a general introduction to Categorial Grammar and extensions to the basic theory. The most closely related theories to that presented here are those of Steedman (e.g. 1988) and Hoffman (1995).

[^2]: Bouma and van Noord (1994) and others demonstrate that CGs can be embedded in a constraint-based representation. Briscoe (1997a,b) gives further details of the encoding of GCG in TDFSs.

[^3]: Throughout double quotes around language names are used as convenient mnemonics for familiar combinations of parameters. Since not all aspects of these actual languages are represented in the grammars, conclusions about actual languages must be made with care.

[^4]: Representation of the v1/v2 parameter(s) in terms of a type constraint determining allowable functor categories is discussed in more detail in Briscoe (1997b).