abstract: In this paper, we evaluate convolutional neural network (CNN) features using the AlexNet architecture developed by  and very deep convolutional network (VGGNet) architecture developed by . To date, most CNN researchers have employed the last layers before output, which were extracted from the fully connected feature layers. However, since it is unlikely that feature representation effectiveness is dependent on the problem, this study evaluates additional convolutional layers that are adjacent to fully connected layers, in addition to executing simple tuning for feature concatenation (e.g., layer 3 + layer 5 + layer 7) and transformation, using tools such as principal component analysis. In our experiments, we carried out detection and classification tasks using the Caltech 101 and Daimler Pedestrian Benchmark Datasets.
author: Hirokatsu Kataoka, Kenji Iwata, Yutaka Satoh
National Institute of Advanced Industrial Science and Technology (AIST)
Tsukuba, Ibaraki, Japan
`firstname.lastname@example.com, http://www.hirokatsukataoka.net/`
title: Feature Evaluation of Deep Convolutional Neural Networks for Object Recognition and Detection

# Introduction

Over the past few years, convolutional neural networks (CNNs) have significantly improved from the standpoint of the network architectures needed to facilitate recognition accuracy and to reduce processing costs . Currently, CNNs are primarily used to help users understand objects and scenes in an image. In our study, we applied a CNN to an ImageNet dataset containing over 1.4 million images and 1,000 object categories . Use of such a large-scale dataset allows us to model a wide variety of object recognition image features. By using the pre-trained ImageNet dataset model, we found that CNN is capable of presenting significantly more effective feature variations.

For feature extraction, Donahue *et al.* employed CNN features as a feature vector by combining those features with a support vector machine (SVM) classifier , while other researchers have evaluated and visualized CNN features with an eight-layer AlexNet architecture . More recent architectures utilize deep structures, such as the very deep convolutional network (VGGNet)  and GoogLeNet , which were developed by Oxford University's Visual Geometry Group and Google Inc., respectively.

According to He *et al.* , the most important CNN feature is deep architecture. Along this line, the VGGNet contains 16 to 19 layers and GoogLeNet utilizes 22 layers. VGGNet is frequently used in the computer vision field, not only in full scratch neural net models, but also as a feature generator. CNN's utility as a feature generator is also important because it can function well even if only a few learning samples are available. Thus, large-scale databases such as ImageNet can provide recognition rates that outperform human-level classification (e.g.,  ). However, this performance will fluctuate depending on the amount and variance of the data. Therefore, when CNN is used for feature generation, it provides better performance for some recognition problems than others.

Donahue *et al.* argued that usage should be limited to the last two layers before output, which are extracted from first and second fully connected layers in CNN features with AlexNet. However, we believe that more detailed evaluations should be undertaken since several different architectures have recently been proposed, and because middle layers have not been examined as feature descriptors. Accordingly, in this study, we performed more detailed experiments to evaluate two famous CNN architectures – AlexNet and VGGNet. In addition, we carried out simple tuning for feature concatenation (e.g., layer 3 + layer 5 + layer 7) and transformations (e.g., principal component analysis: PCA).

The rest of this paper is organized as follows. In Section 2, related works are listed. The feature settings are evaluated in Section 3. The results are shown in Section 4. Finally, we conclude the paper in Section 5.

# Related works

In the time since the neocognitron was first proposed by Fukushima , neuron-based recognition has become one of the most commonly used neural network architectures. Following that study, the LeNet-5  neocognitron model added a baseline to CNNs in order to create a more significant model. Current network architectures include standard structures such as multiple fully connected layers, while recent challengers employ pre-trained  , dropout , and rectified linear units (ReLU)  as improved learning models. The most outstanding computer vision result was obtained by AlexNet in the 2012 ImageNet Large Scale Visual Recognition Challenge (ILSVRC2012), which remains the image recognition leader, with 1,000 classes .

AlexNet made it possible to increase the number of layers in network architectures. For example, Krizhevsky *et al.* implemented an eight-layer model that includes convolution, pooling, and fully connected layers. More recent variations, such as the 16- or 19-layer VGGNet  , and the 22-layer GoogLeNet  models, have even deeper architectures. These deeper models outperform conventional models on the ILSVRC dataset . More specifically, when compared to the AlexNet (top-five error rate on the ILSVRC2012: 16.4%), deeper models achieved better performance levels with GoogLeNet and VGGNet (top-five error rate on the ILSVRC2014: 6.7% for GoogLeNet and 7.3% for VGGNet). Currently, the object detection problem is one of the most important topics in computer vision. The existing state-of-the-art framework, regions with convolutional neural networks (R-CNN), was proposed by Girshick *et al.* . This framework consists of two steps during which (i) object areas are extracted as object proposals, and (ii) CNN recognition is performed. Those authors adopted selective search  as an object proposal approach and VGGNet for the CNN architecture. However, while they restricted the object detection and recognition tasks to fully connected CNN features, we believe that the features of the other layers should be more carefully evaluated in order to determine whether they could provide more accurate recognition and detection.

# Feature settings and representations

In this paper, we evaluate two deep learning feature types. Figure shows the architectures of AlexNet  and VGGNet . We believe that while the evaluation itself is very important, particular attention must be paid to tunings such as concatenation and feature transformation. Basically, deep learning architectures are based on their approaches.

**Feature setting.** We begin by extracting the middle and deeper layers. Layers 3–7 of AlexNet and VGGNet are shown in Figure . Next, we extract each max-pooling layer (layers 3–5), and the last two fully connected layers (layers 6 and 7) in VGGNet.

**Concatenation and transformation.** Next, we concatenate neighboring or one-step layers such as layer-3,4,5 and layer-3,5,7. In feature transformation, we simply apply PCA, which is set at 1,500 dimensions in this experiment.

**Classifier.** In the next step, we apply deep learning features and SVM for object recognition. The parameters are based on DeCAF .

# Experiments

In this section, we discuss our experiments conducted using the Daimler pedestrian benchmark   and Caltech 101   Datasets. Figure  and   show the results of our deep CNN feature evaluations on the Daimler and Caltech 101 datasets, respectively. The figures also show VGGNet, AlexNet, and their compressed features with PCA (VGGNet(PCA) and AlexNet(PCA)).

In the Daimler dataset experiment, we found that the VGGNet(PCA) layers 5 and 4 showed the best performance rates at 99.35% and 98.92%, respectively. We also determined that PCA transforms low-dimensional features and feature vectors at better rates than the original features. The VGGNet layer 5 (98.91%) and layer 4 (98.81%) are, respectively, +0.44% and +0.11% improved with PCA. When AlexNet is used, layers 3 and 4 show top rates of 98.71% and 97.95%, respectively. As for VGGNet, layers 5 and 6 achieved the best results (91.8%) on the Caltech 101 dataset. However, these results show significant layer 5 differences between VGGNet (91.8%) and AlexNet (78.37%).

From the above results, it can be seen that features obtained from fully connected layers do not always provide the highest performance rates during recognition and detection tasks, and that middle-layer features are more flexible for some tasks. We also found that fully connected layers or max-pooling layers located near fully connected layers tend to perform better in general object recognition tasks, such as the Caltech 101 dataset.

The main difference between AlexNet and VGGNet is the architecture depth. Additionally, VGGNet assigns very small 3 $\times$ 3 convolutional kernels against the 7 $\times$ 7 (Conv 1), 5 $\times$ 5 (Conv 2), and 3 $\times$ 3 (others) kernels in AlexNet. The settings refrain the feature representation.

The classification results of concatenated vectors are shown in Table  and  . Here, it can be seen that concatenation of VGGNet layer-5,6,7 provides the highest levels of accuracy for both datasets. The rates are 99.38% on the Daimler dataset and 92.00% on the Caltech 101 dataset. For AlexNet, layer-3,4,5 and layer-3,5,7 achieved top performance rates on those datasets. The results show that combining features of the convolutional and fully connected layers provides better performance. It is especially noteworthy that VGGNet layer 5, which is near the fully connected layer, provides significantly high levels of feature extraction from an image patch.

| Layer |  VGGNet   |  AlexNet  |
|:-----:|:---------:|:---------:|
|  345  |   97.38   | **97.45** |
|  456  |   98.73   |   96.98   |
|  567  | **99.38** |   97.04   |
|  357  |   95.96   |   97.26   |

Feature concatenation on the Daimler pedestrian benchmark dataset. The highest rate for each architecture is shown in bold.

| Layer |  VGGNet   |  AlexNet  |
|:-----:|:---------:|:---------:|
|  345  |   78.13   |   77.95   |
|  456  |   85.03   |   77.06   |
|  567  | **92.00** |   77.38   |
|  357  |   73.07   | **77.91** |

Feature concatenation on the Caltech 101 dataset. The highest rate for each architecture is shown in bold.

# Conclusion

In this paper, we evaluated two different of convolutional neural network (CNN) architectures AlexNet and VGGNet. The convolutional features from layers 3–7 were performed on the Daimler pedestrian benchmark and Caltech 101 datasets. We then attempted to implement feature concatenation and PCA transformation. Our experimental results show that the fully connected layers did not always perform better for recognition tasks. Additionally, the experiments using the Daimler and Caltech 101 datasets showed that layer 5 tends to provide the highest level of accuracy, and that feature concatenation of convolutional and fully connected layers improves recognition performance.


author: Ray Jayawardhana
title: Unraveling Brown Dwarf Origins

Brown dwarfs are not massive enough to be stars, nor are they planets in the traditional sense. They are often found in isolation but may also be companions to stars. They share some characteristics with stars and others with planets, and occupy the mass range in between: from about 75 to about 10 Jupiter masses. Although there is the potential for an identity crisis (1), brown dwarfs may hold clues to the formation of stars as well as planets. The identification of hundreds of brown dwarfs over the past 5 years in the solar neighborhood and in young star clusters (see the figure) has led to widespread interest in their origin. \[For a discussion of brown dwarf chemistry, see (2).\]

How can free-floating objects with inferred masses as low as 10 Jupiter masses form? One possibility is that brown dwarfs form as a result of the turbulent fragmentation and contraction of molecular cloud cores–that is, in the same way as stars. In 1976, Low and Lynden-Bell (3) calculated that the Jeans mass (the minimum mass for a cloud fragment to overcome pressure and collapse under gravity) could be as small as about 7 Jupiter masses, comparable to the masses of some planets detected around nearby Sun-like stars and below the threshold of 13 Jupiter masses for deuterium burning. This deuterium-burning limit is taken by some astronomers as the boundary between brown dwarfs and planets. Simulations suggest that fragmentation of a collapsing cloud might produce self-gravitating objects with initial masses as low as 1 Jupiter mass, provided that magnetic field tension effects are important in the cloud environment (4).

In another scenario proposed by Reipurth and Clarke (5), brown dwarfs are stellar embryos that are ejected from newborn multiple systems before they have accreted sufficient mass (about 75 Jupiter masses) to burn hydrogen. In this scenario, a stellar embryo competes with its siblings to accrete infalling matter; the one that grows slowest is the most likely to be ejected through dynamical interactions. In computer simulations, objects with very low mass are indeed often kicked out of nascent stellar systems (6). It has also been suggested that brown dwarfs form in gravitationally unstable regions of disks surrounding protostars or young binaries.

Studies of young brown dwarfs may help to distinguish among these different scenarios. For example, if the ejection hypothesis were true, one might expect disks around brown dwarfs to be pruned by close interactions within a multiple system (6). The disks may therefore be short-lived. It is also unlikely that many brown dwarfs would come in pairs, because such binaries are likely to be torn apart during ejection.

Several groups have recently searched for dusty disks around large numbers of young brown dwarfs in nearby star-forming regions and clusters (7-10). Such disks would absorb light from the central star or brown dwarf and re-emit at longer wavelengths, making objects with disks appear brighter in the infrared than those without. The results show that disks are rather common around brown dwarfs at an age of about 1 million years, as is the case for Sun-like stars. It has not yet been possible to measure the sizes of brown dwarf disks to determine whether they are truncated, but their lifetimes appear to be comparable to those of disks around stars.

Brown dwarfs also accrete material from surrounding disks in the same way as their stellar cousins. Using high-resolution optical spectrographs on the Keck and Magellan telescopes, astronomers have detected broad, asymmetric emission lines of hydrogen in the spectra of many very young brown dwarfs (11-13). These lines are the telltale sign of gas flowing from the inner edge of the disk onto the central object at velocities of 100 km/s or higher. The rate of mass accretion from the disk is lower in brown dwarfs than in solar-mass stars by a factor of 10 to 100. But in some cases, the material may continue to trickle in for up to 10 million years (14)–another piece of evidence for long-lived disks around these substellar objects.

A particularly intriguing case is the young brown dwarf LS-RCrA 1 in the R Corona Australis star-forming region. Its spectrum not only exhibits signs of ongoing accretion onto the brown dwarf, presumably from a disk, but also shows hints of mass outflow from it: It contains many forbidden emission lines (15, 16), which are usually associated with young stars in which a fraction of the inflowing material is ejected perpendicular to the disk. If confirmed through future observations, this finding would further strengthen the analogy between nascent brown dwarfs and their stellar counterparts.

The mounting evidence thus points to a similar infancy for Sun-like stars and brown dwarfs. Does this mean that the two kinds of objects are born in the same way? Many observers tend to think so (7-12), but it may be too early to rule out the ejection scenario for at least some brown dwarfs. Far-infrared observations with the Spitzer Space Telescope (launched in August 2003) and millimeter observations with ground-based radio telescopes may reveal the sizes and masses of brown dwarf disks, allowing us to determine whether most disks are truncated. Better statistics of the frequency of binary brown dwarfs could provide another observational test. Infrared studies of even younger "proto-brown dwarfs," which are still embedded in a dusty womb, may also provide clues to their origin.

**References**

. G. Basri, Mercury 32, 27 (2003).
. K. Lodders, Science 303, 323 (2004).
. C. Low, D. Lynden-Bell, Mon. Not. R. Astron. Soc. 176, 367 (1976).
. A. Boss, Astrophys. J. 551, L167 (2001).
. B. Reipurth, C. Clarke, Astron. J. 122, 432 (2001).
. M. R. Bate, I. A. Bonnell, V. Bromm, Mon. Not. R. Astron. Soc. 332, L65 (2002).
. A. A. Muench et al., Astrophys. J. 558, L51 (2001).
. A. Natta et al., Astron. Astrophys. 393, 597 (2002).
. R. Jayawardhana et al., Astron. J. 126, 1515 (2003).
. M. Liu et al., Astrophys. J. 585, 372 (2003).
. R. Jayawardhana, S. Mohanty, G. Basri, Astrophys. J. 578, L141 (2002).
. R. Jayawardhana, S. Mohanty, G. Basri, Astrophys. J. 592, 282 (2003).
. J. Muzerolle et al., Astrophys. J. 592, 266 (2003).
. S. Mohanty, R. Jayawardhana, D. Barrado y Navascués, Astron. Astrophys. 380, 264 (2001).
. M. Fernández, F. Comerón, Astron. Astrophys. 380, 264 (2001).
. D. Barrado y Navascués, S. Mohanty, R. Jayawardhana, Astrophys. J., in press.


abstract: Against the backdrop of rising anxiety and discussions on the impact of AI on society, I explore in this article the structural possibilities of AI and automation triggering a new social conflict between the current capitalist elites and the emerging "creative class" (R&D scientists, engineers, business developers, etc.), and how this conflict can produce social tensions and transform urban space. By drawing insights from a structurally similar conflict in 17-18th century Europe between the aristocracy and the emerging bourgeoisie, the impact of this conflict on the social, spatial, and power landscapes in cities of that time, as well as current trends in urban geography, this article outlines the prospects of urban transformations under changing production and consumption economies.
author: Gevorg Yeghikyan
bibliography: sample.bib
date: *Scuola Normale Superiore di Pisa*
  *ISTI-CNR*
  email@example.com
title: How will AI and automation transform society and cities?

***Keywords—*** urbanism, class conflict, capitalism, urban space

# The prospects for a new social conflict

In his classic work, the Production of Space, Henri Lefebvre argued that "new social relationships call for a new space, and vice versa." With all the anxiety and discussions on AI and automation gaining momentum, the future of production relations, power structures, and social relationships becomes increasingly uncertain. Hand in hand, as urban theory suggests, so does the future of cities. To reflect on the possible urban futures unleashed by the effects of AI and automation on the social organization of space, one should ask, following Lefebvre: is a new social conflict structurally possible? The answer to this question might contain the seeds for ideas about the future of work, social relations, forms of social organization, and, ultimately, cities.

## *Formal* vs. *real* subsumption

So how should we approach this question? One need not be familiar with Marxist thought to know that capitalist production functions by appropriating the surplus value created by (social) labour. However, what is interesting regarding the possibility of a new social conflict due to AI and automation, is how capitalism subsumes labor. In Capital, Marx distinguishes between *formal* and *real* subsumption of labour by capital . Under *formal* subsumption, capital exploits labour in socio-economic terms: the capitalist monopolises the means of production, forcing the worker to yield to the conditions of wage labour, be hired, and give away their added value. *Real* subsumption, on the other hand, occurs along with the technological evolution of capitalist production, under which the worker is dominated by the capitalist not only by being hired, but also through exploitation by the material movement of capital in the process of production. He is dominated by the system of machines and becomes a kind of a living appendix to them, forced to work according to the technological logic of the machinery he operates, or rather, is operated by. In other words, the worker is subsumed by capital not only in terms of production relations, but also in terms of the very production processes he works under. This, according to Marx, is what makes the domination of labour by capital in organisational and administrative terms, and hence, the efficient obtaining of maximum surplus value from the employment of labour, possible. This theoretical framework can be easily extended to post-industrial economies dominated by services by replacing the machinery logic with, for instance, the bureaucratic-administrative logic of typical office work.

What is it that changes in capitalist production with the advent of Industry 4.0 with Machine to Machine, Internet of Things, and AI systems? The worker as an appendix to the production process essentially disappears, and with it, disappears also the bundle of manager and supervisor positions telling the worker what to do and how, since there is no one left to command: algorithms and robots are now at work. Unlike the disappearing factory or white collar workers, the remaining employees, required to develop, innovate, and sustain production, such as R&D scientists, engineers, and business developers, are not working under *real* subsumption by capital. They are mainly concerned with intellectual and creative work in which they are operationally free. Although the external socio-economic conditions are still dictated by capital since these workers are employed by it (*formal* subsumption), they are not functionally dominated by capital in the creative process. Moreover, with the capitalist losing leverage over traditional workers due to automation replacing them, the creative workers gain further space for operational freedom. Thus, the widespread introduction of Industry 4.0 and AI systems completely or partially abolishes *real* subsumption in capitalist production.

Interestingly, this is precisely where space for a new social conflict opens up. While the conflict between the traditional industrial worker and the capitalist revolved around wages, working hours and conditions, the creative worker is typically well-paid, enjoys retirement benefits, vacations, and is often even lured by employee stock options, offering company shares to its employees. Therefore, the conflict is to be found elsewhere.

# Social climbing in the 17th century and today

To understand the possibilities of the creative class entering into conflict with existing capitalist structures, it is worthwhile to recall a structurally similar socio-economic conflict in history: that between the bourgeoisie and feudal aristocracy in 17th century Western Europe. Comedies of that epoch show what the emerging bourgeois was striving for: to make his way to the ruling classes through social climbing. His ascent from bourgeois to noble might involve marrying a noble woman or buying a noble title. For example, Moliere's classic play, titled Le bourgeois gentilhomme, an evident oxymoron, mocks such attempts of social climbing by the pretentious bourgeois and ingeniously shows the emerging class conflict .

Likewise, being only *formally* subsumed by capital and having considerable operational freedom, resources, and time at their disposal, **many creative workers today dream about converting their creative abilities into capital and applying them with profit - think of the startup ecosystems, - thus liberating themselves from the exploitation of capital and becoming capitalist entrepreneurs themselves**. As we can see, this is structurally analogous to the 17-18th century bourgeoisie striving to liberate themselves from the domination of the monarchic system offering privileges to the aristocracy, by attempting social climbing to become aristocrats themselves. This state of affairs continued for almost two centuries, until the conflict between the ever-stronger bourgeoisie and the ever-weaker aristocracy first manifested itself in the former articulating their differences from the latter, and then burst into the violent bourgeois revolution.

## Limits to the growth of the creative class

Coming back to our days, capital still succeeds in keeping the ever-growing creative class in check by offering privileged working conditions and employee stock options to a still narrow group of creative workers, but it will not be able to do so indefinitely. Take the example of the so-called Scandinavian Nordic model. The Nordic model, more than any other capitalist model, took the path of collective bargaining: a strong compromise between capital and labour, with an unparalleled level of social guarantees, education and healthcare in the developed part of the world. For example, unlike the United States where one in ten people live officially below the poverty line, poverty in the Scandinavian countries is virtually nonexistent . Similarly, a situation where a person is denied medical care because they cannot afford it is essentially impossible in those countries . Nevertheless, the Nordic model has its limits and reached them already in the 1980s when the portion of GDP redistributed through government spending, i.e., through a non-market mechanism, reached 65% . This meant that capital was forced to concede the lion's share of the surplus value it appropriated from labour and allow it to be redistributed among workers. The Nordic model was unable to go further with its redistributive policies, since doing so would mean to encroach the very heart of capitalist production denying it its main motivation: the appropriation of surplus value. Similarly, given the current growth of the creative class, capital will not be able to attract and sustain *all* creative workers, and, given the discussed aspirations of the latter, the conflict will thus be only exacerbated.

Now, whether the discussed conflict between the growing creative class and the current bourgeoisie will culminate in a revolution or will find another resolution is not only difficult to predict, but is secondary and irrelevant here. Of interest is how it can affect the social, political, and economic organization of urban space.

# Urban transformations in 19th century France

To understand the prospects of these pending socio-economic transformations shaping the urban landscape, let's have a recourse to the French Revolution, and its short and long term aftermath. Before and immediately after the revolution, in the late 18th century, the aristocracy, bourgeoisie, artisans, and workers had different levels of urban mobility and use of urban space. Municipal power, exercised by the monarchy and the aristocracy tightly connected with it, built elaborate public spaces for displaying power as a performative ritual : processions of carriages pompously moved every day along stylised boulevards connecting the various "hôtel particulier" to municipal or religious buildings situated in focal squares. Place des Vosges and Place de la Concorde in Paris are prime examples of such urban spaces. Thus, **public space didn't exist in the modern sense and merely served as a stage for celebrating monarchic power**. While lower class workers and artisans exercised minimal mobility staying within the confines of their neighbourhoods and travelling almost exclusively by foot, the emerging bourgeoisie was increasingly mobile, agile, and sought to establish its class identity. Class membership was first articulated through literacy, and a new consumer culture such as the emergence of restaurants as a cheaper way to simulate a private cook that only nobles could enjoy .

And yet, segregation in cities was mainly vertical rather than horizontal, meaning that the poor lived on the higher floors of buildings inhabited by the upper classes . One could often meet middle class members, artisanal masters, and lower class workers in the same neighbourhood. This was due to the initial alliance of reformist middle classes with the relatively well-doing artisanal classes.

This began to change with the July revolution of 1830, when space started to play a central role in the creation of middle-class identity following similar processes in London and Vienna. The noble landowners had overestimated the falling demand for noble mansion housing, incurring severe losses on investment, and eventually had to sell the land to private investors. The increasing migration to cities and the ensuing severe housing crisis, coupled with the socio-economic transformations with a growing bourgeoisie and its quest for a new identity, compelled private developers to create and sell an image of a culturally homogeneous, technologically modern, and consumer-quality neighbourhoods in order to make money on new housing. Private capital thus subdivided previously aristocratic lands into smaller lots and made possible urban redevelopment in specific areas of the city, meeting the newly formed bourgeois consumer demand. These new quarters instigated the self-reinforcing horizontal stratification of the city, with rising property values attracting financial and banking elites and the upper middle class, which further nourished consumer culture, already manifest in the design of new housing blocks.

To distinguish themselves both from the aristocracy and the lower classes, new kinds of public and private spaces were emerging. This included the appearance of boudoirs and, most notably, balconies, which, as argued by Francois Loyer, were aimed at displaying public wealth by "showing the world outside the location and size of an apartment's salon" . The streets in these new quarters were wider, straighter, and more luminous, containing more parks and public spaces. The socio-economic conditions thus shaped a different kind of urban space, which made it possible to experience older areas of the city as well. As Victoria Thompson argued, the experience of wider streets made older streets seem even narrower, and this came to be associated with the poor, dark neighbourhoods .

This only strengthened segregation in the city, and, given the low urban mobility of the lower classes and the poor living conditions in such centrally located older parts of the city as Cité in Paris, planted the seeds for social tensions between the poor and the bourgeoisie for the first time. For example, as recounted by Eugene Roche, it was common belief among the poor in these quarters that the 1832 cholera was a plot of the rich (sounds familiar?), leading to disregard for social distancing and hygiene rules, and propelling insurrection, resulting in a mortality rate in the poor quarters twice as high as the city average .

Bourgeois urban redevelopment, the emergence of what we now call urban master planning, the Hausmann reconstruction, and rising rents eventually, towards the end of the 19th century, pushed the poor away from the city center to the city outskirts. Here, the poor working class lived in badly built, unsanitary housing and environment, from where the poor did not intrude the rich bourgeois quarters anymore. This concluded the horizontal segregation process that had begun almost a century earlier.

# Customizing or segregating urban space

This rather lengthy historical excursion served to delineate the framework for a conceptually similar possible transformation of urban space following the emergence of the creative class and its conflict with the current bourgeois elites. The economic geography for one such transformation model has been described by the urbanist Dror Poleg in a recent article . Poleg starts by recounting the following idea of Chris Anderson: historically, the entertainment industry was built around producing and promoting "hits" because of economic and physical restrictions. The production, shipping, storing, and displaying CDs or books were expensive, there were not many cinemas, and there were only 24 hours in a day. This meant that producing a wide range of albums, books, or movies was not economically viable and hence the industry was dependent on hits following the Pareto rule: 20% of products made 80% of the sales .

The internet changed this by making the production, distribution and storage of, and access to content cheaper. Now, most of the sales are no longer coming from a few hits, but from what Anderson calls the "long tail" of a multitude of highly customized products, of interest to a very narrow audience, as shown in Figure .

The sheer quantity of such "narrow" products creates near-unlimited choice and constitutes the bulk of most consumer demand. Poleg calls this phenomenon the economics of abundance and goes on to link this idea to urban geography. **While economic scarcity historically produced spatially concentrated population and economic activity distributions in cities, the emergence of remote working options is causing population and economic activity to be distributed across a long tail of many city locations instead of a few spatially concentrated centers as before**. He then notes that under economics of scarcity, the spatially concentrated urban locations were designed to appeal to the largest number of people since they share the same urban infrastructure, centrally located job market, and public spaces. However, under economics of abundance, people won't have to share the same space anymore. **City locations could become as customized as the songs people choose to listen to, making cities even more segregated**.

# So what is at stake?

In the developed world, given the growing ambitions and aspirations of creative workers, gradual and unequal automation can trigger new forms of social organisation of space following the logic discussed in our historical excursion as well as in the shift of urban activity to the "long tail". In fact, the impact of the growing political relevance of the creative class on real estate is already palpable in such business models as that of WeWork. As described in a piece in the Atlantic :

"*The bespoke spaces are appealing to big organizations because they allow for a nimble office experience in which employees aren't necessarily bound to their desks but are free to roam and connect with other businesses and entrepreneurs, creating a looser, more innovative environment in which ideas can sprout.*"

Going further, **urban segregation on the "long tail", for example, can take the form of a digital divide, but in reverse**. With automation bringing low skilled labour wages below the level of subsistence, the unemployed will become structurally unemployable, and universal basic income (UBI) will most likely become an imperative policy to sustain this segment of population, making it a class of its own. This **UBI** class will be offered basic services in their neighbourhoods and cheap access to digital services, but will be denied a range of new kinds of physical services like novel infrastructures serving specific technologies in transport, logistical, and recreational activities, as well as quality healthcare and education in customized quarters of the creative classes. **This might create a feedback loop of further investment in those areas, creating new extraterritorial conditions, pushing the UBI class away, thus concluding the urban segregation process, just like the ascending bourgeois pushed low wage workers away to the city outskirts 150 years ago**.

Moreover, a certain physical-digital consumer culture of minor luxuries will have to be facilitated to keep the UBI class entertained within the range of their basic income, further encouraging this class to customize their neighbourhoods according to that culture. The closest analogy is perhaps the story of the French general Gallieni who conquered Madagascar, imposed a head tax in the newly issued local currency in 1901, effectively printing money and demanding that everyone give some of that money back to him. Described in detail in David Graeber's seminal work, this forced the creation of certain markets and population debt, but was also aimed at nurturing a consumer culture of cheap luxuries like lipstick or parasol, and making sure locals have some of their money left to spend on these products . It was crucial that they develop new tastes, habits, and desires; that consumer demand previously alien to them became ingrained in local culture to keep Madagascar forever tied to France even after the conquerors had left. Despite the speculative nature of these reflections, they highlight the possibility for social and urban transformations articulated through extraterritorial conditions and segregation in our cities, as a result of the emerging structural conflict between the creative class and the current capitalist bourgeoisie.

## Hot dog urbanism

One key aspect of our discussion about automation and AI missing so far is that automation is not taking place uniformly across all levels of production. This consideration is based on Paul Krugman's hot dog economy toy model . In this model, the economy produces just hot dogs, consisting of two goods, sausages and bread rolls. Let's assume that advances in technology allow the bakeries to be automated, boosting productivity and dropping the cost per bread roll produced. This cost reduction causes a rise in demand for hot-dogs, other things being equal. But since automation took place only in bakeries, while sausages continue to be produced manually, this means that demand for manual labour in the sausage industry will have to rise to meet the growing hot-dog demand.

So far, the solution has been to tap into cheap labour in the third world. For example, a technological innovation in Silicon Valley increases productivity in the upper levels of production but simultaneously raises demand for additional manual labour in the lower levels of production. Consider that despite automation and AI, the global workforce has actually doubled in the past decades reaching 3.5 billion people - faster than population growth . Incidentally, this might also be the reason why despite the technology being available for quite some time now, corporations have not been in a hurry to shift to automated production, preferring cheap manual labour somewhere in Southeast Asia instead. However, unless automation takes place uniformly across different levels of production chains, which it won't, we might actually face a workforce shortage, given the limited rural population and the current rates of urbanization. This means that the above mentioned changes in social structures and urban life will have an unequal distribution on the global scale with inevitable geopolitical consequences, which is, however, out of the scope of this article.

# Conclusion

In an attempt to sketch the baseline for how AI and automation could affect social and urban structures, we looked at concepts from Marx's political economy, saw what kind of social conflict could emerge with the advent of automation, and looked at 17-19th century France to discover how the mounting socio-economic conflict between the aristocracy and bourgeoisie shaped the urban landscape of Paris and resulted in segregation in the city. We discussed Dror Poleg's idea of living on the tail by noting how it structurally fits the predictions of our model of the social conflict between the creative class and current capitalist elites. We also speculated about the formation of a structurally unemployable class sustained by universal basic income, the **UBI class**, and reflected on possible urban transformations as an indispensable part of this dynamic.

City authorities have traditionally been *reactive*, but with the advent of the Information age and the disruptive power of AI and automation, policy makers will be compelled to take a *proactive* approach to addressing the challenges to the social and cultural fabric raised by the impact of new technologies on urban space.

This discussed scenario is, no doubt, highly speculative, and the exact form it could take is impossible to predict, but the aim was to draw attention to the new structural conflict emerging in the current post-industrial capitalist regime and to trigger further discussions on how it might transform society and urban space.


author: T.J. Maccarone; P.G. Jonker; A.I. Sills
title: Lithium enhancement in X-ray binaries due to stellar rotation

# Introduction

Light element abundances (deuterium, helium and lithium) are a key tracer of the physical conditions in the early universe, as these are the only elements produced in the Big Bang. They provide a key constraint on the baryon-to-photon ratio at the time of the universe's formation. As a result, considerable effort has been invested in determining the rate at which lithium is destroyed, and in identifying the stars which have the highest lithium abundances. A key factor for understanding how to convert the observed lithium abundances observed in stars today into primordial values is to understand mechanisms for lithium production, rather than just lithium destruction. It has been noted in several cases that the lithium abundances in X-ray binary donor stars are substantially larger than the solar value (Martin et al. 1994; Martin et al. 1996 and references within); this effect is seen in all X-ray binary secondary stars where there are good constraints on the lithium abundances. Since compact objects are natural sites for the acceleration of relativistic particles or flows, several mechanisms related directly to the compact object nature of the systems have been suggested – spallation in the inner accretion flow (Martin et al. 1995; Yi & Narayan 1997), spallation due to the impact on the stellar atmosphere of high energy neutrons produced in the inner accretion flow (Guessom & Kazanas 1999), or interactions between a relativistic jet and the mass donor (Butt, Maccarone & Prantzos 2003), or alternatively, lithium production due to some unspecified process in stellar coronae (Bildsten & Rutledge 2000). With the exception of the last two mechanisms, the transport of the lithium back into the stellar atmosphere is a non-trivial problem. In this paper, we will review the evidence that X-ray binaries' donor stars have higher than normal lithium abundances. We will then demonstrate the similarities with other tidally locked binary stars, and will discuss the possibility that this lithium enhancement may be a natural consequence of the slower lithium depletion in tidally locked binary stars, rather than a consequence of any physics related to the compact objects. We will explain, in the context of this picture, why this enhancement is not seen so strongly in cataclysmic variable stars (CVs).

# Summary of past X-ray binary observations and normal star observations

There are, at the present time, five secondary stars in X-ray binaries with measured lithium abundances. The measured abundances, expressed as, $A({\rm Li}) = {\rm log} N({\rm Li})/N(\rm H) + 12.0$, range from 2.2 to 3.3, where the solar value is approximately 1.0, so these stars are above the solar value by a factor of about 20-200. The actual enhancement relative to what is expected based on normal single star evolution depends heavily on the unknown stellar age and on the stellar mass (see e.g. the $\approx$`<!-- -->`{=html}2 dex difference between the cool stars in the 80 Myr old Pleiades and in the 700 Myr old Hyades compiled by Ryan & Deliyannis 1995) The lithium abundance values of X-ray binary donors are all presented in Martin et al. (1996), with the exception of that for Cen X-4, which has $A({\rm
Li})$=3.3, and is reported separately (Martin et al. 1994). Martin et al. (1996) also note that the ionizing radiation from the X-ray source might lead to an underestimate of the lithium abundance.

The meteoritic lithium abundance in the solar system has a value of 3.31$\pm$`<!-- -->`{=html}0.04 (Anders & Gravesse 1989). This is generally accepted to be the typical initial lithium abundance of Population I stars (e.g. Ryan & Deliyannis 1995). Hence, even the most lithium-rich of the X-ray binaries, Cen X-4, which has a lithium abundance equal to this value, does not require any lithium enhancement of the secondary star, so long as there has not been substantial lithium depletion in this star over its lifetime, and so long as the underestimate due to the lack of accounting for ionization effects is not too severe.

A wealth of literature, both observational and theoretical, is devoted to the effects of rotationally-induced mixing on lithium depletion in stellar atmospheres. It has been suggested that rotating stars should deplete their initial atmospheric lithium abundances more slowly than do non-rotating stars, and that this slower depletion of lithium should be an especially strong effect in tidally locked binaries where internal shears (which mix the lithium into the inner regions of the star where it is destroyed) will be prevented from developing due to the very slow angular momentum losses of the stars (Pinsonneault et al. 1990). Furthermore, it has been found in open clusters that the short-period (i.e. with periods less than 6 days) tidally locked binary systems have substantially higher lithium abundances than single stars of the same type, or stars of the same type in wide binaries; the most lithium-rich stars in open clusters are these short-period tidally locked binaries, and they often show lithium abundances rather close to the meteoritic value (see e.g. Soderblom et al. 1990; Ryan & Deliyannis 1995). These results stand in contrast to the claim of Martin et al. (1994) that, while tidal locking of the LMXBs might play some role in their enhanced lithium abundances, it was likely to be a rather minor effect.

At the present time, only a small number of open cluster tidally-locked binaries have measured lithium abundances (9 appear in the paper of Ryan & Deliyannis (1995), and there has not been any systematic study made since then). Seven of the nine systems have $A({\rm Li})>1.8$ and four have $A({\rm Li})$ of at least 3.0, indicating that the distributions of the X-ray binary systems and the open cluster systems are in relatively good agreement. However, the open cluster systems typically have hotter stars, so it is a better comparison to look at their overabundances relative to the mean trend with temperature for the clusters in which they are found; most of these systems are at least 0.6 dex higher in lithium than the trend curve in lithium versus effective temperature of the open clusters of which they are members. The two Pleiades systems show no measureable lithium enhancement, but this is a fact which is in agreement with theoretical models of rotationally induced lithium depletion given the youth of the Pleides cluster.

The data is not as conclusive for subgiant stars. For two subgiants in the Hyades, lithium is detected at temperatures where there are only upper limits for stars which are not short period tidally locked binaries and where the trend line extrapolates to be about 100 times lower than the detections. On the other hand, the lithium abundances are lower than $A({\rm Li})=1.8$ in these two stars. Clearly, more observations of tidally-locked subgiants are needed to determine whether tidal locking can account for a substantial fraction of the lithium excess in X-ray binaries with subgiant donors.

A typical factor of $\sim$`<!-- -->`{=html}5 enhancement in lithium abundance is thus found for the tidally locked binaries in open clusters. Furthermore, it should be noted also that the effects of tidal locking for the donor stars in X-ray binaries should extend much deeper into the stellar interior than for those systems compiled by Ryan & Deliyannis (1995). The main sequence systems studied by Ryan & Deliyannis (1995) all have orbital periods greater than 3 days, while all of the X-ray binaries except V404 Cyg in the sample have periods less than 1 day and most have periods less than 10 hours. Pinsonneault et al. (1989) studied the lithium depletion as a function of the timescale for angular momentum transport between the surface and the stellar interior; they found it to have "a strong influence" on lithium depletion, capable of accounting for 2 dex of variation over the range they studied. The model they ran for a solar-type star with weak angular momentum transport retained A(Li) greater than 2.5 for about 300 Myrs, and greater than 2.0 for approximately 5 Gyrs. The donors in X-ray binaries should have essentially no angular momentum transport within the star; it therefore seems quite reasonable that they could have more lithium enhancement than in the case of the wider binaries.

# Discussion

## Past interpretations

One of the strongest arguments made in the past for the position that the enhancement of lithium in X-ray binary donor stars must be related to the compact object, rather than to the stellar rotation, is the point that the stellar companions in cataclysmic variables show no evidence for lithium enhancement (Martin et al. 1995; Yi & Narayan 1997). This argument is flawed, though, if one assumes, as is predicted by stellar theory and borne out by stellar observations, that lithium is constantly being destroyed at a rather slow rate in short-period tidally locked binary systems, while it is being destroyed at a much faster rate in stars with low rotation rates. The black hole and neutron star binaries are the end products of evolution of very massive stars with very short lifetimes. The progenitors of the white dwarfs found in cataclysmic variable systems, on the other hand, have considerably longer lifetimes. Since the orbital periods of these systems shrink rather late in their evolution, it is likely for most CVs that while the white dwarf progenitor was on the main sequence, the binary was not tidally locked, so the lithium depletion was proceeding in more or less the normal fashion for isolated or wide binary stars. In fact, it is then likely that some of the cataclysmic variable's donor stars will show mildly enhanced lithium overabundances, but since a rather large amount of lithium depletion probably occurs in the first 100 Myrs of stellar evolution (see e.g. Pinsonneault et al. 1990), CVs' secondaries should be substantially more lithium depleted than neutron star or black hole binaries.

On the other hand, Bildsten & Rutledge (2000) drew attention to the similarity between X-ray binaries' donor stars and the members of RsCvn systems. The stars in RsCvn systems are likely to be tidally locked short period binaries from rather early on in their evolution. Bildsten & Rutledge (2000) had been arguing that the X-ray emission from quiescent low mass X-ray binaries was primarily from the stellar coronae of the mass donors, rather than from a low luminosity accretion flow. In that context, they argued that since both quiescent LMXBs and RsCvn stars had enhanced lithium abundances and X-ray emission(as does at least one white dwarf binary system), that perhaps both were caused by the coronal activity. On top of the arguments of Bildsten & Rutledge (2000) that the lithium enhancement is unlikely to be caused by processes related directly to accretion onto compact objects, we note that the secondary with the highest lithium abundance, by far, is that in Cen X-4, the only neutron star X-ray binary whose secondary's lithium abundance has been measured. Many of the mechanisms for enhancing lithium abundance in X-ray binaries' secondary stars are related to phenomena which are considerably stronger in black hole systems than in neutron star systems – relativistic jets (the mechanism of Butt et al. 2003) from black holes are considerably more powerful than those from neutron stars (see e.g. Migliari et al. 2003), and the radiatively inefficient accretion flows (the mechanism of Yi & Narayan 1997) seen from black hole transients are generally hotter than those seen from neutron star transients.

## Interpretation in terms of stellar rotation effects

In fact, though, it is not necessary to *produce* lithium in X-ray binaries. We note that a large part of the reason why it is thought that the donor stars in X-ray binaries are enhanced in lithium is that they are far more lithium abundant than is the Sun. For most elements, substantial deviations from solar abundances are indicative of some unusual evolutionary history. However, the solar lithium abundance at birth was $A({\rm Li})$=3.3, and over the 5 Gigayear lifetime of the Sun, this value has fallen by a factor of about 200. Therefore, if lithium depletion is halted in the very high rotation rate donor stars like the secondaries in X-ray binaries, then it would not be surprising to see these systems with lithium abundances closer to the standard value at formation for Population I stars, rather than at the solar or sub-solar values typically seen in evolved Population I stars. An exact quantification of this effect is well beyond the scope of this paper; calculations of lithium depletion in tidally locked binaries have not yet been done. The angular momenta of the secondary stars in most X-ray binaries are an order of magnitude higher than the fastest rotators studied by Pinsonneault et al. (1990), and furthermore, the lithium depletion is further stemmed due to the very slow angular momentum loss in these systems. Zahn (1994) attempted to estimate the lithium depletion as a function of angular momentum for tidally locked binaries, but extrapolating from the relation presented in that paper gives a lithium abundance well in excess of the meteoritic value. It thus seems most likely that the secondary stars in X-ray binaries undergo some weak lithium depletion early in their lifetimes, before the supernova explosion creating the compact object, and then undergo little or no further lithium depletion, but considerable further theoretical work should be done to test this hypothesis.

A possible problem with this mechanism for lithium enhancement is the mass loss from the stellar envelope during the system's accreting phase. We note, though, that the stars for which the Li 6708 Angstrom line can be observed are the cooler stars among the X-ray binary counterparts. As a result, these fall into two categories - subgiants with relatively long periods whose lithium abundance evolution is poorly understood both theoretically and observationally (a category including only V404 Cyg, whose orbital period is 6.5 days), and main sequence stars with quite short periods – all the other lithium rich secondaries are in systems with orbital periods shorter than 1 day (with most of them being shorter than 10 hours). It has been shown on both theoretical and observational grounds (Brocksopp et al. 2004; Meyer-Hofmeister 2004; Portegies Zwart, Dewi & Maccarone 2004) that the shortest period X-ray binaries have the lowest outburst amplitudes and the lowest mean mass accretion rates among X-ray binaries. The theoretical calculations of the expected mass accretion rates from systems in this orbital period range are of order $3\times10^{-10}$ $M_\odot$ yr$^{-1}$ (King, Kolb & Burderi 1996), so at least 1 Gyr would be required before these systems underwent substantial lithium depletion due to stripping of the outer layers of the stars. Furthermore, while starting from orbital periods shorter than those of the open cluster systems which have been studied, LMXBs will typically require several Gigayears of evolution as tight, tidally locked binaries before actually coming into Roche lobe contact and starting accretion (e.g. Kalogera & Webbink 1998), further prolonging their lifetimes as lithium rich objects. Many short period X-ray binaries should thus have pre-accretion lifetimes of at least a substantial fraction of a Hubble time, allowing most of them to remain as lithium rich objects today.

### Observational tests

We can make one rather strong prediction based on the suggestion that LMXB secondary stars have enhanced lithium because of reduced depletion, and rather than because of actual lithium production. The mass donors in globular cluster X-ray binaries should, as a class, show less lithium enhancement when compared with other stars of similar spectral types in the same clusters than the mass donors in non-cluster X-ray binaries. The reason for this is that the X-ray binaries in globular clusters are formed through dynamical captures (Clark 1975) – either tidal interactions (Fabian, Rees & Pringle 1975) or three-body (or perhaps four-body) exchange interactions (Hills 1976). As a result, many of these stars will have undergone normal stellar evolution for most of their lifetimes before they became part of a close binary. It should be noted that there is one millisecond pulsar in the globular cluster NGC 6397 whose binary companion shows a lithium enhancement (Sabbi et al. 2003), but it does not seem likely that good measurements of the lithium abundances of a large sample of globular cluster X-ray binary secondary stars will be made with current instrumentation; this task requires both a large aperture (i.e. greater than that of the HST) and very good angular resolution (i.e. better than that available from the ground without adaptive optics). Plans exist for allowing adaptive optics measurements in the red part of the optical spectrum in the near future, so there is some hope for executing this test of rotational lithium enhancement in X-ray binary secondaries in the near future.

Similarly, the stars in low mass X-ray binaries with rotation powered pulsars (i.e. high magnetic field neutron stars) as their compact objects should also be a good test bed for theories of lithium production; that these systems contain slowly spinning, high magnetic field neutron stars is probably indicative of a much shorter history as an accretor; furthermore, these systems are the one class of X-ray binaries that have never been seen to show relativistic jets (Fender 2005), and the highest energies in their X-ray spectra are much lower than those seen in the low/hard states of low magnetic field neutron stars or black holes.

If it can be proven that the lithium abundances in X-ray binaries' stellar counterparts are the result of preservation of lithium due to stellar rotation early in the stars' lifetimes, rather than some means of strong lithium production, this would provide us with a natural means for determining which neutron stars in binaries were formed in supernovae, and which were formed in accretion induced collapses. It has been suggested in some cases that accretion onto a white dwarf, in certain mass accretion rate regimes, can lead to the accumulation of enough mass to allow the white dwarf to exceed the Chandrasekhar limit, and to become a neutron star (e.g. Bailyn & Grindlay 1990; van den Heuvel & Bitzaraki 1995). Since these systems will have undergone a temporary phase as an accreting white dwarf, and hence they will have had mass donors which were not rapid rotators until relatively late in their lifetimes, they should have lithium abundances in their secondary stars which are similar to those of the cataclysmic variables (i.e. not significantly enhanced relative to field stars), rather than to those of the other low mass X-ray binaries. At the present time, it is rather difficult to test this hypothesis; the systems suggested to have evolved into neutron stars through accretion induced collapse are either globular cluster systems (Bailyn & Grindlay 1990) or they are systems in which the donor stars themselves are white dwarfs (van den Heuvel & Bitzaraki 1995). In the former case, the neutron star may have changed partners over its evolution, while in the latter cases, the expected lithium abundance is not clear. Furthermore, at the present time, the measurements of lithium abundances in the neutron star LMXBs' secondaries are quite poor; there exists only the detection of lithium in Cen X-4 and an upper limit in Aql X-1 which is not sufficiently low as to be constraining (Garcia et al. 1999).

Another apparently natural test would seem to be a measurement of the $^6{\rm Li}/^7{\rm Li}$ ratio, but the lines are very close together, and the $^6{\rm Li}$ abundance measurements are typically considerably lower than the $^7{\rm Li}$ abundances. To make useful measurements would require a very long integration on a very large telescope, but would also require that the system to be observed is nearly face-on, so that the orbital and rotational broadening of the lines is minimized. A more feasible test would be to measure the Be abundances. If the lithium overabundances in X-ray binary secondaries are due to tidal locking preserving lithium, rather than lithium production, then one would expect the Be abundances to track the lithium abundances in the same way as they do in other tidally locked binaries. Because the strongest Be lines are at 3130 Angstroms, this would require the source to be nearly directly overhead in order to minimize the atmospheric absorption. Fortunately, this is possible with large planned or existing flexibly scheduled telescopes for two of the systems with strong lithium enhancements – V404 Cyg, which is sometimes nearly directly overhead from the Hobby-Eberly Telescope, and Cen X-4, which is sometimes nearly directly overhead from the site of the SALT telescope. Boron abundance measurements would be similarly useful, but can be made only from space.

# Conclusions

It is shown here that the tidal locking of the mass donors in X-ray binaries should result in an enhancement in lithium abundance of a factor of about 5 when compared with what would be expected from single stars of the same age and mass. Tidal locking is therefore likely to be an important factor in producing the lithium overabundances seen in X-ray binaries' counterparts. It could be the sole factor in the event that the effects of tidal locking are more important in the tighter X-ray binaries than they are in the tidally locked binaries which have been observed in open clusters, or if the X-ray binaries are typically younger than a few Gyrs.