author: K.-P. Schröder; M. Mittag; M. I. Pérez Martínez; M. Cuntz; J. H. M. M. Schmitt
date: Received …; accepted …
title: Basal chromospheric flux and Maunder Minimum-type stars:
  The quiet-Sun chromosphere as a universal phenomenon

We demonstrate the universal character of the quiet-Sun chromosphere among inactive stars (solar-type and giants). By assessing the main physical processes, we shed new light on some common observational phenomena. We discuss measurements of the solar Mt. Wilson S-index, obtained by the Hamburg Robotic Telescope around the extreme minimum year 2009, and compare the established chromospheric basal Ca II K line flux to the Mt. Wilson S-index data of inactive ("flat activity") stars, including giants. During the unusually deep and extended activity minimum of 2009, the Sun reached S-index values considerably lower than in any of its previously observed minima. In several brief periods, the Sun coincided exactly with the S-indices of inactive ("flat", presumed Maunder Minimum-type) solar analogues of the Mt. Wilson sample; at the same time, the solar visible surface was also free of any plages or remaining weak activity regions. The corresponding minimum Ca II K flux of the quiet Sun and of the presumed Maunder Minimum-type stars in the Mt. Wilson sample are found to be identical to the corresponding Ca II K chromospheric basal flux limit. We conclude that the quiet-Sun chromosphere is a universal phenomenon among inactive stars. Its mixed-polarity magnetic field, generated by a local, "fast" turbulent dynamo finally provides a natural explanation for the minimal soft X-ray emission observed for inactive stars. Given such a local dynamo also works for giant chromospheres, albeit on larger length scales, i.e., $l \propto R/g$, with $R$ and $g$ as stellar radius and surface gravity, respectively, the existence of giant spicular phenomena and the guidance of mechanical energy toward the acceleration zone of cool stellar winds along flux-tubes have now become traceable.

# Introduction

The chromospheric and coronal heating problem is one of the unsolved questions in the realm of solar and stellar physics. The underlying dominant physical processes have not been identified in detail, and we are far from having fully understood the quite diverse observational evidence pertaining to the observed plethora of chromospheric and coronal emissions of cool stars. The recent lull of solar activity has raised the question to what extent we can regard the quiet-Sun and its chromosphere as representative for other inactive or low-activity stars, particularly the so-called Maunder Minimum ("flat activity") Mt. Wilson stars (Baliunas et al. 1995), or the many inactive giants with emission line fluxes close to the basal chromospheric flux limit as discussed by, e.g., Pérez Martínez et al. (2011). Can we even obtain insight into the guiding mechanisms of extended chromospheres and cool winds of giants by analyzing the quiet Sun?

An important milestone in our understanding of stellar chromospheres was set by Schrijver (1987) and Schrijver et al. (1989, 1992), who identified a so-called basal component in the chromospheric line emission, notably in the Ca II H+K and Mg II *h*+*k* lines, which is relatively small compared to and independent of the large observed variations of the chromospheric emission commonly attributed to stellar magnetic activity. This concept of a basal flux was subsequently confirmed by several authors, including Strassmeier et al. (1994) and Pasquini et al. (2000). A plausible physical explanation was also readily offered through the dissipation of non-magnetic energy, proposed to exist in the form of acoustic waves. Hydrodynamic models of these waves, including their propagation, shock formation and dissipation, indeed showed the same dependence of the emitted flux on the stellar effective temperature $T_{\rm eff}$ as observed for the basal chromospheric flux, which is $T_{\rm eff}^8$ (e.g., Buchholz et al. 1998). Additionally, in a quantitative study of a distinct Maunder Minimum-type star in the Mt. Wilson sample, i.e., $\tau$ Ceti, Rammacher & Cuntz (2003) were able to reproduce the basal chromospheric flux in terms of acoustic wave energy dissipation with high accuracy.

Nevertheless, this simple picture was seriously challenged when also a minimum flux in the soft X-ray emission was detected, even for stars suspected to be Maunder Minimum ("flat activity") candidates of the Mt. Wilson sample (Schmitt 1997; Saar 1998; Judge et al. 2004). According to detailed theoretical reasoning (e.g., Stȩpień & Ulmschneider 1989; Hammer & Ulmschneider 1991), acoustic waves cannot account for the observed X-ray emission, and therefore the exact physical process(es) leading to the basal chromospheric flux still remain a topic of intense debate (e.g., Judge & Cuntz 1993; Judge & Carpenter 1998).

For evolved stars the prevalence of acoustic rather than magnetic heating appears to be consistent with basic ideas on stellar angular momentum evolution: when solar-type stars evolve away from the main-sequence, their rotation slows down beyond what should be expected from the increase in the moment of inertia caused by changes in the internal mass distribution (i.e., Gray 1991; Schrijver 1993; Schrijver & Pols 1993; Keppens et al. 1995; Charbonneau et al. 1997). Hence, the stellar angular momentum subsides due to magnetic braking resulting from the onset of massive stellar winds and therefore little magnetic activity is expected to persist in evolved stars.

Based on long-term time series observations of chromospheric Ca II K emission, i.e., the Mt. Wilson project (Baliunas et al. 1995), stars identified to exhibit very low S-index levels, i.e., without regular, cyclic changes, thus considered as "flat", appear to be in a state comparable to the solar Maunder Minimum. During the period of more than 30 years covered by the Mt. Wilson project, which also included several solar activity minima, the Sun kept a distinct positive distance from these low S-levels; yet is by wide standards not considered a highly active star. Therefore, it remained unclear, how inactive a Maunder Minimum Sun really is. From historic observations we are aware of a prevailing, though not always complete, absence of sunspots, but this may not be representative for Ca II plages.

A rough comparison shows that at activity minimum the solar chromosphere is relatively close to its basal flux. This is, however, difficult to verify for other Maunder Minimum stars, since any quantitative interpretation of the Mt. Wilson S-indices depends on the exact knowledge of the flux in two UV continuum windows used to normalize the chromospheric line emission fluxes. Hence, there may be long-suspected similarities between Maunder Minimum Mt. Wilson stars, the basal chromospheric flux and the quiet solar chromosphere (see Judge & Saar 2007 for measurements in the UV and X-ray regimes), but the final proof has still been missing. In addition, the rich presence of mixed-polarity magnetic field in the quiet Sun has always called into question whether its characteristic physics would be a good proxy for truly inactive stars, especially giant stars.

In this paper, we will present the final clue regarding the universality of the quiet-Sun chromosphere as the underlying phenomenon to both Maunder Minimum-type stars and basal chromospheric flux stars. We then will give a quantitative interpretation of the Mt. Wilson S-index data in terms of projecting the basal chromospheric Ca II K flux into the S$-(B-V)$ diagram. Finally, we will discuss the aforementioned apparent contradictions in the light of current knowledge about the physical processes in the quiet-Sun chromosphere.

# The solar S-index at Maunder Minimum level

For both historic and instrumental reasons, the Mt. Wilson S-index is defined as the flux ratio between the central 1 Å wide, mostly chromospheric Ca II H and K line emissions, $F_{\rm H}$ and $F_{\rm K}$, and two nearby reference bands of 20 Å of UV quasi-continuum flux, $F_{\rm R}$ and $F_{\rm V}$ at 3901 Å and 4001 Å, i.e., S = $\alpha\,(F_{\rm H} + F_{\rm K}) /(F_{\rm R} + F_{\rm V})$; see Baliunas et al. (1995). According to Duncan et al. (1991), the nightly calibration factor $\alpha$ is about constant, i.e., $\alpha = 2.4$. By contrast, S-indices based on present, normalized spectra need to be scaled by a factor of approximately 19 (see Hall et al. 2007, who derived a value 19.2), to compare the new S-indices with the original Mt. Wilson S-indices, S$_{\rm MWO}$. In a first test phase of the Hamburg Robotic Telescope (HRT) and its Échelle spectrograph HEROS (Heidelberg Extended Range Optical Spectrograph; see Hempelmann et al. 2005 for a detailed description of the HRT including its hardware) in the time frame between October 2008 and July 2009 we obtained normalized spectra of a sample of stars and the Sun spanning the whole activity scale with a spectral resolution of $R \approx 20,000$. Using specifically observations of 29 selected, well-observed and stable Mt. Wilson stars with S$_{\rm MWO}$ between 0.15 and 0.7, we determined the following, very tight linear relation between "classic" S$_{\rm MWO}$-indices and our own, raw S$_{\rm HRT}$-indices via ${\rm S}_{\rm MWO}~=~(0.0294 \pm 0.0040) + (19.79 \pm 0.56) \cdot {\rm S}_{\rm HRT}$, which allows us to compare our S-indices to the large number of MWO S-indices (Duncan et al. 1991).

During October 2008 and July 2009, we observed the Sun on 73 occasions, usually by taking day-sky spectra and twice by taking lunar spectra. Fortuitously, this observing series coincides with the exceptionally long and deep past solar minimum. All HEROS spectra were reduced with the fully automatic reduction pipeline of the HRT (see Mittag et al. 2010). The day-sky spectra were furthermore corrected for Mie and Rayleigh scattering, with a lunar spectrum serving as reference. To estimate the error of this correction, the continuum flux of the day-sky spectra, after correction, and the reference moon spectrum were compared. The remaining differences are very small, indeed, in the range of $0.2\%-1.8\%$, on average approximately 0.6%.

Our individual solar measurements are shown as a time series in Fig. 1; the measured S-index values are distributed between 0.150 and 0.157, with an average solar S-index of ${\rm S}_{\rm{MWO}} = 0.153 \pm 0.005$ in that period. By contrast, the solar S-index measurements obtained in the context of the Mt. Wilson project showed that the solar S-index varied between about 0.16 (normal activity minima) and 0.22 (maxima) between 1966 and 1993 (Baliunas et al. 1995). The abnormally low value of the solar ${\rm S}_{\rm{MWO}}$ found by us in 2009 must be real and caused by the unusually deep solar minimum, rather than by errors in the above-stated transformation from ${\rm S}_{\rm HRT}$ to ${\rm S}_{\rm MWO}$, since the observed, average offset ($>0.007$) is a lot larger than the respective uncertainty of the transformation ($0.004$).

In summary, we argue that our solar S-index measurements from October 2008 to July 2009 are indeed lower than any of the solar S-indices measured in the context of the Mt. Wilson project, ever. Most interestingly, these values are very close to the S-indices of some solar-type, "flat activity" Mt. Wilson sample stars, i.e., HD 43587 ($B-V=0.61$) and HD 143761 ($B-V=0.60$; see Baliunas et al. 1995). The absence of any higher activity for over 30 years make these stars excellent Maunder Minimum candidate stars, and furthermore, because their $T_{\rm eff}$ values are very similar to those of the Sun, their S-indices can be directly compared to the solar values.

Since sunspots were very rare during our specific observing period, there is little correlation between the S-index values and the sunspot numbers. In particular, there are many S-index measurements on days where the sunspot number was zero. However, for the solar Ca II emission the sunspots are of lesser importance, whereas the presence of any plages (faculae) would directly impact the measured S-index. Indeed, the lowest obtained solar S-values of nearly 0.150 occurred only on days without *any* plages at all (see Fig. 2), as already proposed by White et al. (1992).

# S-index and basal chromospheric flux

Next we explore the relationship between the S-index and the basal chromospheric flux for main-sequence stars and giants. Figure 3, which displays the distribution of S$_{\rm MWO}$ (Duncan et al. 1991) for main-sequence stars (black dots) and giant stars (shaded dots) over $B-V$, strongly suggests that the lower boundaries of the respective distributions correspond to inactive stars with pure basal chromospheric emission. Main-sequence stars of spectral types K and M toward the red end are increasingly more active. By contrast, only G-type giants show a significant amount of chromospheric activity (e.g., Pérez Martínez et al. 2011). It is also at the basal flux edge (around S=0.15) of G-type main-sequence stars, where the Maunder Minimum-type "flat activity" Mt. Wilson stars as well as the plage-free Sun are found. However, because quasi-continua and Ca II photospheric line-cores are both included in the definition of S and also depend on the stellar gravity, giants at basal flux levels are offset from the respective main-sequence to slightly lower S-values.

With a detailed revision of the Ca II K basal chromospheric surface line flux, based on new spectroscopic observations and non-LTE photospheric models, which are still being developed, we employ a simple relationship based on Mg II *h*+*k* line emission, which is much easier to measure and quantify. Using IUE spectra of a set of inactive cool giant stars, we previously derived the following relation between the "basal" chromospheric surface flux in the Mg II *h*+*k* lines and effective temperature $T_{\rm eff}$: $\log{F_{\rm Mg~II}}~=~7.33\log{T_{\rm eff}} - 21.75$ (in cgs units; see Pérez Martínez et al. 2011 and references therein, for details). Earlier work on main-sequence stars arrived at a very similar result, which again shows that the basal chromospheric flux itself (within its uncertainties) does not depend on gravity. Furthermore, according to Schrijver et al. (1992), Mg II *h*+*k* and Ca II H+K chromospheric line fluxes differ by a fixed factor, which is $0.78 \pm 0.05$. By dividing the Mg II fluxes from the above given relationship by this factor, we are able to derive Ca II H+K basal surface fluxes, allowing us to compute "basal" S-indices.

Compared to the work by Strassmeier et al. (1994), who determined $\log{F_{\rm Ca~II}} =
8.0\log{T_{\rm eff}} - 24.8$ directly from Ca II line emissions of cool giant stars, our basal flux values turn out to be higher by a factor of 2 to 4; they are of the same order as the photospheric line core fluxes as confirmed by Figure 4. This plot compares the Ca II K line core of HD 109379, a basal flux giant, and its chromospheric emission at basal flux level to a synthetic spectrum given by a stellar atmosphere model obtained by the Phoenix code (see Hauschildt & Baron 2005; with $T_{\rm eff} = 5800$ K and $\log{g} = 2.5$) to make a photospheric template and an accurate, physical surface flux scale. By contrast, the scale used by Strassmeier et al. (1994) relied on historic work from the 1970s. The same appears to apply to the work by White et al. (1992), who found that the Ca II K line flux of inactive solar-type chromospheres would fall much below that of the average quiet Sun.

To properly translate the basal chromospheric Ca II K flux into S$_{\rm MWO}$, the underlying photospheric fluxes in the Ca II line centers, $F_{\rm H}$ and $F_{\rm K}$, need to be known, as well as the above-mentioned UV quasi-continuum fluxes $F_{\rm R}$ and $F_{\rm V}$. For a variety of effective temperatures and two representative sets of gravity (i.e., $\log{g} = 4$ for the old, least active main-sequence stars and $\log{g} = 2$ for LC III giants) we derived these quantities from Phoenix model spectra. The resulting raw values of "basal S" were multiplied by 19 to match the S$_{\rm MWO}$-scale. Finally, effective temperatures were translated into $B-V$ colors using the tables of Schmidt-Kaler (1982). The resulting "basal" S-values are depicted in Fig. 3 (solid and dashed lines, respectively). Since both quasi-continua and Ca II photospheric line cores, are gravity-sensitive, giants at the basal flux limit are offset from the main-sequence stars at the basal flux limit to slightly lower S-values. It is near the main-sequence basal flux S-values (around 0.15) that we find the Maunder Minimum type "flat activity" stars as well as the plage-free Sun.

# A local "fast" dynamo: new answers to old questions?

Through the kind cooperation of our central star in 2009, we found direct proof that it is the quiet-Sun chromosphere which is behind the formation of basal chromospheric flux, and that a Maunder Minimum-type star exhibits a truly quiet-Sun chromosphere. Therefore, we may now conclude that the quiet Sun is not just similar to inactive stars, but it even represents the universal phenomenon that produces the basal flux of all inactive cool stars with some adjustments for low gravity pertaining to giant stars (see discussion). With this insight in mind, can we now learn something new by looking at the physical processes typical for the quit-Sun chromosphere?

The rich presence of mixed-polarity flux in the quiet Sun nurtures phenomena like spicules and bright points, which are related to rising flux-tubes and their dynamic interaction with convection, and a minimal coronal emission of soft X-rays from solar coronal holes and even Maunder Minimum stars (Schmitt 1997). It was long thought that this magnetic presence was a side product of the main stellar activity through magnetic dissipation of the strong, rising local fields. But the level of magnetic flux-tube density in the quiet-Sun surface does *not* change with the overall activity of the Sun, while we would expect it to show some following-tendency with the solar activity on a time-scale of months or years. Hence, its nature must be entirely independent of what we understand as magnetic activity (local, strong fields, rising up from the bottom of the convection zone where a global dynamo produced them).

Recently, Vögler & Schüssler (2007) have presented an MHD simulation for the quiet-Sun surface, which yields a mixed-polarity field, generated by a local "fast" turbulent dynamo operating only in the thin uppermost layer of the convection zone. The principle of such a non-cyclic mechanism to create a light distribution of random magnetic field has already been suggested by Saar (1998), who also anticipated its potential in explaining the soft X-ray flux and transition region emission concerning inactive chromospheres, where pure acoustic wave heating would well account for only the basal line flux. The simulation of Vögler & Schüssler (2007) starts with a weak seed field, and soon a fairly well-defined saturation level of the magnetic energy density of a few percent of the total kinetic energy is attained.

This result is nicely consistent with the relative flux contribution of the solar bright points to the total light, in both MHD simulations (Unruh et al. 2009) and high-resolution observations (by the SUNRISE balloon-borne observatory, Riethmüller et al. 2010). In Ca II K, bright points appear to contribute only about 10% of the quiet-Sun chromospheric flux. The by far largest contribution to the quiet-Sun chromospheric line emission seems to arise from a highly dynamic process (Wöger et al. 2006), which operates on a time-scale significantly shorter than the underlying convection, and which we may therefore attribute to the action of acoustic waves; see, e.g., Cuntz et al. (2007) for recent solar acoustic heating models.

Hence, both present quiet-Sun observations and detailed hydrodynamic case studies of non-active chromospheres with acoustic wave dissipation strongly hint at kinetic energy to be responsible for creating the major part of the basal chromospheric flux. However, this concept alone cannot explain the coronal soft X-ray emission from above non-active areas. However, invoking the idea of an embedded fairly constant share of magnetic field, this puzzle is finally solved: the typical minimum soft X-ray surface flux, as found in coronal holes and for Maunder Minimum-type stars like $\tau$ Cet, is close to 10$^4$ erg cm$^{-2}$ s$^{-1}$ (Schmitt 1997; Judge et al. 2004). That is nearly two orders of magnitude below the total basal chromospheric cooling flux of all emission lines combined, consistent with an energy content of the magnetic field of a few percent of the kinetic energy of the turbulent chromosphere. According to Pevtsov et al. (2003), the minimum X-ray flux requires a magnetic field of about only 10 Gauss, which easily falls within the yield of the MHD simulation of Vögler & Schüssler (2007).

We therefore conclude that local dynamo action finally resolves the long-standing puzzle of the origin of a minimum X-ray flux, in the absence of any ("classical") stellar activity as we used to know it, i.e., in the absence of active regions.

# Discussion and conclusions

In view of the universality of physics, it is a sensible speculation that the same local "fast" dynamo would produce a similar content of mixed-polarity magnetic flux-tubes in giant chromospheres. Since the local "fast" dynamo is entirely different from the classic $\alpha - \Omega$ dynamo and therefore independent of any global dynamo action, it should provide a universal presence of flux-tubes at a fairly well-defined saturation level, for every cool giant, and not just for their highly active tail-end (e.g., Konstantinova-Antova et al. 2010). Indeed, according to Brandenburg (2011), these locally generated magnetic fields do not vary much with Prandtl number.

There is one special aspect for giant stars, however, which requires more careful consideration: Here we must expect all scale lengths $l$ to be a lot larger because of the much lower gravity, following Schwarzschild's simple relation $l \propto R/g$ with $R$ and $g$ as stellar radius and surface gravity, respectively (Schwarzschild 1975). In this concept of a growing extent of chromospheres and their embedded features with lower values of $g$, we would also expect the occurrence of giant spicules. Indeed, these have already been suspected two decades ago based on data gathered during spectroscopic eclipses of HR 2554 and HR 6902 (Schröder & Hünsch 1992).

Furthermore, if the local "fast" turbulent dynamo were still able to operate in an environment of extremely low gravity, particularly concerning the photospheres of K-type supergiants like 32 Cyg, the resulting presence of local, random magnetic fields would also provide us a plausible explanation for transient, prominence-like clouds of chromospheric material, long known from spectroscopic eclipse observations of $\zeta$ Aurigae systems by "satellite lines" in Ca II K (e.g., Wilson 1960). Schröder (1983) found a large cloud in an IUE spectra series of the 1981 eclipse of 32 Cyg, 1/6 giant radius off-limb, by its Rayleigh scattering and concluded that a magnetic field of about 4 Gauss (if $T_{\rm eff} = 3000$ K) would suffice to balance its thermal energy. With an updated choice of a chromospheric temperature of 6000 K, this would amount to about 6 Gauss, which still lies very reasonably within the the means of the quoted local dynamo.

A supply of flux-tubes to giant chromospheres would also provide a natural explanation for the vertical transport of mechanic flux from the kinetic energy reservoir of the turbulent chromosphere up into the cool wind acceleration region, as suggested by Schröder & Cuntz (2005) and Suzuki (2007). The problem is that acoustic waves are expected to be insufficient because they dissipate their energy relatively close to the star (e.g., Cuntz 1990), but vertical magnetic structure may constitute a venue for this kind of energy transport. Hence, we conclude that a number of hitherto unresolved problems can be seen in an entirely new light, and apparent contradictions disappear if the latest insight into the principal and apparently quite universal physics of the quiet-Sun chromosphere is considered.

Another very interesting and direct result of our 2009 solar S-index measurements is the correspondence of the established Maunder Minimum S-level of 0.150 with the complete absence of even plages, hence of any sign of activity regions. This implies that during a Maunder Minimum, surface activity completely vanishes for most of the time or must be very subtle. The question remains as to why and for how long.


abstract: We investigate the effects of anisotropy on the stability and dynamics of vortex cluster states which arise in Bose-Einstein condensates. Sufficiently strong anisotropies are shown to stabilize states with arbitrary numbers of vortices that are highly unstable in the isotropic limit. Conversely, anisotropy can be used to destabilize states which are stable in the isotropic limit. Near the linear limit, we identify the bifurcations of vortex states including their emergence from linear eigenstates, while in the strongly nonlinear limit, a particle-like description of the dynamics of the vortices in the anisotropic trap is developed. Both are in very good agreement with numerical results. Collective modes of stabilized many vortex cluster states are demonstrated.
author: J. Stockhofe; S. Middelkamp; P. Schmelcher; P.G. Kevrekidis
title: Impact of anisotropy on vortex clusters and their dynamics

*Introduction.* Vortices constitute one of the nonlinear wave structures that have received considerable attention not only within Bose-Einstein condensates (BECs) in dilute atomic gases , but also in nonlinear optics  , among other fields . Nevertheless, admittedly, BECs constitute one of the pristine settings where structural and dynamical properties of single- and multi-vortex or multi-charged-vortex states can be investigated experimentally and compared to theoretical predictions. It is for that reason that multiple techniques were developed to produce such vortices through phase-imprinting , stirring or nonlinear interference and few vortex states , vortex lattices and higher charge states were generated experimentally.

Although single- and multi-charge vortices were intensely studied, one of the themes that has received somewhat less attention is that of clusters of few vortices. Central questions here include the possible geometries and structures of vortex clusters as well as their stability. Furthermore, the dynamics of cluster configurations is of immediate interest: due to the intricate interaction among the vortices, we indeed expect a rich "vibrational" dynamics of vortex clusters. In the literature mostly the vortex dipole has been considered and it has been argued to be a robust dynamical configuration, while other states such as tripoles, quadrupoles, etc. are generally considered to be fragile . There are interesting connections between these states and dark solitonic stripes , since some of the multi-vortex states arise from the instabilities of such dark-soliton stripes. The current interest in vortex clusters is also stimulated by several very recent experiments on the preparation of vortex dipoles and three-vortex states  as well as their dynamics.

Our aim in this work is to present a detailed discussion of the existence, stability and dynamical properties of aligned vortex states by encompassing anisotropy i.e., we include the isotropic case of the above works as a particular limit and extend it to arbitrary anisotropies. In the case of co-rotating vortices (in BECs with rotation), works in a similar spirit are those of , although in the latter case the multi-vortex state may indeed be the ground state of the system. Here we focus on the anisotropic variants of the cases relevant to the above recent experiments. We employ two complementary theoretical methods: chiefly and for large atom numbers, we extend the particle picture for vortices, developed for isotropic settings in , to the anisotropic regime. The resulting set of coupled ordinary differential equations (ODEs) is then used to gain insight into the stability of stationary multi-vortex configurations. On the other hand, we report on near-linear techniques valid in the limit of small atom numbers which allow us to make a very general prediction about the stabilization of a class of vortex states. These complementary theoretical approaches are corroborated by the explicit numerical solutions of the corresponding 2D Gross-Pitaevskii equation (GPE). We identify the vortex clusters via fixed point methods for a wide range of atom numbers and strengths of the anisotropy. Subsequently a Bogoliubov-de Gennes (BdG) analysis of these states is performed, thereby yielding information on their linear stability. To examine their robustness beyond linear stability theory, we disturb vortex states with white noise and employ real-time propagation. Our key conclusion is that anisotropy can controllably stabilize a whole class of unstable states of the isotropic limit, but it can also controllably destabilize stable states of that limit; these predictions should be directly testable in the experimental settings of refs. .

*Setup.* The general framework is set by the dimensionless GPE: $${\rm i} \partial_t \psi(x,y,t) = \left[ -\frac{1}{2} \Delta + V(x,y) + | \psi(x,y,t) |^2 \right] \psi(x,y,t).$$ In the BEC setting this implies that length, time, energy and density $|\psi|^2$ are measured in units of $a_z$, $\omega_z^{-1}$, $\hbar \omega_z$ and $(2\sqrt{2\pi}aa_z)^{-1}$, respectively; $a$ is the s-wave scattering length. $\omega_z$ and $a_z$ refer to the oscillator frequency and length in the z-direction. The anisotropic trap is $V(x,y)=(\omega_x^2 x^2 + \omega_y^2 y^2)/2$. Stationary vortex states will be sought in the form $\psi(x,y,t)=\exp(-{\rm i} \mu t) u(x,y)$, where $\mu$ denotes the chemical potential.

*Results.* The single vortex, dipole and tripole states will be the prototypical ones considered here. They are shown as insets in Figs. , and , respectively, for an anisotropic harmonic potential (with $\omega_x=0.2$, $\omega_y=0.08$) and at $\mu=2.5$. We refer to these as "aligned vortex states". While the single vortex and the vortex dipole are stable in the isotropic limit, all higher aligned vortex states (tripole, quadrupole, quintopole, etc. ) are subject to dynamical instabilities in that limit.

The vortex particle picture from can be naturally extended to take anisotropic confinement into account. In the asymptotic regime of high values of $\mu$, one can use the work of to examine the consequences of anisotropy on the vortex precession. This yields the following equations of motion for a single vortex: $\dot{x} = - \omega_y^2 Q y$ and $\dot{y} = \omega_x^2 Q x$, where $Q=\ln(A \mu/\omega_{\text{eff}})/(2 \mu)$, $A \approx 2 \sqrt{2} \pi$ is a numerical constant and $\omega_{\text{eff}}=\sqrt{(\omega_x^2+\omega_y^2)/2}$. This implies that the precession frequency in the anisotropic trap is given by $\omega_{\text{pr}}=\omega_x \omega_y Q$, which yields the isotropic limit of when $\omega_x=\omega_y$. Our numerical results on the single vortex state are in excellent agreement with the predictions from the above particle picture: At high enough values of $\mu$, for every 2D aspect ratio $\alpha=\omega_y/\omega_x$ that we have considered, the stationary single vortex solution exists, is dynamically stable and the value of the single anomalous mode in its BdG spectrum (responsible for vortex precession ) is accurately described by $\omega_{\text{pr}}$ above, as shown in Fig. . Note that in our numerical calculations we kept $\omega_x=0.2$ fixed and varied $\omega_y$ to scan different values of $\alpha$. Notice also that, in addition to the vortex internal modes, in both this and in following BdG plots, the BdG analysis captures the modes of the background state on top of which the vortex "lives". These include e.g. the dipolar frequency at $\omega=0.2$ due to $\omega_x=0.2$, the dipolar frequency of oscillation around the $y$-axis (which is $0.2$ in the isotropic case, but varies as $\omega_y$ varies), as well as higher order such as quadrupolar modes.

If we now consider multiple vortices, then the corresponding large density particle picture should include the combined effects of the anisotropic precession and vortex interaction dynamics. Thus, the equations of motion of a vortex-antivortex pair i.e., a vortex dipole, will read: $$\begin{aligned}
\dot{x}_1 &=& - \omega_y^2 Q y_1 + B \frac{y_1-y_2}{2 \rho^2}
\label{eqn3}
\\
\dot{y}_1 &=& \omega_x^2 Q x_1 - B \frac{x_1-x_2}{2 \rho^2}
\label{eqn4}
\\
\dot{x}_2 &=&  \omega_y^2 Q y_2 - B \frac{y_2-y_1}{2 \rho^2}
\label{eqn5}
\\
\dot{y}_2 &=& -\omega_x^2 Q x_2 + B \frac{x_2-x_1}{2 \rho^2},
\label{eqn6}
\end{aligned}$$ where $\rho^2=(x_1-x_2)^2+(y_1-y_2)^2$ and $B \approx 1.95$. These equations suggest that the two effects acting on the vortices can balance each other in which case an equilibrium position is obtained, described here by $x_{1,2}=0$ and $y_{1,2}=\pm \sqrt{B/(4 \omega_y^2 Q)}$. One can also predict the linearized dynamics around this position, finding two pairs of frequencies: $\omega_{1,2} = \pm \sqrt{2}  \omega_{\text{pr}}$ and $\omega_{3,4} = \pm \omega_{\text{pr}} \sqrt{1-\alpha^2}$, where $\omega_{\text{pr}}$ is the precession frequency of a single vortex in the anisotropic trap. These two "anomalous modes" of the two-vortex state are shown in Fig. , together with the numerically calculated BdG spectrum of the vortex dipole.

Here and in Figs. and , the coloring of the BdG modes is chosen as follows: in the real part of the spectrum, the anomalous modes (of negative energy) corresponding to intrinsic vortex motions are shown in red (gray), while the other modes which are modes of the background condensate are denoted in blue (light gray). The predictions from the linearization of the particle picture ODEs are shown in black (dark). Notice again the excellent agreement between the theoretical prediction for the frequencies of the internal modes of the vortex pair and the corresponding numerical results. For any $\alpha \neq 1$ the rotational symmetry is broken and the corresponding mode in the BdG spectrum (which is present for any stationary solution in isotropic settings) deviates from its formerly vanishing eigenfrequency. Remarkably, for $\alpha>1$ this mode becomes purely imaginary, signaling destabilization of the dipole (and further destabilization of any higher order) configuration. This is in agreement with the ODE linearization results and with physical intuition suggesting that anisotropy aligning the BEC with the vortex cluster should enhance its stability while anisotropy in the opposite direction should destabilize it.

This particle approach can be generalized to any of the aligned vortex states. The case of three vortices ("vortex tripole") located in equilibrium at $x_{1,2,3}=0$ and $y_2=0$, while $y_1=-y_3=\sqrt{B/(4 \omega_y^2 Q)}$ leads naturally to three anomalous mode pairs (the number of such modes associated with vortex motions is equal to the number of vortices in the cluster) with frequencies: $$\begin{aligned}
\omega_{1,2} &=& \pm \sqrt{2}  \omega_{\text{pr}} \sqrt{1-\alpha^2}
\label{eqn9}
\\
\omega_{3,4,5,6} &=& \pm \omega_{\text{pr}} \sqrt{4-5 \alpha^2 \pm \sqrt{9+2\alpha^2 +25 \alpha^4}}.
\label{eqn10}
\end{aligned}$$ In the isotropic limit of $\alpha=1$, these yield an unstable mode at ${\rm i} \sqrt{7} \omega_{\text{pr}}$, a neutral one at $0$ (due to rotational invariance) and a precession frequency of $\sqrt{5} \omega_{\text{pr}}$. Concerning stability, the most important conclusion here is that there is a *critical anisotropy* of $\alpha=1/\sqrt{6} \approx 0.408$, below which the tripole becomes completely stabilised. I.e., not only can anisotropy (in the "wrong direction" i.e., $\alpha>1$) destabilize stable vortex clusters such as the dipole, but also in the "right direction" (i.e., $\alpha<1$), it can stabilize not only the tripole, but in fact any higher order aligned vortex state (e.g. we have found stabilization in an aligned quadrupole not shown here). What changes is the precise critical value of $\alpha$ below which this stabilization occurs. Examining the numerically found BdG spectrum of the tripole shown in Fig. , we can see that the particle picture still captures the overall behaviour of the relevant modes. Most importantly, stabilization of the tripole for small values of $\alpha$ is correctly predicted by the particle picture. The critical value of $\alpha$ obtained from the BdG analysis is given by $\alpha \approx 0.5$, slightly deviating from the predicted critical anisotropy from the ODE approach.

Stabilization of the aligned vortex states for small $\alpha$ can also be understood from the (near-linear) limit of the number of atoms $N \rightarrow 0$, in which the GPE reduces to the linear Schrödinger equation with the chemical potential $\mu$ playing the role of energy. In this regime, few-mode Galerkin-type methods have been developed in for the isotropic case which can be extended to arbitrary $\alpha$. More specifically, for small particle numbers the aligned vortex states and the soliton stripe states from which they bifurcate as the parameter $\mu$ is increased are well described by superpositions of harmonic oscillator eigenstates . This picture is also applicable in anisotropic settings, and it is found that changing $\alpha$ (and thus shifting the energies of the linear eigenstates) qualitatively affects the bifurcation diagram and, in turn, the stability of the states involved.

In particular, the soliton stripe state with zero density along (and a phase jump of $\pi$ across) the $y$-axis can be traced back to the harmonic oscillator state $\psi_{10}(x,y)=\psi_1(x) \psi_0(y)$ in the linear limit, where $\psi_n$ denotes the $n$-th excited state of the one-dimensional quantum harmonic oscillator. As $\mu$ is increased, the aligned vortex states subsequently bifurcate from this solitonic branch as has been shown for the isotropic case in Ref. . For $\alpha = 1$, except for the single vortex state all aligned vortex states bifurcate from the soliton stripe branch at finite values of the particle number. Since aligned $n$-vortex states emerge from the soliton stripe due to an admixture (to $\psi_{10}$) of $\pm \rm{i} \psi_{0n}$ oscillator components, and admixtures with high $n$ are energetically suppressed, they occur at correspondingly high values of $\mu$. In the isotropic case, the first vortex state bifurcating from the solitonic branch at finite $N$ is the vortex dipole, then the tripole, quadrupole and so on. The dipole inherits the soliton's stability, while the soliton itself is destabilized due to this bifurcation. The tripole, quadrupole etc. then bifurcate from the already unstable solitonic branch, and thus are unstable themselves.

In the following, let us apply the Galerkin-type approach (see details in ) to describe the bifurcations leading to the lowest aligned vortex states in the presence of anisotropy. The critical value of the particle number and the chemical potential, respectively, at which the aligned $n$-vortex state is predicted to bifurcate from the soliton stripe branch are given by $$\begin{aligned}
 N_{\text{cr}} &=& \frac{\omega_{0n}-\omega_{10}}{A-B}
\label{eqncr}
\\
 \mu_{\text{cr}} &=& \omega_{10} + A N_{\text{cr}},
 \label{eqmucr}
\end{aligned}$$ where $A=\int \psi_{10}^4 dxdy$, $B=\int \psi_{10}^2 \psi_{0n}^2 dxdy$, and $\omega_{10} = \frac{3}{2}\omega_x + \frac{1}{2}\omega_y$, $\omega_{0n}=\frac{1}{2}\omega_x + (n+\frac{1}{2})\omega_y$ denote the energies of $\psi_{10}$ and $\psi_{0n}$, respectively. Note that in all cases relevant to our discussion $A > B$.

Eq. () implies that $N_{\text{cr}}$ crucially depends on the energy difference of $\psi_{10}$ and $\psi_{0n}$, which in turn is controlled by the value of the anisotropy parameter $\alpha$. Choosing $\alpha > 1$, the energy difference is increased, and the bifurcations leading to aligned vortex states occur at higher values of $N$ (or $\mu$) than in the isotropic case. Physically speaking, the admixture of a $\rm{i} \psi_{0n}$ component to $\psi_{10}$ is energetically suppressed for large $\omega_y$. As a special case of this, the degeneracy of $\psi_{01}$ and $\psi_{10}$ underlying the single vortex state is lifted, and their superposition does no longer form a stationary state in the linear limit. Instead, the single vortex bifurcates from the soliton stripe along the $y$-axis at a finite particle number. This is now the first bifurcation from the solitonic branch, leading to its destabilization. The dipole then bifurcates from the already destabilized soliton stripe and is thus unstable as well, in full agreement with the results from the particle picture and our numerics. The single vortex branch, on the other hand, inherits the soliton's stability and is stable for any $\alpha > 1$. The numerically determined bifurcation diagram for $\alpha=1.5$ is shown in Fig. , together with the critical values of $\mu$ calculated using the Galerkin approach.

Conversely, for values of $\alpha < 1$ the energy difference in the numerator of Eq. () gets smaller, and the bifurcation points are shifted towards smaller values of $N$ and $\mu$. Considering the single vortex state first, we find that it no longer bifurcates from the $\psi_{10}$ soliton stripe branch in this anisotropic regime. This can be expected, as for $\alpha < 1$ the energy of $\psi_{01}$ is lower than that of $\psi_{10}$, and so the single vortex bifurcates from the energetically favourable $\psi_{01}$ soliton stripe branch, characterized by zero density along the $x$-axis. As a consequence, the single vortex is no longer included in the bifurcation diagram for $\alpha=0.7$, shown in Fig. . Comparing to the $\alpha=1.5$ case clearly illustrates how the bifurcations of the dipole and tripole branches are shifted to smaller particle numbers.

Lowering $\alpha$ even further continues this trend, and eventually at $\alpha=1/2$ the vortex dipole arises in the linear limit, due to the degeneracy of $\psi_{10}$ and $\psi_{02}$. For values $\alpha < 1/2$, the dipole bifurcates from the now energetically favorable two soliton branch starting from $\psi_{02}$. Concerning stability, this means that the bifurcation of the dipole can no longer destabilize the soliton stripe branch for $\alpha \leq 1/2$, which in turn implies that the tripole branch bifurcates from the *stable* soliton stripe branch and inherits its stability in this regime. This, again, agrees well with the numerically found BdG spectrum in Fig. .

The picture keeps repeating for decreasing values of $\alpha$: Generally, for $\alpha = 1/(n-1)$, the aligned $(n-1)$ vortex state emerges in the linear limit, and the aligned $n$-vortex state takes its role in the bifurcation diagram and becomes stable, as it is the first state to bifurcate from the soliton stripe branch. This shows that the $n$-vortex state is stable in the regime $1/n \leq \alpha \leq 1/(n-1)$. Additionally, for $\alpha < 1/n$, the aligned $n$-vortex state is the first state bifurcating from the solitonic branch starting at $\psi_{0n}$, inheriting that state's stability.

Thus, in total, we conclude that the state with $n$ vortices aligned along the $y$-axis is stable for any $\alpha \leq 1/(n-1)$. In particular, aligned vortex states with an arbitrary number of vortices can be stabilized using strong enough transverse confinement. Note that this very general result agrees well with our numerical findings for the single vortex, vortex dipole and vortex tripole cases discussed above.

We corroborate the above general conclusions about the role of anisotropy and its different regimes with numerical simulations examining the robustness of the obtained aligned vortex states. To this end, a white noise signal is added to the state under consideration, and it is then propagated in time. Our observations are in excellent agreement with the stability analysis: in regimes of $\alpha$ where the vortex states are found to be linearly stable, they robustly persist. On the other hand, for $\alpha$'s where we find imaginary modes in the BdG spectrum, the perturbation leads far from the equilibrium. Specifically, four examples are considered in Fig. . The top panel confirms the persistence of the vortex dipole in an isotropic setting. The second row illustrates the destabilization of the same structure under $\alpha=1.5$ (with the BEC elongating perpendicularly to the dipole axis) and its transformation into a dynamic state with one vortex weakly precessing close to the center, while the other counter-precesses far from it. The tripole dynamics is shown in the third and fourth rows: while the isotropic third row case suffers from instability, where again one of the vortices gets "expelled" from the BEC center, the anisotropic fourth row case of $\alpha=0.4$ restabilizes the tripole in a BEC elongated along the tripole axis.

Finally, to illustrate that our picture of the aligned vortex states and their stabilization is valid even for very large numbers of vortices, we discuss a more exotic state with 17 vortices aligned along the y-axis. According to the general result reported above, this state should be stabilised for $\alpha \leq 1/16 =0.0625$, and indeed we find that for $\alpha=0.06$ it remains intact when disturbed with white noise. Remarkably, exciting the 17 vortex state with eigenvectors belonging to anomalous modes from its BdG spectrum leads to a behaviour strongly reminiscent of a (discrete variant of a) classical string along the y-axis with fixed endpoints, supporting a standing wave. Thus, the anisotropy transcending the dimensional instability barrier allows the observation of a fundamental vibration mode and the first few "overtones" as is shown in Fig. . Naturally, the period of such modes is directly associated with their BdG frequencies of our analysis.

*Conclusions.* In the present work, we demonstrated how anisotropy can be used to manipulate the stability and dynamics of vortex clusters. If used to elongate the system in a direction perpendicular to that of aligned vortex states, it generically destabilizes them. More importantly, as the system becomes increasingly elongated along the direction of the aligned vortices it can be controllably stabilized below a critical anisotropy and can exhibit even robust oscillatory dynamics reminiscent of classical strings. Critical values of the anisotropy for the stabilization of aligned $n$-vortex clusters are provided. We believe that both our near-linear bifurcation analysis and our particle approach including anisotropic precessions and vortex interactions can be of value to other fields where vortex dynamics is of interest, such as nonlinear optics and condensed matter physics.


abstract: Task oriented dialog systems typically first parse user utterances to semantic frames comprised of intents and slots. Previous work on task oriented intent and slot-filling work has been restricted to one intent per query and one slot label per token, and thus cannot model complex compositional requests. Alternative semantic parsing systems have represented queries as logical forms, but these are challenging to annotate and parse. We propose a hierarchical annotation scheme for semantic parsing that allows the representation of compositional queries, and can be efficiently and accurately parsed by standard constituency parsing models. We release a dataset of 44k annotated queries [^1], and show that parsing models outperform sequence-to-sequence approaches on this dataset.
author: Sonal Gupta; Rushin Shah; Mrinal Mohit; Anuj Kumar
Facebook Conversational AI Michael Lewis
Facebook AI Research
{sonalgupta, rushinshah, mrinalmohit, anujk, email@example.com
title: Semantic Parsing for Task Oriented Dialog
  using Hierarchical Representations

# Introduction

Intelligent personal assistants are now ubiquitous, but modeling the semantics of complex compositional natural language queries remains challenging. Typical systems classify the *intent* of a query (e.g. `GET_DIRECTIONS`) and tag the necessary slots (e.g. `San Francisco`) . It is difficult for such representations to adequately represent nested queries such as *"Driving directions to the Eagles game"*, which is composed of `GET_DIRECTIONS` and `GET_EVENT` intents. We explore a hierarchical representation for such queries, which dramatically improves the expressive power while remaining accurate and efficient to annotate and parse (see Figure ).

We introduce a Task Oriented Parsing (TOP) representation for intent-slot based dialog systems. This hierarchical representation is expressive enough to capture the semantics of complex nested queries, but is easier to annotate and parse than alternative representations such as logical forms or dependency graphs. We show empirically that our representation is expressive enough to model the vast majority of human-generated requests in two domains.

A key advantage of our representation is that it has a structure similar to standard constituency parses, allowing us to easily adapt algorithms developed for phrase structure parsing for inference. In particular, we use linear-time Recurrent Neural Network Grammars (RNNG)  and show that the inductive bias provided by this model significantly improves the accuracy compared to strong sequence-to-sequence (seq2seq) models based on CNNs, LSTMs and Transformers.

Our contributions in this paper are:

1.  A hierarchical semantic representation for task oriented dialog systems that can model compositional and nested queries.

2.  A publicly available dataset of 44k requests annotated with our representation. We show that our representation has very high coverage of these requests, and that inter-annotator agreement is high.

3.  We show that the representation is learnable by standard algorithms. In particular, we show that the RNNG parsing model outperforms seq2seq baselines.

# Representation

Designing semantic annotation schemes requires trade-offs between how expressive the representation is on one hand, and how easily can it be annotated, parsed, and executed on the other. Most existing annotations for task oriented dialog systems have fallen on the extremes of non-recursive intent and slot tagging, such as in the ATIS dataset , and full logical forms .

We introduce a hierarchical representation, similar to a constituency syntax tree, with words as terminals. Non-terminals are either *intents* or *slots*, and the root node is an intent. We allow intents to be nested inside a slot, resulting in the ability to compose requests and call multiple APIs. Using this compositional tree representation, we can enable answering compositional queries over multiple domains.

We introduce the following constraints in our representation: 1. The top level node must be an intent, 2. An intent can have tokens and/or slots as children, 3. A slot can have either tokens as children or one intent as a child.

Executing queries such as those in Figure is straightforward because of the explicit tagging of the outer location slot: first we fetch 'the Eagles game' event (or the relevant coffee shop), extract the location, and pass it as the destination slot to the navigation domain intent.

Compositional queries are frequent. In our dataset of crowd-sourced utterances, we found that 30% could not be adequately represented with traditional intent-slot tagging.[^2] This shows that more expressive representations are often necessary.

While our representation is capable of modeling many complex queries, some utterances are beyond its scope. For example, in *Set an alarm at 8 am for Monday and Wednesday*, *8 am* needs to be associated with both *Monday* and *Wednesday* which would require graph-structured representations. However, we found that just 0.3% of our dataset would require a more expressive representation to model adequately.[^3] More expressive representations, such as dependency graphs or logical forms, would only bring marginal gains but would add significant challenges for annotation and learning.

Together, these results suggest that our tree-structured approach offers a useful compromise between traditional intent-slot tagging and logical forms, by providing very high coverage of queries while avoiding the complexities of annotating and learning more expressive representations.

In summary, our representation has the following attractive properties:

-   **Expressiveness** Compared to traditional intent-slot annotations, it can express complex hierarchical queries, improving coverage of queries by 30%. We found that more general representations are required for only 0.3% of queries.

-   **Easy Annotation** Annotating our representation simply requires labeling spans of a sentence, which is much more straightforward than alternatives such as creating a logical form for the sentence, or an arbitrary dependency graph. This fact allows us to quickly create a large dataset.

-   **Efficient and Accurate Parsing** Since our representation closely resembles syntactic trees, we can easily re-use models from the large literature on constituency parsing.

-   **Execution** Our approach can be seen as a simple generalization of traditional dialog systems, meaning that existing infrastructure can easily be adapted to execute the intents.

# Dataset

We asked crowdsourced workers to generate natural language sentences that they would ask a system that could assist in navigation and event queries. These requests were then labeled by two annotators. If these annotations weren't identical then we adjudicated with a third annotator. If all three annotators disagreed then we discarded the utterance and its annotations. 63.40% of utterances were resolved with 2 annotations and 94.09% were resolved after getting 3 annotations. We also compared percentage of utterances that were resolved after 2 annotations for depth $\leq 2$ (traditional slot filling) and for depth $> 2$ (compositional): 68.87% vs 62.03%, noting that the agreement rate is similar.

We collected a total of 44783 annotations with 25 intents and 36 slots, randomly split into 31279 training, 4462 validation and 9042 test utterances. The dataset has utterances that are focused on navigation, events, and navigation to events.

The median (mean) depth of the trees is 2 (2.54), and the median (mean) length of the utterances is 8 (8.93) tokens. 35% of trees have depth more than 2. The dataset has 4646 utterances that contain both navigation and event intents. Figure shows the distribution of instances in the full dataset over the utterance length and tree depth.

# Models

We experiment with two types of models: standard sequence-to-sequence learning models, and a model adapted from syntactic parsing, Recurrent Neural Network Grammars  (RNNG). RNNG is a top-down transition-based parser and was originally proposed for parsing syntax trees and language modeling. We trained the RNNG parser discriminatively and not generatively to reduce training time of the model. While sequence-to-sequence learning can model arbitrary sequence transduction, we hypothesize that parsing models like RNNG, which can only output well-formed trees, will give better inductive bias and flexibility for predicting compositional and cross-domains scenarios on the fly, particularly for domains with less training data available.

We briefly review the RNNG model – The parse tree is constructed using a sequence of transitions, or 'actions'. The transitions are defined as a set of SHIFT, REDUCE, and the generation of intent and slot labels. SHIFT action *consumes* an input token (that is, adds the token as a child of the right most 'open' sub-tree node) and REDUCE *closes* a sub-tree. The third set of actions is generating non-terminals – the slot and intent labels. Note that at each step, there are only a subset of valid actions. For examples, if all the input tokens have been added to the tree, the only valid action is REDUCE.

# Experiments and Results

### Baselines

We compared RNNG with implementations of sequence-to-sequence models using CNNs , LSTMs  and Transformer networks  in fairseq[^4].

```latex
\begin{table*}[ht!]\centering
    \resizebox{\textwidth}{!}{%
    \begin{tabular}{|l|c|c|c|c|c|c|c|c|}
        \hline
         Model & Exact match & $F_1$ & Precision & Recall & TL-$F_1$ & TL-Precision & TL-Recall & Tree Validity\\
         \hline
         \textbf{RNNG} & \textbf{78.51} & \textbf{90.23} & \textbf{90.62} & \textbf{89.84} & \textbf{84.27} & \textbf{84.64} & \textbf{83.91} & \textbf{100.00}\\
         seq2seq-CNN (LOTV) & 75.87 & 88.56 & 89.25 & 87.88 & 82.31 & 82.92 & 81.72 & 99.75\\
         seq2seq-LSTM (LOTV) & 75.31 & 87.69 & 88.35 & 87.03 & 81.15 & 81.72 & 80.58 & 99.94\\
         seq2seq-Transformer & 72.20 & 86.60 & 87.09 & 86.11 & 78.54 & 78.99 & 78.19 & 99.55\\
         \hline
    \end{tabular}}
    \caption{Performance (in percentage) of RNNG and seq2seq models based on LSTMs, CNNs, and Transformer networks. The CNN and LSTM models were trained with a Limited Output Token Vocabulary (LOTV) of just a single element.}
    \label{tab:comparison}
\end{table*}
```

### Metrics

We used three metrics to evaluate the systems. **Exact match** accuracy is defined as the number of utterances whose full trees are correctly predicted. The second metric is a commonly used scoring method for syntactic parsing – **labeled bracketing $F_1$** scores  (called $F_1$ henceforth). We used the pre-terminals as well in the calculations. One downside of this metric is that it only considers the token spans for a given non-terminal but not the internal structure. Tree sub-structures are rather important for task completion. Thus, we introduce a third metric, **Tree-Labeled** (TL) $F_1$, which compares the sub-tree structure for a non-terminal, instead of just the token span. Exact match accuracy is the strictest metric and $F_1$ is the least strict metric. **Tree Validity** is the percentage of predictions which formed valid trees (via bracket matching).

### Preprocessing and Hyperparameters

We used the same preprocessing of unknown words as used in  and mapped numbers to a constant. We used pre-trained GloVe embeddings  and tuned hyperparameters on the validation set.

-   **RNNG** - We used 2-layer 164-unit LSTM with a bidirectional LSTM compositional function, trained with a learning rate of 0.0004, weight decay of 0.00004, dropout of 0.34 with Adam optimizer for 1 epoch with 16 workers using Hogwild updates.

-   **seq2seq CNN** - We used 3x3 convolutions (9 layers of 512 units, 4 units of 1024 units), followed by 1x1 convolutions (2 layers of 2048 units) with attention, trained with initial learning rate of 0.9, dropout of 0.2, gradient clipping of 0.1 with NAG optimizer for 30 epochs, inferred with beam size 5.

-   **seq2seq Transformer** - We used 3 layers of 4 FFN attention heads of embedding dimension 512, trained with initial learning rate of 0.01, dropout of 0.2, gradient clipping of 5 with Adam optimizer for 50 epochs, inferred with beam size 5.

-   **seq2seq LSTM** - We used 1-layer 256 unit LSTMs with attention, trained with initial learning rate of 0.7, dropout of 0.2, gradient clipping of 0.1 with NAG optimizer for 40 epochs, inferred with beam size 5.

### Results

The experimental results in Table  and Figure  show that existing approaches for syntactic parsing, such as RNNG, perform well for this task, achieving perfect outputs on over 75% of queries. RNNG performs better than sequence-to-sequence models, especially in predicting exact trees, which is important for task completion. We present results for the CNN and LSTM models with an output terminal token vocabulary of just a single element (LOTV), which performed better than the regular token vocabulary (exact match accuracy of 75.63% and 68.39%, respectively). We believe LOTV makes the models focus on learning to predict the tree structure rather than to reproduce the input tokens. But we observed that this vocabulary reduction resulted in significantly poorer performance for the Transformer model.

Below we discuss how varying the beam size during inference affects accuracy. The seq2seq results in Table  are accuracy for the top prediction when a beam of size 5 was run and the RNNG results are for greedy inference. For RNNG, the accuracy of top prediction did not change much when a beam of size 5 was run. We also measured how often the correct tree annotation was in the top $k$ predictions for the models when a beam of size $k$ was run during inference, called as *Top-k*. For RNNG, *Top-3* was 90.21 and *Top-5* was 92.48, compared to 78.51 for *k=*$1$. For seq2seq-CNN, the *Top-3* score was 88.08 and *Top-5* score was 90.21. For seq2seq-LSTM, *Top-3* was 86.55 and *Top-5* was 88.76. We note that *Top-5* is substantially higher than the accuracy of the top prediction. These top-*k* predictions could be used by a hypothesis ranker downstream, which can take into account agent capabilities.

We also experimented with more minimal representations of the RNNG model . Removing the actions LSTM dropped Exact match score slightly to 78.08. Separately, removing the stack LSTM dropped it to 75.31. Removing the buffer LSTM caused a unusable decrease to 13.78.

While sequence-to-sequence models have shown strong parsing performance when trained on very large amounts of data ; in our setting the inductive bias provided by the RNNG model is crucial to achieving high performance. The model has several useful biases, such as guaranteeing a well-formed output tree, and shortening the dependencies between intents and their slots.

A further advantage of RNNG is that inference has linear time complexity, whereas seq2seq models are quadratic because attention is recomputed at every time step.

# Related Work

Many annotation schemes have previously been proposed for representing the semantics of natural language. We briefly compare our method with these.

Most work on task oriented dialog systems has focused on identifying a single user intent and then filling the relevant slots – for example, the representations used on the ATIS dataset and in the Dialog State Tracking Challenge . We showed that hierarchical representations with nested intents can improve coverage of requests in our domains.

The semantic parsing literature has focused on representing language with logical forms . Logical forms are more expressive than our representation, as they are less tightly coupled to the input query, and can be executed directly. However, logical forms are difficult to annotate and no large-scale datasets are available.

While we used a tree-structured representation, others have used arbitrary graphs, such as Abstract Meaning Representation and Alexa Meaning Representation . These approaches can represent complex constructions that are beyond the scope of our approach, but with significantly challenging parsing . We showed that such cases are very rare in our data.

# Conclusions

Drawing on ideas from slot-filling and semantic parsing, we introduce a hierarchical generalization of traditional intents and slots that allows the representation of complex nested queries, leading to 30% higher coverage of user requests. We show that the representation can be annotated with high agreement. We are releasing a large dataset of annotated utterances at <http://fb.me/semanticparsingdialog>. The representation allows the use of existing constituency parsing algorithms, resulting in higher accuracy than sequence-to-sequence models.

[^1]: http://fb.me/semanticparsingdialog

[^2]: In our dataset, 35% of queries have depth $\textgreater 2$, which means that the traditional intent-slot tagging systems would not have been able to annotate or predict these annotations. In addition, to avoid the depth-based statistic being influenced by our label set specification, we manually performed analysis of 100 samples that showed that 30% of the queries required compositional representation.

[^3]: Utterances that could not be annotated with the label sets and corresponding instructions were marked as 'unsupported' (9.14% of the dataset), including the ones that needed more expressive representation than a tree. Analysis of a random sample of 120 unsupported utterances shows that only four instances cannot be supported because of the tree representation constraint, estimating that there are only 0.3% queries that would require a more general (e.g graph-based) representation.

[^4]: https://github.com/pytorch/fairseq