abstract: We present an observational constraint for the typical active galactic nucleus (AGN) phase lifetime. The argument is based on the time lag between an AGN central engine switching on and becoming visible in X-rays, and the time the AGN then requires to photoionize a large fraction of the host galaxy. Based on the typical light travel time across massive galaxies, and the observed fraction of X-ray selected AGN without AGN-photoionized narrow lines, we estimate that the AGN phase typically lasts $\sim10^{5}$ years. This lifetime is short compared to the total growth time of $10^{7}-10^{9}$ years estimated from e.g. the Soltan argument and implies that black holes grow via many such short bursts and that AGN therefore "flicker" on and off. We discuss some consequences of this flickering behavior for AGN feedback and the analogy of X-ray binaries and AGN lifecycles.
author: Kevin Schawinski$^{1}$[^1], Michael Koss$^{1}$, Simon Berney$^{1}$ and Lia F. Sartori$^{1}$

$^{1}$Institute for Astronomy, Department of Physics, ETH Zurich, Wolfgang-Pauli-Strasse 27, CH-8093 Zurich, Switzerland
title: Active galactic nuclei flicker: an observational estimate of the duration of black hole growth phases of $\sim10^{5}$ years

# Introduction

When the massive black holes in galaxy centers accrete, they become visible as quasars or active galactic nuclei (AGN). The energy liberated by accretion episodes is thought to be a critical regulatory mechanism in galaxy evolution . But how exactly does this connection operate? Amongst the most basic unknowns is the timescale on which the AGN phase operates. Indirect measurements of the typical AGN phase are on the order of $10^{7} - 10^{9}$ years . Taking the local relic black hole mass density and comparing it to the total light emitted by quasars and assuming a reasonable radiative efficiency yields such long ($10^{7} - 10^{9}$ year) *total* accretion timescales . This does not constrain however whether the entire mass growth consists of a single accretion phase, or is broken up into shorter phases.

AGN variability has been observed on short time scales all the way out to multiple decades . The *natural time scales* of the AGN central engine however are significantly longer than human time scales. This leaves a major gap on the timescale domain on which we can easily study AGN variability: we can see AGN vary on human timescale, and we can constrain the total growth time using statistical arguments.

In this paper, we present an *observational argument* for why nearby AGN – and perhaps all AGN – switch on rapidly ($\sim 10^{4}$ years) and "stay on'" for $\sim 10^{5}$ years before switching off. In order to reconcile this result with previous measurements of AGN lifetimes, we argue that AGN *flicker* in a $\sim 10^{5}$ year cycle resulting in the total $10^{7-9}$ year lifetime. We therefore begin to fill in AGN variability between the two extremes.

Breaking up the accretion phases of AGN into many short $\sim 10^{5}$ year phases has implications beyond the fact that massive black holes assemble their mass via a large number of individual bursts. Many short phases also means that the AGN central engine swings back and forth between different accretion states. During high-Eddington phases, the AGN will produce predominantly radiative energy and will be visible as a classical quasar or AGN. During the low-Eddington phases, the bulk of the energy is in the form of kinetic energy . In this low-Eddington phase, the AGN is harder to detect, but may still inject (kinetic) energy into the host galaxy. Thus, a full accounting of the AGN lifecycle and the different modes in which an AGN interacts the host galaxy may be vital to a full description of AGN feedback and the galaxy-black hole connection. Ultimately, we will need constraints on the full power spectrum of AGN from days to several Gyrs to understand how black holes influence their surrounding galaxies.

In this paper, we outline the argument for a short AGN lifetime and discuss some implications for our understanding of the galaxy-black hole connection and feedback.

# Analysis

In this Section, we outline our new framework of how existing observations can constrain the duration of an individual AGN phase to $\sim10^{5}$ years, present these observations, and then give an order of magnitude calculation.

## Framework

Consider the case of a central black hole in a star-forming galaxy. When the black hole begins accreting, it become visible virtually instantaneously as a nuclear source. The accretion disk and surrounding material begin emitting at optical and ultraviolet wavelengths, and the hard X-rays will escape the nuclear region even at very high levels of obscuration. As the AGN phase continues in time, photons from the central engine begin to photoionize the interstellar medium (ISM) of the host galaxy. Due to the geometry of obscuring medium, or torus, the photoionized region usually manifests itself as an ionization cone . Once these galaxy-scale photoionized *narrow line regions* are established, the host galaxy can be identified as an AGN as the central engine dominates the photoionization budget of the host galaxy . **The narrow line region (NLR) is therefore the part of the host galaxy interstellar medium whose emission lines are driven by AGN photoionization.** The most prominent AGN line seen in optical spectra is the \[\] $\lambda 5007$ line, though usually a series of line ratio diagnostics is used. Higher ionization coronal lines are often also found.

From this setup, it follows that there is a significant *time delay* between the start of accretion in the AGN central engine, and the time the host galaxy exhibits AGN-like line ratios. To zeroth order, this time delay is on the light travel time from the nucleus to the half-light radius of the host galaxy. Naturally, the properties of the ISM would be an important first order effect in this time delay as the complex physics of photoionization kicks in, but we believe that estimating the switch-on time using the light travel time across the host galaxy is the dominant effect. As the AGN photoionization travels across the host galaxy, AGN lines become stronger and more apparent over those driven by star formation and shocks in the galaxy, and to the host galaxy spectrum may begin to move into the "composite" region on emission line diagrams. Ultimately the AGN will photoionize the ISM and the host galaxy will be classified as a regular AGN.

The non-trivial light travel time of the AGN radiation across the host galaxy thus constrains the *lifetime of the AGN phase* in a statistical sense. Assuming that those AGN host galaxies in a (hard) X-ray selected AGN sample whose spectra show either pure star-formation or composite AGN+star formation lines are those which just switched on, then the combination of the fraction and the light travel time across the host galaxy yields a lifetime for the AGN phase: $$t_{\rm AGN~phase} = \frac{\rm{time~to~photoionize~host~galaxy}}{\rm{fraction~of~optically~elusive~AGN}}$$ In order to measure the typical duration of the AGN phase, we require estimates of the fraction of the AGN population lacking AGN lines (the optically elusive AGN or XBONGs) and the typical size of the narrow line region. We caution that this estimate is only true in a statistical sense as it is derived from population statistics, and that there are likely many systematics in both quantities – we discuss those systematics later.

At a later time, once the black hole stops accreting, the ISM may continue producing AGN-like lines as the light echo from the past AGN travels out across the galaxy. At the largest scales, these light echoes have been seen as the quasar light echo "Hanny's Voorwerp" near IC 2497, and the Voorwerpjes (little Voorwerps) as well as in some quasars . These Voorwerps constrain the "shut-down" time scale to $10^{4}-10^{5}$ years via the geometry of their spatial extent and the recombination timescale of the narrow line emission.

We illustrate this AGN phase life cycle in a schematic form in Figure .

|                |                   |           |
|:---------------|:------------------|:----------|
| AGN/galaxy     | Optically elusive | Reference |
| sample         | fraction          |           |
| $BeppoSAX$     | 4%                |           |
| $Chandra$+SDSS | 6%                |           |
| $Swift$-BAT    | 6%                |           |
| $Swift$-BAT    | 5.6%              | this work |

Literature measurements of "optically elusive" and XBONG fractions

## Observations

### Compilation of "optically elusive" AGN fractions from the literature

If the life cycle for AGN phases outlined is correct, then the switch-on phase has already been seen: X-ray-selected AGN with host galaxies lacking obvious AGN lines. There is some diversity in terminology and definition of these objects in the literature. These AGN host galaxies can be described as "optically elusive" or "optically dull" AGN or as XBONGs (X-ray bright, Optically Normal Galaxies[^2]). These classes can sometimes contain AGN host galaxies which are red and dead and therefore do not have a sufficient cold ISM to photoionize and produce strong lines, but these objects make up a minority. Such AGN host galaxies have been reported repeatedly in the literature in a variety of surveys . Independent of selection and definition, the fraction of such host galaxies is consistently around the $\sim5\%$ level as reported by various teams; we report these values in Table .

While the details of how AGN are selected on emission line diagrams vary, they share generic features which go back to the original and which separate star-forming galaxies, AGN and other non-stellar ionization sources using line ratios. The most common diagram – and the one we use in this paper – is the standard \[\]/H$\beta$ vs \[\]/H$\alpha$ diagram. Star-forming galaxies are separated using an empirical line of . The "composite" region where star-formation and shocks can mix extend all the way to the extreme starburst line of . Seyfert AGN and LINERs (low ionization nuclear emission regions) beyond the extreme starburst line can further be separated . In general, AGN photoionized galaxies are identified by having high \[\]/H$\beta$ line ratios, with a second line ratio such as \[\]/H$\alpha$ separating out other processes such as shocks and evolved stellar populations.

For this paper, we add an independent measurement of the "optically elusive" fraction. We take the sample of hard X-ray selected AGN detected by *Swift* Burst Alert Telescope (BAT) in the footprint of the Sloan Digital Sky Survey in the redshift interval $0.0165<z<0.4$ . Using emission line diagnostics, we find that 6 out of 107 AGN, $5.6\%$ are classified as composite, meaning they are a mixture of AGN and star formation. We show the resulting classical \[\]/H$\beta$ vs \[\]/H$\alpha$ diagram in Figure .

The SDSS fibers cover the nuclear region of the BAT AGN host galaxies so in our framework, the AGN in these galaxies just switched on and has begun to photoionize the nuclear region, but has not yet overwhelmed the star formation lines. Our measurement is consistent with that of of a similar sample of *Swift* BAT AGN, as well as with previous reports despite the heterogeneous nature of samples, selection techniques and definitions.

### Compilation of narrow line region sizes

The switch-on time can be derived from the physical scale of the narrow line region (NLR), which to zeroth order scales as the half-light radius of the host galaxy. What do observations show that the NLRs of luminous AGN are large and at least on scales of several kpc . Long-slit spectroscopy of obscured AGN by shows that the NLR reaches the physical scale of the entire host galaxy as the AGN luminosity increases and tops out, leading to a flattening of the relationship between NLR size and AGN luminosity. Integral field unit studies of AGN host galaxies similarly show large scale NLRs . Based on these observations of NLR sizes, we can take the half-light radius of the host galaxy of a luminous AGN as a reasonable proxy for the expected NLR size.

For this paper, we take the typical half-light radius of the *Swift* BAT AGN host galaxy sample of $\sim 5$ kpc, which corresponds to $\sim 16,000$ light years. To be conservative, we assume that the typical radius of the NLR is somewhat smaller and take a switch on time of $\sim 10,000$ years.

## Estimate of the AGN phase lifetime

We now have estimates of the two quantities that go into the calculation of the AGN phase lifetime. We take the $5\%$ optically elusive fraction, and the 10,000 year switch on time scale: this yields an AGN phase lifetime of: $$t_{\rm AGN~phase} \sim \frac{10,000}{0.05} \sim 200,000~\rm{years}$$ We stress that this estimate should be seen as an order of magnitude estimate, and that it only applies in a statistical sense. Nevertheless, we believe this typical lifetime has significant consequences for our understanding of AGN variability and the role AGN play in galaxy evolution. Before we address these, we discuss some of the major caveats to this estimate.

## Caveats

### Is there sufficient gas in the host galaxies?

In order to light up a narrow line region, the AGN radiation needs a sufficiently dense screen of cold gas in the host galaxy to illuminate. One of the hypotheses for the nature of XBONGs is that they are gas-poor, red sequence galaxies. Correspondingly, their spectra show no strong emission lines *of any kind* while still featuring AGN X-ray emission. For the more distant AGN/XBONG samples, this may be a concern, but for the *Swift* BAT sample, we can rule out this explanation for most host galaxies: as report, very few *Swift* BAT host galaxies are red and gas poor. If such gas-poor AGN hosts[^3] are a significant fraction of the total "optical elusive" AGN fraction, this would increase the inferred AGN lifetime. A 50% contamination would double the inferred AGN lifetime. In our sample of *Swift* BAT AGN, only one object features no emission lines, which implies that this is not a major bias.

### Are XBONGs/optically elusive AGN not simply dusty?

Another explanation for the apparent lack of AGN lines in the optical spectra is that XBONGs/optically elusive AGN are particularly dusty and so their AGN lines are not apparent in the optical spectrum. Searches for AGN lines using near-infrared spectroscopy of *Swift* BAT AGN host galaxies by find that most XBONGs lack AGN-like lines. Even in the case of two objects with near-IR lines consistent with AGN, star-formation remains a possibility. If a significant fraction of optically elusive AGN are in fact normal AGN with dust obscured NLRs, this would increase the inferred AGN lifetime. As with Section , a 50% contamination would double the inferred lifetime.

### Is the assumption of "light travel time" too simplistic?

We assume that we can measure the switch on time using the light travel time across the host galaxy as the relevant time scale. This is naturally a simplification as the switch on process is gradual. More importantly, we are neglecting the well-studies physics of photoionization which certainly modulates the mapping from light travel time to appearance of narrow lines.

How much of a delay can such effects cause? In the central parts of a galaxy, the electron density is high enough that the recombination timescale is very short. For typical values of density and temperature, the H$\beta$ recombination timescale is about $\sim 200$ years (see, e.g., ). It is only in the outer regions of a galaxy where the density drops significantly that the recombination timescale becomes substantial (as is the case with some Voorwerps, see ). Other timescales which contribute to the delay, such as the time needed to significantly increase the ionization level, or to excite a significant fraction of ions, are expected to be shorter than the recombination timescale. The host galaxy ISM is likely already largely photoionized due to star formation, so all the AGN ionization front needs to do is change the relative populations in the ions present. In any case, any additional delay between the AGN photoionization front moving though the host galaxy and exhibiting AGN lines would increase the "optically elusive" AGN fraction artificially, and therefore further *decrease* the inferred lifetime.

### Could aperture effects be significant?

In a host galaxy with significant star formation, the emission lines from star formation could overwhelm the AGN lines, moving the spectroscopic classification out of the AGN region and into the composite region. This is a particular concern for SDSS fiber spectra as the large physical footprint of the fiber can include such a signal from star formation. showed using simulations that this dilution effect is significant for low-luminosity AGN around $L[\mbox{O\,{\sc iii}}]$ $\sim10^{39}$ $~\rm erg~s^{-1}$  but ceases to be important for brighter AGN around $L[\mbox{O\,{\sc iii}}]$ $\gtrsim 10^{40.5}$ $~\rm erg~s^{-1}$. Since the *Swift* BAT AGN are luminous, this dilution effect is unimportant.

Furthermore, not all optically elusive samples are based on fiber spectra: both the and the studies use long-slit spectroscopy and find similar optically elusive fractions as those based on fiber spectra. Ultimately, integral field unit observations will resolve this. AGN during the switch-on phase should exhibit AGN-like lines in the nucleus and lack them at larger radii despite hosting an AGN sufficiently luminous (based on X-ray observations) to photoionize the entire galaxy.

As with the caveats in Section and , a significant fraction of AGN misclassified due to aperture effects would increase the inferred AGN lifetime. We note that while all the caveats discussed here could affect the inferred AGN lifetime, the magnitude of the implied changes are on the order of a factor of $\sim2$ and thus have only a moderate effect on our order-of-magnitude estimate of the AGN lifetime.

# Discussion

We now briefly discuss several consequences of a characteristic lifetime on the order of $10^{5}$ years for AGN phases. We note that our argument and the resulting AGN lifetime is in broad agreement with other studies, as discussed below:

presented a simple model for the quasar luminosity function based on the assumption that quasar activity is driven by thermal-viscous instability in the accretion disk. This model yields short bursts of comparable duration to our measurement driven by such instabilities and the resulting model luminosity function matches the observed data very well.

have argued that the shorter characteristic time scale of AGN relative to star formation in galaxies can account for the *apparent* disconnect between star formation and black hole accretion. They propose a simple model for the distribution of Eddington ratios with a functional form of a power law with an exponential cutoff at high Eddington ratios and allow AGN to vary following this distribution. If star-forming galaxies (*i.e.* those galaxies with gas) follow this prescription for black hole accretion, the model produces a reasonable AGN luminosity function and matches the observed relationship between star formation rate and black hole accretion rate. The model does not constrain the actual AGN phase lifetime, *i.e.* the time spent at high Eddington ratio in any individual burst; our observational argument now constrains this time.

High resolution simulations have similarly indicated short AGN lifetimes: perform very high resolution hydrodynamical simulations of feeding and feedback in elliptical galaxies, resulting in short $10^{5}$ year AGN bursts. Similarly, and find short high-Eddington AGN bursts in simulations of high redshift gas-rich disks with black holes. In these simulation cases, the enormous short time scale variability is driven by clumpy and highly variable inflow of gas in the very center of the galaxy.

All these separate approaches are converging on a picture where short bursts are the norm for black hole growth. It remains however unclear if the burst scale is driven by the fueling mechanism (such as the clumpiness of the material driven towards the center), or by instabilities in the accretion disk. We cannot resolve this issue here, but the fact that we can observationally support short individual AGN phases has a number of interesting consequences:

## Black holes accrete mass through many short phases

The first major consequence is that each individual black hole growth phase contributes only very little to the total mass growth of black holes. The argument implies characteristic growth times of black holes on the order of 100 Myr to 1 Gyr for reasonable radiative efficiencies $\eta$. In order to reconcile the short lifetime of $10^{5}$ years with a total growth time of $10^{8-9}$, the total growth of massive black holes must consist of *many* ( 100-1000) such short accretion bursts.

## Connection to shorter- and loger-term variability

The characteristic time scale of $10^{5}$ years for the AGN phase must be placed in the context of both shorter- and longer-term variability as we know AGN exhibit both. On the shorter term side, there is a rich variety of observations on the hour to years time scale as many local AGN are monitored and sometimes exhibit significant changes in luminosity. This shorter-term would be superimposed on the total duration of a $10^{5}$ year phase, as can be seen e.g. in the simulated light curve of show in Figure . Taking several $10^{5}$ year phases, it seems unlikely that these would be randomly distributed. Rather, it is likely that a large number of 100 to perhaps 10,000 make up a longer growth phase of $10^{7}$-$10^{9}$ years. To put it another way, what we previously considered to be a $\sim10^{8}$ year AGN phase, perhaps triggered by a major merger, should be divided into $\sim1000$ short bursts. In this view, AGN "flicker" in the same sense as a fluorescent lamp[^4] does.

## Rapid flickering in AGN may imply changes in accretion state, similar to X-ray binaries

The flickering behavior for AGN connects the behavior of massive black holes to that of stellar mass black holes. X-ray binaries exhibit often rapid changes in Eddington ratio and accretion state which changes their appearance and their impact on their environment. The idea that the accretion physics in X-ray binaries and AGN is similar, except that AGN black holes are more massive and therefore change on significantly longer time scale has been suggested a number of times . In this framework, the different classes of AGN are closely related: black holes at a given mass rise and fall in Eddington ratio, leading to appearance either as a quasar or a radio galaxy, respectively.

## Time scale implications for AGN feedback

Dividing a single sustained AGN phase into numerous short phases alternating between high-Eddington bursts and lower-Eddington troughs points to a new way in which the black hole-galaxy connection works. During each "cycle", the mode via which energy is injected into the system changes: during the high-Eddington peak, the AGN will produce predominantly radiative energy, while during the low-Eddington troughs, the change in accretion mode means that most of the energy is injected in kinetic form . The AGN flickering cycle thus alternates between radiative and kinetic modes on a short time scale compared to the dynamical time of the host galaxy. This "jackhammer" effect could be important in driving AGN outflows and feedback. Even if each individual cycle only injects a small amount of energy, repeating the cycle 100-10,000 times could add up to sufficient amounts to unbind the gas reservoir of the host galaxy as required for AGN feedback. In order to approach the binding energy of a massive galaxy of $\sim10^{60-61}$ erg, each cycle would only have to inject $\sim10^{56-58}$ ergs.

The short AGN life cycle makes linking AGN activity to outflow phenomena much more challenging. The low-Eddington phase may be difficult or impossible to detect in star-forming host galaxies and thus the galaxy may not be classified as an AGN, despite the AGN being active. Similarly, a kinetic outflow driven by the low-Eddington phase may persist, perhaps coasting ballistically, until the next high-Eddington burst. Searches for AGN outflows generally target bright AGN, and so might erroneously associate observed outflows with the bright phase, when in fact, the previous faint, low-Eddington phase was responsible.

A short lifetime (compared to the total growth time) for the AGN phase causes a time scale problem relative to the galaxy. The AGN central engine operate on timescales comparable only to the central dynamical time of the host galaxy, and orders of magnitude faster than the dynamical time of the whole host galaxy ($t_{\rm dyn} \sim 10^{8}$ years for a massive galaxy). The AGN can switch on and off many times on the time the host galaxy at large is able to react to. This is exacerbated by the fact that most tracers of the host galaxy star formation rate and stellar age are dependent on tracers whose time resolution is much worse than the $10^{5}$ time scale of the AGN. H$\alpha$ is driven by photoionization of OB stars and from the lifetime of these stars alone yields a time "smoothing kernel" of at least $10^{6}$ years. Ultraviolet emission from young stars and reprocessed infrared extend even further in time as they respond to young stellar populations. Spectral features such as Balmer absorption lines or the 4000Å break have even worse time resolution. This mismatch in time scales may explain why it is so difficult to link AGN to galaxy evolution, and suppression of star formation in particular. The AGN lives and acts of a much shorter time scale than can be reconstructed from stellar populations.

## The Milky Way black hole

The recent activity of the black hole in the Milky Way center can be revisited in light of a short AGN flickering cycle. X-ray light echoes in the Galactic Center show moderate-luminosity flares in the last few centuries , though these were likely too short and not sufficiently luminous to generate narrow lines across the Milky Way. show that the Magellanic Stream near the Milky Way was photoionized by an AGN event in the Galactic center some 1-3 Myr ago, and the duration of the burst is estimated to be 100-500 kyr - the same order of magnitude as the lifetime derived in this paper. propose this Galactic Center outburst as the cause of the *Fermi* bubble . If this is the case, the flickering cycle exhibited by other AGN should leave similar remnants as the *Fermi* bubble around other galaxies as their black holes switch on and off.

# Summary

We have presented an observational constraint for the typical AGN phase lifetime. The argument is based on the time lag between an AGN central engine switching on and becoming visible in X-rays, and the time the AGN then requires to photoionize a large fraction of the host galaxy. Based on the typical light travel time across massive galaxies, and the observed fraction of X-ray selected AGN without AGN-photoionized narrow lines, we estimate that the AGN phase typically lasts $\sim10^{5}$ years. This short lifetime implies that black holes grow via many such short bursts and that AGN therefore "flicker" on and off. We discuss some consequences of this flickering behavior for AGN feedback and the analogy of X-ray binaries to AGN.

# Acknowledgements

We thank the anonymous referee for helpful comments. We are grateful to G. Novak for sharing his simulated light curves. We thank Benny Trakhtenbrot, Ezequiel Treister, Meg Urry and Bill Keel for useful discussions. KS, MK and LS gratefully acknowledge support from Swiss National Science Foundation Professorship grant PP00P2_138979/1 and MK support from SNSF Ambizione grant PZ00P2_154799/1. This research has made use of data from the Sloan Digital Sky Survey and the NASA Swift satellite. This research has made use of NASA's ADS Service.

[^1]: E-mail: firstname.lastname@example.com, Twitter: @kevinschawinski

[^2]: The nomenclature for such objects is not uniform. Some studies reserve the term "XBONG" for X-ray selected AGN with host galaxies which show *no* emission lines, as opposed to showing emission lines excited by processes other than AGN.

[^3]: The XBONGs, in some definitions

[^4]: This very useful analogy was first proposed by R. Hickox.


abstract: Miriad is a radio interferometry data-reduction package aimed at taking raw data through to the image analysis stage. The Miriad project, begun in 1988, is now middle-aged. With the wisdom of hindsight, we review design decisions and some of Miriad's characteristics.
author: R.J. Sault; P. J. Teuben; M.C.H. Wright
title: A Retrospective View of Miriad

# A Brief History

Miriad aims at being a "full service" radio interferometry data-reduction package, taking raw telescope data through to image analysis and publication-quality image displays. The Miriad project was initiated by the Berkeley Illinois Maryland Association (BIMA). This followed much internal debate, and a meeting in February 1988 where a number of external experts (from the AIPS, GIPSY and IRAF camps) were invited to express their opinions on BIMA's offline software options. BIMA's decision was to develop two streams. The first stream, the Miriad project, was to build on the experience with the Illinois `Werong` and Berkeley `RALINT` packages, and to develop a package up to, but excluding, the image analysis stage. The second, image-analysis, stream eventually died, and Miriad was extended to cover this area.

Miriad was designed and developed jointly by groups at the three BIMA sites. Most of the infrastructure was written in Illinois by one person, with significant input from Berkeley. The first astronomically useful applications (FITS readers/writers, imaging and deconvolution tasks) appeared in October 1988. A fourth site became involved when two of the Miriad group moved to the Australia Telescope National Facility in 1990, and began extending Miriad to meet the needs of that institute's interferometer.

# Project Management and Economics

Having the project spread over three or four sites has its difficulties, especially when group members are responsible to individual institutes and not to the project as a whole. In the early stages, there were regular phone conferences, quarterly face-to-face meetings and a barrage of email. There was no real project leader, with the project advancing by the good will of the group members (a true anarchy). The pragmatic solution to the occassional disagreements between group members (and the interests they serve) was nick-named "the free market economy" (a true capitalism). Each piece of code has an "owner" who must approve any change to it. If an owner cannot be persuaded, anyone is free to submit alternative code, and the different codes compete in the open market for users. Generally this occurs only occassionally, but it has led to multiple, functionally similar, tasks of significantly varying quality. This "free market" approach results in some inefficient use of resources which perhaps could be avoided with a "centralised economy".

# User Interface and Documentation

User interfaces were a controversial issue in the early stages of the project – no interface suits every use. The approach adopted was to make the "front-end" user interface quite separate from number-crunching tasks. Apart from running tasks, the main functions of a front-end program is to provide task documentation and to help assemble task parameters. These parameters are passed to the number-crunching tasks simply as command line arguments. This trivial interface made it easy to develop front-end interfaces to suit different tastes; early front-end programs included a Sunview windowed environment, a VT100 menu system, and a "dumb terminal" interface similar to POPS.

This design means that the front-end task can be completely bypassed, with users initiating tasks at the host command line. More experienced users do this often, particularly with simpler tasks. It is also the best way to develop batch scripts (we prefer to write those in the powerful shell that the host provides, rather than to try to reinvent it).

Using an idea adapted from PGPLOT, task documentation is stored as comments as a preamble in the source code. A tool extracts this 'help file' and stores it in a directory ready for use by the front-end programs (whenever a task is recompiled, its help file is also updated). Help files for subroutines are treated in a similar fashion.

Although help files are good for specific information, additional documentation giving a greater overview is needed. Users and programmers guides appeared early in Miriad's life. Later a guide specifically aimed at Australia Telescope users was also developed. Although this is continually updated, re-assignments within BIMA have meant that their guides are now out-of-date.

With the popularity of the WWW, a html version of Miriad's documentation was developed (e.g. see `http://bima.astro.umd.edu/bima/miriad` or `http://www.atnf.csiro.au/ATNF/miriad`). This hypertext version is generated automatically from the source of the users guide and the help files.

# File Format Issues

Compatibility with FITS is clearly an important goal. Although we considered the possibility of making FITS the 'native' file format of Miriad (as it was in `Werong`), we concluded that pure FITS was too inflexible for this purpose. However, we adopted an image data-set structure which shadowed FITS reasonably closely (thus making a translation between the two straightforward). This was not possible with visibility data-sets – the general characteristics of the uv FITS format were seen as too restrictive for our needs. The visibility format adopted is based on the `RALINT` design of Wilson Hoffman. It has proven to be significantly more flexible than the FITS style of handling visibility data, and has the added advantage of a much cleaner interface for the programmer. We have found it easy to use this format with a number of forms of data not considered in the original design. Unfortunately it has the penalty that the current implementation can be slow to read.

Our initial concept of Miriad was of a package working in a shared disk environment of VAXes, Suns and Crays – machine-independence of the data was seen as very important. Miriad data are stored in a canonical format on disk, with the i/o system performs needed conversions during the i/o process (this conversion is invisible to the applications programmer). Although this has been very successful, because of declining interest in VAXes and Crays, machine independence has not been as critical as we had anticipated.

# Language and Portability Issues

Miriad was designed to be portable, with VMS and several UNIX variants being the initial target systems. Since then, Miriad has been ported, with minimal effort, to many UNIX-based systems. To aid portability, and to reduce our own workload, we have gladly used public-domain software where appropriate. Miriad's plotting tasks are based on PGPLOT, whereas some of the numerical code is based on LINPACK.

Although all the i/o system and ancillary tools are written in C, most of Miriad is written in FORTRAN. We used FORTRAN because we felt that most astronomers would be happiest with it (and we wanted to attract programmers), and because vector machines were important to us (the best vectorising compilers continue to be FORTRAN ones).

As the i/o system is written in C, at some level FORTRAN has to call C routines. This language barrier is invariably system dependent (there are six schemes used in the systems that Miriad has been ported to). We developed a tool which takes a system-independent interface description, and which produces a thin layer of system-dependent code that mates the FORTRAN and C parts of Miriad. Although we have always had some misgivings about a mixed-language system, this approach has worked reasonably well.

# Visualisation

Visualisation and image display is one of Miriad's failings. In the initial stages, this area was split off to a sub-group to develop. Their plans were comprehensive and their development lagged behind the rest of the project. As a stop-gap, a simple interim set of routines was adopted. Eventually, the comprehensive plan failed and that sub-group disbanded. Somewhat later, a second attempt was made. Although this did progress further, it also effectively failed, and this second sub-group also disbanded.

Meantime, the "interim" routines were slowly upgraded, and made to work under X-Windows, but they are still basic. These shortcomings have been somewhat alleviated by the development of a set of image display tasks using PGPLOT. Though a good plotting package, PGPLOT is not intended to be an image display package, and so its model of a display device is limiting.

# Miriad's On-Line Component

One novel aspect of Miriad is that it has been integrated into the on-line system of the Hat Creek interferometer. The on-line system generally uses the Miriad user interface and documentation system. Thus, to some extent, the user interface remains the same from driving the telescope to producing publication quality output. The on-line system also writes the raw data directly in the Miriad uv data format (this requirement was one of the reasons uv FITS was unsatisfactory).

# A Niche Package

Miriad is continuing to be developed. It has proven to be a good and flexible environment for writing specialised applications, as well as for developing new algorithms of greater applicability. A natural question to ask is "why reinvent the wheel". Certainly at the original planning meeting there was a strong voice (both from NRAO and some BIMA representatives) for using AIPS to solve BIMA's reduction problems. AIPS, however, did not satisfy a number of the criteria that BIMA felt were essential. We had the choice between a major development in AIPS, or a major development with a fresh system. A fresh start, a system more flexible than AIPS, and a more programmer-friendly environment were probably the deciding factors (politics may have also played a part).

In hindsight, it was the correct decision. We had a useful system comparatively quickly, and have been able to extend it with new algorithms and techniques at a good rate. The overhead of programming in AIPS would have, at best, slowed our software development. At worst, it would have completely dissuaded us from implementing many new applications.

Faced with AIPS++, what is the future of Miriad? Part of the success of Miriad is that it is not a huge package – it has been able to adapt and concentrate on specialised areas, and in a timely fashion. Miriad does not try to address the data-reduction needs of the entire radio-astronomy community, so the overheads are much less than those for AIPS++. We do not believe that mega-packages will, or should, swamp the small and mid-size packages; there will always be a place for these. At the same time Miriad is now showing some grey hairs – perhaps Miriad++ is needed.

We thank the many people who have helped make the package successful, in particular (in historical order) Wilson Hoffman, Brian Sutin, Lee Mundy, Neil Killeen, Jim Morgan, Bart Wakker and Mark Stupar.


author: Xiaobo Li$^a$, Shu Zhang$^a$, Catherine Grant$^b$, Matteo Guainazzi$^{c,d}$, Eric Miller$^b$,
Lorenzo Natalucci$^e$, Jukka Nevalainen$^f$, on behalf of the IACHEC
($^a$Institute of High Energy Physics, Beijing, PRC
$^b$MIT Kavli Institute for Astrophysics and Space Research, Cambridge, U.S.A.
$^c$European Space Astronomy Centre of ESA, Madrid, Spain
$^d$Institute of Space and Astronomical Science, Sagamihara, Japan
$^e$Istituto di Astrofisica e Planetologia Spaziali, INAF, Roma, Italy
$^f$University of Tartu, Estonia)
date: 2024-10-01
title: Summary of the 10th IACHEC Meeting

**Abstract**
We summarize the outcome of the 10th meeting of the International Astronomical Consortium for High Energy Calibration (IACHEC), held in Beijing (People's Republic of China) in April 2015. Over 80 scientists directly involved in the calibration of operational and future high-energy missions gathered during 3.5 days to discuss the status of the X-ray payload inter-calibration, as well as possible ways to improve it. A recent study on a large sample of galaxy clusters confirmed that the calibration of the effective area shape above 2 keV between *XMM-Newton*/EPIC and *Chandra*/ACIS is consistent, but showed a significant discrepancy at lower energies. Temperatures measured by EPIC are therefore smaller, the difference being largest for the highest temperatures, up to $\simeq$`<!-- -->`{=html}20% at $kT$=10 keV (Schellenberger et al. 2015). The latest multi-mission study of the Crab Nebula above 10 keV shows a $\pm$`<!-- -->`{=html}13% agreement in the relative normalization of the INTEGRAL, NuSTAR, RXTE, and *Suzaku* hard X-ray instruments.

The International Astronomical Consortium for High Energy Calibration (IACHEC)[^1] is a group dedicated to supporting the cross-calibration environment of high energy astrophysics missions with the ultimate goal of maximizing their scientific return. Its members are drawn from instrument teams, international and national space agencies and other scientists with an interest in calibration in this area. Representatives of over a dozen current and future missions regularly contribute to the IACHEC activities. Support for the IACHEC in the form of travel costs for the participating members is generously provided by the relevant funding agencies.

IACHEC members cooperate within working groups to define calibration standards and procedures. The scope of these groups is primarily a practical one: a set of data and results (eventually published in refereed journals) will be the outcome of a coordinated and standardized analysis of reference sources ("high-energy standard candles"). Past, present and future high-energy missions can use these results as a calibration reference. The 10th IACHEC meeting was successfully hosted by HXMT team during April 20–23 2015 at the Fragrant Hill of Beijing. It turns out to be the IACHEC with the largest number of participants so far. 85 scientists covering a diversity of nationalities, including China, US, Germany, Spain, Italy, India, Japan, and Estonia, joined this meeting and shared their experience on calibration of operational as well as future missions.

At the end of the nominal meeting, a mini-workshop was held at IHEP to discuss the calibration status and plans of the Hard X-ray Modulation Telescope. Six IACHEC participants out of China attended this mini-workshop as experts. The event was highly successful. It could represent a precedent to increase the efficiency and impact of future IACHEC meetings.

# Working Group reports

## CCD

The CCD Working Group again met in conjunction with the Backgrounds Working Group due to substantial overlap in interested participants. As always, the CCD Working Group provided a forum for cross-mission discussion and comparison of CCD-specific modeling and calibration issues, while the Backgrounds Working Group provides the same for measuring and modeling instrument backgrounds in the spatial, spectral and temporal dimensions. At IACHEC 2015, we heard from *Chandra*/ACIS, *Chandra*/ACIS/HETG, and *XMM-Newton*/EPIC-pn.

We started the session with presentations on ACIS calibration and background. Nick Durham summarized work using the ACIS external calibration source (radio-isotope Fe-55 plus Al and Ti fluorescence targets). He is evaluating a variety of calibrated quantities as a function of time and focal plane temperature, such as line centroid and width, quantum efficiency uniformity across the CCDs, and the spatial distribution of the contamination on the ACIS filters. Terry Gaetz spoke on efforts to improve the accuracy of the low-energy gain on the ACIS BI CCDs using Low-Energy Transmission Gratings spectra, and also on a preliminary investigation into ACIS background flares and their frequency. Improvements for the ACIS-S1 low-energy gain based on this work will be released shortly in CALDB 4.6.9. He also found that while the fraction of time during background flares is higher during solar maximum than minimum, the current solar maximum has a much lower flaring fraction than the previous one.

Matteo Guainazzi and Norbert Schultz both gave presentations on a multi-observatory calibration effort to better understand the EPIC-pn response to bright sources at low energies and more generally, CCD redistribution in specialized timing modes. *Chandra*/HETG, *XMM-Newton*, and *Swift* all simultaneously observed the bright obscured X-ray binary Cyg X-3. The *Chandra* HETG line energies can then be fed back into the CCD spectra to better calibrate the energy scale, while comparison of low energy residuals can feed into improved low energy redistribution models.

Finally, Michael Smith discussed the EPIC-pn energy scale and the quiescent background. After adjusting event energies with the long-term CTI correction calibrated using the on-board calibration source, there is a residual secular trend that is strongly correlated with the quiescent background. The residual secular trend is not due to CTI, but is a background-dependent gain effect. SAS implementation and scientific validation of an additional background-dependent gain correction is in progress.

## Contamination

The contamination Working Group held its second face-to-face meeting at the 2015 IACHEC workshop, gathering 6 of 20 WG members and several additional non-members for a single session. The group discussed the affects of molecular contamination (Marshall et al. 2004, Koyama et al. 2007, O'Dell et al., 2013) on soft X-ray ($\leq$ 1 keV) instruments in light of the three broad topics introduced at the inaugural meeting in 2014:
(1) comparison of contamination among instruments and missions;
(2) mitigation for current instruments; and
(3) mitigation for future instruments.

Representatives from operating missions presented status reports on the contamination in their soft X-ray CCD instruments. Herman Marshall presented new observations of the blazar Mrk 421 with the *Chandra* LETG and ACIS-S array. This "big dither" observation was similar to one performed in 2014, where the pointing direction was dithered by $\pm$`<!-- -->`{=html}64 arcsec in a direction orthogonal to the grating dispersion direction. This dither is much larger than the $\pm$`<!-- -->`{=html}8 arcsec Lissajous dither pattern in standard observing, and allows fine mapping of the contaminant spatial distribution along this direction. The results indicate that the contamination is continuing to build at an increasing rate on ACIS, and appears symmetric top-to-bottom in the ACIS-S array, with more contaminant at the edges of the filter. The oxygen to carbon ratio varies from the center to edge, with possibly two contaminant components responsible. Doug Swartz presented an updated model of contamination migration within *Chandra*, building on previous work constraining the volatility of the contaminants. These results suggest that most of the recently accumulated contamination comes from a second, higher volatility source that has become increasingly active, possibly due to rising temperatures within the *Chandra* Observatory. If the source rate continues to track these temperature trends, then the contamination layer might dramatically increase in the near future. Eric Miller showed updates of the *Suzaku* XIS contamination monitoring, using targets such as SNR 1E 0102.2$-$`<!-- -->`{=html}7219, the isolated neutron star RX J1856.5$-$`<!-- -->`{=html}3754, and the BLLac PKS 2155$-$`<!-- -->`{=html}304. The XIS show no evidence for an accelerated source of contaminant as with *Chandra*, and in fact have continued to show signs of decreasing contamination optical depth. The total effective area at 0.65 keV (the O VIII Ly$\alpha$ line) has been increasing at about 10% per year since 2011.

For upcoming missions, Kallol Mukherjee briefly discussed the possible sources of contamination in the Soft X-ray Telescope (SXT) CCD instrument aboard ASTROSAT, along with plans for initial operations to mitigate early contaminant build-up. There was significant discussion among the working group members about how long to wait before opening the instrument door, what initial targets to point at for a zero-contamination baseline, and what might be expected given the CCD operating temperature and other operational parameters.

Efforts will continue before the next IACHEC meeting to work toward a legacy white paper detailing shared lessons learned about contamination on soft X-ray instruments.

## Galaxy Clusters

### Multi-Mission Study

We continued the discussion, started in the previous meeting, about the "Multi Mission Study" project, which currently consists of comparing X-ray spectroscopic results of four clusters obtained with on-going and past X-ray missions/instruments *XMM-Newton*/EPIC, *Chandra*/ACIS, *Swift*/XRT, *Suzaku*/XIS and ROSAT/PSPC.

While we do have preliminary results indicating significant patterns in the behavior of the cross-calibration, we need help with interpreting them. Our aim is to utilize the collective IACHEC experience on the involved instruments and their calibration. We challenge anyone interested to respond to our related "Request to the IACHEC community" found in the project page[^2] We aim for a refereed publication on the topic before the next IACHEC meeting.

We discussed about the possibility of extending the "Multi Mission Study" cluster data base to include NuSTAR mission and the near-future Astro-H, Astrosat and eROSITA missions. This data base could be very valuable for the 0.5-10 keV band effective area calibration of the future missions. We are currently negotiating with the calibration teams of the above missions about including our cluster sample as calibration targets. If this turns out to be infeasible, we will proceed via Guest Observer programs.

### Stack residuals ratio

Our basic tool for evaluating the effective area cross-calibration uncertainties is the stack residuals ratio method (e.g. Kettula et al., 2013; Schellenberger et al., 2015). The method is applicable to other astronomical targets as well. We started discussions about applying it to the blazar data obtained via simultaneous *XMM-Newton* and *Chandra* observations (Smith & Marshall, in preparation). If we find similar *XMM-Newton*/*Chandra* cross-calibration uncertainties using galaxy clusters or blazars, as expected, we will yield additional confidence on our methods. This in turn would result in a larger statistical sample for the cross-calibration work and thus better precision for the calibration.

### HIFLUGCS follow-up

We discussed a possible follow-up cross-calibration work using the *XMM-Newton*/*Chandra* HIFLUGCS cluster sample (Schellenberger et al., 2015, see also the catalog[^3]). The larger sample of hot clusters and the additional exposure time, compared to that in Nevalainen et al., (2010) could be used to improve the Fe XXV/XXVI emission line ratio diagnostics. The line ratio measurement yields the estimate of the ionization temperature which, due to the very narrow energy band used, is independent on the accuracy of the effective area shape calibration. Comparison with the continuum-based bremsstrahlung temperature (affected by the effective area calibration accuracy) yields an additional tool for estimating the calibration accuracy. For cool clusters there is also a possibility of using the emission lines of sulfur (S XV and S XVI) and silicon (Si XIII and Si XIV) for the temperature measurements.

### Cluster X-ray and gravitational lensing masses as calibrators

Inspired by an IACHEC-related paper (Israel et al., 2015), we discussed the comparison of cluster masses obtained with X-rays with those obtained with gravitational lensing. Unfortunately the situation has not improved from what we reported last year; the possible existence of non-thermal pressure in clusters would induce a hydrostatic bias with similar effect on the X-ray masses as caused by the *XMM-Newton*/*Chandra* effective area cross-calibration uncertainties. A possible near-future solution could be achieved with Astro-H measurements of the non-thermal component via the broadening of the Fe XXV emission lines in clusters.

## Heritage

This Working Group aims at preserving the IACHEC corpus of knowledge, know-how and best practices for the benefit of future missions and the community at large. Its main goals are:

-   provide a platform for the discussion of experiences coming from operational missions

-   facilitate the usage of good practices for the management of pre- and post-flight calibration data and procedures, and the maintenance and propagation of systematic uncertainties (the latter task in strict collaboration with the "Calibration uncertainties" IACHEC Working Group)

-   document the best practices in analyzing high-energy astronomical data as a reference for the whole scientific community

-   ensure the usage of homogeneous data analysis procedures across the IACHEC calibration and cross-calibration activities

-   consolidate and disseminate the experience of operational missions on the optimal calibration sources for each specific calibration goal

The activity for the following term will concentrate on:

-   publishing a paper on the in-flight calibration plans of currently operational mission on the Journal of Astronomical Telescope, Instruments and Systems (Guainazzi et al., in preparation)

-   producing a summary of "best-practices" as far as a) photoelectric absorption models and associated cross- sections; b) elemental abundance tables; c) optically thin equilibrium emission plasma codes, and benchmark the effects (if any) of different prescriptions \[a)+b)\] on the calibration results

-   populating the repository of calibration documents on the WG Wiki[^4]

-   build a "IACHEC knowledge database"

## Non-thermal SNRs

A meeting of the Non-thermal SNR group was held, attended by calibration scientists from different missions with a significant share of Chinese representatives. The attendees list is the following: Juan-Ha Wang, Haihui Zhao, Xin Zhou, Dipankar Bhattacharya, Yoshitomo Maeda, Michael Smith, Fangjun Lu, Paul Plucinsky, Xi Long, Lorenzo Natalucci, Mingyu Ge. In addition, Kristin Madsen participated remotely (Skype).

The group addressed first the cross-calibration on the hard X-ray band, using the Crab Nebula as a reference source. This effort includes the analysis of data from *Suzaku* (XIS,HXD), RXTE (PCA) *XMM-Newton* (EPIC-pn), INTEGRAL (IBIS,SPI) and NuSTAR. Updates since year 2014 include new assessments of calibrations for NuSTAR (Madsen et al. 2015) and for IBIS/ISGRI (Savchenko et al. 2014). A simultaneous *XMM-Newton*/NuSTAR/INTEGRAL observation took place in November 2014. For *XMM-Newton*, the data were taken from EPIC-pn in burst mode and a possible update of the burst mode calibration will follow.

Progress on the analysis was achieved by the addition of new data sets from most recent periods, yielding a total of 11 nearly simultaneous epochs up to November 2014. The new observations also include data from NuSTAR. The multi-instrument fits from single epochs show evidence of a break at high energies (near 100 keV) by SPI and HXD/GSO. The HXD normalizations are generally found to be higher than INTEGRAL ($\simeq$`<!-- -->`{=html}13% and 8% for the PIN and GSO, respectively), while the PCA lies in between ($\simeq$`<!-- -->`{=html}6%). The NuSTAR normalization is significantly lower than the INTEGRAL one ($\simeq$`<!-- -->`{=html}12%).

The results obtained from the Crab are broadly consistent with the ones reported by Tsujimoto et al. (2011) from observations of G21.5-0.9. However, the relative spread in the measured flux values is significantly wider in the case of G21.5-0.9. For this source, a break at 9 keV was reported by NuSTAR (Nynka et al. 2014), which is the possible explanation for the above discrepancy. It was noted that in the Tsujimoto et al. paper a clear difference emerges between values of the spectral slope measured independently in the soft and hard band. A natural explanation of this effect would be the presence of the 9 keV spectral break, and not an instrumental bias. A test of the new model against *Chandra*, NuSTAR and INTEGRAL is planned.

Finally, Mingyu Ge presented new results for Crab timing mostly obtained from analysis of RXTE data. The analysis shows clear evidence for a phase lag between the X-ray and radio pulses, increasing with time. M. Smith presented results obtained by *XMM-Newton*. A discussion followed on whether it could be possible to use other instruments data (e.g. INTEGRAL) to confirm these results.

# Cross-calibration status

The latest IACHEC cross-calibration study was published by Schellenberger et al. (2015). These authors discuss an update of the cross-calibration status between the *Chandra*/ACIS and the *XMM-Newton*/EPIC, based on a large sample of galaxy clusters. This study confirms previous results in, *e.g.*, Nevalainen et al. (2010). The calibration of the effective area shape above 2 keV between EPIC and ACIS is consistent, but there is a significant problem at lower energies resulting in significantly smaller EPIC temperatures. The temperature difference is bigger for the highest temperatures, amounting to $\simeq$`<!-- -->`{=html}20% at $kT$=10 keV. Readers are refereed to Sect. 2 of Burrows et al. (2014) for a summary of the cross-calibration status among operational missions based on samples of point-like sources (cf. their Fig. 4).

# References[^5]

Burrows et al., 2014, IACHEC Report 2014[^6]
Kettula et al., 2013, A&A, 552, 47
Koyama et al., 2007, PASJ, 59, 23
Israel et al., 2015, MNRAS, 448, 814
Madsen et al. 2015, ApJ Suppl., 220, 8
Marshall et al., 2004, in Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Vol. 5165, X-Ray and Gamma-Ray Instrumentation for Astronomy XIII, ed. K. A. Flanagan & O. H. W. Siegmund, 497–508
Nevalainen et al., 2010, A&A, 523, 22
Nynka et al. 2014, ApJ 789, 72
O'Dell et al., 2013, in Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Vol. 8859, UV, X-Ray, and Gamma-Ray Space Instrumentation for Astronomy XVIII, ed. O. H. W. Siegmund, 88590F
Savchenko et al. 2014, Proceedings of Science, PoS(Integral2014)083
Schellenberger et al., 2015, A&A. 575, 30
Tsujimoto et al. 2011, A&A 525, 25

[^1]: `http://web.mit.edu/iachec/`

[^2]: `https://wikis.mit.edu/confluence/display/iachec/MMS`

[^3]: `http://vizier.u-strasbg.fr/viz-bin/VizieR?-meta.foot&-source=J/A%2bA/575/A30`

[^4]: `https://wikis.mit.edu/confluence/display/iachec/IACHEC+Heritage+Working+Group`

[^5]: see `http://web.mit.edu/iachec/papers/index.html` for a complete list of IACHEC papers

[^6]: available at `http://arxiv.org/pdf/1412.6233`