\section{Introduction}


Individualized treatment effect (ITE) estimation is an important problem for personalized decision-making across many disciplines \citep{Glass2013, Song2019, hatt2020early}. For instance, in medicine, individual treatment effects guide personalized treatment assignments such that the benefit for each patient is maximized. Traditionally, randomized controlled trials (RCTs) represent the gold standard for estimating treatment effects; yet, RCTs are often unfeasible. Consequently, there is a growing need for estimating ITEs from observational data, such as electronic health records.


Numerous methods have been proposed for estimating ITE from observational data in the longitudinal setting \citep{Robins2008, Schulam2017, Lim2018, Bica2020crn}. However, most of these methods assume that all confounders (\ie, variables that affect both treatment assignment and potential outcomes) are observed. When some confounders are unobserved (\ie, hidden), they cannot be controlled for, and, hence, these methods yield ITE estimates that are biased \citep{Pearl2009}. This can lead to sub-optimal or even harmful treatment recommendations. In practice, it is unlikely that we observe all confounders directly. 


In practice, we often find that measurements of confounders are either indirect measurements and/or subject to noise.  Nevertheless, such indirect and/or noisy measurements of true confounders can serve as proxies for the true confounders. For instance, we may not be able to measure socio-economic status of patients directly; however, we can obtain information on their socio-economic status indirectly, such as, \eg, through a patient's job, salary, or residence address. Such information represents proxies of the true socio-economic status. Hence, while the true confounders are often unobserved in practice, observational data usually contains information on the true confounders in form of noisy proxies. Motivated by this, we study how to leverage noisy proxies for unbiased ITE estimation in the longitudinal setting (and thus circumvent issues due to hidden confounders).


In this paper, we propose the \emph{Deconfounding Temporal Autoencoder}\xspace (DTA\xspace), a novel method for ITE estimation in the longitudinal setting using noisy proxies. Specifically, DTA\xspace leverages observed noisy proxies to learn a hidden embedding that reflects the true hidden confounders. As such, our DTA\xspace method does not rely on the 'no hidden confounders' assumption; instead, DTA\xspace learns a hidden embedding that reflects the true hidden confounders using noisy proxies in the observational data. The DTA\xspace proceeds in two steps: (i)~we build upon a long short-term memory (LSTM) autoencoder to learn a hidden embedding that leverages information from observed noisy proxies, and (ii)~we add a causal regularization penalty based on the Kullback-Leibler divergence to render potential outcomes and treatment assignment conditionally independent given the hidden embedding. This way, we ensure that the learned hidden embedding reflects the true hidden confounders in terms that it can be used to control for them during ITE estimation. 


We emphasize that our DTA\xspace works as a deconfounding method. As such, it captures information on the true hidden confounders by leveraging the observed noisy proxies and, therefore, enables unbiased ITE estimation in the longitudinal setting. The output of the DTA\xspace is a hidden embedding that reflects the true hidden confounders, and which can as such be used in conjunction with any outcome model for ITE estimation. We demonstrate the effectiveness of our DTA\xspace using experiments with both synthetic and real-world data. First, we perform a simulation study with synthetic data where we control the amount of hidden confounding. Here, we show that, across different amounts of confounding, DTA\xspace is effective in reducing bias in ITE estimation. Second, we use real-world data from patients in the intensive care units \citep{Johnson2016}. Here, our DTA\xspace yields significant performance improvements over state-of-the-art outcome models for ITE estimation in the longitudinal setting. 


We list our main \textbf{contributions}\footnote{Code available at: \url{https://github.com/mkuzma96/DTA}} as follows:
\begin{enumerate}
\item We develop the \emph{Deconfounding Temporal Autoencoder}\xspace, a novel method that leverages \emph{noisy proxies} of hidden confounders for ITE estimation in the longitudinal setting. 
\item We propose a causal regularization penalty that forces potential outcomes and treatment assignment to be conditionally independent given the learned hidden embedding.
\vspace{-.35em}
\item We demonstrate that our DTA\xspace, in conjunction with an outcome model, substantially improves over state-of-the-art benchmarks using both synthetic and real-world data.
\end{enumerate}

\section{Related work}
\label{sec:lit}
Extensive work focuses on estimating treatment effects
in the static setting \citep[\eg,][]{Johansson2016, Shalit2017, curth2021inductive, Hatt2021b}. In contrast, our work focuses on ITE estimation in the longitudinal setting where, additionally, we observe noisy proxies instead of the true hidden confounders. Hence, we review two streams in the literature that are particularly relevant, namely (i)~methods for ITE estimation in the longitudinal setting that rely on sequential strong ignorability and (ii)~methods that try to control for the hidden confounders. Additional related work is reviewed in 