arXiv reader

Incorporating Auxiliary Variables to Improve the Efficiency of Time-Varying Treatment Effect Estimation

Jieru Shi, Zhenke Wu and Walter Dempsey

arXiv
2306.17260v3 · PDF · 29 March 2025
Categories
stat.ME, math.ST, stat.TH
Licence
CC BY 4.0 The site shows the text.

Abstract

Contextual sensing and delivery of digital interventions to improve health outcomes have gained significant traction in behavioral and psychiatric studies. Micro-randomized trials (MRTs) are a common experimental design for obtaining data-driven evidence on the effectiveness of digital interventions where each individual is repeatedly randomized to receive treatments over numerous time points. Throughout the study, individual characteristics and contextual factors around randomization are collected, with some prespecified as moderators for assessing time-varying causal effect moderation. However, many additional measurements beyond these moderators often go underutilized. Some of these may influence treatment randomization or known to strongly moderate the treatment effect. Incorporating such auxiliary information into the estimation procedure can reduce chance imbalances and improve asymptotic estimation efficiency. In this work, we propose a method to adjust for auxiliary variables in consistently estimating time-varying intervention effects. The approach can also be extended to include post-treatment auxiliary variables when evaluating lagged treatment effects. Under specific conditions, local efficiency gains are guaranteed. We demonstrate the method’s utility through simulation studies and an analysis of data from the Intern Health Study (NeCamp et al., 2020).

Items 14

Assumption

Assumption 2.1 (Identification)

WOFT
  • Consistency: \{Y_{t+\Delta,j} (\bar{A}_{t+\Delta-1,j} ), X_{t,j} (\bar A_{t-1,j}), A_{t,j} (\bar{A}_{t-1,j} )\} = \{Y_{t+1, j}, X_{t,j}, A_{t,j}\}, for each t \leq T and j, i.e., observed values equal the corresponding potential outcomes;

  • Positivity: if the joint density \mathbb{P}\{H_t = h_t\} is greater than zero, then \mathbb{P} (A_t = a \, | \, H_t = h_t ) > 0, a=0,1;

  • Sequential ignorability: For each t \leq T, the potential outcomes \{Y_{t+\Delta}(\bar a_t), X_{t+1}(\bar a_t), A_{t+1}(\bar a_t), \dots, Y_{T+1}(\bar a_T)\} are independent of A_{t} conditional on the observed history H_t.

Assumption

Assumption 3.1

7BIM

Assume the causal excursion effect \beta_{\bf p,\pi}(t+\Delta-1;s) = f_t(s)^\top \beta_0^\star, where f_t(s) \in \mathbb{R}^q is a feature vector comprised of a q-dimensional summary of observed information depending only on state s and decision point t.

Lemma

Lemma 3.2 (Asymptotic Variance Comparison between \hat\beta_{0,t}^{\text{WCLS}} and \hat\beta_{0,t}^{\text{U}})

HK9U

Denote \beta_{1,t}^\star = \Sigma(g_t(H_t))^{-1}\mathbb{E}[Y_{t+1}(A_t-p_t)\tilde g_t(H_t)]\in \mathbb{R}^{d}, where \Sigma(g_t(H_t)) = \mathbb{E}\big[ \tilde g_t(H_t) \tilde g_t(H_t)^\top\big] \in \mathbb{R}^{d\times d}. The difference in the asymptotic variance between the WCLS estimator \hat\beta_{0,t}^{\text{WCLS}} and the unadjusted estimator \hat\beta_{0,t}^{\text{U}} is - p_t (1-p_t) \alpha_{1,t}^{\star\top} \Sigma(g_t(H_t)) \big(\alpha^\star_{1,t}+2(1-2p_t) \beta^\star_{1,t}\big).

Lemma

Lemma 3.3

82CY

Suppose Assumptions 2.1 and 3.1 hold, and the randomization probability p_t is known. Given invertibility and regularity conditions, let (\hat\alpha_{0,t},\hat\alpha_{1,t}, \hat\beta_{0,t}^{\text{L}}, \hat \beta_{1,t}) minimize objective function (?):

  1. \hat\beta_{0,t}^{\text{L}} is consistent and asymptotically normal such that \sqrt{N}(\hat\beta_{0,t}^{\text{L}} - \beta_{0,t}^\star) \rightarrow \mathcal{N}(0,Q_t^{-1}\Sigma_t^{\text{L}} Q_t^{-1}), where Q_t, \Sigma_t^{\text{L}} are defined in Appendix ?;

  2. \hat\beta_{0,t}^{\text{L}} is at least as efficient as \hat\beta_{0,t}^{\text{U}} described in (?), and the asymptotic efficiency gain is

    \frac{\left(\alpha^\star_{1,t}+(1-2p_t) \beta^\star_{1,t}\right)^\top \Sigma(g_t(H_t)) \left(\alpha^\star_{1,t}+(1-2p_t) \beta^\star_{1,t}\right)}{p_t (1-p_t)} + \beta_{1,t}^{\star\top}\Sigma(g_t(H_t))\beta^\star_{1,t};

  3. \hat\beta_{0,t}^{\text{L}} is at least as efficient as \hat\beta_{0,t}^{\text{WCLS}} described in (?), and the asymptotic efficiency gain is \frac{1-3p_t + 3p_t^2}{p_t (1-p_t)} \beta_{1,t}^{\star\top}\Sigma(g_t(H_t))\beta^\star_{1,t}.

Condition

Condition 3.4 (The orthogonality condition)

P63K

For the i-th component of Z_t \in \mathbb{R}^p, denoted Z^i_t \in \mathbb{R}, i=1, \ldots, p, the associated centering function, denoted \mu_t^i (S_t), must satisfy the following orthogonality condition with respect to f_t(S_t) \in \mathbb{R}^q:

\mathbb{E} \Big[ \sum_{t=1}^T \tilde p_t (1| S_t) \big(1 - \tilde p_t (1| S_t)\big) \big(Z^i_t-\mu^i_t(S_t)\big) f_t(S_t) \Big] = \mathbf{0}_{q \times 1}.

where \tilde p_t(1|S_t) = \tilde p_t(A_t=1|S_t) is the numerator of the weight W_t that is an arbitrary function with range (0,1) depending only on S_t.

Example

Example 3.5 (Fully marginal causal effect estimation)

9V5Z

blackConsider estimating the fully marginal causal excursion effect \beta^{\star}_0, where the primary moderator set is null (i.e., S_t = \emptyset and f_t(S_t) = 1). Our goal is to incorporate auxiliary variable Z_t \in \mathbb{R} to improve the estimation. Here we compare three centering function choices: (a) \mu_t =\bar Z_t, (t=1,2,\dots,T), (b) \mu_t=\mu =\bar Z, and (c) \mu_t=\mu = \frac{\sum_{t=1}^T \tilde p_t (1| S_t) (1 - \tilde p_t (1| S_t))Z_t}{\sum_{t=1}^T \tilde p_t (1| S_t) (1 - \tilde p_t (1| S_t))}. Option (a) estimates the time-specific mean \mathbb{E}[Z_t] following the approach introduced by [lin], indicating a correct model specification. It satisfies Equation (?), but involves T estimates, which can be cumbersome when T is large. Option (b), the global mean of the auxiliary variable \{Z_t\}_{t=1}^T, is a scalar centering function but can lead to inconsistent estimates of \beta_0^\star since it does not satisfy Equation (?). Please refer to Appendix ? for an empirical illustration of the biased estimate. Option (c) is a scalar centering function satisfying Equation (?), representing a weighted average of \{Z_t\}_{t=1}^T. In conclusion, option (c) has the desirable characteristics we seek — a low-dimensional centering function that is uniformly applicable across all time points and consistently estimates the causal parameter \beta_0^\star.

Lemma

Lemma 3.6

VAWO

Suppose Assumptions 2.1 and 3.1 hold, centering function \{\mu_t(S_t)\}_{t=1}^T satisfies the Orthogonality Condition 3.4, and that the randomization probability p_t(A_t=1 | H_t) is known. Let (\hat\alpha, \hat\beta_0^{\text{A2}}, \hat \beta_1) minimize objective function (?). Under regularity conditions, \hat\beta_0^{\text{A2}} is consistent and asymptotically normal such that \sqrt{N}(\hat\beta_0^{\text{A2}}-\beta_0^\star) \rightarrow \mathcal{N}(0,Q^{-1}\Sigma^{\text{A2}} Q^{-1}), where Q, \Sigma^{\text{A2}} are defined in Appendix ?.

Lemma

Lemma 3.7

Y3VV

Under the conditions of Lemma 3.6 and the reference treatment probability satisfies \pi_{t+u} = p_{t+u} for all 0 < u \leq \Delta - 1. Assuming \beta_{\bf p,\pi}(t+\Delta-1;s) = f_t(s)^\top \beta_0^\star, and let \hat\beta_0^{\text{A2}} minimize objective function (?). Under regularity conditions, \hat\beta_0^{\text{A2}} is consistent and asymptotically normal such that \sqrt{N}(\hat\beta_0^{\text{A2}}-\beta_0^\star) \rightarrow \mathcal{N}(0,Q^{-1}\Sigma_l^{\text{A2}} Q^{-1}), where Q, \Sigma_l^{\text{A2}} are defined in Appendix ?.

Assumption

Assumption 4.1 (Correct causal model specification)

9L9Z

The true causal effect model \beta_{\bf p,\pi}(t+\Delta-1;H_t)), \Delta \geq 1 is correctly specified in H_t as a linear model.

Assumption

Assumption 4.2 (Exogenous residuals)

O7P0

The residuals in the outcomes and treatments, not accounted for by the observed history, is conditionally independent of the future observations given the complete history.

Theorem

Theorem 4.3

0UHI

For estimating the \Delta-lag causal excursion effect, A2-WCLS offers the following efficiency properties compared to the WCLS estimator [boruvka2018]:

  1. Under the conditions of Lemma 3.6 and Assumptions 4.1 and 4.2, incorporating auxiliary variables via Equation (?) with a known centering function \mu_t(S_t) guarantees an asymptotic efficiency improvement over the WCLS estimator in estimating the moderated causal effect for a given S_t = s, by f_t(s)^\top Q^{-1} \Sigma Q^{-1}f_t(s), where Q, \Sigma are defined in Appendix ?.

  2. Under the conditions of Lemma 3.7 and Assumptions 4.1, if \{l_{t+u}(H_{t+u}, A_{t+u})\}_{u=0}^{\Delta-1} are correctly specified, incorporating post-treatment auxiliary variables via Equation (?) achieves semiparametric efficiency for estimating the \Delta-lag moderated causal effect. The derivative of Equation (?) with respect to \beta_0 is the efficient influence function for \beta_0.

Proposition

Proposition 4.4

EII5

If the auxiliary variables Z_t is conditionally mean independent of the causal excursion effect given S_t, then incorporating them via A2-WCLS yields an estimator with the same asymptotic variance as the standard WCLS estimator [boruvka2018].

Lemma

Lemma 4.5

QWJC

Under the conditions of Lemma 3.6 or Lemma 3.7, if we incorporate auxiliary variables via A2-WCLS with estimated functions \mu_t(S_t,\hat\theta_{\mu}) and l_{t+u}(A_{t+u}, H_{t+u}; \hat\theta_l), where \hat\Theta is obtained from solving U(\Theta) = 0, then \hat\beta^{\text{A2}}_0 is consistent and asymptotically normal such that \sqrt{N}(\hat\beta_0^{\text{A2}}-\beta_0^\star) \rightarrow \mathcal{N}(0,Q^{-1}\tilde\Sigma^{\text{A2}} Q^{-1}), where Q is as defined in Theorem 4.3, and \tilde\Sigma^{\text{A2}} = \mathbb{E}[\tilde U_{\beta_0}(\hat\beta_0;\hat \Theta, \hat\beta_1)^\top\tilde U_{\beta_0}(\hat\beta_0;\hat\Theta, \hat\beta_1)], in which \tilde U_{\beta_0}(\hat\beta_0;\hat \Theta, \hat\beta_1) is obtained as follows:

\tilde U_{\beta_0}(\hat\beta_0;\hat \Theta, \hat\beta_1) = U_{\beta_0}(\hat\beta_0;\hat \Theta, \hat\beta_1) - U(\hat\Theta)\Big(\mathbb{E}\Big[\frac{\partial U(\Theta)}{\partial \Theta} \big\vert_{\Theta = \hat \Theta} \Big]\Big)^{-1}\mathbb{E}\Big[\frac{\partial U_{\beta_0}(\hat\beta_0;\Theta, \hat\beta_1)}{\partial \Theta}\big\vert_{\Theta = \hat \Theta} \Big]^\top.
Condition

Condition L.1 (The orthogonality condition for binary outcomes)

CBII

For a consistent estimation of moderated causal effects, the centering function \mu_t(S_t) must satisfy the following equation:

\mathbb{E} \left[\sum_{t=1}^T W_t e^{-A_t f_t(S_t)^\top \beta_0} Y_{t+1}(1 - e^{-A_t\beta_1 (Z_t-\mu_t(S_t))})(A_t - \tilde p_t)f_t(S_t)\right] = 0

Source and licence

The text on this page is from arXiv:2306.17260v3 by Jieru Shi, Zhenke Wu and Walter Dempsey, under the licence CC BY 4.0. The corpus made these changes: it read the items out of the LaTeX source, it expanded the macros of the paper, it put each proof after its statement, and it converted the text to HTML. The formulas are the TeX of the paper, and KaTeX renders them. A formula or a reference can look different from the PDF. The page is published under CC BY 4.0.

The record of each item is in analysis/objects/2306/2306.17260.jsonl.