The algorithm performs SHIR, a novel federated learning approach used for aggregating high dimensional and heterogeneous data from local sites, in order to obtain efficient estimators of the logistic model. SHIR protects individual data through a summary-statistics-based integrating procedure. At each local site, it fits LASSO to derive summary data that is free of the individual level information. Susequently, at the central node, it aggregates the derived statistics at the local sites, and produces the integrative estimator.
Meta-analyzing multiple studies allows for more precise estimates and enables investigation of generalizability. However, in the presence of heterogeneity across studies and high dimensional predictors, such integrative analysis is highly challenging. An major application of such integrative analysis is to develop generalizable predictive models using electronic health records (EHR) data from different hospitals. EHR data is subject to high dimensional features and important privacy constraints. The procedure SHIR protects individual data through summary-statistics-based integrating procedure, accommodates between study heterogeneity in both the covariate distribution and model parameters, and attains consistent variable selection.
At each local site m with indivdual level data (the response vector and design matrix):
we fit lasso:
to obtain the summary data (the sample size, hessian matrix, and gradient):
and transfer them to the center node for integrative analysis.
At the center node, we decompose the coefficients into mean effects and heterogeneous effects:
and fit the quadratic-approximated integrative regression:
to obtain the SHIR estimator. Please see more details from the SHIR paper linked in the citation section.
The development version of this package can be installed from GitHub with:
# install.packages("devtools")
devtools::install_github("celehs/SHIR")Follow the main steps displayed in the example, in which we apply SHIR to a simulated dataset.
Cai, T., Liu, M., & Xia, Y. (2021). Individual data protected integrative regression analysis of high-dimensional heterogeneous data. Journal of the American Statistical Association, (just-accepted), 1-34. https://www.tandfonline.com/doi/abs/10.1080/01621459.2021.1904958