TY - JOUR
T1 - Comparing and integrating US COVID-19 data from multiple sources with anomaly detection and repairing
AU - Wang, Guannan
AU - Gu, Zhiling
AU - Li, Xinyi
AU - Yu, Shan
AU - Kim, Myungjin
AU - Wang, Yueying
AU - Gao, Lei
AU - Wang, Li
N1 - Publisher Copyright:
© 2021 Informa UK Limited, trading as Taylor & Francis Group.
PY - 2023
Y1 - 2023
N2 - Over the past few months, the outbreak of Coronavirus disease (COVID-19) has been expanding over the world. A reliable and accurate dataset of the cases is vital for scientists to conduct related research and policy-makers to make better decisions. We collect the United States COVID-19 daily reported data from four open sources: the New York Times, the COVID-19 Data Repository by Johns Hopkins University, the COVID Tracking Project at the Atlantic, and the USAFacts, then compare the similarities and differences among them. To obtain reliable data for further analysis, we first examine the cyclical pattern and the following anomalies, which frequently occur in the reported cases: (1) the order dependencies violation, (2) the point or period anomalies, and (3) the issue of reporting delay. To address these detected issues, we propose the corresponding repairing methods and procedures if corrections are necessary. In addition, we integrate the COVID-19 reported cases with the county-level auxiliary information of the local features from official sources, such as health infrastructure, demographic, socioeconomic, and environmental information, which are also essential for understanding the spread of the virus.
AB - Over the past few months, the outbreak of Coronavirus disease (COVID-19) has been expanding over the world. A reliable and accurate dataset of the cases is vital for scientists to conduct related research and policy-makers to make better decisions. We collect the United States COVID-19 daily reported data from four open sources: the New York Times, the COVID-19 Data Repository by Johns Hopkins University, the COVID Tracking Project at the Atlantic, and the USAFacts, then compare the similarities and differences among them. To obtain reliable data for further analysis, we first examine the cyclical pattern and the following anomalies, which frequently occur in the reported cases: (1) the order dependencies violation, (2) the point or period anomalies, and (3) the issue of reporting delay. To address these detected issues, we propose the corresponding repairing methods and procedures if corrections are necessary. In addition, we integrate the COVID-19 reported cases with the county-level auxiliary information of the local features from official sources, such as health infrastructure, demographic, socioeconomic, and environmental information, which are also essential for understanding the spread of the virus.
KW - Anomaly detection
KW - Coronavirus
KW - count time series
KW - data comparison
KW - data integration
KW - outlier correction
UR - http://www.scopus.com/inward/record.url?scp=85106302225&partnerID=8YFLogxK
U2 - 10.1080/02664763.2021.1928016
DO - 10.1080/02664763.2021.1928016
M3 - Article
AN - SCOPUS:85106302225
SN - 0266-4763
VL - 50
SP - 2408
EP - 2434
JO - Journal of Applied Statistics
JF - Journal of Applied Statistics
IS - 11-12
ER -