COVID-19 dataset clearinghouse: Difference between revisions

From Polymath Wiki
Jump to navigationJump to search
← Older editNewer edit →
No edit summary
Line 72: Line 72:


* [https://www.kaggle.com/unanimad/corona-virus-brazil Coronavirus (COVID-19) - Brazil Dataset], Kaggle
* [https://www.kaggle.com/unanimad/corona-virus-brazil Coronavirus (COVID-19) - Brazil Dataset], Kaggle
* [https://brasil.io/dataset/covid19/caso COVID-19] (Brazil)
** Boletins informativos e casos do coronavírus por município por dia
* [https://www.geopoll.com/blog/coronavirus-africa/ Coronavirus In Sub-Saharan Africa], Geopoll
* [https://www.geopoll.com/blog/coronavirus-africa/ Coronavirus In Sub-Saharan Africa], Geopoll
* [https://www.health.nsw.gov.au/Infectious/diseases/Pages/covid-19-latest.aspx Latest updates on COVID-19], New South Wales
* [https://www.health.nsw.gov.au/Infectious/diseases/Pages/covid-19-latest.aspx Latest updates on COVID-19], New South Wales
Line 80: Line 82:
** [https://www.gisaid.org/registration/register/ Registration] is required.
** [https://www.gisaid.org/registration/register/ Registration] is required.
** [https://github.com/nextstrain/ncov Nextstrain build for novel coronavirus (nCoV)], based on GISAID data
** [https://github.com/nextstrain/ncov Nextstrain build for novel coronavirus (nCoV)], based on GISAID data
*** A [https://nextstrain.org/ncov Genomic epidemiology of novel coronavirus]
*** A [https://nextstrain.org/ncov Genomic epidemiology of novel coronavirus]  
* [https://www.kaggle.com/paultimothymooney/coronavirus-genome-sequence Coronavirus Genome Sequence], Kaggle
* [https://www.kaggle.com/paultimothymooney/coronavirus-genome-sequence Coronavirus Genome Sequence], Kaggle
* [https://www.kaggle.com/paultimothymooney/repository-of-coronavirus-genomes Repository of Coronavirus Genomes], Kaggle
* [https://www.kaggle.com/paultimothymooney/repository-of-coronavirus-genomes Repository of Coronavirus Genomes], Kaggle
Line 128: Line 130:
* [https://dataforgood.fb.com/tools/disease-prevention-maps/ Disease prevention maps], Facebook
* [https://dataforgood.fb.com/tools/disease-prevention-maps/ Disease prevention maps], Facebook


=== Economic ===
=== Economic and Policy ===


* [https://www.marinetraffic.com/research/measuring-the-coronavirus-impact-on-trade/ Measuring the Coronavirus’ impact on trade], Marine Traffic Research
* [https://www.marinetraffic.com/research/measuring-the-coronavirus-impact-on-trade/ Measuring the Coronavirus’ impact on trade], Marine Traffic Research
* [https://www.top10vpn.com/news/surveillance/covid-19-digital-rights-tracker/ COVID-19 Digital Rights Tracker], Top10VPN


=== Data scrapers and aggregators ===
=== Data scrapers and aggregators ===
Line 172: Line 175:
* [https://docs.google.com/spreadsheets/d/1w4czUYSQ1AfOxw-H3Zei5LZAvNkQrSAGeIu60aeXkZs/edit#gid=0 Possible Covid datasets]
* [https://docs.google.com/spreadsheets/d/1w4czUYSQ1AfOxw-H3Zei5LZAvNkQrSAGeIu60aeXkZs/edit#gid=0 Possible Covid datasets]
* [https://docs.google.com/spreadsheets/d/1N_aVyjQWBzPT_MHiAWyoEqNgX4nKkoU7FznVZpvFTu0/edit#gid=1936591204 COVID-19 Data Providers], Amass Insights
* [https://docs.google.com/spreadsheets/d/1N_aVyjQWBzPT_MHiAWyoEqNgX4nKkoU7FznVZpvFTu0/edit#gid=1936591204 COVID-19 Data Providers], Amass Insights
* [https://alan-turing-institute.github.io/COVID-19_PSTC/ COVID-19 Pandemic Symptom Trackers], Alan Turing Institute


== Data or Data cleaning requests ==
== Data or Data cleaning requests ==
Line 190: Line 194:


Contact: c.strohmeier@math.ucla.edu
Contact: c.strohmeier@math.ucla.edu
 
=== From Juan José Piñero de Armas (U. Católica de Murcia), Mar 27 ===
=== From Juan José Piñero de Armas (U. Católica de Murcia), Mar 27 ===


Revision as of 14:28, 29 March 2020

This is a repository for public data sets relating to the COVID-19 pandemic. It was also initially envisioned as a clearinghouse for matching requests for data cleaning of such datasets with volunteers willing to perform this clearing, but the existing clearinghouse at United against COVID-19 is already up and running for this purpose, so we are redirecting such requests to that site in order not to fragment the pools of requests and volunteers.

For discussion of this project, see this blog post.

Data sets

Further contributions are very welcome, and can be made either directly to this wiki page (after requesting an account), or placed in the comments to this blog post, or by email to tao@math.ucla.edu.

Epidemiology

North America

Europe

Asia

Other regional data

Genomics and homology

Literature

Medical imagery and records

Healthcare, vaccine development and equipment

Social and traffic data

Economic and Policy

Data scrapers and aggregators

Visualizations, projections, summaries

Other lists and groups

Data or Data cleaning requests

As mentioned at the top of this page, future requests for data or data cleaning should be directed to this data discourse page at United Against COVID-19. Below are the legacy requests of this project prior to this redirect.

From Chris Strohmeier (UCLA), Mar 25

The biorxiv_medrxiv file at https://www.kaggle.com/allen-institute-for-ai/CORD-19-research-challenge contains another folder titled biorxiv_medrxiv, which in turn contains hundreds of json files. Each file corresponds to a research article, at least tangentially related to COVID-19.

We are requesting:

  • A tf-idf matrix associated to the subset of the above collection which contain full-text articles (some appear to only have abstracts).
  • The rows should correspond to the (e.g. 5000) most commonly used words.
  • The columns should correspond to each individual json file.
  • The clean data should be stored as a npy or mat file (or both).
  • Finally, there should be a csv or text document (or both) explaining the meaning of the individual rows and columns of the matrix (what words do the rows correspond to? What file does each column correspond to).

Contact: c.strohmeier@math.ucla.edu

From Juan José Piñero de Armas (U. Católica de Murcia), Mar 27

We request information (on a person basis) to perform survival analyses, regressions with random effects, etc. Some data exists for instance at

https://www.kaggle.com/sudalairajkumar/novel-corona-virus-2019-dataset/data https://www.kaggle.com/kimjihoo/coronavirusdataset https://www.kaggle.com/imdevskp/covid-19-analysis-visualization-comparisons/data https://www.sirm.org/category/senza-categoria/covid-19/

but we need much more detail (date when each person was diagnosed, date of infection for the same person, discharge date, date of death, gender, age, treatments, temperatures...) not just summaries or country-aggregated data.

Contact: jjpinero@ucam.edu

Miscellaneous

Retrieved from "https://michaelnielsen.org/polymath/index.php?title=COVID-19_dataset_clearinghouse&oldid=11164"