Elevate Your Career with AI & Machine Learning For Dummies PRO
Ready to accelerate your career in the fast-growing fields of AI and machine learning? Our app offers user-friendly tutorials and interactive exercises designed to boost your skills and make you stand out to employers. Whether you're aiming for a promotion or searching for a better job, AI & Machine Learning For Dummies PRO is your gateway to success. Start mastering the technologies shaping the future—download now and take the next step in your professional journey!
Download the AI & Machine Learning For Dummies PRO App:
iOS - Android
Our AI and Machine Learning For Dummies PRO App can help you Ace the following AI and Machine Learning certifications:
- AWS Certified AI Practitioner (AIF-C01): Conquer the AWS Certified AI Practitioner exam with our AI and Machine Learning For Dummies test prep. Master fundamental AI concepts, AWS AI services, and ethical considerations.
- Azure AI Fundamentals: Ace the Azure AI Fundamentals exam with our comprehensive test prep. Learn the basics of AI, Azure AI services, and their applications.
- Google Cloud Professional Machine Learning Engineer: Nail the Google Professional Machine Learning Engineer exam with our expert-designed test prep. Deepen your understanding of ML algorithms, models, and deployment strategies.
- AWS Certified Machine Learning Specialty: Dominate the AWS Certified Machine Learning Specialty exam with our targeted test prep. Master advanced ML techniques, AWS ML services, and practical applications.
- AWS Certified Data Engineer Associate (DEA-C01): Set yourself up for promotion, get a better job or Increase your salary by Acing the AWS DEA-C01 Certification.
Data Sciences – Top 400 Open Datasets – Data Visualization – Data Analytics – Big Data – Data Lakes
Data science is an interdisciplinary field that uses scientific methods, processes, algorithms and systems to extract knowledge and insights from structured and unstructured data, and apply knowledge and actionable insights from data across a broad range of application domains.
A dataset is a collection of data, usually presented in tabular form. Good datasets for Data Science and Machine Learning are typically those that are well-structured (easy to read and understand) and large enough to provide enough data points to train a model. The best datasets are often those that are open and freely available – such as the popular Iris dataset. However, there are also many commercial datasets available for purchase. In general, good datasets for Data Science and Machine Learning should be:
- Well-structured
- Large enough to provide enough data points
- Open and freely available whenever possible
In this blog, we are going to provide popular open source and public data sets, data visualization, data analytics and data lakes.
Population Distribution of the World by Continent
Fertility rates all over the world are steadily declining
Yes, fertility rates have been declining globally in recent decades. There are several factors that contribute to this trend, including increased access to education and employment opportunities for women, improved access to family planning and birth control, and changes in societal attitudes towards having children. However, the rate of decline varies significantly by country and region, with some countries experiencing more dramatic declines than others.
The most Daily Wikipedia Page Views in 2022
How Americans Spend Their Money by Generation
Largest countries in the world (by area size)
The Highest Grossing Movies Of All Time
We are still living mostly on gas, oil & coal – Global primary energy consumption by source (TWh)
Consumption vs production based CO2 emissions by country
Largest banks in the world by total assets
Inflation rate and nominal interest rate
Police Killings per Capita v Homicide Rate per Capita for Select OECD Countries
Instagram Rich List 2022 – Which celebrity earns the most in the world in 2022?
Top human-caused threats to birds in the US
Trailblazing Scientists who Shaped our World
Suicide rate among countries with the highest Human Development Index
Percentage of Obesity in 2022
Source: https://worldpopulationreview.com/country-rankings/obesity-rates-by-country
Tools: Datawrapper
Set yourself up for promotion or get a better job by Acing the AWS Certified Data Engineer Associate Exam (DEA-C01) with the eBook or App below (Data and AI)
Download the Ace AWS DEA-C01 Exam App:
iOS - Android
AI Dashboard is available on the Web, Apple, Google, and Microsoft, PRO version
3 largest global payment networks – measured by total payment volume each year ($B)
Stocks Vs Bonds 2022
Most expensive football transfers
11 developing countries with higher life expectancy than the United States
Healthcare expenditure per capita vs life expectancy years
1.2% of adults own 47.8% of world’s wealth
How to Mathematically Win at Rock Paper Scissors
Researchers from IBM, MIT and Harvard Announced The Release Of DARPA “Common Sense AI” Dataset Along With Two Machine Learning Models At ICML 2021
Building machines that can make decisions based on common sense is no easy feat. A machine must be able to do more than merely find patterns in data; it also needs a way of interpreting the intentions and beliefs behind people’s choices.
At the 2021 International Conference on Machine Learning (ICML), Researchers from IBM, MIT, and Harvard University have come together to release a DARPA “Common Sense AI” dataset for benchmarking AI intuition. They are also releasing two machine learning models that represent different approaches to the problem that relies on testing techniques psychologists use to study infants’ behavior to accelerate the development of AI exhibiting common sense.
Source – Summary – Paper – IBM Blog
Largest healthcare services companies in the world
Performance Of FAANG Stocks In 2022 (Apple, Amazon, Google, Meta, Netflix)
100 million protein structures Dataset by DeepMind
Here’s a good article about this topic
Google Dataset Search
Malware traffic dataset
Comprises 1914081 records created from all malware traffic analysis .net PCAP files, from 2013 to 2021. The logs are generated using Suricata and Zeek.
Originator: ali_alwashali
2019 Crime statistics in the USA
Dataset with arrest in US by race and separate states. Download Excel here
Researchers from IBM, MIT and Harvard Announced The Release Of DARPA “Common Sense AI” Dataset Along With Two Machine Learning Models At ICML 2021
Building machines that can make decisions based on common sense is no easy feat. A machine must be able to do more than merely find patterns in data; it also needs a way of interpreting the intentions and beliefs behind people’s choices.
At the 2021 International Conference on Machine Learning (ICML), Researchers from IBM, MIT, and Harvard University have come together to release a DARPA “Common Sense AI” dataset for benchmarking AI intuition. They are also releasing two machine learning models that represent different approaches to the problem that relies on testing techniques psychologists use to study infants’ behavior to accelerate the development of AI exhibiting common sense.
Source – Summary – Paper – IBM Blog
100 million protein structures Dataset by DeepMind
Here’s a good article about this topic
Google Dataset Search
Malware traffic dataset
Comprises 1914081 records created from all malware traffic analysis .net PCAP files, from 2013 to 2021. The logs are generated using Suricata and Zeek.
Originator: ali_alwashali
CPOST dataset on suicide attacks over four decades
The University of Chicago Project on Security and Threats presents the updated and expanded Database on Suicide Attacks (DSAT), which now links to Uppsala Conflict Data Program data on armed conflicts and includes a new dataset measuring the alliance and rivalry relationships among militant groups with connections to suicide attack groups. Access it here.
Credit Card Dataset – Survey of Consumer Finances (SCF) Combined Extract Data 1989-2019
You can do a lot of aggregated analysis in a pretty straightforward way there.
Drone imagery with annotations for small object detection and tracking dataset
11 TB dataset of drone imagery with annotations for small object detection and tracking
Download and more information are available here
Dataset License: CDLA-Sharing-1.0
Helper scripts for accessing the dataset: DATASET.md
Dataset Exploration: Colab
NOAA High-Resolution Rapid Refresh (HRRR) Model
The HRRR is a NOAA real-time 3-km resolution, hourly updated, cloud-resolving, convection-allowing atmospheric model, initialized by 3km grids with 3km radar assimilation. Radar data is assimilated in the HRRR every 15 min over a 1-h period adding further detail to that provided by the hourly data assimilation from the 13km radar-enhanced Rapid Refresh.
When will computers replace humans?
This chart is essentially measuring “How good is a human at a computers’ area of strength”.. meanwhile computers simply can not compete in human areas of strength.
The most popular car brands on Reddit
Fruit Efficient-C Analysis
Registry of Open Data on AWS
This registry exists to help people discover and share datasets that are available via AWS resources. Learn more about sharing data on AWS.
See all usage examples for datasets listed in this registry.
See datasets from Digital Earth Africa, Facebook Data for Good, NASA Space Act Agreement, NIH STRIDES, NOAA Big Data Program, Space Telescope Science Institute, and Amazon Sustainability Data Initiative.
Textbook Question Answering (TQA)
1,076 textbook lessons, 26,260 questions, 6229 images
Documentation: allenai.org/data/tqa
Harmonized Cancer Datasets: Genomic Data Commons Data Portal
The GDC Data Portal is a robust data-driven platform that allows cancer
researchers and bioinformaticians to search and download cancer data for analysis.
The Cancer Genome Atlas
The Cancer Genome Atlas (TCGA), a collaboration between the National Cancer Institute (NCI) and National Human Genome Research Institute (NHGRI), aims to generate comprehensive, multi-dimensional maps of the key genomic changes in major types and subtypes of cancer.
AWS CLI Access (No AWS account required)
aws s3 ls s3://tcga-2-open/ --no-sign-request
Therapeutically Applicable Research to Generate Effective Treatments (TARGET)
The Therapeutically Applicable Research to Generate Effective Treatments (TARGET) program applies a comprehensive genomic approach to determine molecular changes that drive childhood cancers. The goal of the program is to use data to guide the development of effective, less toxic therapies. TARGET is organized into a collaborative network of disease-specific project teams. TARGET projects provide comprehensive molecular characterization to determine the genetic changes that drive the initiation and progression of childhood cancers. The dataset contains open Clinical Supplement, Biospecimen Supplement, RNA-Seq Gene Expression Quantification, miRNA-Seq Isoform Expression Quantification, miRNA-Seq miRNA Expression Quantification data from Genomic Data Commons (GDC), and open data from GDC Legacy Archive. Access it here.
Genome Aggregation Database (gnomAD)
The Genome Aggregation Database (gnomAD) is a resource developed by an international coalition of investigators that aggregates and harmonizes both exome and genome data from a wide range of large-scale human sequencing projects. The summary data provided here are released for the benefit of the wider scientific community without restriction on use. Downloads
SQuAD (Stanford Question Answering Dataset)
Stanford Question Answering Dataset (SQuAD) is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the answer to every question is a segment of text, or span, from the corresponding reading passage, or the question might be unanswerable. Access it here.
PubMed Diabetes Dataset
The Pubmed Diabetes dataset consists of 19717 scientific publications from PubMed database pertaining to diabetes classified into one of three classes. The citation network consists of 44338 links. Each publication in the dataset is described by a TF/IDF weighted word vector from a dictionary which consists of 500 unique words. The README file in the dataset provides more details.
Drug-Target Interaction Dataset
This dataset contains interactions between drugs and targets collected from DrugBank, KEGG Drug, DCDB, and Matador. It was originally collected by Perlman et al. It contains 315 drugs, 250 targets, 1,306 drug-target interactions, 5 types of drug-drug similarities, and 3 types of target-target similarities. Drug-drug similarities include Chemical-based, Ligand-based, Expression-based, Side-effect-based, and Annotation-based similarities. Target-target similarities include Sequence-based, Protein-protein interaction network-based, and Gene Ontology-based similarities. The original task on the dataset is to predict new interactions between drugs and targets based on different types of similarities in the network. Download link
Pharmacogenomics Datasets
PharmGKB data and knowledge is available as downloads. It is often critical to check with their curators at feedback@pharmgkb.org before embarking on a large project using these data, to be sure that the files and data they make available are being interpreted correctly. PharmGKB generally does NOT need to be a co-author on such analyses; They just want to make sure that there is a correct understanding of our data before lots of resources are spent.
Pancreatic Cancer Organoid Profiling
The dataset contains open RNA-Seq Gene Expression Quantification data and controlled WGS/WXS/RNA-Seq Aligned Reads, WXS Annotated Somatic Mutation, WXS Raw Somatic Mutation, and RNA-Seq Splice Junction Quantification. Documentation
AWS CLI Access (No AWS account required)
aws s3 ls s3://gdc-organoid-pancreatic-phs001611-2-open/ --no-sign-request
Africa Soil Information Service (AfSIS) Soil Chemistry
This dataset contains soil infrared spectral data and paired soil property reference measurements for georeferenced soil samples that were collected through the Africa Soil Information Service (AfSIS) project, which lasted from 2009 through 2018. Documentation
AWS CLI Access (No AWS account required)
aws s3 ls s3://afsis/ --no-sign-request
Dataset for Affective States in E-Environments
DAiSEE is the first multi-label video classification dataset comprising of 9068 video snippets captured from 112 users for recognizing the user affective states of boredom, confusion, engagement, and frustration “in the wild”. The dataset has four levels of labels namely – very low, low, high, and very high for each of the affective states, which are crowd annotated and correlated with a gold standard annotation created using a team of expert psychologists. Download it here.
NatureServe Explorer Dataset
NatureServe Explorer provides conservation status, taxonomy, distribution, and life history information for more than 95,000 plants and animals in the United States and Canada, and more than 10,000 vegetation communities and ecological systems in the Western Hemisphere.
The data available through NatureServe Explorer represents data managed in the NatureServe Central Databases. These databases are dynamic, being continually enhanced and refined through the input of hundreds of natural heritage program scientists and other collaborators. NatureServe Explorer is updated from these central databases to reflect information from new field surveys, the latest taxonomic treatments and other scientific publications, and new conservation status assessments. Explore Data here
Flight Records in the US
Airline On-Time Performance and Causes of Flight Delays – On_Time Data.
This database contains scheduled and actual departure and arrival times, reason of delay. reported by certified U.S. air carriers that account for at least one percent of domestic scheduled passenger revenues. The data is collected by the Office of Airline Information, Bureau of Transportation Statistics (BTS).
FlightAware.com has data but you need to pay for a full dataset.
The anyflights
package supplies a set of functions to generate air travel data (and data packages!) similar to nycflights13
. With a user-defined year and airport, the anyflights
function will grab data on:
flights
: all flights that departed a given airport in a given year and monthweather
: hourly meterological data for a given airport in a given year and monthairports
: airport names, FAA codes, and locationsairlines
: translation between two letter carrier (airline) codes and namesplanes
: construction information about each plane found inflights
Airline On-Time Statistics and Delay Causes
The U.S. Department of Transportation’s (DOT) Bureau of Transportation Statistics (BTS) tracks the on-time performance of domestic flights operated by large air carriers. Summary information on the number of on-time, delayed, canceled and diverted flights appears in DOT’s monthly Air Travel Consumer Report, published about 30 days after the month’s end, as well as in summary tables posted on this website. BTS began collecting details on the causes of flight delays in June 2003. Summary statistics and raw data are made available to the public at the time the Air Travel Consumer Report is released. Access it here
Worldwide flight data
Download: airports.dat (Airports only, high quality)
Download: airports-extended.dat (Airports, train stations and ferry terminals, including user contributions)
Flightera.net seems to have a lot of good data for free. It has in-depth data on flights and doesn’t seem limited by date. I can’t speak on the validity of the data though.
flightradar24.com has lots of data, also historically, they might be willing to help you get it in a nice format.
2019 Crime statistics in the USA
Dataset with arrest in US by race and separate states. Download Excel here
You will find more infographics at StatistaResearchers from IBM, MIT and Harvard Announced The Release Of DARPA “Common Sense AI” Dataset Along With Two Machine Learning Models At ICML 2021
Building machines that can make decisions based on common sense is no easy feat. A machine must be able to do more than merely find patterns in data; it also needs a way of interpreting the intentions and beliefs behind people’s choices.
At the 2021 International Conference on Machine Learning (ICML), Researchers from IBM, MIT, and Harvard University have come together to release a DARPA “Common Sense AI” dataset for benchmarking AI intuition. They are also releasing two machine learning models that represent different approaches to the problem that relies on testing techniques psychologists use to study infants’ behavior to accelerate the development of AI exhibiting common sense.
Source – Summary – Paper – IBM Blog
100 million protein structures Dataset by DeepMind
Here’s a good article about this topic
Google Dataset Search
Malware traffic dataset
Comprises 1914081 records created from all malware traffic analysis .net PCAP files, from 2013 to 2021. The logs are generated using Suricata and Zeek.
Originator: ali_alwashali
Author: Here
CPOST dataset on suicide attacks over four decades
The University of Chicago Project on Security and Threats presents the updated and expanded Database on Suicide Attacks (DSAT), which now links to Uppsala Conflict Data Program data on armed conflicts and includes a new dataset measuring the alliance and rivalry relationships among militant groups with connections to suicide attack groups. Access it here.
Credit Card Dataset – Survey of Consumer Finances (SCF) Combined Extract Data 1989-2019
You can do a lot of aggregated analysis in a pretty straightforward way there.
Drone imagery with annotations for small object detection and tracking dataset
11 TB dataset of drone imagery with annotations for small object detection and tracking
Download and more information are available here
Dataset License: CDLA-Sharing-1.0
Helper scripts for accessing the dataset: DATASET.md
Dataset Exploration: Colab
NOAA High-Resolution Rapid Refresh (HRRR) Model
The HRRR is a NOAA real-time 3-km resolution, hourly updated, cloud-resolving, convection-allowing atmospheric model, initialized by 3km grids with 3km radar assimilation. Radar data is assimilated in the HRRR every 15 min over a 1-h period adding further detail to that provided by the hourly data assimilation from the 13km radar-enhanced Rapid Refresh.
Registry of Open Data on AWS
This registry exists to help people discover and share datasets that are available via AWS resources. Learn more about sharing data on AWS.
See all usage examples for datasets listed in this registry.
See datasets from Digital Earth Africa, Facebook Data for Good, NASA Space Act Agreement, NIH STRIDES, NOAA Big Data Program, Space Telescope Science Institute, and Amazon Sustainability Data Initiative.
Textbook Question Answering (TQA)
1,076 textbook lessons, 26,260 questions, 6229 images
Documentation: allenai.org/data/tqa
Harmonized Cancer Datasets: Genomic Data Commons Data Portal
The GDC Data Portal is a robust data-driven platform that allows cancer
researchers and bioinformaticians to search and download cancer data for analysis.
The Cancer Genome Atlas
The Cancer Genome Atlas (TCGA), a collaboration between the National Cancer Institute (NCI) and National Human Genome Research Institute (NHGRI), aims to generate comprehensive, multi-dimensional maps of the key genomic changes in major types and subtypes of cancer.
AWS CLI Access (No AWS account required)
aws s3 ls s3://tcga-2-open/ --no-sign-request
Therapeutically Applicable Research to Generate Effective Treatments (TARGET)
The Therapeutically Applicable Research to Generate Effective Treatments (TARGET) program applies a comprehensive genomic approach to determine molecular changes that drive childhood cancers. The goal of the program is to use data to guide the development of effective, less toxic therapies. TARGET is organized into a collaborative network of disease-specific project teams. TARGET projects provide comprehensive molecular characterization to determine the genetic changes that drive the initiation and progression of childhood cancers. The dataset contains open Clinical Supplement, Biospecimen Supplement, RNA-Seq Gene Expression Quantification, miRNA-Seq Isoform Expression Quantification, miRNA-Seq miRNA Expression Quantification data from Genomic Data Commons (GDC), and open data from GDC Legacy Archive. Access it here.
Genome Aggregation Database (gnomAD)
The Genome Aggregation Database (gnomAD) is a resource developed by an international coalition of investigators that aggregates and harmonizes both exome and genome data from a wide range of large-scale human sequencing projects. The summary data provided here are released for the benefit of the wider scientific community without restriction on use. Downloads
SQuAD (Stanford Question Answering Dataset)
Stanford Question Answering Dataset (SQuAD) is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the answer to every question is a segment of text, or span, from the corresponding reading passage, or the question might be unanswerable. Access it here.
PubMed Diabetes Dataset
The Pubmed Diabetes dataset consists of 19717 scientific publications from PubMed database pertaining to diabetes classified into one of three classes. The citation network consists of 44338 links. Each publication in the dataset is described by a TF/IDF weighted word vector from a dictionary which consists of 500 unique words. The README file in the dataset provides more details.
Drug-Target Interaction Dataset
This dataset contains interactions between drugs and targets collected from DrugBank, KEGG Drug, DCDB, and Matador. It was originally collected by Perlman et al. It contains 315 drugs, 250 targets, 1,306 drug-target interactions, 5 types of drug-drug similarities, and 3 types of target-target similarities. Drug-drug similarities include Chemical-based, Ligand-based, Expression-based, Side-effect-based, and Annotation-based similarities. Target-target similarities include Sequence-based, Protein-protein interaction network-based, and Gene Ontology-based similarities. The original task on the dataset is to predict new interactions between drugs and targets based on different types of similarities in the network. Download link
Pharmacogenomics Datasets
PharmGKB data and knowledge is available as downloads. It is often critical to check with their curators at feedback@pharmgkb.org before embarking on a large project using these data, to be sure that the files and data they make available are being interpreted correctly. PharmGKB generally does NOT need to be a co-author on such analyses; They just want to make sure that there is a correct understanding of our data before lots of resources are spent.
Pancreatic Cancer Organoid Profiling
The dataset contains open RNA-Seq Gene Expression Quantification data and controlled WGS/WXS/RNA-Seq Aligned Reads, WXS Annotated Somatic Mutation, WXS Raw Somatic Mutation, and RNA-Seq Splice Junction Quantification. Documentation
AWS CLI Access (No AWS account required)
aws s3 ls s3://gdc-organoid-pancreatic-phs001611-2-open/ --no-sign-request
Africa Soil Information Service (AfSIS) Soil Chemistry
This dataset contains soil infrared spectral data and paired soil property reference measurements for georeferenced soil samples that were collected through the Africa Soil Information Service (AfSIS) project, which lasted from 2009 through 2018. Documentation
AWS CLI Access (No AWS account required)
aws s3 ls s3://afsis/ --no-sign-request
Dataset for Affective States in E-Environments
DAiSEE is the first multi-label video classification dataset comprising of 9068 video snippets captured from 112 users for recognizing the user affective states of boredom, confusion, engagement, and frustration “in the wild”. The dataset has four levels of labels namely – very low, low, high, and very high for each of the affective states, which are crowd annotated and correlated with a gold standard annotation created using a team of expert psychologists. Download it here.
NatureServe Explorer Dataset
NatureServe Explorer provides conservation status, taxonomy, distribution, and life history information for more than 95,000 plants and animals in the United States and Canada, and more than 10,000 vegetation communities and ecological systems in the Western Hemisphere.
The data available through NatureServe Explorer represents data managed in the NatureServe Central Databases. These databases are dynamic, being continually enhanced and refined through the input of hundreds of natural heritage program scientists and other collaborators. NatureServe Explorer is updated from these central databases to reflect information from new field surveys, the latest taxonomic treatments and other scientific publications, and new conservation status assessments. Explore Data here
Flight Records in the US
Airline On-Time Performance and Causes of Flight Delays – On_Time Data.
This database contains scheduled and actual departure and arrival times, reason of delay. reported by certified U.S. air carriers that account for at least one percent of domestic scheduled passenger revenues. The data is collected by the Office of Airline Information, Bureau of Transportation Statistics (BTS).
FlightAware.com has data but you need to pay for a full dataset.
The anyflights
package supplies a set of functions to generate air travel data (and data packages!) similar to nycflights13
. With a user-defined year and airport, the anyflights
function will grab data on:
flights
: all flights that departed a given airport in a given year and monthweather
: hourly meterological data for a given airport in a given year and monthairports
: airport names, FAA codes, and locationsairlines
: translation between two letter carrier (airline) codes and namesplanes
: construction information about each plane found inflights
Airline On-Time Statistics and Delay Causes
The U.S. Department of Transportation’s (DOT) Bureau of Transportation Statistics (BTS) tracks the on-time performance of domestic flights operated by large air carriers. Summary information on the number of on-time, delayed, canceled and diverted flights appears in DOT’s monthly Air Travel Consumer Report, published about 30 days after the month’s end, as well as in summary tables posted on this website. BTS began collecting details on the causes of flight delays in June 2003. Summary statistics and raw data are made available to the public at the time the Air Travel Consumer Report is released. Access it here
Worldwide flight data
Download: airports.dat (Airports only, high quality)
Download: airports-extended.dat (Airports, train stations and ferry terminals, including user contributions)
Flightera.net seems to have a lot of good data for free. It has in-depth data on flights and doesn’t seem limited by date. I can’t speak on the validity of the data though.
flightradar24.com has lots of data, also historically, they might be willing to help you get it in a nice format.
2019 Crime statistics in the USA
Dataset with arrest in US by race and separate states. Download Excel here
- The global dataset of historical yields for major crops 1981–2016 – The […]
- Hyperspectral benchmark dataset on soil moisture – This dataset was […]
- Lemons quality control dataset – Lemon dataset has been prepared to […]
- Optimized Soil Adjusted Vegetation Index – The IDB is a tool for working […]
- U.S. Department of Agriculture’s Nutrient Database
- U.S. Department of Agriculture’s PLANTS Database – The Complete PLANTS […]
- 1000 Genomes – The 1000 Genomes Project ran between 2008 and 2015, […]
- American Gut (Microbiome Project) – The American Gut project is the […]
- Broad Bioimage Benchmark Collection (BBBC) – The Broad Bioimage Benchmark […]
- Broad Cancer Cell Line Encyclopedia (CCLE)
- Cell Image Library – This library is a public and easily accessible […]
- Complete Genomics Public Data – A diverse data set of whole human genomes […]
- EBI ArrayExpress – ArrayExpress Archive of Functional Genomics Data […]
- EBI Protein Data Bank in Europe – The Electron Microscopy Data Bank […]
- ENCODE project – The Encyclopedia of DNA Elements (ENCODE) Consortium is […]
- Electron Microscopy Pilot Image Archive (EMPIAR) – EMPIAR, the Electron […]
- Ensembl Genomes
- Gene Expression Omnibus (GEO) – GEO is a public functional genomics data […]
- Gene Ontology (GO) – GO annotation files
- Global Biotic Interactions (GloBI)
- Harvard Medical School (HMS) LINCS Project – The Harvard Medical School […]
- Human Genome Diversity Project – A group of scientists at Stanford […]
- Human Microbiome Project (HMP) – The HMP sequenced over 2000 reference […]
- ICOS PSP Benchmark – The ICOS PSP benchmarks repository contains an […]
- International HapMap Project
- Journal of Cell Biology DataViewer [fixme]
- KEGG – KEGG is a database resource for understanding high-level functions […]
- MIT Cancer Genomics Data
- NCBI Proteins
- NCBI Taxonomy – The NCBI Taxonomy database is a curated set of names and […]
- NCI Genomic Data Commons – The GDC Data Portal is a robust data-driven […]
- NIH Microarray data
- OpenSNP genotypes data – openSNP allows customers of direct-to-customer […]
- Palmer Penguins – The goal of palmerpenguins is to provide a great […]
- Pathguid – Protein-Protein Interactions Catalog
- Protein Data Bank – This resource is powered by the Protein Data Bank […]
- Psychiatric Genomics Consortium – The purpose of the Psychiatric Genomics […]
- PubChem Project – PubChem is the world’s largest collection of freely […]
- PubGene (now Coremine Medical) – COREMINE™ is a family of tools developed […]
- Sanger Catalogue of Somatic Mutations in Cancer (COSMIC) – COSMIC, the […]
- Sanger Genomics of Drug Sensitivity in Cancer Project (GDSC)
- Sequence Read Archive(SRA) – The Sequence Read Archive (SRA) stores raw […]
- Stanford Microarray Data
- Stowers Institute Original Data Repository
- Systems Science of Biological Dynamics (SSBD) Database – Systems Science […]
- The Cancer Genome Atlas (TCGA), available via Broad GDAC
- The Catalogue of Life – The Catalogue of Life is a quality-assured […]
- The Personal Genome Project – The Personal Genome Project, initiated in […]
- UCSC Public Data
- UniGene
- Universal Protein Resource (UnitProt) – The Universal Protein Resource […]
- Rfam – The Rfam database is a collection of RNA families, each […]
- Actuaries Climate Index
- Australian Weather
- Aviation Weather Center – Consistent, timely and accurate weather […]
- Brazilian Weather – Historical data (In Portuguese) – Data related to […]
- Canadian Meteorological Centre
- Climate Data from UEA (updated monthly)
- Dutch Weather – The KNMI Data Center (KDC) portal provides access to KNMI […]
- European Climate Assessment & Dataset
- German Climate Data Center
- Global Climate Data Since 1929
- Charting The Global Climate Change News Narrative 2009-2020 – These four […]
- NASA Global Imagery Browse Services
- NOAA Bering Sea Climate [fixme]
- NOAA Climate Datasets
- NOAA Realtime Weather Models
- NOAA SURFRAD Meteorology and Radiation Datasets
- The World Bank Open Data Resources for Climate Change
- UEA Climatic Research Unit
- WU Historical Weather Worldwide
- Wahington Post Climate Change – To analyze warming temperatures in the […]
- WorldClim – Global Climate Data
- 38-Cloud (Cloud Detection) – Contains 38 Landsat 8 scene images and their […]
- AQUASTAT – Global water resources and uses
- BODC – marine data of ~22K vars
- EOSDIS – NASA’s earth observing system data
- Earth Models [fixme]
- Global Wind Atlas – The Global Wind Atlas is a free, web-based […]
- Integrated Marine Observing System (IMOS) – roughly 30TB of ocean measurements
- Marinexplore – Open Oceanographic Data
- Alabama Real-Time Coastal Observing System
- National Estuarine Research Reserves System-Wide Monitoring Program – […]
- Oil and Gas Authority Open Data – The dataset covers 12,500 offshore […]
- Smithsonian Institution Global Volcano and Eruption Database
- USGS Earthquake Archives
- American Economic Association (AEA)
- EconData from UMD
- Economic Freedom of the World Data
- Historical MacroEconomic Statistics
- INFORUM – Interindustry Forecasting at the University of Maryland
- DBnomics – the world’s economic database – Aggregates hundreds of […]
- International Trade Statistics
- Internet Product Code Database
- Joint External Debt Data Hub
- Jon Haveman International Trade Data Links
- Long-Term Productivity Database – The Long-Term Productivity database was […]
- OpenCorporates Database of Companies in the World
- Our World in Data
- SciencesPo World Trade Gravity Datasets [fixme]
- The Atlas of Economic Complexity
- The Center for International Data
- The Observatory of Economic Complexity [fixme]
- UN Commodity Trade Statistics
- UN Human Development Reports
- AMPds – The Almanac of Minutely Power dataset
- BLUEd – Building-Level fUlly labeled Electricity Disaggregation dataset
- COMBED
- DBFC – Direct Borohydride Fuel Cell (DBFC) Dataset
- DEL – Domestic Electrical Load study datsets for South Africa (1994 – 2014)
- ECO – The ECO data set is a comprehensive data set for non-intrusive load […]
- EIA
- Global Power Plant Database – The Global Power Plant Database is a […]
- HES – Household Electricity Study, UK
- HFED
- PEM1 – Proton Exchange Membrane (PEM) Fuel Cell Dataset
- PLAID – The Plug Load Appliance Identification Dataset [fixme]
- The Public Utility Data Liberation Project (PUDL) – PUDL makes US energy […]
- REDD
- SYND – A synthetic energy dataset for non-intrusive load monitoring – […]
- Smart Meter Data Portal – The Smart Meter Data Portal is part of the […]
- Tracebase
- Ukraine Energy Centre Datasets
- UK-DALE – UK Domestic Appliance-Level Electricity
- WHITED
- iAWE
- BIS Statistics – BIS statistics, compiled in cooperation with central […]
- Blockmodo Coin Registry – A registry of JSON formatted information files […]
- CBOE Futures Exchange
- Complete FAANG Stock data – This data set contains all the stock data of […]
- Google Finance
- Google Trends
- NASDAQ [fixme]
- NYSE Market Data
- OANDA
- OSU Financial data [fixme]
- Quandl
- St Louis Federal
- Yahoo Finance
- 10k US Adult Faces Database
- 2GB of Photos of Cats
- Audience Unfiltered faces for gender and age classification
- Affective Image Classification
- Animals with attributes
- CADDY Underwater Stereo-Vision Dataset of divers’ hand gestures – […]
- Cytology Dataset – CCAgT: Images of Cervical Cells with AgNOR Stain […]
- Caltech Pedestrian Detection Benchmark
- Chars74K dataset – Character Recognition in Natural Images (both English […]
- Cube++ – 4890 raw 18-megapixel images, each containing a SpyderCube color […]
- Danbooru Tagged Anime Illustration Dataset – A large-scale anime image […]
- DukeMTMC Data Set – DukeMTMC aims to accelerate advances in multi-target […] [fixme]
- ETH Entomological Collection (ETHEC) Fine Grained Butterfly (Lepidoptra) Images
- Face Recognition Benchmark
- Flickr: 32 Class Brand Logos [fixme]
- GDXray – X-ray images for X-ray testing and Computer Vision
- HumanEva Dataset – The HumanEva-I dataset contains 7 calibrated video […]
- ImageNet (in WordNet hierarchy)
- Indoor Scene Recognition
- International Affective Picture System, UFL
- KITTI Vision Benchmark Suite
- Labeled Information Library of Alexandria – Biology and Conservation – […]
- MNIST database of handwritten digits, near 1 million examples [fixme]
- Multi-View Region of Interest Prediction Dataset for Autonomous Driving – […]
- Massive Visual Memory Stimuli, MIT
- Newspaper Navigator – This dataset consists of extracted visual content […]
- Open Images From Google – Pictures with segmentation masks for 2.8 […]
- RuFa – Contains images of text written in one of two Arabic fonts (Ruqaa […]
- SUN database, MIT
- SVIRO Synthetic Vehicle Interior Rear Seat Occupancy – 25.000 synthetic […]
- Several Shape-from-Silhouette Datasets [fixme]
- Stanford Dogs Dataset
- The Action Similarity Labeling (ASLAN) Challenge
- The Oxford-IIIT Pet Dataset
- Violent-Flows – Crowd Violence / Non-violence Database and benchmark
- Visual genome
- YouTube Faces Database
- Allen Institute Datasets
- Brain Catalogue
- Brainomics
- CodeNeuro Datasets [fixme]
- Collaborative Research in Computational Neuroscience (CRCNS)
- FCP-INDI
- Human Connectome Project
- NDAR
- NIMH Data Archive
- NeuroData
- NeuroMorpho – NeuroMorpho.Org is a centrally curated inventory of […]
- Neuroelectro
- OASIS
- OpenNEURO
- OpenfMRI
- Study Forrest
The largest repository of standardized and structured statistical data
Chess datasets
ML Dataset to practice methods of regression
Center for Machine Learning and Intelligent Systems
ManyTypes4Py: A benchmark Python Dataset for Machine Learning-Based Type Inference
- The dataset is gathered on Sep. 17th 2020 from GitHub.
- It has more than 5.2K Python repositories and 4.2M type annotations.
- Use it to train ML-based type inference model for Python
- Access it here
Quadrature magnetoresistance in overdoped cuprates
Measurements of the normal (i.e. non-superconducting) state magnetoresistance (change in resistance with magnetic field) in several single crystalline samples of copper-oxide high-temperature superconductors. The measurements were performed predominantly at the High Field Magnet Laboratory (HFML) in Nijmegen, the Netherlands, and the Pulsed Magnetic Field Facility (LNCMI-T) in Toulouse, France. Complete Zip Download
The UMA-SAR Dataset: Multimodal data collection from a ground vehicle during outdoor disaster response training exercises
Collection of multimodal raw data captured from a manned all-terrain vehicle in the course of two realistic outdoor search and rescue (SAR) exercises for actual emergency responders conducted in Málaga (Spain) in 2018 and 2019: the UMA-SAR dataset. Full Dataset.
Child Mortality from Malaria
Child mortality numbers caused by malaria by country
Number of deaths of infants, neonatal, and children up to 4 years old caused by malaria by country from 2000 to 2015. Originator: World Health Organization
Quora Question Pairs at Data.world
The dataset will give anyone the opportunity to train and test models of semantic equivalence, based on actual Quora data. 400,000 lines of potential question duplicate pairs. Each line contains IDs for each question in the pair, the full text for each question, and a binary value that indicates whether the line truly contains a duplicate pair. Access it here.
MIMIC Critical Care Database
MIMIC is an openly available dataset developed by the MIT Lab for Computational Physiology, comprising deidentified health data associated with ~60,000 intensive care unit admissions. It includes demographics, vital signs, laboratory tests, medications, and more. Access it here.
Data.Gov: The home of the U.S. Government’s open data
Here you will find data, tools, and resources to conduct research, develop web and mobile applications, design data visualizations, and more. Search over 280000 Datasets.
Tidy Tuesday Dataset
US Census Bureau: QuickFacts Dataset
QuickFacts provides statistics for all states and counties, and for cities and towns with a population of 5,000 or more.
Classical Abstract Art Dataset
Art that does not attempt to represent an accurate depiction of a visual reality but instead use shapes, colours, forms and gestural marks to achieve its effect
5000+ classical abstract art here, real artists with annotation. You can download them in very high resolution, however you would have to crawl them first with this scraper.
Interactive map of indigenous people around the world
Native-Land.ca is a website run by the nonprofit organization Native Land Digital. Access it here.
Data Visualization: A Wordcloud for each of the Six Largest Religions and their Religious Texts (Judaism, Christianity, and Islam; Hinduism, Buddhism, and Sikhism)
Highest altitude humans have been each year since 1961
Worldwide prevalence of drug use
I took the data from IHME’s Global Burden of Disease 2019 study (2019 all-ages prevalence of drug use disorders among both men and women for all countries and territories) and plotted it using R.
Also, what is going on in the US exactly? 3.3% of the population there is addicted and it’s the worst rate in the world.
World Population and Energy Consumption: History and Projections
From the author:
I am working on a presentation and I found a similar graph but couldn’t source it, so I found the data and remade this:
Data:
Population 2010-2019: US Census Bureau via Alexa
Population 2020-2050: World Population Prospects – Population Division – United Nations
File POP/1-1: Total population (both sexes combined) by region, subregion and country, annually for 1950-2100 (thousands)Medium fertility variant, 2020 – 2100
World Energy Consumption: Annual Energy Outlook 2021
Number of Operational Nuclear Reactors by Region over Time
Data from Power Reactor Information System maintained by IAEA.
Countries with reactors in each region:
ASIA-E: China, Japan, South Korea, Taiwan
ASIA-S: India, Pakistan, Bangladesh (under construction)
EUROPE-E & ASIA-CTRL: Armenia, Bulgaria, Belarus, Czechia, Hungary, Kazakhstan, Lithuania, Romania, Russia, Slovenia, Slovakia, Ukraine, Turkey (under construction)
EUROPE-N, S & W: Belgium, Switzerland, Germany, Spain, Finland, France, UK, Italy, Netherlands, Sweden
LATIN AMERICA: Argentina, Brazil, Mexico
MIDDLE EAST: UAE, Iran
SUB-SAHARAN AFRICA: South Africa
USA & CANADA: Canada, USA (obviously)
Made with MATLAB
Edit: If it wasn’t clear, these are nuclear power stations only
source: r/dataisbeautiful
National Household Travel Survey (US)
Conducted by the Federal Highway Administration (FHWA), the NHTS is the authoritative source on the travel behavior of the American public. It is the only source of national data that allows one to analyze trends in personal and household travel. It includes daily non-commercial travel by all modes, including characteristics of the people traveling, their household, and their vehicles. Access it here.
National Travel Survey (UK)
Statistics and data about the National Travel Survey, based on a household survey to monitor trends in personal travel.
The survey collects information on how, why, when and where people travel as well as factors affecting travel (e.g. car availability and driving license holding).
National Travel Survey (NTS)[Canada]
ENTUR: NeTEx or GTFS datasets [Norway]
NeTEx is the official format for public transport data in Norway and is the most complete in terms of available data. GTFS is a downstream format with only a limited subset of the total data, but we generate datasets for it anyway since GTFS can be easier to use and has a wider distribution among international public transport solutions. GTFS sets come in “extended” and “basic” versions. Access here.
The Swedish National Forest Inventory
A subset of the field data collected on temporary NFI plots can be downloaded in Excel format from this web site. The file includes a Read_me sheet and a sheet with field data from temporary plots on forest land1 collected from 2007 to 2019. Note that plots located on boundaries (for example boundaries between forest stands, or different land use classes) are not included in the dataset. The dataset is primarily intended to be used as reference data and validation data in remote sensing applications. It cannot be used to derive estimates of totals or mean values for a geographic area of any size. Download the dataset here
Large data sets from finance and economics applicable in related fields studying the human condition
World Bank Data: Countries Data | Topics Data | Indicators Data | Catalog
Boards of Governors of the Federal Reserve: Data Download Program
CIA: The world Factbook provides basic intelligence on the history, people, government, economy, energy, geography, environment, communications, transportation, military, terrorism, and transnational issues for 266 world entities.
Human Development Report: United Nations Development Programme – Public Data Explorer
Consumer Price Index: The Consumer Price Index (CPI) is a measure of the average change over time in the prices paid by urban consumers for a market basket of consumer goods and services. Indexes are available for the U.S. and various geographic areas. Average price data for select utility, automotive fuel, and food items are also available.
Gapminder.org: Unveiling the beauty of statistics for a fact based world view Watch everyday life in hundreds of homes on all income levels across the world, to counteract the media’s skewed selection of images of other places.
Our world in Data: International Trade
Research and data to make progress against the world’s largest problems: 3139 charts across 297 topics, All free: open access and open source.
International Historical Statistics (by Brian Mitchell)
World Input-Output Database
World Input-Output Tables and underlying data. World Input-Output Tables and underlying data, covering 43 countries, and a model for the rest of the world for the period 2000-2014. Data for 56 sectors are classified according to the International Standard Industrial Classification revision 4 (ISIC Rev. 4).
- Data: Real and PPP-adjusted GDP in US millions of dollars, national accounts (household consumption, investment, government consumption, exports and imports), exchange rates and population figures.
- Geographical coverage: Countries around the world
- Time span: from 1950-2011 (version 8.1)
- Available at: Online
Correlates of War Bilateral Trade
COW seeks to facilitate the collection, dissemination, and use of accurate and reliable quantitative data in international relations. Key principles of the project include a commitment to standard scientific principles of replication, data reliability, documentation, review, and the transparency of data collection procedures
- Data: Total national trade and bilateral trade flows between states. Total imports and exports of each country in current US millions of dollars and bilateral flows in current US millions of dollars
- Geographical coverage: Single countries around the world
- Time span: from 1870-2009
- Available at: Online here
- This data set is hosted by Katherine Barbieri, University of South Carolina, and Omar Keshk, Ohio State University.
World Bank Open Data – World Development Indicators
Free and open access to global development data. Access it here.
World Trade Organization – WTO
The WTO provides quantitative information in relation to economic and trade policy issues. Its data-bases and publications provide access to data on trade flows, tariffs, non-tariff measures (NTMs) and trade in value added.
- Data: Many series on tariffs and trade flows
- Geographical coverage: Countries around the world
- Time span: Since 1948 for some series
- Available at: Online here
SMOKA Science Archive
The Subaru-Mitaka-Okayama-Kiso Archive, holds about 15 TB of astronomical data from facilities run by the National Astronomical Observatory of Japan. All data becomes publicly available after an embargo period of 12-24 months (to give the original observers time to publish their papers).
Graph Datasets
- Web crawl graph with 3.5 billion web pages and 128 billion hyperlinks
- Diverse graphs (Stanford) with up to 1.8 billion edges
- Twitter follower graph (Uni Koblence) with 1.4 billion edges
- Divers graph data sets (Yahoo) including bipartite graphs with 2.2 million edges
- Many web and social graphs with up to 95 billion edges. While this data collection seems to be very comprehensive, it is not trivially accessible without external tool.
- Over 3000 social, biological, web graph data sets with small to large scale (dozens to billions of edges).
- Github project with dozens of graph data sets.
- Brain graphs (among other biological networks) with up to tens of millions of edges.
- Heterogeneous graph data from wolve interactions to co-authorships to social network data.
Multi-Domain Sentiment Dataset
The Multi-Domain Sentiment Dataset contains product reviews taken from Amazon.com from many product types (domains). Some domains (books and dvds) have hundreds of thousands of reviews. Others (musical instruments) have only a few hundred. Reviews contain star ratings (1 to 5 stars) that can be converted into binary labels if needed. Access it here.
A Global Database of Society
Supported by Google Jigsaw, the GDELT Project monitors the world’s broadcast, print, and web news from nearly every corner of every country in over 100 languages and identifies the people, locations, organizations, themes, sources, emotions, counts, quotes, images and events driving our global society every second of every day, creating a free open platform for computing on the entire world.
The Yahoo News Feed: Ratings and Classification Data
Dataset is 1.5 TB compressed, 13.5 TB uncompressed
Yahoo! Music User Ratings of Musical Artists, version 1.0 (423 MB)
Yahoo! Movies User Ratings and Descriptive Content Information, v.1.0 (23 MB)
Yahoo News Video dataset, version 1.0 (645MB)
Other Datasets
More than 1 TB
- The 1000 Genomes project makes 260 TB of human genome data available
- The Internet Archive is making an 80 TB web crawl available for research
- The TREC conference made the ClueWeb09 [3] dataset available a few years back. You’ll have to sign an agreement and pay a nontrivial fee (up to $610) to cover the sneakernet data transfer. The data is about 5 TB compressed.
- ClueWeb12 is now available, as are the Freebase annotations, FACC1
- CNetS at Indiana University makes a 2.5 TB click dataset available
- ICWSM made a large corpus of blog posts available for their 2011 conference. You’ll have to register (an actual form, not an online form), but it’s free. It’s about 2.1 TB compressed. The dataset consists of over 386 million blog posts, news articles, classifieds, forum posts and social media content between January 13th and February 14th. It spans events such as the Tunisian revolution and the Egyptian protests (see http://en.wikipedia.org/wiki/January_2011 for a more detailed list of events spanning the dataset’s time period). Access it here
- The Yahoo News Feed dataset is 1.5 TB compressed, 13.5 TB uncompressed
- The Proteome Commons makes several large datasets available. The largest, the Personal Genome Project , is 1.1 TB in size. There are several others over 100 GB in size.
More than 1 GB
- The Reference Energy Disaggregation Data Set has data on home energy use; it’s about 500 GB compressed.
- The Tiny Images dataset has 227 GB of image data and 57 GB of metadata.
- The ImageNet dataset is pretty big.
- The MOBIO dataset is about 135 GB of video and audio data
- The Yahoo! Webscope program makes several 1 GB+ datasets available to academic researchers, including an 83 GB data set of Flickr image features and the dataset used for the 2020 KDD Cup , from Yahoo! Music, which is a bit over 1 GB.
- Freebase makes regular data dumps available. The largest is their Quad dump , which is about 3.6 GB compressed.
- Wikipedia made a dataset containing information about edits available for a recent Kaggle competition [6]. The training dataset is about 2.0 GB uncompressed.
- The Research and Innovative Technology Administration (RITA) has made available a dataset about the on-time performance of domestic flights operated by large carriers. The ASA compressed this dataset and makes it available for download.
- The wiki-links data made available by Google is about 1.75 GB total.
- Google Research released a large 24GB n-gram data set back in 2006 based on processing 10^12 words of text and published counts of all sequences up to 5 words in length.
Power and Energy Consumption Open Datasets
These data are intended to be used by researchers and other professionals working in power and energy related areas and requiring data for design, development, test, and validation purposes. These data should not be used for commercial purposes.
- Consumption
- Electric Vehicles
- Power Quality
- PV Generation
- Reliability
- Weather Data
- Wind Based Generation
- General Energy Data
- Monthly data on average electricity prices (US)
- Monthly data on average electricity prices (Mexico)
- Monthly data on average electricity prices (Brazil)
- Monthly data on average electricity prices (Europe)
- Monthly data on average electricity prices (Australia)
- Monthly data on average electricity prices (UK)
The Million Playlist Dataset (Spotify)
A dataset and open-ended challenge for music recommendation research ( RecSys Challenge 2018). Sampled from the over 4 billion public playlists on Spotify, this dataset of 1 million playlists consist of over 2 million unique tracks by nearly 300,000 artists, and represents the largest public dataset of music playlists in the world. Access it here
How much each of 20 most popular artists earns from Spotify.
Regression Analysis Cheat Sheet
Hotel Reviews Dataset from Yelp
20k+ Hotel Reviews from Yelp for 5 Star Hotels in Las Vegas.
This dataset can be used for the following applications and more:
Analyzing trends, Sentiment Analysis / Opinion Mining, Sentiment Analysis / Opinion Mining, Competitor Analysis. Access it here.
A truncated version with 500 reviews is also available on Kaggle here
Motorcycle Crash data
1- Texas: Perform specific queries and analysis using Texas traffic crash data.
2- BTS: Motorcycle Rider Safety Data
3- National Transportation Safety Board: US Transportation Fatalities in 2019
4- Fatal single vehicle motorcycle crashes
5- Motorcycle crash causes and outcomes : pilot study
6- Motorcycle Crash Causation Study: Final Report
Natural Disasters – Free News Intelligence Dataset
Download a collection of news articles relating to natural disasters over an eight-month period. Access it here.
World Population Data by Country and Age Group
1- WorldoMeter: Countries in the world by population (2021)
2- Worldometer: Current World Population Live
Top 10 richest billionaires from 1987-2021
Source: Here
World’s Top 80 Wealthiest People by Country of Origin as of November 2021
Source: Here
From the author:
Needless to say, the United States absolutely dominates this list more than any other country. 9 of the top 10 are Americans, you’d have to combine the next 5 countries after the US to match their output of 33 among the top 80, and you’d have to combined every other country not named China on this graph to equal the USA.
To break things down based on region:
– The Americas has 34 individuals on this list with USA (33) and Mexico (1)
– Asia-Pacific has 28 individuals on this list with China (14), India (5), Hong Kong (4), Japan (3), and Australia (2)
– Europe has 18 individuals on this list with France (5), Russia (5), Germany (3), Italy (2), UK (1), Ireland (1), and Spain (1)
How Americans Spend Money on Halloween
Source: here
How the Duration of an Average World Series Baseball Game Has Changed Over 118 Years
Source: Here
Investment-Related Dataset with both Qualitative and Quantitative Variables
1- Numer.ai: Anonymized and feature normalized financial data which is interesting for machine learning applications. Download here
3- Quandl: The premier source for financial, economic and alternative datasets, serving investment professionals.
National Obesity Monitor
The National Health and Nutrition Examination Survey (NHANES) is conducted every two years by the National Center for Health Statistics and funded by the Centers for Disease Control and Prevention. The survey measures obesity rates among people ages 2 and older. Find the latest national data and trends over time, including by age group, sex, and race. Data are available through 2017-2018, with the exception of obesity rates for children by race, which are available through 2015-2016. Access here
The World’s Nations by Fertility Rate 2021
Total number of deaths due to Covid19 vis-à-vis Population in million
Unlike its successor (COVID), SARS only heavily impacted 5 countries.
USA Cigarettes Sold v. Lung Cancer Death Rates
Google searches for different emotions during each hour of the day and night
Where do the world’s CO2 emissions come from? This map shows emissions during 2019. Darker areas indicate areas with higher emissions
Global Linguistic Diversity
Where in the world are the densest forests? Darker areas represent higher density of trees.
Likes and Dislikes per movie genre
Global Historical Climatology Network-Monthly (GHCN-M) temperature dataset
NCEI first developed the Global Historical Climatology Network-Monthly (GHCN-M) temperature dataset in the early 1990s. Subsequent iterations include version 2 in 1997, version 3 in May 2011, and version 4 in October 2018.
Electric power consumption (kWh per capita)
The World’s Most Eco-Friendly Countries
Alternate Source from Wikipedia : List of countries by carbon dioxide emissions per capita
Alcohol-Impaired Driving Deaths by State & County [US]
% change in life expectancy from 2020 to 2021 across the globe
This is how life expectancy is calculated.
How Many Years Till the World’s Reserves Run Out of Oil?
Data Source Here: Note that these values can change with time based on the discovery of new reserves, and changes in annual production.
Which energy source has the least disadvantages?
Here’s a paper on the wind fatalities
Human development index (HDI) by world subdivisions
The Human Development Index (HDI) is a statistic composite index of life expectancy, education (mean years of schooling completed and expected years of schooling upon entering the education system), and per capita income indicators, which are used to rank countries into four tiers of human development.
Data source – subnational human development index website
US Streaming Services Market Share, 2020 vs 2021
Number of tweets deleted by month
Average Career Length by Sports Profession
Source: r/dataisbeautiful
From the author:
Got these numbers from here
Numbers like these are a quick reminder that not every athlete is LeBron James or Roger Federer who can play their sport at such high levels for their entire young adulthood while becoming billionaires in the process. Many careers are short lived and end abruptly while the athlete is still very young and some don’t really have a plan B.
NFL being at the bottom here doesn’t surprise me though as most positions (with the exception of QB and kicker) in US Football is lowkey bodily suicide.
Football/Soccer Leagues with the fairest distributions of money have seen the most growth in long-term global interest.
How Much Does Your Favorite Fast Food Brand Spend on Ads?
Sources:
mcdonald-s-advertising-spending-worldwide/
dominos-pizza-advertising-spending-usa/
advertising-expense-chick-fil-a/
starbucks-advertising-spending-in-the-us
Historical population count of Western Europe
Results from survey on how to best reduce your personal carbon footprint
Data from IpsosMori
Where does the world’s non-renewable energy come from?
The data comes from the Global Power Plant Database. The Global Power Plant Database is a comprehensive, open source database of power plants around the world. It centralizes power plant data to make it easier to navigate, compare and draw insights for one’s own analysis. The database covers approximately 30,000 power plants from 164 countries and includes thermal plants (e.g. coal, gas, oil, nuclear, biomass, waste, geothermal) and renewables (e.g. hydro, wind, solar). Each power plant is geolocated and entries contain information on plant capacity, generation, ownership, and fuel type. It will be continuously updated as data becomes available.
Recorded Music Industry Revenues from 1997 to 2020
Source: riaa.com/
US Trade Surpluses and Deficits by Country (2020)
Facebook Monthly Active Users
Facebook data is based on the end of year from 2004 to 2020
Source: SeeMetrics.com
Heat map of the past 50,000 earthquakes pulled from USGS sorted by magnitude
Source: USGS website
Where do the world’s methane (CH4)emissions come from?
Darker areas indicate areas with higher emissions.
Source: Data comes from EDGARv5.0 website and Crippa et al. (2019)
Earth Surface Albedo (1950 to 2020)
Data Source: ECMWF ERA5
Wealth of Forbes’ Top 100 Billionaires vs All Households in Africa
United nations world population prospects
Credit Suisse Global Wealth Report 2020
20 years of Apple sales in a minute
Source: Wikipedia
Racial Diversity of Each State (Based on US Census 2019 Estimates)
Suppose your state is 60% orc, 30% undead, and 10% tauren. You chance in a random selection of two being of the same race is as follows:
36% chance ((60%)2) of two orcs
9% chance ((30%)2) of two undead
1% chance ((10%)2) of two tauren
For a total of 46%. The diversity index would be 100% minus that, or 54%.
A curated, daily feed of newly published datasets in machine learning
Machine Learning: CIFAR-10 Dataset
A curated, daily feed of newly published datasets in machine learning
The CIFAR-10 dataset consists of 60000 32×32 colour images in 10 classes, with 6000 images per class. There are 50000 training images and 10000 test images.
Machine Learning: ImageNet
The ImageNet dataset contains 14,197,122 annotated images according to the WordNet hierarchy. Since 2010 the dataset is used in the ImageNet Large Scale Visual Recognition Challenge (ILSVRC), a benchmark in image classification and object detection. The publicly released dataset contains a set of manually annotated training images.
Machine Learning: The MNIST Database of Handwritten Digits
The MNIST database of handwritten digits, available from this page, has a training set of 60,000 examples, and a test set of 10,000 examples. It is a subset of a larger set available from NIST. The digits have been size-normalized and centered in a fixed-size image.
It is a good database for people who want to try learning techniques and pattern recognition methods on real-world data while spending minimal efforts on preprocessing and formatting. Access it here.
The Massively Multilingual Image Dataset (MMID)
MMID is a large-scale, massively multilingual dataset of images paired with the words they represent collected at the University of Pennsylvania. The dataset is doubly parallel: for each language, words are stored parallel to images that represent the word, and parallel to the word’s translation into English (and corresponding images.) . Dcumentation.
AWS CLI Access (No AWS account required)
aws s3 ls s3://mmid-pds/ --no-sign-request
Capitol insurrection arrests per million people by state
How have cryptocurrencies done during the Pandemic?
Data Source: Downloaded performance data on these cryptocurrencies from Investing.com which provides free historic data
Share of US Wealth by Generation
Source: US Federal Reserve
Top 100 Cryptocurrencies by Market Cap
Data Source from coinmarketcap.com/
Crypto race: DOGE vs BTC, last 365 days
Data sources: Coindesk BTC, Coindesk Dodge
12,000 years of human population dynamics
Countries with a higher Human Development Index (HDI) than the European Union (EU)
HDI is calculated by the UN every year to measure a country’s development using average life expectancy, education level, and gross national income per capita (PPP). The EU has a collective HDI of 0.911.
Data Source: Here
Countries with a higher Human Development Index (HDI) than the United States (US)
Data source: Human Development Report 2020
Child marriage by country, by gender
Data on the percentage of children married before reaching adulthood (18 years).
Data source The State of the World’s Children 2019
Wars with greater than 25,000 deaths by year
Data Source : Wikipedia
Population Projection for China and India till 2050
Data Source: Here
Relative cumulative and per capita CO2 emissions 1751-2017
Dat Source: ourworldindata.org
Formula 1 Cumulative Wins by Team (1950-2021)
Data Source : f1-fansite.com/f1-results/
Countries with the most nuclear warheads. A couple of days ago I posted this with a logarithmic scale.
Data source: Wikipedia
Using machine learning methods to group NFL quarterbacks into archetypes
Data Source:
Data collected from a series of rushing and passing statistics for NFL Quarterbacks from 2015-2020 and performed a machine learning algorithm called clustering, which automatically sorts observations into groups based on shared common characteristics using a mathematical “distance metric.”
The idea was to use machine learning to determine NFL Quarterback Archetype to agnostically determine which quarterbacks were truly “mobile” quarterbacks, and which were “pocket passers” that relied more on passing. I used a number of metrics in my actual clustering analysis, but they can be effectively summarized across two dimensions: passing and rushing, which can be further roughly summarized across two metrics: passer rating and rushing yards per year. Plotting the quarterbacks along these dimensions and plotting the groups chosen by the clustering methodology shows how cleanly the methodology selected the groups.
Read this blog article on the process for more information if you’re interested, or just check out this blog in general if you found this interesting!
Data: Collected from the ESPN API
2M rows of 1-min S&P bars (12 years of stock data) – 2008-2021
Intraday Stock Data (1 min) – S&P 500 – 2008-21: 12 years of 1 minute bars for data science / machine learning.
Granular stock bar data for research is difficult to find and expensive to buy. The author has compiled this library from a variety of sources and is making it available for free.
One compressed CSV file with 9 columns and 2.07 million rows worth of 1 minute SPY bars. Access it here
A global database of COVID-19 vaccinations
Datasets: A live version of the vaccination dataset and documentation are available in a public GitHub repository here. These data can be downloaded in CSV and JSON formats. PDF.
A list of available datasets for machine learning in manufacturing
Industrial ML Datasets: curated list of datasets, publicly available for machine learning researches in the area of manufacturing.
Predictive Maintenance and Condition Monitoring
Name | Year | Feature Type | Feature Count | Target Variable | Instances | Official Train/Test Split | Data Source | Format |
---|
Diesel Engine Faults Features | 2020 | Signal | 84 | C (4) | 3.500 | Synthetic | MAT | Link |
Process Monitoring
Name | Year | Feature Type | Feature Count | Target Variable | Instances | Official Train/Test Split | Data Source | Format | |
---|---|---|---|---|---|---|---|---|---|
High Storage System Anomaly Detection | 2018 | Signal | 20 | C (2) | 91.000 | Synthetic | CSV | Link |
Predictive Quality and Quality Inspection
Name | Year | Feature Type | Feature Count | Target Variable | Instances | Official Train/Test Split | Data Source | Format | |
---|---|---|---|---|---|---|---|---|---|
Casting Product Quality Inspection | 2020 | Image | 300×300 512×512 | C (2) | 7.348 | ✔️ | Real | JPG | Link |
Process Parameter Optimization
Name | Year | Feature Type | Feature Count | Instances | Official Train/Test Split | Data Source | Format | |
---|---|---|---|---|---|---|---|---|
Laser Welding | 2020 | Signal | 13 | 361 | Real | XLS | Link |
Data Analytics Certification Questions and Answers Dumps
Datasets needed for Crop Disease Identification using image processing
Here is a collection of datasets with images of leaves
and more generic image datasets that include plant leaves
One hundreds plant species datasets
A Database of Leaf Images: Practice towards Plant Conservation with Plant Pathology
Survival Analysis datasets for machines
English alphabet organized by each letter’s note in ABC
Discover datasets hosted in thousands of repositories across the Web using datasetsearch.research.google.com
Create, maintain, and contribute to a long-living dataset that will update itself automatically across projects.
Datasets should behave like git repositories.
Learn how to create, maintain, and contribute to a long-living dataset that will update itself automatically across projects, using git and DVC as versioning systems, and DAGsHub as a host for the datasets.
Human Rights Measurement Initiative Datasets
World Wide Energy Production by Source 1860 – 2019
[OC] World Wide Energy Production by Source 1860 – 2019 from dataisbeautiful
Data source: ourworldindata.org/energy
Project Sunroof – Solar Electricity Generation Potential by Census Tract/Postal Code
Courtesy of Google’s Project Sunroof: This dataset essentially describes the rooftop solar potential for different regions, based on Google’s analysis of Google Maps data to find rooftops where solar would work, and aggregate those into region-wide statistics.
It comes in a couple of aggregation flavors – by census tract , where the region name is the census tract id, and by postal code , where the name is the postal code. Each also contains latitude/longitude bounding boxes and averages, so that you can download based on that, and you should be able to do custom larger aggregations using those, if you’d like.
Carbon emission arithmetic + hard v. soft science
carbon emission arithmetic + hard v. soft science [oc] from dataisbeautiful
Data sources: Video From data-driven documentary The Fallen of World War II. Here and Here
Most popular Youtuber in every country 2021
What Does 1GB of Mobile Data Cost in Every Country?
Key Concepts of Data Science
A large dataset aimed at teaching AI to code, it consists of some 14M code samples and about 500M lines of code in more than 55 different programming languages, from modern ones like C++, Java, Python, and Go to legacy languages like COBOL, Pascal, and FORTRAN.
NSRDB: National Solar Radiation Database
Download instructions are here
Cheat Sheet for Machine Learning, Data Science.
Emigrants from the UK by Destination
Data source: Originally at the location marked on the Sankey Flow but is now here
Direct link to the spreadsheet used
US Rivers and Streams Dataset
Data source: hub.arcgis.com/
Bubble Chart that compares the GDP of the G20 Countries
Data source: databank.worldbank.org
Desktop OS Market Share 2003 – 2021
[OC] Desktop OS Market Share 2003 – 2021 from dataisbeautiful
Data source: w3school
National Parks of North America
Data Source: DataBayou
NPS.gov, Open.canada.ca, and sig.conanp.gob.mx
Inflation of Bitcoin and DogeCoin vs. Federal Reserve target
Data source:
Percentage of women who experienced physical or sexual violence since the age of 15 in the EU
Data Source from The Guardian:
The whole report – Questionnaire
Canadian Interprovincial Migration
Some context here
Data scraped from StatsCan
Covid-19 Vaccination Doses Administered per 100 in the G20
Data source: ourworldindata.org covid-vaccinations
What does per 100 mean?
When the whole country is double vaccinated, the value will be 200 doses per 100 population. At the moment the UK is like 85, which is because ~70% of the population has had at least one dose and ~15% of the population (which is a subset of that 70%) have had two. Hence ~30% are currently unprotected – myself included until Sunday.
Import/Export of Conventional Arms by Different Countries over past 2 decades
DataSource: SIPRI Arms Transfer Database
Aggregated disease comparison dataset – Ensemble de données agrégées de comparaison des maladies
According to the author of the source data: “For the 1918 Spanish Flu, the data was collected by knowing that the total counts were 500M cases and 50M deaths, and then taking a fraction of that per day based on the area of this graph image:” – the graph is used is here:
Visualización y conjunto de datos de comparación de enfermedades agregadas
Trending Google Searches by State Between 2018 and 2020 – Tendances des recherches Google par État
Data source: trends.google.com Trending topics from 2010 to 2019 were taken from Google’s annual Year in Search summary 2010-2029
The full, ~11 minute video covering the whole 2010s decade is available here at youtu.be/xm91jBeN4oo
Google Trends provides weekly relative search interest for every search term, along with the interest by state. Using these two datasets for each term, we’re able to calculate the relative search interest for every state for a particular week. Linear interpolation was used to calculate the daily search interest.
Market capitalization in billion dollars of Top 20 Cryptocurrencies in 2021-05-20 – crypto-monnaies
Data source: CoinMarket from end of 2013 until present
Capitalisation boursière en milliards de dollars des 20 principales crypto-monnaies en 2021-05-20
Top Chess Players From 2000-2020, Meilleurs joueurs d’échecs, Лучшие шахматисты с 2000 по 2020 год
Data source: ratings.fide.com/
The y-axis is the world elo ratings (called FIDE ratings).
Comparing Emissions Sources – How to Shrink your Carbon Footprint More Effectively
Data sources: Here
Source article: Here
Oil and gas-fired power plants in the world –
La dependencia de los combustibles fósiles – La dépendance aux énergies fossiles –
Data is from the Global Power Plant Database (World Resources Institute)
Top 100 Reddit posts of all time
Source: r/all on Reddit
Tool used: meta-chart.com
Fastest routes on land (and sometimes, boat) between all 990 pairs of European capitals
Las rutas más rápidas en tierra (y, a veces, en barco) entre los 990 pares de capitales europeas
Les itinéraires les plus rapides sur terre (et parfois en bateau) entre les 990 paires de capitales européennes
Source: Reddit
From the author: I started with data on roads from naturalearth.com, which also includes some ferry lines. I then calculated the fastest routes (assuming a speed of 90 km/h on roads, and 35 km/h on boat) between each pair of 45 European capitals. The animation visualizes these routes, with brighter lines for roads that are more frequently “traveled”.
In reality these are of course not the most traveled roads, since people don’t go from all capitals to all other capitals in equal measure. But I thought it would be fun to visualize all the possible connections.
The model is also very simple, and does not take into account varying speed limits, road conditions, congestion, border checks and so on. It is just for fun!
In order to keep the file size manageable, the animation only shows every tenth frame.
Is Russia, Turkey or country X really part of Europe? That of course depends on the definition, but it was more fun to include them than to exclude them! The Vatican is however not included since it would just be the same as the Rome routes. And, unfortunately, Nicosia on Cyprus is not included to due an error on my behalf. It should be!
Link to final still image in high resolution on my twitter
Pokemon Dataset
- Dataset of all 825 Pokemon (this includes Alolan Forms). It would be preferable if there are at least 100 images of each individual Pokemon.
pokedex: This is a Python library slash pile of data containing a whole lot of data scraped from Pokémon games. It’s the primary guts of veekun.
2) This dataset comprises of more than 800 pokemons belonging up to 8 generations.
Using this dataset have been fun for me. I used it to create a mosaic of pokemons taking image as reference. You can find it here and it’s free to use: Couple Mosaic (powered by Pokemons)
Here is the data type information in the file:
- Name: Pokemon Name
- Type: Type of Pokemon like Grass / Fire / Water etc..,.
- HP: Hit Points
- Attack: Attack Points
- Defense: Defence Points
- Sp. Atk: Special Attack Points
- Sp. Def: Special Defence Points
- Speed: Speed Points
- Total: Total Points
- url: Pokemon web-page
- icon: Pokemon Image
Data File: Pokemon-Data.csv
30×30 m Worldwide High-Resolution Population and Demographics Data
ETL pipeline for Facebook’s research project to provide detailed large-scale demographics data. It’s broken down in roughly 30×30 m grid cells and provides info on groups by age and gender.
Data Source and API for access
Article about Dataset at Medium
Gridded global datasets for Gross Domestic Product and Human Development Index over 1990–2015
Rasterized GDP dataset – basically a heat map of global economic activity.
Gap-filled multiannual datasets in gridded form for Gross Domestic Product (GDP) and Human Development Index (HDI)
Decrease in worldwide infant mortality from 1950 to 2020
Data Sources: United Nations, CIA World Factbook, IndexMundi.
Countries of the world sorted by those that have warmed the most in the last 10 years, showing temperatures from 1890 to 2020
Data source: Gistemp temperature data
The GISS Surface Temperature Analysis ver. 4 (GISTEMP v4) is an estimate of global surface temperature change. Graphs and tables are updated around the middle of every month using current data files from NOAA GHCN v4 (meteorological stations) and ERSST v5 (ocean areas), combined as described in our publications Hansen et al. (2010) and Lenssen et al. (2019).
Climate change concern vs personal spend to reduce climate change
Data Source: Competitive Enterprise Institute (PDF)
Less than 20 firms produce over a third of all carbon emissions
The Illusion of Choice in Consumer Brands
Buying a chocolate bar? There are seemingly hundreds to choose from, but its just the illusion of choice. They pretty much all come from Mars, Nestlé, or Mondelēz (which owns Cadbury).
Source: Visual Capitalist
Yearly Software Sales on PlayStation Consoles since 1994
Some context for these numbers :
- PS4 holds the record for being the console to have sold the most games in video game history (> 1.622B units)
- Previous record holder was PS2 at 1.537B games sold
- PS4 holds the record for having sold the most games in a single year (> 300M units in FY20)
- FY20 marks the biggest yearly software sales in PlayStation ecosystem with more than 338M units
- Since PS5 release, Sony starts combining PS4/PS5 software sales
- In FY12, Sony combined PS2/PS3 and PSP/VITA software sales
- Sony stopped disclosing software sales in FY13/14
- Source: Sony’s financial results
Yearly Hardware Sales of PlayStation Consoles since 1994
Sony combined PS2/PS3 hardware sales in FY12 and combined PSP/VITA sales in FY12/13/14
- Source: Sony’s financial results
Cybertruck vs F150 Lightning pre-orders, by time since debut
Source: Ford exec tweeting about preorder numbers this week
Top 100 Most Populous City Proper in the world
The City with 32 million is Chongqing, Shan is Shanghai, Beijin is Beijing, and Guangzho is Guangzhou
Tax data for different countries
What do Europeans feel most attached to – their region, their country, or Europe?
Data source: Builds on data from the 2021 European Quality of Government Index. You can read more about the survey and download the data here
Cost of 1gb mobile data in every country
Dataset: Visual Capitalist
Frequency of all digrams in 18 languages, diacritics included
Dataset (according to author): Dictionaries are scattered on the internet and had to be borrowed from several sources: the Scrabble3d project, and Linux spellcheck dictionaries. The data can be found in the folder “Avec_diacritiques”.
Criteria for choosing a dictionary:
– No proper nouns
– “Official” source if available
– Inclusion of inflected forms
– Among two lists, the largest was fancied
– No or very rare abbreviations if possible- but hard to detect in unknown languages and across hundreds of thousands of words.
Mapped: The World’s Nuclear Reactor Landscape
Dataset: Visual Capitalist
Database of 999 chemicals based on liver-specific carcinogenicity
The author found this dataset in a more accessible format upon searching for the keyword “CDPB” (Carcinogenic Potency Database) in the National Library of Medicine Catalog. Check out this parent website for the data source and dataset description. The dataset referenced in OP’s post concerns liver specific carcinogens, which are marked by the “liv” keyword as described in the dataset description’s Tissue Codes section.
SMS Spam Collection Data Set
Download: Data Folder, Data Set Description
The SMS Spam Collection is a public set of SMS labeled messages that have been collected for mobile phone spam research
Open Datasets for Autonomous Driving
A2D2 Dataset – ApolloScape Dataset – Argoverse Dataset – Berkeley DeepDrive Dataset
CityScapes Dataset – Comma2k19 Dataset – Google-Landmarks Dataset
KITTI Vision Benchmark Suite – LeddarTech PixSet Dataset – Level 5 Open Data – nuScenes Dataset
Oxford Radar RobotCar Dataset – PandaSet – Udacity Self Driving Car Dataset – Waymo Open Dataset
Open Dataset people are looking for [Help if you can]
- Looking for Dataset on the outcomes of abstinence-only sex education.
- Funny Datasets for School Data Science Project [1, 2, 3, 4, 5]
- Need a dataset for English practicing chatbot. [1, 2 ]
- Creating a dataset for plant disease recognition [1, 2 ]
- Central Bank Speeches Dataset (Text data from 1997 to 2020 from 118 institutions) [1, 2]
- Cat Meow Classification dataset [1, 2]
- Looking for Raw Data: Camping / Outdoors Travel in United States trends, etc [1, 2 ]
- Looking for Data set of horse race results / lottery results any results related to gambling [1, 2, 3]
- Looking for Football (Soccer) Penalties Dataset [1, 2]
- Looking for public datasets on baseball [1, 2, 3]
- Looking for Datasets on edge computing for AI bandwidth usage, latency, memory, CPU/GPU resource usage? [1 ,2 ]
- Data set of people who died by suicide [1, 2 ]
- Supreme Court dataset with opinion text? [1, 2, 3, 4, https://storage.googleapis.com/scotus-db/scotus-db.db5]
- Dataset of employee attrition or turnover rate? [1, 2]
- Is there a Dataset for homophobic tweets? [1 ,2, 3, 4, ]
- Looking for a Machine condition Monitoring Dataset [1,2]
- Where to find data for credit risk analysis? [1, 2]
- Datasets on homicides anywhere in the world [1, 2]
- Looking for a dataset containing coronavirus self-test (if this is a thing globally) pictures for ML use
- Is there any transportation dataset with daily frequency? [1, 2]
- A Dataset of film Locations [1, 2 ]
- Looking for a classification dataset [1, 2, 3, 4, 5]
- Where can I search for macroeconomics data? [1, 2, 3, 4, 5, 6, 7]
- Looking for Beam alignment 5G vehicular networks dataset
- Looking for tidy dataset for multivariate analysis (PCA, FA, canonical correlations, clustering)
- Indian all types of Fuel location datasets [1, 2,]
- Spotify Playlists Dataset [1, 2]
- World News Headline Dataset. With Sentiment Scores. Free download in JSON format. Updated often. [1, 2]
- Are there any free open source recipe datasets for commercial use [1, 2, 3, 4, 5]
- Curated social network datasets with summary statistics and background info
- Looking for textile crop disease datasets such as jute, flax, hemp
- Shopify App Store and Chrome Webstore Datasets
- Looking for dataset for university chatbot
- Collecting real life (dirty/ugly) datasets for data analysis
- In Need of Food Additive/Ingredient Definition Database
- Recent smart phone sensor Dataset – Android
- Cracked Mobile Screen Image Dataset for Detection
- Looking for Chiller fault data in a chiller plant
- Looking for dataset that contains the genetic sequences of native plasmids?
- Looking for a dataset containing fetus size measurements at various gestational ages.
- Looking for datasets about mental health since 2021
- Do you know where to find a dataset with Graphical User Interfaces defects of web applications? [1, 2, 3 ]
- Looking for most popular accounts on social medias like Twitter, Tik Tok, instagram, [1, 2, 3]
- GPS dataset of grocery stores
- What is the easiest way to bulk download all of the data from this epidemiology website? (~20,000 files)
- Looking for Dataset on Percentage of death by US state and Canadian province grouped by cause of death?
- Looking for Social engineering attack dataset in social media
- Steam Store Games (Clean dataset) by Nik Davis
- Dataset that lists all US major hospitals by county
- Another Data that list all US major hospitals by county
- Looking for open source data relating privacy behavior or related marketing sets about the trustworthiness of responders?
- Looking for a dataset that tracks median household income by country and year
- Dataset on the number of specific surgical procedures performed in the US (yearly)
- Looking for a dataset from reddit or twitter on top posts or tweets related to crypto currency
- Looking for Image and flora Dataset of All Known Plants, Trees and Shrubs
- US total fertility rates data one the state level
- Dataset of Net Worth of *World* Politicians
- Looking for water wells and borehole datasets
- Looking for Crop growth conditions dataset
- Dataset for translate machine JA-EG
- Looking for Electronic Health Record (EHR) record prices
- Looking for tax data for different countries
- Musicians Birthday Datasets and Associated groups
- Searching for dataset related to car dealerships [1]
- Looking for Credit Score Approval dataset
- Cyberbullying Dataset by demographics
- Datasets on financial trends for minors
- Data where I can find out about reading habits? [1, 2]
- Data sets for global technology adoption rates
- Looking for any and all cat / feline cancer datasets, for both detection and treatment
- ITSM dictionary/taxonomy datasets for topic modeling purposes
- Multistage Reliability Dataset
- Looking for dataset of ingredients for food[1]
- Looking for datasets with responses to psychological questionnaires[1,2,3]
- Data source for OEM automotive parts
- Looking for dataset about gene regulation
- Customer Segmentation Datasets (For LTV Models)
- Automobile dataset, years of ownership and repairs
- Historic Housing Prices Dataset for Individual Houses
- Looking for the data for all the tokens on the Uniswap graph
- Job applications emails datasets, either rejection, applications or interviews
- E-learning datasets for impact on e learning on school/university students
- Food delivery dataset (Uber Eats, Just Eat, …)
- Data Sets for NFL Quarterbacks since 1995
- Medicare Beneficiary Population Data
- Covid 19 infected Cancer Patients datasets
- Looking for EV charging behavior dataset
- State park budget or expansionary spending dataset
- Autonomous car driving deaths dataset
- FMCG Spending habits over the pandemic
- Looking for a Question Type Classification dataset
- 20 years of Manufacturer/Retail price of Men’s footwear
- Dataset of Global Technology Adoption Rates
- Looking For Real Meeting Transcripts Dataset
- Dataset For A Large Archive Of Lyrics [1,2,3]
- Audio dataset with swearing words
- A global, georeferenced event dataset on electoral violence with lethal outcomes from 1989 to 2017. [1,]
- Looking for Jaundice Dataset for ML model
- Looking for social engineering attack detection dataset?
- Wound image datasets to train ML model [1]
- Seeking for resume and job post dataset
- Labelled dataset (sets of images or videos) of human emotions [1,2]
- Dataset of specialized phone call transcripts
- Looking for Emergency Response Plan Dataset for family Homes, condo buildings and Companies
- Looking for Birthday wishes datasets
- Desperately in need of national data for real estate [1,2,]
- NFL playoffs games stadium attendance dataset
- Datasets with original publication dates of novels [1,2]
- Annotated Documents with Images Data Dump
- Looking for dataset for “Face Presentation Attack Detection”
- Electric vehicle range & performance dataset [1, 2]
- Dataset or API with valid postal codes for US, Mexico, and Canada with country, state/province, and city/town [1, 2, 3, 4, 5, 6]
- Looking for Data sources regarding Online courses dropout rate, preferably by countries [1,2 ]
- Are there dataset for language learning [1, 2]
- Corporate Real Estate Data [1,2, 3]
- Looking for simple clinical trials datasets [1, 2]
- CO2 Emissions By Aircraft (or Aircraft Type) – Climate Analysis Dataset [1,2, 3, 4]
- Player Session/playtime dataset from games [1,2]
- Data sets that support Data Science (Technology, AI etc) being beneficial to sustainability [1,2]
- Datasets of a grocery store [1,2]
- Looking for mri breast cancer annotation datasets [1,2]
- Looking for free exportable data sets of companies by industry [1,2]
- Datasets on Coffee Production/Consumption [1,2]
- Video gaming industry datasets – release year, genre, games, titles, global data [1,2]
- Looking for mobile speaker recognition dataset [1,2]
- Public DMV vehicle registration data [1,2]
- Looking for historical news articles based on industry sector [1,2]
- Looking for Historical state wide Divorce dataset [1,2]
- Public Big Datasets – with In-Database Analytics [1,2]
- Dataset for detecting Apple products (object detection) [1,2]
- Help needed to get the American Hospital Association (AHA) datasets (AHA Annual Survey, AHA Financial Database, and AHA IT Survey datasets) [1, 2]
- Looking for help Getting College Football Betting Data [1,2]
- 2012-2020 US presidential election results by state/city dataset [1,2, 3]
- Looking for datasets of models and images captured using iphone’s LIDAR? [1,2]
- Finding Datasets to Age Texts (Newspapers, Books, Anything works) [1, 2, 3]
- Looking for cost of living index of some type for US [1,2]
- Looking for dataset that recorded historical NFT prices and their price increases, as well as timestamps. [1,2]
- Looking for datasets on park boundaries across the country [1, 2, 3]
- Looking for medical multimodal datasets [1, 2, 3]
- Looking for Scraped Parler Data [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]
- Looking for Silicon Wafer Demand dataset [1, 2]
- Looking for a dataset with the values [Gender – Weight – Height – Health] [1, 2]
- Exam questions (mcqs and short answer) datasets? [1, 2]
- Canada Botanical Plants API/Database [1, 2, 3]
- Looking for a geospatial dataset of birds Migration path [1, 2, 3]
- WhatsApp messages dataset/archives [1, 2]
- Dataset of GOOD probiotic microorganisms in the HUMAN gut [1, 2]
- Twitter competition to reduce bias in its image cropping [1,2]
- Dataset: US overseas military deployments, 1950–2020 [1,2]
- Dataset on human clicking on desktop [1,2]
- Covid-19 Cough Audio Classification Dataset [1, 2]
- 12,000+ known superconductors database [1, 2, 3]
- Looking for good dataset related to cyber security for prediction [1, 2]
- Where can I find face datasets to classify whether it is a real person or a picture of that person. For authentication purposes? [1,2]
- DataSet of Tokyo 2020 (2021) Olympics ( details about the Athletes, the countries they representing, details about events, coaches, genders participating in each event, etc.) [1, 2]
- What is your workflow for budget compute on datasets larger than 100GB? [1, 2, 3]
Looking for a dataset that contains information about cryptocurrencies. [1, 2
Looking for a depression dataset [1,2, 3]
- Looking for chocolate consumer demographic data [1,2, 3]
- Looking for thorough dataset of housing price/tax history [1, 2, 3]
- Wallstreetbets data scraping from 01/01/2020 to 01/06/2021 [1, 2]
- Retinal Disease Classification Dataset [1, 2]
- 400,000 years of CO2 and global temperature data [1, 2, 3]
- Looking for datasets on neurodegenerative diseases [1, 2, 3]
- Dataset for Job Interviews (either Phone, Online, or Physical) [1,2 ,3]
- Firm Cyber Breach Dataset with Firm Identifiers [1, 2, 3]
- Wondering how Stock market and Crypto website get the Data from [1, 2, 3, 4, 5]
- Looking for a dataset with US tourist injuries, attacks, and/or fatalities when traveling abroad [1, 2, 3]
- Looking for Wildfires Database for all countries by year and month? The quantity of wildfires happening, the acreage, things like that, etc.. [1, 2, 3, ]
- Looking for a pill vs fake pill image dataset [1, 2, 3, 4, 5, 6, 7]
Cars for sale in Germany from 2011 to 2021
Dataset obtained scraping AutoScout. In the file, you will find features describing 46405 vehicles: mileage, make, model, fuel, gear, offer type, price, horse power, registration year.
Dataset scraped from AutoScout24 with information about new and used cars.
Percentage of female students in higher education by subject area
The data was obtained from the UK government website here , so unfortunately there are some things I’m unaware of regarding data and methodology.
All the passes: A visualization of ~1 million passes from 890 matches played in major football/soccer leagues/cups
- Champion League 1999
- FA Women’s Super League 2018
- FIFA World Cup 2018, La Liga 2004 – 2020
- NWSL 2018
- Premier League 2003 – 2004
- Women’s World Cup 2019
Data Source: StatsBomb
Global “Urbanity” Dataset (using population mosaics, nighttime lights, & road networks
In this project, the authors have designed a spatial model which is able to classify urbanity levels globally and with high granularity. As the target geographic support for our model we selected the quadkey grid in level 15, which has cells of approximately 1x1km at the equator.
Dataset: Here
Percentage of students with disabilities in higher education by subject area
The author obtained the data from the UK Government website, so unfortunately don’t know the methodology or how they collected the data etc.
The comparison to the general public is a great idea – according to the Government site, 6% of children, 16% of working-age adults and 45% of Pension-age adults are disabled.
Dataset: here
Arrests for Hate Crimes in NYC by Category, 2017-2020
The Most Successful U.S. Sports Franchises
Data source: sports-reference.com/
Adult cognitive skills (PIAAC literacy and numeracy) by Percentile and by country
According to the author , this animation depicts adult cognitive skills, as measured by the PIAAC study by OECD. Here, the numeracy and literacy skills have been combined into one. Each frame of the animation shows the xth percentile skill level of each individual country. Thus, you can see which countries have the highest and lowest scores among their bottom performers, median performers, and top performers. So for example, you can see that when the bottom 1st percentile of each country is ranked, Japan is at the top, Russia is second, etc. Looking at the 50th percentile (median) of each country, Japan is top, then Finland, etc.
Programme for the International Assessment of Adult Competencies (PIAAC) is a study by OECD to measure measured literacy, numeracy, and “problem-solving in technology-rich environments” skills for people ages 16 and up. For those of you who are familiar with the school-age children PISA study, this is essentially an adult version of it.
Dataset: PIAAC
G7 Corporate Tax rate 1980 – 2020
Dataset: Tax Foundation
Euro 2020 (played in 2021) Group Stage Predictions Based of a Bayesian Linear Item Response Model
Data Source: UEFA qualifying match data
The model was built in Stan and was inspired by Andrew Gelman’s World Cup model shown here. These plots show posterior probabilities that the team on the y axis will score more goals than the team on the x axis. There is some redundancy of information here (because if I know P(England beats Scotland) then I know P(Scotland beats England) )
Data
Source: Italian National Institute of Statistics (Istituto Nazionale di Statistica)
The 15 most shared musicians on Reddit
Data source: The authors made a dataset of YouTube and Spotify shares on Reddit. More info available here
Spam vs. Legitimate Email, Average Global Emails per Day
Data Source: Here. The author computed the average per day over the June 3 – June 9, 2021 period.
Falling Fertility, 1800–2016
Data source: Here (go to the “Babies per woman,” “Income,” and “Population” links on that page).
Europe Covid-19 waves
Data Source: Here
Who is going to win EURO 2020? Predicted probabilities pooled together from 18 sources
Data source: Here
Population Density of Canada 2020
DataSet: Gathered from worldpop.org/project
The greater the length of each spike correlates to greater population density.
The portion of a country’s population that is fully vaccinated for COVID (as of June 2021) scales with GDP per capita.
Dataset of Chemical reaction equations
4- Chemistry datasets
Maths datasets
1111 2222 3333 Equation Learning
Datasets for Stata Structural Equation Modeling
SQL Queries Dataset
SEDE (Stack Exchange Data Explorer) is a dataset comprised of 12,023 complex and diverse SQL queries and their natural language titles and descriptions, written by real users of the Stack Exchange Data Explorer out of a natural interaction. These pairs contain a variety of real-world challenges which were rarely reflected so far in any other semantic parsing dataset. Access it here
Countries of the world, ranked by population, with the 100 largest cities in the world marked
Each map size is proportional to population, so China takes up about 18-19% of the map space.
Countries with very far-flung territories, such as France (or the USA) will have their maps shrunk to fit all territories. So it is the size of the map rectangle that is proportional to population, not the colored area. Made in R, using data from naturalearthdata.com. Maps drawn with the tmap package, and placed in the image with the gridExtra package. Map colors from the wesanderson package.
Data source: The Economist
What businesses in different countries search for when they look for a marketing agency – “creative” or “SEO”?
Data source: Google Trends
More maps, charts and written analysis on this topic here
Is the economic gap between new and old EU countries closing?
Data source: Eurostat
Interactive version so you can click on those circles here
Reddit r/wallstreetbets posts and comments in real-time
- Beneath adds some useful features for shared data, like the ability to run SQL queries, sync changes in real-time, a Python integration, and monitoring. The monitoring is really useful as it lets you check out the write activity of the scraper (no surprise, WSB is most active when markets are open
- The scraper (which uses Async PRAW) is open source here
Global NO2 pollution data visualization June 2021
Data Source: SILAM
Shopify App Store Report: 2021
Data source: Marketplace Apps
The Chrome Webstore Report: 2021
Data source: Marketplace Apps
Percentage of Adults with HIV/AIDS in Africa
Dataset: All the countries through the UN AIDS organization
Recorded CDC deaths (2014 – June 16, 2021) from Symptoms, signs and abnormal clinical and laboratory findings, not elsewhere classified (R00-R99)
Data Source: combined CDC weekly death counts 2014 – 2019 and CDC weekly death counts 2020-2021
What are the long term gains on cryptocurrencies?
Data Sources: investing.com and coingecko.com
The chart shows the average daily gain in $ if $100 were invested at a date on x-axis. Total gain was divided by the number of days between the day of investing and June 13, 2021. Gains were calculated on average 30-day prices.
Time range: from March 28, 2013, till June 13, 2021
Life Expectancy and Death Probability by Age and Gender
Data source: Here
Daily Coronavirus cases in Canada vs % of Population Vaccinated
Google Playstore Apps with 2.3million app data on Kaggle
Google Playstore dataset is now available with double the data (2.3 Million) android application data and a new attribute stating the scraped date time in Kaggle.
Dataset: Get it here or here
African languages dataset
We have 3000 tribes or more in Africa and in that 3000 we have sub tribes.
1– Introduction to African Languages (Harvard)
2- Languages of the world at Ethnologue
3- Britannica: Nilo-Saharan Laguages
4- Britannica: Khoisan Languages
Daily Temperature of Major Cities Dataset
Daily average temperature values recorded in major cities of the world.
The dataset is available as separate txt files for each city here. The data is available for research and non-commercial purposes only
Do stricter gun laws reduce firearms homicides?
Data Sources: Guns to Carry, EFSGV, CDC
According to the author: Looking at non-suicide firearms deaths by state (2019), and then grouping by the Guns to Carry rating (1-5 stars), it seems that stricter gun laws are correlated with fewer firearms homicides. Guns to Carry rates states based on “Gun friendliness” with 1 star being least friendly (California, for example), and 5 stars being most friendly (Wyoming, for example). The ratings aren’t perfect but they include considerations like: Permit required, Registration, Open carry, and Background checks to come up with a rating.
The numbers at the bottom are the average non-suicide deaths calculated within the rating group. Each bar shows the number for the individual state.
Interesting that DC is through the roof despite having strict laws. On the flip side, Maine is very friendly towards gun owners and has a very low homicide rate, despite having the highest ratio of suicides to homicides.
Obviously, lots of things to consider and this is merely a correlation at a basic level. This is a topic that interested me so I figured I’d share my findings. Not attempting to make a policy statement or anything.
Relative frequency of words in economics textbooks vs their frequency in mainstream English (the Google Books corpus)
Data Source: Data for word frequency in the Google corpus is from the 2019 Ngram dataset. For details about how to work with this data, see Working With Google Ngrams: A Data-Wrangling Tale.
Data for word frequency in econ textbooks was compiled by myself by scraping words from 43 undergraduate economics textbooks. For details see Deconstructing Econospeak.
Hours per day spent on mobile devices by US adults
Author: nava_7777
Data Source: from eMarketer, as quoted byJon Erlichman
Purpose according to the author: raw textual numbers (like in the original tweet) are hard to compare, particularly the acceleration or deceleration of a trend. Did for myself, but maybe is useful to somebody.
Environmental Impact of Coffee Brewing Methods
Author: Coffee_Medley
More according to the author:
Measurements and calculations of NG and Electricity used to heat four cups of distilled water by Coffee Medley (6/14/2021)
Average coffee bag and pod weight by Coffee Medley (6/14/2021)
Murders in major U.S. Cities: 2019 vs. 2020
Author: datacanbeuseful
Data source: NPR
New Harvard Data (Accidentally) Reveal How Lockdowns Crushed the Working Class While Leaving Elites Unscathed
Data source: Harvard
Support for same-sex marriage by religious group
Data source: PEW
More: Summary of religiously (un)affiliated people’s views on homosexuality, broken down into 18 countries
Daily chance of dying for Americans
Author: NortherSugarLoaf
Data source: SSA Actuarial Data,
Processing: Yearly probability of death is converted to the daily probability and expressed in micromorts. Plotted versus age in years.
According to the author,
A few things to notice: It’s dangerous to be a newborn. The same mortality rates are reached again only in the fifties. However, mortality drops after birth very quickly and the safest age is about ten years old. After experiencing mortality jump in puberty – especially high for boys, mortality increases mostly exponentially with age. Every thirty years of life increase chances of dying about ten times. At 80, chance of dying in a year is about 5.8% for males and 4.3% for females. This mortality difference holds for all ages. The largest disparity is at about twenty three years old when males die at a rate about 2.7 times higher than females.
This data is from before COVID.
Here is the same graph but in linear Y axis scale
Here is the male to female mortality ratio
Mapping Global Carbon Emission Intensity (Dec 2020)
Data Source: Copernicus Atmosphere Monitoring Service (CAMS)
Religions with the most Adherents from 1945 – 2010
IPO Returns 2000-2020
IPO Returns 2000-2020
IPO Returns 2000-2020
Total number of streams per artist vs. number of Top 200 hits (Spotify Top 200 since 2017)
Author: blairfix
Data is from the Spotify Top 200 and covers the period from Jan. 1, 2017 to Jun. 9, 2021. You can download my dataset here.
For every artist that appears in the Top 200, I add up their total streams (for all songs) and the total number of songs in the dataset.
For a commentary on the data, see The Half Life of a Spotify Hit.
Number of Miss Americas by U.S. State
Data Source: Wikipedia
The World’s Nuclear Warheads
Author: academiadvice
Data Source: Federation of American Scientists – status-world-nuclear-forces/
Tools: Excel, Datawrapper, coolors.co/
Check out the FAS site for notes and caveats about their estimates. Governments don’t just print this stuff on their websites. These are evidence-based estimates of tightly-guarded national secrets.
Of particular note – Here’s what the FAS says about North Korea: “After six nuclear tests, including two of 10-20 kilotons and one of more than 150 kilotons, we estimate that North Korea might have produced sufficient fissile material for roughly 40-50 warheads. The number of assembled warheads is unknown, but lower. While we estimate North Korea might have a small number of assembled warheads for medium-range missiles, we have not yet seen evidence that it has developed a functioning warhead that can be delivered at ICBM range.”
The population of Las Vegas over time
Data Source: Wikipedia
The Alpha to Omega of Wikipedia
Author: feldesque
Data Source: The wikipediatrend package in R
Glacial Inter-glacial cycles over the past 450000 years
Source: geology.utah.gov/
Global temperature change from 1850-2020
Top Companies Contributing to Open Source – 2011/2021
Source and links
The author used several sources for this video and article. The first, for the video, is GitHub Archive & CodersRank. For the analysis of the OSCI index data, the author used opensourceindex.io
Crime Rates in the US: 1960-2021
Data source: Here
2021 is straight projections, must be taken with a grain of salt. However, the assumption of continuous rise of murder rate is not a bad one based on recent news reports, such as: here
In a property crime, a victim’s property is stolen or destroyed, without the use or threat of force against the victim. Property crimes include burglary and theft as well as vandalism and arson.
A network visualization of privacy research (83k nodes, 462k edges)
Author: FvDijk
This image was generated for my research mapping the privacy research field. The visual is a combination of network visualisation and manual adding of the labels.
The data was gathered from Scopus, a high-quality academic publication database, and the visualisation was created with Gephi. The initial dataset held ~120k publications and over 3 million references, from which we selected only the papers and references in the field.
The labels were assigned by manually identifying clusters and two independent raters assigning names from a random sample of publications, with a 94% match between raters.
The scripts used are available on Github:
The full paper can be found on the author’s website:
GDP (at purchasing power parity) per capita in international dollars
Author: Simaniac
Data source: IMF
Phone Call Anxiety dataset for Millennials and Gen Z
Author: /u/CynicalScyntist
This is a randomized experiment the author conducted with 450 people on Amazon MTurk. Each person was randomly assigned to one of three writing activities in which they either (a) described their phone, (b) described what they’d do if they received a call from someone they know, or (c) describe what they’d do if they received a call from an unknown number. Pictures of an iPhone with a corresponding call screen were displayed above the text box (blank, “Incoming Call,” or “Unknown”). Participants then rated their anxiety on a 1-4 scale.
Dataset: Here
Hate Crime Statistics in New York State 2019-2021
Active Hydrating Toner, Anti-Aging Replenishing Advanced Face Moisturizer, with Vitamins A, C, E & Natural Botanicals to Promote Skin Balance & Collagen Production, 6.7 Fl Oz
Age Defying 0.3% Retinol Serum, Anti-Aging Dark Spot Remover for Face, Fine Lines & Wrinkle Pore Minimizer, with Vitamin E & Natural Botanicals
Firming Moisturizer, Advanced Hydrating Facial Replenishing Cream, with Hyaluronic Acid, Resveratrol & Natural Botanicals to Restore Skin's Strength, Radiance, and Resilience, 1.75 Oz
Skin Stem Cell Serum
Smartphone 101 - Pick a smartphone for me - android or iOS - Apple iPhone or Samsung Galaxy or Huawei or Xaomi or Google Pixel
Can AI Really Predict Lottery Results? We Asked an Expert.
Djamgatech
Read Photos and PDFs Aloud for me iOS
Read Photos and PDFs Aloud for me android
Read Photos and PDFs Aloud For me Windows 10/11
Read Photos and PDFs Aloud For Amazon
Get 20% off Google Workspace (Google Meet) Business Plan (AMERICAS): M9HNXHX3WC9H7YE (Email us for more)
Get 20% off Google Google Workspace (Google Meet) Standard Plan with the following codes: 96DRHDRA9J7GTN6(Email us for more)
FREE 10000+ Quiz Trivia and and Brain Teasers for All Topics including Cloud Computing, General Knowledge, History, Television, Music, Art, Science, Movies, Films, US History, Soccer Football, World Cup, Data Science, Machine Learning, Geography, etc....
List of Freely available programming books - What is the single most influential book every Programmers should read
- Bjarne Stroustrup - The C++ Programming Language
- Brian W. Kernighan, Rob Pike - The Practice of Programming
- Donald Knuth - The Art of Computer Programming
- Ellen Ullman - Close to the Machine
- Ellis Horowitz - Fundamentals of Computer Algorithms
- Eric Raymond - The Art of Unix Programming
- Gerald M. Weinberg - The Psychology of Computer Programming
- James Gosling - The Java Programming Language
- Joel Spolsky - The Best Software Writing I
- Keith Curtis - After the Software Wars
- Richard M. Stallman - Free Software, Free Society
- Richard P. Gabriel - Patterns of Software
- Richard P. Gabriel - Innovation Happens Elsewhere
- Code Complete (2nd edition) by Steve McConnell
- The Pragmatic Programmer
- Structure and Interpretation of Computer Programs
- The C Programming Language by Kernighan and Ritchie
- Introduction to Algorithms by Cormen, Leiserson, Rivest & Stein
- Design Patterns by the Gang of Four
- Refactoring: Improving the Design of Existing Code
- The Mythical Man Month
- The Art of Computer Programming by Donald Knuth
- Compilers: Principles, Techniques and Tools by Alfred V. Aho, Ravi Sethi and Jeffrey D. Ullman
- Gödel, Escher, Bach by Douglas Hofstadter
- Clean Code: A Handbook of Agile Software Craftsmanship by Robert C. Martin
- Effective C++
- More Effective C++
- CODE by Charles Petzold
- Programming Pearls by Jon Bentley
- Working Effectively with Legacy Code by Michael C. Feathers
- Peopleware by Demarco and Lister
- Coders at Work by Peter Seibel
- Surely You're Joking, Mr. Feynman!
- Effective Java 2nd edition
- Patterns of Enterprise Application Architecture by Martin Fowler
- The Little Schemer
- The Seasoned Schemer
- Why's (Poignant) Guide to Ruby
- The Inmates Are Running The Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity
- The Art of Unix Programming
- Test-Driven Development: By Example by Kent Beck
- Practices of an Agile Developer
- Don't Make Me Think
- Agile Software Development, Principles, Patterns, and Practices by Robert C. Martin
- Domain Driven Designs by Eric Evans
- The Design of Everyday Things by Donald Norman
- Modern C++ Design by Andrei Alexandrescu
- Best Software Writing I by Joel Spolsky
- The Practice of Programming by Kernighan and Pike
- Pragmatic Thinking and Learning: Refactor Your Wetware by Andy Hunt
- Software Estimation: Demystifying the Black Art by Steve McConnel
- The Passionate Programmer (My Job Went To India) by Chad Fowler
- Hackers: Heroes of the Computer Revolution
- Algorithms + Data Structures = Programs
- Writing Solid Code
- JavaScript - The Good Parts
- Getting Real by 37 Signals
- Foundations of Programming by Karl Seguin
- Computer Graphics: Principles and Practice in C (2nd Edition)
- Thinking in Java by Bruce Eckel
- The Elements of Computing Systems
- Refactoring to Patterns by Joshua Kerievsky
- Modern Operating Systems by Andrew S. Tanenbaum
- The Annotated Turing
- Things That Make Us Smart by Donald Norman
- The Timeless Way of Building by Christopher Alexander
- The Deadline: A Novel About Project Management by Tom DeMarco
- The C++ Programming Language (3rd edition) by Stroustrup
- Patterns of Enterprise Application Architecture
- Computer Systems - A Programmer's Perspective
- Agile Principles, Patterns, and Practices in C# by Robert C. Martin
- Growing Object-Oriented Software, Guided by Tests
- Framework Design Guidelines by Brad Abrams
- Object Thinking by Dr. David West
- Advanced Programming in the UNIX Environment by W. Richard Stevens
- Hackers and Painters: Big Ideas from the Computer Age
- The Soul of a New Machine by Tracy Kidder
- CLR via C# by Jeffrey Richter
- The Timeless Way of Building by Christopher Alexander
- Design Patterns in C# by Steve Metsker
- Alice in Wonderland by Lewis Carol
- Zen and the Art of Motorcycle Maintenance by Robert M. Pirsig
- About Face - The Essentials of Interaction Design
- Here Comes Everybody: The Power of Organizing Without Organizations by Clay Shirky
- The Tao of Programming
- Computational Beauty of Nature
- Writing Solid Code by Steve Maguire
- Philip and Alex's Guide to Web Publishing
- Object-Oriented Analysis and Design with Applications by Grady Booch
- Effective Java by Joshua Bloch
- Computability by N. J. Cutland
- Masterminds of Programming
- The Tao Te Ching
- The Productive Programmer
- The Art of Deception by Kevin Mitnick
- The Career Programmer: Guerilla Tactics for an Imperfect World by Christopher Duncan
- Paradigms of Artificial Intelligence Programming: Case studies in Common Lisp
- Masters of Doom
- Pragmatic Unit Testing in C# with NUnit by Andy Hunt and Dave Thomas with Matt Hargett
- How To Solve It by George Polya
- The Alchemist by Paulo Coelho
- Smalltalk-80: The Language and its Implementation
- Writing Secure Code (2nd Edition) by Michael Howard
- Introduction to Functional Programming by Philip Wadler and Richard Bird
- No Bugs! by David Thielen
- Rework by Jason Freid and DHH
- JUnit in Action
#BlackOwned #BlackEntrepreneurs #BlackBuniness #AWSCertified #AWSCloudPractitioner #AWSCertification #AWSCLFC02 #CloudComputing #AWSStudyGuide #AWSTraining #AWSCareer #AWSExamPrep #AWSCommunity #AWSEducation #AWSBasics #AWSCertified #AWSMachineLearning #AWSCertification #AWSSpecialty #MachineLearning #AWSStudyGuide #CloudComputing #DataScience #AWSCertified #AWSSolutionsArchitect #AWSArchitectAssociate #AWSCertification #AWSStudyGuide #CloudComputing #AWSArchitecture #AWSTraining #AWSCareer #AWSExamPrep #AWSCommunity #AWSEducation #AzureFundamentals #AZ900 #MicrosoftAzure #ITCertification #CertificationPrep #StudyMaterials #TechLearning #MicrosoftCertified #AzureCertification #TechBooks
Top 1000 Canada Quiz and trivia: CANADA CITIZENSHIP TEST- HISTORY - GEOGRAPHY - GOVERNMENT- CULTURE - PEOPLE - LANGUAGES - TRAVEL - WILDLIFE - HOCKEY - TOURISM - SCENERIES - ARTS - DATA VISUALIZATION
Top 1000 Africa Quiz and trivia: HISTORY - GEOGRAPHY - WILDLIFE - CULTURE - PEOPLE - LANGUAGES - TRAVEL - TOURISM - SCENERIES - ARTS - DATA VISUALIZATION
Exploring the Pros and Cons of Visiting All Provinces and Territories in Canada.
Exploring the Advantages and Disadvantages of Visiting All 50 States in the USA
Health Health, a science-based community to discuss health news and the coronavirus (COVID-19) pandemic
- Sustainable Practices for Your Child’s Oral Health - Tooth Fairy: Best Pediatric Child Dental Clinic In Hyderabadby /u/NoCalligrapher6445 on November 5, 2024 at 4:57 am
submitted by /u/NoCalligrapher6445 [link] [comments]
- RFK Jr. and Trump want fluoride out of water. What does the mineral do?by /u/globalnewsca on November 4, 2024 at 10:36 pm
submitted by /u/globalnewsca [link] [comments]
- The Deaths and Agonies of Trump’s Abortion Bansby /u/marji80 on November 4, 2024 at 10:06 pm
submitted by /u/marji80 [link] [comments]
- Seven Hours of Sleep Is the New Eight, Expert Saysby /u/SscorpionN08 on November 4, 2024 at 8:46 pm
submitted by /u/SscorpionN08 [link] [comments]
- Is election anxiety keeping you awake? Sleep experts share adviceby /u/scientificamerican on November 4, 2024 at 7:39 pm
submitted by /u/scientificamerican [link] [comments]
Today I Learned (TIL) You learn something new every day; what did you learn today? Submit interesting and specific facts about something that you just found out here.
- TIL Patrick Swayze’s Vietnam draft lottery number of 141 was called in 1970, but he quite probably avoided the draft due to a career ending knee injury he received while playing high school football.by /u/LadyWarrior73 on November 5, 2024 at 5:13 am
submitted by /u/LadyWarrior73 [link] [comments]
- TIL that in 2023, a massive Greenland landslide shook the Earth for nine days, baffling scientists. A huge rock-ice avalanche hit a fjord, creating a global seismic "hum" detected worldwide. The impact's repetitive pulses kept the planet vibrating for days.by /u/ahmadreza777 on November 5, 2024 at 3:59 am
submitted by /u/ahmadreza777 [link] [comments]
- TIL that ancient Egyptians had a pregnancy test using wheat and barley. Women would urinate on bags of wheat and barley, and if the grains sprouted, it was considered a positive pregn aresult. Studies in the 20th century showed this method was surprisingly accurate due to hormonal changes.by /u/nitintomar269 on November 5, 2024 at 3:25 am
submitted by /u/nitintomar269 [link] [comments]
- TIL The beautiful sand beaches of the Maldives are made out of up to 85% poo by the Parrot fish. One Parrot fish alone can create up to 500kg of sand per year!by /u/wolkenjaeger on November 5, 2024 at 3:12 am
submitted by /u/wolkenjaeger [link] [comments]
- TIL that Arches National Park in Utah has a rock column known as The Phallusby /u/A_Mirabeau_702 on November 5, 2024 at 12:43 am
submitted by /u/A_Mirabeau_702 [link] [comments]
Reddit Science This community is a place to share and discuss new scientific research. Read about the latest advances in astronomy, biology, medicine, physics, social science, and more. Find and submit new publications and popular science coverage of current research.
- Iron-lowering drug could accelerate brain function decline for people with Alzheimer'sby /u/SilverDragon1 on November 5, 2024 at 5:30 am
submitted by /u/SilverDragon1 [link] [comments]
- Bio-based fibers could pose greater threat to the environment than conventional plastics | Study finds , 30% of earthworms died after 72 hours when exposed to polyester, and those exposed to the bio-based fibres experienced higher mortality up to 60% exposed to lyocell and 80% for viscose.by /u/FunnyGamer97 on November 5, 2024 at 5:28 am
submitted by /u/FunnyGamer97 [link] [comments]
- Children with higher IQ scores were diagnosed later with ADHD than those with lower scores. Children with higher cognitive abilities might be able to mask ADHD symptoms better, especially inattentive symptoms, which are less disruptive.by /u/mvea on November 5, 2024 at 4:58 am
submitted by /u/mvea [link] [comments]
- Researchers found that university students in both the United States and Iran who frequently engage in doomscrolling were also more likely to exhibit high levels of celebrity worship, suggesting that these behaviors may co-occur as forms of media-related behavioral addictions.by /u/a_Ninja_b0y on November 5, 2024 at 4:21 am
submitted by /u/a_Ninja_b0y [link] [comments]
- Programmable bacteria synergize with PD-1 blockade to overcome cancer cell–intrinsic immune resistance mechanismsby /u/MgSnGd125064 on November 5, 2024 at 3:40 am
submitted by /u/MgSnGd125064 [link] [comments]
Reddit Sports Sports News and Highlights from the NFL, NBA, NHL, MLB, MLS, and leagues around the world.
- Freshman Cooper Flagg helps No. 7 Duke roll past Maine in season openerby /u/Oldtimer_2 on November 5, 2024 at 3:25 am
submitted by /u/Oldtimer_2 [link] [comments]
- Grizzlies Ja Morant with another spectacular basket vs. Brooklynby /u/Oldtimer_2 on November 5, 2024 at 3:01 am
submitted by /u/Oldtimer_2 [link] [comments]
- Grizzlies Ja Morant with the beautiful 360° basketby /u/Oldtimer_2 on November 5, 2024 at 2:56 am
submitted by /u/Oldtimer_2 [link] [comments]
- [Highlight] DeAndre Hopkins scores his 1st touchdown with the Chiefs, does Remember The Titans TD celebrationby /u/nfl on November 5, 2024 at 2:09 am
submitted by /u/nfl [link] [comments]
- Joey Jay, First Little Leaguer to Get to the Majors, Dies at 89by /u/newzee1 on November 5, 2024 at 1:43 am
submitted by /u/newzee1 [link] [comments]