toddrjones/datasets

This is a compilation of free datasets that I hope can be useful to students, professors, and others for research, data visualization, etc. I am an applied microeconomist, and this is reflected in what is included below. Most of the datasets are publicly available, but some aren't and require data agreements. If you have any changes, additions, or comments, please contribute!

- Todd Jones

Skip to: Time Use, Crime, US Censuses and Economic History, Household Surveys, Mobility and Migration, Names, Injury and death, Crashes and traffic, Education, Academia, Temperature, Family, Sports, Religion, Government, Inflation and cost of Living, Working, Businesses, Politics and voting, Health, Real estate, Patents, Social networks, Beliefs and values, Law, Environment and energy, Shopping, Maps and geography, States, conflict and regimes

• American Time Use Survey (ATUS) - 24-hour US time diaries
  • Years: 2003-present; Access: Public; There is also an IPUMS version
  • Includes minute-by-minute information on which of hundreds of activities the person is doing. For most activities, there is also information on where and with whom the activity occurred.
  • The ATUS is a sample of the Current Population Survey (CPS), to which it can be linked.
  • Sample paper: Parental and Student Time Use Around the Academic Year
• Multinational Time Use Study - Time diaries from a number of countries
  • Years: varies. Access: Requires IPUMS data agreement.

• National Incident-based Reporting System (NIBRS) - Individual-level crime data covering much of the US
  • Years: 1991-present. This version was standardized and compiled by Jacob Kaplan.
  • Includes information like offender age, sex, and race; victim age, sex, and race; type of offense; time of offense; location of offense; and relationship between victim and offender.
  • The geography is police agency, so the individual crimes are not geocoded.
    • Useful crosswalk to get more information about the police agencies
  • Sample paper: School and Crime
• National Crime Victimization Survey (NCVS) - Self-reported victimization data
  • Years: 1992-present. This version is from ICPSR.
• City-level crime data - many cities have individual-level, geocoded crime data. A small number of examples:
  • New York City
  • Chicago
  • Los Angeles
  • Seattle
  • See also this site, this site, and this older site each of which detail availability for many cities
  • And OpenPoliceData, which compiles data from many sources
• 911 calls - many cities have data on 911 calls. A small number of examples:
  • New York
  • Los Angeles
  • Seattle
• Stanford Open Policing Project - Data on millions of police traffic stops across locations
• Justice Outcomes Explorer - Collaboration between University of Michigan's Criminal Justices Administrative Records System and the U.S. Census Bureau. Years covered: 2000-2020 (varies by jurisdiction). Criminal justice involvement includes criminal charges, prison releases, and probation and parole sentences. Outcomes: employment, earnings, government program participation, and mortality.

• 1850-1880 and 1900-1950 individual-level full count US Censuses
  • This version is from IPUMS, which requires an agreement.
    • IPUMS also has samples of some of the later Censuses
  • Information varies by year, but includes fields like age, sex, race, occupation, household structure, etc. Sometimes earnings and years of education.
  • It does not include name or address.
• OpenCensus
  • A project that is initially working to make the 1940 Census publicly available, so it includes name, address, etc.
• Individual-level links between Censuses
  • Census Tree - The largest set of links and good coverage for women. It uses information from the world's largest family tree, FamilySearch, to create the links.
  • IPUMS has its own links
  • Another option is the Census Linking Project
• Census Place Project - Census links to standardized and geocoded place names.
• CenSoc - Links between the 1940 Census and death records.

• American Community Survey (ACS) - Like a more-detailed version of the US Census, but only a sample of the population participates
  • Repeated cross-section. You can access it, e.g., via IPUMS (above link) or the tidycensus R package (requires a Census API key).
  • Depending on the geography, you can get a large number of variables like demographics, income, travel time to work, college major, industry, home value, and primary heating source.
• Current Population Survey (CPS) - Large US labor force survey
  • Years: 1962-present. This version is via IPUMS.
  • A person participates every month for four months, takes eight months off, then does four more months.
  • A subset of the CPS participates in the ATUS (see above).
• Panel Study of Income Dynamics (PSID) - long-running panel household survey
• National Longitudinal Study of Youth (NLSY79 and NLSY97) - detailed, long-running panel surveys
  • NLSY79 follows people born 1957-64, with the first interview in 1979
  • NLSY97 follows people born 1980-84, with the first interview in 1997
• IPUMS International - 100+ countries, 650+ surveys, 1B+ records
  • Massive, standardized compilation of censuses and surveys
• Household Pulse Survey/Household Trends and Outlook Pulse Survey Collected starting April 23, 2020 to measure timely issues affecting U.S. households. Household Pulse Survey ended on September 16, 2024 and was relaunched as Household Trends and Outlook Survey in early October 2024.

• MIGRATE - yearly migration patterns between US Census Blocks
  • From Inferring fine-grained migration patterns across the United States
• Opportunity Atlas - many adult outcomes of children at very fine-grained geographies
  • From The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility and Changing Opportunity: Sociological Mechanisms Underlying Growing Class Gaps and Shrinking Race Gaps in Economic Mobility
• Migration Patterns - Counts of children commuting zone to adult commuting zone migration patterns, split by race and parental income
  • From The Radius of Economic Opportunity: Evidence from Migration and Local Labor Markets

• SSA baby names – Frequencies of baby names by year from the Social Security Administration
  • Years: 1880–present; Access: Public
  • Data presented separately by male and female and by state. Minimum 5 names.
  • Fun article about the origins of these data.
• England and Wales names - Baby names from the Office of National Statistics
  • Years: 1996-present
  • Minimum 3 names.
• US Census names - Most commonly-occurring first and last names in the US
  • Years: 1990, 2000, 2010, 2020. Access: Public
• Facebook Name List - How often names are male and female
  • Access: Public

• NCHS Multiple Cause of Death - Individual-level US mortality data
  • Years: 1959-present. Only years before 2005 have geographical information.
  • This version is cleaned by the NBER.
• CDC Mortality Data - County-level mortality data
  • Years: 1969-present. Requires agreement.
  • Depending on the year, splits by age, race, sex, and cause of death.
• National Electronic Injury Surveillance System - Individual-level data on injuries involving consumer products.
  • Sample paper: Smartphones and child injuries

• Fatal Accident Reporting System (FARS) - Individual-level data on virtually the universe of US fatal car crashes
  • Years: 1975-present. Includes drive and passenger demographics, car characteristics, location, and other circumstances regarding the crash.
• State-level crash data - some states (and cities) have individual-level, geocoded car crash data. A small number of examples:
  • California
  • Massachusetts and then search for "Crashes"
  • See also this site and this other site, which both detail data availability for each state.
• UTD19 - Traffic data from 20k+ stations across 40 cities
  • Years: 2017-2019. Access: public.

• IPEDS - Data on college enrollments, faculty/staff, expenditures, incoming test scores, graduation, etc.
• SEDA - K-12 district-, county-, and state-level test scores, by race and gender
  • Years: 2009-2019
• Common Core of Data - K-12 school- and district-level data
• You can access a lot of different datasets, such as IPEDS and CCD, using Urban Institute's educationdata, including R and Stata packages.
• NERD$ - K-12 nationwide per pupil spending by school, nationwide
• HERI - Detailed college freshman, senior, and faculty surveys
  • Years vary. Some of data is publicly available; rest requires agreement.
• Data on where colleges graduates go after graduating
  • Years: 2010-2018. From Grads on the Go: Measuring College-Specific Labor Markets for Graduates
• PISA - Data allowing cross-county comparisons on educational progress
• Median earnings four years after graduation by university-major
  • Graduates from 2017-18 and 2018-19. Access: public. A university-major is only included if there are at least 16 graduates.
  • From the Department of Education; this version is made available by the HEA Group.
• Post-Secondary Employment Outcomes (PSEO) Earnings and employment outcomes for college and university graduates by degree level, degree major, post-secondary institution, and state of institution.

• Openalex - over half a billion academic papers
  • Free to download the full data, but it is really big! Limited number of free API pulls per day
• Metadata on NBER articles
  • Includes information like authors, affiliations, and abstracts
• Economics PhD Placements - placements of 18k+ economics PhDs from from 82 programs over 1990-2026
• Economics Graduates North-America 1997-2017 with RePEc handles and Scopus IDs
• Gender composition by academic field
  • Since 1950, based on estimated name from publications
• PhD origins of academic faculty - where hundreds of thousands of professors got their PhDs, by university and field
  • From Quantifying hierarchy and dynamics in US faculty hiring and retention

• PRISM - Gridded weather data, including temperature and precipitation
  • Years: 1981-present (daily), 1895-present (monthly)
• NOAA - Weather station data
• Open-Meteo - weather API
  • Some of data goes back to 1940. Forecast data from 2021. Free version of API is rate limited (300k/month)

Births, Marriages, and Divorces

• NVSS Natality data - Individual-level data on births
  • Years: 1968-present. Provided by NBER. Only years before 2005 have geographical information.
• National Survey of Family Growth - Survey on things like pregnancy, infertility, births, and marriage
• CDC and SSA Birthdates - Counts of birth by calendar day
  • Years: 1994-2003 (CDC) and 2000-2014 (Social Security Administration)
  • From FiveThirtyEight. See Some People Are Too Superstitious To Have A Baby On Friday The 13th
• Marriages and Divorces in Texas - Individual-level data on marriages and divorces
  • Years vary. Some of the years are missing data.
  • Both files have names and dates. The divorce file has number of children and date of marriage.
• Marriages in England and Wales - Counts of marriages by day
  • Years: 1999-present for the data with day of marriage.

• MLB
  • Pitch-level data from Baseball Savant's Statcast. You can get the location of the pitch, the distance a batted ball was estimated to travel, etc.
  • Cot's salary data
  • Lahman Baseball Database - Season-level player statistics, 1871-present
  • 10,000 baseball scouting reports
    • From Trouble with the Curve: Predicting Future MLB Players Using Scouting Reports
• NBA
  • Box score data, 1947-present, from Kaggle
  • Play-by-play data, 1997-present, from Kaggle
• NFL
  • nflverse - R package that you can use to get lots of data, including play-by-play
• Marathons
  • Marathon times

• 2020 US Religion Census - Estimates of the number of adherents by faith at the county and state level
• Pew's Religious Landscape Study (RLS) - large survey about religion
• LDS Hymn Stats - the hymns sung at over 100,000 (non-representative) Latter-day Saint Sacrament Meetings
  • The microdata is not available, but counts by hymn are, overall and separately by before and since June 2024
• The ARDA - compiles many datasets on religion

• LocalView - transcripts of local government meetings that were uploaded to YoutTube
• Voteview - how everyone in Congress has voted throughout all of US history as well as an ideology score for everyone
• Visits by Foreign Leaders and Heads of State - Every visit of a foreign head of state to the US President (or VP if President was indisposed/abroad) from 1874-2020
• CongressInData - For Congress members between 2005-2015, it provides information on social networks, voting, etc.

• CPI-U - you can use this to adjust for inflation
  • To use, click on "Edit Graph" and adjust the frequency to "Annual" with "Average aggregation" method.
• Cost of living - County-level cost of living estimates

• CPS, ACS, PSID - see above
• O*NET - Data on occupational tasks
• Quarterly Census of Employment and Wages (QCEW) - county-level data on employment and wages
• Quarterly Workforce Indicators (QWI) - employment, jobs creation, earnings and other measures of employment flows by detailed firm characteristics and worker demographics. Downloadable via Census API
• Job to Job Flows (J2J) - statistics on job mobility in the United States, including the job-to-job transition rate, hires and separation rates, earnings changes due to job change, and characteristics of the origin and destination job.
• LEHD Origin-Destination Employment Statistics (LODES) - source data for the Census OnTheMap data tool, providing statistics at the Census block level at both residential and workplace locations and flows between the two (origin-destination).
• Veteran Employment Outcomes (VEO) - labor market outcomes for discharged veterans from five branches of the military - Air Force, Army, Coast Guard, Marine Corps, and Navy. Tabulated by military specialization, service characteristics, employer industry, and veteran demographics.
• Mobility, Opportunity, and Volatility Statistics (MOVS) a dataset that tracts the income changes of a 2005 cohort of U.S. adults from 2005 to 2019 by initial income decile, sex, and race/ethnicity.

• County Business Patterns - county-level data on employment and payroll
• Chicago Business Registrations - geocoded business licenses with business name, date of expiration, etc.
• Business Dynamic Statistics - Annual measures of business dynamics - job creation and destruction, establishment births and deaths, firm startups and shutdowns by establishment and firm characteristics. Also available for specific types of firms/measures: Patenting Firms, High Growth Firms, Goods Traders, High Tech Industries, Single-Unit Firms with Revenue, Human Capital, Coastal Counties.
• Dispersion Statistics on Productivity (DiSP) - within-industry measures of productivity dispersion. Covers every five years from 1987-2017 by 4-digit NAICS for manufacturing and retail sectors.
• Business Trends and Outlook Survey (BTOS) high-frequency, nationally representative data on U.S. employer businesses. Collected starting September 11, 2023. Data released every 2 weeks by NACIS sector, state, and 25 most populous MSAs.

• MIT Election Lab - Collection of various US election results
• NYT's Presidential precinct data for the 2024 U.S. general election
  • See also this map
• North Carolina voter registration data

• National Health and Nutrition Examination Survey (NHANES) - National survey for adults and children with various health-related questions

• Prices paid dataset - All residential property sales in England and Wales (that are sold for value and registered)
  • Years: 2018-present. Has address and price paid.
• Tract-level home price indices
  • Years: 1989-2021
  • From [Larson and Contat (2022)](A Flexible Method of House Price Index Construction using Repeat-Sales Aggregates)

• Worldwide patent data - Geocoded, 1980-2014, 46 countries
  • From Geocoding of Worldwide Patent Data
• US patent data

• Facebook Social Connectedness Index (SCI) - county-to-county connectedness
  • Based on Facebook friendships. Also country-to-country and other subnational links.

• World Values Survey - Worldwide survey on beliefs and values

• A list of all federal laws
• From A comprehensive dataset of U.S. federal laws (1789–2022)
• LawAtlas - Coded laws from Temple University's Public Health Law Review

• ERCOT - hourly electricity load data in Texas
  • 1995-present. ERCOT is the largest provider in the state
• Gridded Environmental Impacts Frame (Gridded EIF) - detailed demographic counts by age, sex, race and ethnicity and data for environmental hazards on a 0.01 degree grid of the United States.

• 1.8 million Amazon purchases from 5000 people
  • From Open e-commerce 1.0, five years of crowdsourced U.S. Amazon purchase histories with user demographics

• Historical Topographic Maps
  • Maps from 1884-2006
• Elevation data - R package to get elevation data from a variety of sources

• Interstate System Dataset (ISD), version 2.1 - All independent states since 1816, a wider list than the Correlates of War one
  • Years: 1816-2016; Access: Public (CC0)
  • One row per state, with entry and exit dates and how the state ended (conquest, unification, dissolution, etc.)
• Abramson (2017) replication data - European states from 1100 to 1790, with their territory and when they ended
  • Years: 1100-1790; Access: Public (CC0)
  • From The Economic Origins of the Territorial State
• Political Instability Task Force (PITF) State Failure Problem Set - Onsets and ends of ethnic wars, revolutionary wars, adverse regime changes and genocides
  • Years: 1955-2018; Access: Free download, cite the source, no redistribution without permission
• Polity5 - Regime scores for independent states with more than 500,000 people
  • Years: 1800-2018; Access: Free download
• V-Dem - Hundreds of indicators of democracy and regime characteristics, by country and year
  • Years: 1789-present; Access: Public
• CShapes 2.0 - Borders and capitals of states and dependent territories, as maps
  • Years: 1886-2019 (Europe from 1816); Access: Public (CC BY-NC-SA 4.0)

Disclaimer: This site may contain errors and in no way do we guarantee the accuracy of the referenced data. In no event will we be liable for any loss or damage.