ITSEW 2024 Explored Understanding Error in a Blended World

The NISS International Total Survey Error Workshop (ITSEW) 2024 Workshop brought together leading experts in survey methodology from across North America and beyond, focusing on innovative approaches to Total Survey Error (TSE) and data quality in the 21st century. The workshop was held on September 18-20, 2024, on the George Washington University campus and delivered comprehensive exploration of current challenges and advancements in survey research.

Highlights of the workshop included plenary speakers Dr. Robert Groves, Georgetown University, A 21st Century Data Infrastructure, Dr. Sallie Ann Keller, U.S. Census Bureau, Total Survey Error and Total Uncertainty Analyses Viewed through the Lens of Statistical Products First, Dr. Paul Beimer, PPB Consulting, Sunset Salvo: Reprise, and Dr. Jerome P. “Jerry” Reiter, Duke University, Modeling for Nonresponse and Measurement Error with Survey Weighted Data when some Margins are Known from External Data Sources.

Lively discussions and networking highlighted the talks over the three days. With just over eighty registrants, the workshop broached the critical need for a modern data infrastructure that can adapt to the evolving landscape of survey data collection and analysis (see presentation listing below). Participants from around the world converged on Washington, DC coming from Brazil, Canada, China, Germany, Netherlands, and the United Kingdom, as well as all over the United States.

The National Institute of Statistical Sciences (NISS) was extremely pleased and grateful to receive support from the George Washington University Department of Statistics/Professor & Chair, Huixia Judy Wang and GWU School of Engineering and Applied Science's, Sandra Little, and our generous sponsors NORC at the University of Chicago, RTI International, and Westat.

Attendees also had the opportunity to engage with a diverse range of research through poster presentations covering topics such as attrition bias in longitudinal surveys, happiness measurement design effects, and practical case prioritization strategies.

NISS proudly hosted three of ITSEW's founders at the 2024 installation. ITSEW was created in 2005 by Paul Biemer, Alan Karr, and Jerry Reiter, and began under the NISS Affiliates Program, being held at the Bureau of Labor Statistics. Its goal was to foster discussion and research on total survey error, featuring work in progress and active discussions. After a hiatus, ITSEW resumed in 2008 and continued annually until 2019, held in various global locations. Lars Lyberg notably organized ITSEW 2009 in Sweden and a short course in 2019 in Italy. The pandemic caused cancellations in 2020, 2022, and 2023, with a virtual meeting in 2021. The 2024 in-person meeting in Washington saw many first-time attendees. ITSEW hopes to continue in-person meetings biennially, expanding into new data forms, technologies, and survey error sources.

NISS also wishes to extend praise to our ITSEW 2024 Organizing Committee who relentlessly led this workshop to greatness! With much thanks and gratitude, we honor our organizers below:

Wednesday, September 18, 2024

  Robert Groves, Georgetown University, motrya.calafiura@georgetown.edu

A 21st Century Data Infrastructure for the United States

  Beatrice Baribeau, Statistics Canada, beatrice.baribeau@statcan.gc.ca

Addressing Nonresponse Error within the Total Survey Error (TSE) Framework: Statistics Canada's "Smart Survey Initiative"

  Ipek Bilgen, NORC at the University of Chicago, bilgen-ipek@norc.org

Impact of Equitable Communication Strategies During Panel Recruitment on Nonresponse and Measurement Errors

  Sallie Ann Keller, U.S. Census Bureau, sallie.a.keller@census.gov

Total Survey Error and Total Uncertainty Analyses Viewed through the Lens of Statistical Products First

  Brad Edwards, Westat, bradedwards@westat.com

Extending TSE to Biomarker Quality

  Dan Liao, RTI International, dliao@rti.org

Ensuring Total Survey Quality when Transitioning a Longitudinal Survey from In-Person to Web-Mail Mixed Mode

  Karolina von Glasenapp, GESIS - Leibniz Institute for the Social Sciences, Germany, karolina.glasenapp@gesis.org

Evaluating Total Survey Quality: The Case of Surveys Conducted During the Covid-19 Pandemic in Germany

  Chris Lam, Statistics Netherlands, c.lam@cbs.nl

Analyzing Measurement and Representational Errors in Smart Survey Datasets used for Machine Learning

  Curtiss Engstrom, University of Michigan, cwengstr@umich.edu

A Comparison of Collapsing and Bridging Methods for Measures of Sexual Identity Using Two National Health Surveys in the United States

  J. David Brown, U.S. Census Bureau, j.david.brown@census.gov

Citizenship Question Effects on Noncitizen Household Response

  Grace Guynn, Federal Reserve Bank of Atlanta, grace.guynn@atl.frb.org

Constructing Representative Sampling Frames From Commercial Vendors

  Jason Kosakow, Federal Reserve Bank of Richmond, jason.kosakow@rich.frb.org

Assessing the Effectiveness of Using the USPS CDS File on Commercially Available Business Lists to Build a More Accurate Business Sampling Frame

  Jake Soffronoff, Institute of Museum and Library Sciences, jsoffronoff@imls.gov

Approaches to Digital Cleaning: Blending Traditional Methods with Crowdsourcing and AI to Clean a Public Sector Establishment Survey Population Frame

Thursday, September 19, 2024

  Lilian Huang, NORC at the University of Chicago, huang-lilian@norc.org

Impact of Record Linkage Quality on Survey Error: A Case Study

  Danny Friel, U.S. Bureau of Labor Statistics, friel.daniel@bls.gov

A Scalar Method for Variance Estimation of the Modeled Wage Estimates

  Jeremy Flood, North Carolina A&T State University, jrflood@aggies.ncat.edu

Survey Data Integration for Distribution Function Estimation

  Graham ‘Gray’ Jones, Bureau of Labor Statistics, jones.graham@bls.gov

Data Quality Profile Used in the Consumer Expenditure Surveys (CE)

  Zachary Seeskin, NORC at the University of Chicago, zach.seeskin@gmail.com

TSE for Multiple Vaccination Coverage Estimates from the 2022 National Immunization Survey for Young Children (NIS-Child)

  Shalima Zalsha, NORC at the University of Chicago, zalsha-shalima@norc.org

TSE for COVID-19 vaccination Coverage Among Children and Teens Using the 2023 NIS-Child COVID Module

  Elizabeth Allen, NORC at the University of Chicago, allen-elizabeth@norc.org

Adult COVID-19 Vaccination Coverage from the 2023 NIS-Adult COVID Module

  Paul Biemer, PPB Consulting, ppb@rti.org

Sunset Salvo: Reprise

  Ai Rene Ong, American Institutes for Research, aong@air.org

Assessing the Use of Multiple Sources of Auxiliary Data for Tailored Survey Designs

  Burton Levine, RTI International, blevine@rti.org

Combining a Probability ABS Sample with a Nonprobability Social Media Sample

  Michael Elliott, University of Michigan, mrelliot@umich.edu

Using Synergies Between Survey Statistics and Causal Inference to Improve Transportability of Clinical Trials

  Alexander Haas, NORC at the University of Chicago (ahaas128@aol.com) and Zachary Seeskin, NORC at the University of Chicago

Extending a Data Quality Scorecard to Assess Fitness for Use of Blended Data Sources

  Katherine Davies, Office for National Statistics (UK), katie.davies@ons.gov.uk

Understanding Error in UK Travel and Tourism Estimates

  Mahmoud Elkasabi, RTI International, melkasabi@rti.org

National Center for Health Statistics Rapid Surveys System: Calibrating Blended Samples

  Ting Yan, NORC at the University of Chicago (prev. Westat), tyanuconn@gmail.com

Revisiting Total Survey Error Framework In a Multimode and MultiData Environment with Two Case Studies

Friday, September 20, 2024

  Jerry Reiter, Duke University, jreiter@duke.edu

Modeling for Nonresponse and Measurement Error with Survey Weighted Data when some Margins are Known from External Data Sources

  Marta Murray-Close, U.S. Census Bureau, mmurrayclose@gmail.com

Survey-First vs. Administrative Record-First Approaches to a Census

  Joseph L. Schafer, U.S. Census Bureau, Joseph.L.Schafer@census.gov

Total Uncertainty Analysis for the U.S. Decennial Census

  Alan Pate, Battelle, patea@battelle.org and Paul J. Lavrakas, Independent Consultant, pjlavrakas@comcast.net

An Evaluation of the 2022 National Household Travel Surveys: A Total Survey Error Comparison of the ABS vs. the Probability-Based Panel NextGen NHTS Studies

POSTERS

  Aulia Dini Rafsanjani, University of Michigan, aulia@umich.edu

The Construction of Weight Adjustment to Mitigate Attrition Bias in Longitudinal Survey

  Chan Zhang, Zhejiang University, chanzh05@gmail.com

Question Design Effects in Measuring Happiness: Combining Data from 34 Chinese National Representative Surveys from 2002 to 2022

  John Tsang, University of Ottawa, john.tsang@uottawa.ca

Correcting Selection Bias in Non-Probability Two-Phase Payment Survey

  Joy Wu, Bank of Canada, jwu@bank-banque-canada.ca

Low Response Rate from Merchants? No Problem, Just Ask Consumers! An Application of Indirect Sampling to Consumer Payment Diary Data

  Pei Geng, University of New Hampshire, pei.geng@unh.edu

A Bias-Corrected Parameter Estimation Approach in Logistic Regression with Measurement Error in Covariates

  Rui Jiao, Westat, ruijiao@westat.com

A Practical Approach for Case Prioritization in A Panel Survey

  William Waldron, National Center for Health Statistics, nap2@cdc.gov

Two-Stage Systematic Cluster Sampling in the NHIS 2020 Design

ATTENDEES

 

 

Wednesday, September 25, 2024 by Randy Freret