SEASON
Scroll or swipe ↔
  1. SEASON
    All About Surveys

    All About Surveys

    Surveys might seem simple, but good data collection requires nuance, rigor, and constant vigilance. This season digs into the science behind asking questions: designing unbiased instruments, avoiding misleading phrasing, and detecting fraud or bot activity in online panels. With insights from practitioners and researchers, it uncovers the hidden complexities behind the polls and studies we often take at face value.

  2. EP 01
    The NLP Community Metasurvey

    The NLP Community Metasurvey

    5/15/2023

    Julian Michael, a postdoc at the Center for Data Science, New York University, joins us today. Julian’s conversation with Kyle was centered on the NLP community metasurvey: a survey aimed at understan…

    Julian Michael
    ▶ Listen
  3. EP 02
    Skeptical Survey Interpretation

    Skeptical Survey Interpretation

    5/10/2023

    Kyle shares his own perspectives on challenges getting insight from surveys. The discussion ranges from commentary on the market research industry to specific advice for detecting disingenuous or frau…

    Kyle Polich
    ▶ Listen
  4. EP 03
    The Gallup Poll

    The Gallup Poll

    5/1/2023

    Jeff Jones, a Senior Editor at Gallup, joins us today. His conversation with Kyle spanned a range of topics on Gallup’s poll creation process. He discussed how Gallup generates unbiased questionnaires…

    Jeff Jones
    ▶ Listen
  5. EP 04
    Inclusive Study Group Formation at Scale

    Inclusive Study Group Formation at Scale

    4/25/2023

    Gireeja Ranade, a University of California at Berkeley professor, speaks with us today. She presented her study on implementing inclusive study groups at scale and shared the observed student performa…

    Gireeja Ranade
    ▶ Listen
  6. EP 05
    The PhilPapers Survey

    The PhilPapers Survey

    4/21/2023

    Today, we are joined by David Bourget. David is an Associate Professor in Philosophy at Western University in London, Ontario. David is also the co-director of the PhilPapers Foundation and Director o…

    David Bourget
    ▶ Listen
  7. EP 06
    Non-Response Bias

    Non-Response Bias

    4/10/2023

    Today’s show focused on an essential part of surveys — missing values. This is typically caused by a low response rate or non-response from respondents. Yajuan Si is a Research Associate Professor at …

    Yajuan Si
    ▶ Listen
  8. EP 07
    Measuring Trust in Robots with Likert Scales

    Measuring Trust in Robots with Likert Scales

    4/3/2023

    There is more going on in Measuring Trust in Robots with Likert Scales than first meets the eye. Two guests today, Mariah, a Ph.D. student in the CORE Robotics Lab at Georgia Tech, and Matthew Gombola…

    Mariah SchrumMatthew Gombolay
    ▶ Listen
  9. EP 08
    CAREER Prediction

    CAREER Prediction

    3/27/2023

    Ever wondered what your next career would be? Today, Keyon Vafa, a computer science Ph.D. student at Columbia University, joins us to discuss his latest research on developing a machine-learning model…

    Keyon Vafa
    ▶ Listen
  10. EP 09
    The Panel Study of Income Dynamics

    The Panel Study of Income Dynamics

    3/21/2023

    Noura Insolera, a Research Investigator with the Panel Study of Income Dynamics (PSID), joins us to share how PSID conducts longitudinal household surveys. She also shared some interesting findings fr…

    Noura Insolera
    ▶ Listen
  11. EP 10
    Survey Design Working Session

    Survey Design Working Session

    3/14/2023

    Susan Gerbic joins Kyle to review some of the surveys Data Skeptic has launch, draft a new survey about podcast listening habits, and then review the results of that survey. You can see those results …

    Susan Gerbic
    ▶ Listen
  12. EP 11
    Bot Detection and Dyadic Surveys

    Bot Detection and Dyadic Surveys

    3/6/2023

    The use of social bots to fill out online surveys is becoming prevalent. Today, we speak with Sara Bybee, a postdoctoral research scholar at the University of Utah. Sara shares from her research, how …

    Sara Bybee
    ▶ Listen
  13. EP 12
    Reproducible ESP Testing

    Reproducible ESP Testing

    2/20/2023

    Reproducible ESP Testing turns out to be a useful lens for thinking about data in the real world. Zoltán Kekecs, a Ph.D. holder in Behavioural Science. Zoltán highlights the problem of low replicabili…

    Zoltán Kekecs
    ▶ Listen
  14. EP 13
    A Survey of Data Science Methodologies

    A Survey of Data Science Methodologies

    2/13/2023

    On the show, Iñigo Martinez, a Ph.D. student at the University of Navarra shares his survey results which investigated how data practitioners perform data science projects. He revealed the methodologi…

    Iñigo Martinez
    ▶ Listen
  15. EP 14
    Opinion Dynamics Models

    Opinion Dynamics Models

    2/6/2023

    On the show today, Dino Carpentras, a post-doctoral researcher at the Computational Social Science group at ETH Zürich joins us to discuss how opinion dynamics models are built and validated. He expla…

    Dino Carpentras
    ▶ Listen
  16. EP 15
    Casual Affective Triggers

    Casual Affective Triggers

    1/30/2023

    Crafting survey questions is one thing but getting your audience to fill it is yet another. On the show today, we speak with Alexander Nolte, an Associate Professor at the University of Tartu. Alexand…

    Alexander Nolte
    ▶ Listen
  17. EP 16
    Conversational Surveys

    Conversational Surveys

    1/23/2023

    Traditional surveys have straight-jacket questions to be answered, thus restricting the information that can be gotten. Today, Ziang Xiao, a Postdoc Researcher in the FATE group at Microsoft Research …

    Ziang Xiao
    ▶ Listen
  18. EP 18
    4 out of 5 Data Scientists Agree

    4 out of 5 Data Scientists Agree

    1/10/2023

    This episode kicks off the new season of the show, **Data Skeptic: Surveys**. Linhda rejoins the show for a conversation with Kyle about her experience taking surveys and what questions she has for th…

    LinhDa TranKyle Polich
    ▶ Listen