When Should Survey Reminders be Sent Out? An Investigation Into Surveys Analyzing High Schoolers

Authors

  • Sammy Socol Chadwick School
  • Maura Large Chadwick School

DOI:

https://doi.org/10.47611/jsrhs.v11i3.2848

Keywords:

Survey, Survey Reminders, Reminder Timing, Case study, High school

Abstract

In the modern day, surveys often have very low response rates. This reveals a need for greater understanding of survey research, in order to enable researchers to achieve high response rates. One relevant facet of survey research is reminder timings, or the amount of time between the survey invitation and the reminder. In this study, the researcher investigated a potential reminder timing, analyzing surveys on high school students to discover the day that people stop responding to surveys. The researcher found that in their dataset, people stop responding to surveys after an average of 3 days of the survey being active. This finding may be relevant to informing survey reminder timings in the future, as effective reminders may be placed at the point people stop responding to surveys. There may be more optimal reminder timings, however. More investigation must be done into the ideal point for survey reminders to generate more solid conclusions.

Downloads

Download data is not yet available.

Author Biography

Maura Large, Chadwick School

Teacher - AP Research

References or Bibliography

Aaronson, D., Park, K.-H., & Sullivan, D. G. (2006). The Decline in Teen Labor Force

Participation. Economic Perspectives: Federal Reserve Bank of Chicago.

Asire, A. M. (2017). A Meta-Analysis of the Effects of Incentives on Response Rate in Online

Survey Studies. Electronic Theses and Dissertations.

Barnhart, B. J., Reddy, S. G., & Arnold, G. K. (2021). Remind Me Again: Physician Response to

Web Surveys: The Effect of Email Reminders Across 11 Opinion Survey Efforts at the American Board of Internal Medicine from 2017 to 2019. Evaluation & the Health Professions, 44(3), 245–259. https://doi.org/10.1177/01632787211019445

Barron, G., & Yechiam, E. (2002). Private e-mail requests and the diffusion of

responsibility. Computers in Human Behavior, 18(5), 507–520. https://doi.org/10.1016/s0747-5632(02)00007-9

Baruch, Y., & Holtom, B. C. (2008). Survey response rate levels and trends in

Organizational Research. Human Relations, 61(8), 1139–1160. https://doi.org/10.1177/0018726708094863

Bauer, L., Liu, P., Moss, E., Nunn, R., & Shambaugh, J. (2019, July 3). All school and no

work becoming the norm for American teens. Brookings. Retrieved December 1, 2021, from https://www.brookings.edu/blog/up-front/2019/07/02/all-school-and-no-work-becoming-the-norm-for-american-teens/.

Beebe, T. J., McAlpine, D. D., Ziegenfuss, J. Y., Jenkins, S., Haas, L., & Davern, M. E. (2012).

Deployment of a Mixed-Mode Data Collection Strategy Does Not Reduce Nonresponse Bias in a General Population Health Survey. Health Services Research, 47(4), 1739–1754. https://doi.org/10.1111/j.1475-6773.2011.01369.x

Beebe, T. J., Jacobson, R. M., Jenkins, S. M., Lackore, K. A., & Rutten, L. J. (2018).

Testing the impact of mixed-mode designs (mail and web) and multiple contact attempts within mode (mail or web) on clinician survey response. Health Services Research, 53, 3070–3083. https://doi.org/10.1111/1475-6773.12827

Biner, P. M. (1988). Effects of cover appeal and monetary incentives on survey response: A

reactance theory application. Basic and Applied Social Psychology, 9(2), 99–106. https://doi.org/10.1207/s15324834basp0902_3

Blumenberg, C., Menezes, A. M., Gonçalves, H., Assunção, M. C., Wehrmeister, F. C., Barros, F.

C., & Barros, A. J. (2019). The role of questionnaire length and reminders frequency on response rates to a web-based epidemiologic study: A randomised trial. International Journal of Social Research Methodology, 22(6), 625–635. https://doi.org/10.1080/13645579.2019.1629755

Brown, J. A., Serrato, C. A., Hugh, M., Kanter, M. H., Spritzer, K. L., & Hays, R. D.

(2016). Effect of a post-paid incentive on response rates to a web-based survey. Survey Practice, 9(1), 1–7. https://doi.org/10.29115/sp-2016-0001

Buchholz, K. (2020). Americans Get Driver's Licenses Later in Life. Statista. Retrieved

January 21, 2021, from https://www.statista.com/chart/18682/percentage-of-the-us-population-holding-a-drivers-license-by-age-group/.

Coopersmith, J., Vogel, L. K., Bruursema, T., & Feeney, K. (2016). Effects of incentive

amount and type of web survey response rates. Survey Practice, 9(1), 1–10. https://doi.org/10.29115/sp-2016-0002

Crawford, S. D., Couper, M. P., & Lamias, M. J. (2001). Web surveys. Social Science

Computer Review, 19(2), 146–162. https://doi.org/10.1177/089443930101900202

Dillman, D. A., Lesser, V., Mason, R., Carlson, J., Willits, F., Robertson, R., & Burke, B.

(2007). Personalization of mail surveys for general public and populations with a group identity: Results from nine studies. Rural Sociology, 72(4), 632–646. https://doi.org/10.1526/003601107782638693

Edwards, L., Salisbury, C., Horspool, K., Foster, A., Garner, K., & Montgomery, A. A.

(2016). Increasing follow-up questionnaire response rates in a randomized controlled trial of telehealth for depression: Three embedded controlled studies. Trials, 17(1). https://doi.org/10.1186/s13063-016-1234-3

Edwards, P. J., Roberts, I., Clarke, M. J., DiGuiseppi, C., Wentz, R., Kwan, I., Cooper, R., Felix,

L. M., & Pratap, S. (2009). Methods to increase response to postal and electronic questionnaires. Cochrane Database of Systematic Reviews. https://doi.org/10.1002/14651858.mr000008.pub4

Fatkin, J.-M., & Lansdown, T. C. (2017). Group size and personalization’s effect on

Facebook message response rates. Information Technology & People, 30(1), 71–80. https://doi.org/10.1108/itp-02-2015-0042

Fincham, J. E. (2008). Response rates and responsiveness for surveys, standards, and the journal.

American Journal of Pharmaceutical Education, 72(2), 43. https://doi.org/10.5688/aj720243

Goyder, J. (1986). Surveys on surveys: Limitations and potentialities. Public Opinion Quarterly,

(1), 27. https://doi.org/10.1086/268957

Göritz, A. S. (2006). Incentives in Web Studies: Methodological Issues and a Review.

International Journal of Internet Science, 1(1), 58–70.

Heerwegh, D., Vanhove, T., Matthijs, K., & Loosveldt, G. (2005). The effect of

personalization on response rates and data quality in web surveys. International Journal of Social Research Methodology, 8(2), 85–99. https://doi.org/10.1080/1364557042000203107

Joinson, A. N., & Reips, U.-D. (2007). Personalized salutation, power of sender and

response rates to web-based surveys. Computers in Human Behavior, 23(3), 1372–1383. https://doi.org/10.1016/j.chb.2004.12.011

Kennedy, C., & Hartig, H. (2020, May 30). Response rates in telephone surveys have

resumed their decline. Pew Research Center. Retrieved December 1, 2021, from https://www.pewresearch.org/fact-tank/2019/02/27/response-rates-in-telephone-surveys-have-resumed-their-decline/.

Klagge, J. (2018). Guidelines for conducting surveys. ResearchGate. Retrieved December 1,

, from https://www.researchgate.net/profile/Jay-Klagge/publication/327425122_Guidelines_for_Conducting_Surveys/links/5b8eb8c7a6fdcc1ddd0ec931/Guidelines-for-Conducting-Surveys.pdf.

Koitsalu, M., Eklund, M., Adolfsson, J., Grönberg, H., & Brandberg, Y. (2018). Effects of

pre-notification, invitation length, questionnaire length and reminder on participation rate: A quasi-randomised controlled trial. BMC Medical Research Methodology, 18(1). https://doi.org/10.1186/s12874-017-0467-5

Muñoz-Leiva, F., Sánchez-Fernández, J., Montoro-Ríos, F., & Ibáñez-Zapata, J. Á. (2009).

Improving the response rate and quality in web-based surveys through the personalization and frequency of reminder mailings. Quality & Quantity, 44(5), 1037–1052. https://doi.org/10.1007/s11135-009-9256-5

Newell, C. E., Rosenfeld, P., Harris, R. N., & Hindelang, R. L. (2004). Reasons for

nonresponse on U.S. Navy Surveys: A closer look. Military Psychology, 16(4), 265–276. https://doi.org/10.1207/s15327876mp1604_4

Patrick, M. E., Couper, M. P., Jang, B. J., Laetz, V., Schulenberg, J. E., O’Malley, P. M.,

Bachman, J., & Johnston, L. D. (2022). Building on a Sequential Mixed-Mode Research Design in the Monitoring the Future Study. Journal of Survey Statistics & Methodology, 10(1), 149–160. https://doi.org/10.1093/jssam/smaa030

Pickett, J. T., Metcalfe, C. F., Baker, T., Gertz, M., & Bedard, L. (2013). Superficial survey

choice: An experimental test of a potential method for increasing response rates and response quality in correctional surveys. Journal of Quantitative Criminology, 30(2), 265–284. https://doi.org/10.1007/s10940-013-9203-4

Pit, S. W., Hansen, V., & Ewald, D. (2013). A small unconditional non-financial incentive

suggests an increase in survey response rates amongst older General Practitioners (GPS): A Randomised Controlled Trial Study. BMC Family Practice, 14(1). https://doi.org/10.1186/1471-2296-14-108

Pit, S. W., Vo, T., & Pyakurel, S. (2014). The effectiveness of recruitment strategies on

general practitioner’s survey response rates – a systematic review. BMC Medical Research Methodology, 14(1). https://doi.org/10.1186/1471-2288-14-76

Porter, S. R., Whitcomb, M. E., & Weitzer, W. H. (2004). Multiple surveys of students and

survey fatigue. New Directions for Institutional Research, 2004(121), 63–73. https://doi.org/10.1002/ir.101

Sahlqvist, S., Song, Y., Bull, F., Adams, E., Preston, J., & Ogilvie, D. (2011). Effect of

questionnaire length, personalisation and reminder type on response rate to a complex postal survey: Randomised Controlled Trial. BMC Medical Research Methodology, 11(1). https://doi.org/10.1186/1471-2288-11-62

Shults, R. A., & Williams, A. F. (2013). Trends in driver licensing status and driving among

high school seniors in the United States, 1996–2010. Journal of Safety Research, 46, 167–170. https://doi.org/10.1016/j.jsr.2013.04.003

Singer, E., & Ye, C. (2012). The use and effects of incentives in surveys. The ANNALS of

the American Academy of Political and Social Science, 645(1), 112–141. https://doi.org/10.1177/0002716212458082

Steindl, C., Jonas, E., Sittenthaler, S., Traut-Mattausch, E., & Greenberg, J. (2015).

Understanding psychological reactance. Zeitschrift Für Psychologie, 223(4), 205–214. https://doi.org/10.1027/2151-2604/a000222

Van Mol, C. (2016). Improving web survey efficiency: The impact of an extra reminder and

reminder content on web survey response. International Journal of Social Research Methodology, 20(4), 317–327. https://doi.org/10.1080/13645579.2016.1185255

Young, J. M., O'Halloran, A., McAulay, C., Pirotta, M., Forsdike, K., Stacey, I., & Currow,

D. (2015). Unconditional and conditional incentives differentially improved general practitioners' participation in an online survey: Randomized Controlled Trial. Journal of Clinical Epidemiology, 68(6), 693–697. https://doi.org/10.1016/j.jclinepi.2014.09.013

Yu, S., Alper, H. E., Nguyen, A.-M., Brackbill, R. M., Turner, L., Walker, D. J., Maslow, C. B.,

& Zweig, K. C. (2017). The effectiveness of a monetary incentive offer on survey response rates and response completeness in a longitudinal study. BMC Medical Research Methodology, 17(1). https://doi.org/10.1186/s12874-017-0353-1

Published

08-31-2022

How to Cite

Socol, S., & Large, M. (2022). When Should Survey Reminders be Sent Out? An Investigation Into Surveys Analyzing High Schoolers. Journal of Student Research, 11(3). https://doi.org/10.47611/jsrhs.v11i3.2848

Issue

Section

AP Capstone™ Research