Misconduct and Questionable Research Practices: The Ethics of Quantitative Data Handling and Reporting in Applied Linguistics
Abstract
Scientific progress depends on the integrity of data and research findings. Intentionally distorting research data and findings constitutes scientific misconduct and introduces falsehoods into the scientific record. Unintentional distortions arising from questionable research practices (QRPs), such as unsystematically deleting outliers, pose similar obstacles to knowledge advancement. To investigate the extent of misconduct and QRPs in quantitative applied linguistics research, we surveyed 351 applied linguists who conduct quantitative research about their practices related to data handling and reporting. We found that 17% of respondents (approximately 1 in 6) admitted to 1 or more forms of scientific misconduct and that 94% admitted to 1 or more QRPs relevant to quantitative research. We also examined these practices in relation to participant background and training. Researchers admitting to misconduct tended to be earlier in their careers and had experienced publication rejection due to lack of statistically significant results. Quantitative training had generally desirable associations with QRPs. Publication rate and experience with publication rejection were associated with admission of several QRPs related to omitting statistical results. We discuss these findings and offer 5 recommendations for the field of applied linguistics to improve ethical quantitative data handling and reporting in research.