Evaluation of a Data Collection Intrument for “Students Learning Styles in an EFL Context”: A Case Study


Authors : Mafuta Mungombo Claude

Volume/Issue : Volume 10 - 2025, Issue 4 - April


Google Scholar : https://tinyurl.com/3u99jc7b

Scribd : https://tinyurl.com/z6a73kmx

DOI : https://doi.org/10.38124/ijisrt/25apr1415

Google Scholar

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.

Note : Google Scholar may take 15 to 20 days to display the article.


Abstract : This article focuses on the assessment of data collection instruments designed to collect data on the topic “STUDENTS LEARNING STYLES IN AN EFL CONTEXT: A CASE STUDY ” for its validity and reliability. The evaluation of the instrument was done by 4 teachers whose 3 males and 1 female of the Languages School of the Faculty of Letters and Human Sciences who were supposed to be knowledgeable on the topic. The instrument used the mixed methods i.e. quantitative and qualitative methods. The qualitative method was converted into quantitative to obtain a more straightforward determination of the overall quality of the instrument. The study shows that there were some questions to improve and to be reformulated. Overall, from what our respondents have said, we can say that the instrument was valid and be administered to respondents for data collection on this issue.  Resume: Cet article se concentre sur l'évaluation de l’instrument de la collecte de données conçu pour collecter les données sur le sujet “LE STYLES D’APPRENTISSAGE DANS UN CONTEXT D’ANGLAIS COMME LANGUE ETRANGERE : CAS D’ETUDE ” pour sa validité et fiabilité. L'évaluation de l'instrument a été faite par 4 Enseignants dont 3 hommes et 1 femme de l'Ecole de Langues de la Faculté des Lettres et Sciences humaines qui sont supposés avoir des connaissances sur le sujet. L'instrument a utilisé les méthodes mixtes c-à-d. la méthode quantitative et la méthode qualitative. La méthode qualitative a été convertie en méthode quantitative pour obtenir une détermination la plus franche de la qualité globale de l'instrument. Après l’évaluation de l’instrument par les répondants, il ressort qu'il y a quelques questions à améliorer et à reformuler. De manière générale, de ce que nos répondants ont dit, nous pouvons dire que l'instrument était valide et peut être administrés aux répondants pour la collecte de données sur cette question.

Keywords : Learning Style, EFL.

References :

  1. Barrett, Paul  ( 2001). Assessing the Reliability of Rating Data     
  2. Bresciani, Marilee J., Oakleaf, Megan, Kolkhorst, Fred, Nebeker, Camille, Barlow, Jessica, Duncan, Kristin, and Hickmott, Jessica  (2009). Examining Design and Inter-Rater Reliability of a Rubric Measuring Research Quality across Multiple Disciplines. Practical Assessment, Research & Evaluation, 14(12). Available online: http://pareonline.net/getvn.asp?v=14&n=12.
  3. Brewer, B.W.( 2002).  Avondoglio JB, Cornelius A. E et al. Construct validity and interrater agreement of the Sport Injury Rehabilitation Adherence Scale. Journal  Sport and  Rehabilitation 11:170-178.
  4. Bryman, A. (2006): Integrating quantitative and qualitative research: how is it done? Qualitative Research doi:10.1177/1468794106058877
  5. Kimberlin Carole l. and almut Winterstein G. (2008). Validity and reliability of measurement instruments used in research . Am J Health-Syst Pharm—Vol 65   
  6. Cohen, J. (1960). A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement, 20, 37 – 46.
  7. Gwet, L. (2008). Computing Inter-Rater Reliability and its Variance in the Presence of High Agreement. British Journal of Mathematical and Statistical Psychology, 61, 29 – 48.
  8. Gwet, L. (2010). The Handbook of Inter-Rater  Reliability. Gaithersburg: Advanced Analytics.
  9. Hallgren , Kevin A. Computing Inter-Rater Reliability for Observational Data:  An Overview and Tutorial Tutorials in Quantitative Methods for Psychology 2012, Vol. 8(1), p. 23-34.
  10. Havercamp,Susan Evaluating the Reliability and Validity of the  Questionnaire for Situational Information:  Test-Retest Reliability  Final Report
  11. Inter-rater Agreement for Nominal/Categorical Ratings. http//: _________
  12. Inter-rater Agreement for Ranked Categories of Ratings. http//: __________
  13. Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14–26. (Also available online at http://aera.net/publications/?id=338)
  14. Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1(2), 112-133.
  15. Kathy J. Rye,  Commissioner Incorporating Inter-Rater Reliability into Your Curriculum. www.coarc.com
  16. Kilem Li Gwet (2008)   Computing inter-rater reliability and its variance in the presence of high agreement. British Journal of Mathematical and Statistical Psychology (2008), 61, 29–48
  17. Matthew Graham , Anthony Milanowski, Jackson Miller, & Westat (February 2012 ) Measuring and Promoting  Inter-Rater Agreement  of Teacher and Principal  Performance Ratings. Center for Educcation Compensation Reform (CECRF)
  18. McCray, G, (2013) Assessing inter-rater agreement for nominal judgement variables. Paper presented at the Language   Testing Forum. Nottingham, November 15-17.
  19. Rust,  Roland (2001)Interrater Reliability.  Journal Of Consumer Psychology, 10(1&2), 71–73
  20. STURGILL,  LYNNE P.,  Lynn Snyder Mackler , Tara Jo  Manal, &  Michael J. Axe, (2009Interrater Reliability of a Clinical Scale to Assess Knee Joint Effusion. Journal of Orthopaedic  &  Sports Physical Therapy , Volume 39   number 12  december 2009  pp.  845-849. Doi: 10. 2519/jospt.
  21. Walsh P, Thornton J, Asato J, Walker N, McCoy G, Baal J, Baal J, Mendoza N, Banimahd F. (2014) Approaches to describing inter-rater reliability of the overall clinical appearance of febrile infants and toddlers in the emergency department. PeerJ 2:e651 https://dx.doi.org/10.7717/peerj.651
  22. Zegers,  Frits E.  Coefficients for Interrater Agreement. Applied Psychological Measurement Vol.  15,  No. 4, December 1991, Pp. 321-333
  23. Walsh P, Thornton J, Asato J, Walker N, McCoy G, Baal J, Baal J, Mendoza N, Banimahd F. (2014) Approaches to describing inter-rater reliability of the overall clinical appearance of febrile infants and toddlers in the emergency department. PeerJ 2:e651 https://dx.doi.org/10.7717/peerj.651.

This article focuses on the assessment of data collection instruments designed to collect data on the topic “STUDENTS LEARNING STYLES IN AN EFL CONTEXT: A CASE STUDY ” for its validity and reliability. The evaluation of the instrument was done by 4 teachers whose 3 males and 1 female of the Languages School of the Faculty of Letters and Human Sciences who were supposed to be knowledgeable on the topic. The instrument used the mixed methods i.e. quantitative and qualitative methods. The qualitative method was converted into quantitative to obtain a more straightforward determination of the overall quality of the instrument. The study shows that there were some questions to improve and to be reformulated. Overall, from what our respondents have said, we can say that the instrument was valid and be administered to respondents for data collection on this issue.  Resume: Cet article se concentre sur l'évaluation de l’instrument de la collecte de données conçu pour collecter les données sur le sujet “LE STYLES D’APPRENTISSAGE DANS UN CONTEXT D’ANGLAIS COMME LANGUE ETRANGERE : CAS D’ETUDE ” pour sa validité et fiabilité. L'évaluation de l'instrument a été faite par 4 Enseignants dont 3 hommes et 1 femme de l'Ecole de Langues de la Faculté des Lettres et Sciences humaines qui sont supposés avoir des connaissances sur le sujet. L'instrument a utilisé les méthodes mixtes c-à-d. la méthode quantitative et la méthode qualitative. La méthode qualitative a été convertie en méthode quantitative pour obtenir une détermination la plus franche de la qualité globale de l'instrument. Après l’évaluation de l’instrument par les répondants, il ressort qu'il y a quelques questions à améliorer et à reformuler. De manière générale, de ce que nos répondants ont dit, nous pouvons dire que l'instrument était valide et peut être administrés aux répondants pour la collecte de données sur cette question.

Keywords : Learning Style, EFL.

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe