Contenuto in:
Capitolo

Clustering students according to their proficiency: a comparison between different approaches based on item response theory models

  • Rosa Fabbricatore
  • Francesco Palumbo

Evaluating learners' competencies is a crucial concern in education, and home and classroom structured tests represent an effective assessment tool. Structured tests consist of sets of items that can refer to several abilities or more than one topic. Several statistical approaches allow evaluating students considering the items in a multidimensional way, accounting for their structure. According to the evaluation's ending aim, the assessment process assigns a final grade to each student or clusters students in homogeneous groups according to their level of mastery and ability. The latter represents a helpful tool for developing tailored recommendations and remediations for each group. At this aim, latent class models represent a reference. In the item response theory (IRT) paradigm, the multidimensional latent class IRT models, releasing both the traditional constraints of unidimensionality and continuous nature of the latent trait, allow to detect sub-populations of homogeneous students according to their proficiency level also accounting for the multidimensional nature of their ability. Moreover, the semi-parametric formulation leads to several advantages in practice: It avoids normality assumptions that may not hold and reduces the computation demanding. This study compares the results of the multidimensional latent class IRT models with those obtained by a two-step procedure, which consists of firstly modeling a multidimensional IRT model to estimate students' ability and then applying a clustering algorithm to classify students accordingly. Regarding the latter, parametric and non-parametric approaches were considered. Data refer to the admission test for the degree course in psychology exploited in 2014 at the University of Naples Federico II. Students involved were N=944, and their ability dimensions were defined according to the domains assessed by the entrance exam, namely Humanities, Reading and Comprehension, Mathematics, Science, and English. In particular, a multidimensional two-parameter logistic IRT model for dichotomously-scored items was considered for students' ability estimation.

  • Keywords:
  • Educational testing,
  • Students' proficiency,
  • Cluster analysis,
  • Multidimensional latent class IRT models,
+ Mostra di più

Rosa Fabbricatore

University of Naples Federico II, Italy - ORCID: 0000-0002-4056-4375

Francesco Palumbo

University of Naples Federico II, Italy - ORCID: 0000-0002-9027-5053

  1. Bartolucci, F., Bacci, S., Gnaldi, M. (2014). MultiLCIRT: An R package for multidimensional latent class item response models. Computational Statistics & Data Analysis, 71, pp. 971–985.
  2. Bartolucci, F., Bacci, S., Gnaldi, M. (2019). Statistical analysis of questionnaires: A unified approach based on R and Stata. Chapman and Hall/CRC, London, (UK).
  3. Chalmers, R.P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of statistical Software, 48(6), pp. 1–29.
  4. Cutler, A., Breiman, L. (1994). Archetypal analysis. Technometrics, 36(4), pp. 338–347.
  5. Davino, C., Fabbricatore, R., Pacella, D., Vistocco, D., Palumbo, F. (2020). Aleas: a tutoring system for teaching and assessing statistical knowledge, in Proceedings of the Second Symposium on Psychology-Based Technologies, eds. O. Gigliotta and M. Ponticorvo, CEUR Workshop Proceedings, 2730.
  6. Dempster, A.P., Laird, N.M., Rubin, D.B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39(1), pp. 1–22.
  7. Eugster M.J.A., Leisch, F. (2009). From Spider-Man to Hero – Archetypal Analysis in R. Journal of Statistical Software, 30(8), pp. 1–23.
  8. Fabbricatore, R., Parola, A., Pepicelli, G., Palumbo, F. (2021). A latent class approach for advising in learning statistics: implementation in the ALEAS system, in Proceedings of the First Workshop on Technology Enhanced Learning Environments for Blended Education - The Italian e-Learning Conference 2021, eds. P. Limone and R. Di Fuccio, CEURWorkshop Proceedings, 2817.
  9. Hubert, L., Arabie, P. (1985). Comparing partitions. Journal of classification, 2(1), pp. 193–218.
  10. MacQueen, J. (1967). Some methods for classification and analysis of multivariate observations, in Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, eds. L. Lecam and J. Neyman, Cambridge University Press, Oakland, (CA), pp. 281–297.
  11. McLachlan, G.J., Peel, D. (2000). Finite mixture models. Wiley-Interscience, New York, (NY).
  12. Schwarz, G. (1978). Estimating the dimension of a model. Annals of statistics, 6(2), pp. 461–464.
  13. Scrucca, L., Fop, M., Murphy, T.B., Raftery, A.E. (2016). mclust 5: clustering, classification and density estimation using Gaussian finite mixture models. The R journal, 8(1), pp. 289–317.
PDF
  • Anno di pubblicazione: 2021
  • Pagine: 43-48

XML
  • Anno di pubblicazione: 2021

Informazioni sul capitolo

Titolo del capitolo

Clustering students according to their proficiency: a comparison between different approaches based on item response theory models

Autori

Rosa Fabbricatore, Francesco Palumbo

Lingua

English

DOI

10.36253/978-88-5518-461-8.09

Opera sottoposta a peer review

Anno di pubblicazione

2021

Copyright

© 2021 Author(s)

Licenza d'uso

CC BY 4.0

Licenza dei metadati

CC0 1.0

Informazioni bibliografiche

Titolo del libro

ASA 2021 Statistics and Information Systems for Policy Evaluation

Sottotitolo del libro

BOOK OF SHORT PAPERS of the on-site conference

Curatori

Bruno Bertaccini, Luigi Fabbris, Alessandra Petrucci

Opera sottoposta a peer review

Anno di pubblicazione

2021

Copyright

© 2021 Author(s)

Licenza d'uso

CC BY 4.0

Licenza dei metadati

CC0 1.0

Editore

Firenze University Press

DOI

10.36253/978-88-5518-461-8

eISBN (pdf)

978-88-5518-461-8

eISBN (xml)

978-88-5518-462-5

Collana

Proceedings e report

ISSN della collana

2704-601X

e-ISSN della collana

2704-5846

233

Download dei libri

328

Visualizzazioni

Salva la citazione

1.388

Libri in accesso aperto

in catalogo

2.597

Capitoli di Libri

4.205.799

Download dei libri

4.979

Autori

da 1067 Istituzioni e centri di ricerca

di 66 Nazioni

70

scientific boards

da 375 Istituzioni e centri di ricerca

di 43 Nazioni

1.304

I referee

da 397 Istituzioni e centri di ricerca

di 38 Nazioni