A meta-analysis of the Mantel-Haenszel procedure in the detection of DIF in dichotomous items

Abstract

The study describes the present state of research into the effectiveness of the Mantel-Haenszel technique (MH) to detect Differential Item Function ing (DIF) in dichotomous items, and analyses the influence of diverse variables on the statistical power and the Type I error rate. A meta-analysis was performed, running searches in various databases for the terms Differencial Item Functioning, DIF, Mantel-Haenszel and MH, up to 2006. Only studies with simulated data were included. For each study, the correct detections of items with DIF were coded, as well as the false positives. Moderator variables that may affect the procedure under study were also assessed.