Université de Fribourg

Capitalising on covariates in cluster-randomised experiments

Vanhove, Jan

In: PyArXiv, 2020, p. 1-45

In cluster-randomised experiments, participants are randomly assigned to the conditions not on an individual basis but in entire groups. For instance, all pupils in a class are assigned to the same condition. This article reports on a series of simulations that were run to determine (1) how the clusters (e.g., classes) in such experiments should be assigned to the conditions if a relevant...

Université de Fribourg

Analyzing randomized controlled interventions : Three notes for applied linguists

Vanhove, Jan

In: Studies in Second Language Learning and Teaching, 2015, vol. 5, no. 1, p. 135-152

I discuss three common practices that obfuscate or invalidate the statistical analysis of randomized controlled interventions in applied linguistics. These are (a) checking whether randomization produced groups that are balanced on a number of possibly relevant covariates, (b) using repeated measures ANOVA to analyze pretest-posttest designs, and (c) using traditional significance tests to...

Université de Fribourg

A cautionary tale about control variables in IV estimation

Deuchert, Eva ; Huber, Martin

(Working Papers SES ; 453)

Many instrumental variable (IV) regressions include control variables to justify (conditional) independence of the instrument and the potential outcomes. The plausibility of conditional IV independence crucially depends on the timing when the control variables are determined. This paper systemically works through different IV models and discusses the (conditions for the) satisfaction of...