Bayesian Evidence Synthesis
The informative hypotheses research group works on several replication projects. Since original studies can yield informative hypotheses for the future, informative hypotheses can be used well in the replication context.
Within our group, Mariëlle Zondervan-Zwijnenburg focusses on the replication of original study conclusions (as expressed in informative hypotheses), and Fayette Klaassen developed a method to evaluate the replication of N=1 studies.
Software and instructions by Mariëlle to test the replication of informative hypotheses are provided here.
All the software is licensed under the GNU General Public License Version >=2
To test the replication of ANOVA results Mariëlle Zondervan-Zwijnenburg, Herbert Hoijtink and Rens van de Schoot developed a Shiny application, a CRAN R-package (interactive Shiny environment included), and wrote a methodological article (submitted). Background material for the article can be found at the open science framework repository.
We are also developing methods to test replication in structural equation models (SEM). You can contact us for more information about this project.
============================================================
Fayette Klaassen, Claire Zedelius, Harm Veling, Henk Aarts and Herbert Hoijtink wrote this article that presents a methodology to analyze multiple N=1 datasets.
Using aggregate Bayes factors you can answer the question if a group of individuals is homogeneous with regard to a set of hypotheses. (see the paper for more details)
If you want to analyze your own data using this methodology, you can use the Shiny app One For All, developed by Fayette Klaassen. You can find the accompanying manual here
The software is licensed under the GNU General Public License Version >=2
Reference
Klaassen, F., Zedelius, C. M., Veling, H., Aarts, H., & Hoijtink, H. (2017). All for one or some for all? Evaluating informative hypotheses using multiple N= 1 studies. Behavior Research Methods, 1-16. doi: 10.3758/s13428-017-0992-5