Data collection is only the start
Once the data are available from a study there are still a number of steps that must be undertaken to get them into shape for analysis.
One of the most misunderstood parts of the analysis process is the data preparation stage. To say that 70% of any analysis is spent on the data management stage is not an understatement.
![]()
Example workflow
Generating a reproducible workflows
Reproducibility is the ability for any researcher to take the same data set and run the same set of software program instructions as another researcher and achieve the same results.
Not the same as replicability where you re-run an experiment and achieve the same outcomes.
The goal is to create an exact record of what was done to a data set to produce a specific result.
Three steps to achieve reproducibility
- The un-processed data are connected directly to software code file(s) that perform data preparation techniques.
- The processed data are connected directly to other software code file(s) that perform the analyses.
- All data and code files are self-contained such that they could be given to another researcher to execute the code commands on a separate computer and achieve the same results as the original author.
Literate programming
- Explain the logic of the program or analysis process in a natural language,
- Small code snippets included at each step act as a full set of instructions that can be executed to reproduce the result/analysis being discussed.
- Literate programming tools such as Markdown and \(\LaTeX\) are integrated into all common statistical packages except SPSS.
Example Quarto Document
Reproducible Research + Literate Programming
- Practicing reproducible research techniques using literate programming tools allows such major updates to be a simple matter of re-compiling all coded instructions using the updated data set.
- The effort then is reduced to a careful review and update of any written results.
- Using literate programming tools create formatted documents in a streamlined manner that is fully synchronized with the code itself.
- The author writes the text explanations, interpretations, and code in the statistical software program itself, and the program will execute all commands and combine the text, code and output all together into a final dynamic document.
Why all the fuss?
- You are your own collaborator 6 months from now. Be nice to your future self
- Explain your steps (the WHY more than the what)
- How did you get from point A to B?
- Why did you recode this variable in this manner?
- Found an error in your analysis code? Need to add an analysis to your presentation?
- Reproduce your steps in a few clicks using a script file (
.R, .Rmd, .sas, .sps, .do, .ipynb)
Data Analysis Pipeline
Regardless of the programming language you choose to use, using scripts will make this process reproducible and more powerful with less pain points.
Quarto as an end-to-end solution
- https://quarto.org/
- Supports R, Python, Observable and Julia
- “Next Generation” R Markdown files
- Publish reproducible, production quality articles, presentations, dashboards, websites, blogs, and books in HTML, PDF, MS Word, ePub, and more.
- Write using Pandoc markdown, including equations, citations, crossrefs, figure panels, callouts, advanced layout, and more.
