-
Notifications
You must be signed in to change notification settings - Fork 16
/
Copy pathREADME.Rmd
171 lines (129 loc) · 6.99 KB
/
README.Rmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
---
output: github_document
---
<!-- README.md is generated from README.Rmd. Please edit that file -->
```{r, echo = FALSE}
knitr::opts_chunk$set(
collapse = TRUE,
comment = "#>",
fig.path = "README-"
)
```
# codebook
[](https://app.travis-ci.com/rubenarslan/codebook)
[](https://cran.r-project.org/package=codebook)
[](https://app.codecov.io/gh/rubenarslan/codebook)
[](https://zenodo.org/badge/latestdoi/109252375)
_Automatic Codebooks from Metadata Encoded in Dataset Attributes_
## Description
Easily automate the following tasks to describe data frames:
- summarise the distributions, and labelled missings of variables graphically and using descriptive statistics
- for surveys, compute and summarise reliabilities (internal consistencies, retest, multilevel) for psychological scales,
- combine this information with metadata (such as item labels and labelled values) that is derived from R attributes.
To do so, the package relies on 'rmarkdown' partials, so you can generate HTML, PDF, and Word documents. Codebooks are also available as tables (CSV, Excel, etc.) and in JSON-LD, so that search engines can find your data and index the metadata.
## Generate markdown codebooks from the attributes of the variables in your data frame
RStudio and a few of the tidyverse package already usefully display the information contained in the attributes of the variables in your data frame. The [haven](https://github.com/tidyverse/haven) package also manages to grab variable documentation from SPSS or Stata files.
## RStudio Addin
If the RStudio data viewer scrolls slow for your taste, or you'd like to keep the variable labels in view while working, use our RStudio Addins (ideally assigned to a keyboard shortcut) to see and search variable and value labels in the viewer pane.
## Codebook generation
The codebook package takes those attributes and the data and tries to produce a good-looking codebook, i.e. a place to get an overview of the variables in a dataset. The codebook processes single items, but also "scales", i.e. psychological questionnaires that are aggregated to extract a construct. For scales, the appropriate reliability coefficients (internal consistencies for single measurements, retest reliabilities for repeated measurements, multilevel reliability for multilevel data) are computed.
For items and scales, the distributions are summarised graphically and numerically.
This package integrates tightly with formr ([formr.org](https://formr.org)), an online survey framework and especially the data frames produced and marked up by the [formr R package](https://github.com/rubenarslan/formr). However, codebook is completely independent of it.
## Documentation
Confer the help or: https://rubenarslan.github.io/codebook/.
See the [vignette](https://rubenarslan.github.io/codebook/articles/codebook.html) for a quick example of an HTML document generated using `codebook`, or below for a copy-pastable rmarkdown document to get you started.
## Use as a webapp
If you don't want to install the codebook package, you can just upload an annotated dataset in a variety of formats (R, SPSS, Stata, ...) here: https://codebook.formr.org
## Use locally
### Install
Run the following in R.
```r
install.packages("codebook")
```
Or to get the latest development version:
```r
install.packages("remotes")
remotes::install_github("rubenarslan/codebook")
```
Then run the following to get started:
```r
library(codebook)
new_codebook_rmd()
```
## Citation
To cite the package, you can cite the open access paper, but to make your codebook
traceable to the version of the package you used, you might also want to cite
the archived package DOI.
### Paper
> Arslan, R. C. (2019). How to automatically document data with the codebook package to facilitate data re-use. Advances in Methods and Practices in Psychological Science. [doi:10.1177/2515245919838783](https://doi.org/10.1177/2515245919838783)
### Zenodo
> Arslan, R. C. (2024). Automatic codebooks from survey metadata (2018). URL https://github.com/rubenarslan/codebook. [](https://zenodo.org/badge/latestdoi/109252375)
### How to use
Here's a simple rmarkdown template, that you could use to get started.
The resulting codebook will be an HTML file, but you can also choose to generate PDFs or Word files by fiddling with the `output` settings.
````markdown
---
title: "Codebook"
output:
html_document:
toc: true
toc_depth: 4
toc_float: true
code_folding: 'hide'
self_contained: true
pdf_document:
toc: yes
toc_depth: 4
latex_engine: xelatex
---
```{r setup}`r ''`
knitr::opts_chunk$set(
warning = TRUE, # show warnings during codebook generation
message = TRUE, # show messages during codebook generation
error = TRUE, # do not interrupt codebook generation in case of errors,
# usually makes debugging easier, and sometimes half a codebook
# is better than none
echo = FALSE # don't show the R code
)
ggplot2::theme_set(ggplot2::theme_bw())
```
Here, we import data from formr
```{r}`r ''`
library(formr)
source(".passwords.R")
formr_connect(email = credentials$email, password = credentials$password)
codebook_data <- formr_results("s3_daily")
```
But we can also import data from e.g. an SPSS file.
```{r}`r ''`
codebook_data <- rio::import("s3_daily.sav")
```
Sometimes, the metadata is not set up in such a way that codebook
can leverage it fully. These functions help fix this.
```{r codebook}`r ''`
library(codebook) # load the package
# omit the following lines, if your missing values are already properly labelled
codebook_data <- detect_missing(codebook_data,
only_labelled = TRUE, # only labelled values are autodetected as
# missing
negative_values_are_missing = FALSE, # negative values are NOT missing values
ninety_nine_problems = TRUE, # 99/999 are missing values, if they
# are more than 5 MAD from the median
)
# If you are not using formr, the codebook package needs to guess which items
# form a scale. The following line finds item aggregates with names like this:
# scale = scale_1 + scale_2R + scale_3R
# identifying these aggregates allows the codebook function to
# automatically compute reliabilities.
# However, it will not reverse items automatically.
codebook_data <- detect_scales(codebook_data)
```
Now, generating a codebook is as simple as calling codebook from a chunk in an
rmarkdown document.
```{r}`r ''`
codebook(codebook_data)
```
````
## [Code of conduct for contributing](https://github.com/rubenarslan/codebook/blob/master/CONDUCT.md)