Skip to content

Commit

Permalink
feat: add codespell (#17)
Browse files Browse the repository at this point in the history
  • Loading branch information
nicoalee authored Aug 3, 2024
1 parent e5ec291 commit 482c46e
Show file tree
Hide file tree
Showing 4 changed files with 230 additions and 47 deletions.
23 changes: 23 additions & 0 deletions .github/workflows/codespell.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
name: Codespell

on:
push:
branches: [master]
pull_request:
branches: [master]

permissions:
contents: read

jobs:
codespell:
name: Check for spelling errors
runs-on: ubuntu-latest

steps:
- name: Checkout
uses: actions/checkout@v4
- name: Codespell
uses: codespell-project/actions-codespell@master
with:
path: src
2 changes: 1 addition & 1 deletion .github/workflows/deploy.yml
Original file line number Diff line number Diff line change
Expand Up @@ -35,4 +35,4 @@ jobs:
# The GH actions bot is used by default if you didn't specify the two fields.
# You can swap them out with your own user credentials.
user_name: github-actions[bot]
user_email: 41898282+github-actions[bot]@users.noreply.github.com
user_email: 41898282+github-actions[bot]@users.noreply.github.com
81 changes: 44 additions & 37 deletions docs/guide/Project/Curation.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,32 +5,32 @@ sidebar_position: 0

# Curation

*Curation* is the first step in creating a meta-analysis, and begins by *searching* for and *importing* studies into the project. Next, you will *review* studies for inclusion based on their relevancy to your research question. This involves **excluding** irrelevant studies, and **including** relevant ones.
_Curation_ is the first step in creating a meta-analysis, and begins by _searching_ for and _importing_ studies into the project. Next, you will _review_ studies for inclusion based on their relevancy to your research question. This involves **excluding** irrelevant studies, and **including** relevant ones.

At the end of the process, you will be ready to create a [**Studyset**](/compose-docs/guide/glossary#studyset) of related studies that are amenable for neuroimaging meta-analysis

## Getting Started

The curation interface uses columns as a way to label studies based on their current status.
The left most column is the starting point and all studies imported into the project will begin there.
The right most column is the **inclusion column** and is the place where studies will go to be included in the meta-analysis.
The curation interface uses columns as a way to label studies based on their current status.
The left most column is the starting point and all studies imported into the project will begin there.
The right most column is the **inclusion column** and is the place where studies will go to be included in the meta-analysis.

The goal is to get studies from the left most starting column, and narrow them down to a final subset of included studies in the right most column.
If a study is not eligible for inclusion at any point, it should be marked as "excluded" before reaching the inclusion column.

The curation step is complete when all studies have been categorized, either by being included or excluded.

When you first begin *Curation*, you will choose between different workflows, which vary in how rigorous or systematic the selection of studies will be.
When you first begin _Curation_, you will choose between different workflows, which vary in how rigorous or systematic the selection of studies will be.

:::tip How specific to be?

Performing a systematic meta-analysis involves a substantial amount of effort. It is up to you, the researcher, how rigorous to be in this process. We reccomend thinking about your *goals* prior to starting this process so that you can have clear inclusion guidelines. If you are looking for an exploratory analysis, we reccomend following the tutorial for *automated meta-analysis*, which replaces manual curation with an automated selection of studies. Note that automated meta-analyses are not a replacement for a careful systematic meta-analysis.
:::
Performing a systematic meta-analysis involves a substantial amount of effort. It is up to you, the researcher, how rigorous to be in this process. We reccomend thinking about your _goals_ prior to starting this process so that you can have clear inclusion guidelines. If you are looking for an exploratory analysis, we reccomend following the tutorial for _automated meta-analysis_, which replaces manual curation with an automated selection of studies. Note that automated meta-analyses are not a replacement for a careful systematic meta-analysis.
:::

### PRISMA Workflow

PRISMA stands for the **Preferred Reporting Items for Systematic Review and Meta-Analyses**. The
[PRISMA guidelines](http://www.prisma-statement.org/?AspxAutoDetectCookieSupport=1) are a set of rules for reporting a
[PRISMA guidelines](http://www.prisma-statement.org/?AspxAutoDetectCookieSupport=1) are a set of rules for reporting a
systematic review, and are the gold standard for producing a proper, rigorous, and transparent meta-analysis.

If you are trying to create a rigorous [PRISMA compliant manual meta-analysis](/compose-docs/tutorial/manual) you will want to select this option.
Expand All @@ -42,14 +42,14 @@ After importing studies into neurosynth, they will be placed into the identifica

:::info PRISMA Summary
The **Identification** column is where all imported studies are deposited into initially. As alluded to by the name, the identification
column is where you identify all records yielded from your search. In this column, you wil exclude studies purely based on whether they are
column is where you identify all records yielded from your search. In this column, you wil exclude studies purely based on whether they are
duplicates of existing studies. All other studies are promoted.

The **Screening** column consists of all records that have been screened for duplicates. In this column, you want to review the titles/abstracts of studies
and exclude purely based on whether they are irrelevant to your research question or domain. All other studies are promoted.
The **Screening** column consists of all records that have been screened for duplicates. In this column, you want to review the titles/abstracts of studies
and exclude purely based on whether they are irrelevant to your research question or domain. All other studies are promoted.

The **Eligibility** column consists of all records that have been screened for duplicates and irrelevant content. In this column, you want to
review the full text of studies and exclude based on whether the study described aligns with the standards of the meta-analysis itself. Reasons
The **Eligibility** column consists of all records that have been screened for duplicates and irrelevant content. In this column, you want to
review the full text of studies and exclude based on whether the study described aligns with the standards of the meta-analysis itself. Reasons
for exclusion may include wrong setting, wrong patient population, wrong intervention, wrong paragdigm, etc.

The **Included** column consists of all records that have passed previous levels of exclusion and can be considered for the next step of the project.
Expand All @@ -65,17 +65,17 @@ This workflow is initalized with only two columns. As before, the left most colu

## Importing

To begin importing studies into your project clicking the **IMPORT STUDIES** button.
To begin importing studies into your project click the **IMPORT STUDIES** button.

You will be asked to choose a source, name your import, and address
You will be asked to choose an import method, source, name for your import, and finally address
any potential duplicate studies.

:::tip
We recommend giving each import a meaningful name. This will be useful when you come back
We recommend giving each import a meaningful name. This will be useful when you come back
and want to know where a certain study was imported from.
:::

### Import from Neurostore
### Import Method 1: Import from Neurostore

Neurostore indexes a large number of neuroimaging studies which are ready for meta-analysis. Studies in Neurostore have been pre-processed, including extracting peak activation coordinates from Tables in the text, and computing semantic features from the abstract/full text. Neurostore also indexes studies which other users have annotated and made available to others for re-use.

Expand All @@ -86,69 +86,72 @@ After entering your search, click the bottom right button to import the searched
Importing from Neurostore can save you a lot of time, as these studies are much more likely to be amenable to meta-analysis, and have pre-extracted coordinates. However, note that some manual annotation may still be required to verify the coordinate extraction, and choose the relevant Analysis (i.e. contrast) for final inclusion.
:::

### Import from PubMed
### Import Method 2: Import from PubMed

Use this option to import studies directly from PubMed. To start, you need to go to the [PubMed Site](https://pubmed.ncbi.nlm.nih.gov/)
and either enter in a search or navigate to a previously created collection.
Use this option to import studies directly from PubMed. To start, you need to go to the [PubMed Site](https://pubmed.ncbi.nlm.nih.gov/)
and either enter in a search or navigate to a previously created collection.

To import the search or collection from PubMed into neurosynth-compose, you will need a text file containing a list of PMIDs.
You can obtain this by going to your collection/search and clicking the **Save** button. Set **Selection** to **All results**
You can obtain this by going to your collection/search and clicking the **Save** button. Set **Selection** to **All results**
and set **Format** to **PMID**. Click **Create file** and your text file containing the PMIDs will be generated and downloaded.

:::caution
Neurosynth-Compose uses the PubMed API to import studies. As a result, the maximum number of PMIDs that can be imported at once is 1,500.
If your collection has more than 1,500 PMIDs, split the import into multiple files.
If your collection has more than 1,500 PMIDs, split the import into multiple files. You can select the same import name so that they are all grouped together.
:::

### Import from BibTex/RIS/endnote
### Import Method 3: Import from BibTex/RIS/endnote

Use this option to import studies via a .bib, .RIS, or .enw file. This may be useful if you want to import from a citation manager like Zotero.

### Custom Studies
### Import Method 4: Custom Studies

If there is any record that cannot be easily imported using one of the methods listed above, you can also manually create a study. This may be necessary
If there is any record that cannot be easily imported using one of the methods listed above, you can also manually create a study. This may be necessary
to include resources like unpublished studies.

### Sleuth files

At the moment, it's not possible to add studies from a sleuth file into an _existing project_. To create a new project from a sleuth file, [read more here](/compose-docs/guide/glossary#studyset).

### Duplicates

If duplicates are detected in your import, you will be asked how to re-concile them by choosing which of the studies to keep by choosing "KEEP THIS STUDY". Matching duplicates will be automatically marked for exclusion. Note that as a user, you can over-ride any of these selection at any time, and choose which studies to keep or exclude.
If duplicates are detected in your import, you will be asked how to reconcile them by choosing which of the studies to keep by choosing "KEEP THIS STUDY". Matching duplicates will be automatically marked for exclusion. Note that as a user, you can override any of these selections at any time, and choose which studies to keep or exclude.

:::info
*Neurosynth Compose* does not delete studies. If a study is marked as a duplicate, it is marked as **excluded** but it is not discarded to ensure complete provenance.
_Neurosynth Compose does not delete studies_. If a study is marked as a duplicate, it is marked as **excluded** but it is not discarded to ensure complete provenance.
:::

There are two potential ways that duplicates can occur:

#### Duplicates are detected between the studies being imported and the studies already in the project

If any study being important has the same title, PMID, or DOI is the same as
If any study being important has the same title, PMID, or DOI is the same as
one already in the project, you will be asked reconcile these duplicates.

Note that if you mark a study that is already promoted as a duplicate, it will be "demoted" back to the first column and marked as "duplicate". It is reccomended to mark as duplicate the incoming study to avoid this.
Note that if you mark a study that is already promoted as a duplicate, it will be "demoted" back to the first column and marked as "duplicate". It is reccomended to mark as duplicate the incoming study to avoid this.

#### Duplicates are detected within the file you are importing

Although rare, it is possible to have duplicates within a given import. For example, if within a RIS file there are duplicate entries. In this case, you will be asked to select which study to keep. Studies marked as duplicates will still be imported but marked as excluded.
Although rare, it is possible to have duplicates within a given import. For example, if within a RIS file there are duplicate entries. In this case, you will be asked to select which study to keep. Studies marked as duplicates will still be imported but marked as excluded.

## Excluding and Promoting Studies

Once studies have been imported into the first column of the curation phase, they need to be reviewed for inclusion into your meta-analysis.
Once studies have been imported into the first column of the curation phase, they need to be reviewed for inclusion into your meta-analysis.
All studies must be either excluded or moved to the inclusion column in order to progress to the extraction phase.

To begin, either click on the button at the top of the column or click on any study in the column. This will open up a page which will show the study
along with the following options: **PROMOTE, NEEDS REVIEW**, and **EXCLUDE**. There is also a button to **ADD TAGS** which will assign an informational tag to the study.
To begin, either click on the button at the top of the column or click on any study in the column. This will open up a page which will show the study
along with the following options: **PROMOTE, NEEDS REVIEW**, and **EXCLUDE**. There is also a button to **ADD TAGS** which will assign an informational tag to the study. This informational tag is a tool that allows you to mark studies with certain information - once an informational tag is created, you can filter by those tags.

### Exclude

To exclude a study, click the **EXCLUDE** button and select the exclusion reason. You can either choose from the preset exclusion reasons or you can begin
To exclude a study, click the **EXCLUDE** button and select the exclusion reason. You can either choose from the preset exclusion reasons or you can begin
typing to create a new one.

:::tip
For the PRISMA workflow, the default exclusion reason wil depend on the phase you are in (identification vs screening vs eligibility), to match the PRISMA guidelines. While we do not recommend it, you can click the arrow button and start typing in the input to create a new exclusion reason.
Revisit the [PRISMA workflow](./Curation#prisma-workflow) to review reccomended exclusion criteria.
:::


### Promote

If a study meets inclusion critera (for the current phase), click **PROMOTE** to move the study forward to the next curation column. If it is moved into the right most inclusion column, then it will be included in the meta-analysis.
Expand All @@ -157,9 +160,13 @@ If a study meets inclusion critera (for the current phase), click **PROMOTE** to
For the first column (especially in a PRISMA workflow) it can be tedious to promote non-duplicates to the next column. If all duplicates have been resolved, you can exit the dialog and click **PROMOTE ALL UNCATEGORIZED STUDIES** to advance all non-duplicate studies to the next column.
:::

## Downloading included studies

In order to download the studies that you have included in Curation, you can utilize our download feature. Go to curation and click "Download Included as CSV". Alternatively, you can click the dropdown and download the included studies in BibTeX format instead.

## On to Extraction

When you have categorized all imported studies by either excluding them or moving them to the inclusion column, then you have
When you have categorized all imported studies by either excluding them or moving them to the inclusion column, then you have
successfully completed the curation portion of the meta-analysis.

*Neurosynth Compose* will detect this and reveal a new button: **MOVE TO EXTRACTION PHASE**. This will move you back to the project page and get you started on the next major component to building your meta-analysis: [extraction](./Extraction).
_Neurosynth Compose_ will detect this and reveal a new button: **MOVE TO EXTRACTION PHASE**. This will move you back to the project page and get you started on the next major component to building your meta-analysis: [extraction](./Extraction).
Loading

0 comments on commit 482c46e

Please sign in to comment.