migrate_islandora_csv

Tutorial for batch ingesting content into Islandora

Steps to setup

Clone isle-dc and clone this repo

$ git clone https://github.com/Islandora-Devops/isle-dc
# Clone this repo
$ git clone https://github.com/DonRichards/migrate_islandora_csv

$ cd migrate_islandora_csv
$ git fetch --all
$ git checkout demo
$ git pull

To test

Change directories to isle-dc. This assumes you have isle-dc running or another docker equivalent and then run the reset script. Reset is a strong handed approach to avoid common issues with configuration & migrations. This rolls back any of the migrations in this module. It resets all of the configurations manually including reinstalling the migration module entirely. Currently this then tries the import process for the all groups found within this module. This script indexes all of the yml files in the config/install directory for the group names and IDs indicated within the files.

$ ../migrate_islandora_csv/reset.sh

Another test

Add a lookup within the migration. Modify data/geo_location.csv file to this.

9,"Another place",,,
504,"Proscenium Thrust, Performance Place",,,"Another place"

Run the Reset and go to https://islandora.traefik.me/admin/structure/taxonomy/manage/geo_location/overview Click edit next to "Proscenium Thrust, Performance Place" and scroll to the botton. Broder should now be an entity reference to "Another Place".

This is a place holder for more complex functions.

To do list

• Setup migration scaffolding
• Create a automated manner to test/run and reset
• Install all prerequisite software needed to run migration and debug (Drupal Console, this module, etc.)
• Setup example collection structure
• Setup example taxonomy migration
• Set Script to dynamically determine the migration names
• Example CSVs with some using all possible fields
• Setup field mapping examples
• Setup field input tolerances (like dates, etc.)
• Identify and process when there is likely to have multiple values (array of inputs like tags)
• [-] Integrate some of the original Lyrasis migration module work.
• Config Export
• RDF mapping import/export
• Mapping in OAI-PMH
• Mapping in Solr fields
• Mapping in Solr schema
• Mapping in Solr config

Some information can be found here at Next Gen Repository Documentation

This is migrating 3 collections from Islandora 7 to 8

Links to Islandora 7 version of digital repository

University Archives Collections (DRUID)

Knoxville Garden Slides

Great Smoky Mountains Regional Collection (pcard00)