Project: NIH CAFE

[cmbz]

Overview

Activities and tasks related to our participation in the NIH CAFE project. Work includes biomedical metadata support and geospatial support and data curation.

CAFE Team Requests

• Activity: CAFE team requests #358

Development Issues

CAFE Team Development Requests

• Implement Dropdown Selector for NIH Controlled Vocabulary in Keywords dataverse.harvard.edu#267
• Feature Request/Idea: ISO 19115 versus Dataverse Geospatial Metadata Block (Proposed Changes) dataverse#10398 (2024-12-09, Pending)
• Ensure Visibility of Non-Required Metadata Blocks on Dataset Creation dataverse#10476 (2024-12-09, In Progress)
• Conditionally Required Entries in Custom Metadata Blocks dataverse#10576 (2024-12-09, Sprint Ready)
• Allow Multiple Data Sources in Custom Metadata Block dataverse.harvard.edu#287 (2025-01-22, This Sprint)

Other Related Issues

• Add Data Curation Tool to Harvard Dataverse Repository dataverse.harvard.edu#32 (@cmbz checked on release status on 2024/12/03, no new release available yet)
• Add support for OAI-harvesting from DataCite dataverse#10909 (2024-11-23, In Progress)
• Feature Request/Idea: Native API access to upload collection logos and Theme specifications  dataverse#10194
• As a Dataverse collection admin, I want to use the UI to link harvested datasets into my collection dataverse#4025 (2024-12-04, Functionality available in API, not UI until post-SPA)

Complete

• Implement Dropdown for Dataset Tagging in Metadata dataverse#10743
• Add "Submit for Review" Option for Datasets Uploaded by CAFE Admin dataverse#10577
• For harvesting, allow advanced feature of using listRecords vs ListIdentifiers dataverse#10936
• Allow Harvesting to use arbitrary sets dataverse#10937
• Searchable Facets: Searchable facets displayed for CAFE collection should reflect the metadata in the searchable facets dialogue box EDIT-General Information dataverse.harvard.edu#265
• Zip files containing "shape file" folder should successfully upload  dataverse#9384
• ".qpj" file taken out of QGIS Shapefile zip dataverse#8134
• Load updated custom CAFE metadata block (displayname changed from "Metadata About Data Location" to "Metadata About Geospatial Files") to demo and prod dataverse.harvard.edu#244
• File Upload: file upload for collection with metadblocks that have required, single, controlled vocab fails dataverse#10385
• Geospatial metadata block > bounding box coordinates fields > tool tips are INCORRECT and mention use of commas dataverse#10397
• Geospatial Search behavior dataverse#9798

Related

• Epic: NIH CAFE Grant Tasks #157 (closed on 2024/03/20, in favor of current tracking issue)
• https://github.com/IQSS/dataverse-HDV-Curation/issues/500

Resources

• Customization and Improvement of Dataverse for the CAFE Project
• Google Drive Folder
• Development Issue Tracker: https://github.com/orgs/IQSS/projects/34/views/32

---

Curation Issues

Pursuing Collaborations with:

• http://wellcome.org/
• https://openclimatecampaign.org/

[cmbz]

March 2024

The following issue was completed:

• ".qpj" file taken out of QGIS Shapefile zip dataverse#8134

Additional issues were identified and added for future sprints:

• File Upload: file upload for collection with metadblocks that have required, single, controlled vocab fails dataverse#10385
• Geospatial metadata block > bounding box coordinates fields > tool tips are INCORRECT and mention use of commas dataverse#10397
• Feature Request/Idea: ISO 19115 versus Dataverse Geospatial Metadata Block (Proposed Changes) dataverse#10398
• Feature Request/Idea: Native API access to upload collection logos and Theme specifications  dataverse#10194

[cmbz]

April 2024

Development

• A new document Customization and Improvement of Dataverse for the CAFE Project was created to capture and address user feedback from the CAFE team.

Additional issues created for future sprints. Sizing underway:

• Implement Dropdown Selector for NIH Controlled Vocabulary in Keywords dataverse.harvard.edu#267
• Ensure Visibility of Non-Required Metadata Blocks on Dataset Creation dataverse#10476
• Integrate Geographic Unit Field into Geographic Coverage Metadata Block dataverse#10502
• Searchable Facets: Searchable facets displayed for CAFE collection should reflect the metadata in the searchable facets dialogue box EDIT-General Information dataverse.harvard.edu#265

[cmbz]

May 2024

• Conditionally Required Entries in Custom Metadata Blocks dataverse#10576
• Add "Submit for Review" Option for Datasets Uploaded by CAFE Admin dataverse#10577
• Alexis': Monthly Summary - May 2024

[cmbz]

Status: June 2024

Curation

• Finalized the CAFE acquisition template this month and have sent out 12 Acquisition Letters (still pending),
• 4 new Datasets have been shared through CAFE,
• Generating statistics and identifying key datasets from the HDR every month for the CAFE newsletter
• The team is planning a meeting in July to discuss a website revamp
• The team is focused on identifying tutorials that have been created by other organizations but are also relevant to CAFE that can be shared on the CAFE website/GitHub

Development

• Alexis' Monthly Summary - June 2024

[cmbz]

Status: July 2024

Curation

• Allow Multiple Data Sources in Custom Metadata Block dataverse.harvard.edu#287
• Allow Multiple Images for Header and Footer Logos dataverse#10693
• 7 more Acquisition letters were sent out
• 3 new Datasets have been shared through CAFE
• Website requirements were collected during the revamp meeting to be delivered to website development team
• We created a template that is undergoing review to share NIH funded research projects through CAFE, this includes P20 grant funded projects as well as other NIH funded projects
• The newsletter this month featured a more targeted blurb to push for additional contributions from the climate and health community
• The team met with Stefano earlier today and reached a consensus to use CAFE as both a repository and a catalogue, and will include a way to easily filter datasets accordingly

Development

• Alexis' Monthly Summary - July 2024

[cmbz]

Status: August 2024

• New issue created: Implement Dropdown for Dataset Tagging in Metadata dataverse#10743
• The team is preparing a PowerPoint for the NIH and CAFE all-hands meeting in early September, this PowerPoint summarizes CAFE's accomplishments over the last year and plans for the upcoming year.
• The Dataverse team met with RAPID and are in the early stages of creating a harvested sub-collection for their data
• The CAFE team is working with NIH to develop documentation to recommend that NIH researchers share their datasets in the CAFE collection on Dataverse
• The team is working on an outreach to Climate Change AI on creating a subcollection

Development

• Alexis' Monthly Summary - August 2024

[cmbz]

Status: September 2024

• The CAFE team is working on an updated version of the DMSP, which will be linked in an outreach to recommend NIH and P20 researchers deposit data into the CAFE collection on the Harvard Dataverse Repository.
• The CAFE team is defining what information README files should contain for CAFE datasets.
• The team is identifying metadata fields they would like 'hidden' on datasets in the CAFE collection, to reduce confusion on some duplicated fields (due to custom metadata blocks).
• Meetings with RAPID and DesignSafe have established interest in harvesting. Another meeting is set for the beginning of November to continue these conversations.

Development

• Alexis' Monthly Summary - September 2024

[cmbz]

Status: October 2024

• Note: small metadata fix is in progress to improve DDI metadata exports: File description metadata of ingested files are not in the DDI exported metadata dataverse#5051
• The Dataverse team met on 2024/10/15 to review, discuss, and decide next steps for several open development issues

DesignSafe

• CAFE project team with DesignSafe to discuss dataset harvesting.
• A DesignSafe metadata mapping table was created

Curation

• Follow-up meeting held with RAPID and DesignSafe, metadata passed through DataCite has been mapped to fields in CAFE, meeting will be held in December to work on getting additional metadata from DesignSafe passed to DataCite
• Completed DMSP draft and sent to NISH team for review. Received feedback from NISH which led to a redirection, where the skeleton will be scrapped, example DMSPs will be provided along with the README document that is currently in progress and a guidelines document.
• Identifying metadata fields to be hidden is still in progress.

Development

• Create customCAFEAdditionalData metadata block with CCH Terms field dataverse.harvard.edu#318
• Alexis' Monthly Summary - October 2024

[cmbz]

Status: November 2024

Curation

• Met with Monica and Taylor with Open Climate Campaign, who sent over a list of organizations who may be open to sharing their data through harvested collections through CAFE
• Team is considering which data is relevant and will reach back out to Taylor to schedule another meeting to move forward on this collaboration.
• Next meeting with RAPID and DesignSAFE is scheduled for December 18th.
• Team is currently importing a large India dataset into a sub-collection on CAFE.
• P20 data kickoff is scheduled for December 16th, and is expected to lead to another sub-collection on CAFE.

Development

• Create customCAFEAdditionalData metadata block with CCH Terms field dataverse.harvard.edu#318
• Add "Submit for Review" Option for Datasets Uploaded by CAFE Admin dataverse#10577
• Implement Dropdown for Dataset Tagging in Metadata dataverse#10743
• Allow Multiple Images for Header and Footer Logos dataverse#10693
• Alexis' Monthly Summary - November 2024

[cmbz]

Status: December 2024

• Created new non-development related punch list of CAFE team requests: Activity: CAFE team requests #358 to support tracking
• Moved to weekly team meetings starting January 2025

Curation

• Sonia set up the CAFE Datathon collection for deposits
• Leonid created draft DesignSafe Harvested collection and harvested 3 datasets. The DesignSafe team is working out bugs with the keywords that are being passed through DataCite.
• Held Datathon event where members of the CAFE community came together to preserve data from various organizations that are at risk of defunding.
• Linked relevant air pollution related datasets and collections already in HDV to CAFE collection.
• Gained approval from Danielle to pursue harvesting efforts with Geo KnowledgeHub, Copernicus Dataspace, and ASDI Data from Amazon Open Data into CAFE. Other collections from the Open Climate Campaign will be pursued as HDV efforts outside of CAFE.

Development

• Ensure Visibility of Non-Required Metadata Blocks on Dataset Creation dataverse#10476
• Implement Dropdown Selector for NIH Controlled Vocabulary in Keywords dataverse.harvard.edu#267

[cmbz]

Status: January 2025

• Several harvesting demos for DesignSafe/CAFE were created. See: Harvesting metadata from DataCite for CAFE project dataverse.harvard.edu#331 (comment)
• Sonia meeting with Jonathan Gilmour next week on large data support related to CAFE (collab project with Steve Alsonbhere)-large data intake form already submitted

Development

• Implement Dropdown Selector for NIH Controlled Vocabulary in Keywords dataverse.harvard.edu#267
• Create customCAFEAdditionalData metadata block with CCH Terms field dataverse.harvard.edu#318
• Install customCAFEAdditionalData Metadata Block on Harvard Dataverse dataverse#11155

[cmbz]

Status: February 2025

• Metadata harvesting from DataCite for CAFE project was completed:
  • Harvesting metadata from DataCite for CAFE project dataverse.harvard.edu#331

Development

• Ensure Visibility of Non-Required Metadata Blocks on Dataset Creation dataverse#10476

• 10476 display on create field option dataverse#11224

• Add displayOnCreate field configuration in collection settings dataverse#11221

• NcML previewer not working dataverse#11252

• Add H5Web Previewer to Harvard Dataverse (Demo) dataverse.harvard.edu#336

• Custom metadata block not displaying in dataset creation due to template issue dataverse#11214 (workaround applied)