ESS-DIVE

Deep Insight for Earth Science Data

ESS-DIVE Training Events

ESS-DIVE Community Data Workshop 2022

Collaborative Data Management to Advance Environmental System Science

ESS-DIVE had their Community Data Workshop on Collaborative Data Management to Advance Environmental System Science in November 2022. During this workshop, attendees learned about:

  • Publishing data for your BER ESS project;
  • ESS-DIVE features, data, and vision; 
  • How others in the community manage and publish project data, and discuss needs; 
  • How to use ESS-DIVE and features for collaborative data management; and
  • How to organize and curate high-quality datasets.

The two-day workshop took place on Wednesday and Thursday, November 9-10, 2022 from 9am – 2pm PST (12pm – 5pm EST).

You can request access to videos and presentations by contacting ess-dive support (ess-dive-support@lbl.gov).

Wednesday, November 9, 2022
09:00AM
11:30AM 

(All times listed in PDT)

 Opening Session: 

  • Welcome, introductions, logistics  (Deb Agarwal)
  • BER remarks on ESS program data management (Dan Stover, Jay Hnilo)
  • ESS-DIVE features  (Shreyas Cholia)
  • ESS-DIVE data and vision (Charu Varadharajan)
  • Engaging with ESS-DIVE on data management  (Joan Damerow)
  • Q&A

10 min break

ESS Project Data Presentations: ESS projects that have published many datasets in ESS-DIVE discuss their overall project data management approach, and how they create and publish datasets.  

  • Terri Velliquette (ORNL): NGEE-Arctic & Terrestrial Ecosystem Science SFA including the experiment Spruce and Peatland Responses Under Changing Environments (SPRUCE)
  • Gilberto Pastorello (LBNL): NGEE-Tropics
  • Amy Goldman (PNNL): Worldwide Hydrobiogeochemical Observation Network for Dynamic River Systems (WHONDRS)
  • Madison Burrus (LBNL): Watershed Function SFA
  • Will Rudisill (Boise State University): Model-Data Fusion to Examine Multiscale Dynamical Controls on Snow Cover and Critical Zone Moisture Inputs
  • Nicole Lau (UC Berkeley): Subalpine and Alpine Species Range Shifts with Climate Change
  • Gil Bohrer (Ohio State University): Functional-type modeling approach and data-driven parameterization of methane emissions in wetland
11:30AM 
12:00PM
 Break 
12:00PM 
02:00PM
 Understanding Project Needs for Managing and Publishing Data* – Breakout Discussions     

ESS-DIVE team members will lead discussions on how we can address data management and publication needs as a community. Topics include: project data management approaches, number of datasets produced by projects, challenges with publication, and successes.

*Attendees will be randomly assigned to a smaller breakout room

 

Thursday, November 10, 2022
09:00AM
10:30AM

 

 

 

 

10:40AM
11:30AM

 

 

 ESS-DIVE How-To Tutorials (Choose one)** 

  • ESS-DIVE for Data Submitters (Emily Robles)
    • Organize and submit datasets
    • Online Form: for data file upload less than 10GB
    • API: for large, bulk and complex data upload
  • ESS-DIVE for Data Users (Madison Burrus)
    • Online Portal: dataset search and discovery
    • API: bulk download and search summary

10 min break

Managing Data on ESS-DIVE (Joan Damerow, Charu Varadharajan)

  • Portals, Dataset collaboration, and Project Spaces 
    • Manage team members and editing permissions 
    • View and access project dataset collection with portals
  • Link datasets to external data sources
11:30AM 
12:00PM
 Break
12:00PM 
1:45PM
 Organizing and Curating High-Quality Datasets 

  • Data organization and ESS-DIVE reporting formats
  • Community examples of curating datasets and workflows
    • Dylan O’Ryan (LBNL): Watershed Function SFA
    • Ricardo Eloy Alves (LBNL): LBNL TES SFA 
    • Brieanne Forbes (PNNL): WHONDRS 
    • Stephanie Pennington (PNNL): Coastal Observations, Mechanisms, and Predictions Across Systems and Scales (COMPASS)

Tutorial: Getting Started with ESS-DIVE Reporting Formats 

  • Choose which reporting formats to use and workflow
  • Describe, format, and use standardized data files
  • Q&A, Polls: Needs for adopting community reporting formats
01:45PM
02:00PM
 Workshop Wrap Up

**Attendees to choose their own breakout sessions in zoom.

You can request access to videos and presentations by contacting ess-dive support (ess-dive-support@lbl.gov).

DOE ESS PI Meeting Training Sessions

ESS-DIVE presented training sessions at the annual Environmental System Science (ESS) Program Principal Investigators Meeting that began on Tuesday, May 24, 2022, and concluded on Thursday, May 26, 2022. The ESS-DIVE team presented at multiple sessions at this virtual meeting hosted by the U.S. Department of Energy. 

On Tuesday, May 24, 2022 the ESS-DIVE team presented the following hands-on data management trainings from 1:30 pm – 3:30 pm ET that will help you better understand and use various ESS-DIVE features for managing project data. Here are more details:

ESS-DIVE Overview [Presentation Slides]

Presenter: Charuleka Varadharajan and Team

Main room

Introduction to ESS-DIVE before breakout sessions.

New user bootcamp [Presentation Slides]

Presenter: Emily Robles

Breakout room A

Learn how to upload and publish data with ESS-DIVE as a new contributor in this hands-on training session. We will go over the process for publishing data on ESS-DIVE, from important considerations for organizing data and accompanying metadata, to requesting publication and following the dataset review process. We will also discuss how to utilize the ESS-DIVE main portal search features and download data.

Project data management [Presentation Slides]

Presenters: Charuleka Varadharajan and Madison Burrus

Breakout room B

This session is designed for PI’s and data managers who want to learn how to manage project data on ESS-DIVE. We will first provide an overview of how ESS-DIVE can support a project’s data management needs. We will then describe how projects can use ESS-DIVE features to curate and manage data including: (1) a package Service API for bulk programmatic dataset creation and editing (2) sharing datasets with project members for collaborative editing and review. (3) linking data on ESS-DIVE to related datasets on other public data repositories (4) portals to showcase data collections, and (5) an upcoming feature to manage project members and data. 

ESS-DIVE data formats [Presentation Slides / View Recording of Session]

Presenters: Robert Crystal-Ornelas and Dylan O’Ryan

Breakout room C 

In this session, we will discuss ways that researchers can make research data more reusable using ESS-DIVE’s 11 community data and metadata formats. These data formatting templates apply to many data types relevant to earth and environmental science research. They include general formats that apply to many data types (CSV files, file-level metadata, locations, samples, model data), and formats for specific data types (water and sediment chemistry, sensor-based hydrological monitoring, leaf-level gas exchange, soil respiration, and amplicon abundance). In this session, participants will apply the reporting formats to tabular data, and hear from researchers who are currently using reporting formats on their own environmental data and metadata.

ESS-DIVE Community Data Workshop 2021

Jump-start and build your environmental data management and sharing for DOE ESS-funded projects.

Registration for this event is closed, thank you to everyone who joined us for the ESS-DIVE Community Data Workshop. Workshop presentations and materials can be accessed through our 2021 workshop GitHub repository.

Join us for the ESS-DIVE Community Data Workshop to start and build your DOE Environmental Systems Science (ESS) project data management and sharing efforts. During this workshop, you can expect to learn about:

  • DOE ESS project data management and review process; 
  • How to use ESS-DIVE and updates on features;
  • Standard reporting formats that make data more discoverable and usable;
  • How others in the community manage and share data;
  • Other data-related topics important to our community.

The two-day workshop will take place on Monday and Tuesday, May 24-25, 2021 from 9am – 2pm PST (12pm – 5pm EST). While we encourage attending both days to gain the most value, feel free to join sessions that interest you.

How to Register: Complete this short form to register for the ESS-DIVE Community Data Workshop. This event is free and open to all who will use the ESS-DIVE data repository, so please forward to your respective groups.

Please review our Attendee Instructions in preparation for the workshop.

Download a PDF version of our agenda.. Contact us at ess-dive-support@lbl.gov for any questions or suggestions. 

Monday, May 24, 2021
09:00 AM-11:00 AM

(All times listed in PDT)

                                                                   

Opening Session:

Welcome, introductions, logistics (Joan Damerow)

BER EESS project data management and review (Justin Hnilo)

ESS-DIVE Demo video (Emily Robles)

ESS-DIVE Features overview and future directions (Charu Varadharajan)

Data management plan – what to expect from ESS-DIVE (Deb Agarwal)

ESS-DIVE data reporting formats and standards (Rob Crystal-Ornelas)

Q&A (Deb and Charu)

Community Project Data Presentations:

Watershed Function SFA Field-Data Workflow (Zarine Kakalie, LBNL), Biogeochemistry of Actinides (Nancy Merino, LLNL), SPRUCE Whole Ecosystem Warming Experiment (Les Hook, ORNL), NEON Hyperspectral Ground Campaign (Katie Grant, Stanford/USC), Worldwide Hydrobiogeochemical Observation Network for Dynamic River Systems (WHONDRS; Amy Goldman, PNNL)
11:00 AM-12:00 PM

Break and Data Help:

Office Hour
12:00 PM-02:00 PM                                                                                                                                                                                                                                                      

Breakout Sessions on Data Management and Publication Challenges and Needs(Choose a session)*

  • National Lab Projects
  • University Projects

To start the breakout session, attendees will present a one-min/one-slide summary of project data and data management approach. This may include challenges moving data to ESS-DIVE, and any barriers encountered. The remainder of the session will be dedicated to discussion of your data management and publication challenges and needs.

 

 

*Attendees to choose their own breakout sessions in zoom.

Tuesday, May 25, 2021
 09:00 AM-09:30 AM

                                                                                

Ready to publish your data package? A discussion on what to include in a data package. (Zarine Kakalia)

Bring your use cases and get feedback on what to include and what repositories to publish different data.
9:30 AM-11:00 AM

Hands-on Tutorial for How to Use ESS-DIVE(Choose a tutorial)*

  • ESS-DIVE for Beginners: Data Submission, Search and Download using the Web User-Interface 

(Geared towards new users or those who have not uploaded data to ESS-DIVE)

  • ESS-DIVE for Advanced Users: Uploading Data to ESS-DIVE Programmatically, Portals Tutorial 

(Geared towards those who have uploaded data previously, and/or need to upload a large amount of data from a project)
11:00 AM-12:00 PM

Break and Data Help:

Office Hour
12:00 PM-01:00 PM

ESS Data Types (Choose a session)*

  • Large data and model data archiving
  • Sensor data and QA/QC
  • Sample tracking and analysis workflows, linking related sample data
01:00 PM-02:00 PM

How to Use ESS-DIVE Reporting Formats:

ESS-DIVE reporting format tutorial (Rob Crystal-Ornelas)

File-level and csv (Terri Velliquette)

Breakout Tutorials (Choose one or more tutorials)*

  • Model data (Madison Burrus)
  • Sample identifiers and metadata (Joan Damerow)
  • Water quality/soil samples (Kristin Boye)
  • Leaf-gas exchange (Kim Ely)
  • Continuous soil respiration (Ben Bond-Lamberty)
  • 16s amplicon sequencing (Pamela Weisenhorn)
  • Hydrologic monitoring (Amy Goldman)

*Attendees to choose their own breakout sessions in zoom.