ESS-DIVE Community Data Workshop 2024
ESS Data Integration and Use
The workshop theme focused on “ESS Data Integration and Use”. Our opening session featured members of the ESS community who are integrating data across sources to answer new scientific questions; they shared their goals, data management approach, needs and challenges. We then held discussions and tutorial sessions open to a wide range of experience with ESS-DIVE.
Here’s what we covered during the workshop:
- Updates from ESS-DIVE on new and planned features;
- Community presentations from ESS synthesis projects;
- Discussions on new features and needs to enhance data discovery, and BER data integration;
- Tutorials on how to publish and use data on ESS-DIVE;
- Discussions on data curation needs and reporting format updates;
- And more!
The two-day workshop took place on Thursday and Friday, November 14-15, 2024 9am – 2pm PST (12pm – 5pm EST).
You can request access to videos and presentations by contacting ess-dive support (ess-dive-support@lbl.gov).
Thursday, November 14, 2024 |
|
09:00AM10:15AM
10:15AM11:00AM |
Opening Session (Presentation Slides)
Data Management and Needs for ESS Synthesis Projects
|
11:00AM11:30PM |
Break |
11:30AM12:00PM |
Enhancing Data Discovery through Search Innovations (Presentation Slides) Fusion database overview, and planned search enhancements (Valerie Hendrix) CurateGPT Overview and Demo (Harry Caufield) |
12:00PM1:00PM |
ESS Cyberinfrastructure Working Group (Danielle Christianson (LBNL), Terri Velliquette (ORNL)) Discussion on needs for ESS data discovery and use |
1:00PM2:00PM |
BER Data Integration Discussion (Presentation Slides) (Joan Damerow) Use cases for BER ESS integration |
Friday, November 15, 2024 |
|
09:00AM11:00AM
|
Breakout Tutorials on How to Use ESS-DIVE *Choose One
Publishing Data on ESS-DIVE (Dylan O’Ryan) (Presentation Slides)
Using ESS-DIVE Data (Emily Nagamoto, Danielle Christianson) (Presentation Slides)
|
11:00AM11:30AM |
Break |
11:30AM1:30PM |
Data Curation to Enable Reuse and Integration with Community Projects
Meet the new ESS Community Data Curator (Kim Ely) ESS-DIVE Reporting Format Updates
|
01:30PM02:00PM |
Workshop Wrap Up & Future Directions |
DOE ESS CI and PI Meeting Training Sessions (April 2024)
The ESS-DIVE Team is looking forward to participating in the Environmental System Science (ESS) Cyberinfrastructure (CI) Working Group Annual Meeting (April 15th) and ESS PI Meeting April 16th-17th in Reston, VA. Charu Varadharajan, Shreyas Cholia, Joan Damerow, Madison Burrus, and Emily Robles will all be there in person and hope to see you! For informal office hours and help desk, stop by the ESS-DIVE posters during the ESS PI meeting. Below are some ways that you can engage with ESS-DIVE at both meetings. Review our Blog Post on the CI and PI meetings to learn more about the sessions and presentations that we will be leading and participating in.
Below are the details on the training sessions ESS-DIVE is leading:
ESS-DIVE Updates / Planning Discussion
Presenters: Charu Varadharajan and Shreyas Cholia, ESS-DIVE PIs
Session Date and Time: Monday, April 15th; 9:30am to 10:30am EST / 6:30am to 7:30am PST
Hands-on Session: ESS-DIVE Data Reporting Formats
Presenters: Emily Robles, Senior Research Associate; Joan Damerow, Research Scientist
Session Date and Time: Monday, April 15th; 1:45pm – 3:15pm EST / 10:45am – 12:15pm PST
Hands-on Session: Accessing HPC resources with Jupyter notebooks
Presenter: Shreyas Cholia, ESS-DIVE PI
Session Date and Time: Monday, April 15th; 1:45pm – 3:15pm EST / 10:45am – 12:15pm PST
Breakouts: Round Robin over three key topics
Facilitator: Charu Varadharajan, ESS-DIVE PI
Date and Time: Monday, April 15th; 3:30pm to 5:00pm EST / 12:30pm to 2:00pm PST
Strategic Data Management to Advance Environmental Systems Science
Presenter: Joan Damerow, Research Scientist
Session Date and Time:Tuesday, April 16th; 11:15am – 12:45pm EST / 8:15am – 9:45am PST
ESS research often requires multidisciplinary science teams to understand and model multi-scale processes that involve diverse data types. More and more data is being collected, with significant resources. As Elizabeth Wolkowich wrote in 2012: “an ecological dataset collected at a certain place and time represents an irreproducible set of observations, ecologists doing local, independent research possess, in their file cabinets and spreadsheets, a wealth of information about the natural world and how it is changing.“ Making data Findable, Accessible, Interoperable and Reproducible (FAIR) is not a controversial goal, but it takes intentional data management strategies to achieve this goal, particularly so in large team science projects. Furthermore, integrating datasets from different sources can unlock additional scientific returns on data collection efforts.
This breakout gathers perspectives from data providers, data users and data repositories on intentional data management to make data FAIR. We will collect feedback on technical and community needs for setting the course towards advancing environmental and biological data integration and reuse capabilities.
Lunchtime Breakout: ESS-DIVE Tutorial for PIs and Data Managers
Presenter: Madison Burrus, Computer Systems Engineer
Session Date and Time:Wednesday, April 17th; 12:30pm – 1:30pm EST / 9:30am – 10:30am PST
The ESS-DIVE data repository has expanded features and resources to support Environmental System Science, such as project data management and sharing, reporting publication progress, large data support, and enhanced search. This session is designed for ESS PI’s and data managers to learn about the growing suite of features and resources that the ESS-DIVE data repository provides for data management, publication, and use.
Poster: ESS-DIVE Data Repository
Presenter: Shreyas Cholia, ESS-DIVE PI
Session Date and Time: Tuesday, April 16th; 4:00-5:30pm EST / 1:00-2:30pm PST; Poster #12
Poster: ESS-DIVE: Enabling Integration Across Diverse ESS Datasets
Presenter: Joan Damerow, Community Engagement Lead Scientist
Session Date and Time: Tuesday, April 16th; 4:00-5:30pm EST / 1:00-2:30pm PST; Poster #18
Inclusive and Equitable Research: Best Practices and Lessons Learned
Participant: Charu Varadharajan, ESS-DIVE PI
Session Date and Time: Tuesday, April 16th; 5:30pm – 6:30pm EST / 2:30pm – 3:30pm PST
ESS-DIVE Open Data Workshop 2023
Unlocking Environmental Insights Through Open Data and Collaboration
Federal agencies in the United States are commemorating 2023 as the Year of Open Science. We were excited to be part of this celebration as we strive to assist you in making your ESS project data not only open but also easily discoverable and highly usable. During this workshop, we had:
- Presentations from community members;
- Tutorials on new and existing ESS-DIVE features;
- Knowledge exchange on challenges and opportunities related to ESS data;
- Collaborative paper opportunity on interdisciplinary project data management;
- And more!
The two-day workshop took place on Wednesday and Thursday, November 15-16, 2023 9am – 2pm PST (12pm – 5pm EST).
You can request access to videos and presentations by contacting ess-dive support (ess-dive-support@lbl.gov).
Wednesday, November 15, 2023 |
|
09:00AM10:00AM
10:00AM11:00AM |
Opening Session:
Project Data Management and Open Science: Community members engaged with ESS-DIVE
|
11:00AM11:30PM |
Break |
11:30AM12:30PM |
Community-Led Discussion: Project Data Publishing Decisions to Support Open Environmental System Science (Amy Goldman, PNNL) |
12:30PM02:00PM |
Connecting Related Data for your Project (Joan Damerow) BER unified data framework report conclusions (Pamela Weisenhorn) Lightning presentations from EMSL (Jay Bardhan), JGI (Chuck Parker), NMDC (Chris Mungall), KBase (Elisha Wood-Charlson), ARM (Giri Prakash), and MSD-LIVE (Casey Burleyson). We will then discuss:
|
Thursday, November 16, 2023 |
|
09:00AM11:00AM
|
Breakout Tutorials on How to Use ESS-DIVE *Choose One
Publishing Data on ESS-DIVE
Managing Project Data on ESS-DIVE
Finding and Accessing ESS-DIVE Data
|
11:00AM11:30AM |
Break |
11:30AM1:30PM |
Advanced Search and Data Integration Enabled by ESS-DIVE Reporting Formats Enabling data validation and advanced search (Val Hendrix) BASIN-3D Data Synthesis Demonstration (Danielle Christianson) Curating High-Quality Datasets for your Project (Emily Robles)Reporting formats are community data standards developed by ESS-DIVE and community partners to standardize metadata and data files of data types commonly collected by DOE ESS projects. These reporting formats will be used to enable synthesis across datasets on ESS-DIVE. To learn more, view the Reporting Formats page and our Reporting Formats Checklist.
|
01:30PM02:00PM |
Workshop Wrap Up & Future Directions |
You can request access to videos and presentations by contacting ess-dive support (ess-dive-support@lbl.gov).
DOE ESS PI Meeting Training Sessions (May 2023)
The ESS-DIVE Team is looking forward to participating in the ESS PI Meeting on May 16th-17th. Deb Agarwal, Charu Varadharahan, Shreyas Cholia, Joan Damerow, and Emily Robles will all be in-person for the ESS PI meeting! For additional presentations that ESS-DIVE is giving, see our blog post on our activities at the Environmental System Science (ESS) Cyberinfrastructure (CI) Working Group Annual Meeting and ESS PI Meeting on May 15th and May 16th-17th.
On Tuesday, May 16, 2023 the ESS-DIVE team will present tutorials on: (1) Managing project data on ESS-DIVE and (2) Creating and publishing high-quality datasets. Here are more details on the two tutorials:
ESS-DIVE tutorials: Managing project data on ESS-DIVE
Presenter: Joan Damerow, Community Engagement Lead Scientist
Session Date and Time: May 16th, 2023; 10:30 AM -12:30 PM ET / 7:30 AM – 9:30 AM PT
This session is designed for PI’s and data managers who want to learn how to manage project data on ESS-DIVE. We will first provide an overview of how ESS-DIVE can support a project’s data management needs. The tutorial will then walk through how to use ESS-DIVE features for project data management, including: (1) new features to assign project data managers and create teams, (2) sharing data permissions with project members for collaborative editing and review, (3) creating portals to showcase project data collections, and (4) linking ess-dive datasets to other repositories.
ESS-DIVE tutorials: Creating and publishing high-quality datasets
Presenter: Emily Robles, Senior Research Associate
Session Date and Time: May 16th, 2023; 1:00 PM – 2:30 PM ET / 10:00 AM – 11:30 AM PT
Learn how to upload and publish data with ESS-DIVE as a new contributor in this hands-on training session. We will cover all of the basics needed to get started with publishing datasets, from important considerations for organizing data and accompanying metadata, to choosing an upload method for dataset submission, and requesting publication and following the dataset review process. Our hands-on activity walks through creating and submitting a dataset to ESS-DIVE’s sandbox using our online submission form. We will also discuss ways that researchers can improve the quality of their datasets by using ESS-DIVE’s community data and metadata formats.
ESS-DIVE Community Data Workshop 2022
Collaborative Data Management to Advance Environmental System Science
ESS-DIVE had their Community Data Workshop on Collaborative Data Management to Advance Environmental System Science in November 2022. During this workshop, attendees learned about:
- Publishing data for your BER ESS project;
- ESS-DIVE features, data, and vision;
- How others in the community manage and publish project data, and discuss needs;
- How to use ESS-DIVE and features for collaborative data management; and
- How to organize and curate high-quality datasets.
The two-day workshop took place on Wednesday and Thursday, November 9-10, 2022 from 9am – 2pm PST (12pm – 5pm EST).
You can request access to videos and presentations by contacting ess-dive support (ess-dive-support@lbl.gov).
Wednesday, November 9, 2022 |
|
09:00AM11:30AM(All times listed in PDT) |
Opening Session:
10 min break ESS Project Data Presentations: ESS projects that have published many datasets in ESS-DIVE discuss their overall project data management approach, and how they create and publish datasets.
|
11:30AM12:00PM |
Break |
12:00PM02:00PM |
Understanding Project Needs for Managing and Publishing Data* – Breakout Discussions
ESS-DIVE team members will lead discussions on how we can address data management and publication needs as a community. Topics include: project data management approaches, number of datasets produced by projects, challenges with publication, and successes. |
*Attendees will be randomly assigned to a smaller breakout room
Thursday, November 10, 2022 |
|
09:00AM10:30AM
10:40AM11:30AM
|
ESS-DIVE How-To Tutorials (Choose one)**
10 min break Managing Data on ESS-DIVE (Joan Damerow, Charu Varadharajan)
|
11:30AM12:00PM |
Break |
12:00PM1:45PM |
Organizing and Curating High-Quality Datasets
Tutorial: Getting Started with ESS-DIVE Reporting Formats
|
01:45PM02:00PM |
Workshop Wrap Up |
**Attendees to choose their own breakout sessions in zoom.
You can request access to videos and presentations by contacting ess-dive support (ess-dive-support@lbl.gov).
DOE ESS PI Meeting Training Sessions (May 2022)
ESS-DIVE presented training sessions at the annual Environmental System Science (ESS) Program Principal Investigators Meeting that began on Tuesday, May 24, 2022, and concluded on Thursday, May 26, 2022. The ESS-DIVE team presented at multiple sessions at this virtual meeting hosted by the U.S. Department of Energy.
On Tuesday, May 24, 2022 the ESS-DIVE team presented the following hands-on data management trainings from 1:30 pm – 3:30 pm ET that will help you better understand and use various ESS-DIVE features for managing project data. Here are more details:
ESS-DIVE Overview [Presentation Slides]
Presenter: Charuleka Varadharajan and Team
Main room
Introduction to ESS-DIVE before breakout sessions.
New user bootcamp [Presentation Slides]
Presenter: Emily Robles
Breakout room A
Learn how to upload and publish data with ESS-DIVE as a new contributor in this hands-on training session. We will go over the process for publishing data on ESS-DIVE, from important considerations for organizing data and accompanying metadata, to requesting publication and following the dataset review process. We will also discuss how to utilize the ESS-DIVE main portal search features and download data.
Project data management [Presentation Slides]
Presenters: Charuleka Varadharajan and Madison Burrus
Breakout room B
This session is designed for PI’s and data managers who want to learn how to manage project data on ESS-DIVE. We will first provide an overview of how ESS-DIVE can support a project’s data management needs. We will then describe how projects can use ESS-DIVE features to curate and manage data including: (1) a package Service API for bulk programmatic dataset creation and editing (2) sharing datasets with project members for collaborative editing and review. (3) linking data on ESS-DIVE to related datasets on other public data repositories (4) portals to showcase data collections, and (5) an upcoming feature to manage project members and data.
ESS-DIVE data formats [Presentation Slides / View Recording of Session]
Presenters: Robert Crystal-Ornelas and Dylan O’Ryan
Breakout room C
In this session, we will discuss ways that researchers can make research data more reusable using ESS-DIVE’s 11 community data and metadata formats. These data formatting templates apply to many data types relevant to earth and environmental science research. They include general formats that apply to many data types (CSV files, file-level metadata, locations, samples, model data), and formats for specific data types (water and sediment chemistry, sensor-based hydrological monitoring, leaf-level gas exchange, soil respiration, and amplicon abundance). In this session, participants will apply the reporting formats to tabular data, and hear from researchers who are currently using reporting formats on their own environmental data and metadata.
ESS-DIVE Community Data Workshop 2021
Jump-start and build your environmental data management and sharing for DOE ESS-funded projects.
Registration for this event is closed, thank you to everyone who joined us for the ESS-DIVE Community Data Workshop. Workshop presentations and materials can be accessed through our 2021 workshop GitHub repository.
Join us for the ESS-DIVE Community Data Workshop to start and build your DOE Environmental Systems Science (ESS) project data management and sharing efforts. During this workshop, you can expect to learn about:
- DOE ESS project data management and review process;
- How to use ESS-DIVE and updates on features;
- Standard reporting formats that make data more discoverable and usable;
- How others in the community manage and share data;
- Other data-related topics important to our community.
The two-day workshop will take place on Monday and Tuesday, May 24-25, 2021 from 9am – 2pm PST (12pm – 5pm EST). While we encourage attending both days to gain the most value, feel free to join sessions that interest you.
How to Register: Complete this short form to register for the ESS-DIVE Community Data Workshop. This event is free and open to all who will use the ESS-DIVE data repository, so please forward to your respective groups.
Please review our Attendee Instructions in preparation for the workshop.
Download a PDF version of our agenda.. Contact us at ess-dive-support@lbl.gov for any questions or suggestions.
Monday, May 24, 2021 |
|
09:00 AM-11:00 AM(All times listed in PDT)
|
Opening Session: Welcome, introductions, logistics (Joan Damerow) BER EESS project data management and review (Justin Hnilo) ESS-DIVE Demo video (Emily Robles) ESS-DIVE Features overview and future directions (Charu Varadharajan) Data management plan – what to expect from ESS-DIVE (Deb Agarwal) ESS-DIVE data reporting formats and standards (Rob Crystal-Ornelas) Q&A (Deb and Charu) Community Project Data Presentations: Watershed Function SFA Field-Data Workflow (Zarine Kakalie, LBNL), Biogeochemistry of Actinides (Nancy Merino, LLNL), SPRUCE Whole Ecosystem Warming Experiment (Les Hook, ORNL), NEON Hyperspectral Ground Campaign (Katie Grant, Stanford/USC), Worldwide Hydrobiogeochemical Observation Network for Dynamic River Systems (WHONDRS; Amy Goldman, PNNL) |
11:00 AM-12:00 PM |
Break and Data Help: Office Hour |
12:00 PM-02:00 PM |
Breakout Sessions on Data Management and Publication Challenges and Needs(Choose a session)*
To start the breakout session, attendees will present a one-min/one-slide summary of project data and data management approach. This may include challenges moving data to ESS-DIVE, and any barriers encountered. The remainder of the session will be dedicated to discussion of your data management and publication challenges and needs.
|
*Attendees to choose their own breakout sessions in zoom.
Tuesday, May 25, 2021 |
|
09:00 AM-09:30 AM
|
Ready to publish your data package? A discussion on what to include in a data package. (Zarine Kakalia) Bring your use cases and get feedback on what to include and what repositories to publish different data. |
9:30 AM-11:00 AM |
Hands-on Tutorial for How to Use ESS-DIVE(Choose a tutorial)*
(Geared towards new users or those who have not uploaded data to ESS-DIVE)
(Geared towards those who have uploaded data previously, and/or need to upload a large amount of data from a project) |
11:00 AM-12:00 PM |
Break and Data Help: Office Hour |
12:00 PM-01:00 PM |
ESS Data Types (Choose a session)*
|
01:00 PM-02:00 PM |
How to Use ESS-DIVE Reporting Formats: ESS-DIVE reporting format tutorial (Rob Crystal-Ornelas) File-level and csv (Terri Velliquette) Breakout Tutorials (Choose one or more tutorials)*
|
*Attendees to choose their own breakout sessions in zoom.