ESS-DIVE holds monthly webinars on a variety of topics related to data management, preservation, and standardization.
Publishing Large Data on ESS-DIVE’s Tier 2 Storage Service
September 19, 2023
Fianna O’Brien, LBNL
Webinar Slides
Do you have large volumes of data sitting on a server that you have been wanting to publish? Is the volume of your data a bottleneck to uploading files to ESS-DIVE? Recognizing that many ESS projects generate large data such as remote sensing, model output, and imagery, ESS-DIVE has developed new tools that enable submitting, publishing, and accessing large datasets.
Join our September webinar for an introduction to Tier 2 storage and Globus transfer services and to learn how they are used to accommodate hierarchical data and large data volumes greater than 500GB.
This webinar is designed to help data contributors, data managers and PIs learn about ESS-DIVE’s new large data support tools and how to incorporate them into data publication workflows. We will cover the following topics:
- What is considered large data on ESS-DIVE?
- ESS-DIVE’s data submission tools
- Web submission form(standard)
- Dataset API (programmatic)
- Globus (large data transfer service)
- Tier 2: large data storage on ESS-DIVE
ESS-DIVE Project Management Features
June 26th, 2023
Madison Burrus, LBNL
Webinar Slides
ESS-DIVE has released our first set of features specifically dedicated to supporting projects’ data management needs. These features expand our existing suite of data management tools and provide a more comprehensive way for projects to collaborate on ESS-DIVE. During this webinar, learn about ESS-DIVE features that can be used for managing project data and the necessary steps to set up and leverage these tools. See our recent blog post for a brief description of the new project management features.
If you missed ESS-DIVE’s breakout session at the ESS PI meeting, please come join our June webinar!
This webinar is particularly geared toward helping Principal Investigators (PIs) and Data Managers set up their project data management on ESS-DIVE. We will cover the following topics:
- Introduction to new project-centric features:
- ESS-DIVE Project List
- Project Manager role
- Project page
- Teams
- Sharing Data Permissions
- How PIs can start setting up project-centric data management on ESS-DIVE
- Feedback session: tell us what your projects need!
ESS-DIVE and Urban Integrated Field Laboratories Data
February 27th, 2023
Joan Damerow and Emily Robles, LBNL
Webinar Slides
ESS-DIVE is excited to welcome Urban Integrated Field Laboratory (Urban IFL) projects to the community. We invite all who are part of an Urban IFL project and the broader ESS community to an introductory webinar about the ESS-DIVE data repository for Earth and environmental system science data, and associated resources for project data management. We will also have a discussion on data management needs for Urban IFL projects.
We will cover the following topics:
- Overview of ESS-DIVE and our data;
- ESS-DIVE project data management features;
- Resources to organize and curate high-quality datasets; and
- Discussion on Urban IFL data management needs.
ESS-DIVE’s Reporting Format for UAS Data and Metadata
January 30th, 2023
Kim Ely and Shawn Serbin, BNL
Webinar Slides
Are you interested in publishing or using data from small Unoccupied Aerials Systems (UAS)? With rapid development of platform and sensor technologies, the use of UASs, also known as UAVs or drones, in Earth sciences is becoming increasingly common. This webinar will review the new UAS data and metadata reporting format that is in development, and provide you an opportunity to give feedback.
We will cover the following topics:
- Benefits of using reporting formats,
- Types of data that this format will cover and associated challenges,
- Metadata variables to describe flight details and equipment,
- Categorizing data by processing level, and
- Discussion and feedback.
You can review the draft UAS data and metadata reporting format before the webinar, although this is not required to attend. This webinar will be presented by Kim Ely and Shawn Serbin from Brookhaven National Laboratory (BNL).
Using ESS-DIVE’s Upgraded API for Dataset Search and Aggregate (Meta)data Download
September 13th, 2022
Madison Burrus, LBNL
Webinar Slides
Did you know that ESS-DIVE’s upgraded Package Service API can help you efficiently search ESS-DIVE data, and get info you need to help prepare your project’s Annual Report? Join our September webinar to learn how to use the API’s new data search capabilities to quickly download dataset files and metadata in bulk, or get a list of the datasets published by your project.
This webinar is designed for Principal Investigators (PIs), Data Managers, and Software Developers. We will cover the following topics:
- Brief overview of the ESS-DIVE Package Service API and recent upgrades
- How to use the API for bulk data search and download
- How to use the API to generate csv reports of relevant metadata for published datasets*
- Q&A**
*If you would like to follow along during the webinar, make sure you use your ORCiD to login to ESS-DIVE before we begin (login instructions are available in our documentation)
**This webinar will focus on recent upgrades to the Package Service API, but we can review other API capabilities at the end as needed.
Publish your terrestrial model data with ESS-DIVE
March 21st, 2022
Charuleka Varadharajan, LBNL
Webinar Slides
Are you looking to publish your model data on ESS-DIVE? Learn about our guidelines for archiving terrestrial simulation data developed in partnership with the ESS modeling community and outlined in a recent publication (Simmonds et al., 2020).
We cover the following topics related to archiving model data using FAIR principles:
- What is terrestrial model data and what model data components should be archived?
- What are the considerations when publishing terrestrial model data? What are the benefits of archiving model data?
- Provide feedback on additional needs for archiving terrestrial or other model data
Expand the Discoverability of your ESS-DIVE Data through External Linking
February 7th, 2022
Madison Burrus and Joan Damerow, LBNL
Webinar Slides
Enhance the discoverability of your datasets by cross-linking relevant data and associated information across repositories. Learn about ESS-DIVE’s new approach and capability to link your ESS-DIVE data to other online repositories and data systems.
We cover the following use cases for linking your external data and metadata:
- Link to individual data files or copies of your data stored elsewhere
- Link to the original publication of a dataset (e.g. your project’s data archive) where metadata and data can be found
- Provide feedback on additional needs for linking to external data, methods, samples, and publications.
Sharing and Collaborating on ESS-DIVE Datasets
January 10th, 2022
Madison Burrus, LBNL
Webinar Slides
One great way for your project to start the new year is to collaboratively publish your team’s datasets! View this webinar to learn about ESS-DIVE’s new dataset sharing feature, which allows you to collaborate on data publications directly on ESS-DIVE. You can now assign permissions that enable your team members to review, edit, revise, or publish datasets that you have created. Our January 10 webinar will help you get started with dataset sharing and work with your team to publish data.
Computer Systems Engineer Madison Burrus covers the following topics:
- Why share your datasets on ESS-DIVE
- What sharing permissions options are available
- How to share datasets
How to Find Public Data Portals and Create Your Own Data Collection
September 28th, 2021
Madison Burrus, LBNL
Webinar Slides
Learn about ESS-DIVE’s new portals page that allows you to view existing public portals, and get some ideas for creating your own! Portals are customizable web pages for displaying data collections on ESS-DIVE (e.g. project data collections). They allow you to filter ESS-DIVE data to a selection of your choice and write verbose text to describe the filtered data. Our September webinar will help you create a new data portal, refine data collection filters, and share your portal with team members and larger audiences.
Computer Systems Engineer Madison Burrus covers the following topics:
- New portals page and it’s uses
- How to create a portal
- How to use the data filter tool
- Recommendations for filtering project data collections
- Recommendations for markdown resources
How to Create Your Datasets and Format Files for Publication
August 31st, 2021
Rob Crystal-Ornelas, Emily Robles, LBNL
Webinar Slides
What data should you include when publishing one or more datasets? Our August webinar helps answer this question with tips on how to create your datasets and format your data files. This tutorial will help you get started with publishing high-quality datasets on ESS-DIVE that not only support your project, but also future use of project data. Presenters Emily Robles and Rob Crystal-Ornelas cover the following topics:
- Publishing datasets: what and where to publish
- Considerations when delineating multiple datasets for a project
- How to publish your dataset on ESS-DIVE
- How to format and describe data files using ESS-DIVE’s file-level metadata reporting format
ESS-DIVE Sample Identifiers and Metadata Reporting Format Tutorial
July 12th, 2021
Joan Damerow, LBNL
Webinar Slides
Our July community webinar is lead by Joan Damerow, ESS-DIVE Community Engagement Lead Scientist. She presents a tutorial on how to use ESS-DIVE’s reporting format for sample identifiers and metadata—designed to make sample data more discoverable and usable.
This tutorial will help you more efficiently track samples that are sent to different collaborators, labs, or published in multiple datasets and papers. You can expect to learn:
- About sample identifiers and metadata (overview)
- How to use ESS-DIVE’s sample ID and metadata instructions guide and template
- Sample planning and publication workflows to help improve sample tracking
- How and why to use International Geo/General Sample Numbers (IGSN)
16S Amplicon Data Reporting Format and KBase Integration
April 29, 2021
Pamela Weisenhorn
ESS-DIVE’s April webinar features a discussion on a new ESS community reporting format for 16S Amplicon data products, which is currently in development. Pamela Weisenhorn from Argonne National Lab presents community progress on the reporting format related to microbiome data, and demonstrates use-cases for how standardized formats can help link data across ESS-DIVE and the DOE Systems Biology Knowledgebase (KBase). We cover the following topics:
- Required and suggested metadata related to 16S amplicon tables
- Format for data and metadata (and opportunities for providing feedback)
- Current state of data integration across platforms
- Work in progress for seamless data transfer of amplicon data from ESS-DIVE to KBase
Data Package Quality Review
March 30, 2021
Emily Robles & Rob Crystal-Ornelas, LBNL
Webinar Slides
Our March webinar provides on how to submit high-quality metadata to ESS-DIVE and streamline your review and publication process. We cover the following topics:
- Data preparation resources and considerations before you submit data
- Using ESS-DIVE’s Metadata Assessment Reports
- ESS-DIVE metadata quality review process and recommendations to make data discoverable and reusable
- Summary of ESS-DIVE’s community-developed reporting formats and how you can begin implementing them
ESS-DIVE Data Citation
February 18, 2021
Joan Damerow and Deb Agarwal, LBNL
Webinar Slides
Are you uncertain about when, where, or how to cite data in your publications? Have you experienced any challenges with citing data that you use in your research? ESS-DIVE’s Data Citation webinar is designed to help you as an author or a reviewer of a scientific paper make informed decisions about citing data. We cover the following topics:
- Dataset citation purpose and recommendations
- Examples of data citations
- Challenges and options for citing large numbers of datasets
- Discussion on community citation needs
ESS-DIVE Advanced User Bootcamp
November 29, 2020
Madison Burrus, Robert Crystal-Ornelas, and Fianna O’Brien, LBNL
Webinar Slides
Our November monthly webinar features an “ESS-DIVE Advanced Bootcamp.” This webinar targets experienced users who have uploaded data to ESS-DIVE before and want to learn more about data archiving tools. We cover the following topics:
- Programmatic submissions and updates to data packages on ESS-DIVE
- Customizable data portals to organize your data collections
- How to use the ESS-DIVE community github for reviewing and commenting on the ESS-DIVE proposed metadata/data reporting formats
ESS-DIVE New User Bootcamp
October 29, 2020
Fianna O’Brien and Madison Burrus, LBNL
Webinar Slides
Documenting Data Reporting Formats on GitHub
September 30, 2020
Joan Damerow and Rob Crystal-Ornelas, LBNL
Webinar Slides – GitHub Presentation
Webinar Slides – Sample ID/Metadata Reporting Presentation
Community Funds Project Highlight: Water Quality and Hydrological Monitoring Standards
August 20, 2020
Kristin Boye (SLAC) and Amy Goldman (PNNL)
Community Funds Project Highlight: Leaf Physiology and Soil Respiration Standards
July 28th, 2020
Ben Bond-Lamberty/Stephanie Pennington (PNNL), Kim Ely/Alistair Rogers (BNL)
Community Funds Project Highlight: File CSV Standards
June 30, 2020
Terri Velliquette and team, ORNL
ESS-DIVE Bootcamp
April 28, 2020
Fianna O’Brien, LBNL
Webinar Slides
Model Data Archiving
March 15, 2020
Maegen Simmonds, LBNL
Webinar Slides
Our March webinar by Maegen Simmonds discusses ESS-DIVE’s efforts to research solutions for long-term preservation of model data (inputs/outputs/related software). Findings from the collection and analysis of community feedback are presented.
Portals Feature Presentation
February 27, 2020
Hesham Elbashandy, LBNL
Webinar Slides
For our February webinar, Hesham Elbashandy introduces and demonstrates the capabilities of the upcoming ESS-DIVE Portals feature. The steps to building a portal as well as aspects of the layout and design are discussed, along with the metrics that will be available to Portal creators.
Sample ID Metadata
January 30, 2020
Joan Damerow, LBNL
Webinar Slides
In this webinar, Joan Damerow presents on recent conclusions from ESS-DIVE’s sample ID pilot tests and information gathered from sample-related meetings. Joan leads the discussion on options to make the process of standardizing sample metadata and sample tracking more efficient, as well as related plans moving forward.
Model Data Archiving
November 22, 2019
Maegen Simmonds and Bill Riley, LBNL
Webinar Slides
This webinar features ESS-DIVE’s efforts to research solutions for long-term preservation and distribution of model data (inputs/outputs/related software), with input from the community.
Community Data Standards
October 29, 2019
Alison Boyer, ORNL (file-level metadata)
Amy Goldman/WHONDRS, PNNL (water quality sonde measurements)
Kristin Boye, SLAC (water/soil chemistry from sample analysis)
Kim Ely/Alistair Rogers, BNL (leaf physiology)
Ben Bond-Lamberty, PNNL (soil respiration)
This webinar features data/metadata standards being researched by our community funds partners. It includes presentations by the following groups about their early work on identifying standardized formats, vocabularies and metadata requirements for various ESS measurements.
ESS-DIVE Package Service API Tutorial
September 30, 2019
Fianna OBrien and Val Hendrix, LBNL
Webinar Slides
This tutorial features the ESS-DIVE data package service Application Programming Interface (API), which allows users to upload and edit data and metadata programmatically. The webinar covers the API features, as well as extensive documentation and tutorial examples. The API is designed to be easy to use, so as to facilitate scientists, postdocs/students and data managers to write scripts that upload data to ESS-DIVE.
ESS-DIVE Metadata Quality Checks
August 27, 2019
Joan Damerow, Emily Robles, Zarine Kakalia
Webinar Slides
This webinar features ESS-DIVE’s proposed quality checks for metadata that describe data packages (e.g. title, abstract, keywords). ESS-DIVE currently reviews the metadata for all data package submissions to ensure that published data meet basic expectations for discovery and use, with the vision of making data packages FAIR (Findable, Accessible, Interoperable and Reusable).
Community Funds Projects
June 28, 2019
Deb Agarwal, LBNL
This webinar presents an update, as of June 2019, on the status of the community fund requests to ESS-DIVE. Groups who have expressed interest in community data standards also present brief descriptions of their proposed projects.
Sample Identifiers, Metadata, and Tracking
May 29, 2019
Joan Damerow
Webinar Slides
To fulfill the community’s need for a standardized method of sample ID and tracking, the ESS-DIVE team is working to pilot the use of persistent sample identifiers throughout its projects. In this webinar, Environmental Data Standards Postdoc Joan Damerow describes ESS-DIVE’s current research into existing standards for sample identifiers and metadata, and our summer pilot test with ESS projects that are collecting samples in the field.
Community Funds Input
April 22, 2019
March 25, 2019
February 26, 2019
April Slides
March Slides
February Slides
This is a series of webinars to present the ESS-DIVE roadmap, and gather input on community priorities and needs to guide the allocation of ESS-DIVE community funds. The funds are used for supporting priority community data management activities related to ESS-DIVE.
December 20, 2018
Webinar Slides
These webinars introduce the new ESS-DIVE Package Service, which enables projects to programmatically store data packages with ESS-DIVE. This is an alternative to using the ESS-DIVE web portal for data uploads. For up to date information regarding this service, review our GitBooks Tutorial.