Cumulus

Project Description

This Cumulus project seeks to address the existing need for a “native” cloud-based data ingest, archive, distribution, and management system that can be used for all future Earth Observing System Data and Information System (EOSDIS) data streams via the development and implementation of Cumulus. The term “native” implies that the system will leverage all components of a cloud infrastructure provided by the vendor for efficiency (in terms of both processing time and cost). Additionally, Cumulus will operate on future data streams involving satellite missions, aircraft missions, and field campaigns.

This documentation includes both guidelines, examples and source code docs.

The documentation is accessible at https://cumulus-nasa.github.io/

Contributing

Please refer to: https://github.com/cumulus-nasa/cumulus/blob/master/CONTRIBUTING.md for information

Content

Documentation

• Architecture
• Cumulus Deployment
  • Creating an S3 Bucket
  • Locating IAMs
  • Troubleshooting Deployment
• Cumulus Workflows
  • Protocol
  • Input & Ouptut
  • Cumulus Task Message Flow
  • Developing Workflow Tasks
    • Lambda Functions
    • Dockerization
  • Workflow Configuration How-to's
• Tasks
• Cumulus API
• Backup and Restore

• EMS Reporting

• Local Docs

  • Adding a task
• Upgrade Instructions
  • 1.6.0
  • 1.7.0
• Changelog
• Team

Data Cookbook

• About Cookbooks
• HelloWorldWorkflow
• SNS Configuration