Configuration of Tasks

The cumulus module exposes values for configuration for some of the provided archive and ingest tasks. Currently the following are available as configurable variables:

cmr_search_client_config

Configuration parameters for CMR search client for cumulus archive module tasks in the form:

<lambda_identifier>_report_cmr_limit = <maximum number records can be returned from cmr-client search, this should be greater than cmr_page_size>
<lambda_identifier>_report_cmr_page_size = <number of records for each page returned from CMR>
  type = map(string)

More information about cmr limit and cmr page_size can be found from @cumulus/cmr-client and CMR Search API document.

Currently the following values are supported:

• create_reconciliation_report_cmr_limit
• create_reconciliation_report_cmr_page_size

Example

cmr_search_client_config = {
  create_reconciliation_report_cmr_limit = 2500
  create_reconciliation_report_cmr_page_size = 250
}

elasticsearch_client_config

Configuration parameters for Elasticsearch client for cumulus archive module tasks in the form:

<lambda_identifier>_es_scroll_duration = <duration>
<lambda_identifier>_es_scroll_size = <size>
  type = map(string)

Currently the following values are supported:

• create_reconciliation_report_es_scroll_duration
• create_reconciliation_report_es_scroll_size

Example

elasticsearch_client_config = {
  create_reconciliation_report_es_scroll_duration = "15m"
  create_reconciliation_report_es_scroll_size = 2000
}

lambda_timeouts

An optional configurable map of timeouts (in seconds) for cumulus lambdas in the form:

lambda_timeouts = {
  <lambda_name> = <timeout>
}

Example

lambda_timeouts = {
  sqsMessageRemover = 300
}

lambda_memory_sizes

An optional configurable map of memory sizes (in MBs) for cumulus lambdas in the form:

lambda_memory_sizes = {
  <lambda_name> = <memory_size>
}

Example

lambda_memory_sizes = {
  SyncGranule = 1024
}