CMIP Data Pool (DKRZ CDP)#
The DKRZ CMIP data pool (DKRZ CDP) contains flagship collections of Earth System Model data.
In 2016, DKRZ made it their mission to create and operate the national CMIP6⁺ Data pool as part of the German Alliance DICAD supported by the Federal Ministry of Education and Research. Today, it provides the largest online data collection of the recent phase 6 of the Coupled Model Intercomparison Project (CMIP6) in Europe, is the data basis for the IPCC report AR6 and contributes to the Copernicus Climate Data Store. The DKRZ CDP supports scientists in browsing, access and processing these high volume data collections. Ongoing activities on analysis services for working with the CDP are coordinated within the IS-ENES3 project.
CMIP is a periodically conducted model intercomparison project with the object to evaluate and compare climate models. CMIP protocols define central basic experiments which build the basis for model evaluation. As endorsed to CMIP6, many additional MIP activites investigate specific research questions (Fig. 1).
Fig. 1 Fig. 1: Schematic of the CMIP6 experiment design (Eyring et al., 2016). CMIP DECK experiments and the CMIP6 historical simulation form the inner part and are standard experiments. They represent an entry card for models that would like to participate in CMIP and its endorsed MIPs. The middle ring and outer ring connect science topics with corresponding CMIP6-endorsed MIPs.#
The CMIP design may vary in scientific targets but the upcoming phases will share the DECK experiments with CMIP6 as they remain the basic experiments (Fig. 2).
Fig. 2 Fig. 2: Future CMIP phases (Eyring et al., ,2016).#
The climate research community benefits from the DKRZ CDP in many ways. Most importantly, the CDP is accessible on file system for direct and fast access. This is only possible because the Scientific Steering Commitee has granted a disk space on Levante’s file system of 4.7PB for the Consortium project CMIP data pool. In addition to /work disk space, we provide back ups in the HSM archive as well as some collections in the swift object storage.
We offer you support in different fields of data processing that help your data to become part of the CMIP Data pool. Additionally, we perform many tasks required to maintain and host the CMIP dtaa pool. One of our goals is to develop these services towards automizied pipelines. Here is an overview about our activites:
Pipeline |
Job |
Frequency |
Automization |
Repository |
|---|---|---|---|---|
Preparation |
Post-Processing |
On demand |
No |
|
Ingestion |
Data Transfer of primary Publication |
Once per month |
No |
|
Ingestion |
Quality Assurance |
On request |
No |
|
Ingestion |
Publication |
On demand |
No |
|
Curation |
Replication |
On demand |
No |
|
Curation |
Retraction |
On demand |
No |
|
Curation |
Intake CMIP6 |
Daily |
Cronjob |
https://gitlab.dkrz.de/data-infrastructure-services/intake-esm |
Curation |
Intake CORDEX |
Monthly |
Cronjob |
https://gitlab.dkrz.de/data-infrastructure-services/intake-esm |
Parts of these services have been developed in projects which have ended. Due to a lack of permanent positions, its maintance is not supported anymore. They are proceeded as long as no errors occur.
Highlights of data pool news are presented on DKRZ’s blog Subscribe the mailing list ✉ cmip-data-poolATlists.dkrz.de to get the latest news per mail. Contact data-poolATdkrz.de for dedicated support regarding the DKRZ CDP or replication requests.
The DKRZ DM Data Infrastructure team is preparing these documentations of the data pool status.
Publications:
Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J. and Taylor, K. E.: Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization, Geosci. Model Dev., 9(5), 1937-1958, doi:10.5194/gmd-9-1937-2016, 2016.
test intake