Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published July 1, 2023 | Submitted + Updated + Supplemental Material
Report Open

The ENCODE Uniform Analysis Pipelines

Abstract

The Encyclopedia of DNA elements (ENCODE) project is a collaborative effort to create a comprehensive catalog of functional elements in the human genome. The current database comprises more than 19000 functional genomics experiments across more than 1000 cell lines and tissues using a wide array of experimental techniques to study the chromatin structure, regulatory and transcriptional landscape of theHomo sapiensandMus musculusgenomes. All experimental data, metadata, and associated computational analyses created by the ENCODE consortium are submitted to the Data Coordination Center (DCC) for validation, tracking, storage, and distribution to community resources and the scientific community. The ENCODE project has engineered and distributed uniform processing pipelines in order to promote data provenance and reproducibility as well as allow interoperability between genomic resources and other consortia. All data files, reference genome versions, software versions, and parameters used by the pipelines are captured and availableviathe ENCODE Portal. The pipeline code, developed using Docker and Workflow Description Language (WDL;https://openwdl.org/) is publicly available in GitHub, with images available on Dockerhub (https://hub.docker.com), enabling access to a diverse range of biomedical researchers. ENCODE pipelines maintained and used by the DCC can be installed to run on personal computers, local HPC clusters, or in cloud computing environmentsviaCromwell. Access to the pipelines and dataviathe cloud allows small labs the ability to use the data or software without access to institutional compute clusters. Standardization of the computational methodologies for analysis and quality control leads to comparable results from different ENCODE collections - a prerequisite for successful integrative analyses. Database URL: https://www.encodeproject.org/

Additional Information

The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license. We wish to thank all participants in the ENCODE Consortium for collaborations that have enhanced the metadata definitions, and the ENCODE Portal users for their useful feedback. Research reported in this publication was supported by the National Human Genome Research Institute of the National Institutes of Health under grant number U24-HG009397. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. All ENCODE primary and processed data are distributed for free via the Amazon Web Services (AWS; https://registry.opendata.aws/encode-project) and the ENCODE portal, https://www.encodeproject.org (a mirror of the data corpus also exists on the Microsoft Azure (https://learn.microsoft.com/en-us/azure/open-datasets/dataset-encode) cloud, courtesy of Microsoft and Terra. The authors have declared no competing interest.

Attached Files

Submitted - nihpp-2023.04.04.535623v1.pdf

Supplemental Material - media-1.pdf

Supplemental Material - media-2.pdf

Supplemental Material - media-3.pdf

Supplemental Material - media-4.pdf

Supplemental Material - media-6.pdf

Supplemental Material - media-7.pdf

Updated - media-5.pdf

Files

media-7.pdf
Files (1.8 MB)
Name Size Download all
md5:50073295206bfa3754f9beda820281f2
66.5 kB Preview Download
md5:89aed15d89927f4c0a42dcd6430c7869
56.6 kB Preview Download
md5:d6b983989c8a174fbff2b8f4846b266a
1.4 MB Preview Download
md5:762bea866449f6330a0853475856bcfe
51.6 kB Preview Download
md5:455dc878f3290150f842e0e517b5a8ee
74.9 kB Preview Download
md5:9ac21439cf4d57af4601dd2c160dbb7b
56.0 kB Preview Download
md5:984797e711e18b3d1eecb8dec5764049
55.6 kB Preview Download
md5:0d40666527dd76d3c55992ec47c1384f
44.5 kB Preview Download

Additional details

Created:
August 20, 2023
Modified:
December 13, 2023