SLUR(M)-py: A SLURM Powered Pythonic Pipeline for Parallel Processing of 3D (Epi)genomic Profiles
Cullen RothiD, Vrinda VenuiD, Sasha Bacot, Shawn R. StarkenburgiD, Christina R. SteadmaniD
Abstract
Epigenomics has become multi-faceted, with researchers exploring chromatin structure, nucleosome states, and epigenetic modifications, producing large, complex multi-omic data sets. Given this shift, there is de-mand for bioinformatics that leverage high performance computing (HPC) and parallelization to quickly process data. As such, we developed SLUR(M)-py: a pythonic computational platform that leverages the Simple Linux Utility for Resource Management system (SLURM) to process sequencing data. SLUR(M)-py is multi-omic and automates calls to SLURM for processing paired-end sequences from chromatin charac-terization experiments, including whole-genome, ChIP-seq, ATAC-seq, and Hi-C, thereby eliminating the need for multiple analytics pipelines. To demonstrate SLUR(M)-pys utility, we employ ATAC-seq and Hi-C data from viral infection experiments and the ENCODE project, and illustrate its processing speed and completeness, which outpaces current HPC pipelines. We explore the effect of dropping duplicate se-quenced reads in ATAC-seq, demonstrate how SLUR(M)-py can be used for quality control, and how to detect artifacts in Hi-C from viral infection experiments. Finally, we show how features in SLUR(M)-py, like inter-chromosomal analysis, can be used to explore the dynamics of chromosomal contacts in mammalian cells. This multi-omic, system agnostic platform eases the computational burden for researchers and quickly produces accurate, reliable data analytics for the epigenomics community.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 3
- FWCI
- 0.90
- Field percentile
- top 28%
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- EAP: a versatile cloud-based platform for comprehensive and interactive analysis of large-scale ChIP/ATAC-seq data sets
Guangyong Zheng, Haojie Chen, … Zhen Shao·Computational and Structural Biotechnology JournalPeer-reviewed·Jan 1, 2025
- snakePipes enable flexible, scalable and integrative epigenomic analysis
Vivek Bhardwaj, Steffen Heyne, … Thomas Manke·BioinformaticsPeer-reviewed·May 23, 2019
- Dr.seq2: A Quality Control And Analysis Pipeline For Parallel Single Cell Transcriptome And Epigenome Data
Chengchen Zhao, Shengen Shawn Hu, … Yong Zhang·PLoS ONEPeer-reviewed·Jul 3, 2017
- CHIPS: A Snakemake pipeline for quality control and reproducible processing of chromatin profiling data
Len Taing, Clara C. Cousins, … Ming Tang·F1000ResearchPeer-reviewed·Jun 30, 2021
- GenPipes: an open-source framework for distributed and scalable genomic analyses
Mathieu Bourgey, Rola Dali, … Guillaume Bourque·GigaSciencePeer-reviewed·Jun 1, 2019
- A Python-based optimization framework for high-performance genomics
Ariya Shajii, Ibrahim Numanagić, … Bonnie Berger·bioRxiv·Oct 29, 2020