PM4NGS

PM4NGS was designed to generate a standard organizational structure for Next Generation Sequencing (ngs) data analysis. It includes a directory structure for the project, several Jupyter notebooks for data management and CWL workflows for pipeline execution.

Our work was inspired by a manuscript by Prof. William Noble in 2009: A Quick Guide to Organizing Computational Biology Projects. We recommend reading this paper for a better understanding of the guiding principles of our project.

The project is composed of three main parts.

1. a project organizational structure which define a standard files and directories for the project

2. Jupyter Notebooks as user interfaces for data management and visualization

3. CWL workflows that execute the data analysis

PM4NGS source code includes the templates used by cookiecutter to generate the project organizational structure and the Jupyter notebooks. The CWL workflows are defined in a separate GitHub project named: cwl-ngs-workflows-cbb.

All projects generated from these templates follow the same design principles explained in the Background Information.

Features

• NGS data integration, management and analysis uses Jupyter notebooks, CWL workflows and cookiecutter project templates

• Easy installation and use with a minimum command line interaction

• Data analysis CWL workflows executed from the Jupyter notebook with automatic failing detection and can be validated with published data

• CWL workflows and Jupyter Notebooks are ready for cloud computing

• Project reports and dynamic content creation after data processing using CWL workflows are included

• Optional use of Docker/Biocontainers or Conda/Bioconda for Bioinformatics tool installations and managements are also included

Links to available data analysis workflows

• Differential Gene expression from RNA-Seq data
  • Samples description file
  • Installation
  • Jupyter Notebook Server
  • CWL workflows
  • Test Project
  • Extra requirements
• Differential Binding detection from ChIP-Seq data
  • Samples description file
  • Installation
  • Jupyter Notebook Server
  • CWL workflows
  • Test Project
  • Extra requirements
• Detection of binding events from ChIP-exo data
  • Samples description file
  • Installation
  • Jupyter Notebook Server
  • CWL workflows
  • Test Project
  • Extra requirements

Extra links

• Project Templates Installation
• Project Description YAML file

Reference

1. Vera Alvarez R, Pongor LS, Mariño-Ramírez L and Landsman D. Containerized open-source framework for NGS data analysis and management [version 1; not peer reviewed]. F1000Research 2019, 8(ISCB Comm J):1229 (poster) (doi: 10.7490/f1000research.1117155.1)

Public Domain Notice

National Center for Biotechnology Information.

This software is a "United States Government Work" under the terms of the United States Copyright Act. It was written as part of the authors' official duties as United States Government employees and thus cannot be copyrighted. This software is freely available to the public for use. The National Library of Medicine and the U.S. Government have not placed any restriction on its use or reproduction.

Although all reasonable efforts have been taken to ensure the accuracy and reliability of the software and data, the NLM and the U.S. Government do not and cannot warrant the performance or results that may be obtained by using this software or data. The NLM and the U.S. Government disclaim all warranties, express or implied, including warranties of performance, merchantability or fitness for any particular purpose.

Please cite NCBI in any work or product based on this material.