Skip to content

jkmckenna/smftools

Repository files navigation

PyPI Docs

smftools

A Python tool for processing raw sequencing data derived from single molecule footprinting experiments into anndata objects. Additional functionality for preprocessing, analysis, and visualization.

Philosophy

While most genomic data structures handle low-coverage data (<100X) along large references, smftools prioritizes high-coverage data (scalable to at least 1 million X coverage) of a few genomic loci at a time. This enables efficient data storage, rapid data operations, hierarchical metadata handling, seamless integration with various machine-learning packages, and ease of visualization. Furthermore, functionality is modularized, enabling analysis sessions to be saved, reloaded, and easily shared with collaborators. Analyses are centered around the anndata object, and are heavily inspired by the work conducted within the single-cell genomics community.

Dependencies

The following CLI tools need to be installed and configured before using the informatics (smftools.inform) module of smftools:

  1. Dorado -> For standard/modified basecalling and alignment. Can be attained by downloading and configuring nanopore MinKnow software.
  2. Samtools -> For working with SAM/BAM files
  3. Minimap2 -> The aligner used by Dorado
  4. Modkit -> Extracting summary statistics and read level methylation calls from modified BAM files
  5. Bedtools -> For generating Bedgraphs from BAM alignment files.
  6. BedGraphToBigWig -> For converting BedGraphs to BigWig files for IGV sessions.

Modules

Informatics: Processes raw Nanopore/Illumina data from SMF experiments into an AnnData object.

Preprocessing: Appends QC metrics to the AnnData object and perfroms filtering.

  • Tools: Appends various analyses to the AnnData object.
  • Plotting: Visualization of analyses stored within the AnnData object.

Announcements

09/09/24 - The pre-alpha phase package (smftools-0.1.1)

The informatics module has been bumped to alpha-phase status. This module can deal with POD5s and unaligned BAMS from nanopore conversion and direct SMF experiments, as well as FASTQs from Illumina conversion SMF experiments. Primary output from this module is an AnnData object containing all relevant SMF data, which is compatible with all downstream smftools modules. The other modules are still in pre-alpha phase. Preprocessing, Tools, and Plotting modules should be promoted to alpha-phase within the next month or so.

08/30/24 - The pre-alpha phase package (smftools-0.1.0) is installable through pypi!

Currently, this package (smftools-0.1.0) is going through rapid improvement (dependency handling accross Linux and Mac OS, testing, documentation, debugging) and is still too early in development for standard use. The underlying functionality was originally developed as a collection of scripts for single molecule footprinting (SMF) experiments in our lab, but is being packaged/developed to facilitate the expansion of SMF to any lab that is interested in performing these styles of experiments/analyses. The alpha-phase package is expected to be available within a couple months, so stay tuned!