Skip to content

Commit a854a34

Browse files
committed
More updates following lesson and feedback
1 parent 0b182b6 commit a854a34

File tree

2 files changed

+36
-1
lines changed

2 files changed

+36
-1
lines changed

3_Cluster_Computing.md

Lines changed: 22 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -154,6 +154,8 @@ This leads to the question: what are appropriate amounts of memory and CPUs to r
154154

155155
Perhaps the simplest and most convenient way to make these calculations is to check the resources used by already completed jobs and use that as a benchmark for the future. Obtaining these metrics on already completed jobs can be achieved with the `sacct` command.
156156

157+
It is also possible to specify what type of node you wish to use for a job. For example, to use the GPU nodes: `--partition=gpu`.
158+
157159
### A note on exit codes
158160
At various points when using the cluster, you may see the term "exit code" reported. What does this mean? Well, when a job finishes it will be assigned an exit code which reports whether a job completed successfully or whether there was some kind of error. To assist with debugging, different classes of errors are usually assigned different exit codes. But all you need to know is that an exit code of 0 means the job completed successfully, while any other exit code denotes some kind of error.
159161

@@ -167,7 +169,7 @@ To get the maximum memory usage:
167169
sacct --format=jobID%20,CPUTime,MaxRSS -j [job id]
168170

169171
#### `scancel`
170-
To kill running jobs use scancel:
172+
To kill running jobs use `scancel`:
171173

172174
scancel [job id]
173175

@@ -346,5 +348,24 @@ You need to be a member of the `singularity` group to place files in that folder
346348

347349
Singularity is also installed on the Cell Biology Bioinformatics Machine. Containers can be run from any location on that system.
348350

351+
## Next-Generation Sequencing bioinformatics pipelines
352+
We have installed a variety of NGS bioinformatics pipelines on the cluster. Some of these we have built in-house at the LMB, while the others have been made available by [nf-core](https://nf-co.re).
353+
354+
We currently have the following pipelines installed for:
355+
356+
* NGS QC - initial quality control on FASTQ files
357+
* ATAC-seq - assesses genome-wide chromatin accessibility
358+
* ChIP-seq - identify DNA-protein interactions
359+
* Cut and Run/Tag - identify DNA-protein interactions
360+
* RNA-seq - detection and quantitative analysis of RNA
361+
* Single Cell RNA-seq (10x) - detection and quantitative analysis of RNA at single cell resolution using 10x technology
362+
* Single Cell RNA-seq (Parse) - detection and quantitative analysis of RNA at single cell resolution using Parse Evercode technology
363+
* Taxonomy Profiling - taxonomic classification of the origin of FASTQ reads
364+
* Download Data - download NGS datasets (FASTQ files and metadata) from online repositories
365+
366+
For more details on these pipelines, please go to the following intranet link: http://intranet.lmb.internal/scientific-facilities/high-throughput-sequencing
367+
368+
We have tried to make the running of the pipelines easier by creating the intranet site [Guide-Piper](http://guidepiper), which helps you build the cluter command you need to process your datasets.
369+
349370
## Further assistance
350371
This section introduced the key concepts of using Slurm on the LMB cluster, but for more details please view the Scientific Computing page at: https://www.mrc-lmb.cam.ac.uk/scicomp/index.php?id=computer-cluster

presentation.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -850,6 +850,20 @@ table {
850850

851851
---
852852

853+
## NGS Bionformatics Pipelines
854+
855+
* NGS QC
856+
* ATAC-seq
857+
* ChIP-seq
858+
* Cut and Run/Tag
859+
* RNA-seq
860+
* Single Cell RNA-seq (10x)
861+
* Single Cell RNA-seq (Parse)
862+
* Taxonomy Profiling
863+
* NGS data downloading Data
864+
865+
---
866+
853867
## Summary
854868

855869
* Linux / Bash

0 commit comments

Comments
 (0)