Skip to content

Latest commit

 

History

History
 
 

formatdata

README.md

Pipeline : format data

Script : vcf_in_plink.nf

Requirement :

  • python3, plink, bcftools, bash, nextflow
  • singularity / dockers image : no test yet

what script done :

  • select for each chromosome on quality of imputation : min info
  • convert each vcf in plink
  • rename duplicate rs or . by chro
  • added cm in bim files if file genetic_map give in argumen,
  • merge all chromosome in plink format

arguments :

  • file_listvcf : file contains each bgzip vcf files to merge, one by line [default : none]
  • min_scoreinfo : what score info minimum do you want : [default :0.6]
  • output_pat : pattern of output for bed final file [default : out]
  • output_dir : directory of output : [default : plink]
  • genetic_maps : genetics maps to added map in bim file, if not provided, map doesn't added in bim, must be not compressed :
  • file for hg19
  • file for hg17
  • file for hg18
  • file for hg38
chr position COMBINED_rate(cM/Mb) Genetic_Map(cM)
1 55550 0 0
1 568322 0 0
1 568527 0 0

example

ls  dirvcf/chr*.vcf.gz > listfileawigen
nextflow run h3abionet/h3agwas/formatdata/vcf_in_plink.nf --file_listvcf listfileawigen -resume -profile slurm --output_pat awigen  --genetic_maps $FileCM --plink_mem_req 6GB -r hackathon

Script : vcf_in_impute2.nf

Requirement :

  • plink, bcftools, bash, nextflow
  • singularity / dockers image : no test yet

what script done :

  • Intiial data : format of Sanger imputation format vcf file
  • select for each chromosome on quality of imputation : min info
  • convert each vcf in impute2 format used by boltlmmm
  • output for each chromosome is basename of initial files with .impute2.gz

arguments :

  • file_listvcf : file contains each bgzip vcf files to merge, one by line [default : none]
  • min_scoreinfo : what score info minimum do you want : [default :0.6]
  • output_dir : directory of output : [default : impute2]

format a gwas file format_gwasfile.nf

Requirement :

  • plink, bash, nextflow, python3 (library : panda)
  • singularity / dockers image : no test yet

what script done :

  • initial data of gwas format transform in other files
  • search rs on file to added new rs at each position (if not found add chro:pos)
  • added N and frequencies values if need and plink file gave
  • Change header, separator... etc

arguments :

  • file_gwas : one file gwas :

    • intial header of your file :
      • head_pval [optional]
      • head_freq [optional]
      • head_bp
      • head_chr
      • head_beta [optional]
      • head_se [optional]
      • head_A1 [optional]
      • head_A2 [optional]
      • head_N [optional]
    • sep separator default space or tab, [optional], for comma : COM, tabulation : TAB and space "WHI"

  • header of your output :

    • if not initialise : using output of your initial files
    • headnew_pval [optional]
    • headnew_freq [optional]
    • headnew_bp [optional]
    • headnew_chr [optional]
    • headnew_beta [optional]
    • headnew_se [optional]
    • headnew_A1 [optional]
    • headnew_A2 [optional]
    • headnew_N [optional]

  • file to extract rsinfomation with position :

    • file_ref_gzip : must be in gzip example of file used : here
      • poshead_chro_inforef psotion of column chromosome in file [default : 0]
      • poshead_bp_inforef : position of column where bp in file [default : 1]
      • poshead_rs_inforef : position of column where rs in file [default : 2]

  • others option :

    • added some N and frequencie in gwas file :
      • used plink information to compute freq and N and added in gwas file if head_N and/or head_freq not intialise
      • input_dir : plink directory
      • input_pat : plink basename
    • mem_req : memory request for processes>

Pipeline : convert position hg38 in hg19

nextflow run convert_posversiongenome.nf

what is doing?

  • if no file give download gwas catalog
  • extract positions of interest
  • used rs to search position see args file_ref_gzip
  • used crossmap to defined position s not found previously and strand : see bin_crossmap and data_crossmap
  • return file with new position

arguments

  • output_dir : direction of output [default : output]

  • output : output : [default : out]

  • file_toconvert : file to convert if empty download gwas catalog

    • link_gwas_cat : link to download gwas catalog [default : https://www.ebi.ac.uk/gwas/api/search/downloads/alternative ]
    • head_rs : head rs to file to convert [default SNPS (gwas catalog)]
    • head_bp : head bp to file to convert [default SNPS (gwas catalog)]
    • head_chro : head bp to file to convert [default SNPS (gwas catalog)]
    • sep : separator used TAB, SPACE, "," [default TAB] (not allowed : ;)

  • file to extract rsinfomation with position :

  • file_ref_gzip : must be in gzip example of file used : here

    • poshead_chro_inforef psotion of column chromosome in file [default : 0]
    • poshead_bp_inforef : position of column where bp in file [default : 1]
    • poshead_rs_inforef : position of column where rs in file [default : 2]

  • bin_crossmap : crossmap [default ~/.local/bin/CrossMap.py]

  • data_crossmap : data to convert [default : "" ]

###output ;

  • {out}.tsv : final file
  • {out}.multi.tsv : more that one position have been found
  • {out}.detail.tsv : file before cleaning
  • {out}.notfound.tsv : fileswhere position not found
  • folder datai : contains files contains files download
  • folder datatmp : contains temporary file (extract of rs file)

installation :

R : library pip3.6 install CrossMap --user pip3.6 install numpy==1.16.1 --user chmod +x ~/.local/bin/CrossMap.py

Pipeline : vcf_in_bimbam.nf

transform vcf in bimbam format after filters for quality. ###arguments

  • file_listvcf : file contains each bgzip vcf files to merge, one by line [default : none]
  • min_scoreinfo : what score info minimum do you want : [default :0.6]
  • output_dir : directory of output : [default : impute2]
  • genotype_field : genotype field in vcf file [default : GP]
  • qctoolsv2_bin : qctools v2 binary [default :qctool_v2]
  • bcftools_bin : bcftools bin [default : bcftools]

Pipeline : prepareforimp.nf

argument :

  • input_dir
  • input_pat
  • output_dir : direction of output [default : output]
  • file to extract rsinfomation with position :
  • file_ref_gzip : must be in gzip example of file used : here
    • poshead_chro_inforef psotion of column chromosome in file [default : 0]
    • poshead_bp_inforef : position of column where bp in file [default : 1]
    • poshead_rs_inforef : position of column where rs in file [default : 2]
  • deleted_notref : deleted position s not found in file_ref_gzip
  • reffasta : fasta reference, if present do control of vcf file : *checkVCF.py *bcftools : used plugin of +fixref see BCFTOOLS_PLUGINS=bcftools/plugins/

requirement

*bcftools *plink *R *python