Official MCTSeg

Description

This is the source code for the paper, "A Multimodal Feature Distillation with CNN-Transformer Network for Brain Tumor Segmentation with Incomplete Modalities", of which I am the first author. The paper is a preprint without the intention to publish and available to download from arXiv.

Model

The Multimodal feature distillation with CNN-Transformer hybrid network for incomplete multimodal brain tumor Segmentation (MCTSeg) model configuration (i.e., network construction) file is net.py in the directory .\model. To train and test by running train.py and test.py.

Recommended dependencies:

Python <= 3.8
Torch <= 1.7.1
CUDA <= 11.1

Evaluation

Datasets Brain Tumor Segmentation (BraTS) Challenge 2018/2020 (BraTS2018/BraTS2020).

Referencing Guide

Please cite the paper if using this repository. Here is a guide to referencing this work in various styles for formatting your references:

Plain Text

• IEEE Reference Style
  M. Kang, F. F. Ting, R. C.-W. Phan, Z. Ge, and C.-M. Ting, "A multimodal feature distillation with cnn-transformer network for brain tumor segmentation with incomplete modalities," 2024, arXiv:2404.14019.
  

• IEEE Full Name Reference Style
  M. Kang, F. F. Ting, R. C.-W. Phan, Z. Ge, and C.-M. Ting, "A multimodal feature distillation with cnn-transformer network for brain tumor segmentation with incomplete modalities," arXiv:2404.14019, 2024.
  ^{NOTE: This is a modification to the standard IEEE Reference Style and used by most IEEE/CVF conferences, including CVPR, ICCV, and WACV, to render first names in the bibliography as "Firstname Lastname" rather than "F. Lastname" or "Lastname, F.".}
   - IJCAI Full Name-Year Variation
  [Kang et al., 2024] Ming Kang, Fung Fung Ting, Raphaël C.-W. Phan, Zongyuan Ge, and Chee-Ming Ting. A multimodal feature distillation with cnn-transformer network for brain tumor segmentation with incomplete modalities. arXiv preprint arXiv:2404.14019, 2024.
   - ACL Full Name-Year Variation
  Ming Kang, Fung Fung Ting, Raphaël C.-W. Phan, Zongyuan Ge, and Chee-Ming Ting. 2024. A multimodal feature distillation with cnn-transformer network for brain tumor segmentation with incomplete modalities. arXiv preprint arXiv:2404.14019.
  

• Nature Reference Style
  Kang, M., Ting, F. F., Phan, R. C.-W., Ge, Z. & Ting, C.-M. A multimodal feature distillation with CNN-Transformer network for brain tumor segmentation with incomplete modalities. Preprint at https://arxiv.org/abs/2404.14019 (2024).
  

• Springer Reference Style
  Kang, M., Ting, F.F., Phan, R.C.-W., Ge, Z., Ting, C.-M.: A multimodal feature distillation with CNN-transformer network for brain tumor segmentation with incomplete modalities (2024), arXiv preprint arXiv:2404.14019
  

• Elsevier Numbered Style
  M. Kang, F.F. Ting, R.C.-W. Phan, Z. Ge, C.-M. Ting, A multimodal feature distillation with CNN-Transformer network for brain tumor segmentation with incomplete modalities, arXiv preprint arXiv:2404.14019 (2024).
  

• Elsevier Name–Date (Harvard) Style
  Kang, M., Ting, F.F., Phan, R.C.-W., Ge, Z., Ting, C.-M., 2024. A multimodal feature distillation with CNN-Transformer network for brain tumor segmentation with incomplete modalities. arXiv preprint arXiv:2404.14019.
  

• Elsevier Vancouver Style
  Kang M, Ting FF, Phan RC-W, Ge Z, Ting C-M. A multimodal feature distillation with CNN-Transformer network for brain tumor segmentation with incomplete modalities. ArXiv [Preprint]. 2024 arXiv:2404.14019 [posted 2024 Apr 22]: [10 p.]. Available from: https://arxiv.org/abs/2404.14019 doi: https://doi.org/10.48550/arXiv.2404.14019
  

• Elsevier Embellished Vancouver Style
  Kang M, Ting FF, Phan RC-W, Ge Z, Ting C-M. A multimodal feature distillation with CNN-Transformer network for brain tumor segmentation with incomplete modalities. ArXiv [Preprint]. 2024 arXiv:2404.14019 [posted 2024 Apr 22]: [10 p.]. Available from: https://arxiv.org/abs/2404.14019 doi: https://doi.org/10.48550/arXiv.2404.14019
  

• APA7 (Author–Date) Style
  Kang, M., Ting, F. F., Phan, R. C.-W., Ge, Z., & Ting, C.-M. (2024). A multimodal feature distillation with CNN-Transformer network for brain tumor segmentation with incomplete modalities. ArXiv, https://doi.org/10.48550/arXiv.2404.14019
   - ICML (Author–Year) Variation
  Kang, M., Ting, F. F., Phan, R. C.-W., Ge, Z., and Ting, C.-M. A multimodal feature distillation with CNN-Transformer network for brain tumor segmentation with incomplete modalities. arXiv preprint arXiv:2404.14019, 2024.
  ^{NOTE: For NeurIPS and ICLR, any reference/citation style is acceptable as long as it is used consistently. The sample of references in Formatting Instructions For NeurIPS almost follows APA7 (author–date) style and that in Formatting Instructions For ICLR Conference Submissions is similar to IJCAI full name-year variation.}

BibTeX Format

\begin{thebibliography}{1}
\bibitem{bib1} M. Kang, R. C.-W. Phan, F. F. Ting, Z. Ge, and C.-M. Ting, ``A multimodal feature distillation with cnn-transformer network for brain tumor segmentation with incomplete modalities,'' 2024, {\em arXiv:2406.08634}.
\end{thebibliography}

@unpublished{Kang24Mctseg,
  author = "Kang, Ming and Ting, Fung Fung and Phan, Rapha{\"e}l C.-W. and Ge, Zongyuan and Ting, Chee-Ming",
  title = "A multimodal feature distillation with {CNN}-{T}ransformer network for brain tumor segmentation with incomplete modalities",
  howpublished = "arXiv preprint",
  year = "2024",
  doi= "10.48550/arXiv.2404.14019",
  url = "https://doi.org/10.48550/arXiv.2404.14019"
}

@aunpublished{Kang24Mctseg,
  author = "Ming Kang and Fung Fung Ting and Rapha{\"e}l C.-W. Phan and Zongyuan Ge and Chee-Ming Ting",
  title = "A multimodal feature distillation with cnn-transformer network for brain tumor segmentation with incomplete modalities",
  howpublished = "arXiv preprint",
  note = "arXiv:2404.14019",
  year = "2024",
}

^{NOTE: Please remove some optional BibTeX fields/tags such as series, volume, address, url, and so on if the LaTeX compiler produces an error. Author names may be manually modified if not automatically abbreviated by the compiler under the control of the bibliography/reference style (i.e., .bst) file. The BibTex citation key may be bib1, b1, or ref1 when references appear in numbered style in which they are cited. The quotation mark pair "" in the field could be replaced by the brace {}, whereas the brace {} in the BibTeX field/tag title plays a role of keeping letters/characters/text original lower/uppercases or sentence/capitalized cases unchanged while using Springer Nature bibliography style files, for example, sn-nature.bst.}

License

MCTSeg is released under the BSD 3-Clause "New" or "Revised" License. Please see the LICENSE file for more information.

Copyright Notice

Many utility codes of our project base on the codes of RFNet, M³AE, and Vision Transformer PyTorch repositories.