This is a DL environment for developing and comparing results of certain hollow organs segmentation, such as the bladder, which is especially hard to automate due to their complex geometry, vague intensity gradients in the soft tissues, and a tedious manual process of the data annotation routine. Yet, accurate localization of the walls and the cancer regions in the radiologic images of such organs is an essential step in oncology. We proposed a new class of hollow kernels that learn to 'mimic' the contours of the segmented organ, effectively replicating its shape and structural complexity. We train a series of the U-Net-like neural networks using the proposed kernels and demonstrate the superiority of the idea in various spatio-temporal convolution scenarios. Specifically, the dilated hollow-kernel architecture outperforms state-of-the-art spatial segmentation models, whereas addition of temporal blocks with, e.g., Bi-LSTM, establishes a new multi-class baseline for the bladder segmentation challenge.
Top: the bladder in 3D and the hollow kernels which mimic the shape of the organ.
Bottom: Intuition behind the hollow kernels: convolution with them emphasizes the contours of the organ along with the tissue borders in the vicinity. The effect depends on the scale of the convolution kernel.
git clone https://github.com/cviaai/LEARNABLE-HOLLOW-KERNELS.git
In this case, you may need to manually install the dependencies.
If you use this package in your publications or in other work, please cite it as follows:
@misc{lazareva2020learnable,
title={Learnable Hollow Kernels for Anatomical Segmentation},
author={Elizaveta Lazareva and Oleg Rogov and Olga Shegai and Denis Larionov and Dmitry V. Dylov},
year={2020},
eprint={2007.05103},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
Elizaveta Lazareva (main contributor)
Oleg Rogov