oversmoothing

Here are 10 public repositories matching this topic...

VITA-Group / ViT-Anti-Oversmoothing

[ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang Wang

signal-processing fourier-analysis vision-transformer oversmoothing

Updated Jan 6, 2024
Python

tk-rusch / GraphCON

Star

GraphCON (ICML 2022)

graph-convolutional-networks icml graph-attention-networks graph-neural-networks pytorch-geometric oversmoothing icml-2022

Updated Sep 29, 2022
Python

tk-rusch / gradientgating

Star

Gradient gating (ICLR 2023)

pytorch message-passing gcn iclr graphsage graph-neural-networks gat pytorch-geometric heterophily oversmoothing iclr2023

Updated May 11, 2023
Python

VITA-Group / Diverse-ViT

Star

[CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong Chen, Zhenyu Zhang, Yu Cheng, Ahmed Awadallah, Zhangyang Wang

diversity transformer regularization vision-transformer oversmoothing training-techniques

Updated Mar 9, 2022
Python

xnuohz / DeeperGCN-dgl

Star

A DGL implementation of "DeeperGCN: All You Need to Train Deeper GCNs".

dgl ogb oversmoothing deeper-gnn

Updated Apr 14, 2021
Python

YeskendirK / Reducing-Oversmoothing

Star

Source code accompanying the paper "Reducing Over-smoothing in Graph Neural Networks Using Relational Embeddings" published in DLG-AAAI’23

graph-algorithms graph-neural-networks graph-attention-network oversmoothing

Updated Jan 8, 2023
Python

SirArthur7 / GCN-ISI-Summer-School

Star

ISI 7th Summer School Project on implementing 2-layer GCN on CORA, CiteSeer, PubMed datasets, using PyTorch, and analyzing Oversmoothing by going deep upto 1024 layers

deep-learning pytorch semi-supervised-learning gcn citation-network node-classification oversmoothing