Molecule property prediction based on computational strategy plays a key role in the process of drug discovery and design, such as DFT. Yet, these classical methods are timeconsuming and labour-intensive, which can’t satisfy the need of biomedicine. Thanks to the development of deep learning, there are many variants of Graph Neural Networks (GNN) for molecule representation learning. However, whether the existed well-perform graph-based methods have a number of parameters, or the light models can’t achieve good grades on various tasks. In order to manage the trade-off between efficiency and performance, we propose a novel model architecture, CoAtGIN1, using both Convolution and Attention. On the local level, khop convolution is designed to capture long-range neighbour information. On the global level, besides using the virtual node to pass identical messages, we utilize linear attention to aggregate global graph representation according to the importance of each node and edge. In the recent OGB Large-Scale Benchmark, CoAtGIN achieves the 0.0901 Mean Absolute Error (MAE) on the large-scale PCQM4Mv2 dataset with only 6.4 M model parameters. Moreover, using the linear attention block improves the performance, which helps to capture the global representation.
-
Notifications
You must be signed in to change notification settings - Fork 1
CoAtGIN: Marrying Convolution and Attention for Graph-based Molecule Property Prediction
License
xfcui/CoAtGIN
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
CoAtGIN: Marrying Convolution and Attention for Graph-based Molecule Property Prediction
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published