Skip to content

Commit 836e3b7

Browse files
committed
change the model name
1 parent e64d8c3 commit 836e3b7

File tree

3 files changed

+18
-5
lines changed

3 files changed

+18
-5
lines changed

README.md

Lines changed: 15 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,8 @@
11
# PS-Mixer
22

3-
![image-20220613005537561](https://jhfaoisehoiew.oss-cn-beijing.aliyuncs.com/img/image-20220613005537561.png)
3+
![image-20220613102731468](https://jhfaoisehoiew.oss-cn-beijing.aliyuncs.com/img/image-20220613102731468.png)
4+
5+
We propose a Polar-Vector and Strength-Vector mixer model called PS-Mixer, which is based on MLP-Mixer, to achieve better communication between different modal data for multimodal sentiment analysis.
46

57
## Requirements
68

@@ -25,7 +27,13 @@ pip install requirements.txt
2527
2. Set ```sdk_dir``` to the path of CMU-MultimodalSDK.
2628
3. ```python train.py --data mosi```. Replace ```mosi``` with ```mosei``` for other datasets.
2729

28-
The repository is updating...
30+
31+
32+
## Result
33+
34+
![image-20220615124635075](https://jhfaoisehoiew.oss-cn-beijing.aliyuncs.com/img/image-20220615124635075.png)
35+
36+
![image-20220615124651014](https://jhfaoisehoiew.oss-cn-beijing.aliyuncs.com/img/image-20220615124651014.png)
2937

3038
## Acknowledgements
3139

@@ -40,6 +48,11 @@ We begin our work on the basis of [MISA](https://github.com/declare-lab/MISA) in
4048
}
4149
```
4250

51+
52+
53+
The repository is updating...
54+
4355
## Contact
4456

4557
For any questions, please email at [zpl010720@gmail.com](zpl010720@gmail.com)
58+

config.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -95,7 +95,7 @@ def get_config(parse=True, **optional_kwargs):
9595
parser.add_argument('--scale_weight', type=float, default=0.1)
9696

9797
parser.add_argument('--model', type=str,
98-
default='MISA', help='one of {MISA, }')
98+
default='PS-Mixer', help='one of {PS-Mixer, }')
9999

100100
parser.add_argument('--test_duration', type=int, default=1)
101101

new_models.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,9 +5,9 @@
55
from einops.layers.torch import Rearrange
66

77
# let's define a simple model that can deal with multimodal variable length sequence
8-
class MISA(nn.Module):
8+
class PS_Mixer(nn.Module):
99
def __init__(self, config):
10-
super(MISA, self).__init__()
10+
super(PS_Mixer, self).__init__()
1111
self.config = config
1212
self.text_size = config.embedding_size
1313
self.visual_size = config.visual_size

0 commit comments

Comments
 (0)