From a9c24502bcdbf4a6b83477fdf7b3c4b3b86f7084 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 09:21:26 +0200
Subject: [PATCH 01/14] Update 12-3.md

Self-Attention Paragraph Typos: Issues #779
---
 docs/en/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/en/week12/12-3.md b/docs/en/week12/12-3.md
index 6b7149760..c486ea881 100644
--- a/docs/en/week12/12-3.md
+++ b/docs/en/week12/12-3.md
@@ -36,7 +36,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$.
+where $\boldsymbol{a} \in \mathbb{R}^t$ is a column vector with components $\alpha_i$.
 
 Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights.
 

From d5c0816437e19126484303888c155e913f071c2c Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 09:29:10 +0200
Subject: [PATCH 02/14] Update 12-3.md

Correction in Spanish
---
 docs/es/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/es/week12/12-3.md b/docs/es/week12/12-3.md
index 56795474a..7b5ed76d5 100644
--- a/docs/es/week12/12-3.md
+++ b/docs/es/week12/12-3.md
@@ -47,7 +47,7 @@ $$
 $$
 
 <!-- where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$. -->
-donde $\boldsymbol{a} \in \mathbb{R}^n$ es un vector columna con componentes $\alpha_i$.
+donde $\boldsymbol{a} \in \mathbb{R}^t$ es un vector columna con componentes $\alpha_i$.
 
 <!-- Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights. -->
 Nótese que esto difiere de la representación oculta que hemos visto hasta ahora, donde las entradas son multiplicadas por una matriz de pesos.

From 381affd34e008bb60e9cfd3a8166a325623ced9a Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 09:30:10 +0200
Subject: [PATCH 03/14] Update 12-3.md

---
 docs/fr/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/fr/week12/12-3.md b/docs/fr/week12/12-3.md
index fe6f17e4d..beb0acc1f 100644
--- a/docs/fr/week12/12-3.md
+++ b/docs/fr/week12/12-3.md
@@ -49,7 +49,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$.
+where $\boldsymbol{a} \in \mathbb{R}^t$ is a column vector with components $\alpha_i$.
 
 Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights.
 

From 638c7563e9d2e1dad6dab247a7655da8e1cd10f8 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 09:30:55 +0200
Subject: [PATCH 04/14] Update 12-3.md

---
 docs/ja/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/ja/week12/12-3.md b/docs/ja/week12/12-3.md
index 7265dbd3e..728736a8f 100644
--- a/docs/ja/week12/12-3.md
+++ b/docs/ja/week12/12-3.md
@@ -47,7 +47,7 @@ $$
 $$
 
 <!-- where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$. -->
-ただし$\boldsymbol{a} \in \mathbb{R}^n$は要素が$\alpha_i$の列ベクトルです。
+ただし$\boldsymbol{a} \in \mathbb{R}^t$は要素が$\alpha_i$の列ベクトルです。
 
 <!-- Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights.
 

From ef766c072d896dd66679b2b546ea93c845ad9748 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 09:31:26 +0200
Subject: [PATCH 05/14] Update 12-3.md

---
 docs/ko/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/ko/week12/12-3.md b/docs/ko/week12/12-3.md
index f092eeeb0..c564a9a10 100644
--- a/docs/ko/week12/12-3.md
+++ b/docs/ko/week12/12-3.md
@@ -48,7 +48,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$.
+where $\boldsymbol{a} \in \mathbb{R}^t$ is a column vector with components $\alpha_i$.
 
 Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights.
 

From cb709367cd8ad3a3690113935fe396546200d885 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 09:32:07 +0200
Subject: [PATCH 06/14] Update 12-3.md

---
 docs/ru/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/ru/week12/12-3.md b/docs/ru/week12/12-3.md
index 3e95e9603..c1b1e001f 100644
--- a/docs/ru/week12/12-3.md
+++ b/docs/ru/week12/12-3.md
@@ -46,7 +46,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$.
+where $\boldsymbol{a} \in \mathbb{R}^t$ is a column vector with components $\alpha_i$.
 
 Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights.
 

From 0bea95972e85f43d3303521a3981a034306820e3 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 09:33:03 +0200
Subject: [PATCH 07/14] Update 12-3.md

---
 docs/tr/week12/12-3.md | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/docs/tr/week12/12-3.md b/docs/tr/week12/12-3.md
index 91491d2bf..b8fcd517a 100644
--- a/docs/tr/week12/12-3.md
+++ b/docs/tr/week12/12-3.md
@@ -58,7 +58,7 @@ $$
 $$
 
 <!--
-where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$.
+where $\boldsymbol{a} \in \mathbb{R}^t$ is a column vector with components $\alpha_i$.
 
 Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights.
 
@@ -577,4 +577,4 @@ model = TransformerClassifier(num_layers=1, d_model=32, num_heads=2,
 ```
 <!--
 Where this model is trained in typical fashion.
--->
\ No newline at end of file
+-->

From 6d4070359d4bdc6621eaa806164b7d73cf2db7a8 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 09:33:53 +0200
Subject: [PATCH 08/14] Update 12-3.md

---
 docs/zh/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/zh/week12/12-3.md b/docs/zh/week12/12-3.md
index d9ecefeee..397f887ee 100644
--- a/docs/zh/week12/12-3.md
+++ b/docs/zh/week12/12-3.md
@@ -38,7 +38,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-其中$\boldsymbol{a} \in \mathbb{R}^n$ 是具有$\alpha_i$分量的列向量.
+其中$\boldsymbol{a} \in \mathbb{R}^t$ 是具有$\alpha_i$分量的列向量.
 
 请注意，这与我们到目前为止看到的隐藏表示形式不同，在隐藏表示形式中，输入乘以权重矩阵。
 

From 8f5a3ff4929d21db3487cad5026093e00e8e16e4 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 15:38:47 +0200
Subject: [PATCH 09/14] Update docs/es/week12/12-3.md

Co-authored-by: Alfredo Canziani <alfredo.canziani@gmail.com>
---
 docs/es/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/es/week12/12-3.md b/docs/es/week12/12-3.md
index 7b5ed76d5..f7d4405b6 100644
--- a/docs/es/week12/12-3.md
+++ b/docs/es/week12/12-3.md
@@ -46,7 +46,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-<!-- where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$. -->
+<!-- where $\boldsymbol{a} \in \mathbb{R}^t$ is a column vector with components $\alpha_i$. -->
 donde $\boldsymbol{a} \in \mathbb{R}^t$ es un vector columna con componentes $\alpha_i$.
 
 <!-- Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights. -->

From a84a4791241f271eb4b735fa917c900f08f9f280 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 15:43:16 +0200
Subject: [PATCH 10/14] Update French 12-3.md

---
 docs/fr/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/fr/week12/12-3.md b/docs/fr/week12/12-3.md
index beb0acc1f..418bfd33a 100644
--- a/docs/fr/week12/12-3.md
+++ b/docs/fr/week12/12-3.md
@@ -78,7 +78,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-où $\boldsymbol{a} \in \mathbb{R}^n$ est un vecteur colonne avec les composantes $\alpha_i$.
+où $\boldsymbol{a} \in \mathbb{R}^t$ est un vecteur colonne avec les composantes $\alpha_i$.
 
 Notez que cela diffère de la représentation cachée que nous avons vue jusqu'à présent, où les entrées sont multipliées par une matrice de poids.
 

From 0a73ac6aa5072375f7c5d11583f2f580a3a8c53d Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 15:46:03 +0200
Subject: [PATCH 11/14] Update english comment 12-3.md

---
 docs/ja/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/ja/week12/12-3.md b/docs/ja/week12/12-3.md
index 728736a8f..ea3ba6940 100644
--- a/docs/ja/week12/12-3.md
+++ b/docs/ja/week12/12-3.md
@@ -46,7 +46,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-<!-- where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$. -->
+<!-- where $\boldsymbol{a} \in \mathbb{R}^t$ is a column vector with components $\alpha_i$. -->
 ただし$\boldsymbol{a} \in \mathbb{R}^t$は要素が$\alpha_i$の列ベクトルです。
 
 <!-- Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights.

From f4c66df14ee13033d8203986068dbf398f372181 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 15:47:45 +0200
Subject: [PATCH 12/14] Update korean 12-3.md

---
 docs/ko/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/ko/week12/12-3.md b/docs/ko/week12/12-3.md
index c564a9a10..0d5b011d1 100644
--- a/docs/ko/week12/12-3.md
+++ b/docs/ko/week12/12-3.md
@@ -76,7 +76,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-$\boldsymbol{a} \in \mathbb{R}^n$는 요소 $\alpha_i$를 갖고있는 열 벡터이다.
+$\boldsymbol{a} \in \mathbb{R}^t$는 요소 $\alpha_i$를 갖고있는 열 벡터이다.
 
 이는 우리가 지금까지 보아온 은닉 표현, 입력값이 가중치 행렬로 곱해지는 것과는 다르다.
 

From 7ff5eef7249b2bf6385f394e30ffe198671b90f1 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 15:48:40 +0200
Subject: [PATCH 13/14] Update Russian 12-3.md

---
 docs/ru/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/ru/week12/12-3.md b/docs/ru/week12/12-3.md
index c1b1e001f..42ab13088 100644
--- a/docs/ru/week12/12-3.md
+++ b/docs/ru/week12/12-3.md
@@ -75,7 +75,7 @@ $$
 \boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
 $$
 
-где $\boldsymbol{a} \in \mathbb{R}^n$ вектор-столбец с компонентами $\alpha_i$.
+где $\boldsymbol{a} \in \mathbb{R}^t$ вектор-столбец с компонентами $\alpha_i$.
 
 Отметим, что это отличается от внутреннего представления, которое мы видели до сих пор, где входы умножались на матрицу весов.
 

From d97d2ea432d2456ca62911ca1bc46d7014732767 Mon Sep 17 00:00:00 2001
From: Giuseppe Saccardi <giuseppesaccardi@icloud.com>
Date: Thu, 6 May 2021 15:50:30 +0200
Subject: [PATCH 14/14] Update turkish 12-3.md

---
 docs/tr/week12/12-3.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/tr/week12/12-3.md b/docs/tr/week12/12-3.md
index b8fcd517a..7b1c2cf9a 100644
--- a/docs/tr/week12/12-3.md
+++ b/docs/tr/week12/12-3.md
@@ -64,7 +64,7 @@ Note that this differs from the hidden representation we have seen so far, where
 
 Depending on the constraints we impose on the vector $\vect{a}$, we can achieve hard or soft attention.
 -->
-Burada $\boldsymbol{a} \in \mathbb{R}^n$, bileşenleri  $\alpha_i$ olan bir sütun vektörüdür.
+Burada $\boldsymbol{a} \in \mathbb{R}^t$, bileşenleri  $\alpha_i$ olan bir sütun vektörüdür.
 
 Dikkat edin, bu daha önce gördüğümüz, girdilerin ağırlık matrisleriyle çarpıldığı gizli gösterimlerden farklı.