diff --git "a/DL\345\210\235\347\272\247\346\225\260\345\255\246\345\237\272\347\241\200/index.html" "b/DL\345\210\235\347\272\247\346\225\260\345\255\246\345\237\272\347\241\200/index.html" index e17dca6..bdca5de 100644 --- "a/DL\345\210\235\347\272\247\346\225\260\345\255\246\345\237\272\347\241\200/index.html" +++ "b/DL\345\210\235\347\272\247\346\225\260\345\255\246\345\237\272\347\241\200/index.html" @@ -49,7 +49,7 @@

概率论

优化理论

由于这方面内容确实很多,这里就强推一波 凸优化 (美) 鲍德 (Stephen Boyd) 这本书好了,上学期的凸优化主要也是使用的这本书,感觉是这方面入门比较友善的一本书了。

这方面具体以后应该会根据优化方法详细来写,Mark,之后再填好了。

-Share
MathDL
使用迅雷下载百度云中的文件
Share
MathDL
使用迅雷下载百度云中的文件
\ No newline at end of file diff --git a/EM-Algorithm/index.html b/EM-Algorithm/index.html index ce3cac4..577285d 100644 --- a/EM-Algorithm/index.html +++ b/EM-Algorithm/index.html @@ -1,29 +1,40 @@ -EM Algorithm | Welcome To Oa

EM Algorithm

Abstract

EM is an algorithm that enables parameter estimation in probabilistic models with incomplete data.

-

Introduction

Background

    -
  • maximum-likelihood estimation(MLE): $argmax\theta L(\theta)=argmax\theta \prod_{i=1}^n p(x_i;\theta_i)$
  • +EM Algorithm | Welcome To Oa

    EM Algorithm

    Abstract

    +

    EM is an algorithm that enables parameter estimation in probabilistic models with incomplete data.

    +

    Introduction

    +

    Background

    +
      +
    • maximum-likelihood estimation(MLE): $argmax_\theta L(\theta)=argmax_\theta \prod_{i=1}^n p(x_i;\theta_i)$
    • Jesen-inequality: for a concave function f(x), $f(E(x))>=E(f(x))$;equal when x is a constant
    • -
    • GMM:$ p ( \mathrm { x } ) = \sum { i = 1 } ^ { k } w { i } N { i } \left( \mathrm { x } ; \mu { i } , \Sigma { i } \right )$ s.t. $\sum { i = 1 } ^ { k } w _ { i } = 1$
    • +
    • GMM:$ p ( \mathrm { x } ) = \sum _ { i = 1 } ^ { k } w _ { i } N _ { i } \left( \mathrm { x } ; \mu _ { i } , \Sigma _ { i } \right )$ s.t. $\sum _ { i = 1 } ^ { k } w _ { i } = 1$
    -

    Problem Settings

    We have a distribution $p(x;\theta)$, then sample from it, get ($x_i,z_i$);$x$ is observable variable, while $y$ is hidden variable which can not be observed.Our task is estimating the $\theta$ from samples ${x_i}$.Use MLE construct log-likelihood function:

    -

    But the problem is we cannot observe hidden variable $z_i$.

    -

    Algorithm

    If $z_i \thicksim Q_i$, then

    -

    Then,

    -

    So we get the lower bound of log-likelihood function which can be easily diffrentiated.This means we can maxmize the lower bound easily.

    -

    Details

    while $\Delta >\epsilon${

    -
    # E-Step
    +

    Problem Settings

    +

    We have a distribution $p(x;\theta)$, then sample from it, get ($x_i,z_i$);$x$ is observable variable, while $y$ is hidden variable which can not be observed.Our task is estimating the $\theta$ from samples ${x_i}$.Use MLE construct log-likelihood function: +$$\begin{aligned} L ( \boldsymbol { \theta } ) & = \sum _ { i = 1 } ^ { 1 } \ln p \left( \mathbf { x } _ { i } ; \boldsymbol { \theta } \right ) \ & = \sum _ { i = 1 } ^ { 1 } \ln \sum _ { z } p \left( \mathbf { x } _ { i } , z _ { i } ; \boldsymbol { \theta } \right ) \end{aligned}$$ +But the problem is we cannot observe hidden variable $z_i$.

    +

    Algorithm

    +

    If $z_i \thicksim Q_i$, then +$$\begin{array} { l } { \sum _ { z } p ( z ) = 1 } \ { p ( z ) \geq 0 } \end{array}$$

    +

    Then, +$$\begin{aligned} \sum _ { i = 1 } ^ { l } \ln p \left( \mathbf { x } _ { i } ; \mathbf { \theta } \right ) = & \sum _ { i = 1 } ^ { l } \ln \sum _ { z _ { i } } p \left( \mathbf { x } _ { i } , z _ { i } ; \boldsymbol { \theta } \right ) \ & = \sum _ { i = 1 } ^ { l } \ln \sum _ { z _ { i } } Q _ { i } \left( z _ { i } \right ) \frac { p \left( \mathbf { x } _ { i } , z _ { i } ; \boldsymbol { \theta } \right ) } { Q _ { i } \left( z _ { i } \right ) } \ & \geq \sum _ { i = 1 } ^ { l } \sum _ { z _ { i } } Q _ { i } \left( z _ { i } \right ) \ln \frac { p \left( \mathbf { x } _ { i } , z _ { i } ; \boldsymbol { \theta } \right ) } { Q _ { i } \left( z _ { i } \right ) } \end{aligned}$$

    +

    So we get the lower bound of log-likelihood function which can be easily diffrentiated.This means we can maxmize the lower bound easily.

    +

    Details

    +

    while $\Delta >\epsilon${ +# E-Step $Q _ { i } \left( z _ { i } \right ) = p \left( z _ { i } | \mathrm { x } _ { i } ; \boldsymbol { \theta } \right )=\frac { p \left( \mathbf { x } _ { i } , z _ { i } ; \boldsymbol { \theta } \right ) } { \sum _ { z } p \left( \mathbf { x } _ { i } , z ; \mathbf { \theta } \right ) }$ # M-Step $L(\theta)=\sum _ { i } \sum _ { z _ { i } } Q _ { i } \left( z _ { i } \right ) \ln \frac { p \left( \mathbf { x } _ { i } , z _ { i } ; \theta \right ) } { Q _ { i } \left( z _ { i } \right ) }$ $\theta^{t+1} = \arg \max _ { \theta }L(\theta)$ $\Delta= L(\theta^{t+1})-L(\theta^t)$ -

    }

    -

    Coin-filpping experiment

    +}

    +

    Coin-filpping experiment

    +

    Fristly, we assign $\theta_A$ and $\theta_B$, then calculate the hidden variable distribution based on $\theta_A$, $theta_B$ and the samples.After that we maximize the lower bound of log-likelihood function, get new $\theta_A$ and $\theta_B$. After 10 runs, $\theta_A=0.80$ and $\theta_B=0.58$

    -

    References

    Share
    Share
    Hypergraph Convolution and Hyper Attention
\ No newline at end of file diff --git a/Hypergraph-Convolution-and-Hyper-Attention/fig1.png b/Hypergraph-Convolution-and-Hyper-Attention/fig1.png new file mode 100644 index 0000000..c9ed021 Binary files /dev/null and b/Hypergraph-Convolution-and-Hyper-Attention/fig1.png differ diff --git a/Hypergraph-Convolution-and-Hyper-Attention/index.html b/Hypergraph-Convolution-and-Hyper-Attention/index.html new file mode 100644 index 0000000..1f3ccd7 --- /dev/null +++ b/Hypergraph-Convolution-and-Hyper-Attention/index.html @@ -0,0 +1,50 @@ +Hypergraph Convolution and Hyper Attention | Welcome To Oa

Hypergraph Convolution and Hyper Attention

Introduction

+
    +
  • Author: Oxford
  • +
  • contribution: proposed end to end tranable conv and attention for hypergraph.
  • +
  • paper
  • +
+

What is Hypergraph

+

A simple graph's edge connect two vertices, while hypergraph's edge connects more than two vertices.As shown in fig1: +

+

Let $\mathcal { G } = ( V , E )$ be vera hypergraph with $N$ vertices and $M$ hyperedges. Each hyperedge $\epsilon \in E$ is assigned with a positive weight $W _ { \epsilon \epsilon }$, with all the weights stored in a diagonal matrix $\mathbf { W } \in \mathbb { R } ^ { M \times M }$.This

+

Different from simple graph which has an adjacency matrix, hypergraph use incidence matrix $\mathbf { H } \in \mathbb { R } ^ { N \times M }$ to represent graph's connections. If $v_i$ is connected by $\epsilon$, the $H_{i\epsilon}=1$,otherwise 0.Then the vertex degree is +$$D _ { i i } = \sum _ { \epsilon = 1 } ^ { M } W _ { \epsilon \epsilon } H _ { i \epsilon }$$ +and the hyperedge degree is +$$B _ { \epsilon \epsilon } = \sum _ { i = 1 } ^ { N } H _ { i \epsilon }$$ +and the vertices' feature is $X$

+

Hyper Conv

+

Assumtions:

+
    +
  1. more propagaions should be done between those vertices connected by a common hyperedge
  2. +
  3. the hyperedges with larger weights deserve more confidence in propagations.
  4. +
+

So one step conv can be: +$$x _ { i } ^ { ( l + 1 ) } = \sigma \left( \sum _ { j = 1 } ^ { N } \sum _ { \epsilon = 1 } ^ { M } H _ { i \epsilon } H _ { j \epsilon } W _ { \epsilon \epsilon } x _ { j } ^ { ( l ) } \mathbf { P } \right)$$

+

Written in matrix form: +$$\mathbf { X } ^ { ( l + 1 ) } = \sigma \left( \mathbf { H } \mathbf { W } \mathbf { H } ^ { \mathrm { T } } \mathbf { X } ^ { ( l ) } \mathbf { P } \right)$$

+

However $\mathbf { H } \mathbf { W } \mathbf { H } ^ { \mathrm { T } } $ does not hold a constrainted spectal radius, which means the scale of $X^l$ (here means distribution in my thoughts) will be changed.This will lead to numerical instabilities and increase the risk of exploding/vanishing gradients when stack multi hpyer conv layer together. So the author impose normalization here: +$$\mathbf { X } ^ { ( l + 1 ) } = \sigma \left( \mathbf { D } ^ { - 1 / 2 } \mathbf { H } \mathbf { W } \mathbf { B } ^ { - 1 } \mathbf { H } ^ { \mathrm { T } } \mathbf { D } ^ { - 1 / 2 } \mathbf { X } ^ { ( l ) } \mathbf { P } \right)$$

+

Hyper Attention

+

The incidence matrix $\mathbf{H}$ can be thought some kind of Attention matrix, but it was not learnable and trainable after defined before.

+

So here the author proposed Hyper Attention.However hypergraph attention is only feasible when the vertex set and the hyperedge set are from (or can be projected to) the same homogeneous domain, since only in this case, the similarities between vertices and hyperedges are directly comparable.Then the author choose a simple way: each vertex collects its K-nearest neighbors to form a hyper-edge.Then the attention score can be: +$$H _ { i j } = \frac { \exp \left( \sigma \left( \operatorname { sim } \left( x _ { i } \mathbf { P } , x _ { j } \mathbf { P } \right) \right) \right) } { \sum _ { k \in \mathcal { N } _ { i } } \exp \left( \sigma \left( \operatorname { sim } \left( x _ { i } \mathbf { P } , x _ { k } \mathbf { P } \right) \right) \right) }$$ +and \sin ( \cdot ) is a similarity function that computes the pairwise similarities between two verticies.

+

More have not been done

+
    +
  1. Hyper Attention on heterogeneous domain.
  2. +
  3. Why not treat the hyperedge as fully connected subgraph? better or worse than GCN+Polling or HGN?
  4. +
+
Share
\ No newline at end of file diff --git a/Install-tensorflow-gpu-with-CUDA10-0-Guide/index.html b/Install-tensorflow-gpu-with-CUDA10-0-Guide/index.html index 0a97e97..a2d3862 100644 --- a/Install-tensorflow-gpu-with-CUDA10-0-Guide/index.html +++ b/Install-tensorflow-gpu-with-CUDA10-0-Guide/index.html @@ -1,6 +1,6 @@ Install tensorflow-gpu with CUDA10.0 Guide | Welcome To Oa

Install tensorflow-gpu with CUDA10.0 Guide

Here is the guides I followed when install the tensorflow-gpu.

How to install Tensorflow GPU with CUDA 10.0 for python on Ubuntu

-
Share
Summary: ACM: Learning Dynamic Multi-agent Cooperation via Attentional Commmunication Model(ICANN 2018)
Share
Summary: ACM: Learning Dynamic Multi-agent Cooperation via Attentional Commmunication Model(ICANN 2018)
\ No newline at end of file +gitment.render('container')
\ No newline at end of file diff --git "a/MarkDown\350\257\255\346\263\225\350\256\260\345\275\225/index.html" "b/MarkDown\350\257\255\346\263\225\350\256\260\345\275\225/index.html" index 30f66f9..8538337 100644 --- "a/MarkDown\350\257\255\346\263\225\350\256\260\345\275\225/index.html" +++ "b/MarkDown\350\257\255\346\263\225\350\256\260\345\275\225/index.html" @@ -238,7 +238,7 @@

希腊字母

其他字符

内容包括关系运算符,集合运算符,对数,三角以及微积分运算符。
Markdown中写数学公式

-Share
Util
共轭梯度法&QR分解法
Share
Util
共轭梯度法&QR分解法
\ No newline at end of file diff --git a/Messeage/index.html b/Messeage/index.html index d318f11..c76ecee 100644 --- a/Messeage/index.html +++ b/Messeage/index.html @@ -7,4 +7,4 @@ client_secret: 'fed7dc675f5293f90d56d4055654fb89db9003a8', }, }) -gitment.render('container')
\ No newline at end of file +gitment.render('container')
\ No newline at end of file diff --git "a/Summary-ACCNet-Actor-Coordinator-Critic-Net-for-\342\200\234Learning-to-Communicate\342\200\235-with-Deep-Multi-agent-Reinforcement-Learning/index.html" "b/Summary-ACCNet-Actor-Coordinator-Critic-Net-for-\342\200\234Learning-to-Communicate\342\200\235-with-Deep-Multi-agent-Reinforcement-Learning/index.html" index 18fb7db..3e0e396 100644 --- "a/Summary-ACCNet-Actor-Coordinator-Critic-Net-for-\342\200\234Learning-to-Communicate\342\200\235-with-Deep-Multi-agent-Reinforcement-Learning/index.html" +++ "b/Summary-ACCNet-Actor-Coordinator-Critic-Net-for-\342\200\234Learning-to-Communicate\342\200\235-with-Deep-Multi-agent-Reinforcement-Learning/index.html" @@ -47,7 +47,7 @@

Notes

  • encode both action and state to message when learning can generate better policy .
  • PCA can be used to inteprete message .
  • -Share
    rl-papers
    Summary: Mean Field Multi-Agent Reinforcement Learning. ICML(2018)
    Share
    rl-papers
    Summary: Mean Field Multi-Agent Reinforcement Learning. ICML(2018)
    \ No newline at end of file diff --git a/Summary-ACM-Learning-Dynamic-Multi-agent-Cooperation-via-Attentional-Commmunication-Model/index.html b/Summary-ACM-Learning-Dynamic-Multi-agent-Cooperation-via-Attentional-Commmunication-Model/index.html index 4988301..86f77b1 100644 --- a/Summary-ACM-Learning-Dynamic-Multi-agent-Cooperation-via-Attentional-Commmunication-Model/index.html +++ b/Summary-ACM-Learning-Dynamic-Multi-agent-Cooperation-via-Attentional-Commmunication-Model/index.html @@ -34,7 +34,7 @@

    Notes

  • It is helpful to distill the information when state space is complex .
  • the code is not released,but i think it is two stage iteratively trained.policy->CAN->policy
  • -Share
    rl-papers
    Summary: Learning Attentional Communication for Multi-Agent Cooperation
    Share
    rl-papers
    Summary: Learning Attentional Communication for Multi-Agent Cooperation
    \ No newline at end of file diff --git a/Summary-Actor-Attention-Critic-For-Multi-Agent-Reinforcement-Learning/index.html b/Summary-Actor-Attention-Critic-For-Multi-Agent-Reinforcement-Learning/index.html index 35e3b3a..b387fe1 100644 --- a/Summary-Actor-Attention-Critic-For-Multi-Agent-Reinforcement-Learning/index.html +++ b/Summary-Actor-Attention-Critic-For-Multi-Agent-Reinforcement-Learning/index.html @@ -35,7 +35,7 @@

    Notes

    -Share
    rl-papers
    Summary: Intrinsic Social Motivation Via Causal Influence In Multi-Agent RL
    Share
    rl-papers
    Summary: Intrinsic Social Motivation Via Causal Influence In Multi-Agent RL
    \ No newline at end of file diff --git a/Summary-Emergence-of-Grounded-Compositional-Language-in-Multi-Agent-Populations/index.html b/Summary-Emergence-of-Grounded-Compositional-Language-in-Multi-Agent-Populations/index.html index 86edb00..4679dc0 100644 --- a/Summary-Emergence-of-Grounded-Compositional-Language-in-Multi-Agent-Populations/index.html +++ b/Summary-Emergence-of-Grounded-Compositional-Language-in-Multi-Agent-Populations/index.html @@ -49,7 +49,7 @@

    Notes

    -Share
    rl-papers
    Summary: ACCNet: Actor-Coordinator-Critic Net for “Learning-to-Communicate” with Deep Multi-agent Reinforcement Learning
    Share
    rl-papers
    Summary: ACCNet: Actor-Coordinator-Critic Net for “Learning-to-Communicate” with Deep Multi-agent Reinforcement Learning
    \ No newline at end of file diff --git a/Summary-Intrinsic-Social-Motivation-Via-Causal-Influence-In-Multi-Agent-RL/index.html b/Summary-Intrinsic-Social-Motivation-Via-Causal-Influence-In-Multi-Agent-RL/index.html index 8ef29d3..094561d 100644 --- a/Summary-Intrinsic-Social-Motivation-Via-Causal-Influence-In-Multi-Agent-RL/index.html +++ b/Summary-Intrinsic-Social-Motivation-Via-Causal-Influence-In-Multi-Agent-RL/index.html @@ -48,7 +48,7 @@

    Thoughts

  • what the result will be when it running on particle-worlds?
  • ...
  • -Share
    rl-papers
    Summary: TarMAC:Targeted Multi-Agent Communication
    Share
    rl-papers
    Summary: TarMAC:Targeted Multi-Agent Communication
    \ No newline at end of file diff --git a/Summary-Learning-Attentional-Communication-for-Multi-Agent-Cooperation/index.html b/Summary-Learning-Attentional-Communication-for-Multi-Agent-Cooperation/index.html index d333b1a..6d2b1aa 100644 --- a/Summary-Learning-Attentional-Communication-for-Multi-Agent-Cooperation/index.html +++ b/Summary-Learning-Attentional-Communication-for-Multi-Agent-Cooperation/index.html @@ -50,7 +50,7 @@

    Thoughts

  • MADDPG train policy for every agent which was hard to applied to many agent scene.
  • Code hasn't been released yet
  • -Share
    rl-papers
    Summary: Actor-Attention-Critic For Multi-Agent Reinforcement Learning
    Share
    rl-papers
    Summary: Actor-Attention-Critic For Multi-Agent Reinforcement Learning
    \ No newline at end of file diff --git a/Summary-Learning-Multiagent-Communication-with-Backpropagation/index.html b/Summary-Learning-Multiagent-Communication-with-Backpropagation/index.html index 29bcd4f..d200ed8 100644 --- a/Summary-Learning-Multiagent-Communication-with-Backpropagation/index.html +++ b/Summary-Learning-Multiagent-Communication-with-Backpropagation/index.html @@ -38,7 +38,7 @@

    Notes

  • Agents prefer not to communicate unless necessary
  • single network with a communication channel at each layer is not easy to scale up
  • -Share
    rl-papers
    Summary: Emergence of Grounded Compositional Language in Multi-Agent Populations(AAAI 2018)
    Share
    rl-papers
    Summary: Emergence of Grounded Compositional Language in Multi-Agent Populations(AAAI 2018)
    \ No newline at end of file diff --git a/Summary-Learning-to-Communicate-with-Deep-Multi-Agent-Reinforcement-Learning/index.html b/Summary-Learning-to-Communicate-with-Deep-Multi-Agent-Reinforcement-Learning/index.html index 629c7db..92554eb 100644 --- a/Summary-Learning-to-Communicate-with-Deep-Multi-Agent-Reinforcement-Learning/index.html +++ b/Summary-Learning-to-Communicate-with-Deep-Multi-Agent-Reinforcement-Learning/index.html @@ -50,7 +50,7 @@

    Notes

  • Add impact of message can lead to faster learning
  • Message is delayed for one time-stamp and the env will be unstationary
  • -Share
    rl-papers
    Summary: Learning Multiagent Communication with Backpropagation(Nips 2016)
    Share
    rl-papers
    Summary: Learning Multiagent Communication with Backpropagation(Nips 2016)
    \ No newline at end of file diff --git a/Summary-Mean-Field-Multi-Agent-Reinforcement-Learning/index.html b/Summary-Mean-Field-Multi-Agent-Reinforcement-Learning/index.html index 71a5ef2..720fde0 100644 --- a/Summary-Mean-Field-Multi-Agent-Reinforcement-Learning/index.html +++ b/Summary-Mean-Field-Multi-Agent-Reinforcement-Learning/index.html @@ -57,7 +57,7 @@

    Results

    Conclusion

    Transform many-body problem into two-body problem using mean field theory enable the scalability in MARL.

    -Share
    rl-papers
    EM Algorithm
    Share
    rl-papers
    EM Algorithm
    \ No newline at end of file diff --git a/Summary-TarMAC-Targeted-Multi-Agent-Communication/index.html b/Summary-TarMAC-Targeted-Multi-Agent-Communication/index.html index 433abc6..b302037 100644 --- a/Summary-TarMAC-Targeted-Multi-Agent-Communication/index.html +++ b/Summary-TarMAC-Targeted-Multi-Agent-Communication/index.html @@ -28,7 +28,7 @@

    Confused

  • It's still transmit all the info to all others,that seems like didn't match the paper's intitution s
  • -Share
    rl-papers
    Summary: Learning to Communicate with Deep Multi-Agent Reinforcement Learning(Nips 2016)
    Share
    rl-papers
    Summary: Learning to Communicate with Deep Multi-Agent Reinforcement Learning(Nips 2016)
    \ No newline at end of file diff --git a/about/index.html b/about/index.html index d9950c3..339783c 100644 --- a/about/index.html +++ b/about/index.html @@ -1,4 +1,4 @@ about | Welcome To Oa

    about

    <i class="fa fa-user">Nickname: Jarvis
    <i class="fa fa-envelope"></i> Email: 2667356534@qq.com
    <i class="fa fa-github"> Github :@Jarvis-K

    -
    \ No newline at end of file +
    \ No newline at end of file diff --git a/archives/2017/07/index.html b/archives/2017/07/index.html index 4ed764b..98ab55a 100644 --- a/archives/2017/07/index.html +++ b/archives/2017/07/index.html @@ -1 +1 @@ -Archive | Welcome To Oa

    2017

    \ No newline at end of file +Archive | Welcome To Oa

    2017

    \ No newline at end of file diff --git a/archives/2017/10/index.html b/archives/2017/10/index.html index 62749d1..7b6b1c8 100644 --- a/archives/2017/10/index.html +++ b/archives/2017/10/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2017/index.html b/archives/2017/index.html index 56a3d37..1f4c8eb 100644 --- a/archives/2017/index.html +++ b/archives/2017/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2018/05/index.html b/archives/2018/05/index.html index 03109c6..084372b 100644 --- a/archives/2018/05/index.html +++ b/archives/2018/05/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2018/06/index.html b/archives/2018/06/index.html index 7d64d13..ec10dc7 100644 --- a/archives/2018/06/index.html +++ b/archives/2018/06/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2018/10/index.html b/archives/2018/10/index.html index f85e137..446cf4a 100644 --- a/archives/2018/10/index.html +++ b/archives/2018/10/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2018/11/index.html b/archives/2018/11/index.html index df08c06..1ce550b 100644 --- a/archives/2018/11/index.html +++ b/archives/2018/11/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2018/12/index.html b/archives/2018/12/index.html index 0a56b03..e7a35d6 100644 --- a/archives/2018/12/index.html +++ b/archives/2018/12/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2018/index.html b/archives/2018/index.html index 1a4c73b..402a27e 100644 --- a/archives/2018/index.html +++ b/archives/2018/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2018/page/2/index.html b/archives/2018/page/2/index.html index 50cfa38..ff689f9 100644 --- a/archives/2018/page/2/index.html +++ b/archives/2018/page/2/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2019/01/index.html b/archives/2019/01/index.html index d2aadc0..c457e82 100644 --- a/archives/2019/01/index.html +++ b/archives/2019/01/index.html @@ -1 +1 @@ -Archive | Welcome To Oa

    2019

    \ No newline at end of file +Archive | Welcome To Oa

    2019

    \ No newline at end of file diff --git a/archives/2019/04/index.html b/archives/2019/04/index.html new file mode 100644 index 0000000..0d4df2d --- /dev/null +++ b/archives/2019/04/index.html @@ -0,0 +1 @@ +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/2019/index.html b/archives/2019/index.html index d2aadc0..48d2465 100644 --- a/archives/2019/index.html +++ b/archives/2019/index.html @@ -1 +1 @@ -Archive | Welcome To Oa

    2019

    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/index.html b/archives/index.html index cc1b22f..f1dc7c6 100644 --- a/archives/index.html +++ b/archives/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/page/2/index.html b/archives/page/2/index.html index c82a707..949137a 100644 --- a/archives/page/2/index.html +++ b/archives/page/2/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/archives/page/3/index.html b/archives/page/3/index.html index 75c89c6..c4e9f5d 100644 --- a/archives/page/3/index.html +++ b/archives/page/3/index.html @@ -1 +1 @@ -Archive | Welcome To Oa
    \ No newline at end of file +Archive | Welcome To Oa
    \ No newline at end of file diff --git a/baidu_verify_IAmPtENQzv.html b/baidu_verify_IAmPtENQzv.html index 56d64ff..1cf694d 100644 --- a/baidu_verify_IAmPtENQzv.html +++ b/baidu_verify_IAmPtENQzv.html @@ -7,4 +7,4 @@ client_secret: 'fed7dc675f5293f90d56d4055654fb89db9003a8', }, }) -gitment.render('container')
    \ No newline at end of file +gitment.render('container')
    \ No newline at end of file diff --git a/baidusitemap.xml b/baidusitemap.xml index 28bfc9e..327e788 100644 --- a/baidusitemap.xml +++ b/baidusitemap.xml @@ -3,6 +3,23 @@ + + https://jarvis.world/Hypergraph-Convolution-and-Hyper-Attention/ + 2019-04-29T17:05:32.504Z + + + Hypergraph Convolution and Hyper Attention + 2019-04-29T14:40:15.000Z + + gnn-papers + + + + + + + + https://jarvis.world/EM-Algorithm/ 2019-02-01T16:16:37.076Z diff --git a/google9ac2c2824710541a.html b/google9ac2c2824710541a.html index e776127..97ce953 100644 --- a/google9ac2c2824710541a.html +++ b/google9ac2c2824710541a.html @@ -7,4 +7,4 @@ client_secret: 'fed7dc675f5293f90d56d4055654fb89db9003a8', }, }) -gitment.render('container')
    \ No newline at end of file +gitment.render('container')
    \ No newline at end of file diff --git a/guestbook/index.html b/guestbook/index.html index 483b390..23a923c 100644 --- a/guestbook/index.html +++ b/guestbook/index.html @@ -7,4 +7,4 @@ client_secret: 'fed7dc675f5293f90d56d4055654fb89db9003a8', }, }) -gitment.render('container')
    \ No newline at end of file +gitment.render('container')
    \ No newline at end of file diff --git a/index.html b/index.html index 04eee90..61ac5bb 100644 --- a/index.html +++ b/index.html @@ -1 +1 @@ -Welcome To Oa
    \ No newline at end of file +Welcome To Oa
    \ No newline at end of file diff --git a/mongodb-import-complex-txt/index.html b/mongodb-import-complex-txt/index.html index 2e152db..b73ab3c 100644 --- a/mongodb-import-complex-txt/index.html +++ b/mongodb-import-complex-txt/index.html @@ -8,7 +8,7 @@

    python encode txt to json

    import into mongodb

    这步就直接使用mongoimport就可以了

    mongoimport --db ccir --collection training_set --file training_set.txt

    -Share
    mongodbutilpython
    mxnet与gluon初级使用
    Share
    mongodbutilpython
    mxnet与gluon初级使用
    \ No newline at end of file diff --git "a/mongodb-\346\270\205\351\231\244\347\243\201\347\233\230\345\215\240\347\224\250/index.html" "b/mongodb-\346\270\205\351\231\244\347\243\201\347\233\230\345\215\240\347\224\250/index.html" index 2f0d67c..76be7ab 100644 --- "a/mongodb-\346\270\205\351\231\244\347\243\201\347\233\230\345\215\240\347\224\250/index.html" +++ "b/mongodb-\346\270\205\351\231\244\347\243\201\347\233\230\345\215\240\347\224\250/index.html" @@ -9,7 +9,7 @@

    Reference

  • codeQ&A
  • DZone
  • -Share
    mongodbutil
    Install tensorflow-gpu with CUDA10.0 Guide
    Share
    mongodbutil
    Install tensorflow-gpu with CUDA10.0 Guide
    \ No newline at end of file diff --git "a/mongodb\344\275\277\347\224\250join\345\271\266\347\256\200\345\215\225\345\244\204\347\220\206\346\225\260\346\215\256/index.html" "b/mongodb\344\275\277\347\224\250join\345\271\266\347\256\200\345\215\225\345\244\204\347\220\206\346\225\260\346\215\256/index.html" index d9719a3..9dd4445 100644 --- "a/mongodb\344\275\277\347\224\250join\345\271\266\347\256\200\345\215\225\345\244\204\347\220\206\346\225\260\346\215\256/index.html" +++ "b/mongodb\344\275\277\347\224\250join\345\271\266\347\256\200\345\215\225\345\244\204\347\220\206\346\225\260\346\215\256/index.html" @@ -35,7 +35,7 @@

    Reference

  • 在MongoDB中使用JOIN操作
  • MongoDB Manual Contents
  • -Share
    mongodbutil
    mongodb 清除磁盘占用
    Share
    mongodbutil
    mongodb 清除磁盘占用
    \ No newline at end of file diff --git "a/mxnet\344\270\216gluon\345\210\235\347\272\247\344\275\277\347\224\250/index.html" "b/mxnet\344\270\216gluon\345\210\235\347\272\247\344\275\277\347\224\250/index.html" index ec35c10..77fb3cb 100644 --- "a/mxnet\344\270\216gluon\345\210\235\347\272\247\344\275\277\347\224\250/index.html" +++ "b/mxnet\344\270\216gluon\345\210\235\347\272\247\344\275\277\347\224\250/index.html" @@ -52,7 +52,7 @@

    train

    在trainer中我们先收集参数,再定义优化方法为sgd,并设置lr,而在训练时设置网络结构,训练集,测试集,loss,迭代次数,批大小,以及训练器。

    Conclusion

    一般处理的过程也是读取数据,定义网络结构,初始化参数,设置损失函数,训练这样的流程了。后面将会以多种CNN网络为例子详细介绍。

    -Share
    DLmxnetgluon
    python opencv 基础
    Share
    DLmxnetgluon
    python opencv 基础
    \ No newline at end of file diff --git a/page/2/index.html b/page/2/index.html index 19243ee..91342a3 100644 --- a/page/2/index.html +++ b/page/2/index.html @@ -1 +1 @@ -Welcome To Oa

    Summary: ACM: Learning Dynamic Multi-agent Cooperation via Attentional Commmunication Model(ICANN 2018)

    ACM summary by Jarvis

    Read More

    Install tensorflow-gpu with CUDA10.0 Guide

    a detailed guide to install tensorflow-gpu with cuda10

    Read More

    mongodb 清除磁盘占用

    mongodb drop collections 后磁盘空间不自动回收解决。

    Read More

    mongodb使用join并简单处理数据

    mongodb 3.2使用join并clean数据

    Read More

    pyqt更新UI卡死解决

    使用QRunnable解决更新UI卡死

    Read More

    python opencv 基础

    记录python opencv的基础操作

    Read More

    mxnet与gluon初级使用

    记录下mxnet与gluon的使用

    Read More

    mongodb import complex txt

    use python encode txt to json then import to mongodb

    Read More

    神经网络和机器学习基础

    神经网络和机器学习基础(参考深度学习与计算机视觉)

    Read More

    使用迅雷下载百度云中的文件

    下载百度云文件的小trick

    Read More

    \ No newline at end of file +Welcome To Oa

    Summary: Learning Attentional Communication for Multi-Agent Cooperation

    ATOC summary by Jarvis

    Read More

    Summary: ACM: Learning Dynamic Multi-agent Cooperation via Attentional Commmunication Model(ICANN 2018)

    ACM summary by Jarvis

    Read More

    Install tensorflow-gpu with CUDA10.0 Guide

    a detailed guide to install tensorflow-gpu with cuda10

    Read More

    mongodb 清除磁盘占用

    mongodb drop collections 后磁盘空间不自动回收解决。

    Read More

    mongodb使用join并简单处理数据

    mongodb 3.2使用join并clean数据

    Read More

    pyqt更新UI卡死解决

    使用QRunnable解决更新UI卡死

    Read More

    python opencv 基础

    记录python opencv的基础操作

    Read More

    mxnet与gluon初级使用

    记录下mxnet与gluon的使用

    Read More

    mongodb import complex txt

    use python encode txt to json then import to mongodb

    Read More

    神经网络和机器学习基础

    神经网络和机器学习基础(参考深度学习与计算机视觉)

    Read More

    \ No newline at end of file diff --git a/page/3/index.html b/page/3/index.html index 0341c80..2302dea 100644 --- a/page/3/index.html +++ b/page/3/index.html @@ -1 +1 @@ -Welcome To Oa
    \ No newline at end of file +Welcome To Oa
    \ No newline at end of file diff --git "a/pyqt\346\233\264\346\226\260UI\345\215\241\346\255\273\350\247\243\345\206\263/index.html" "b/pyqt\346\233\264\346\226\260UI\345\215\241\346\255\273\350\247\243\345\206\263/index.html" index 4d5e9d7..e305357 100644 --- "a/pyqt\346\233\264\346\226\260UI\345\215\241\346\255\273\350\247\243\345\206\263/index.html" +++ "b/pyqt\346\233\264\346\226\260UI\345\215\241\346\255\273\350\247\243\345\206\263/index.html" @@ -7,7 +7,7 @@

    问题解决

    每次按refresh按钮,则重新加载图片。实现的逻辑见代码注释,我们在按下按钮时emit一个信号,然后这个信号的响应函数中开启一个新的线程来更新imagelabel。完成。

    结语

    其实这个问题在逻辑上是很容易理解的,但由于之前接触UI相关的较少,没注意到UI线程与逻辑线程互相阻塞的问题,解决还是花了些时间的,打扰打扰。

    -Share
    pyqt
    mongodb使用join并简单处理数据
    Share
    pyqt
    mongodb使用join并简单处理数据
    \ No newline at end of file +gitment.render('container')
    \ No newline at end of file diff --git a/python-and-opencv-basics/index.html b/python-and-opencv-basics/index.html index e3790f3..2893be0 100644 --- a/python-and-opencv-basics/index.html +++ b/python-and-opencv-basics/index.html @@ -55,7 +55,7 @@

    bilateral Filter

    1
    2
    # filter space diameter is 9,color space sigmma is 75,sigmaSpace sigmma is 75
    cv2.bilateralFilter(img,9,75,75)

    Edge detection

    好长啊。。。。。。感觉还有好多没写啊。。。。。算了。。。。。明日再接着写

    -Share
    pythoncv
    pyqt更新UI卡死解决
    Share
    pythoncv
    pyqt更新UI卡死解决
    \ No newline at end of file diff --git a/sitemap.xml b/sitemap.xml index 0b2ff59..ebc7632 100644 --- a/sitemap.xml +++ b/sitemap.xml @@ -1,6 +1,13 @@ + + https://jarvis.world/Hypergraph-Convolution-and-Hyper-Attention/ + + 2019-04-29T17:05:32.504Z + + + https://jarvis.world/EM-Algorithm/ diff --git a/tags/DL/index.html b/tags/DL/index.html index 048caa8..07ee5a7 100644 --- a/tags/DL/index.html +++ b/tags/DL/index.html @@ -1 +1 @@ -DL | Welcome To Oa \ No newline at end of file +DL | Welcome To Oa \ No newline at end of file diff --git a/tags/DM/index.html b/tags/DM/index.html index 5183c5e..f12ded5 100644 --- a/tags/DM/index.html +++ b/tags/DM/index.html @@ -1 +1 @@ -DM | Welcome To Oa \ No newline at end of file +DM | Welcome To Oa \ No newline at end of file diff --git a/tags/ML/index.html b/tags/ML/index.html index d0ea368..f6307b1 100644 --- a/tags/ML/index.html +++ b/tags/ML/index.html @@ -1 +1 @@ -ML | Welcome To Oa \ No newline at end of file +ML | Welcome To Oa \ No newline at end of file diff --git a/tags/Math/index.html b/tags/Math/index.html index 9ca40f4..329ec2e 100644 --- a/tags/Math/index.html +++ b/tags/Math/index.html @@ -1 +1 @@ -Math | Welcome To Oa \ No newline at end of file +Math | Welcome To Oa \ No newline at end of file diff --git a/tags/Util/index.html b/tags/Util/index.html index 75cfd42..00ae3e5 100644 --- a/tags/Util/index.html +++ b/tags/Util/index.html @@ -1 +1 @@ -util | Welcome To Oa \ No newline at end of file +util | Welcome To Oa \ No newline at end of file diff --git a/tags/cv/index.html b/tags/cv/index.html index 6ec4010..5690a9a 100644 --- a/tags/cv/index.html +++ b/tags/cv/index.html @@ -1 +1 @@ -cv | Welcome To Oa \ No newline at end of file +cv | Welcome To Oa \ No newline at end of file diff --git a/tags/gluon/index.html b/tags/gluon/index.html index ff7ff44..40f10ba 100644 --- a/tags/gluon/index.html +++ b/tags/gluon/index.html @@ -1 +1 @@ -gluon | Welcome To Oa \ No newline at end of file +gluon | Welcome To Oa \ No newline at end of file diff --git a/tags/gnn-papers/index.html b/tags/gnn-papers/index.html new file mode 100644 index 0000000..818447e --- /dev/null +++ b/tags/gnn-papers/index.html @@ -0,0 +1 @@ +gnn-papers | Welcome To Oa \ No newline at end of file diff --git a/tags/installation/index.html b/tags/installation/index.html index 768a58a..e4f3e45 100644 --- a/tags/installation/index.html +++ b/tags/installation/index.html @@ -1 +1 @@ -installation | Welcome To Oa \ No newline at end of file +installation | Welcome To Oa \ No newline at end of file diff --git a/tags/ml-algo/index.html b/tags/ml-algo/index.html index 968b7e6..c452643 100644 --- a/tags/ml-algo/index.html +++ b/tags/ml-algo/index.html @@ -1 +1 @@ -ml-algo | Welcome To Oa \ No newline at end of file +ml-algo | Welcome To Oa \ No newline at end of file diff --git a/tags/mongodb/index.html b/tags/mongodb/index.html index 0fb4cfb..8a69c80 100644 --- a/tags/mongodb/index.html +++ b/tags/mongodb/index.html @@ -1 +1 @@ -mongodb | Welcome To Oa \ No newline at end of file +mongodb | Welcome To Oa \ No newline at end of file diff --git a/tags/mxnet/index.html b/tags/mxnet/index.html index 2f434af..f6c318c 100644 --- a/tags/mxnet/index.html +++ b/tags/mxnet/index.html @@ -1 +1 @@ -mxnet | Welcome To Oa \ No newline at end of file +mxnet | Welcome To Oa \ No newline at end of file diff --git a/tags/pyqt/index.html b/tags/pyqt/index.html index 46c7d75..91393b4 100644 --- a/tags/pyqt/index.html +++ b/tags/pyqt/index.html @@ -1 +1 @@ -pyqt | Welcome To Oa \ No newline at end of file +pyqt | Welcome To Oa \ No newline at end of file diff --git a/tags/python/index.html b/tags/python/index.html index b54331c..94f35e9 100644 --- a/tags/python/index.html +++ b/tags/python/index.html @@ -1 +1 @@ -python | Welcome To Oa \ No newline at end of file +python | Welcome To Oa \ No newline at end of file diff --git a/tags/rl-papers/index.html b/tags/rl-papers/index.html index 193abcd..d06c902 100644 --- a/tags/rl-papers/index.html +++ b/tags/rl-papers/index.html @@ -1 +1 @@ -rl-papers | Welcome To Oa
    \ No newline at end of file +rl-papers | Welcome To Oa
    \ No newline at end of file diff --git "a/tags/\346\225\260\345\200\274\350\256\241\347\256\227\344\270\216\344\274\230\345\214\226/index.html" "b/tags/\346\225\260\345\200\274\350\256\241\347\256\227\344\270\216\344\274\230\345\214\226/index.html" index fc7b97e..5de2922 100644 --- "a/tags/\346\225\260\345\200\274\350\256\241\347\256\227\344\270\216\344\274\230\345\214\226/index.html" +++ "b/tags/\346\225\260\345\200\274\350\256\241\347\256\227\344\270\216\344\274\230\345\214\226/index.html" @@ -1 +1 @@ -数值计算与优化 | Welcome To Oa \ No newline at end of file +数值计算与优化 | Welcome To Oa \ No newline at end of file diff --git "a/\344\275\277\347\224\250\350\277\205\351\233\267\344\270\213\350\275\275\347\231\276\345\272\246\344\272\221\344\270\255\347\232\204\346\226\207\344\273\266/index.html" "b/\344\275\277\347\224\250\350\277\205\351\233\267\344\270\213\350\275\275\347\231\276\345\272\246\344\272\221\344\270\255\347\232\204\346\226\207\344\273\266/index.html" index ba97adc..b1d5065 100644 --- "a/\344\275\277\347\224\250\350\277\205\351\233\267\344\270\213\350\275\275\347\231\276\345\272\246\344\272\221\344\270\255\347\232\204\346\226\207\344\273\266/index.html" +++ "b/\344\275\277\347\224\250\350\277\205\351\233\267\344\270\213\350\275\275\347\231\276\345\272\246\344\272\221\344\270\255\347\232\204\346\226\207\344\273\266/index.html" @@ -6,7 +6,7 @@

    流程

  • 在chrome中打开百度云链接,选中文件直接获取下载链接
  • 将链接复制到迅雷中下载。DONE!
  • -Share
    神经网络和机器学习基础
    Share
    神经网络和机器学习基础
    \ No newline at end of file +gitment.render('container')
    \ No newline at end of file diff --git "a/\345\205\261\350\275\255\346\242\257\345\272\246\346\263\225-QR\345\210\206\350\247\243\346\263\225/index.html" "b/\345\205\261\350\275\255\346\242\257\345\272\246\346\263\225-QR\345\210\206\350\247\243\346\263\225/index.html" index 3173431..79c0f3b 100644 --- "a/\345\205\261\350\275\255\346\242\257\345\272\246\346\263\225-QR\345\210\206\350\247\243\346\263\225/index.html" +++ "b/\345\205\261\350\275\255\346\242\257\345\272\246\346\263\225-QR\345\210\206\350\247\243\346\263\225/index.html" @@ -26,7 +26,7 @@

    结果分析

    Householder 0.0368831157684 QR 1 time : 0.0372591018677 所以共轭梯度法的速度远远高于QR法,且他们都获得的是真实解,而在QR分解上Gram_Schmidt优于Householder

    -Share
    迭代法解线性方程组
    Share
    迭代法解线性方程组
    \ No newline at end of file diff --git "a/\347\245\236\347\273\217\347\275\221\347\273\234\345\222\214\346\234\272\345\231\250\345\255\246\344\271\240\345\237\272\347\241\200/index.html" "b/\347\245\236\347\273\217\347\275\221\347\273\234\345\222\214\346\234\272\345\231\250\345\255\246\344\271\240\345\237\272\347\241\200/index.html" index 26e2e48..7e2822d 100644 --- "a/\347\245\236\347\273\217\347\275\221\347\273\234\345\222\214\346\234\272\345\231\250\345\255\246\344\271\240\345\237\272\347\241\200/index.html" +++ "b/\347\245\236\347\273\217\347\275\221\347\273\234\345\222\214\346\234\272\345\231\250\345\255\246\344\271\240\345\237\272\347\241\200/index.html" @@ -47,7 +47,7 @@

    机器学习基础

  • 集成学习,综合多个模型结果
  • 随机失活(Dropout),降低特征间关联,增强泛化能力
  • -Share
    mongodb import complex txt
    Share
    mongodb import complex txt
    \ No newline at end of file diff --git "a/\350\277\255\344\273\243\346\263\225\350\247\243\347\272\277\346\200\247\346\226\271\347\250\213\347\273\204/index.html" "b/\350\277\255\344\273\243\346\263\225\350\247\243\347\272\277\346\200\247\346\226\271\347\250\213\347\273\204/index.html" index b4dc431..21a4857 100644 --- "a/\350\277\255\344\273\243\346\263\225\350\247\243\347\272\277\346\200\247\346\226\271\347\250\213\347\273\204/index.html" +++ "b/\350\277\255\344\273\243\346\263\225\350\247\243\347\272\277\346\200\247\346\226\271\347\250\213\347\273\204/index.html" @@ -31,7 +31,7 @@

    结果分析

    GaussSeidel 1.40041995049 SOR 0.781527996063 都收敛到了目的值附近,但3个收敛速度不同,其中SOR收敛最快,应对大型稀疏矩阵更加适用

    -Share
    DL初级数学基础整理
    Share
    DL初级数学基础整理
    \ No newline at end of file