Determined is an all-in-one deep learning platform, compatible with PyTorch and TensorFlow.
@@ -20,7 +20,8 @@ It takes care of:
The main components of Determined are the Python library, the command line interface (CLI), and the Web UI.
## Python Library
-Use the Python library to make your existing PyTorch or Tensorflow code compatible with Determined.
+
+Use the Python library to make your existing PyTorch or Tensorflow code compatible with Determined.
You can do this by organizing your code into one of the class-based APIs:
@@ -57,8 +58,8 @@ det deploy local cluster-up
det deploy aws up
```
-
- Train your models:
+
```bash
det experiment create gpt.yaml .
```
@@ -80,17 +81,16 @@ searcher:
smaller_is_better: true
```
-
## Web UI
Use the Web UI to view loss curves, hyperparameter plots, code and configuration snapshots, model registries, cluster utilization, debugging logs, performance profiling reports, and more.
-
# Installation
To install the CLI:
+
```bash
pip install determined
```
@@ -107,31 +107,29 @@ For installation details, visit the the cluster deployment guide for your enviro
# Documentation
-* [Documentation](https://docs.determined.ai)
-* [Quick Start Guide](https://docs.determined.ai/latest/getting-started.html)
-* Tutorials:
- * [PyTorch MNIST Tutorial](https://docs.determined.ai/latest/tutorials/pytorch-mnist-tutorial.html)
- * [TensorFlow Keras MNIST Tutorial](https://docs.determined.ai/latest/tutorials/tf-mnist-tutorial.html)
-* User Guides:
- * [Core API](https://docs.determined.ai/latest/model-dev-guide/apis-howto/api-core-ug.html)
- * [PyTorch API](https://docs.determined.ai/latest/model-dev-guide/apis-howto/api-pytorch-ug.html)
- * [Keras API](https://docs.determined.ai/latest/model-dev-guide/apis-howto/api-keras-ug.html)
- * [DeepSpeed API](https://docs.determined.ai/latest/model-dev-guide/apis-howto/deepspeed/overview.html)
-
+- [Documentation](https://docs.determined.ai)
+- [Quick Start Guide](https://docs.determined.ai/latest/getting-started.html)
+- Tutorials:
+ - [PyTorch MNIST Tutorial](https://docs.determined.ai/latest/tutorials/pytorch-mnist-tutorial.html)
+ - [TensorFlow Keras MNIST Tutorial](https://docs.determined.ai/latest/tutorials/tf-mnist-tutorial.html)
+- User Guides:
+ - [Core API](https://docs.determined.ai/latest/model-dev-guide/apis-howto/api-core-ug.html)
+ - [PyTorch API](https://docs.determined.ai/latest/model-dev-guide/apis-howto/api-pytorch-ug.html)
+ - [Keras API](https://docs.determined.ai/latest/model-dev-guide/apis-howto/api-keras-ug.html)
+ - [DeepSpeed API](https://docs.determined.ai/latest/model-dev-guide/apis-howto/deepspeed/overview.html)
# Community
If you need help, want to file a bug report, or just want to keep up-to-date
with the latest news about Determined, please join the Determined community!
-* [Slack](https://determined-community.slack.com) is the best place to
- ask questions about Determined and get support. [Click here to join our Slack](
- https://join.slack.com/t/determined-community/shared_invite/zt-1f4hj60z5-JMHb~wSr2xksLZVBN61g_Q).
-* You can also follow us on [YouTube](https://www.youtube.com/@DeterminedAI) and [Twitter](https://www.twitter.com/DeterminedAI).
-* You can also join the [community mailing list](https://groups.google.com/a/determined.ai/forum/#!forum/community)
+- [Slack](https://determined-community.slack.com) is the best place to
+ ask questions about Determined and get support. [Click here to join our Slack](https://join.slack.com/t/determined-community/shared_invite/zt-1f4hj60z5-JMHb~wSr2xksLZVBN61g_Q).
+- You can also follow us on [YouTube](https://www.youtube.com/@DeterminedAI) and [Twitter](https://www.twitter.com/DeterminedAI).
+- You can also join the [community mailing list](https://groups.google.com/a/determined.ai/forum/#!forum/community)
to ask questions about the project and receive announcements.
-* To report a bug, [open an issue](https://github.com/determined-ai/determined/issues) on GitHub.
-* To report a security issue, email [`security@determined.ai`](mailto:security@determined.ai).
+- To report a bug, [open an issue](https://github.com/determined-ai/determined/issues) on GitHub.
+- To report a security issue, email [`security@determined.ai`](mailto:security@determined.ai).
# Contributing
diff --git a/determined-logo.png b/determined-logo.png
deleted file mode 100644
index 0baad157ee85038894337fa1ab5028c128057005..0000000000000000000000000000000000000000
GIT binary patch
literal 0
HcmV?d00001
literal 9291
zcmYjXby!qU(_cDQ=~x8mRB~CRJET*jkw#i_X$6)>5Tru{K{};Na%l;rVd-`WDXH)B
zzR&Z0-yeH+@1B`+&&-^e`OVxLrKO<+CWH`zKp^l7WqBPC2qOddy@HPmj7P~Hzkn|S
zH)TT)5QvEE{(~{G7<3H+F@j#m%jo&e9b^l5&o|d2?iRd6DUWI26_dWAeV2aLR3(Tx
z+3Vq$tznv`v8ZkItWb%h$&LOEwgKebH&XFpt!x9g6M3aXc@Va=&TYr{x<5_T@|cX(
z!A=%dYu#hHQZo3(xd-2-@!T*N_hM6Njl;5t9&LKYMo5xhZkhsH=>!Nc+)$ZLlG^5+Z3>r(}Z6K{)@r304B$=>C
zJYt8XDA=ZsQP2V8J-J8<3d}pOLj1Y8uNgD>qTSy!<`>u)rna&?_ITu0x
zL9vI={nb{*+8#N;WgYQ4eAz69bH*04%|V>JqCVejxL*_4UgK8DD*7s=EgjUKzm&mR
z6Q*U4e6h4F4&AYgYUL2{6kMLS~<4l2S#slU`P=Gjrn;VI6-S69R7
zslT+#k`wZ2d$BWA>Db=SxJN<6o^20~zA=;L4ADPiR|raYwOR!>*?cC(R`>V<7Z5QI
znRYZs%ZK;WA(VSSf`{O(T`Tb=)kpTOVj;_+&OW!)w;L~gAmxf5A@aE2sFu_LaiC__
z|3K}}+eh-%B7_(7TgrFNC?J61?c(@cSzH>C3%@+CQb&E$kAzv(!yTaoCGWtAN@yDbb(U9@*D|==AFOWae_<4!jHQ0Z~
zvP61+B9M`t#2X&pB&S!aZ`$ZjZ9%K-1d+n=Ur0sf*2s
z+)raSRM)P6P)7ay`^T@ZzHBhBJCe3IKA}VUg3F)vIMb-miGb
zi3m7FoY3+gU3!VUd?0pz-N2-53K6UZcA^z>QKw14GP-Mh)<8&7MFx
zD81pDE3S+Ajk&y}3Vo%KU!8Dkh=j1RiaJe@UFT$%E@&%wV>5Cx`WjflqkA9O?h~O2
zooDvkA1Rw-6%>r4dETnf$Dqs!-Qp7rTzBMXHdAyDcw2VDlHTWcq$iQ|q&II(5NxzL
zpoVfQNg{Yg5WX20sb(~u5RjOBF4}|4FE^=?If*B@FjC^qB19`;HYm|PnIQtmS{2wy
z5~~H&Jsapx5gGY2d28Gcz)C~B5*f+NlcQ&h6c9^A%oaz|;FyR4ZWuv`Yy9q+&TAG_
z%d;Schc;F)JJ~!DD>oLwr63H50*WQH1SGv~4m=J5Su1sK&
zmg(m2;T(IhQ`=2wCZIXqv{Ed(qb*wk{5$hD<03(C?erM#Lm_9r_
zgy-^}o9LjDWSsR7sAIB%f>fU=Hv@&IQ^@85~ZoiOUp5L2g
zRd#*ruSrbRa3bErf)wyu!VbIheIi>{S>vK-#X?@QI0=AfhsfX^Aaw2QI=!cc9zm+c
zydXtFeu@H*G~H8tzlMqy<#8+Cwn3kZVQYuz+HJ|~Z#VNq#|pC;Pmf+QtMHaK(K4q+
zm@mJeySFt_`jVkYBXlx)#!
zi#UE7R6r|)?n>TUsmpF_1lgW&OPVi?$KN2)%c`y0js=3*FAe0T?ti6#yk)RVa#E7e
zqsXM4^ASJdk_%>HP{0naT0Qt?ux_II2>zCClxw)vM8u2|@0l~(@iFw&k7?C=g%mWWo-9Baz?n0MI{s_KJr
zA0u*&m|^Nq*Fc@Y!ojuAsWq=8x{HP0@-k0GTrFk
z7qQsq^Ny8!86du|rilvDwKnKcvm0R#znc>BP#vrFO}Uz^;0oG!Kj~K?7!FgCr1#!W
z3yZrB?0RIkh2fE%SklKS&mbz!De!mn!N^>^pWJ$)WqafFi~1(|(*U0usZtvIqdCiP
zJHqv%APu!biVaCD(kjUyHlb`C3jkbDV3K$5AM%#=gMh#(d|l{k=+!qQogY9DBBp8M
ze-N7*8vTWyu5PPg)OR3RVV%(=pNYNC{{8hU>q&BEbOKtJ_7$fp_8q*3ccZ<8m0<{0
z{4*uW7r}mT$(e^z3wi+<6pc$?ZC8E?l%!>+#s)qvKibayqJd-Ly4{b8i6?+Fz
zc_q_c;X)srSScW@Id$);Jz}?_Ej^5NjklMcz4xp8L_kNgSwuc|Jgy^BAzz0NfUbPf
z%2E^kv6{_%-z>G)3WQQ|tKgTA>RdQejPgz_p!4}rjhf64n*XgT&u-;(O
z<^;mzs;RZplZ7P*rvzf7pW-`WEv}|Z`2=dQfXSXRBNn$mZ?QktEEBOwozfeANv93J
zt@yyFT$%!GG`u&$_H!G*zsCt!7G$x5ny3X3Ny>s4;;vTjCoP|peZ4l}Rk6F?#nhLz
z>~o2Akp)D#qfO(I|8fK}pZ+1+IaD$wZi2V6yW_Kem
z{*l|#-El>YMK%vU4Sj9Yc^)aifAc!dax&cT%psTgWd8z2m&SJS=+)sIJPaC+sH6Q*
zBuCXlIn?s!J}8+>Jo`lnX|zSXu(k!sc3(TfS`&G4g5~m<4mgf|D^&?fE4UK`LKu$S
zW_-9{6Y=`;o0R=Rd`_TN#)n4_c-AdyDbs%1J^T8TL`blI+Q4W#RgdSKVNaq?Ko;;-
zL%Y^Tk*MphsPvI_e+f{oMaohksU^#}O`-p1GtghrwGHXBu4}FX?Et^*qhlb6E9#%s
zzH(t9R1bZvGh&+r+xVA#B$&wg{IRyG>AIs_UR+F+md3j7e)O{N+dV9nV`6EGMu+bt
znOeW&0tnSUc`68jj@o^d=}lT=OpM_i{6f;*vj9+P6w6ZaKYDoj&UoEerv7Pi?y06nD5vhmq%2jUK)6Y$AyJeS+yVrCyVPrt5!4xuf
zSlh9wN-k?4wzgq{N$mM7+zcb_3O|r)Y%k*7N)Qgo1qChByG030T6G)=h|Wl)bycol
z!N&$hmI;DuwXedqb=;Xm>apwQys>Z`*P#~bTHQ^2Z|I4(#fX*>MP~Cw
zX?(F@gmW*K5Fyxo>a|?=_jf8Va7oKq_XA}iMDs`;Qx`zW&!H})
zQ@_O^!CJ|_Z^+XW)WATc%g&%vb$&jqWbfYH3qWj%;nqSsM~Jw)Q%EB7LrbJR0Z_@I
z?FD+!1kYm>*1ckO6Csd-k*HX(p6=sAoqqgpN+O|{s=8Pd0R$?5{D{G2`Zqz7>%3q>BoHz6w$g$8$M4{;wWj4#4Xd<2D1h{
z@;ZSU_Hv{V`{FySrvCK;cbL>3>WSW*?wi}bNHv9b?%dZv88OGhOO3=LWxke_&?%@d
zhTg0^?>GKoM~$m7w{SA3~{cC-~6K{5U?cBk{?kjflJ(i<|3QK(X*(DT@@q|8RSV92-R5Su)+k9^|xgS|>cGE11JjcCgF5J@HX{UUss(Z>P
z1!Ic?0(!zGT!?h|w_0o)Zu*3g@3*C&mSU%lK^pH?&?a`P6<%wc0F5_^{t<-x8g{7l
zEK}E%T3CwX;Oyf!f$4}@1qxa~Z8mz@DFom)tjAZ{yiaq@mtmIu(;apfg5ijS!qv%(
z^JOcnn6wrXUB8tKVjzbcw?{oP^Z!w62^gMaXeyg+9(BtrArgH*_tcE%+WTZQe$KRR
zyS<`t#Ma~*z;9oM>JZDe410EyoWI#hxXg8doKmhpiw0LuV4A*)oso5_xA7pJWG#d_-$dt-c^KHGV
zOII`VEX*Wb<6m0h9HboP4OA8WsU!jk@$CakUAA?2=r#UUk5$taGpsU&ZxN_a>jgEH
zsCo{=@iKs@AwpffLkBsaUUw9ngbcO;K^+T}n~0}2V`)(uK-qgpcao84fS(O#@!+kGFo}PeMYrt|5M~H(Qxa_Gm@Bq3OG~tR6tZ93E2U3Wm
za7e`d)IHz&wKB9_4A2o4LW0~68b)GTX$!8sw&z*Lt7iM_i7x?>jeJ^Zo2m-(0R;h-
zq0^SN9?&xiBjJ&)!2sHCb(1OFt{Puh{+3*5uz0mHbTxyO~VSyi8v?iol@
z3;xp{3TtF_54ZtR>+sC*{bt0z3Ym>!3_n_8w&nScem>C*`}PRkvocy9jvU)Ov&a#;
z-{XGd2uWv*LLxyE?0&t3!0Mu}~IZVWf8Tr7E^uDs70Q0-|yAzOy+?7*>~+
zjWy1koZEg$XwelOe7{Uuw8mq2$z4pF)CfjF_R-ssm&^b=K9k+OHJJWm-v18wqJ;gw
z;hve~{|)yt{YUx#9qt2$?0<*$5Yc9gpx{BBl3!
z@{vmj@>?=FsG=c%sX)kVj$!JrDwOq9z{?v4McOIY2v-ixj7UK9!6TT3#2E!~OhM%J
zWCGUP+bzEj+Y~*(C?&TOey|Gz??q68PtWHvSEL@8Npxu#=WmK6;+U@TT3h#O0TcN?
zGlJ9KKO<)cAGYAmQGk4wubnt}ctV`glYpd8IGYO7e&V%PRM1a41IPgL!Q}!8(yt
zAR(b@%hYF;P980Y6JP8m2(jZUUnn3nnQi~M-GM&5!^uo{e%{~cdd><%ejpC-04XiGS30UG^ca$I1
za}rekn~oi0O-#ll?8hoMGhb#tn=iod!^Txp;P^C#TL06AB;B!wJjYigiJU8YXJy<`
zzpujO@IF20eHO>x?VDJn_i9Dk=bbqmu?CHWAaJ+wbc3
z+Zq#K1natWZ6`a;e$vvJ
zJAbuQP$@`nO!Gn4!8F=mt)P96d^x7zsjFrH9umun3>4);rUri&oOLlMJNbs?lJH#&Hc3e8jvGaK2w*1L%)02HiN?2Hr
z7Hct;yAhtIqSP+LscR6_KRB
zE7c?jN2k7tM&TFggVH)JvtI6bZ~W0sWmoMV6?lzYPIT)tt`NKMADTyx?o#%8)oUaH
z`Dhlzt)sn~dMd9&lS`S|P0z9tv`KT`VDW4tc)?-;WWC9W(tY(4ED1CtlxZ7laB%t@>QCv0Uq(
zUsPXdylC6vA2M0`l;~^ZG1`6`e|Q@*yV}$6SIb
ztoAfDGPP>Y?>=Q4-nKYp{L`rje8~W&Sgg}JV!LzUuQ8xq9L{8h>5NUuNVHg5mqd@G
zMk5q|Iiu+!hk136TK}cYofzejw-g+@b-eOj{@$y&G-RiAqgg8c!088l26bA&>H!;~
zLrf|!@${WOW!@}&z;yg6u`ZT)dQ|9WD<913mq-41UJKQ32D1O9zuENjIB)0i?zRb1
z^@lfT!sxxa)d6uaZaLl7bgds&fdF2gy_Fj5_!KT`J|ry>R$
zPTT&$PUzHkWuk(QWZU(Kks8sZSd}Xmhzowemy@8|QU=1M1Nr>B!19?p1RHb3-a%!7
zdbFM)5%kflo*_)QjZ-$`AyY7q|3ep3XH?lq8Yo}wyCv}uBrsIm>FgN`d;XT5B)NOb
zP*|z**HFOU#kC4)inazKn*DJKJS4aSPWJ>VEw*x^>Wp=mP2^@oGQ8Q(|Jen1jV?w1
z81>XN8PB{d|D!V&l{YPzw5NVvXoDa`n~*bqf-(Dcgqz1uljV!sZ?41H1Z_5J?gf&KxSu9oQ+_xFcLKb7mRk~Ke^y+cH!2a5oSMeCI~{QU>5r6&3d
z;m=oJCr9m+2$``Hre<>c-e6I4xYeuJ_u!|voJ}ppaxUj4(Bx={FlR+DXc1p(bo%jCrFrSRuTR%6`?2uOKa7KIR@-UBv`4hJQ7pcP;Sl*hSEr+NB3aK?C
z+aHtpB|yW7BYT*lXzOSXpVWLCat=h+r&q2Fs!KogPTJHY&N>8*s|2$%MwW6m0XHYw
z505vXeU*wM+Pb~Y1>pZ#?)>7>c4bBR(im=(4!1GsYrv9Jrayd2@K18a@mc
zB>90!LzuYF=iR51+rq2MnQZXor~}N%ugiBcTF`RjL>RJ5%s0?nr858
z0jJi{;@X|a@n}
zRW{B_xST$h#a`9(PYtaQ$z4nJNw~@ljGnZOrh^8)wX?!1nl2V1DAt4fM&)7L4&@E)
zPhO;ESDsLgWE!!qFRfU(mCrtw(~Ha~IXbL;jg`AsRbscMZZB`Gm+a?l$>Exg(QZFK
z`-fu}UL!JAkW*kS@S9C>RqfNky*#c}5>l&A7?HjPF3
zwdTj$0OmV-qoo~&D7wnpQK26@f4O?y8?dr>-Yu?S0yxiqu_tSNF$v|Vh>?54Cj&>s
zb|{D=Y&J->qxTNEd#pI;bHBgkd~b8!u@LVUI_m3CNBUC1o_A#{3-N9>COz^v*N@f(
z!x}i@*l^y`{WQE#@!X$om5I9a)dNd86CX!hP1i365DI48@JqR!gd41BHF*@DYL6{%
zj@8?;R-G{|vqDq!u}C8v)Qhlx5HhGU?Yk2U#3E=T{1q3?wiswdLu!EHAHr1+ceZ-u
z+R9%R4@XQY>~&wb6y*4L$+6&=*9=voxHIU}jvQ*dtI0iXZf>>=og}~@`f(eioY2FQ
z&H%4krrf>6M+r2-XHe$~6Q2uMbetjuC+^x|-|iGZLH5LH9nh!d*{irCaXg8$w9?67
zR3-3GdYSb=ojjhP@!4|&HpCL{pej6}CAUIW>4orb!4hjehDUVOdDorgH-hMCT{hFf
zS~XLWiMrcqzD#xL%S%!9{xfaRoHFiq@z)xdiv3HZ<_oC)4#^)O9M8Px9Nee;Pscv5
z|M-Vg;dij_VQ^r_YSa{+)fWf?LV2a+YF8$KR{Ln(yIia1mf`4y7wN`KP(I{`Y+*CE
z)YGi?HEJh}Ha)6BGnwkG?cQPg+GLm1nsXuNUl0|R$!fuZiZ5I6PRVdda
ze~EY$zBfpcamH1cAHAf?paw~Zboe{3*zm<3#)Q@cg{~eo`n$C542e9~*A!{EEe-W+
zXI=))&9R0Rz^c>51P`Ty^x)>dG?X9HzS?D>qfy(T^A)1j5^H*PcJWGoSA0rcbxqFR
z7OC5P&4rm{7&JRQI}bdWPx`7I%!H657f4P$$(J$wM>rji@%M?>z5yt=rlAN!f>x*c
z4*ckE$4r&D{uNRUH!b{!mxzRU{l$ZI4tv}7oT4m!-Lpq6&1NHyk@+%Ct&Frm3Mtkg
z!CVKOb+f!D42psiIwBpmp#j|+6rEEai-c2a!gNw@-_=kgJ}+J{5Kb1w;-4V^$9)dc
z7;`GhNteMBN2t3Z>+OCe@0F|0@rxayD+<-iB_R_8>z#l;z;XPdINs&&UCgTA&J4yjgcPSL>8H=6Qp
h!GjTj-B@=I-%k+6IesqyUIYSxUMOhDSIAnt{~wCnnZf`7
diff --git a/determined-logo.svg b/determined-logo.svg
new file mode 100644
index 00000000000..8163db12ad4
--- /dev/null
+++ b/determined-logo.svg
@@ -0,0 +1,22 @@
+
