Xinyazhang/forward port perf bwd to 09132024_upstream_main#71

Draft

amathews-amd wants to merge 182 commits into09132024_upstream_mainfrom xinyazhang/forward-port-perf-bwd

+1,763-14

Commits on Jan 25, 2022

Hipification of fbgemm for AMD GPUs/CPUs (#4 )

authored

Commits on Jan 26, 2022

Commits on Jan 31, 2022

Change the hipify dependency to hipify_torch (#7 )
liligwu
authored

Commits on Feb 14, 2022

IFU, merge from upstream commit c6df576 to main. (#8 )

authored

Commits on Mar 2, 2022

Enable split_table_batched_embeddings_test.py (#10 )
liligwu
authored

Commits on Mar 7, 2022

Commits on Mar 11, 2022

Commits on Mar 14, 2022

Commits on Mar 31, 2022

Match upstream setup (#21 )
liligwu
authored

Commits on Apr 1, 2022

Enable merge_pooled_embeddings op. in ROCm (#15 )

reza-amd
and
liligwu
authored

Commits on Apr 14, 2022

Commits on Apr 15, 2022

* Enabling the specificationn of hip architecture by using PYTORCH_ROCM_ARCH. # Enabling building on Pytorch 1.11.
liligwu
committed

Commits on Apr 19, 2022

Commits on Apr 21, 2022

Commits on Apr 22, 2022

Commits on May 2, 2022

Merge remote-tracking branch 'upstream/main' into IFU-main-2022-05-02
liligwu
committed

Commits on May 4, 2022

Commits on May 5, 2022

Commits on May 9, 2022

Commits on May 10, 2022

Commits on May 11, 2022

Addressing the second batch of comments of pytorch#1102
liligwu
committed

Commits on May 12, 2022

* Removing the condition on c++ standard * An indentation correction
liligwu
committed

Commits on May 13, 2022

* Changing the logic of detecting GPU vender, making CUDA as default. * Fixing the cudaMemoryAdvise mapping in hipify_torch
liligwu
committed

Commits on May 24, 2022

Commits on May 26, 2022

Commits on May 31, 2022

Merge pull request #3 from ROCmSoftwarePlatform/IFU-main-2022-05-23
liligwu
authored

Commits on Jun 24, 2022

Merge remote-tracking branch 'upstream/main' into main
liligwu
committed

Commits on Jul 14, 2022

Merge branch 'pytorch:main' into main
liligwu
authored

Commits on Jul 18, 2022

Merge branch 'pytorch:main' into main
liligwu
authored

Commits on Jul 28, 2022

Commits on Aug 11, 2022

Merge pull request #15 from ROCmSoftwarePlatform/IFU-2022-08-10
liligwu
authored

Commits on Aug 16, 2022

HIP: improve perf for quantized embedding forward kernel
root
committed

Commits on Aug 24, 2022

Merge remote-tracking branch 'upstream/main' into IFU-2022-08-24
liligwu
committed

Commits on Sep 13, 2022

Commits on Sep 17, 2022

Merge remote-tracking branch 'upstream/main' into main
liligwu
committed

Commits on Sep 30, 2022

Merge remote-tracking branch 'upstream/main' into IFU-2022-09-30
liligwu
committed

Commits on Oct 5, 2022

Merge pull request #27 from ROCmSoftwarePlatform/IFU-2022-09-30
liligwu
authored

Commits on Oct 24, 2022

Commits on Dec 6, 2022

Merge remote-tracking branch 'upstream/main' into main
liligwu
committed

Commits on Dec 7, 2022

Commits on Dec 16, 2022

flake8 fixes in fbgemm_gpu/test/split_table_batched_embeddings_test.py
jeffdaily
committed

Commits on Jan 3, 2023

Commits on Feb 17, 2023

Merge remote-tracking branch 'upstream/main' into IFU-2023-02-17
liligwu
committed

Commits on Feb 20, 2023

Merge pull request #36 from ROCmSoftwarePlatform/IFU-2023-02-17
liligwu
authored

Commits on Mar 9, 2023

Commits on Mar 10, 2023

Merge pull request #37 from ROCmSoftwarePlatform/IFU-2023-03-10
amathews-amd
authored

Commits on Apr 3, 2023

Ifu 2023 03 31 (#38 )

authored

Commits on Apr 20, 2023

Ifu 2023 04 20 (#39 )

authored

Commits on May 5, 2023

Ifu 2023 05 04 (#40 )

authored

Commits on May 25, 2023

Commits on Jun 14, 2023

Commits on Jun 26, 2023

Commits on Jul 12, 2023

Commits on Aug 31, 2023

Commits on Oct 26, 2023

Merge remote-tracking branch 'upstream/main' into IFU-2023-10-26
root
committed

Commits on Nov 1, 2023

Merge pull request #47 from ROCmSoftwarePlatform/IFU-2023-10-26
liligwu
authored

Commits on Nov 3, 2023

Commits on Dec 6, 2023

Merge remote-tracking branch 'upstream/main' into IFU-2023-12-06
liligwu
committed

Commits on Dec 7, 2023

Merge pull request #49 from ROCmSoftwarePlatform/IFU-2023-12-06
liligwu
authored

Commits on Dec 14, 2023

Commits on Jan 5, 2024

Merge remote-tracking branch 'upstream/main' into IFU-2024-01-05
liligwu
committed

Commits on Jan 16, 2024

Merge pull request #54 from ROCmSoftwarePlatform/IFU-2024-01-05
liligwu
authored

Commits on Feb 1, 2024

Commits on Feb 20, 2024

Commits on Apr 1, 2024

Commits on Apr 19, 2024

Commits on Jul 9, 2024

SWDEV-455991 - Fix the use of uninitialized stack variable
shiltian
committed

Commits on Jul 12, 2024

Merge pull request #63 from shiltian/SWDEV-455991
amathews-amd
authored

Commits on Jul 16, 2024

Switch hipcub::DeviceRadixSort::SortPairs call to rocprim::device_radix_sort_pairs

stanleytsang-amd
authored and
dllehr-amd
committed

Commits on Aug 7, 2024

Old kernel source

xinyazhang
authored and
avbokovoy
committed
Symlinks to generated code since they are easier to read.

xinyazhang
authored and
avbokovoy
committed
Rename old hip kernel files.

xinyazhang
authored and
avbokovoy
committed
PR23: Add template instantiation.

xinyazhang
authored and
avbokovoy
committed
Add missing header files for compiling.

xinyazhang
authored and
avbokovoy
committed
Enable HIP Performance GPU kernel and fix compiling errors

xinyazhang
authored and
avbokovoy
committed
Only enable fp32 cache_t, and leave fp16/bf16 cache_t as TODO.

xinyazhang
authored and
avbokovoy
committed
Note weight_decay problems

xinyazhang
authored and
avbokovoy
committed
Move files under codegen/training/backward/rocm/ to include/fbgemm_gpu/hip_kernel_inc/

xinyazhang
authored and
avbokovoy
committed
Add the missing file

xinyazhang
authored and
avbokovoy
committed
[Nobag support] Add experimental nobag support
avbokovoy
committed
Fix wrong num_tables initialization
avbokovoy
committed
Remove debug output
avbokovoy
committed
Add the missing file

xinyazhang
authored and
avbokovoy
committed
Revert "Add the missing file"

xinyazhang
authored and
avbokovoy
committed
support weight decay mode

xinyazhang
authored and
avbokovoy
committed
Unify weight_decay_mode to int32_t

xinyazhang
authored and
avbokovoy
committed
Fix the compiling error.

xinyazhang
authored and
avbokovoy
committed
Fix weight decay integration problem.

xinyazhang
authored and
avbokovoy
committed

Commits on Aug 8, 2024

Clean up new perf kernel (#64 )
avbokovoy
authored

Commits on Aug 12, 2024

Account for NRVO in pack function
avbokovoy
committed

Commits on Aug 13, 2024

Commits on Aug 14, 2024

Merge pull request #66 from avbokovoy/fix-rocm-header
avbokovoy
authored

Commits on Aug 15, 2024

Commits on Aug 19, 2024

Merge pull request #67 from avbokovoy/bwd-kernel-fix-unit-tests
avbokovoy
authored

Commits on Aug 21, 2024

Commits on Aug 22, 2024

Merge pull request #68 from avbokovoy/refactor-cpu-kernel-call
avbokovoy
authored

Commits on Aug 26, 2024

Commits on Aug 30, 2024

Merge pull request #69 from avbokovoy/exp-160
avbokovoy
authored