Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FusedAdam as a drop-in replacement for AdamW #1615

Open
wants to merge 23 commits into
base: master
Choose a base branch
from
Open

FusedAdam as a drop-in replacement for AdamW #1615

wants to merge 23 commits into from

Commits on Mar 10, 2023

  1. Try coding in C++

    @thomasw21
    thomasw21 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    e1e6e5b View commit details
    Browse the repository at this point in the history

  2. WIP

    @thomasw21
    thomasw21 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    14ded5c View commit details
    Browse the repository at this point in the history

  3. WIP

    @thomasw21
    thomasw21 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    1e74ef1 View commit details
    Browse the repository at this point in the history

  4. WIP

    @thomasw21
    thomasw21 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    38ce9a4 View commit details
    Browse the repository at this point in the history

  5. Woops

    @thomasw21
    thomasw21 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    b39f6f4 View commit details
    Browse the repository at this point in the history

  6. Woops

    @thomasw21
    thomasw21 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    b8d99ae View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2023

  1. Woops

    @thomasw21
    thomasw21 committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    2f4cce2 View commit details
    Browse the repository at this point in the history

  2. Woops

    @thomasw21
    thomasw21 committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    70c117f View commit details
    Browse the repository at this point in the history

  3. Stupid error

    @thomasw21
    thomasw21 committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    af323cf View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. Maybe we need to build the std::vector after calling dispatch

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    a27ecb8 View commit details
    Browse the repository at this point in the history

  2. Woops

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    43d027a View commit details
    Browse the repository at this point in the history

  3. Add a test that FusedAdam has the same serialization format

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    871f8a5 View commit details
    Browse the repository at this point in the history

  4. Woops

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    8bbaa52 View commit details
    Browse the repository at this point in the history

  5. It seems tensors have to be float

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    518b97c View commit details
    Browse the repository at this point in the history

  6. Woops

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    834cf9a View commit details
    Browse the repository at this point in the history

  7. better

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    60df103 View commit details
    Browse the repository at this point in the history

  8. assign on gpu

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    6568587 View commit details
    Browse the repository at this point in the history

  9. assign on gpu

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    d1a0d18 View commit details
    Browse the repository at this point in the history

  10. Maybe I just need to move data to device

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    f862c76 View commit details
    Browse the repository at this point in the history

  11. Woops

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    df29cc0 View commit details
    Browse the repository at this point in the history

  12. Woops

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    f6405d9 View commit details
    Browse the repository at this point in the history

  13. Better backward compatibility

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    1f94f0d View commit details
    Browse the repository at this point in the history

  14. Remove deprecated comment

    @thomasw21
    thomasw21 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    6ee2982 View commit details
    Browse the repository at this point in the history