Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BBT#442] Trimming and broadcast #355

Open
wants to merge 41 commits into
base: master
Choose a base branch
from
Open

[BBT#442] Trimming and broadcast #355

wants to merge 41 commits into from

Commits on Sep 23, 2021

  1. create bcast key task class

    @yu-pei
    yu-pei committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    3c92ede View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2021

  1. setting release dep func for BCAST KEY class

    @yu-pei
    yu-pei committed Sep 25, 2021
    Configuration menu
    Copy the full SHA
    ef3117f View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2021

  1. added a sleep to have a temp solution for the last data flush iterate… 

    … successor issue
    @yu-pei
    yu-pei committed Sep 27, 2021
    Configuration menu
    Copy the full SHA
    3f7320f View commit details
    Browse the repository at this point in the history

  2. add in populate remote dep and check successors code for chain topology

    @yu-pei
    yu-pei committed Sep 27, 2021
    Configuration menu
    Copy the full SHA
    db21cda View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2021

  1. handle calling iterate successor from get datatype

    @yu-pei
    yu-pei committed Sep 28, 2021
    Configuration menu
    Copy the full SHA
    5345981 View commit details
    Browse the repository at this point in the history

  2. node in the chain continue propagation; TODO: data, remote dep ref co… 

    …unt accounting
    @yu-pei
    yu-pei committed Sep 28, 2021
    Configuration menu
    Copy the full SHA
    95c9066 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2021

  1. add in some tile clean up on root node from data flush

    @yu-pei
    yu-pei committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    0492882 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2021

  1. fixes tile accounting on nodes in the chain; TODO: clearn up of non p… 

    …articipating nodes
    @yu-pei
    yu-pei committed Sep 30, 2021
    Configuration menu
    Copy the full SHA
    bcf2c35 View commit details
    Browse the repository at this point in the history

  2. not involved nodes calling TILE_OF will insert tile into hash table

    @yu-pei
    yu-pei committed Sep 30, 2021
    Configuration menu
    Copy the full SHA
    1b7534e View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2021

  1. some code clean up

    @yu-pei
    yu-pei committed Oct 1, 2021
    Configuration menu
    Copy the full SHA
    de4f299 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2021

  1. BCAST DATA task class piggyback to the normal workflow

    @yu-pei
    yu-pei committed Oct 3, 2021
    Configuration menu
    Copy the full SHA
    3b2fd37 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2021

  1. clean up and add previous potrf test case

    @yu-pei
    yu-pei committed Oct 5, 2021
    Configuration menu
    Copy the full SHA
    0728ed3 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2021

  1. key array propagate will need root rank info as part of key as well

    @yu-pei
    yu-pei committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    ed5a53a View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2021

  1. fix issue of pending_ack for created remote_deps

    @yu-pei
    yu-pei committed Oct 13, 2021
    Configuration menu
    Copy the full SHA
    5ad52fe View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2021

  1. fix issue in get successor rank; TODO: data copy and remote deps recycle

    @yu-pei
    yu-pei committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    4396353 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2021

  1. window size limits the key bcast in current scheme; incresing as temp… 

    … fix
    @yu-pei
    yu-pei committed Oct 23, 2021
    Configuration menu
    Copy the full SHA
    af22ab6 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2021

  1. allocating more bits for ranks

    Yu Pei committed Oct 26, 2021
    Configuration menu
    Copy the full SHA
    c11afe1 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2021

  1. hash table to store key arrays, still overfill task window

    @yu-pei
    yu-pei committed Nov 3, 2021
    Configuration menu
    Copy the full SHA
    8bec4b0 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2021

  1. WIP: removing receiver task for key array, reduce tasks

    @yu-pei
    yu-pei committed Nov 4, 2021
    Configuration menu
    Copy the full SHA
    a0d16b6 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2021

  1. use correct key to retrieve saved deps

    @yu-pei
    yu-pei committed Nov 11, 2021
    Configuration menu
    Copy the full SHA
    f873ec7 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2021

  1. remove prints

    @yu-pei
    yu-pei committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    31445b0 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2021

  1. clean up the not needed bcast release deps func

    @yu-pei
    yu-pei committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    c46a57d View commit details
    Browse the repository at this point in the history

  2. move broadcast code into own file

    @yu-pei
    yu-pei committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    c736fea View commit details
    Browse the repository at this point in the history

  3. move the bcast key/data task body to dtd_broadcast file

    @yu-pei
    yu-pei committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    3d8e030 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2021

  1. move the bcast keys tile to be DTD internal

    @yu-pei
    yu-pei committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    d3625dd View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2022

  1. switch to reuse PTG implementation

    @yu-pei
    yu-pei committed Jan 24, 2022
    Configuration menu
    Copy the full SHA
    464c721 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2022

  1. linking bcast meta data to propagate bcast data with global ID

    @yu-pei
    yu-pei committed Jan 31, 2022
    Configuration menu
    Copy the full SHA
    d56c3b9 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2022

  1. fix remote dep refcount issue

    @yu-pei
    yu-pei committed Feb 7, 2022
    Configuration menu
    Copy the full SHA
    b1b6ce2 View commit details
    Browse the repository at this point in the history

  2. minor update to test case

    @yu-pei
    yu-pei committed Feb 7, 2022
    Configuration menu
    Copy the full SHA
    1b222f0 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2022

  1. changes to allow QR to work

    @yu-pei
    yu-pei committed Feb 28, 2022
    Configuration menu
    Copy the full SHA
    92c2d35 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2022

  1. increase nb pending task of task pool for a remote dep, similar to PT… 

    …G coll
    @yu-pei
    yu-pei committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    1ce2dbe View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2022

  1. cache multiple bcast keys for binomial in the locals

    @yu-pei
    yu-pei committed Mar 7, 2022
    Configuration menu
    Copy the full SHA
    6dc8829 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2022

  1. fix p2p after bcast data issue

    @yu-pei
    yu-pei committed Mar 21, 2022
    Configuration menu
    Copy the full SHA
    13f4f58 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2022

  1. reset bcast keys in remote_deps when freed

    @yu-pei
    yu-pei committed Apr 1, 2022
    Configuration menu
    Copy the full SHA
    788b1bc View commit details
    Browse the repository at this point in the history

  2. remove printf for perf testing

    @yu-pei
    yu-pei committed Apr 1, 2022
    Configuration menu
    Copy the full SHA
    0e4fc3d View commit details
    Browse the repository at this point in the history

  3. pack the local keys into locals

    @yu-pei
    yu-pei committed Apr 1, 2022
    Configuration menu
    Copy the full SHA
    06f99ef View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2022

  1. updates to prevent multiple bcast forwarding, and seems like a misuse… 

    … of hashtable insert?
    @yu-pei
    yu-pei committed Apr 11, 2022
    Configuration menu
    Copy the full SHA
    e1145df View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2022

  1. some internal param changes to run on 512 nodes of Shaheen

    Yu Pei committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    f0bd339 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2022

  1. fix other cases where nolock find was used

    @yu-pei
    yu-pei committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    0615a41 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2022

  1. include broadcast benchmark codes for PTG and DTD

    @yu-pei
    yu-pei committed May 18, 2022
    Configuration menu
    Copy the full SHA
    27cfc44 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2022

  1. move the timing to just around the bcast

    Yu Pei committed May 19, 2022
    Configuration menu
    Copy the full SHA
    b9c717a View commit details
    Browse the repository at this point in the history