Skip to content

Commit 5e014af

Browse files
Remove commented code
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Kshitij Lakhani <33047503+KshitijLakhani@users.noreply.github.com>
1 parent 51440db commit 5e014af

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

transformer_engine/jax/cpp_extensions/attention.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1542,8 +1542,8 @@ def q_seqlens_for_striped_for_rank(self, q_segment_ids, q_segment_pos, max_segme
15421542
segment_changes = jnp.concatenate(
15431543
[
15441544
first_is_segment, # First valid element starts a segment
1545-
(valid_segment_ids[..., 1:] != valid_segment_ids[..., :-1]) |
1546-
# ((valid_segment_pos[..., 1:] != valid_segment_pos[..., :-1] + 1) & actual_valid[..., 1:])
1545+
(valid_segment_ids[..., 1:] != valid_segment_ids[..., :-1])
1546+
| (valid_segment_pos[..., 1:] != valid_segment_pos[..., :-1] + 1),
15471547
(valid_segment_pos[..., 1:] != valid_segment_pos[..., :-1] + 1),
15481548
],
15491549
axis=-1,

0 commit comments

Comments
 (0)