Skip to content

Commit

Permalink
Add debug statement
Browse files Browse the repository at this point in the history
  • Loading branch information
pomonam committed Jul 10, 2024
1 parent 3310f19 commit 7ea5ca7
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions kronfluence/module/tracker/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,7 @@ def _preprocess_gradient(self, output_gradient: torch.Tensor, target_dtype: torc
The preprocessed gradient.
"""
original_dtype = output_gradient.dtype
print(output_gradient.dtype)
output_gradient = output_gradient.to(dtype=target_dtype)
if self.module.gradient_scale != 1.0:
if original_dtype != target_dtype:
Expand Down

0 comments on commit 7ea5ca7

Please sign in to comment.