Skip to content

Commit

Permalink
syntax revision
Browse files Browse the repository at this point in the history
  • Loading branch information
Char15Xu committed Aug 13, 2024
1 parent 5bc4d66 commit 96274c9
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ class Message(BaseModel):
"text-generation",
model=model_id,
model_kwargs={"torch_dtype": torch.bfloat16},
device="cuda",
device="cuda",
)

lock = threading.Lock()
Expand Down

0 comments on commit 96274c9

Please sign in to comment.