Skip to content

Commit

Permalink
syntax revision
Browse files Browse the repository at this point in the history
  • Loading branch information
Char15Xu authored and FranardoHuang committed Aug 13, 2024
1 parent c636bab commit d1a3f0f
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ class Message(BaseModel):
"text-generation",
model=model_id,
model_kwargs={"torch_dtype": torch.bfloat16},
device="cuda",
device="cuda",
)

lock = threading.Lock()
Expand Down

0 comments on commit d1a3f0f

Please sign in to comment.