Skip to content

Commit 224ec40

Browse files
authored
Use get_input_embeddings
1 parent 608e9e6 commit 224ec40

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

vllm/model_executor/models/llama_eagle3.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -249,8 +249,7 @@ def get_input_embeddings(
249249
multimodal_embeddings: Optional[NestedTensors] = None,
250250
is_multimodal: Optional[torch.Tensor] = None,
251251
) -> torch.Tensor:
252-
# The llama3 drafter only processes text embeddings
253-
return self.model.embed_tokens(input_ids)
252+
return self.model.get_input_embeddings(input_ids)
254253

255254
def forward(
256255
self,

0 commit comments

Comments
 (0)