Skip to content

Commit dd5ca50

Browse files
committed
Merge branch 'streaming_lm_encoding' of github.com:iefode/openvino.genai into streaming_lm_encoding
2 parents 02622c9 + 61e55a6 commit dd5ca50

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

src/cpp/src/continuous_batching_impl.cpp

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -285,8 +285,6 @@ ContinuousBatchingPipeline::ContinuousBatchingImpl::generate(const std::vector<o
285285
}
286286
if (streamer_ptr && generations.at(0)->can_read()) {
287287
std::unordered_map<uint64_t, GenerationOutput> token = generations.at(0).get()->back();
288-
OPENVINO_ASSERT(1 <= token.size());
289-
OPENVINO_ASSERT(1 <= token.begin()->second.generated_ids.size());
290288
for (const auto& gen_token : token.begin()->second.generated_ids) {
291289
if (!streamer_ptr->put(gen_token)) {
292290
break;

0 commit comments

Comments
 (0)