Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable control plane check for searcher. #5360

Merged
merged 1 commit into from
Aug 28, 2024

Conversation

fmassot
Copy link
Contributor

@fmassot fmassot commented Aug 28, 2024

No description provided.

@guilload
Copy link
Member

I'd get rid of the env var. We never need the control plane check for searchers anyway.

@fmassot fmassot force-pushed the fmassot/searcher-can-start-with-no-control-plane branch from 9127acf to dcb5305 Compare August 28, 2024 16:41
@fmassot fmassot changed the title Add env to disable control plane check for searcher. Disable control plane check for searcher. Aug 28, 2024
@fmassot fmassot merged commit e2fb196 into main Aug 28, 2024
5 checks passed
@fmassot fmassot deleted the fmassot/searcher-can-start-with-no-control-plane branch August 28, 2024 17:35
Copy link

On SSD:

Average search latency is 0.997x that of the reference (lower is better).
Ref run id: 3063, ref commit: 60368df
Link

On GCS:

Average search latency is 1.02x that of the reference (lower is better).
Ref run id: 3064, ref commit: 60368df
Link

if !node_config.is_service_enabled(QuickwitService::Metastore) {
// If the node is a searcher, we skip this check because the searcher does not need to.
if !(node_config.is_service_enabled(QuickwitService::Metastore)
|| node_config.is_service_enabled(QuickwitService::Searcher))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is wrong: unless i'm missing something it's telling "if metastore is disabled AND searcher is disabled", connect to control plane. This means if this node is searcher+indexer, don't connect to the metastore

What we want is if !(is_service_enabled(Metastore) OR enabled_services.filter(service != Searcher).is_empty)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with @trinity-1686a . (except I believe the expression can simply be

enabled_services.filter(service != Searcher).is_empty() (as it includes the metastore)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants