Skip to content

Long initialization time #10

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
rocketraman opened this issue Jan 29, 2017 · 0 comments
Open

Long initialization time #10

rocketraman opened this issue Jan 29, 2017 · 0 comments

Comments

@rocketraman
Copy link

The adapter takes a really long time to initialize the Kafka producers. Here is a log with DEBUG=1:

logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:17:45 Starting Kafka producer for address: [kafka-1:9092], topic: logs.
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # logspout v3.2-dev-custom by gliderlabs
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # adapters: kafka
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # options : debug:1 persist:/mnt/routes
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:18:16 Starting Kafka producer for address: [kafka-2:9092], topic: logs.
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:18:47 Starting Kafka producer for address: [kafka-3:9092], topic: logs.
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.Run(): using inactivity timeout:  1m0s
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # jobs    : http[logs,routes]:80 pump routes
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # routes  :
logspout.1.wgwrytv5dnt8@swarm-manager000001    | #   ADAPTER    ADDRESS         CONTAINERS      SOURCES OPTIONS
logspout.1.wgwrytv5dnt8@swarm-manager000001    | #   kafka      kafka-2:9092                            map[topic:logs]
logspout.1.wgwrytv5dnt8@swarm-manager000001    | #   kafka      kafka-3:9092                            map[topic:logs]
logspout.1.wgwrytv5dnt8@swarm-manager000001    | #   kafka      kafka-1:9092                            map[topic:logs]
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): 6b53ae08c445 ignored: environ ignore
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): c05d779d98b6 ignored: log driver not supported
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): 61a00f27b1aa started
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): ca60c09c16b2 started
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): 802b3872793f started
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): 75b670376771 started
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): cf81c5b84109 started

You can see it from the times it takes about 30s to start each producer, so for three producers, it takes over 1.5 minutes to start up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant