helm installs stackstorm-ha, mongo prompts the following error

[xiaofan-linux]

System version and kubernetes version

# cat /etc/redhat-release 
CentOS Linux release 7.9.2009 (Core)
# kubectl version
Client Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.8", GitCommit:"fd5d41537aee486160ad9b5356a9d82363273721", GitTreeState:"clean", BuildDate:"2021-02-17T12:41:51Z", GoVersion:"go1.15.8", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.8", GitCommit:"fd5d41537aee486160ad9b5356a9d82363273721", GitTreeState:"clean", BuildDate:"2021-02-17T12:33:08Z", GoVersion:"go1.15.8", Compiler:"gc", Platform:"linux/amd64"}

Charts version

# cat Chart.yaml 
apiVersion: v2
appVersion: "3.6"
dependencies:
- condition: rabbitmq.enabled
  name: rabbitmq
  repository: https://charts.bitnami.com/bitnami
  version: 8.0.2
- condition: mongodb.enabled
  name: mongodb
  repository: https://charts.bitnami.com/bitnami
  version: 10.0.1
- condition: external-dns.enabled
  name: external-dns
  repository: https://charts.bitnami.com/bitnami
  version: 4.0.0
- condition: redis.enabled
  name: redis
  repository: https://charts.bitnami.com/bitnami
  version: 12.3.2
description: StackStorm K8s Helm Chart, optimized for running StackStorm in HA environment.
home: https://stackstorm.com/
icon: https://landscape.cncf.io/logos/stack-storm.svg
keywords:
- st2
- stackstorm
- devops
- SRE
- automation
- chatops
- event-driven
- auto-remediation
- IFTTT
- HA
maintainers:
- email: armab@stackstorm.com
  name: Eugen Cusmaunsa
  url: https://github.com/armab
name: stackstorm-ha
version: 0.80.0

helm installs stackstorm-ha, mongo prompts the following error

2022-01-10 14:39:16,766 INFO [-] Using Python: 3.6.9 (/opt/stackstorm/st2/bin/python)
2022-01-10 14:39:16,767 INFO [-] Using fs encoding: utf-8, default encoding: utf-8, locale: en_US.UTF-8, LANG env variable: en_US.UTF-8, PYTHONIOENCODING env variable: notset
2022-01-10 14:39:16,767 INFO [-] Using config files: /etc/st2/st2.conf,/etc/st2/st2.docker.conf,/etc/st2/st2.user.conf
2022-01-10 14:39:16,768 INFO [-] Using logging config: /etc/st2/logging.actionrunner.conf
2022-01-10 14:39:16,768 INFO [-] Using coordination driver: redis
2022-01-10 14:39:16,768 INFO [-] Using metrics driver: noop
2022-01-10 14:39:16,791 INFO [-] Connecting to database "st2" @ "stackstorm-mongodb-0.stackstorm-mongodb-headless:27017,stackstorm-mongodb-1.stackstorm-mongodb-headless:27017,stackstorm-mongodb-2.stackstorm-mongodb-headless:27017 (replica set)" as user "st2-admin".
2022-01-10 14:39:19,801 ERROR [-] Failed to connect to database "st2" @ "stackstorm-mongodb-0.stackstorm-mongodb-headless:27017,stackstorm-mongodb-1.stackstorm-mongodb-headless:27017,stackstorm-mongodb-2.stackstorm-mongodb-headless:27017 (replica set)" as user "st2-admin": No replica set members found yet, Timeout: 3.0s, Topology Description: <TopologyDescription id: 61dc4514ce477e1b34d7fef7, topology_type: ReplicaSetNoPrimary, servers: [<ServerDescription ('stackstorm-mongodb-0.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>, <ServerDescription ('stackstorm-mongodb-1.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>, <ServerDescription ('stackstorm-mongodb-2.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>]>
2022-01-10 14:39:19,802 ERROR [-] (PID=1) Worker quit due to exception.
Traceback (most recent call last):
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2actions/cmd/actionrunner.py", line 98, in main
    _setup()
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2actions/cmd/actionrunner.py", line 58, in _setup
    capabilities=capabilities,
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/service_setup.py", line 249, in setup
    db_setup()
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/database_setup.py", line 55, in db_setup
    connection = db_init.db_setup_with_retry(**db_cfg)
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/persistence/db_init.py", line 93, in db_setup_with_retry
    ssl_match_hostname=ssl_match_hostname,
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/persistence/db_init.py", line 58, in db_func_with_retry
    return retrying_obj.call(db_func, *args, **kwargs)
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/retrying.py", line 206, in call
    return attempt.get(self._wrap_exception)
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/retrying.py", line 247, in get
    six.reraise(self.value[0], self.value[1], self.value[2])
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/six.py", line 696, in reraise
    raise value
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/retrying.py", line 200, in call
    attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/models/db/__init__.py", line 251, in db_setup
    ssl_match_hostname=ssl_match_hostname,
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/models/db/__init__.py", line 213, in _db_connect
    raise e
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/models/db/__init__.py", line 204, in _db_connect
    connection.admin.command("ping")
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/database.py", line 737, in command
    read_preference, session) as (sock_info, slave_ok):
  File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/mongo_client.py", line 1325, in _socket_for_reads
    server = self._select_server(read_preference, session)
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/mongo_client.py", line 1278, in _select_server
    server = topology.select_server(server_selector)
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/topology.py", line 243, in select_server
    address))
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/topology.py", line 200, in select_servers
    selector, server_timeout, address)
  File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/topology.py", line 217, in _select_servers_loop
    (self._error_message(selector), timeout, self.description))
pymongo.errors.ServerSelectionTimeoutError: No replica set members found yet, Timeout: 3.0s, Topology Description: <TopologyDescription id: 61dc4514ce477e1b34d7fef7, topology_type: ReplicaSetNoPrimary, servers: [<ServerDescription ('stackstorm-mongodb-0.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>, <ServerDescription ('stackstorm-mongodb-1.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>, <ServerDescription ('stackstorm-mongodb-2.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>]>

[arms11]

Just curious did you check if mongodb with its volume(s) already active/provisioned and ready to accept connections? Also, was this one off or it prevents successful completion of StackStorm deployment process every time?

[xiaofan-linux]

Just curious did you check if mongodb with its volume(s) already active/provisioned and ready to accept connections? Also, was this one off or it prevents successful completion of StackStorm deployment process every time?

mongo logs and pod status

>>> get pvc -n stackstorm
NAME                                 STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS       AGE
data-stackstorm-rabbitmq-0           Bound    pvc-381b86ff-b381-4b4b-a945-f4c4da59d2ab   8Gi        RWO            openebs-hostpath   17m
data-stackstorm-rabbitmq-1           Bound    pvc-a7dd93a4-df7d-4584-a28b-592e0766521a   8Gi        RWO            openebs-hostpath   12m
data-stackstorm-rabbitmq-2           Bound    pvc-7846301b-fd35-44a4-ab57-98c4d6817324   8Gi        RWO            openebs-hostpath   12m
datadir-stackstorm-mongodb-0         Bound    pvc-bcbd437d-b6c9-462a-baf8-f6040feb2dda   8Gi        RWO            openebs-hostpath   17m
datadir-stackstorm-mongodb-1         Bound    pvc-84bc2140-452f-452c-8764-e9466407e066   8Gi        RWO            openebs-hostpath   13m
datadir-stackstorm-mongodb-2         Bound    pvc-3dae01a8-267f-4da8-a48c-5e39c955056a   8Gi        RWO            openebs-hostpath   13m
redis-data-stackstorm-redis-node-0   Bound    pvc-c96ca4ac-cc5f-47c2-b805-98052dd0004d   8Gi        RWO            openebs-hostpath   17m
redis-data-stackstorm-redis-node-1   Bound    pvc-1f751c4c-8911-452a-8bb9-c8794f71439a   8Gi        RWO            openebs-hostpath   13m
redis-data-stackstorm-redis-node-2   Bound    pvc-456c40bd-6862-4542-b764-88578af4b8e2   8Gi        RWO            openebs-hostpath   12m
>>> get pv
NAME                                       CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS   CLAIM                                           STORAGECLASS       REASON   AGE
pvc-1f751c4c-8911-452a-8bb9-c8794f71439a   8Gi        RWO            Delete           Bound    stackstorm/redis-data-stackstorm-redis-node-1   openebs-hostpath            20m
pvc-381b86ff-b381-4b4b-a945-f4c4da59d2ab   8Gi        RWO            Delete           Bound    stackstorm/data-stackstorm-rabbitmq-0           openebs-hostpath            22m
pvc-3dae01a8-267f-4da8-a48c-5e39c955056a   8Gi        RWO            Delete           Bound    stackstorm/datadir-stackstorm-mongodb-2         openebs-hostpath            21m
pvc-456c40bd-6862-4542-b764-88578af4b8e2   8Gi        RWO            Delete           Bound    stackstorm/redis-data-stackstorm-redis-node-2   openebs-hostpath            20m
pvc-7846301b-fd35-44a4-ab57-98c4d6817324   8Gi        RWO            Delete           Bound    stackstorm/data-stackstorm-rabbitmq-2           openebs-hostpath            19m
pvc-84bc2140-452f-452c-8764-e9466407e066   8Gi        RWO            Delete           Bound    stackstorm/datadir-stackstorm-mongodb-1         openebs-hostpath            21m
pvc-a7dd93a4-df7d-4584-a28b-592e0766521a   8Gi        RWO            Delete           Bound    stackstorm/data-stackstorm-rabbitmq-1           openebs-hostpath            20m
pvc-bcbd437d-b6c9-462a-baf8-f6040feb2dda   8Gi        RWO            Delete           Bound    stackstorm/datadir-stackstorm-mongodb-0         openebs-hostpath            23m
pvc-c96ca4ac-cc5f-47c2-b805-98052dd0004d   8Gi        RWO            Delete           Bound    stackstorm/redis-data-stackstorm-redis-node-0   openebs-hostpath            23m

>>> get pod -n stackstorm
NAME                                              READY   STATUS             RESTARTS   AGE
stackstorm-job-st2-apikey-load-8t7fc              0/1     Init:1/3           0          7m48s
stackstorm-mongodb-0                              1/1     Running            0          7m49s
stackstorm-mongodb-1                              1/1     Running            0          3m58s
stackstorm-mongodb-2                              1/1     Running            0          3m44s
stackstorm-rabbitmq-0                             1/1     Running            0          7m49s
stackstorm-rabbitmq-1                             1/1     Running            0          2m59s
stackstorm-rabbitmq-2                             1/1     Running            0          2m20s
stackstorm-redis-node-0                           2/2     Running            0          7m49s
stackstorm-redis-node-1                           2/2     Running            0          3m18s
stackstorm-redis-node-2                           2/2     Running            0          3m8s
stackstorm-st2actionrunner-698f747fb6-pqs77       0/1     CrashLoopBackOff   4          7m49s
stackstorm-st2api-76f4d47dd6-tlb9d                0/1     CrashLoopBackOff   4          7m49s
stackstorm-st2auth-66ff6ccd44-jz48b               0/1     CrashLoopBackOff   4          7m48s
stackstorm-st2chatops-79b477ff84-chqtk            1/1     Running            0          7m49s
stackstorm-st2client-76bc84bb6f-l2r7d             1/1     Running            0          7m49s
stackstorm-st2garbagecollector-5787b8997f-2w25f   0/1     CrashLoopBackOff   4          7m49s
stackstorm-st2notifier-68fbc44b54-t2hx4           0/1     CrashLoopBackOff   4          7m49s
stackstorm-st2rulesengine-64fb7cc876-5lzz8        0/1     CrashLoopBackOff   4          7m48s
stackstorm-st2scheduler-6c57f76999-xcbzr          0/1     CrashLoopBackOff   4          7m49s
stackstorm-st2sensorcontainer-6f5b467686-xxcdb    0/1     Error              4          7m48s
stackstorm-st2stream-69fc49f547-7bj84             0/1     CrashLoopBackOff   4          7m49s
stackstorm-st2timersengine-868db79948-zbcxs       0/1     CrashLoopBackOff   4          7m48s
stackstorm-st2web-688568565f-jhztq                1/1     Running            0          7m49s
stackstorm-st2workflowengine-7d9ff8759-jhpp6      0/1     CrashLoopBackOff   4          7m49s

>>> logs -n stackstorm stackstorm-mongodb-0
Advertised Hostname: stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local
Pod name matches initial primary pod name, configuring node as a primary
mongodb 04:59:22.66 
mongodb 04:59:22.66 Welcome to the Bitnami mongodb container
mongodb 04:59:22.66 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-mongodb
mongodb 04:59:22.66 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-mongodb/issues
mongodb 04:59:22.66 
mongodb 04:59:22.66 INFO  ==> ** Starting MongoDB setup **
mongodb 04:59:22.69 INFO  ==> Validating settings in MONGODB_* env vars...
mongodb 04:59:22.70 INFO  ==> Initializing MongoDB...
mongodb 04:59:22.72 INFO  ==> Deploying MongoDB from scratch...
mongodb 04:59:23.47 INFO  ==> Creating users...
mongodb 04:59:23.47 INFO  ==> Creating root user...
MongoDB shell version v4.0.27
connecting to: mongodb://127.0.0.1:27017/?gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("7e6091f2-dfc0-48d8-9d42-47ceef23ce43") }
MongoDB server version: 4.0.27
Successfully added user: {
        "user" : "root",
        "roles" : [
                {
                        "role" : "root",
                        "db" : "admin"
                }
        ]
}
bye
mongodb 04:59:23.59 INFO  ==> Creating user 'st2-admin'...
MongoDB shell version v4.0.27
connecting to: mongodb://127.0.0.1:27017/?gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("cb6ea13d-4374-419c-a480-996bc8f3953c") }
MongoDB server version: 4.0.27
Successfully added user: {
        "user" : "st2-admin",
        "roles" : [
                {
                        "role" : "readWrite",
                        "db" : "st2"
                }
        ]
}
bye
mongodb 04:59:23.72 INFO  ==> Users created
mongodb 04:59:23.72 INFO  ==> Writing keyfile for replica set authentication...
mongodb 04:59:23.74 INFO  ==> Configuring MongoDB replica set...
mongodb 04:59:23.75 INFO  ==> Stopping MongoDB...
mongodb 04:59:25.97 INFO  ==> Configuring MongoDB primary node
mongodb 04:59:26.12 INFO  ==> Stopping MongoDB...
mongodb 04:59:28.14 INFO  ==> Enabling authentication...
mongodb 04:59:28.16 INFO  ==> ** MongoDB setup finished! **

mongodb 04:59:28.19 INFO  ==> ** Starting MongoDB **
2022-01-11T04:59:28.212+0000 I CONTROL  [main] ***** SERVER RESTARTED *****
2022-01-11T04:59:28.215+0000 I CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten] MongoDB starting : pid=1 port=27017 dbpath=/bitnami/mongodb/data/db 64-bit host=stackstorm-mongodb-0
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten] db version v4.0.27
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten] git version: d47b151b55f286546e7c7c98888ae0577856ca20
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.1.0l  10 Sep 2019
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten] allocator: tcmalloc
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten] modules: none
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten] build environment:
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten]     distmod: debian92
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten]     distarch: x86_64
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten]     target_arch: x86_64
2022-01-11T04:59:28.231+0000 I CONTROL  [initandlisten] options: { config: "/opt/bitnami/mongodb/conf/mongodb.conf", net: { bindIpAll: true, ipv6: false, port: 27017, unixDomainSocket: { enabled: true, pathPrefix: "/opt/bitnami/mongodb/tmp" } }, processManagement: { fork: false, pidFilePath: "/opt/bitnami/mongodb/tmp/mongodb.pid" }, replication: { enableMajorityReadConcern: true, replSetName: "rs0" }, security: { authorization: "enabled", keyFile: "/opt/bitnami/mongodb/conf/keyfile" }, setParameter: { enableLocalhostAuthBypass: "false" }, storage: { dbPath: "/bitnami/mongodb/data/db", directoryPerDB: false, journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, logRotate: "reopen", path: "/opt/bitnami/mongodb/logs/mongodb.log", quiet: false, verbosity: 0 } }
2022-01-11T04:59:28.231+0000 I STORAGE  [initandlisten] Detected data files in /bitnami/mongodb/data/db created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
2022-01-11T04:59:28.231+0000 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=23531M,cache_overflow=(file_max=0M),session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress),
2022-01-11T04:59:29.007+0000 I STORAGE  [initandlisten] WiredTiger message [1641877169:7263][1:0x7f0f1de1f080], txn-recover: Main recovery loop: starting at 2/45952 to 3/256
2022-01-11T04:59:29.007+0000 I STORAGE  [initandlisten] WiredTiger message [1641877169:7712][1:0x7f0f1de1f080], txn-recover: Recovering log 2 through 3
2022-01-11T04:59:29.072+0000 I STORAGE  [initandlisten] WiredTiger message [1641877169:72531][1:0x7f0f1de1f080], txn-recover: Recovering log 3 through 3
2022-01-11T04:59:29.127+0000 I STORAGE  [initandlisten] WiredTiger message [1641877169:127187][1:0x7f0f1de1f080], txn-recover: Set global recovery timestamp: 61dd0eae00000008
2022-01-11T04:59:29.135+0000 I RECOVERY [initandlisten] WiredTiger recoveryTimestamp. Ts: Timestamp(1641877166, 8)
2022-01-11T04:59:29.136+0000 I STORAGE  [initandlisten] Triggering the first stable checkpoint. Initial Data: Timestamp(1641877166, 8) PrevStable: Timestamp(0, 0) CurrStable: Timestamp(1641877166, 8)
2022-01-11T04:59:29.137+0000 I STORAGE  [initandlisten] Starting to check the table logging settings for existing WiredTiger tables
2022-01-11T04:59:29.139+0000 I STORAGE  [initandlisten] Starting OplogTruncaterThread local.oplog.rs
2022-01-11T04:59:29.139+0000 I STORAGE  [initandlisten] The size storer reports that the oplog contains 7 records totaling to 1323 bytes
2022-01-11T04:59:29.139+0000 I STORAGE  [initandlisten] Scanning the oplog to determine where to place markers for truncation
2022-01-11T04:59:29.140+0000 I STORAGE  [initandlisten] WiredTiger record store oplog processing took 0ms
2022-01-11T04:59:29.143+0000 I CONTROL  [initandlisten] 
2022-01-11T04:59:29.143+0000 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2022-01-11T04:59:29.143+0000 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2022-01-11T04:59:29.143+0000 I CONTROL  [initandlisten] 
2022-01-11T04:59:29.150+0000 I STORAGE  [initandlisten] Finished adjusting the table logging settings for existing WiredTiger tables
2022-01-11T04:59:29.151+0000 I FTDC     [initandlisten] Initializing full-time diagnostic data capture with directory '/bitnami/mongodb/data/db/diagnostic.data'
2022-01-11T04:59:29.156+0000 I REPL     [initandlisten] Rollback ID is 1
2022-01-11T04:59:29.157+0000 I REPL     [initandlisten] Recovering from stable timestamp: Timestamp(1641877166, 8) (top of oplog: { ts: Timestamp(1641877166, 8), t: 1 }, appliedThrough: { ts: Timestamp(0, 0), t: -1 }, TruncateAfter: Timestamp(0, 0))
2022-01-11T04:59:29.157+0000 I REPL     [initandlisten] Starting recovery oplog application at the stable timestamp: Timestamp(1641877166, 8)
2022-01-11T04:59:29.157+0000 I REPL     [initandlisten] No oplog entries to apply for recovery. Start point is at the top of the oplog.
2022-01-11T04:59:29.158+0000 I REPL     [replexec-0] New replica set config in use: { _id: "rs0", version: 1, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:29.158+0000 I REPL     [replexec-0] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:29.158+0000 I REPL     [replexec-0] transition to STARTUP2 from STARTUP
2022-01-11T04:59:29.158+0000 I REPL     [replexec-0] Starting replication storage threads
2022-01-11T04:59:29.159+0000 I NETWORK  [initandlisten] waiting for connections on port 27017
2022-01-11T04:59:29.159+0000 I REPL     [replexec-0] transition to RECOVERING from STARTUP2
2022-01-11T04:59:29.159+0000 I NETWORK  [LogicalSessionCacheRefresh] Starting new replica set monitor for rs0/stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:29.159+0000 I REPL     [replexec-0] Starting replication fetcher thread
2022-01-11T04:59:29.159+0000 I ASIO     [ReplicaSetMonitor-TaskExecutor] Connecting to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:29.159+0000 I REPL     [replexec-0] Starting replication applier thread
2022-01-11T04:59:29.159+0000 I REPL     [replexec-0] Starting replication reporter thread
2022-01-11T04:59:29.159+0000 I REPL     [rsSync-0] Starting oplog application
2022-01-11T04:59:29.160+0000 I REPL     [rsSync-0] transition to SECONDARY from RECOVERING
2022-01-11T04:59:29.160+0000 I NETWORK  [listener] connection accepted from 100.64.0.30:43444 #2 (1 connection now open)
2022-01-11T04:59:29.160+0000 I REPL     [rsSync-0] conducting a dry run election to see if we could be elected. current term: 1
2022-01-11T04:59:29.160+0000 I REPL     [replexec-0] dry election run succeeded, running for election in term 2
2022-01-11T04:59:29.161+0000 I NETWORK  [conn2] received client metadata from 100.64.0.30:43444 conn2: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:29.162+0000 I REPL     [replexec-0] election succeeded, assuming primary role in term 2
2022-01-11T04:59:29.162+0000 I REPL     [replexec-0] transition to PRIMARY from SECONDARY
2022-01-11T04:59:29.162+0000 I REPL     [replexec-0] Resetting sync source to empty, which was :27017
2022-01-11T04:59:29.162+0000 I REPL     [replexec-0] Entering primary catch-up mode.
2022-01-11T04:59:29.162+0000 I REPL     [replexec-0] Exited primary catch-up mode.
2022-01-11T04:59:29.162+0000 I REPL     [replexec-0] Stopping replication producer
2022-01-11T04:59:29.162+0000 I REPL     [ReplBatcher] Oplog buffer has been drained in term 2
2022-01-11T04:59:29.162+0000 I REPL     [rsSync-0] transition to primary complete; database writes are now permitted
2022-01-11T04:59:29.174+0000 I ACCESS   [conn2] Successfully authenticated as principal __system on local from client 100.64.0.30:43444
2022-01-11T04:59:29.174+0000 I NETWORK  [LogicalSessionCacheRefresh] stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 detected as new replica set primary for rs0; Old primary was :27017
2022-01-11T04:59:29.174+0000 I NETWORK  [listener] connection accepted from 100.64.0.30:43448 #5 (2 connections now open)
2022-01-11T04:59:29.174+0000 I NETWORK  [listener] connection accepted from 100.64.0.30:43450 #6 (3 connections now open)
2022-01-11T04:59:29.175+0000 I NETWORK  [conn5] received client metadata from 100.64.0.30:43448 conn5: { driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:29.175+0000 I NETWORK  [LogicalSessionCacheRefresh] Successfully connected to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (1 connections now open to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 with a 0 second timeout)
2022-01-11T04:59:29.175+0000 I NETWORK  [conn6] received client metadata from 100.64.0.30:43450 conn6: { driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:29.175+0000 I NETWORK  [LogicalSessionCacheReap] Successfully connected to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (2 connections now open to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 with a 0 second timeout)
2022-01-11T04:59:29.175+0000 I ACCESS   [conn5] Successfully authenticated as principal __system on local from client 100.64.0.30:43448
2022-01-11T04:59:29.175+0000 I ACCESS   [conn6] Successfully authenticated as principal __system on local from client 100.64.0.30:43450
2022-01-11T04:59:29.466+0000 I NETWORK  [listener] connection accepted from 100.64.0.15:42589 #7 (4 connections now open)
2022-01-11T04:59:29.467+0000 I NETWORK  [conn7] end connection 100.64.0.15:42589 (3 connections now open)
2022-01-11T04:59:29.508+0000 I NETWORK  [listener] connection accepted from 100.64.0.17:44225 #8 (4 connections now open)
2022-01-11T04:59:29.509+0000 I NETWORK  [conn8] end connection 100.64.0.17:44225 (3 connections now open)
2022-01-11T04:59:29.525+0000 I NETWORK  [listener] connection accepted from 100.64.0.13:38489 #9 (4 connections now open)
2022-01-11T04:59:29.525+0000 I NETWORK  [conn9] end connection 100.64.0.13:38489 (3 connections now open)
2022-01-11T04:59:29.729+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:49980 #10 (4 connections now open)
2022-01-11T04:59:29.730+0000 I NETWORK  [conn10] received client metadata from 127.0.0.1:49980 conn10: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:29.733+0000 I NETWORK  [conn10] end connection 127.0.0.1:49980 (3 connections now open)
2022-01-11T04:59:30.284+0000 I NETWORK  [listener] connection accepted from 100.64.0.24:46753 #11 (4 connections now open)
2022-01-11T04:59:30.285+0000 I NETWORK  [conn11] end connection 100.64.0.24:46753 (3 connections now open)
2022-01-11T04:59:30.719+0000 I NETWORK  [listener] connection accepted from 100.64.0.19:41847 #12 (4 connections now open)
2022-01-11T04:59:30.719+0000 I NETWORK  [conn12] end connection 100.64.0.19:41847 (3 connections now open)
2022-01-11T04:59:32.271+0000 I NETWORK  [listener] connection accepted from 100.64.0.16:44399 #13 (4 connections now open)
2022-01-11T04:59:32.271+0000 I NETWORK  [conn13] end connection 100.64.0.16:44399 (3 connections now open)
2022-01-11T04:59:32.654+0000 I NETWORK  [listener] connection accepted from 100.64.0.26:38533 #14 (4 connections now open)
2022-01-11T04:59:32.654+0000 I NETWORK  [conn14] end connection 100.64.0.26:38533 (3 connections now open)
2022-01-11T04:59:33.238+0000 I NETWORK  [listener] connection accepted from 100.64.0.12:40339 #15 (4 connections now open)
2022-01-11T04:59:33.238+0000 I NETWORK  [conn15] end connection 100.64.0.12:40339 (3 connections now open)
2022-01-11T04:59:33.900+0000 I NETWORK  [listener] connection accepted from 100.64.0.27:41197 #16 (4 connections now open)
2022-01-11T04:59:33.900+0000 I NETWORK  [conn16] end connection 100.64.0.27:41197 (3 connections now open)
2022-01-11T04:59:34.381+0000 I NETWORK  [listener] connection accepted from 100.64.0.11:42613 #17 (4 connections now open)
2022-01-11T04:59:34.381+0000 I NETWORK  [conn17] end connection 100.64.0.11:42613 (3 connections now open)
2022-01-11T04:59:35.149+0000 I NETWORK  [listener] connection accepted from 100.64.0.28:45321 #18 (4 connections now open)
2022-01-11T04:59:35.149+0000 I NETWORK  [conn18] end connection 100.64.0.28:45321 (3 connections now open)
2022-01-11T04:59:35.470+0000 I NETWORK  [listener] connection accepted from 100.64.0.25:37463 #19 (4 connections now open)
2022-01-11T04:59:35.470+0000 I NETWORK  [conn19] end connection 100.64.0.25:37463 (3 connections now open)
2022-01-11T04:59:38.490+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57900 #20 (4 connections now open)
2022-01-11T04:59:38.490+0000 I NETWORK  [conn20] end connection 100.64.0.34:57900 (3 connections now open)
2022-01-11T04:59:38.550+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57902 #21 (4 connections now open)
2022-01-11T04:59:38.551+0000 I NETWORK  [conn21] received client metadata from 100.64.0.34:57902 conn21: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.583+0000 I ACCESS   [conn21] Successfully authenticated as principal root on admin from client 100.64.0.34:57902
2022-01-11T04:59:38.590+0000 I NETWORK  [conn21] end connection 100.64.0.34:57902 (3 connections now open)
2022-01-11T04:59:38.651+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57904 #22 (4 connections now open)
2022-01-11T04:59:38.653+0000 I NETWORK  [conn22] received client metadata from 100.64.0.34:57904 conn22: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.682+0000 I ACCESS   [conn22] Successfully authenticated as principal root on admin from client 100.64.0.34:57904
2022-01-11T04:59:38.687+0000 I NETWORK  [conn22] end connection 100.64.0.34:57904 (3 connections now open)
2022-01-11T04:59:38.747+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57908 #23 (4 connections now open)
2022-01-11T04:59:38.748+0000 I NETWORK  [conn23] received client metadata from 100.64.0.34:57908 conn23: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.777+0000 I ACCESS   [conn23] Successfully authenticated as principal root on admin from client 100.64.0.34:57908
2022-01-11T04:59:38.783+0000 I NETWORK  [conn23] end connection 100.64.0.34:57908 (3 connections now open)
2022-01-11T04:59:38.843+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57912 #24 (4 connections now open)
2022-01-11T04:59:38.844+0000 I NETWORK  [conn24] received client metadata from 100.64.0.34:57912 conn24: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.872+0000 I ACCESS   [conn24] Successfully authenticated as principal root on admin from client 100.64.0.34:57912
2022-01-11T04:59:38.877+0000 I NETWORK  [conn24] end connection 100.64.0.34:57912 (3 connections now open)
2022-01-11T04:59:38.937+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57918 #25 (4 connections now open)
2022-01-11T04:59:38.939+0000 I NETWORK  [conn25] received client metadata from 100.64.0.34:57918 conn25: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.968+0000 I ACCESS   [conn25] Successfully authenticated as principal root on admin from client 100.64.0.34:57918
2022-01-11T04:59:38.973+0000 I REPL     [conn25] replSetReconfig admin command received from client; new config: { _id: "rs0", version: 2, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", priority: 0.0, votes: 0.0, _id: 1.0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:38.988+0000 I REPL     [conn25] replSetReconfig config object with 2 members parses ok
2022-01-11T04:59:38.988+0000 I REPL     [replexec-1] New replica set config in use: { _id: "rs0", version: 2, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: {}, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:38.988+0000 I REPL     [replexec-1] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:38.988+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:38.990+0000 I REPL     [replexec-0] Member stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state STARTUP
2022-01-11T04:59:38.991+0000 I NETWORK  [conn25] end connection 100.64.0.34:57918 (3 connections now open)
2022-01-11T04:59:38.991+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57924 #28 (4 connections now open)
2022-01-11T04:59:38.991+0000 I NETWORK  [conn28] received client metadata from 100.64.0.34:57924 conn28: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.004+0000 I ACCESS   [conn28] Successfully authenticated as principal __system on local from client 100.64.0.34:57924
2022-01-11T04:59:39.006+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57926 #29 (5 connections now open)
2022-01-11T04:59:39.006+0000 I ACCESS   [conn29] Successfully authenticated as principal __system on local from client 100.64.0.34:57926
2022-01-11T04:59:39.006+0000 I NETWORK  [conn29] end connection 100.64.0.34:57926 (4 connections now open)
2022-01-11T04:59:39.055+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57930 #30 (5 connections now open)
2022-01-11T04:59:39.056+0000 I NETWORK  [conn30] received client metadata from 100.64.0.34:57930 conn30: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.060+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57932 #31 (6 connections now open)
2022-01-11T04:59:39.060+0000 I NETWORK  [conn31] received client metadata from 100.64.0.34:57932 conn31: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.062+0000 I ACCESS   [conn31] Successfully authenticated as principal __system on local from client 100.64.0.34:57932
2022-01-11T04:59:39.063+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57934 #32 (7 connections now open)
2022-01-11T04:59:39.064+0000 I NETWORK  [conn32] received client metadata from 100.64.0.34:57934 conn32: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.064+0000 I ACCESS   [conn32] Successfully authenticated as principal __system on local from client 100.64.0.34:57934
2022-01-11T04:59:39.085+0000 I ACCESS   [conn30] Successfully authenticated as principal root on admin from client 100.64.0.34:57930
2022-01-11T04:59:39.091+0000 I NETWORK  [conn30] end connection 100.64.0.34:57930 (6 connections now open)
2022-01-11T04:59:39.157+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:57946 #33 (7 connections now open)
2022-01-11T04:59:39.159+0000 I NETWORK  [conn33] received client metadata from 100.64.0.34:57946 conn33: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.188+0000 I ACCESS   [conn33] Successfully authenticated as principal root on admin from client 100.64.0.34:57946
2022-01-11T04:59:39.193+0000 I NETWORK  [conn33] end connection 100.64.0.34:57946 (6 connections now open)
2022-01-11T04:59:39.738+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:50160 #34 (7 connections now open)
2022-01-11T04:59:39.739+0000 I NETWORK  [conn34] received client metadata from 127.0.0.1:50160 conn34: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.742+0000 I NETWORK  [conn34] end connection 127.0.0.1:50160 (6 connections now open)
2022-01-11T04:59:40.990+0000 I REPL     [replexec-2] Member stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state SECONDARY
2022-01-11T04:59:44.064+0000 I NETWORK  [conn31] end connection 100.64.0.34:57932 (5 connections now open)
2022-01-11T04:59:44.257+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58028 #35 (6 connections now open)
2022-01-11T04:59:44.259+0000 I NETWORK  [conn35] received client metadata from 100.64.0.34:58028 conn35: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:44.293+0000 I ACCESS   [conn35] Successfully authenticated as principal root on admin from client 100.64.0.34:58028
2022-01-11T04:59:44.985+0000 I NETWORK  [conn35] end connection 100.64.0.34:58028 (5 connections now open)
2022-01-11T04:59:45.059+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58036 #36 (6 connections now open)
2022-01-11T04:59:45.060+0000 I NETWORK  [conn36] received client metadata from 100.64.0.34:58036 conn36: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:45.090+0000 I ACCESS   [conn36] Successfully authenticated as principal root on admin from client 100.64.0.34:58036
2022-01-11T04:59:45.098+0000 I REPL     [conn36] replSetReconfig admin command received from client; new config: { _id: "rs0", version: 3, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:45.100+0000 I REPL     [conn36] replSetReconfig config object with 2 members parses ok
2022-01-11T04:59:45.101+0000 I REPL     [replexec-2] New replica set config in use: { _id: "rs0", version: 3, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:45.101+0000 I REPL     [replexec-2] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:45.102+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58040 #38 (7 connections now open)
2022-01-11T04:59:45.103+0000 I ACCESS   [conn38] Successfully authenticated as principal __system on local from client 100.64.0.34:58040
2022-01-11T04:59:45.103+0000 I NETWORK  [conn38] end connection 100.64.0.34:58040 (6 connections now open)
2022-01-11T04:59:45.396+0000 I COMMAND  [conn32] command local.oplog.rs command: find { find: "oplog.rs", limit: 1, sort: { $natural: 1 }, projection: { ts: 1, t: 1 }, $readPreference: { mode: "secondaryPreferred" }, $clusterTime: { clusterTime: Timestamp(1641877185, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } }, $db: "local" } planSummary: COLLSCAN keysExamined:0 docsExamined:1 cursorExhausted:1 numYields:1 nreturned:1 reslen:248 locks:{ Global: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 2 } }, oplog: { acquireCount: { r: 2 } } } storage:{} protocol:op_msg 246ms
2022-01-11T04:59:45.396+0000 I NETWORK  [conn36] end connection 100.64.0.34:58036 (5 connections now open)
2022-01-11T04:59:45.417+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58050 #39 (6 connections now open)
2022-01-11T04:59:45.417+0000 I NETWORK  [conn39] received client metadata from 100.64.0.34:58050 conn39: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:45.418+0000 I ACCESS   [conn39] Successfully authenticated as principal __system on local from client 100.64.0.34:58050
2022-01-11T04:59:45.462+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58052 #40 (7 connections now open)
2022-01-11T04:59:45.463+0000 I NETWORK  [conn40] received client metadata from 100.64.0.34:58052 conn40: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:45.494+0000 I ACCESS   [conn40] Successfully authenticated as principal root on admin from client 100.64.0.34:58052
2022-01-11T04:59:45.668+0000 I NETWORK  [conn40] end connection 100.64.0.34:58052 (6 connections now open)
2022-01-11T04:59:46.736+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58078 #41 (7 connections now open)
2022-01-11T04:59:46.738+0000 I NETWORK  [conn41] received client metadata from 100.64.0.34:58078 conn41: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:46.772+0000 I ACCESS   [conn41] Successfully authenticated as principal root on admin from client 100.64.0.34:58078
2022-01-11T04:59:46.778+0000 I NETWORK  [conn41] end connection 100.64.0.34:58078 (6 connections now open)
2022-01-11T04:59:47.843+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58096 #42 (7 connections now open)
2022-01-11T04:59:47.845+0000 I NETWORK  [conn42] received client metadata from 100.64.0.34:58096 conn42: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:47.874+0000 I ACCESS   [conn42] Successfully authenticated as principal root on admin from client 100.64.0.34:58096
2022-01-11T04:59:47.880+0000 I NETWORK  [conn42] end connection 100.64.0.34:58096 (6 connections now open)
2022-01-11T04:59:48.399+0000 I NETWORK  [conn39] end connection 100.64.0.34:58050 (5 connections now open)
2022-01-11T04:59:48.400+0000 I NETWORK  [conn28] end connection 100.64.0.34:57924 (4 connections now open)
2022-01-11T04:59:49.101+0000 I CONNPOOL [Replication] dropping unhealthy pooled connection to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:49.101+0000 I CONNPOOL [Replication] after drop, pool was empty, going to spawn some connections
2022-01-11T04:59:49.101+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:49.101+0000 I ASIO     [Replication] Failed to connect to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.101+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I REPL_HB  [replexec-0] Error in heartbeat (requestId: 27) to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:49.102+0000 I ASIO     [Replication] Failed to connect to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I REPL_HB  [replexec-2] Error in heartbeat (requestId: 28) to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:49.103+0000 I ASIO     [Replication] Failed to connect to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.103+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.103+0000 I REPL_HB  [replexec-0] Error in heartbeat (requestId: 29) to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.103+0000 I REPL     [replexec-0] Member stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state RS_DOWN
2022-01-11T04:59:49.744+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:50340 #43 (5 connections now open)
2022-01-11T04:59:49.746+0000 I NETWORK  [conn43] received client metadata from 127.0.0.1:50340 conn43: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:49.749+0000 I NETWORK  [conn43] end connection 127.0.0.1:50340 (4 connections now open)
2022-01-11T04:59:50.419+0000 I NETWORK  [conn32] end connection 100.64.0.34:57934 (3 connections now open)
2022-01-11T04:59:50.905+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58164 #44 (4 connections now open)
2022-01-11T04:59:50.918+0000 I ACCESS   [conn44] Successfully authenticated as principal __system on local from client 100.64.0.34:58164
2022-01-11T04:59:50.918+0000 I NETWORK  [conn44] end connection 100.64.0.34:58164 (3 connections now open)
2022-01-11T04:59:50.920+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58166 #45 (4 connections now open)
2022-01-11T04:59:50.920+0000 I NETWORK  [conn45] received client metadata from 100.64.0.34:58166 conn45: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:50.921+0000 I ACCESS   [conn45] Successfully authenticated as principal __system on local from client 100.64.0.34:58166
2022-01-11T04:59:51.103+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:51.118+0000 I REPL     [replexec-2] Member stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state SECONDARY
2022-01-11T04:59:52.599+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45392 #47 (5 connections now open)
2022-01-11T04:59:52.599+0000 I NETWORK  [conn47] end connection 100.64.0.36:45392 (4 connections now open)
2022-01-11T04:59:52.655+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45396 #48 (5 connections now open)
2022-01-11T04:59:52.657+0000 I NETWORK  [conn48] received client metadata from 100.64.0.36:45396 conn48: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:52.686+0000 I ACCESS   [conn48] Successfully authenticated as principal root on admin from client 100.64.0.36:45396
2022-01-11T04:59:52.692+0000 I NETWORK  [conn48] end connection 100.64.0.36:45396 (4 connections now open)
2022-01-11T04:59:52.757+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45398 #49 (5 connections now open)
2022-01-11T04:59:52.758+0000 I NETWORK  [conn49] received client metadata from 100.64.0.36:45398 conn49: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:52.787+0000 I ACCESS   [conn49] Successfully authenticated as principal root on admin from client 100.64.0.36:45398
2022-01-11T04:59:52.792+0000 I NETWORK  [conn49] end connection 100.64.0.36:45398 (4 connections now open)
2022-01-11T04:59:52.852+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45406 #50 (5 connections now open)
2022-01-11T04:59:52.853+0000 I NETWORK  [conn50] received client metadata from 100.64.0.36:45406 conn50: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:52.881+0000 I ACCESS   [conn50] Successfully authenticated as principal root on admin from client 100.64.0.36:45406
2022-01-11T04:59:52.886+0000 I NETWORK  [conn50] end connection 100.64.0.36:45406 (4 connections now open)
2022-01-11T04:59:52.949+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45408 #51 (5 connections now open)
2022-01-11T04:59:52.950+0000 I NETWORK  [conn51] received client metadata from 100.64.0.36:45408 conn51: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:52.979+0000 I ACCESS   [conn51] Successfully authenticated as principal root on admin from client 100.64.0.36:45408
2022-01-11T04:59:52.984+0000 I NETWORK  [conn51] end connection 100.64.0.36:45408 (4 connections now open)
2022-01-11T04:59:53.048+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45410 #52 (5 connections now open)
2022-01-11T04:59:53.050+0000 I NETWORK  [conn52] received client metadata from 100.64.0.36:45410 conn52: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.090+0000 I ACCESS   [conn52] Successfully authenticated as principal root on admin from client 100.64.0.36:45410
2022-01-11T04:59:53.095+0000 I REPL     [conn52] replSetReconfig admin command received from client; new config: { _id: "rs0", version: 4, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { host: "stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", priority: 0.0, votes: 0.0, _id: 2.0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:53.110+0000 I REPL     [conn52] replSetReconfig config object with 3 members parses ok
2022-01-11T04:59:53.110+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:53.111+0000 I REPL     [replexec-2] New replica set config in use: { _id: "rs0", version: 4, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: {}, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:53.111+0000 I REPL     [replexec-2] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:53.111+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:53.112+0000 I CONNPOOL [Replication] Ending idle connection to host stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 because the pool meets constraints; 1 connections to that host remain open
2022-01-11T04:59:53.113+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58220 #57 (6 connections now open)
2022-01-11T04:59:53.113+0000 I REPL     [replexec-3] Member stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state STARTUP
2022-01-11T04:59:53.113+0000 I ACCESS   [conn57] Successfully authenticated as principal __system on local from client 100.64.0.34:58220
2022-01-11T04:59:53.114+0000 I NETWORK  [conn57] end connection 100.64.0.34:58220 (5 connections now open)
2022-01-11T04:59:53.114+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45422 #58 (6 connections now open)
2022-01-11T04:59:53.114+0000 I NETWORK  [conn58] received client metadata from 100.64.0.36:45422 conn58: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.115+0000 I NETWORK  [conn52] end connection 100.64.0.36:45410 (5 connections now open)
2022-01-11T04:59:53.138+0000 I ACCESS   [conn58] Successfully authenticated as principal __system on local from client 100.64.0.36:45422
2022-01-11T04:59:53.140+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45426 #59 (6 connections now open)
2022-01-11T04:59:53.140+0000 I ACCESS   [conn59] Successfully authenticated as principal __system on local from client 100.64.0.36:45426
2022-01-11T04:59:53.141+0000 I NETWORK  [conn59] end connection 100.64.0.36:45426 (5 connections now open)
2022-01-11T04:59:53.177+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45436 #60 (6 connections now open)
2022-01-11T04:59:53.178+0000 I NETWORK  [conn60] received client metadata from 100.64.0.36:45436 conn60: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.207+0000 I ACCESS   [conn60] Successfully authenticated as principal root on admin from client 100.64.0.36:45436
2022-01-11T04:59:53.213+0000 I NETWORK  [conn60] end connection 100.64.0.36:45436 (5 connections now open)
2022-01-11T04:59:53.278+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45442 #61 (6 connections now open)
2022-01-11T04:59:53.279+0000 I NETWORK  [conn61] received client metadata from 100.64.0.36:45442 conn61: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.311+0000 I ACCESS   [conn61] Successfully authenticated as principal root on admin from client 100.64.0.36:45442
2022-01-11T04:59:53.311+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45444 #62 (7 connections now open)
2022-01-11T04:59:53.311+0000 I NETWORK  [conn62] received client metadata from 100.64.0.36:45444 conn62: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.312+0000 I ACCESS   [conn62] Successfully authenticated as principal __system on local from client 100.64.0.36:45444
2022-01-11T04:59:53.314+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45446 #63 (8 connections now open)
2022-01-11T04:59:53.314+0000 I NETWORK  [conn63] received client metadata from 100.64.0.36:45446 conn63: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.314+0000 I ACCESS   [conn63] Successfully authenticated as principal __system on local from client 100.64.0.36:45446
2022-01-11T04:59:53.317+0000 I NETWORK  [conn61] end connection 100.64.0.36:45442 (7 connections now open)
2022-01-11T04:59:53.922+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58294 #64 (8 connections now open)
2022-01-11T04:59:53.922+0000 I NETWORK  [conn64] received client metadata from 100.64.0.34:58294 conn64: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.923+0000 I ACCESS   [conn64] Successfully authenticated as principal __system on local from client 100.64.0.34:58294
2022-01-11T04:59:53.924+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58296 #65 (9 connections now open)
2022-01-11T04:59:53.924+0000 I NETWORK  [conn65] received client metadata from 100.64.0.34:58296 conn65: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.925+0000 I ACCESS   [conn65] Successfully authenticated as principal __system on local from client 100.64.0.34:58296
2022-01-11T04:59:54.730+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:50524 #66 (10 connections now open)
2022-01-11T04:59:54.731+0000 I NETWORK  [conn66] received client metadata from 127.0.0.1:50524 conn66: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:54.734+0000 I NETWORK  [conn66] end connection 127.0.0.1:50524 (9 connections now open)
2022-01-11T04:59:55.113+0000 I REPL     [replexec-3] Member stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state SECONDARY
2022-01-11T04:59:58.383+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45646 #67 (10 connections now open)
2022-01-11T04:59:58.384+0000 I NETWORK  [conn67] received client metadata from 100.64.0.36:45646 conn67: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:58.413+0000 I ACCESS   [conn67] Successfully authenticated as principal root on admin from client 100.64.0.36:45646
2022-01-11T04:59:58.418+0000 I NETWORK  [conn67] end connection 100.64.0.36:45646 (9 connections now open)
2022-01-11T04:59:58.485+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45648 #68 (10 connections now open)
2022-01-11T04:59:58.486+0000 I NETWORK  [conn68] received client metadata from 100.64.0.36:45648 conn68: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:58.517+0000 I ACCESS   [conn68] Successfully authenticated as principal root on admin from client 100.64.0.36:45648
2022-01-11T04:59:58.523+0000 I REPL     [conn68] replSetReconfig admin command received from client; new config: { _id: "rs0", version: 5, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:58.526+0000 I REPL     [conn68] replSetReconfig config object with 3 members parses ok
2022-01-11T04:59:58.528+0000 I REPL     [replexec-1] New replica set config in use: { _id: "rs0", version: 5, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:58.528+0000 I REPL     [replexec-1] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:58.529+0000 I NETWORK  [listener] connection accepted from 100.64.0.34:58454 #71 (11 connections now open)
2022-01-11T04:59:58.530+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45656 #72 (12 connections now open)
2022-01-11T04:59:58.530+0000 I ACCESS   [conn71] Successfully authenticated as principal __system on local from client 100.64.0.34:58454
2022-01-11T04:59:58.530+0000 I NETWORK  [conn71] end connection 100.64.0.34:58454 (11 connections now open)
2022-01-11T04:59:58.530+0000 I ACCESS   [conn72] Successfully authenticated as principal __system on local from client 100.64.0.36:45656
2022-01-11T04:59:58.531+0000 I NETWORK  [conn68] end connection 100.64.0.36:45648 (10 connections now open)
2022-01-11T04:59:58.531+0000 I NETWORK  [conn72] end connection 100.64.0.36:45656 (9 connections now open)
2022-01-11T04:59:58.596+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45662 #73 (10 connections now open)
2022-01-11T04:59:58.597+0000 I NETWORK  [conn73] received client metadata from 100.64.0.36:45662 conn73: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:58.625+0000 I ACCESS   [conn73] Successfully authenticated as principal root on admin from client 100.64.0.36:45662
2022-01-11T04:59:58.630+0000 I NETWORK  [conn73] end connection 100.64.0.36:45662 (9 connections now open)
2022-01-11T04:59:59.701+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45686 #74 (10 connections now open)
2022-01-11T04:59:59.702+0000 I NETWORK  [conn74] received client metadata from 100.64.0.36:45686 conn74: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:59.732+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:50698 #75 (11 connections now open)
2022-01-11T04:59:59.734+0000 I NETWORK  [conn75] received client metadata from 127.0.0.1:50698 conn75: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:59.737+0000 I ACCESS   [conn74] Successfully authenticated as principal root on admin from client 100.64.0.36:45686
2022-01-11T04:59:59.737+0000 I NETWORK  [conn75] end connection 127.0.0.1:50698 (10 connections now open)
2022-01-11T04:59:59.745+0000 I NETWORK  [conn74] end connection 100.64.0.36:45686 (9 connections now open)
2022-01-11T05:00:00.809+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45706 #76 (10 connections now open)
2022-01-11T05:00:00.811+0000 I NETWORK  [conn76] received client metadata from 100.64.0.36:45706 conn76: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:00.847+0000 I ACCESS   [conn76] Successfully authenticated as principal root on admin from client 100.64.0.36:45706
2022-01-11T05:00:00.854+0000 I NETWORK  [conn76] end connection 100.64.0.36:45706 (9 connections now open)
2022-01-11T05:00:01.533+0000 I NETWORK  [conn63] end connection 100.64.0.36:45446 (8 connections now open)
2022-01-11T05:00:01.533+0000 I NETWORK  [conn62] end connection 100.64.0.36:45444 (7 connections now open)
2022-01-11T05:00:01.534+0000 I NETWORK  [conn58] end connection 100.64.0.36:45422 (6 connections now open)
2022-01-11T05:00:02.528+0000 I CONNPOOL [Replication] dropping unhealthy pooled connection to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:02.528+0000 I CONNPOOL [Replication] after drop, pool was empty, going to spawn some connections
2022-01-11T05:00:02.528+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:02.529+0000 I ASIO     [Replication] Failed to connect to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.529+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.529+0000 I REPL_HB  [replexec-0] Error in heartbeat (requestId: 67) to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.529+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:02.530+0000 I ASIO     [Replication] Failed to connect to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.530+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.530+0000 I REPL_HB  [replexec-4] Error in heartbeat (requestId: 68) to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.530+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:02.531+0000 I ASIO     [Replication] Failed to connect to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.531+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.531+0000 I REPL_HB  [replexec-3] Error in heartbeat (requestId: 69) to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.531+0000 I REPL     [replexec-3] Member stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state RS_DOWN
2022-01-11T05:00:02.908+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45774 #77 (7 connections now open)
2022-01-11T05:00:02.921+0000 I ACCESS   [conn77] Successfully authenticated as principal __system on local from client 100.64.0.36:45774
2022-01-11T05:00:02.921+0000 I NETWORK  [conn77] end connection 100.64.0.36:45774 (6 connections now open)
2022-01-11T05:00:02.936+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45778 #78 (7 connections now open)
2022-01-11T05:00:02.937+0000 I NETWORK  [conn78] received client metadata from 100.64.0.36:45778 conn78: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:02.937+0000 I ACCESS   [conn78] Successfully authenticated as principal __system on local from client 100.64.0.36:45778
2022-01-11T05:00:04.531+0000 I ASIO     [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:04.545+0000 I REPL     [replexec-4] Member stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state SECONDARY
2022-01-11T05:00:04.722+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:50824 #80 (8 connections now open)
2022-01-11T05:00:04.723+0000 I NETWORK  [conn80] received client metadata from 127.0.0.1:50824 conn80: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:04.726+0000 I NETWORK  [conn80] end connection 127.0.0.1:50824 (7 connections now open)
2022-01-11T05:00:09.730+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:50936 #81 (8 connections now open)
2022-01-11T05:00:09.732+0000 I NETWORK  [conn81] received client metadata from 127.0.0.1:50936 conn81: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:09.735+0000 I NETWORK  [conn81] end connection 127.0.0.1:50936 (7 connections now open)
2022-01-11T05:00:09.939+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45934 #82 (8 connections now open)
2022-01-11T05:00:09.939+0000 I NETWORK  [conn82] received client metadata from 100.64.0.36:45934 conn82: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:09.940+0000 I ACCESS   [conn82] Successfully authenticated as principal __system on local from client 100.64.0.36:45934
2022-01-11T05:00:09.942+0000 I NETWORK  [listener] connection accepted from 100.64.0.36:45936 #83 (9 connections now open)
2022-01-11T05:00:09.942+0000 I NETWORK  [conn83] received client metadata from 100.64.0.36:45936 conn83: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:09.943+0000 I ACCESS   [conn83] Successfully authenticated as principal __system on local from client 100.64.0.36:45936
2022-01-11T05:00:14.724+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:51028 #84 (10 connections now open)
2022-01-11T05:00:14.726+0000 I NETWORK  [conn84] received client metadata from 127.0.0.1:51028 conn84: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:14.729+0000 I NETWORK  [conn84] end connection 127.0.0.1:51028 (9 connections now open)
2022-01-11T05:00:19.730+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:51118 #85 (10 connections now open)
2022-01-11T05:00:19.732+0000 I NETWORK  [conn85] received client metadata from 127.0.0.1:51118 conn85: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:19.735+0000 I NETWORK  [conn85] end connection 127.0.0.1:51118 (9 connections now open)
2022-01-11T05:00:24.727+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:51220 #86 (10 connections now open)
2022-01-11T05:00:24.729+0000 I NETWORK  [conn86] received client metadata from 127.0.0.1:51220 conn86: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:24.732+0000 I NETWORK  [conn86] end connection 127.0.0.1:51220 (9 connections now open)
2022-01-11T05:00:29.728+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:51324 #87 (10 connections now open)
2022-01-11T05:00:29.730+0000 I NETWORK  [conn87] received client metadata from 127.0.0.1:51324 conn87: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:29.733+0000 I NETWORK  [conn87] end connection 127.0.0.1:51324 (9 connections now open)
2022-01-11T05:00:34.737+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:51440 #88 (10 connections now open)
2022-01-11T05:00:34.738+0000 I NETWORK  [conn88] received client metadata from 127.0.0.1:51440 conn88: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:34.742+0000 I NETWORK  [conn88] end connection 127.0.0.1:51440 (9 connections now open)
2022-01-11T05:00:39.725+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:51560 #89 (10 connections now open)
2022-01-11T05:00:39.726+0000 I NETWORK  [conn89] received client metadata from 127.0.0.1:51560 conn89: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:39.730+0000 I NETWORK  [conn89] end connection 127.0.0.1:51560 (9 connections now open)
2022-01-11T05:00:44.735+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:51678 #90 (10 connections now open)
2022-01-11T05:00:44.737+0000 I NETWORK  [conn90] received client metadata from 127.0.0.1:51678 conn90: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:44.741+0000 I NETWORK  [conn90] end connection 127.0.0.1:51678 (9 connections now open)
2022-01-11T05:00:49.723+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:51792 #91 (10 connections now open)
2022-01-11T05:00:49.725+0000 I NETWORK  [conn91] received client metadata from 127.0.0.1:51792 conn91: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:49.728+0000 I NETWORK  [conn91] end connection 127.0.0.1:51792 (9 connections now open)
2022-01-11T05:00:54.723+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:51912 #92 (10 connections now open)
2022-01-11T05:00:54.725+0000 I NETWORK  [conn92] received client metadata from 127.0.0.1:51912 conn92: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:54.728+0000 I NETWORK  [conn92] end connection 127.0.0.1:51912 (9 connections now open)
2022-01-11T05:00:59.737+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52016 #93 (10 connections now open)
2022-01-11T05:00:59.738+0000 I NETWORK  [conn93] received client metadata from 127.0.0.1:52016 conn93: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:59.741+0000 I NETWORK  [conn93] end connection 127.0.0.1:52016 (9 connections now open)
2022-01-11T05:01:04.721+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52122 #94 (10 connections now open)
2022-01-11T05:01:04.723+0000 I NETWORK  [conn94] received client metadata from 127.0.0.1:52122 conn94: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:04.726+0000 I NETWORK  [conn94] end connection 127.0.0.1:52122 (9 connections now open)
2022-01-11T05:01:09.736+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52246 #95 (10 connections now open)
2022-01-11T05:01:09.737+0000 I NETWORK  [conn95] received client metadata from 127.0.0.1:52246 conn95: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:09.740+0000 I NETWORK  [conn95] end connection 127.0.0.1:52246 (9 connections now open)
2022-01-11T05:01:14.749+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52344 #96 (10 connections now open)
2022-01-11T05:01:14.750+0000 I NETWORK  [conn96] received client metadata from 127.0.0.1:52344 conn96: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:14.753+0000 I NETWORK  [conn96] end connection 127.0.0.1:52344 (9 connections now open)
2022-01-11T05:01:19.728+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52446 #97 (10 connections now open)
2022-01-11T05:01:19.729+0000 I NETWORK  [conn97] received client metadata from 127.0.0.1:52446 conn97: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:19.733+0000 I NETWORK  [conn97] end connection 127.0.0.1:52446 (9 connections now open)
2022-01-11T05:01:24.751+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52544 #98 (10 connections now open)
2022-01-11T05:01:24.753+0000 I NETWORK  [conn98] received client metadata from 127.0.0.1:52544 conn98: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:24.756+0000 I NETWORK  [conn98] end connection 127.0.0.1:52544 (9 connections now open)
2022-01-11T05:01:29.732+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52648 #99 (10 connections now open)
2022-01-11T05:01:29.733+0000 I NETWORK  [conn99] received client metadata from 127.0.0.1:52648 conn99: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:29.736+0000 I NETWORK  [conn99] end connection 127.0.0.1:52648 (9 connections now open)
2022-01-11T05:01:34.737+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52738 #100 (10 connections now open)
2022-01-11T05:01:34.739+0000 I NETWORK  [conn100] received client metadata from 127.0.0.1:52738 conn100: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:34.742+0000 I NETWORK  [conn100] end connection 127.0.0.1:52738 (9 connections now open)
2022-01-11T05:01:39.737+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52844 #101 (10 connections now open)
2022-01-11T05:01:39.739+0000 I NETWORK  [conn101] received client metadata from 127.0.0.1:52844 conn101: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:39.742+0000 I NETWORK  [conn101] end connection 127.0.0.1:52844 (9 connections now open)
2022-01-11T05:01:44.739+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:52942 #102 (10 connections now open)
2022-01-11T05:01:44.741+0000 I NETWORK  [conn102] received client metadata from 127.0.0.1:52942 conn102: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:44.743+0000 I NETWORK  [conn102] end connection 127.0.0.1:52942 (9 connections now open)
2022-01-11T05:01:49.738+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53032 #103 (10 connections now open)
2022-01-11T05:01:49.739+0000 I NETWORK  [conn103] received client metadata from 127.0.0.1:53032 conn103: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:49.742+0000 I NETWORK  [conn103] end connection 127.0.0.1:53032 (9 connections now open)
2022-01-11T05:01:54.733+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53120 #104 (10 connections now open)
2022-01-11T05:01:54.734+0000 I NETWORK  [conn104] received client metadata from 127.0.0.1:53120 conn104: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:54.737+0000 I NETWORK  [conn104] end connection 127.0.0.1:53120 (9 connections now open)
2022-01-11T05:01:59.739+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53210 #105 (10 connections now open)
2022-01-11T05:01:59.740+0000 I NETWORK  [conn105] received client metadata from 127.0.0.1:53210 conn105: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:59.743+0000 I NETWORK  [conn105] end connection 127.0.0.1:53210 (9 connections now open)
2022-01-11T05:02:04.730+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53302 #106 (10 connections now open)
2022-01-11T05:02:04.731+0000 I NETWORK  [conn106] received client metadata from 127.0.0.1:53302 conn106: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:04.734+0000 I NETWORK  [conn106] end connection 127.0.0.1:53302 (9 connections now open)
2022-01-11T05:02:09.728+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53406 #107 (10 connections now open)
2022-01-11T05:02:09.729+0000 I NETWORK  [conn107] received client metadata from 127.0.0.1:53406 conn107: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:09.732+0000 I NETWORK  [conn107] end connection 127.0.0.1:53406 (9 connections now open)
2022-01-11T05:02:14.730+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53504 #108 (10 connections now open)
2022-01-11T05:02:14.731+0000 I NETWORK  [conn108] received client metadata from 127.0.0.1:53504 conn108: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:14.734+0000 I NETWORK  [conn108] end connection 127.0.0.1:53504 (9 connections now open)
2022-01-11T05:02:19.726+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53598 #109 (10 connections now open)
2022-01-11T05:02:19.728+0000 I NETWORK  [conn109] received client metadata from 127.0.0.1:53598 conn109: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:19.730+0000 I NETWORK  [conn109] end connection 127.0.0.1:53598 (9 connections now open)
2022-01-11T05:02:24.728+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53688 #110 (10 connections now open)
2022-01-11T05:02:24.730+0000 I NETWORK  [conn110] received client metadata from 127.0.0.1:53688 conn110: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:24.733+0000 I NETWORK  [conn110] end connection 127.0.0.1:53688 (9 connections now open)
2022-01-11T05:02:29.734+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53778 #111 (10 connections now open)
2022-01-11T05:02:29.735+0000 I NETWORK  [conn111] received client metadata from 127.0.0.1:53778 conn111: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:29.738+0000 I NETWORK  [conn111] end connection 127.0.0.1:53778 (9 connections now open)
2022-01-11T05:02:34.727+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53868 #112 (10 connections now open)
2022-01-11T05:02:34.729+0000 I NETWORK  [conn112] received client metadata from 127.0.0.1:53868 conn112: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:34.731+0000 I NETWORK  [conn112] end connection 127.0.0.1:53868 (9 connections now open)
2022-01-11T05:02:39.731+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:53974 #113 (10 connections now open)
2022-01-11T05:02:39.733+0000 I NETWORK  [conn113] received client metadata from 127.0.0.1:53974 conn113: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:39.736+0000 I NETWORK  [conn113] end connection 127.0.0.1:53974 (9 connections now open)
2022-01-11T05:02:44.727+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54072 #114 (10 connections now open)
2022-01-11T05:02:44.728+0000 I NETWORK  [conn114] received client metadata from 127.0.0.1:54072 conn114: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:44.731+0000 I NETWORK  [conn114] end connection 127.0.0.1:54072 (9 connections now open)
2022-01-11T05:02:49.726+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54170 #115 (10 connections now open)
2022-01-11T05:02:49.727+0000 I NETWORK  [conn115] received client metadata from 127.0.0.1:54170 conn115: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:49.730+0000 I NETWORK  [conn115] end connection 127.0.0.1:54170 (9 connections now open)
2022-01-11T05:02:54.736+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54258 #116 (10 connections now open)
2022-01-11T05:02:54.737+0000 I NETWORK  [conn116] received client metadata from 127.0.0.1:54258 conn116: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:54.740+0000 I NETWORK  [conn116] end connection 127.0.0.1:54258 (9 connections now open)
2022-01-11T05:02:59.727+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54356 #117 (10 connections now open)
2022-01-11T05:02:59.728+0000 I NETWORK  [conn117] received client metadata from 127.0.0.1:54356 conn117: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:59.731+0000 I NETWORK  [conn117] end connection 127.0.0.1:54356 (9 connections now open)
2022-01-11T05:03:04.730+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54444 #118 (10 connections now open)
2022-01-11T05:03:04.732+0000 I NETWORK  [conn118] received client metadata from 127.0.0.1:54444 conn118: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:04.735+0000 I NETWORK  [conn118] end connection 127.0.0.1:54444 (9 connections now open)
2022-01-11T05:03:09.733+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54548 #119 (10 connections now open)
2022-01-11T05:03:09.734+0000 I NETWORK  [conn119] received client metadata from 127.0.0.1:54548 conn119: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:09.737+0000 I NETWORK  [conn119] end connection 127.0.0.1:54548 (9 connections now open)
2022-01-11T05:03:14.723+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54644 #120 (10 connections now open)
2022-01-11T05:03:14.724+0000 I NETWORK  [conn120] received client metadata from 127.0.0.1:54644 conn120: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:14.728+0000 I NETWORK  [conn120] end connection 127.0.0.1:54644 (9 connections now open)
2022-01-11T05:03:19.724+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54746 #121 (10 connections now open)
2022-01-11T05:03:19.725+0000 I NETWORK  [conn121] received client metadata from 127.0.0.1:54746 conn121: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:19.728+0000 I NETWORK  [conn121] end connection 127.0.0.1:54746 (9 connections now open)
2022-01-11T05:03:24.721+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54848 #122 (10 connections now open)
2022-01-11T05:03:24.723+0000 I NETWORK  [conn122] received client metadata from 127.0.0.1:54848 conn122: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:24.726+0000 I NETWORK  [conn122] end connection 127.0.0.1:54848 (9 connections now open)
2022-01-11T05:03:29.728+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:54940 #123 (10 connections now open)
2022-01-11T05:03:29.729+0000 I NETWORK  [conn123] received client metadata from 127.0.0.1:54940 conn123: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:29.732+0000 I NETWORK  [conn123] end connection 127.0.0.1:54940 (9 connections now open)
2022-01-11T05:03:34.722+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55032 #124 (10 connections now open)
2022-01-11T05:03:34.723+0000 I NETWORK  [conn124] received client metadata from 127.0.0.1:55032 conn124: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:34.726+0000 I NETWORK  [conn124] end connection 127.0.0.1:55032 (9 connections now open)
2022-01-11T05:03:39.735+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55140 #125 (10 connections now open)
2022-01-11T05:03:39.736+0000 I NETWORK  [conn125] received client metadata from 127.0.0.1:55140 conn125: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:39.739+0000 I NETWORK  [conn125] end connection 127.0.0.1:55140 (9 connections now open)
2022-01-11T05:03:44.732+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55240 #126 (10 connections now open)
2022-01-11T05:03:44.733+0000 I NETWORK  [conn126] received client metadata from 127.0.0.1:55240 conn126: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:44.736+0000 I NETWORK  [conn126] end connection 127.0.0.1:55240 (9 connections now open)
2022-01-11T05:03:49.744+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55344 #127 (10 connections now open)
2022-01-11T05:03:49.746+0000 I NETWORK  [conn127] received client metadata from 127.0.0.1:55344 conn127: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:49.750+0000 I NETWORK  [conn127] end connection 127.0.0.1:55344 (9 connections now open)
2022-01-11T05:03:54.731+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55444 #128 (10 connections now open)
2022-01-11T05:03:54.732+0000 I NETWORK  [conn128] received client metadata from 127.0.0.1:55444 conn128: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:54.735+0000 I NETWORK  [conn128] end connection 127.0.0.1:55444 (9 connections now open)
2022-01-11T05:03:59.728+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55540 #129 (10 connections now open)
2022-01-11T05:03:59.729+0000 I NETWORK  [conn129] received client metadata from 127.0.0.1:55540 conn129: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:59.732+0000 I NETWORK  [conn129] end connection 127.0.0.1:55540 (9 connections now open)
2022-01-11T05:04:04.720+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55628 #130 (10 connections now open)
2022-01-11T05:04:04.721+0000 I NETWORK  [conn130] received client metadata from 127.0.0.1:55628 conn130: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:04:04.724+0000 I NETWORK  [conn130] end connection 127.0.0.1:55628 (9 connections now open)
2022-01-11T05:04:09.734+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55730 #131 (10 connections now open)
2022-01-11T05:04:09.735+0000 I NETWORK  [conn131] received client metadata from 127.0.0.1:55730 conn131: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:04:09.739+0000 I NETWORK  [conn131] end connection 127.0.0.1:55730 (9 connections now open)
2022-01-11T05:04:14.727+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55826 #132 (10 connections now open)
2022-01-11T05:04:14.728+0000 I NETWORK  [conn132] received client metadata from 127.0.0.1:55826 conn132: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:04:14.731+0000 I NETWORK  [conn132] end connection 127.0.0.1:55826 (9 connections now open)
2022-01-11T05:04:19.732+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:55926 #133 (10 connections now open)
2022-01-11T05:04:19.734+0000 I NETWORK  [conn133] received client metadata from 127.0.0.1:55926 conn133: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:04:19.737+0000 I NETWORK  [conn133] end connection 127.0.0.1:55926 (9 connections now open)

[arms11]

I do not have access to 1.19 kubernetes to be able to verify this. But could you please verify the service has the headless service created and configured correctly. Since this looks to be a connectivity issue, I wonder if that is not configured correctly.

1. Ensure the headless service is exists/enabled
2. Ensure 3 endpoints are showing IP and Ports

kubectl get services

NAME                            TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                                 AGE
kubernetes                      ClusterIP   172.20.0.1       <none>        443/TCP                                 119d
st2-staging-mongodb-headless    ClusterIP   None             <none>        27017/TCP                               118d

kubectl describe service st2-staging-mongodb-headless

Name:              st2-staging-mongodb-headless
Namespace:         default
Labels:            app.kubernetes.io/component=mongodb
                   app.kubernetes.io/instance=st2-staging
                   app.kubernetes.io/managed-by=Helm
                   app.kubernetes.io/name=mongodb
                   helm.sh/chart=mongodb-10.0.1
Annotations:       meta.helm.sh/release-name: st2-staging
                   meta.helm.sh/release-namespace: default
Selector:          app.kubernetes.io/component=mongodb,app.kubernetes.io/instance=st2-staging,app.kubernetes.io/name=mongodb
Type:              ClusterIP
IP Family Policy:  SingleStack
IP Families:       IPv4
IP:                None
IPs:               None
Port:              mongodb  27017/TCP
TargetPort:        mongodb/TCP
Endpoints:         10.138.241.85:27017,10.138.242.83:27017,10.138.243.90:27017
Session Affinity:  None
Events:            <none>

[xiaofan-linux]

I do not have access to 1.19 kubernetes to be able to verify this. But could you please verify the service has the headless service created and configured correctly. Since this looks to be a connectivity issue, I wonder if that is not configured correctly.

1. Ensure the headless service is exists/enabled
2. Ensure 3 endpoints are showing IP and Ports

>>> get svc -n stackstorm-system
NAME                           TYPE        CLUSTER-IP    EXTERNAL-IP   PORT(S)                                 AGE
stackstorm-mongodb-headless    ClusterIP   None          <none>        27017/TCP                               9m5s
stackstorm-rabbitmq            ClusterIP   10.96.0.64    <none>        5672/TCP,4369/TCP,25672/TCP,15672/TCP   9m5s
stackstorm-rabbitmq-headless   ClusterIP   None          <none>        4369/TCP,5672/TCP,25672/TCP,15672/TCP   9m5s
stackstorm-redis               ClusterIP   10.96.2.168   <none>        6379/TCP,26379/TCP                      9m5s
stackstorm-redis-headless      ClusterIP   None          <none>        6379/TCP,26379/TCP                      9m5s
stackstorm-st2api              ClusterIP   10.96.1.23    <none>        9101/TCP                                9m5s
stackstorm-st2auth             ClusterIP   10.96.1.114   <none>        9100/TCP                                9m5s
stackstorm-st2chatops          ClusterIP   10.96.0.165   <none>        8081/TCP                                9m5s
stackstorm-st2stream           ClusterIP   10.96.0.131   <none>        9102/TCP                                9m5s
stackstorm-st2web              NodePort    10.96.2.241   <none>        80:31470/TCP                            9m5s
>>> describe svc -n stackstorm-system stackstorm-mongodb-headless
Name:              stackstorm-mongodb-headless
Namespace:         stackstorm-system
Labels:            app.kubernetes.io/component=mongodb
                   app.kubernetes.io/instance=stackstorm
                   app.kubernetes.io/managed-by=Helm
                   app.kubernetes.io/name=mongodb
                   helm.sh/chart=mongodb-10.0.1
Annotations:       meta.helm.sh/release-name: stackstorm
                   meta.helm.sh/release-namespace: stackstorm-system
Selector:          app.kubernetes.io/component=mongodb,app.kubernetes.io/instance=stackstorm,app.kubernetes.io/name=mongodb
Type:              ClusterIP
IP:                None
Port:              mongodb  27017/TCP
TargetPort:        mongodb/TCP
Endpoints:         100.64.0.30:27017,100.64.0.38:27017,100.64.0.40:27017
Session Affinity:  None
Events:            <none>
>>> get pod -n stackstorm-system -o wide
NAME                                              READY   STATUS             RESTARTS   AGE     IP            NODE           NOMINATED NODE   READINESS GATES
stackstorm-job-st2-apikey-load-j6hb7              0/1     Init:1/3           0          11m     100.64.0.26   0110cfe94989   <none>           <none>
stackstorm-mongodb-0                              1/1     Running            0          11m     100.64.0.30   0110cfe94989   <none>           <none>
stackstorm-mongodb-1                              1/1     Running            0          6m28s   100.64.0.38   0110cfe94989   <none>           <none>
stackstorm-mongodb-2                              1/1     Running            0          6m      100.64.0.40   0110cfe94989   <none>           <none>
stackstorm-rabbitmq-0                             1/1     Running            0          11m     100.64.0.29   0110cfe94989   <none>           <none>
stackstorm-rabbitmq-1                             1/1     Running            0          6m59s   100.64.0.34   0110cfe94989   <none>           <none>
stackstorm-rabbitmq-2                             1/1     Running            0          6m32s   100.64.0.36   0110cfe94989   <none>           <none>
stackstorm-redis-node-0                           2/2     Running            0          11m     100.64.0.32   0110cfe94989   <none>           <none>
stackstorm-redis-node-1                           2/2     Running            0          5m8s    100.64.0.42   0110cfe94989   <none>           <none>
stackstorm-redis-node-2                           2/2     Running            0          4m54s   100.64.0.44   0110cfe94989   <none>           <none>
stackstorm-st2actionrunner-5fd4f58667-wkhfv       0/1     CrashLoopBackOff   5          11m     100.64.0.21   0110cfe94989   <none>           <none>
stackstorm-st2api-7ccb6fbf99-4zw9b                0/1     CrashLoopBackOff   5          11m     100.64.0.16   0110cfe94989   <none>           <none>
stackstorm-st2auth-6c7b9d84b9-2nqq8               0/1     CrashLoopBackOff   5          11m     100.64.0.24   0110cfe94989   <none>           <none>
stackstorm-st2chatops-79b477ff84-kh8rq            1/1     Running            0          11m     100.64.0.12   0110cfe94989   <none>           <none>
stackstorm-st2client-6dcc69f474-8vk8b             1/1     Running            0          11m     100.64.0.25   0110cfe94989   <none>           <none>
stackstorm-st2garbagecollector-5787b8997f-tjjmn   0/1     CrashLoopBackOff   5          11m     100.64.0.27   0110cfe94989   <none>           <none>
stackstorm-st2notifier-68fbc44b54-vz7k8           0/1     CrashLoopBackOff   5          11m     100.64.0.14   0110cfe94989   <none>           <none>
stackstorm-st2rulesengine-5fbb49b944-fnd75        0/1     CrashLoopBackOff   5          11m     100.64.0.17   0110cfe94989   <none>           <none>
stackstorm-st2scheduler-744459f594-mff7g          0/1     CrashLoopBackOff   5          11m     100.64.0.23   0110cfe94989   <none>           <none>
stackstorm-st2sensorcontainer-7d65b8f8f-46dv7     0/1     CrashLoopBackOff   5          11m     100.64.0.28   0110cfe94989   <none>           <none>
stackstorm-st2stream-69fc49f547-kpp79             0/1     CrashLoopBackOff   5          11m     100.64.0.19   0110cfe94989   <none>           <none>
stackstorm-st2timersengine-868db79948-ww5z7       0/1     CrashLoopBackOff   5          11m     100.64.0.11   0110cfe94989   <none>           <none>
stackstorm-st2web-688568565f-76269                1/1     Running            0          11m     100.64.0.13   0110cfe94989   <none>           <none>
stackstorm-st2workflowengine-7c5b87456f-828h5     0/1     CrashLoopBackOff   5          11m     100.64.0.20   0110cfe94989   <none>           <none>
>>> 

[stale]

Thanks for contributing to this issue. As it has been 90 days since the last activity, we are automatically marking is as stale. If this issue is not relevant or applicable anymore (problem has been fixed in a new version or similar), please close the issue or let us know so we can close it. On the contrary, if the issue is still relevant, there is nothing you need to do, but if you have any additional details or context which would help us when working on this issue, please include it as a comment to this issue.

[usulkies]

Any solution for this?