Fluentd worker threads ruby processes startup exhausting entire CPU causing other application crash

[deepaksb2]

In my use case I allocated 11 worker threads to monitor the multiple log files, windows events , syslogs etc.

My linux VM has 2 CPU cores with 8GB RAM, and there is one application running which log file/s i have to tail, that application CPU consumption is between 3 to 15% max.

At the time of td-agent startup all worker threads ruby processes are launched in parallel.
Each ruby process takes around 15-20% CPU for fraction of seconds, since all worker threads ruby processes launch at same time it occupies almost entire CPU cycle close to 200% at some point of time, and due to that the existing running applications are crashing.
I am getting below error in /var/log/messages

systemd: abcexampleApp.service: main process exited, code=killed, status=9/KILL

Is there any settings/parameter in fluentd/td-agent configuration to handle this problem or any settings to launch the worker thread process in sequentially (one by one)?

• Fluentd version: 1.16.3
• TD Agent version: 0.17.1
• Operating system: RHEL 8 or any linux OS

Any help would be greatly appreciated.

Thanks in advance.