Detected ES 8.x or above: document type will not be used

[harish2497]

Problem

I am using the latest version of fluentd, fluent-plugin-elasticsearch and ES (8.14.0). I see the below error for all the logs

[debug]: #0 Detected ES 8.x or above: document type will not be used.

Please help as I couldn't find the solution yet for this

Steps to replicate

Upgrade to 8.14.0 failed

Provide example config and message

Expected Behavior or What you need to ask

... It should parse the logs and send to elasticsearch

Using Fluentd and ES plugin versions

• OS version - Latest Debain
• Bare Metal or within Docker or Kubernetes or others? Kubernetes
• Fluentd v0.12 or v0.14/v1.0 - fluentd 1.17.0
• ES plugin 3.x.y/2.x.y or 1.x.y -
  NFO[0039] Running: [/bin/sh -c fluent-gem list]
  abbrev (default: 0.1.1)
  addressable (2.8.7)
  async (1.31.0)
  async-http (0.60.2)
  async-io (1.43.2)
  async-pool (0.6.1)
  base64 (0.2.0, default: 0.1.1)
  benchmark (default: 0.2.1)
  bigdecimal (default: 3.1.3)
  bundler (default: 2.4.19)
  cgi (default: 0.3.6)
  concurrent-ruby (1.3.3, 1.3.1)
  console (1.25.2)
  cool.io (1.8.1)
  csv (default: 3.2.6)
  date (default: 3.3.3)
  debug (1.7.1)
  delegate (default: 0.3.0)
  did_you_mean (default: 1.6.3)
  digest (default: 3.1.1)
  domain_name (0.6.20240107)
  drb (2.2.1, default: 2.1.1)
  elastic-transport (8.3.2)
  elasticsearch (8.14.0)
  elasticsearch-api (8.14.0)
  english (default: 0.7.2)
  erb (default: 4.0.2)
  error_highlight (default: 0.5.1)
  etc (default: 1.4.2)
  excon (0.110.0)
  faraday (2.9.2)
  faraday-excon (2.1.0)
  faraday-net_http (3.1.0)
  fcntl (default: 1.0.2)
  ffi (1.17.0 x86_64-linux-gnu)
  ffi-compiler (1.3.2)
  fiber-annotation (0.2.0)
  fiber-local (1.1.0)
  fiber-storage (0.1.1)
  fiddle (default: 1.1.1)
  fileutils (default: 1.7.0)
  find (default: 0.1.1)
  fluent-plugin-elasticsearch (5.4.3)
  fluent-plugin-grafana-loki (1.2.20)
  fluent-plugin-kubernetes_metadata_filter (3.5.0)
  fluent-plugin-multi-format-parser (1.1.0)
  fluentd (1.17.0)
  forwardable (default: 1.3.3)
  getoptlong (default: 0.2.0)
  http (5.2.0)
  http-accept (1.7.0)
  http-cookie (1.0.6)
  http-form_data (2.3.0)
  http_parser.rb (0.8.0)
  io-console (default: 0.6.0)
  io-nonblock (default: 0.2.0)
  io-wait (default: 0.3.0)
  ipaddr (default: 1.2.5)
  irb (default: 1.6.2)
  json (2.6.3)
  jsonpath (1.1.5)
  kubeclient (4.12.0)
  llhttp-ffi (0.5.0)
  logger (default: 1.5.3)
  lru_redux (1.1.0)
  matrix (0.4.2)
  mime-types (3.5.2)
  mime-types-data (3.2024.0604)
  minitest (5.16.3)
  msgpack (1.7.2)
  multi_json (1.15.0)
  mutex_m (default: 0.1.2)
  net-ftp (0.2.1)
  net-http (default: 0.4.1)
  net-imap (0.3.4.1)
  net-pop (0.1.2)
  net-protocol (default: 0.2.1)
  net-smtp (0.3.4)
  netrc (0.11.0)
  nio4r (2.7.3)
  nkf (default: 0.1.2)
  observer (default: 0.1.1)
  oj (3.16.1)
  open-uri (default: 0.3.0)
  open3 (default: 0.1.2)
  openssl (default: 3.1.0)
  optparse (default: 0.3.1)
  ostruct (default: 0.5.5)
  pathname (default: 0.2.1)
  power_assert (2.0.3)
  pp (default: 0.4.0)
  prettyprint (default: 0.1.1)
  prime (0.1.2)
  protocol-hpack (1.4.3)
  protocol-http (0.24.7)
  protocol-http1 (0.15.1)
  protocol-http2 (0.15.1)
  pstore (default: 0.1.2)
  psych (default: 5.0.1)
  public_suffix (6.0.0)
  racc (default: 1.6.2)
  rake (13.2.1, 13.0.6)
  rbs (2.8.2)
  rdoc (default: 6.5.1.1)
  readline (default: 0.0.3)
  readline-ext (default: 0.1.5)
  recursive-open-struct (1.2.2)
  reline (default: 0.3.2)
  resolv (default: 0.2.2)
  resolv-replace (default: 0.1.1)
  rest-client (2.1.0)
  rexml (3.2.6, 3.2.5)
  rinda (default: 0.1.1)
  rss (0.2.9)
  ruby2_keywords (default: 0.0.5)
  securerandom (default: 0.2.2)
  serverengine (2.3.2)
  set (default: 1.0.3)
  shellwords (default: 0.1.0)
  sigdump (0.2.5)
  singleton (default: 0.1.1)
  stringio (default: 3.0.4)
  strptime (0.2.5)
  strscan (default: 3.0.5)
  syntax_suggest (default: 1.1.0)
  syslog (default: 0.1.1)
  tempfile (default: 0.1.3)
  test-unit (3.5.7)
  time (default: 0.2.2)
  timeout (default: 0.3.1)
  timers (4.3.5)
  tmpdir (default: 0.1.3)
  traces (0.11.1)
  tsort (default: 0.1.1)
  typeprof (0.21.3)
  tzinfo (2.0.6)
  tzinfo-data (1.2024.1)
  un (default: 0.2.1)
  uri (default: 0.12.2)
  weakref (default: 0.1.2)
  webrick (1.8.1)
  yajl-ruby (1.4.3)
  yaml (default: 0.2.1)
  zlib (default: 3.0.0)
• ES version (optional) - 8.14.0
• ES template(s) (optional)

[cosmo0920]

[debug]: #0 Detected ES 8.x or above: document type will not be used.

This is debug level log message. So, increasing info or warn or higher log level would be better to use.