Invalid Metric Names with JDK 11?

[Rapierian]

We recently upgraded to JDK 11 and I'm noticing that the various CodeHeap metrics now have an ' in the name, and so the otel agent is complaining when it instantiates the metrics instruments, i.e.:
[otel.javaagent 2024-03-11 18:06:53:001 +0000] [main] WARN io.opentelemetry.sdk.metrics.SdkMeter - Instrument name "memory.pools.CodeHeap-'non-profiled-nmethods'.usage" is invalid, returning noop instrument. Instrument names must consist of 63 or fewer characters including alphanumeric, _, ., -, and start with a letter. --

I can't be the first person to encounter this, but I'm not seeing a solution anywhere for all of these warnings. What's the method for dealing with these invalid instrument names?

[jkwatson]

What's generating the metrics?

[Rapierian]

I think this is just a jvm metric that we're getting from auto-instrumentation. We do have these flags enabled so it could be one of these, however:

` ``OTEL_INSTRUMENTATION_AKKA_ACTOR_ENABLED: "true"
OTEL_INSTRUMENTATION_AKKA_HTTP_ENABLED: "true"
OTEL_INSTRUMENTATION_APACHE_HTTPASYNCCLIENT_ENABLED: "true"
OTEL_INSTRUMENTATION_AWS_SDK_ENABLED: "true"
OTEL_INSTRUMENTATION_DROPWIZARD_METRICS_ENABLED: "true"
OTEL_INSTRUMENTATION_GUAVA_ENABLED: "true"
OTEL_INSTRUMENTATION_HIKARICP_ENABLED: "true"
OTEL_INSTRUMENTATION_JDBC_ENABLED: "true"
OTEL_INSTRUMENTATION_NETTY_ENABLED: "true"
OTEL_INSTRUMENTATION_PLAY_ENABLED: "true"
OTEL_INSTRUMENTATION_PLAY_WS_ENABLED: "true"
OTEL_INSTRUMENTATION_SCALA_FORK_JOIN_ENABLED: "true"```

[jack-berg]

Can you tell me more about your setup? What libraries / frameworks are you using? What version of the otel java agent?

The metric you're describing doesn't come from the standard JVM runtime metrics that the otel java agent provides. It may be coming from some instrumentation built directly into one of the libraries you depend on?

[Rapierian]

Hmm, that's interesting - because "CodeHeap 'non-profiled nmethods'" IS a JVM metric, it looks like it was added as of JDK 9 and gets enabled/disabled on these flags.

So I'm guessing one of the flags I've got above - probably the Dropwizard Metrics one - is taking that JVM metric and these similar ones with ' and exposing them. Let me see if I can figure out which flag exposes that metric...