How can we use Bedrock Application Inference Profiles?

[mknet3]

Hi! is there a way to use Bedrock Application Inference Profiles ?

I checked Cross-Region Inference profile and it works fine with something like this:

      - model_name: anthropic-claude-3-7-sonnet
        litellm_params:
          model: bedrock/us.anthropic.claude-3-7-sonnet-20250219-v1:0
          aws_region_name: us-east-1

But, what about an application inference profile? I tested in many ways but I could not make it work. E.g.:

      - model_name: anthropic-claude-3-7-sonnet
        litellm_params:
          model: bedrock/arn:aws:bedrock:us-east-1:000000000000:application-inference-profile/0z0z0z0z0z0
          aws_region_name: us-east-1

also with this:

      - model_name: anthropic-claude-3-7-sonnet
        litellm_params:
          model: bedrock/anthropic/arn:aws:bedrock:us-east-1:000000000000:application-inference-profile/0z0z0z0z0z0
          model_id: bedrock/arn:aws:bedrock:us-east-1:000000000000:application-inference-profile/0z0z0z0z0z0
          aws_region_name: us-east-1

Application Inference Profiles are a strong requirement in AWS if you want to know usage / costs per application.

Any idea how to configure it? 🙏

[krrishdholakia]

maybe relevant to @mirodrr2's issue

[mknet3]

Just to link it here -> #8911
I think it is close related, I will look into the issue! Thanks!!