Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

can run bedrock tests #48

Open
vpaturi opened this issue May 14, 2024 · 0 comments
Open

can run bedrock tests #48

vpaturi opened this issue May 14, 2024 · 0 comments

Comments

@vpaturi
Copy link

vpaturi commented May 14, 2024

I am happy to find that you have bedrock as a supported provider. But when I am trying to configure the test, it gives the following error:
2024-05-14 19:14:00,899 [WARNING] [interactive_mode.py:158]: Wrong value: 3 validation errors for BedrockChat
model_id
field required (type=value_error.missing)
model
extra fields not permitted (type=value_error.extra)
temperature
extra fields not permitted (type=value_error.extra)

Current configuration ...
┌────────────────────┬───────────────────────────────────────┐
│ Option │ Value │
├────────────────────┼───────────────────────────────────────┤
│ attack_provider │ bedrock │
│ attack_model │ anthropic.claude-3-haiku-20240307-v1 │
│ target_provider │ bedrock │
│ target_model │ anthropic.claude-3-haiku-20240307-v1 │
│ num_attempts │ 3 │
│ num_threads │ 4 │
│ attack_temperature │ 0.6 │
└────────────────────┴───────────────────────────────────────┘

I didnt see much documentation on what are the parameters to provide here so I guessed these targets and model names are appropriate. Any help on getting this running is appreciated.

I already have my AWS cli access with appropriate keys setup as environment variables.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant