Conversation
| The latest updates on your projects. Learn more about Vercel for GitHub.
|
Greptile SummaryThis PR registers four new AWS Bedrock models —
Confidence Score: 4/5Safe to merge after confirming the correct AWS model ID for writer.palmyra-vision-7b; all other additions are well-structured and low-risk. The PR is a pure JSON data change — no runtime logic is altered. The only actionable concern is whether model_prices_and_context_window.json and litellm/model_prices_and_context_window_backup.json — verify the writer.palmyra-vision-7b key name against the actual AWS model ID |
| Filename | Overview |
|---|---|
| model_prices_and_context_window.json | Adds global and per-region pricing entries for 4 new Bedrock models (writer.palmyra-vision-7b, minimax.minimax-m2.5, nvidia.nemotron-super-3-120b, zai.glm-5); includes trivial supported_regions formatting changes; potential key name mismatch for the writer model |
| litellm/model_prices_and_context_window_backup.json | Mirrors main JSON additions exactly — same four new models added across same regions; inherits the same potential writer model key-name issue |
Flowchart
%%{init: {'theme': 'neutral'}}%% flowchart TD User["User calls bedrock/model"] --> Lookup["litellm model_info lookup\nin model_prices_and_context_window.json"] Lookup --> RegionKey["Try bedrock/region/model_id\ne.g. bedrock/us-east-1/minimax.minimax-m2.5"] Lookup --> GlobalKey["Fallback: try model_id\ne.g. minimax.minimax-m2.5\n(bedrock_converse provider)"] RegionKey --> Hit1["Region-specific pricing\n+ supports_service_tier"] GlobalKey --> Hit2["Default pricing\n(us-east-1 rates used)"] RegionKey -- not found --> GlobalKey subgraph NewModels["New models added in this PR"] M1["writer.palmyra-vision-7b\nglobal only · bedrock_converse\nsupports_vision: true"] M2["minimax.minimax-m2.5\n11 regions + global"] M3["nvidia.nemotron-super-3-120b\n11 regions + global"] M4["zai.glm-5\n10 regions + global\n(intentionally absent from 3 EU regions)"] end Reviews (3): Last reviewed commit: "Fix Palmyra model ID" | Re-trigger Greptile
Adds support for AWS Bedrock:
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/test_litellm/directory, Adding at least 1 test is a hard requirement - see detailsmake test-unit@greptileaiand received a Confidence Score of at least 4/5 before requesting a maintainer reviewDelays in PR merge?
If you're seeing a delay in your PR being merged, ping the LiteLLM Team on Slack (#pr-review).
CI (LiteLLM team)
Branch creation CI run
Link:
CI run for the last commit
Link:
Merge / cherry-pick CI run
Links:
Type
🆕 New Feature