Skip to content
This repository was archived by the owner on Sep 29, 2025. It is now read-only.

Single entry point for language model config + AI SDK standardization #873

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

Single entry point for language model config + AI SDK standardization #873

wants to merge 3 commits into from

Conversation

@mongodben
Copy link
Collaborator

@mongodben mongodben commented Aug 11, 2025 •
edited
Loading

Jira: n/a

Changes

  • Single entry point for language model config
  • AI SDK standardization
  • Use GPT-5 models

Notes

  • This does not work well b/c the GPT-5 models are reasoning models, and sometimes they generate a ton of reasoning tokens before responding. i tried setting the reasoningBudget per the vercel ai sdk docs (which are fairly sparse), but it does not appear to make a big difference or work correctly. there's others who are observing similar problems (see Azure OpenAI Does not output reasoning summary vercel/ai#6569), so i suspect there'll be a fix fairly soon. may just have to wait a bit longer to validate and move to gpt-5
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

2 participants

@mongodben