Skip to content

Commit 45056e4

Browse files
author
Paweł Kędzia
committed
Merge branch 'features/lb'
2 parents 5b03698 + 4603e5e commit 45056e4

File tree

2 files changed

+438
-347
lines changed

2 files changed

+438
-347
lines changed

CHANGELOG.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,4 +11,4 @@
1111
| 0.2.0 | Add balancing strategies: `balanced`, `weighted`, `dynamic_weighted` and `first_available` which works for streaming and non streaming requests. Included Prometheus metrics logging via `/metrics` endpoint. First stage of `llm_router_lib` library, to simply usage of `llm-router-api`. |
1212
| 0.2.1 | Fix stream: OpenAI->Ollama, Ollama->OpenAI. Add Redis caching of availability of model providers (when using `first_available` strategy). Add `llm_router_web` module with simple flask-based frontend to manage llm-router config files. |
1313
| 0.2.2 | Update dockerfile and requirements. Fix routing with vLLM. |
14-
| 0.2.3 | New web configurator: Handling projects, configs for each user separately. |
14+
| 0.2.3 | New web configurator: Handling projects, configs for each user separately. First Available strategy is more powerful, a lot of improvements to efficiency. |

0 commit comments

Comments
 (0)