Add the ability to set a custom LLM URL
O
Oliver Bailey
I just need a way to set a custom URL, and set what model I want to use.
We're effectively using bedrock, however we want to be able to control credit usage on a per user basis and potentially charge those to their relevant AWS accounts, hence wanting to use a proxy.