LLM selection
m
mansona
AI space is every evolving. Would love to have more insight into what LLM is currently being used. Also what emedding model is being used on the inference side as well. What's good today may not be good tomorrow. Are you all using open ai? I'd love the option of using open router even. or better yet give folks a discounted rate, but let them use their own API key.
Log In
a
acannon37
I think that this feature should be a must in the next update. Most, if not all, LLM based tools provide the option of selecting from a menu of top models.
I've found this feature helpful because I can use the model that might perform best for either the specific material at hand or intended task.