LLM selection
m
mansona
AI space is every evolving. Would love to have more insight into what LLM is currently being used. Also what emedding model is being used on the inference side as well. What's good today may not be good tomorrow. Are you all using open ai? I'd love the option of using open router even. or better yet give folks a discounted rate, but let them use their own API key.
Log In
Sankari Nair
Merged in a post:
OpenRouter Integration
s
spambooger56
In my view, the biggest drawback of the Recall system is being limited to only one LLM model when there are so many advanced models available through an OpenRouter API. I use Novelcrafter with OpenRouter integration and it works seamlessly. There are many ways to utilize a personal Recall database. Recall users would benefit immensely by having the option to choose the best models for specific use cases.
S
Stefanos Chrysanthakopoulos
Also, have the ability to regenerate summaries/content with different LLMs.
Again, you may want to generate content with 2 LLMs and compare either at once ot manually.
Lots of space here to improvise and check as LLMs constantly improve/change.
a
acannon37
I think that this feature should be a must in the next update. Most, if not all, LLM based tools provide the option of selecting from a menu of top models.
I've found this feature helpful because I can use the model that might perform best for either the specific material at hand or intended task.