Basically this is GPT 3.5 for free but with access to local documents so it's easier. Tried a few example tests and it did pretty reasonably. What would be the point of openai with products like this running locally on edge/client? Also it seems like a pretty thin shell over top of Open Source model, kind of interesting Nvidia branding TC 600k
These small models will be limited in capability and won't be general enough.