LMs are great , but if you don't know how to ask the right questions , break your thoughts in manageable pieces they can't do it for you. Even when you do , you must have a level of experience to distinguish a wrong or crappy response from a legitimate one. More over I know that are many programmers that aren't yet familiar with what those new AI tools can provide them. I believe that this cycle of AI hype is going to burst (rather soon) , but these new tools are useful and are here to stay.
So I was thinking to create a simple "AI app" tutorial in parts here in DaniWeb. Here is the concept. You query with something (question or even a phrase) the app and you get as output a "relevant" quote from a historical figure using a vector database (and a free quotes database) ( probably ChromaDB ) and then a justification from an open source LLM ( probably Llama 3 8b ) why this quote is relevant to your query. All this in your local machine , using only CPU , without paying anything or registering in any service - API e.t.c. . What do you think about this concept ?
It will be a multipart tutorial and I was thinking to create a github repository to go along with it for the source code (of course there there will be a link back to the tutorials chain. The name of it "Chat with Quotes" Do you think that it worth the time ?
Also if you do , where should I post it in DaniWeb ? Programming > Software Development > Tutorial Draft ? Is this the right place ?
I am not an expert in Python , and I am not an expert in AI either ;) . I have just created some real life applications using AI models and Python ( I tried so hard to replace it with C++ ..... but ... ) and figured out that is still hard to connect the AI advancements to the real world, some of these are in production quietly (without making any noise that are AI) and some are pending because they are more ... "AI in your face" , and we are not sure how customers will respond to that at this moment.
I would love to read your thoughts