Member Avatar for Tzanko

Hi all,
My team and I is making an open-source library for running AI models on the phone. We are planning to create a very simple SDK which will allow you to download a model and use it on your phone. We plan to release an initial version in a month. Our library is based on llama.cpp and whisper.cpp.

We are looking for app developers who want to build mobile apps with this functionality in order to understand their needs better. Have in mind that models will be running slower on the phone than they can run on a laptop. We want to understand what uses this library could have.
If anyone is planning to build a mobile AI app, please let me know.

  • 3 Contributors
  • 2 Replies
  • 172 Views
  • 4 Months Discussion Span
  • Latest Post Latest Post by Emily Johnson
Member Avatar for Dani

That sounds really interesting. Did you ever launch the SDK?

I am a bit in the same boat as you as DaniWeb Connect has an API but I have been really struggling getting it adopted. Sorry I can't be more help to you directly.

Member Avatar for Emily Johnson

That sounds like an exciting project! An open-source library for running AI models on mobile devices could be incredibly useful for developers looking to integrate AI-driven features. While performance limitations exist, optimizing for real-time or lightweight tasks could open up many possibilities. I’d love to learn more about your SDK and its potential use cases. Have you considered applications like voice assistants, real-time transcription, or offline AI processing? Looking forward to seeing the initial release

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.