UPDATE: As of Nov 11-20-2024, I wrote a guide for a local LLM GenAI GPT Chatbot Android app over here.
UPDATE: As of Oct 10-12-2024, I have presented an end-to-end, FREE & local GenAI GPT app solution. Check it out & lmk if it works for you! Thank you for stopping by! 👋🏾
You can learn more about generative pre-trained transformers from this research paper.
You can learn about quantization of GPTs or GPT-Q from this research paper.
Also there's this blog post.👇🏾
The image above came from here.