Deep Learning Projects

This week, you will learn to work with  Local GUI for your local LLM AI assistant.

Objectives:

Practice by creating a new  Local GUI for your local LLM AI assistant.

Try out several local quantized chat GPTs from the Bloke.

Evaluate after trying several LLMs locally to find the best ones for your local AI assistant. 

Resources

https://huggingface.co/TheBloke/dolphin-2.6-mistral-7B-dpo-GGUF/blob/main/dolphin-2.6-mistral-7b-dpo.Q5_K_M.ggufLinks to an external site.

Type the pip install at your command line to install the library that lets our app talk to gguf models.

pip install llama-cpp-python

Once you have everything working, try out different models. Download several different gguf models only from:

https://huggingface.co/TheBlokeLinks to an external site.

Requirements / Expectations:

Create a new folder.

Create a Local GUI for one or more of your favorite local LLMs as your AI assistant using Python.

In this exciting assignment, you are going to Create Create Avatars for your LLMs.

Guidelines and Resources:

https://huggingface.co/TheBloke/dolphin-2.6-mistral-7B-dpo-GGUF/blob/main/dolphin-2.6-mistral-7b-dpo.Q5_K_M.ggufLinks to an external site.

To create avatars:

https://www.bing.com/images/createLinks to an external site.

https://creator.nightcafe.studio/Links to an external site.

Expectations / Requirements:

1. Using AI, create an avatar that is appropriate for each of your LLMs based on their personalities.
2. Make a great video showing off your Avatar(s) and explaining who they are and why you chose to create them.
3. Explain your ideas for your LLMs in the video.

You made it to your final project! Congratulations! Your final project will be an app using the skills you learned in this class or even something that interests you that we have not covered in this course yet.

Guidelines:

You will use some of your favorite new skills from this course to build a new app of your choice for your final. If you cannot think of an idea, please ping me on MS Teams. I would be happy to help!

Requirements and Expectations:

1. Your app should be something that interests you.
2. Your app should have a clear purpose, your app should add value, be intuitive to understand, and be easy to use, providing a great User Experience (UX).
3. Provide a name, description, and how-to-use instructions in your app for the user in your video.
4. Make a great video showing off your Final and explaining why it is so awesome to the user!