From the course: Responsible Generative AI and Local LLMs

Unlock this course with a free trial

Join today to access over 25,000 courses taught by industry experts.

Fine-tune Mistral and Ludwig

Fine-tune Mistral and Ludwig

- [Instructor] Let's take a look at Ludwig here, which is one of the more stealth, fine tuning tools available for large language models. A lot of people are very interested in training large language models and getting a little deeper into that whole ecosystem. And Ludwig is a good choice because it's a low code framework. If we take a look here at some of the things you can do, first up here, you can see this is a visual of the fact that you use config files, which I'm a huge fan of. And you also have some getting started guides here. For example, Fine-Tune Mistral, which is one of the hotter open source, large language models. And you can see here that it is a YAML based approach, which makes it very appealing. And then in fact, you can just train with the command line. So, it has some of the same characteristics of, let's say, a DevOps type workflow where you're able to simplify things with a YAML file. Now, let's go ahead and take a look here at a notebook in Colab Pro, which is…

Contents