From the course: Responsible Generative AI and Local LLMs
Unlock this course with a free trial
Join today to access over 25,000 courses taught by industry experts.
Fine-tune Mistral and Ludwig
From the course: Responsible Generative AI and Local LLMs
Fine-tune Mistral and Ludwig
- [Instructor] Let's take a look at Ludwig here, which is one of the more stealth, fine tuning tools available for large language models. A lot of people are very interested in training large language models and getting a little deeper into that whole ecosystem. And Ludwig is a good choice because it's a low code framework. If we take a look here at some of the things you can do, first up here, you can see this is a visual of the fact that you use config files, which I'm a huge fan of. And you also have some getting started guides here. For example, Fine-Tune Mistral, which is one of the hotter open source, large language models. And you can see here that it is a YAML based approach, which makes it very appealing. And then in fact, you can just train with the command line. So, it has some of the same characteristics of, let's say, a DevOps type workflow where you're able to simplify things with a YAML file. Now, let's go ahead and take a look here at a notebook in Colab Pro, which is…
Contents
-
-
Coding ELO in Python4m 7s
-
Coding ELO in Rust3m 49s
-
Coding ELO in R3m 31s
-
(Locked)
Coding ELO in Julia3m 5s
-
(Locked)
Profit sharing concepts5m 40s
-
(Locked)
Tragedy of the commons4m
-
(Locked)
Deploying LLMs with Lorax and SkyPilot3m 56s
-
(Locked)
Fine-tune Mistral and Ludwig3m 22s
-
(Locked)
Game theory in generative AI4m 45s
-
(Locked)
Perfect competition2m 45s
-
(Locked)
Negative externalities3m 23s
-
(Locked)
Regulatory entrepreneurship4m 18s
-
(Locked)
Creating reinforcement bias3m 59s
-
(Locked)
Getting started with Mozilla llamafile3m 36s
-
(Locked)
Developing cosmopolitan4m 29s
-
(Locked)
Building blocks for generative AI with whisper.cpp2m 53s
-
(Locked)
Transcribing with Whisper2m 56s
-
(Locked)
Portable phrase CLI3m 34s
-
(Locked)
Candle hello world2m 56s
-
(Locked)
Exploring StarCoder in Rust5m 54s
-
(Locked)
Whisper Candle transcriber5m 51s
-
(Locked)
Local system metrics3m 4s
-
(Locked)
Exploring remote development on AWS2m 15s
-
(Locked)
Rust for large language models (LLMs)2m
-
(Locked)
The continuous build binary2m 6s
-
(Locked)
Serverless inference1m 56s
-
(Locked)
Rust CLI inference2m 7s
-
(Locked)
Rust chat inference2m 3s
-
(Locked)
The chat loop with StarCoder2m 4s
-
(Locked)
Invoke an LLM on an AWS G5 instance, part 14m 36s
-
(Locked)
Invoke an LLM on an AWS G5 instance, part 22m 58s
-