Minimalist AI Video Translation and Dubbing Tool

English｜简体中文｜日本語｜한국어｜Tiếng Việt｜Français｜Deutsch｜Español｜Português｜Русский｜اللغة العربية

Krillin AI is a versatile audio and video localization and enhancement solution. This minimalist yet powerful tool integrates video translation, dubbing, and voice cloning, supporting both landscape and portrait formats to ensure perfect presentation across all major platforms (Bilibili, Xiaohongshu, Douyin, WeChat Video, Kuaishou, YouTube, TikTok, etc.). With an end-to-end workflow, Krillin AI can transform raw materials into polished, ready-to-use cross-platform content with just a few clicks.

🎯 One-Click Start: No complex environment setup required, automatic dependency installation, ready to use immediately, with a new desktop version for easier use!

📥 Video Acquisition: Supports yt-dlp downloads or local file uploads

📜 Accurate Recognition: High-accuracy speech recognition based on Whisper

🧠 Intelligent Segmentation: Subtitle segmentation and alignment using LLM

🔄 Terminology Replacement: One-click replacement of specialized vocabulary

🌍 Professional Translation: LLM-based paragraph-level translation maintains semantic coherence

🎙️ Voice Cloning: Offers selected voice tones from CosyVoice or custom voice cloning

🎬 Video Composition: Automatically handles landscape and portrait video and subtitle layout

The image below shows the effect of the subtitle file generated after importing a 46-minute local video and executing it with one click, without any manual adjustments. There are no omissions or overlaps, the segmentation is natural, and the translation quality is very high.

All local models in the table below support automatic installation of executable files + model files; you just need to select, and KrillinAI will prepare everything for you.

✅ Compatible with all cloud/local large language model services that comply with OpenAI API specifications, including but not limited to:

• OpenAI
• DeepSeek
• Tongyi Qianwen
• Locally deployed open-source models
• Other API services compatible with OpenAI format

Input languages supported: Chinese, English, Japanese, German, Turkish, Korean, Russian, Malay (continuously increasing)

Translation languages supported: English, Chinese, Russian, Spanish, French, and 101 other languages

First, download the executable file that matches your device system from the Release, then follow the tutorial below to choose between the desktop version or non-desktop version, and place it in an empty folder. Download the software into an empty folder, as it will generate some directories after running, making it easier to manage.

【If it is the desktop version, i.e., the release file with "desktop", see here】
The desktop version is newly released to address the issue of novice users having difficulty correctly editing configuration files, and there are still many bugs; ongoing updates are in progress.

1. Double-click the file to start using it (the desktop version also requires configuration within the software)

【If it is the non-desktop version, i.e., the release file without "desktop", see here】
The non-desktop version is the initial version, with a more complex configuration, but stable functionality, suitable for server deployment, as it provides a UI in a web manner.

1. Create a config folder within the directory, then create a config.toml file in the config folder, copy the contents of the config-example.toml file from the source code's config directory into config.toml, and fill in your configuration information accordingly.
2. Double-click or execute the executable file in the terminal to start the service
3. Open your browser and enter http://127.0.0.1:8888 to start using it (replace 8888 with the port you filled in the configuration file)

【If it is the desktop version, i.e., the release file with "desktop", see here】
Due to signing issues, the current packaging method for the desktop version cannot be run directly by double-clicking or installed via dmg; you need to manually trust the application. The method is as follows:

1. Open the terminal in the directory where the executable file (assuming the file name is KrillinAI_1.0.0_desktop_macOS_arm64) is located
2. Execute the following commands in order:

sudo xattr -cr ./KrillinAI_1.0.0_desktop_macOS_arm64
sudo chmod +x ./KrillinAI_1.0.0_desktop_macOS_arm64 
./KrillinAI_1.0.0_desktop_macOS_arm64

【If it is the non-desktop version, i.e., the release file without "desktop", see here】
This software is not signed, so when running on macOS, after completing the file configuration in the "Basic Steps," you also need to manually trust the application. The method is as follows:

1. Open the terminal in the directory where the executable file (assuming the file name is KrillinAI_1.0.0_macOS_arm64) is located
2. Execute the following commands in order:

    sudo xattr -rd com.apple.quarantine ./KrillinAI_1.0.0_macOS_arm64
    sudo chmod +x ./KrillinAI_1.0.0_macOS_arm64
    ./KrillinAI_1.0.0_macOS_arm64
   

   This will start the service

This project supports Docker deployment; please refer to the Docker Deployment Instructions

If you encounter video download failures,

please refer to the Cookie Configuration Instructions to configure your Cookie information.

The fastest and most convenient configuration method:

• Set both transcription_provider and llm_provider to openai, so you only need to fill in openai.apikey in the three configuration categories below: openai, local_model, and aliyun for subtitle translation. (app.proxy, model, and openai.base_url can be filled in as needed)

Using a local language recognition model (not yet supported on macOS) configuration method (balancing cost, speed, and quality):

• Set transcription_provider to fasterwhisper and llm_provider to openai, so you only need to fill in openai.apikey and local_model.faster_whisper in the three configuration categories below: openai and local_model for subtitle translation, and the local model will be automatically downloaded. (app.proxy and openai.base_url as above)

For the following situations, Aliyun configuration is required:

• If llm_provider is set to aliyun, you need to use Aliyun's large model service, so you need to configure the aliyun.bailian item.
• If transcription_provider is set to aliyun, or if the "Dubbing" feature is enabled when starting a task, you need to use Aliyun's speech service, so you need to fill in the aliyun.speech item.
• If the "Dubbing" feature is enabled and you have uploaded local audio for voice cloning, you will also need to use Aliyun's OSS cloud storage service, so you need to fill in the aliyun.oss item.
  Aliyun configuration help: Aliyun Configuration Instructions

Please visit Frequently Asked Questions

1. Do not submit useless files, such as .vscode, .idea, etc.; please make good use of .gitignore to filter them out.
2. Do not submit config.toml; instead, submit config-example.toml.

1. Join our QQ group for answers to questions: 754069680
2. Follow our social media accounts, Bilibili, where we share quality content in the AI technology field every day.