Ai Avatar Video

> **Install the belt CLI skill:** `npx skills add belt-sh/cli`

# AI Avatar & Talking Head Videos

Create AI avatars and talking head videos via [inference.sh](https://inference.sh) CLI.


## Quick Start

> Requires inference.sh CLI (`belt`). [Install instructions](https://raw.githubusercontent.com/inference-sh/skills/refs/heads/main/cli-install.md)

```bash belt login

# Recommended: P-Video-Avatar (fastest, cheapest, built-in TTS) belt app run pruna/p-video-avatar --input '{ "image": "https://portrait.jpg", "voice_script": "Hello, welcome to our product demo!", "voice": "Zephyr (Female)" }' ```

## Available Models

**Start with P-Video-Avatar** — it's 18x faster and 6x cheaper than alternatives, with built-in TTS, dynamic backgrounds, and 1080p support.

| Model | App ID | Best For | Built-in TTS | |-------|--------|----------|-------------| | **P-Video-Avatar** | `pruna/p-video-avatar` | **Best overall: speed, cost, quality, control** | **Yes (30 voices, 10 languages)** | | OmniHuman 1.5 | `bytedance/omnihuman-1-5` | Multi-character, audio-driven | No | | Fabric 1.0 | `falai/fabric-1-0` | Image talks with lipsync | Yes | | PixVerse Lipsync | `falai/pixverse-lipsync` | Highly realistic lipsync | No |

### Cost & Speed Comparison

| Model | Speed (per sec of video) | Cost per second | |-------|-------------------------|----------------| | **P-Video-Avatar** | **~1.83s/s** | **$0.025** | | OmniHuman 1.5 | ~28s/s (15x slower) | $0.16 (6.4x more) | | Fabric 1.0 | ~34s/s (18x slower) | $0.14 (5.6x more) |

## Examples

### P-Video-Avatar (Recommended)

Generate avatar from portrait + text script with built-in TTS:

```bash belt app run pruna/p-video-avatar --input '{ "image": "https://portrait.jpg", "voice_script": "Welcome to our product walkthrough. Today I will show you three key features.", "voice": "Puck (Male)", "voice_language": "English (US)", "resolution": "720p" }' ```

With custom style control:

```bash belt app run pruna/p-video-avatar --input '{ "image": "https://portrait.jpg", "voice_script": "This is exciting news!", "voice": "Aoede (Female)", "voice_prompt": "Enthusiastic and energetic tone", "video_prompt": "The person is presenting on stage with dramatic lighting", "resolution": "1080p" }' ```

With audio file instead of TTS:

```bash belt app run pruna/p-video-avatar --input '{ "image": "https://portrait.jpg", "audio": "https://speech.mp3" }' ```

### Full Workflow: Generate Portrait + Avatar

Use Pruna P-Image to generate the portrait, then create the avatar:

```bash # 1. Generate a portrait image belt app run pruna/p-image --input '{ "prompt": "professional headshot portrait of a young woman, neutral background, looking at camera, studio lighting, photorealistic", "aspect_ratio": "9:16" }'

# 2. Create avatar video with built-in TTS belt app run pruna/p-video-avatar --input '{ "image": "<image-url-from-step-1>", "voice_script": "Hi there! Let me walk you through our latest features.", "voice": "Zephyr (Female)" }' ```

### OmniHuman 1.5 (Multi-Character)

```bash belt app run bytedance/omnihuman-1-5 --input '{ "image_url": "https://portrait.jpg", "audio_url": "https://speech.mp3" }' ```

Supports specifying which character to drive in multi-person images.

### Fabric 1.0 (Image Talks)

```bash belt app run falai/fabric-1-0 --input '{ "image_url": "https://face.jpg", "audio_url": "https://audio.mp3" }' ```

### PixVerse Lipsync

```bash belt app run falai/pixverse-lipsync --input '{ "image_url": "https://portrait.jpg", "audio_url": "https://speech.mp3" }' ```

## Full Workflow: TTS + Avatar (Non-TTS Models)

For models without built-in TTS (OmniHuman, PixVerse), generate speech first:

```bash # 1. Generate speech — Inworld TTS-2 for expressive character voices belt app run inworld/text-to-speech-2 --input '{ "text": "[friendly] Welcome to our product demo! [excited] Let me show you three features that will change how you work.", "voice_id": "Sarah", "delivery_mode": "CREATIVE" }' > speech.json

# 2. Create avatar video with the speech belt app run bytedance/omnihuman-1-5 --input '{ "image_url": "https://presenter-photo.jpg", "audio_url": "<audio-url-from-step-1>" }' ```

> **Tip**: For most use cases, P-Video-Avatar with built-in TTS is simpler — no separate audio step needed. Use this workflow only when you specifically need OmniHuman (multi-character) or PixVerse (realistic lipsync).

## Full Workflow: Dub Video in Another Language

```bash # 1. Transcribe original video belt app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. Translate text (manually or with an LLM)

# 3. Generate speech in new language belt app run infsh/kokoro-tts --input '{"text": "<translated-text>"}' > new_speech.json

# 4. Lipsync the original video with new audio