HappyHorse Video Models

HappyHorse Video Models, created by Alibaba Group, are video generation and editing models. This skill integrates with HappyHorse Model APIs on ModelStudio (Bailian-Alibaba Model Service Platform).

Model Overview

Text to Video Generation (happyhorse-1.0-t2v)

Generate videos from text prompts.

text2video task-submit

python3 {baseDir}/scripts/happyhorse-magic.py text2video-gen --prompt "一座由硬纸板和瓶盖搭建的微型城市，在夜晚焕发出生机" --resolution "720P" --ratio "16:9" --duration 5
python3 {baseDir}/scripts/happyhorse-magic.py text2video-gen --prompt "一只可爱的小猫将军站在悬崖上，远处是壮丽的雪山" --resolution "1080P" --ratio "16:9" --duration 10
python3 {baseDir}/scripts/happyhorse-magic.py text2video-gen --prompt "海浪拍打岩石的慢镜头" --resolution "720P" --ratio "9:16" --duration 8 --no-watermark

Options

• --prompt: Text prompt for video generation (required, max 5000 non-Chinese chars or 2500 Chinese chars)
• --resolution: Video resolution - 720P or 1080P (default: 1080P)
• --ratio: Aspect ratio - 16:9, 9:16, 1:1, 4:3, 3:4 (default: 16:9)
• --duration: Video duration in seconds, 3-15 (default: 5)
• --no-watermark: Disable "Happy Horse" watermark (default: enabled)
• --seed: Random seed for reproducibility [0, 2147483647]

text2video tasks-get (round-robin)

python3 {baseDir}/scripts/happyhorse-magic.py text2video-get --task-id "<TASK_ID_FROM_VIDEO_GEN>"

Image to Video Generation (happyhorse-1.0-i2v)

Generate video from a first-frame image. Output aspect ratio automatically follows the input image.

First-frame to Video

python3 {baseDir}/scripts/happyhorse-magic.py image2video-gen --prompt "一只猫在草地上奔跑" --first-frame "https://example.com/cat.png" --resolution "720P" --duration 5
python3 {baseDir}/scripts/happyhorse-magic.py image2video-gen --first-frame "https://example.com/landscape.jpg" --resolution "1080P" --duration 10
python3 {baseDir}/scripts/happyhorse-magic.py image2video-gen --prompt "花朵缓缓绽放" --first-frame "https://example.com/flower.png" --duration 8 --no-watermark

Options

• --prompt: Text prompt for video generation (optional but recommended)
• --first-frame: First frame image URL (required). Format: JPEG/JPG/PNG/WEBP, min 300px per side, max 10MB.
• --resolution: Video resolution - 720P or 1080P (default: 1080P). Output ratio follows input image.
• --duration: Video duration in seconds, 3-15 (default: 5)
• --no-watermark: Disable "Happy Horse" watermark (default: enabled)
• --seed: Random seed for reproducibility [0, 2147483647]

Note: There is no --ratio parameter. The output video aspect ratio automatically follows the input first-frame image.

image2video tasks-get (round-robin)

python3 {baseDir}/scripts/happyhorse-magic.py image2video-get --task-id "<TASK_ID_FROM_VIDEO_GEN>"

Reference to Video Generation (happyhorse-1.0-r2v)

Generate video from reference images as character/object sources. Use "character1", "character2", etc. in the prompt to reference images by their array order.

Multi-character Reference

python3 {baseDir}/scripts/happyhorse-magic.py reference2video-gen --prompt "身着红色旗袍的女性character1，镜头以侧面中景勾勒旗袍修身剪裁" --reference-images "https://example.com/girl.jpg" --resolution "720P" --ratio "16:9" --duration 5
python3 {baseDir}/scripts/happyhorse-magic.py reference2video-gen --prompt "身着红色旗袍的女性character1，轻抬玉手展开折扇character2时流苏耳坠character3随头部转动轻盈摆动" --reference-images "https://example.com/girl.jpg" "https://example.com/fan.jpg" "https://example.com/earrings.jpg" --resolution "720P" --ratio "16:9" --duration 5
python3 {baseDir}/scripts/happyhorse-magic.py reference2video-gen --prompt "character1在海边散步，阳光洒在沙滩上" --reference-images "https://example.com/person.png" --resolution "1080P" --ratio "16:9" --duration 10

Options

• --prompt: Text prompt with character references (required, max 5000 non-Chinese chars). Use "character1/character2/..." to reference images in array order.
• --reference-images: Reference image URLs (required, 1-9 images). The 1st image = character1, 2nd = character2, etc.
• --resolution: Video resolution - 720P or 1080P (default: 1080P)
• --ratio: Aspect ratio - 16:9, 9:16, 1:1, 4:3, 3:4 (default: 16:9)
• --duration: Video duration in seconds, 3-15 (default: 5)
• --no-watermark: Disable "Happy Horse" watermark (default: enabled)
• --seed: Random seed for reproducibility [0, 2147483647]

Note: Reference images should have short side >= 400px. Avoid low-resolution, blurry, or heavily compressed images.

reference2video tasks-get (round-robin)

python3 {baseDir}/scripts/happyhorse-magic.py reference2video-get --task-id "<TASK_ID_FROM_VIDEO_GEN>"

Video Editing (happyhorse-1.0-video-edit)

Edit existing videos with text instructions and optional reference images. Supports style transfer, local replacement, and other editing tasks.

Instruction-based Editing

python3 {baseDir}/scripts/happyhorse-magic.py video-edit --prompt "将场景变成夜晚，添加霓虹灯效果" --video "https://example.com/video.mp4" --resolution "720P"
python3 {baseDir}/scripts/happyhorse-magic.py video-edit --prompt "为人物换上酷闪的衣服" --video "https://example.com/original.mp4"

Reference Image-based Editing

python3 {baseDir}/scripts/happyhorse-magic.py video-edit --prompt "让视频中的角色穿上图片中的条纹毛衣" --video "https://example.com/video.mp4" --reference-images "https://example.com/clothes.webp"
python3 {baseDir}/scripts/happyhorse-magic.py video-edit --prompt "将背景替换为参考图中的场景" --video "https://example.com/video.mp4" --reference-images "https://example.com/bg.jpg" --resolution "720P"

Options

• --prompt: Editing instruction (required, max 5000 non-Chinese chars)
• --video: Input video URL to edit (required, mp4/mov, 3-60s input, output max 15s)
• --reference-images: Reference image URLs for editing (optional, 0-5 images)
• --resolution: Output resolution - 720P or 1080P (default: 1080P)
• --audio-setting: Audio handling - auto (default) or origin (keep original audio)
• --no-watermark: Disable "Happy Horse" watermark (default: enabled)
• --seed: Random seed for reproducibility [0, 2147483647]

Note: Output aspect ratio and duration follow the input video. No --ratio or --duration parameters. If input video > 15s, system auto-truncates to first 15s.

video-edit tasks-get (round-robin)

python3 {baseDir}/scripts/happyhorse-magic.py video-edit-get --task-id "<TASK_ID_FROM_VIDEO_EDIT>"

Key Differences from Wan 2.7

Important Notes

• Task ID Validity: Task IDs are valid for 24 hours
• Video URL Validity: Generated video URLs are valid for 24 hours, download immediately
• Content Review: Both input and output are subject to content safety review
• Billing: Based on resolution (1080P > 720P) × duration (seconds)
• Watermark: Default enabled with "Happy Horse" text; use --no-watermark to disable