DreamActor-M1 From ByteDance

Back to products

Holistic & expressive human animation with custom controls

Website grisoon.github.io

What it is

DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance.

Intent

I need it when

Perform pose transfer and motion retargeting with shape-aware adaptation

DreamActor-M1 supports partial motion transfer (facial expressions, head movements only) and bone length adjustment techniques to adapt animations to different character shapes and poses.

Maintain temporal consistency and visual coherence in long-form human animation sequences

The framework uses complementary visual guidance and progressive training across varying resolutions to ensure long-term temporal coherence, particularly for human poses not observed in reference frames.

Create expressive facial animations with fine-grained control over expressions and head movements

The system integrates implicit facial representations and 3D head spheres to enable precise control of facial expressions, supporting audio-driven lip-sync in multiple languages and head pose direction variations.

Generate realistic human video animations from a single reference image and motion video

DreamActor-M1 uses a diffusion transformer framework with hybrid guidance to animate human subjects across multiple scales (portrait to full-body), preserving identity and temporal coherence while imitating behaviors from driving videos.

Drop

Not a fit when

User needs a commercial, production-ready SaaS product with guaranteed support and service level agreements
User requires pricing transparency and clear licensing terms before adoption
User needs real-time animation generation for live streaming or interactive applications
User lacks technical expertise to implement research code or integrate with existing pipelines
User requires animations of non-human subjects or objects

Commercials

Pricing

Pricing not specified