Creating Landscape Animation using Generative AI

Our innovative approach generates high-quality ShanShui landscape images and animations. Utilizing a diffusion model and a landscape skeleton generation module, alongside techniques like Perlin noise and ControlNet, it captures ShanShui landscape features. Integration with AnimateDiff facilitates static image transformation into animations. GPT-4 enhances prompt generation, improving output quality. This framework enables flexible creation of diverse and realistic scenes and animations.

Jiangnan

BackBone Image
Colored Image

Japan

BackBone Image
Colored Image

Xian

BackBone Image
Colored Image

First Night View Example

BackBone Image
Colored Image

BackBone Image

Example Image

Image Generation

Example Image

Video Generation

More Examples

Beach

BackBone Image
Colored Image

Desert

BackBone Image
Colored Image

Hakka

BackBone Image
Colored Image

Second Night View Example

BackBone Image
Colored Image

Taiwan Opera

BackBone Image
Colored Image

ShanShui

BackBone Image
Colored Image