A short film by Chris Beach

In case anyone reads this on Hacker News, firstly allow me to apologise for the inconsistent gravity, and the consistency errors in general throughout the video! I hope you can forgive me and that you enjoy the film anyway :-)

Creating this film was a surprisingly profound experience for me. I am aphantasic and cannot visualise things in my mind. So it's an emotional rollercoater seeing my ideas come to life visually like this. I teared up when I saw the video come together.

How it was made

Every shot in the film was generated by AI on my home PC with an NVIDIA RTX 5090. I made the ships using an image generation model, Krea2, and supplied some reference photos of my family. A local model did the rest.

The model

The video model is MiniMax H3, run locally in its reference-to-video mode (REF2VA). Rather than starting from a text prompt alone, each shot is built from a set of reference pictures: photos of the family, plus images of the spaceship, the cockpit, the cabin, the spacesuit and Freddie's toy giraffe. The prompt then says which picture is which subject, for example "Subject 1 is the 7 year old boy in Pictures 1, 2 and 3", and describes the action shot by shot. The model keeps those people and objects recognisable across the whole clip. Aside from learning the AI tech, this was also an education in Hollywood terminology e.g. "the camera trucks right, pedestal down at low amplitude," as this is the language Minimax is trained to accept.

The MiniMax H3 Director node in ComfyUI, with four reference pictures and a structured prompt
The MiniMax H3 Director in ComfyUI: four reference pictures (the boy, the spacesuit and spaceship) and the structured prompt that assigns them to subjects and describes each shot. Click to zoom.

The workflow

Electricity

Generating the whole film, including every take I threw away, took about 32 hours of rendering and roughly 23.5 kWh of electricity (about 0.1 kWh per take). The house has solar panels and a battery, and I'm on Intelligent Octopus (30p peak, 7p off-peak per kWh), so the cost depends on where each minute's power came from:

SourcekWhCost
Grid (almost all at the 30p peak rate)15.0£4.49
Solar that would otherwise have been exported4.1£0.61
Home battery (refilled at the 7p off-peak rate)4.4£0.34
Total23.5≈ £5.44

Estimated from the PC's measured GPU and CPU power plus an allowance for the rest of the machine, matched minute by minute against the house's solar, battery and tariff data.

The edit

The clips were cut together in DaVinci Resolve Studio on a 48 fps timeline and set to music: Snowfall by Øneheart and reidenshi.

The DaVinci Resolve Studio timeline, with the generated clips on three video tracks above the music
The edit in DaVinci Resolve Studio: the generated clips on three video tracks, with the music underneath. Click to zoom, then click again to see it at full size.

Tools