Video & Sound Generation Series

Applying joint video+audio generation models to real industrial-inspection X-ray imagery – what a general-purpose model can and can’t do when handed one real radiograph and asked to imagine motion and sound around it.
series
computer-vision
video-generation
audio-generation
X-ray
Author

Hasan Goni

Published

September 2, 2026

Modified

September 2, 2026

0.1 Series Overview

Every post in the Synthetic Data Series generates a single static image. Real industrial inspection is often a video problem – radioscopy scan heads and conveyors moving parts past an X-ray detector, with real ambient mechanical sound alongside the picture. This series asks whether general-purpose joint video+audio generation models, applied to that real domain, actually stay in that domain – or quietly drift back to whatever they were trained on most.

Same ethos as the rest of this blog: real code, real captured output, honest limitations reported alongside anything that works.

0.1.1 Posts in this series

  1. Part 1 – X-ray Inspection Video + Sound Generation. A real GDXray weld radiograph, LTX-2 (a real, non-gated 19B joint video+audio diffusion transformer, int4-quantized to fit real memory constraints), and a real, honest failure mode: the model holds the X-ray domain faithfully for the one real conditioning frame, then drifts into ordinary color industrial photography for the rest of the generated motion.
  2. Part 2 – Video Conditioning vs. Single-Frame Conditioning. A reader question about a real LTX-2 feature – conditioning on many real frames instead of one – tested directly against Part 1. Real, measured result: color drift drops roughly 12-30x, but content drift (X-ray texture to industrial-machinery footage) persists, and audio gets noticeably quieter. A real partial fix, not a full one.

Reuse

Citation

BibTeX citation:
@online{goni2026,
  author = {Goni, Hasan},
  title = {Video \& {Sound} {Generation} {Series}},
  date = {2026-09-02},
  langid = {en}
}
For attribution, please cite this work as:
Goni, Hasan. 2026. “Video & Sound Generation Series.” September 2.
Free email course · 7 days

Industrial Vision Foundations

AI can write the code, but someone still has to know which method fits a real inspection line. One short lesson a day for 7 days on the classical computer vision techniques that still run production systems.

Runnable code in every lesson. No spam, unsubscribe any time.

Questions, corrections or feedback?

Found a mistake, or want a topic covered next? Leave a comment below (sign in with GitHub), or write to hasanme1412@gmail.com. I read everything.