GitHub radar
JD.com Open-Sources Real-Time AI Video Editor
JoyAI-Video-Edit, an open-source real-time video editing framework based on textual description developed by JD.com, one of the largest e-commerce and tech companies in China, achieves 30 FPS processing on 720p videos.
JoyAI-Video-Edit is a real-time video editing system built by JD.com, one of the biggest e-commerce and technology company in China. It leverages a 16 billion parameter multimodal diffusion transformer to enable real-time video editing via textual instructions. You can use this system to edit videos from a live camera stream or a video file in real time (no pre-processing needed) with various styles, objects, backgrounds etc., by manipulating the frames while playing the video. With this system, we achieve an end-to-end processing speed of 30.19 FPS on 720×1280 resolution.
Why a vibe-coder should care
Unlike classical post-processing methods, our system enables you to describe your preferences and see the video getting edited on the fly! We release our code and model weights under Apache 2.0 license so that you can run our system offline.
▌ More finds