Skip to main content

Video Prodution B-Roll Flow with GPT-5 and SORA-2

 After gaining access to OpenAI’s new Sora-2 video API, I rebuilt my entire B-roll workflow for The Gladych Files channel — automating prompt generation, stitching clips together, and producing cinematic sequences in minutes. In this post, I walk through the full pipeline, share lessons learned, and offer tips for anyone curious about AI-assisted video creation.

I recently took a video production for the web class at City College San Francisco. I wish I had the tools I'm going to desribe in this post available to me two weeks ago. Such is the nature of AI development speed :)

This week, I gained access ot the Sora-2 vide API through OpenAI. If you haven't heard of it, Sora-2 is an AI enabled video generator in much the same way that Dall-E is an  AI enabled image generator. The kids and I have recently started a new video channel where we're publishing videos about all things Michael Gladych

I'm jsut starting to work with AI enabled video production flows, so if you have any cool ideas, or suggetsions to make things better, please comment below. My flow looks like this

  • Write a script for the video
  • Pass that script along with other material to a GPT-5 project I've setup to help with suggestions. I have, roughly speaking, a whole book's worth of material, (that's why I started a video channel), as well as several books worth of research material on the Gladych's in gneral, and the people that Michael Gladych reported on in the world of science in specific.
  • The prompt for the project looks like this most of the time
  • "You are a YouTube videographer consultant. You specialize in fringe science and the paranormal. You're an expert who's watched every episode of the Why Files, the X Files, and Fringe. You've read works like "The Philadelphia Experiment" by William Moore and "The Roswell Incident" by Charles Berlitz. You are consulting with me on a project called the Gladych Files. I've provided you with a basic document for the first two episodes. I'll also be providing graphics."
  • OpenAI responds with ideas to perk up the scripts where it makes sense, and generally makes good B-Roll video suggestions for background and scene transitions. I then hand those suggestions to my productcion team and, ... 

Wait! What!? I have no production team!?

Oh.

Well, there's that. So, I've developed the habit of asking GPT-5 to write insructions for Sora for the B-Roll footage. For the sora-1 engine, my results were less than promising. For sora-2 though! Wow! Things are different.

First, the engine does well enough that I fee comfortable automating it using its associated API.  I ask GPT-5 to ouptut all the B-Roll descriptions in a data structure. As of this morning, I have a script, scaffolded using GPT-5, that I can paste those descriptions into. Several minutes later, I had my nine B-Roll videos. Eight of then are shown in the video below.

Programming Aside

This is the second time in a few weeks I've been reminded that the GPT chat engines, (all LLMs really), have cutoff training dates. GPT-5 was mostly guessing at how to write pythong for the Sora API. I've seen things in the code it guesses that make me think it does tend to have preliminary releases of the GPT tools in its training, it's just that things change when the libraries are released.

In any event, OpenAI did a good job of documenting the API, so I was able to grab code examples from there, then ask GPT-5 to modify those, and then tune them to do exacxtly what I want. It's still better, just not as ideal as some other programming forays I've made with GPT-5.

The documentation for the Sora API outlines how to prompt for videos, how to download thumbnails, and sprite sheets, and how to remix videos with Sora. (Remixing is a video iterating technique. You hand the API the id of a video it has already created with a prompt that asks for the video to be modified in some way. The smaller or more atomic the requested modification, the better chance you have of getting something you like. Once again, expreienced programmers might expect to have better remixing experiences than most.

As a final important note, be sure to download your generated videos within 60 minutes. That's all the longer OpenAI sgtores them for you before throwing them out.

Prompting Tips

For now, my best prompting tip is to make sure that GPT-5 knows what you're trying to accomplish, (this is ideal for me since I write my own scripts, and I've written a book on this material), and then asking it to generate good Sora prompts for you. Now that I have access to the sora-2 engine, this has worked really well.

I'd suggetstkeeping a database of prompts and the videos they generate. I'm putting together one of these for myself using Datasette. As with anything else that requires practice, reflecting on results vs. execution is crtical for improvement. 

New Channel Plug

Sora-2 dramatically changes what a solo creator can accomplish. With a well-structured workflow — script → GPT-5 ideation → automated B-roll generation → remixing and refinement — it’s now possible to produce polished video packages that previously required a small production team.

If you’re experimenting with AI video generation, or you’re just curious about WWII history, fringe science, and Michael Gladych’s extraordinary life, subscribe to our new channel, The Gladych Files. And if you’ve developed your own Sora or GPT-5 production tricks, please share them in the comments — I’d love to incorporate them into future posts.





Comments

Popular posts from this blog

Cool Math Tricks: Deriving the Divergence, (Del or Nabla) into New (Cylindrical) Coordinate Systems

Now available as a Kindle ebook for 99 cents ! Get a spiffy ebook, and fund more physics The following is a pretty lengthy procedure, but converting the divergence, (nabla, del) operator between coordinate systems comes up pretty often. While there are tables for converting between common coordinate systems , there seem to be fewer explanations of the procedure for deriving the conversion, so here goes! What do we actually want? To convert the Cartesian nabla to the nabla for another coordinate system, say… cylindrical coordinates. What we’ll need: 1. The Cartesian Nabla: 2. A set of equations relating the Cartesian coordinates to cylindrical coordinates: 3. A set of equations relating the Cartesian basis vectors to the basis vectors of the new coordinate system: How to do it: Use the chain rule for differentiation to convert the derivatives with respect to the Cartesian variables to derivatives with respect to the cylindrical variables. The chain ...

The Valentine's Day Magnetic Monopole

There's an assymetry to the form of the two Maxwell's equations shown in picture 1.  While the divergence of the electric field is proportional to the electric charge density at a given point, the divergence of the magnetic field is equal to zero.  This is typically explained in the following way.  While we know that electrons, the fundamental electric charge carriers exist, evidence seems to indicate that magnetic monopoles, the particles that would carry magnetic 'charge', either don't exist, or, the energies required to create them are so high that they are exceedingly rare.  That doesn't stop us from looking for them though! Keeping with the theme of Fairbank[1] and his academic progeny over the semester break, today's post is about the discovery of a magnetic monopole candidate event by one of the Fairbank's graduate students, Blas Cabrera[2].  Cabrera was utilizing a loop type of magnetic monopole detector.  Its operation is in...

More Cowbell! Record Production using Google Forms and Charts

First, the what : This article shows how to embed a new Google Form into any web page. To demonstrate ths, a chart and form that allow blog readers to control the recording levels of each instrument in Blue Oyster Cult's "(Don't Fear) The Reaper" is used. HTML code from the Google version of the form included on this page is shown and the parts that need to be modified are highlighted. Next, the why : Google recently released an e-mail form feature that allows users of Google Documents to create an e-mail a form that automatically places each user's input into an associated spreadsheet. As it turns out, with a little bit of work, the forms that are created by Google Docs can be embedded into any web page. Now, The Goods: Click on the instrument you want turned up, click the submit button and then refresh the page. Through the magic of Google Forms as soon as you click on submit and refresh this web page, the data chart will update immediately. Turn up the:...