Generative AI for filmmakers:
From Text Prompt to the Edit Bay
AGC 1 (30 hours) | September 16 – November 18, 2026
turn complex AI tools
into intuitive filmmaking techniques for creators
of all levels.
Start with an intuitive, visual tour of today’s AI capabilities—from storyboarding to full-scene composition—while
demystifying concepts like diffusion models and latent space in filmmaker-friendly terms.
Course Format
Duration: 10 sessions / 30 hours
Days/Times: Thursday Sept 16, 7pm EST
Language of Instruction: English
Delivery: Live virtual instruction
WHAT YOU’LL LEARN
Learn to start using tools like ComfyUI and ControlNet, you’ll learn how to craft cinematic visuals from simple prompts and direct AI as a trusted creative collaborator.
Career Paths
AI-Assisted Filmmaker, Creative Technologist, Previsualization Artist, Virtual Production Designer, AI-Augmented Editor, Generative Content Creator
Practical course for…
SKILLS YOU’LL GAIN
Recommended Knowledge
No coding experience required — just bring your storytelling instincts and curiosity. Basic computer literacy (e.g., navigating files, installing applications) is expected. A passion for film, animation, or creative technology is a definite plus.
SOFTWARE & HARDWARE REQUIREMENTS
This course uses Virtual Machines and AI workflows in the Comfy Cloud. You will need a 3-month subscription to Comfy’s Standard Monthly Plan.
Virtual Machines (VM’s) provided by York U’s Cloud-Based Learning & Instruction Pipeline (CLIP). Sign up instructions for a cloud account on Spark Cloud Studio will be provided after you enrol in the course.
Tuition costs:
Earlybird pricing (until August 16) – $640 + $83.20 (HST) CDN
Regular pricing – $800.00 + $104 (HST) CDN
week 1:
Real-time snapshot of generative AI, covering what’s possible, emerging trends, and what might be overhyped. It introduces core concepts like diffusion models and latent space, explaining how they apply to visual storytelling.
The State of the Art & Big Picture Concepts
week 2:
Current state-of-the-art pipeline for professional video production. Topics include prompting, CLIP, VAEs, latent space, prompt engineering, and basic image editing using multimodal large language models.
From prompt to image to video to DI-ready asset
week 3:
Deep dive into ComfyUI, covering installation techniques, adding models and nodes, using template workflows, and alternatives for low-RAM GPUs.
Deep dive into ComfyUI
week 4:
ControlNet and other methods for guiding composition and action, including how ControlNet works, Canny and Depth maps, first/last frame guidance, prompt guidance, and LoRA guidance.
ControlNet and other ways to guide composition and action
week 5:
All things audio, including synthetic voices, automated Foley, soundbeds, lip-sync methods, and dialogue.
All things Audio
week 6:
Introduces other useful tools such as Pinokio Clarity, faceFusion, Expression Editor, Vid2Pose, and more.
Other cool tools
week 7:
Prepping for digital intermediate (DI) work, including using Topaz Labs for upscaling, retiming, HDR conversion, and techniques for provoking positive hallucinations by going smaller.
Prepping for DI
week 8:
LoRA training, explaining what a LoRA is, how to use LoRAs for character consistency and special effects, and how to train a LoRA both locally and in the cloud.
LoRA training
week 9:
Leveraging AI-based modeling for fast scene blocking using tools like Hunyuan 3D 2.1 and Meshy, assembling scenes in 3D, and applying LoRAs to low-resolution renders to create final image-to-video start and end frames.
Leveraging AI-based modeling for fast scene blocking
week 10:
Dedicated to final project submission and showcase, including project reviews and a discussion on the future of jobs in the industry.
Final Project Submission and Showcase
explore foundational lighting theory, light typologies, shader interactions & advanced rendering techniques within Houdini’s USD pipeline.
AI Generated Content (AGC) for Filmmakers is a 10-week, project-based course for directors, editors, writers, and producers ready to harness AI to streamline and elevate their creative workflows.
You’ll also work with synthetic audio, automated foley, lip-syncing, and visual consistency through custom-trained LoRA models. Practical workflows for prepping assets—color grading, upscaling, and final delivery—are covered in detail. You’ll explore 3D blocking tools for rapid previsualization and learn to guide AI as you would actors, editors, or DPs. By the end, you’ll complete a personal project with your own production-ready video clips—proof of your new creative capabilities.
Instructor spotlight
Damian Allen
Damian Allen is the Founder of Pixerati LLC and the CEO of TumplePlay. As a visual effects artist, Allen remains immersed in the process of visual effects work, supervising teams of up to 30 compositors, as well as having direct hands-on shots in tentpole features. He specializes in picture lock emergencies and is frequently called in to fix last minute stereoscopic and cosmetic issues.
meet Damian Allen
Certificate & Stackable Micro-Credentials
AI-Generated Content (AGC) is a cutting-edge training program that empowers filmmakers, animators, editors, and producers to harness the power of artificial intelligence as a creative partner—whether you’re generating visuals from prompts or coding smart tools to streamline your workflow.
Micro-Credentials
Earn a recognized micro-credential for each course you complete—ideal for upskilling in AI-assisted creative production and automation.
Flexible Entry
Take one course or complete the full sequence. Whether you’re building AI-generated visuals or coding smarter pipelines, this program adapts to your creative goals.