VFX AI Specialist

Job Title: VFX AI Specialist (Technical Director / Artist)Role Overview
We are seeking a forward-thinking VFX AI Specialist to spearhead the integration of machine learning and generative artificial intelligence into our production pipeline. In this role, you will bridge the gap between traditional VFX and next-generation AI workflows. You will be responsible for creating consistent multi-shot sequences, deploying AI-driven compositing tools, training custom character/environment models, and streamlining complex visual effects processes.
The ideal candidate possesses a deep foundation in classical VFX (compositing, 3D tracking, or look development) combined with production-level mastery of video/image generative models and machine learning pipelines.
Key Responsibilities
Pipeline Integration: Design, test, and deploy AI tools into existing studio pipelines (e.g., Foundry Nuke, SideFX Houdini, Unreal Engine, Autodesk Maya).
Asset & Character Continuity: Develop and maintain strict visual continuity for characters, clothing, and complex environmental assets across multi-angle sequences using custom checkpoints, LoRAs, and embedding models.
AI-Driven Compositing & Roto: Utilize machine learning tools (like Nuke's CopyCat or custom trained models) for advanced rotoscoping, smart paint/plate cleanups, digital makeup, and tracking automation.
3D-to-AI Hybrid Workflows: Set up ControlNet and Video-to-Video architectures that convert low-fidelity 3D blocking meshes and depth passes from Blender/Maya into photorealistic cinematic elements and chaotic VFX (smoke, energy, explosions).
Model Training & Fine-Tuning: Train, fine-tune, and optimize custom models on proprietary studio assets while maintaining ethical data practices and data security protocols.
R&D and Prototyping: Stay ahead of the curve by continuous testing of emerging AI video models (e.g., Runway, Kling, Luma, Sora, and open-source models like Stable Diffusion/ComfyUI architectures) to identify production-ready capabilities.
Cross-Department Collaboration: Partner with traditional VFX Supervisors, Technical Directors, and Animators to educate the team on AI constraints and translate artistic vision into precise prompt engineering and structural nodes.
Required Skills & Qualifications
VFX Industry Experience: 3+ years of experience working inside a professional VFX, gaming, or animation studio pipeline.
Advanced AI Architecture: Mastery of node-based AI interfaces like ComfyUI or Automatic1111, with deep knowledge of ControlNet, IP-Adapter, AnimateDiff, and model merging.
Core Industry Software: Proficiency in standard VFX tools, specifically Foundry Nuke (including its Machine Learning toolsets) and/or Blender/Maya/Houdini.
Programming / Scripting: Strong Python scripting skills to automate tasks, build custom nodes, or link AI API endpoints directly into the studio's pipeline tools.
Problem-Solving Skills: An exceptional ability to troubleshoot temporal flickering, geometric mutations, and visual drift inherent to AI video generation.
Portfolio/Reel: A demonstrable portfolio showing successful AI-augmented workflows, specifically highlighting consistency in multi-shot sequences, complex camera motions, or advanced clean-plate generation.
Preferred / Nice-to-Have Qualifications
Experience training custom LoRAs or Dreambooth models for specific production IP.
Familiarity with real-time rendering engines like Unreal Engine 5 and Neural Radiance Fields (NeRFs) / 3D Gaussian Splatting.
A background in traditional cinematography, lighting, or photography to better inform prompt structures and lighting continuity.
Please email hr@s51media.com with your reel and resume.

Work arrangement
Hybrid