Runway has released a prompting guide for generating hyper-realistic videos using the Gen-3 model.
It demonstrates how to control camera motion, viewing angle, lighting, and text placement.
Gen-3 can:
🖥 create clips up to 10 seconds
🖥 generate videos from text prompts and images
🖥 maintain high video detail
Let’s go through examples to understand how to manage the camera and lighting.
📹 Camera Motion
Prompt Structure:
[shot type/camera movement], [subject + action], [style]
Prompt Example:
360-degree orbiting shot of a man on a mountain top, cinematic style
Camera Motions Tested:
📷 360 Degree Orbit: Orbits around subject
📷Zoom Out: Pulls back from subject
📷 Zoom In: Pulls into subject
📷 Panning: Camera tracks right/left
📷 Fly Over: Aerial fly-by
📷 Timelapse: Time passing in real-time
📷 Vertigo: Zooming in while dollying out
📷 Arcing: Camera moves around the subject
📷 Tracking: Camera follows the subject
📷 Tilt: Vertical movement
📷 Descending: Camera moving downward
📷 Sweeping: Broad, fluid camera movement
💡 Lighting
Prompt Structure:
[shot type], [subject + action], [lighting description]
Prompt Example:
closeup shot of a man wearing sunglasses walking in the Tokyo streets, Strobe Lighting
Lighting Tested:
☀ High-Key: Bright, evenly lit scene
☀ Low-Key: Dark, contrasty scene
☀ Back Light: Light source behind the subject
☀ Silhouette: Dark subject, bright background
☀ Chiaroscuro: Dramatic contrast
☀ Volumetric Lighting: Beams light in hazy environments
☀ Strobe Lighting: Rapid flashes
☀ Light Painting: Moving lights create streaks
☀ Warm Lighting: Yellow-orange tones, cozy feel
☀ Cool Lighting: Blue-green tints, calm mood
☀ Over-Exposed: Bright, washed-out dreaminess
☀ Ethereal: Soft, diffused otherworldly glow
⭐️ Bonus: Runway + Claude 3
One user created a Runway prompt generator based on Claude 3. It allows you to fill in a template and get a detailed prompt for creating high-quality videos. Get inspired!
More on the topic:
DreamFlare AI — an interactive video content platform
Luma AI creates videos from just two frames
#manual #Runway @hiaimediaen