Nvidia announced DLSS 5 on Monday, which was swiftly followed by immediate backlash from gamers and developers alike. And while Nvidia CEO Jensen Huang has claimed people are wrong about their distaste for the fledgling technology, Team Green has released some comments that have clarified what it does – for better or worse.
In a statement to YouTuber Daniel Owen, Jacob Freeman, GeForce Evangelist for Nvidia clarified some of the finer points about how DLSS 5 actually works. And, just like Death Stranding 2 animator Mike York suggested, it seems like the algorithm is just taking frames from the game, along with motion vector data and drawing a new image that’s pasted on top.
When Owen asked whether or not the model is just taking a rendered frame as input, Freeman responded “Yes, DLSS 5 takes a 2D frame plus motion vectors as input.” Then, he clarified “DLSS 5 is trained end to end to understand complex scene semantics such as characters, hair, fabric and translucent skin, along with environmental lighting conditions like front-lit, back-lit or overcast, all by analyzing a single frame.”
Nvidia has made the claim about “complex scene semantics” before, but because the model is only taking the rendered frame and motion data as input, it has no way to know definitively the values given to various in-game objects by the developers.





