Ray Tracing in Gaming: What is it and How does it work ?

Ray tracing. If you are an avid video game player or follower, you must have heard this term quiet a number of times, however, we got to agree that this term is still isn’t that common and vivid as we think it it. In simple language, it’s a technique that makes light behave in a realistic way. Well, What does it do ? It makes the game more realistic and immersive. Wouldn’t you be spellbound by the light bouncing off of objects in a natural way? The blurry line between reality and fantasy is no doubt appealing.

Let’s dive deep into knowing more about Ray Tracing and how does it actually work.

What is ray tracing?

Imagine you’re playing a game on your PC with top notch graphics. It could be open-world game like Red Dead Redemption 2, where there are loads of objects and textures. As you enter a dense forest and notice sun light running through the leaves. That is what you call Ray Tracing. This feature provides a more realist and dynamic environment. That means shadows will move according to the sun’s position and look softer.

Ray tracing uses an algorithm that tracks beams of light. When the light hits an object or surface, the algorithm calculates the way it interacts with it, and with the way it interacts with other rays of light bouncing off different surfaces of their own. The idea is to mimic how the human eye processes light and shadows in real-time. That’s what makes it look so realistic.

While ray tracing produces impressive results, it sometimes does put a lot of stress on your GPU, as it requires a massive amount of power. It’s also quiet expensive to trace all those rays. It is one of the reasons as to why most video games typically use traditional rasterization instead. It’s much faster and it saves resources. Even games that support ray tracing tend to rely on rasterization for the vast majority of visuals, deploying the cutting-edge lighting effects for only a few key features.

Rasterization

Rasterization is how most video games are traditionally rendered. Simply put, it’s the process in which the GPU assembles a 3D scene. Let’s just think of the GPU as the sculptor and the polygons as the clay. Once the scene is set, these polygons get transformed into 2D pixels and then gets fine-tuned with shading, lighting, colors, and textures. One limitation to rasterization is inaccurate lighting effects. This technique can’t quite track light and calculate how it should hit virtual objects like ray tracing does, forcing developers to put a lot of work into “faking” lighting and its associated effects instead.

That’s where ray tracing comes in, in supported games—though your frame rates still plummet when even limited ray tracing features kick into action. That’s why the rise of ray tracing has come hand-in-hand with new image upsampling technologies that help reduce the load on your graphics card, boosting performance back up.

DLSS and FSR

DLSS is the acronym for Nvidia’s Deep Learning Super Sampling. This technology works by rendering a video game at a lower resolution and then upscales those frames to your chosen resolution, using artificial intelligence and temporal data from multiple frames to help fill in the blanks. The idea is to make a game look as sharp as possible without sacrificing performance. So, what does this technology have to do with ray tracing? Well, it’s supposed to make ray tracing work faster. Because ray tracing puts a lot of stress on your GPU, most games plummet below the respectable 60 frames-per-second. DLSS helps improve ray tracing by taking some stress off of the GPU.

FSR stands for FidelityFX Super Resolution and is AMD’s upscaling solution. Similar to Nvidia’s DLSS, FSR lowers your game’s resolution and then uses a “spatial” upscaling technique to show your game at your full chosen resolution. In other words, your game will look like it’s running at a higher higher resolution than it actually is. FSR is a bit different than DLSS, though. For one, it works across different generations of GPUs, including Nvidia’s GeForce cards. The source code is also free for developers, which is pretty darn rad. FSR’s spatial upscaling delivers a more noticeable hit to visual quality than DLSS if you crank them to their faster Performance options, but both work very well when set to Quality or Ultra Quality presets, especially on pixel-packed 1440p or 4K displays.

The proof is in the pudding

If you’d like to see what full-blown ray tracing looks like in action in a fully path-traced game, check out the stream above. In the video, the team at PCWorld explores Minecraft with ray tracing enabled. As you can see, there’s a huge difference in image quality. The surface of the water is reflective and glass-like, and the log cabins cast realistic-looking shadows on the ground. When Adam Patrick Murray, PCWorld’s video director, looks up at the sky while underwater at the 44:28 mark, you almost have to squint because the mid-day sun is so bright. It’s just beaming straight into the water. This technology is lovely and immersive, sure, but it comes at a cost.

Ray tracing has a huge impact on performance, as it requires more processing power from your system. You’ll definitely see those frame rates plummet, which is a real bummer. This will happen even with the most powerful GPUs. There aren’t many games that support ray tracing, either, and the ones that do only tend to support ray tracing for a few effects—like reflections or shadows—rather than being fully path-traced, like the Minecraft video above. That said, if you really care about aesthetics and have the right graphics card, you should definitely give it a try. The realistic effects look truly incredible when it’s done well.