The following iteration of Nvidia’s DLSS expertise has landed and immediately we’re trying out what DLSS 3.5 is and extra particularly, take a more in-depth take a look at its new ray reconstruction function.

The brand new tech has been built-in into Cyberpunk 2077 2.0 which launched this week forward of the Phantom Liberty growth, and we have been spending a while with it over the past week or so to see how effectively DLSS 3.5 works.

TL;DR: What’s ray reconstruction and why is it an vital improve?

Ray tracing results in immediately’s video games are noisy, as a result of operating these results at a better high quality degree would cripple present graphics playing cards. To combat and take away this picture noise, builders implement denoising filters, which do assist this noise however include a number of different points, like ghosting, decrease ranges of element, and varied inaccuracies.

Ray reconstruction replaces the sport’s denoiser with a DLSS AI-enhanced denoiser that guarantees higher high quality and fewer artifacts than normal denoisers. It achieves this by combining the upscaling and denoising passes into the one algorithm, successfully changing DLSS Tremendous Decision with a mixed DLSS ray reconstruction and Tremendous Decision algorithm. Like current DLSS strategies, it requires recreation engine inputs as seen on this diagram.

DLSS 3.5 ray reconstruction is educated to not solely present upscaling reconstruction from a decrease pixel rely picture, however ray tracing impact reconstruction from a low ray rely picture, too.

As ray reconstruction replaces the usual Tremendous Decision algorithm with a mixed model, it have to be used with Tremendous Decision enabled, however Nvidia believes this can ship an general superior picture at little or no price to efficiency relative to enjoying with conventional denoisers and solely Tremendous Decision.

DLSS 3.5 might have been named higher

In our opinion, DLSS 3.5 is confusingly named. When DLSS was first launched, it referred solely to Nvidia’s upscaling expertise, “Deep Studying Tremendous Sampling.” Nvidia has since modified this to check with their assortment of AI rendering applied sciences, so what was once DLSS and DLSS 2.0 is now DLSS Tremendous Decision.

Then, with the launch of GeForce RTX 40 collection GPUs, they’ve added in Body Era to the DLSS household, and now we’re getting ray reconstruction as effectively.

Every of those additions has led to a brand new DLSS model quantity: 3.0 for Body Gen, 3.5 for ray reconstruction. Staying with us thus far? Good…

On prime of this, every DLSS expertise has its personal model quantity. So with DLSS 3.5, Nvidia has added ray reconstruction, and up to date each Tremendous Decision and Body Era to model 3.5. Recreation builders are free to decide on no matter applied sciences they like.

Cyberpunk 2077, for instance, has been up to date to make use of DLSS 3.5 however just for the ray reconstruction half; Tremendous Decision continues to be on model 3.1.1, and Body Era is on 3.1.13. Equally, there will probably be video games that use DLSS 3.5 Tremendous Decision, however do not combine ray reconstruction. Nonetheless with us?

To ensure that players positively cannot observe all of this, DLSS 3.5 ray reconstruction works on all RTX GPUs. However not all of DLSS 3.5 works on all RTX GPUs: Body Era continues to be unique to RTX 40 collection merchandise.

Contemplating that Nvidia spent a number of time advertising DLSS 3 as an unique to RTX 40 playing cards, it’s kind of bizarre to have DLSS 3.5’s major new function engaged on older RTX playing cards.

However do not get us flawed, it is nice that ray reconstruction is obtainable to the overwhelming majority of present GeForce homeowners, however absolutely there was a greater strategy to title all of this.

Can DLSS Render “Higher Than Native” Graphics?

We’re assured that sooner or later RTX 30 collection homeowners, for instance, will not perceive that their card would not help DLSS 3 Body Era however does help DLSS 3.5 ray reconstruction.

Early limitations of ray reconstruction in Cyberpunk 2077

Shifting on, having examined ray reconstruction in Cyberpunk, it is clear that that is an early stage expertise that is successfully a preview of what’s (hopefully) to come back. It is laborious to attract too many overarching conclusions from seeing it in only one recreation, however ray reconstruction does have some instantly apparent limitations.

Ray reconstruction is barely educated for use with DLSS upscaling enabled, not DLAA (Deep Studying Anti-Aliasing), so you’ll be able to’t use each concurrently, similar to you’ll be able to’t use ray reconstruction with none type of DLSS Tremendous Decision. Nvidia says they’re engaged on coaching ray reconstruction for use with DLAA and that can ultimately be supported.

However the greater limitation is that ray reconstruction is barely accessible when utilizing Cyberpunk’s path tracing mode, a.ok.a. RT Overdrive mode. It can’t be enabled when utilizing the sport’s common and fewer taxing ray tracing results. Nvidia advised us that is an intentional restriction, no less than for now. They “targeted [their] efforts to make RT Overdrive look nice in Cyberpunk 2077, and [are] working with CD Projekt so as to add help for ray reconstruction for different RT modes.”

We suspect it’s because the primary model of ray reconstruction has solely been optimized for path traced results and wishes optimization work for normal ray tracing. We do not know this for positive, and Nvidia does declare DLSS 3.5 has been educated on 5x extra information than DLSS 3 and acknowledges completely different RT results.

This can be a bit disappointing for many GeForce RTX GPU homeowners as a result of the trail traced mode in Cyberpunk is punishing on GPU {hardware}. Until you have got a high-end GPU like an RTX 4090 or RTX 4080, it is laborious to attain acceptable efficiency utilizing RT Overdrive even at decrease resolutions like 1080p.

So whereas it is good that DLSS 3.5 does work on decrease tier RTX GPUs, virtually talking, somebody with one thing like an RTX 3060 is just not going to be utilizing it – no less than for now. That is why it might have been good to see ray reconstruction accessible to be used with the common RT results which can be extra playable on mid-tier GPUs.

Ray reconstruction visible evaluation

So how does ray reconstruction influence the visible high quality of Cyberpunk 2077’s path tracing mode? There’s areas of enchancment and there are areas which can be the identical. Watch the video under for a full breakdown.

We recorded gameplay utilizing an Asus ROG Strix GeForce RTX 4090 on a Ryzen 7 7800X3D take a look at system, setting the picture high quality to 4K on extremely, path tracing enabled, DLSS High quality mode, and no body era until in any other case specified.

For a greater illustration of picture high quality comparisons, try the HUB video under:

For ray traced reflections on extremely reflective surfaces, ray reconstruction is ready to denoise these results to supply a better obvious decision. In some scenes it produces a noticeably greater reflection high quality in comparison with the trail traced mode with out ray reconstruction, and the common ray tracing mode.

The ray reconstructed picture is sharper and clearer, each stationary and in movement. It is a disgrace this tech is not accessible with the common RT mode as I believe it may gain advantage from it simply as a lot as we’re seeing within the path traced mode. It isn’t delicate and makes ray tracing a extra worthwhile impact to allow.

Ray reconstruction additionally improves the temporal accuracy of reflections. The trail tracing mode by default clearly makes use of a temporal denoising filter that works over a protracted time frame. Whenever you transfer round and cease whereas viewing a mirrored image, it may well usually take a number of seconds for the ultimate reflection to “settle” into place, with the reflection showing to maneuver when it should not be. Ray reconstruction considerably shortens that settling interval and virtually removes this temporal artifact.

This brings the ray traced picture a lot nearer to the responsiveness of the sport’s non ray traced display area reflections. Whereas the display area reflections are additionally of a better obvious decision at instances, they’ve some… fairly important limitations in movement, like disappearing completely.

At instances at evening we see a mixture of those enhancements to reflections, although this is not at all times this case. The scene above has a better reflection decision, diminished reflection ghosting and reflections which can be extra conscious of movement when ray reconstruction is enabled. Ray reconstruction additionally handles the precise denoising half higher for some extra diffuse reflections.

Not all reflections are enhanced by ray reconstruction although. In some examples we noticed reflections in clear glass. Each with and with out ray reconstruction enabled, the readability of reflections is great both approach, so for one of these impact, enhanced denoising is just not mandatory.

It isn’t simply reflections that ray reconstruction improves although. When assessing shadow high quality, ray reconstruction produced much less noisy shadows in movement, it is a delicate impact that is not as noticeable because the enhancements to reflections – and usually the responsiveness of shadows in movement is rather a lot higher than reflections – however ray reconstruction did seem a bit sharper.

On prime of improved noise discount, ray reconstruction supplied extra correct automobile headlights with diminished smearing, ghosting and blur. With the traditional path traced mode, automobile headlights lack definition in movement and virtually seem like a blob of sunshine on the entrance of the automobile – typically with gentle showing earlier than the precise place of the headlight, an impact of temporal denoising. With ray reconstruction enabled, the sunshine emitted from the headlight is extra outlined and fewer more likely to seem earlier than its precise place, enhancing the accuracy of this impact.

World illumination and ambient occlusion are additionally improved via ray reconstruction. Ambient occlusion enhancements are delicate, although varied scenes do look completely different with ray reconstruction on.

For a greater illustration of picture high quality comparisons, try the HUB video under:

The scene above is among the weirder ones we discovered for picture high quality. Right here we have now a light-weight panel that illuminates concrete above and under. With all three ray traced modes: the traditional RT Psycho mode, RT Overdrive with out ray reconstruction, and RT Overdrive with ray reconstruction; it takes a quick second for the colour change of the sunshine to influence the worldwide illumination seen right here. ray reconstruction would not clear up this delay, there’s nonetheless an unnatural disconnect.

Nonetheless when the colours do change, with out ray reconstruction you get this ugly transition between colours that is particularly noticeable across the shifting pedestrians. It is this bizarre shade ghosting impact and it occurs between each shade. With ray reconstruction, some shade transitions happen immediately with out this ugly ghosting, like purple to yellow, or blue to purple. Different colours see some however diminished ghosting, like yellow to inexperienced. Fairly a weird discovery.

Sadly ray reconstruction would not at all times look higher when it is enabled. The expertise struggles with some particular kinds of reflections, normally when it is a semi-reflective, not as shiny floor with texturing. Take the scene above for instance which has this marbled concrete tiling on the bottom. The trail traced mode with out ray reconstruction produces a clearly greater decision and extra outlined reflection. It is a stark distinction, too, to the purpose the place we have been positive we have been getting the settings tousled. However nope, we have tripled checked and that is certainly labelled appropriately.

Once we add movement to the combination, the ray reconstructed picture additionally has worse ghosting and stability. It appears to be the case the place the ray reconstruction algorithm is not fairly positive whether or not what it is seeing is a mirrored image or not, and finally ends up dealing with each the reflection and the feel utilized to this floor moderately poorly.

And at last right here is maybe the clearest instance of the strengths and weaknesses of all these reflections. Once we begin additional away from this glassy floor, ray reconstruction is ready to produce a greater high quality reflection.

When strolling in the direction of the floor, after a sure level a texture masses in throughout the glass, it is smudgy and has a number of scratches and stuff. After this level, the non ray reconstructed picture higher preserves this texture and produces a better element picture.

Additionally, as anticipated, with a decrease render decision, not solely does common picture high quality worsen, however so does the sharpness and readability of ray traced results. Nonetheless, even with DLSS Efficiency getting used, we nonetheless get many of the advantages of ray reconstruction, so reflection high quality as one instance would not change into worse than not utilizing ray reconstruction, it nonetheless finally ends up wanting higher regardless of the decrease render decision.

DLSS 3.5 ray reconstruction efficiency

There’s lot rather a lot to say on the subject of efficiency. When testing utilizing the GeForce RTX 4090 throughout a number of resolutions and DLSS high quality modes, ray reconstruction has little influence to border charge whether or not it is enabled or disabled. On the RTX 4090, having the setting off was barely sooner within the space we examined, however even then we’re speaking about as much as a 4% distinction, with a typical margin round 1% which is successfully margin of error sort stuff. On condition that it typically offers superior picture high quality, it is good to see this setting has little influence to efficiency.

DLSS 3.5 Efficiency

That is additionally true when wanting on the setting throughout a variety of GPUs, right here we have now 4 fashions examined at 1440p utilizing the DLSS High quality mode. Whereas the RTX 4090 was barely sooner with out ray reconstruction, the opposite fashions have been all barely sooner with ray reconstruction enabled.

Greatest case, we noticed a 7% win for ray reconstruction with the RTX 4070. By the point we bought to the RTX 3070, this card is just too gradual for path tracing at 1440p, so efficiency is essentially an identical both approach.

At 1080p once more most of those decrease tier playing cards actually aren’t able to path tracing, although typically the ray reconstruction mode is barely sooner. It isn’t an earth shattering margin, we might sometimes name this a tie which is an efficient consequence for higher picture high quality on the entire.

What We Discovered

General, we’re fairly impressed with this primary take a look at DLSS 3.5 ray reconstruction in Cyberpunk 2077. With no influence to efficiency, ray reconstruction sometimes improves picture high quality for ray traced results in numerous methods: greater constancy reflections and shadows, a much less noisy picture in movement, a extra responsive picture in movement with a a lot shorter settling time for results, diminished ghosting, and improved accuracy for lighting leading to higher picture definition.

For probably the most half, this solves a number of points we have had with ray tracing through the years. In lots of video games, while you allow ray traced results, absolutely we are able to see extra spectacular reflections that look extra correct and work correctly in additional conditions. However this has usually come at a price of a decrease impact decision, a extra grainy picture, extra artifacts and fewer temporal responsiveness.

Typically ray traced results will boil, sizzle and transfer even when there isn’t any precise movement on display, a byproduct of very low ray counts and weak denoisers. There are occasions we have not wished to play with ray tracing on as a result of these points are so noticeable and annoying and actually do not justify the large efficiency hit.

Ray reconstruction is a step in the direction of fixing this type of issues, making ray tracing rather more usable. We’re extra more likely to allow ray tracing in a recreation when the picture high quality is genuinely spectacular, when there’s not many artifacts or points, and when the efficiency hit is visually justified. This expertise looks as if an appropriate strategy to cut back artifacts and enhance ray tracing high quality while not having to extend ray counts and make the efficiency hit even bigger.

We’re additionally hopeful that ray reconstruction will encourage builders to make use of extra intensive ray tracing results as a result of the ensuing high quality will really justify the efficiency price. It is clear that some builders are being conservative with ray tracing to the purpose the place the visible distinction is negligible with it enabled, all as a result of they do not need to trigger a large hit to efficiency.

Ray reconstruction would not cut back the efficiency hit from enabling prime quality RT results, nevertheless it makes them simpler to justify as a result of the ultimate picture high quality is extra acceptable than it in any other case can be. Nonetheless, ray reconstruction clearly nonetheless has some points and Nvidia has a protracted strategy to go earlier than this function is a slam dunk win for enhancing ray tracing.

In a number of areas we noticed ray reconstruction cripple picture high quality, because it does appear to battle with some kinds of reflections on textured surfaces. This is not one thing you may see on a regular basis, it is extremely depending on the floor, lighting, location, time of day, and so forth, nevertheless it was apparent at instances throughout many hours testing Cyberpunk.

If we needed to put some numbers to it, we are saying that ray reconstruction improves picture high quality about 60% of the time, ~20% of the time there isn’t a influence, and ~20% of the time we see a regression.

If we needed to put some numbers to it, we are saying that ray reconstruction improves picture high quality about 60% of the time, ~20% of the time there isn’t a influence, and ~20% of the time we see a regression. Nonetheless Nvidia does have a confirmed monitor report of enhancing DLSS high quality over time via updates – we have seen that with Tremendous Decision and Body Era. Nvidia additionally acknowledged that there are specific eventualities the place ray reconstruction would profit from further AI coaching, so we’ll be maintaining an eye fixed out for enhancements over time.

What additionally leads us to consider that that is an early, maybe even rushed implementation and that is why ray reconstruction is just not accessible for the common ray tracing modes, after they would clearly profit from superior denoising and higher picture high quality.

Having it working with probably the most intensive path traced mode is good, however the majority of RTX homeowners haven’t got the GPU energy for path tracing. It is barely viable on an RTX 4070 or RTX 3080, the latter of which does not even have the crutch of Body Era. As soon as we get to GeForce fashions priced at $500 or much less (or all the Turing era), at finest you may be utilizing the traditional ray traced modes, which at the moment aren’t appropriate with ray reconstruction.

Nvidia and CDPR have to get the function working with common ray tracing, so nearly all of GeForce homeowners can profit, and in order that DLSS 3.5 can really stay as much as its compatibility claims throughout all RTX GPUs, as a result of proper now that is simply on-paper help. As well as, supporting DLAA can be good, though DLAA with path tracing is fairly crippling even on an RTX 4090.

As soon as once more, that is an early look of the expertise primarily based on testing with only one recreation. DLSS 3.5 ray reconstruction replaces the ray tracing denoiser within the recreation, so the profit over normal picture high quality will differ relying on how good the sport’s conventional denoiser is. It is doable that video games with glorious denoisers will profit much less from ray reconstruction, whereas these with rubbish denoisers or poor implementations will profit extra. Over time we’ll get a greater concept of the overall influence in video games, though this preliminary look is fairly spectacular and we have but to see many (or any) examples of video games with superior ray tracing impact high quality than what DLSS 3.5 is offering.

At current, ray reconstruction is just not a promoting level to buy a GeForce GPU. Recreation help, even in upcoming titles, could be very restricted and Nvidia has lots to work on to enhance the function. However AMD and Intel must be engaged on a competing expertise straight away, as a result of neither will need to fall behind in ray tracing picture high quality over time if ray reconstruction takes a maintain throughout a lot of video games. AMD particularly should not need to be the model the place not solely does ray tracing carry out worse on their merchandise, however seems to be worse as effectively.

Buying Shortcuts:

• Nvidia GeForce RTX 4070 Ti on Amazon
• Nvidia GeForce RTX 4080 on Amazon
• Nvidia GeForce RTX 4090 on Amazon
• Nvidia GeForce RTX 4060 Ti on Amazon
• Nvidia GeForce RTX 4070 on Amazon
• AMD Radeon RX 7800 XT on Amazon
• AMD Radeon RX 7900 XTX on Amazon