Top

Nvidia Broadcast deepfakes your eyes to make you look at the camera

Nvidia Broadcast deepfakes your eyes to make you look at the camera
Credits: Nvidia Official Website

With AI-enhanced voice and video, Nvidia Broadcast takes your live streams, voice chats, and video conference calls to the next level.

Nvidia has launched artificial intelligence software that can deepfake your eyes to make you look at the camera, even if you are looking elsewhere in real life.

The “Eye Contact” feature was added to Nvidia Broadcast 1.4. and uses sophisticated AI technology to replace your real eyes with simulated ones that remain aligned with your camera.

The eyes maintain their natural colour and blink, and there is even a disconnect feature in case you look too far away. Nvidia Broadcast 1.4. is currently available to download.

“Eye Contact is ideal for content creators seeking to record themselves while reading their notes or a script or avoiding having to stare directly at the camera. Video conference presenters will look at the eyes of the person they’re speaking with, improving engagement with their audiences,” Nvidia notes. “Currently in beta, we want to work with you, the community, to help improve Eye Contact. There are millions of eye colors and lighting combinations. If you test it and find any issues, or just want to help us develop this AI effect further, please send us a quick video here, we would appreciate it!”.

Mixed feedback

Many users rushed to try out the new feature. Several people pointed out various malfunctions. Most of their complaints reported that the AI feature makes you look slightly off. However, some users also stated that the feature got it right and that, to a satisfactory extent, the result was ideal.

The new feature requires at least a GeForce RTX 2060 graphics card (or Quadro equivalent) and 8GB of RAM. Nvidia recommends at least a Core i5-8600 or Ryzen 5 2600 processor.

The company warns that the technology is still in beta form and thus still needs to be completely ready since infinite combinations of eye colours and lighting could not be tested. This means that in some cases, there may be blemishes.

Nvidia is one of many companies to introduce an eye contact feature. Back in 2018, Apple tested a similar tool called “Attention Correction” for its FaceTime. Now, this feature is called “Eye Contact” and is available in current versions of iOS. Microsoft has its version of the same feature, which is available in Windows 11 for devices with a neural processing unit.

Nvidia Broadcast deepfakes your eyes to make you look at the camera
Credits: Nvidia Official Website

Nvidia Broadcast: Better virtual background

Nvidia Broadcast 1.4 provides other AI-powered tools, such as background replacement that operates as a virtual green screen and the feature to remove background noises that a microphone picks up.

A Vignette effect – like those seen in apps like Instagram – has been integrated into Broadcast. In parallel, the Blur, Replacement, and Removal of Virtual Background effects have also been enhanced with temporal data to achieve better segmentation and stability, enabling artificial intelligence to make better decisions.

Broadcast has also integrated the option to mirror your camera and to take a screenshot of your webcam.

George Mavridis is a journalist currently conducting his doctoral research at the Department of Journalism and Mass Media at Aristotle University of Thessaloniki (AUTH). He holds a degree from the same department, as well as a Master’s degree in Media and Communication Studies from Malmö University, Sweden, and a second Master’s degree in Digital Humanities from Linnaeus University, Sweden. In 2024, he completed his third Master’s degree in Information and Communication Technologies: Law and Policy at AUTH. Since 2010, he has been professionally involved in journalism and communication, and in recent years, he has also turned to book writing.