The Mandalorian production sets has gone one step further. They render out the actual background footage that would normally be added in post-production (in place of the green screen) during the filming. This way the actors do not need to 'pretend' to be seeing something anymore, the directors and cinematographers get to change things in real-time based on their CGI background renderings, which can actually include manipulation to the set (via software) without someone having to make physical changes to the set in the real world.
Chapter 1 / Part 2 - Movie Magic
https://www.slashfilm.com/the-mandalorian-stagecraft-photos/
The Mandalorian production sets has gone one step further. They render out the actual background footage that would normally be added in post-production (in place of the green screen) during the filming. This way the actors do not need to 'pretend' to be seeing something anymore, the directors and cinematographers get to change things in real-time based on their CGI background renderings, which can actually include manipulation to the set (via software) without someone having to make physical changes to the set in the real world.