The Mandalorian production sets has gone one step further. They render out the actual background footage that would normally be added in post-production (in place of the green screen) during the filming. This way the actors do not need to 'pretend' to be seeing something anymore, the directors and cinematographers get to change things in real-time based on their CGI background renderings, which can actually include manipulation to the set (via software) without someone having to make physical changes to the set in the real world.
Right, they are doing the post production... during production. From the camera's point of view, there is no where you could look that doesn't have the proper background. Now imagine that your eyes have that same POV.
https://www.slashfilm.com/the-mandalorian-stagecraft-photos/
The Mandalorian production sets has gone one step further. They render out the actual background footage that would normally be added in post-production (in place of the green screen) during the filming. This way the actors do not need to 'pretend' to be seeing something anymore, the directors and cinematographers get to change things in real-time based on their CGI background renderings, which can actually include manipulation to the set (via software) without someone having to make physical changes to the set in the real world.
Right, they are doing the post production... during production. From the camera's point of view, there is no where you could look that doesn't have the proper background. Now imagine that your eyes have that same POV.