Virtual view synthesis is essential for 3D teleconference systems
like VIRTUE, which utilizes the motion parallax cue. In this paper
we propose a multi-step view synthesis algorithm to efficiently
reconstruct an arbitrary view in real time and utilize all the
information we have from stereo cameras. We show that the newly
proposed algorithm can be used to reconstruct a high quality view
from an arbitrary pose, using occlusion information. Its
modular property makes real-time implementation feasible and due
to the parallel setup latency can be kept low.