LiDAR scanners and other sensors deliver information about the 3D world around the vehicle. Making sense of this information in terms of drivable space and important objects in 3D is required to develop robust driving system that plan and act safely.