SAR self-enhanced by electro-optical network

We investigate the relationship between paired SAR and optical images. SAR sensors have the capabilities of penetrating clouds and capturing data at night, whereas optical sensors cannot. We are interested in the case where we have access to both modalities during training, but only the SAR during test time. To that end, we developed a framework that inputs a SAR image and predicts a Canny edge map of the optical image, which retains structural information, while removing superfluous details. Our experiments show that by additionally using this predicted edge map for downstream tasks, we can outperform the same model that only uses the SAR image.