Self-supervised learning with randomised layers for remote sensing

This letter presents a new self-supervised learning approach based on randomised layers for remote sensing. Our method is basically based on the Tile2Vec approach, which is one of the state-of-the-art self-supervised learning approaches for remote sensing. Unlike the original Tile2Vec algorithm, we reformulate the triplet loss as a classification loss. We use several fully connected layers with binary cross-entropy loss instead of no fully connected layers with triplet loss of the original Tile2Vec. We observe that not updating the fully connected layers is more helpful in obtaining more robust representations. The proposed algorithm is verified and evaluated by applying it to a cropland data layer classification task. The experimental results show that our approach is superior to the original Tile2Vec approach in all experiments based on random forest, logistic regression, and multi-layer classifiers.