Continue scrolling down to learn more about our Deep Learning Model developed for classifying sea/land/clouds on the HYPSO-1 dataset. The model remains relatively simple suggesting its viability for inference both for on-ground data processing and for on-board inference at the System-on-Chip (SoC) software on the HYSPO-1 platform.
To demonstrate the significance of our dataset for Earth and ocean observation, HSI data processing and sea/land/clouds classification tasks, we adapt the following 1D Fully Convolutional Network (FCN) architecture to tackle this classification problem. The 1D FCN, originally designed for regression-based predictions of e.g. clay content in soil spectroscopy, as detailed in previous works (2018) was later adapted to address classification tasks for soil texture, as explained in the state of the art (2019). In our work, as depicted in the figure below, we employ the 2019 architecture, but we make several adjustments to its hyper-parameters to boost its performance on our dataset. Contrary to the 2019 classification model which utilizes four convolutions with 32, 32, 64, and 64 kernels (all of size 3), our convolutions are expanded to 32, 64, 96, and 128 kernels, increasing the kernel size to 6 for each filter to enhance our neural network’s efficacy. Despite using more and larger kernels, our model, with 124,163 parameters trained using categorical cross-entropy loss over one epoch in 300-pixel batches on raw data excluding the first and last three noisy channels, remains relatively simple. This suggests the model is apt for inference, suitable both for on-ground processing and for the System-on-Chip (SoC) software on-board the HYPSO-1 platform. As we elaborate next in this page, our adapted 1D FCN model applied to the HYPSO-1 Sea-Land-Cloud-Labeled Dataset achieves substantially higher scores compared to the existing literature.
In the results section of our paper, we specify that the training set comprises 30 images (around 20 million signatures), the validation set contains 3 images (approximately 2 million signatures), and the 5 remaining images are used as test set (over 3 million signatures).
We provide the IDs of the images used for the training, validation, and testing of the model as indicated in the next table. The images were randomly selected, but it serves to clarify the exact data we have utilized for training, validating, and testing the model. Remeber that you can find the IDs and their associated images in Section DATASET.
Set | Image IDs |
---|---|
Training Set | 4, 5, 6, 7, 9, 10, 15, 16, 17, 25, 26, 47, 56, 89, 95, 96, 107, 111, 124, 137, 148, 151, 158, 166, 178, 211, 253, 255, 266, 273 |
Validation Set | 120, 127, 204 |
Testing Set | 39, 58, 59, 150, 207 |
Our adapted 1D FCN model applied to the HYPSO-1 Sea-Land-Cloud-Labeled Dataset achieves substantially high scores: 0.95 for overall accuracy, 0.91 for average accuracy, and 0.92 for kappa. These results highlight the superior performance of our network configuration for our dataset compared to the existing literature. In the paper we present how the model performs for an image in the Stuary of Ría de Arousa in Galicia (Spain), from the test set. On this page, we display additional results in the following table for the remaining captures in the test set. The table shows that the clouds category exhibits a lower hit rate accuracy compared to the sea and land classes. This can be attributed to the dataset's slightly skewed distribution, with clouds and overexposed pixels constituting a minority class, alongside other factors influencing these results such as the training process of the network.
RGB | Labeled & Predicted | Confusion Matrix | Image ID, country and date |
---|---|---|---|
39 Qatar on 13th December 2022 |
|||
58 Argentina on 05th December 2022 |
|||
59 Spain on 05th December 2022 |
|||
150 Iran on 26th September 2022 |
|||
207 China on 08th August 2022 |