-
Generating Synthetic Multispectral Satellite Imagery from Sentinel-2
Authors:
Tharun Mohandoss,
Aditya Kulkarni,
Daniel Northrup,
Ernest Mwebaze,
Hamed Alemohammad
Abstract:
Multi-spectral satellite imagery provides valuable data at global scale for many environmental and socio-economic applications. Building supervised machine learning models based on these imagery, however, may require ground reference labels which are not available at global scale. Here, we propose a generative model to produce multi-resolution multi-spectral imagery based on Sentinel-2 data. The r…
▽ More
Multi-spectral satellite imagery provides valuable data at global scale for many environmental and socio-economic applications. Building supervised machine learning models based on these imagery, however, may require ground reference labels which are not available at global scale. Here, we propose a generative model to produce multi-resolution multi-spectral imagery based on Sentinel-2 data. The resulting synthetic images are indistinguishable from real ones by humans. This technique paves the road for future work to generate labeled synthetic imagery that can be used for data augmentation in data scarce regions and applications.
△ Less
Submitted 5 December, 2020;
originally announced December 2020.
-
Semantic Segmentation of Medium-Resolution Satellite Imagery using Conditional Generative Adversarial Networks
Authors:
Aditya Kulkarni,
Tharun Mohandoss,
Daniel Northrup,
Ernest Mwebaze,
Hamed Alemohammad
Abstract:
Semantic segmentation of satellite imagery is a common approach to identify patterns and detect changes around the planet. Most of the state-of-the-art semantic segmentation models are trained in a fully supervised way using Convolutional Neural Network (CNN). The generalization property of CNN is poor for satellite imagery because the data can be very diverse in terms of landscape types, image re…
▽ More
Semantic segmentation of satellite imagery is a common approach to identify patterns and detect changes around the planet. Most of the state-of-the-art semantic segmentation models are trained in a fully supervised way using Convolutional Neural Network (CNN). The generalization property of CNN is poor for satellite imagery because the data can be very diverse in terms of landscape types, image resolutions, and scarcity of labels for different geographies and seasons. Hence, the performance of CNN doesn't translate well to images from unseen regions or seasons. Inspired by Conditional Generative Adversarial Networks (CGAN) based approach of image-to-image translation for high-resolution satellite imagery, we propose a CGAN framework for land cover classification using medium-resolution Sentinel-2 imagery. We find that the CGAN model outperforms the CNN model of similar complexity by a significant margin on an unseen imbalanced test dataset.
△ Less
Submitted 5 December, 2020;
originally announced December 2020.
-
Localization of Malaria Parasites and White Blood Cells in Thick Blood Smears
Authors:
Rose Nakasi,
Aminah Zawedde,
Ernest Mwebaze,
Jeremy Francis Tusubira,
Gilbert Maiga
Abstract:
Effectively determining malaria parasitemia is a critical aspect in assisting clinicians to accurately determine the severity of the disease and provide quality treatment. Microscopy applied to thick smear blood smears is the de facto method for malaria parasitemia determination. However, manual quantification of parasitemia is time consuming, laborious and requires considerable trained expertise…
▽ More
Effectively determining malaria parasitemia is a critical aspect in assisting clinicians to accurately determine the severity of the disease and provide quality treatment. Microscopy applied to thick smear blood smears is the de facto method for malaria parasitemia determination. However, manual quantification of parasitemia is time consuming, laborious and requires considerable trained expertise which is particularly inadequate in highly endemic and low resourced areas. This study presents an end-to-end approach for localisation and count of malaria parasites and white blood cells (WBCs) which aid in the effective determination of parasitemia; the quantitative content of parasites in the blood. On a dataset of slices of images of thick blood smears, we build models to analyse the obtained digital images. To improve model performance due to the limited size of the dataset, data augmentation was applied. Our preliminary results show that our deep learning approach reliably detects and returns a count of malaria parasites and WBCs with a high precision and recall. We also evaluate our system against human experts and results indicate a strong correlation between our deep learning model counts and the manual expert counts (p=0.998 for parasites, p=0.987 for WBCs). This approach could potentially be applied to support malaria parasitemia determination especially in settings that lack sufficient Microscopists.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Luganda Text-to-Speech Machine
Authors:
Irene Nandutu,
Ernest Mwebaze
Abstract:
In Uganda, Luganda is the most spoken native language. It is used for communication in informal as well as formal business transactions. The development of technology startups globally related to TTS has mainly been with languages like English, French, etc. These are added in TTS engines by Google, Microsoft among others, allowing developers in these regions to innovate TTS products. Luganda is no…
▽ More
In Uganda, Luganda is the most spoken native language. It is used for communication in informal as well as formal business transactions. The development of technology startups globally related to TTS has mainly been with languages like English, French, etc. These are added in TTS engines by Google, Microsoft among others, allowing developers in these regions to innovate TTS products. Luganda is not supported because the language is not built and trained on these engines. In this study, we analyzed the Luganda language structure and constructions and then proposed and developed a Luganda TTS. The system was built and trained using locally sourced Luganda language text and audio. The engine is now able to capture text and reads it aloud. We tested the accuracy using MRT and MOS. MRT and MOS tests results are quite good with MRT having better results. The results general score was 71%. This study will enhance previous solutions to NLP gaps in Uganda, as well as provide raw data such that other research in this area can take place.
△ Less
Submitted 11 May, 2020;
originally announced May 2020.
-
Scoring Root Necrosis in Cassava Using Semantic Segmentation
Authors:
Jeremy Francis Tusubira,
Benjamin Akera,
Solomon Nsumba,
Joyce Nakatumba-Nabende,
Ernest Mwebaze
Abstract:
Cassava a major food crop in many parts of Africa, has majorly been affected by Cassava Brown Streak Disease (CBSD). The disease affects tuberous roots and presents symptoms that include a yellow/brown, dry, corky necrosis within the starch-bearing tissues. Cassava breeders currently depend on visual inspection to score necrosis in roots based on a qualitative score which is quite subjective. In t…
▽ More
Cassava a major food crop in many parts of Africa, has majorly been affected by Cassava Brown Streak Disease (CBSD). The disease affects tuberous roots and presents symptoms that include a yellow/brown, dry, corky necrosis within the starch-bearing tissues. Cassava breeders currently depend on visual inspection to score necrosis in roots based on a qualitative score which is quite subjective. In this paper we present an approach to automate root necrosis scoring using deep convolutional neural networks with semantic segmentation. Our experiments show that the UNet model performs this task with high accuracy achieving a mean Intersection over Union (IoU) of 0.90 on the test set. This method provides a means to use a quantitative measure for necrosis scoring on root cross-sections. This is done by segmentation and classifying the necrotized and non-necrotized pixels of cassava root cross-sections without any additional feature engineering.
△ Less
Submitted 7 May, 2020;
originally announced May 2020.
-
Proceedings of the ICLR Workshop on Computer Vision for Agriculture (CV4A) 2020
Authors:
Yannis Kalantidis,
Laura Sevilla-Lara,
Ernest Mwebaze,
Dina Machuve,
Hamed Alemohammad,
David Guerena
Abstract:
This is the proceedings of the Computer Vision for Agriculture (CV4A) Workshop that was held in conjunction with the International Conference on Learning Representations (ICLR) 2020.
The Computer Vision for Agriculture (CV4A) 2020 workshop was scheduled to be held in Addis Ababa, Ethiopia, on April 26th, 2020. It was held virtually that same day due to the COVID-19 pandemic. The workshop was hel…
▽ More
This is the proceedings of the Computer Vision for Agriculture (CV4A) Workshop that was held in conjunction with the International Conference on Learning Representations (ICLR) 2020.
The Computer Vision for Agriculture (CV4A) 2020 workshop was scheduled to be held in Addis Ababa, Ethiopia, on April 26th, 2020. It was held virtually that same day due to the COVID-19 pandemic. The workshop was held in conjunction with the International Conference on Learning Representations (ICLR) 2020.
△ Less
Submitted 17 May, 2020; v1 submitted 23 April, 2020;
originally announced April 2020.
-
Mobile community sensing with smallholder farmers in a developing nation; A scaled pilot for crop health monitoring
Authors:
Daniel Mutembesa,
Ernest Mwebaze,
Solomon Nsumba,
Christopher Omongo,
Humphrey Mutaasa
Abstract:
Previously, crowdsourcing experiments in surveillance of crop diseases and pest have been trialed as small scale community sensing campaigns with select cohort of smallholder farmers, extension and experts. While those pilots have demonstrated the viability of community sensing with mobile phones to collect massive amounts of real-time data all year round, to compliment low-resourced agricultural…
▽ More
Previously, crowdsourcing experiments in surveillance of crop diseases and pest have been trialed as small scale community sensing campaigns with select cohort of smallholder farmers, extension and experts. While those pilots have demonstrated the viability of community sensing with mobile phones to collect massive amounts of real-time data all year round, to compliment low-resourced agricultural expert surveys, they are limited in generalising ideas for scaled implementations of a community sensing system with farmer communities. This work presents a case of scaled deployment of the mobile ad hoc surveillance for crowdsourcing real-time surveillance data on cassava from over 175 smallholder farmers across Uganda. This paper describes a modified mobile ad hoc surveillance ecosystem to suite smallholder farmer agents, a communication model and data collection model designed to cover the spatial interests for the scale of surveillance, a deployment plan, the training methodology and incentives structure. The paper also presents very early results of contributions from farmer agents, that could be usable in monitoring the movement of planting materials between districts, mapping cassava varieties, multiplication sites, and communities with little or no access to agricultural extension services, and possibly guide precision expert surveys in areas of high disease incidence.
△ Less
Submitted 19 August, 2019;
originally announced August 2019.
-
Crowdsourcing real-time viral disease and pest information. A case of nation-wide cassava disease surveillance in a developing country
Authors:
Daniel Mutembesa,
Christopher Omongo,
Ernest Mwebaze
Abstract:
In most developing countries, a huge proportion of the national food basket is supported by small subsistence agricultural systems. A major challenge to these systems is disease and pest attacks which have a devastating effect on the smallholder farmers that depend on these systems for their livelihoods. A key component of any proposed solution is a good disease surveillance network. However, curr…
▽ More
In most developing countries, a huge proportion of the national food basket is supported by small subsistence agricultural systems. A major challenge to these systems is disease and pest attacks which have a devastating effect on the smallholder farmers that depend on these systems for their livelihoods. A key component of any proposed solution is a good disease surveillance network. However, current surveillance efforts are unable to provide sufficient data for monitoring such phenomena over a vast geographic area efficiently and effectively due to limited resources, both human and financial. Crowdsourcing with farmer crowds that have access to mobile phones offers a viable option to provide all year round real-time surveillance data on viral disease and pest incidence and severity. This work presents a mobile ad hoc surveillance system for monitoring viral diseases and pests in cassava. We present results from a pilot in Uganda where this system was deployed for 76 weeks. We discuss the participation behaviours of the crowds with mobile smartphones as well as the effects of several incentives applied.
△ Less
Submitted 9 August, 2019;
originally announced August 2019.
-
iCassava 2019 Fine-Grained Visual Categorization Challenge
Authors:
Ernest Mwebaze,
Timnit Gebru,
Andrea Frome,
Solomon Nsumba,
Jeremy Tusubira
Abstract:
Viral diseases are major sources of poor yields for cassava, the 2nd largest provider of carbohydrates in Africa.At least 80% of small-holder farmer households in Sub-Saharan Africa grow cassava. Since many of these farmers have smart phones, they can easily obtain photos of dis-eased and healthy cassava leaves in their farms, allowing the opportunity to use computer vision techniques to monitor t…
▽ More
Viral diseases are major sources of poor yields for cassava, the 2nd largest provider of carbohydrates in Africa.At least 80% of small-holder farmer households in Sub-Saharan Africa grow cassava. Since many of these farmers have smart phones, they can easily obtain photos of dis-eased and healthy cassava leaves in their farms, allowing the opportunity to use computer vision techniques to monitor the disease type and severity and increase yields. How-ever, annotating these images is extremely difficult as ex-perts who are able to distinguish between highly similar dis-eases need to be employed. We provide a dataset of labeled and unlabeled cassava leaves and formulate a Kaggle challenge to encourage participants to improve the performance of their algorithms using semi-supervised approaches. This paper describes our dataset and challenge which is part of the Fine-Grained Visual Categorization workshop at CVPR2019.
△ Less
Submitted 23 December, 2019; v1 submitted 7 August, 2019;
originally announced August 2019.
