DeepVGI – Deep Learning with Volunteered Geographic Information
Deep learning techniques, esp. Convolutional Neural Networks (CNNs), are now widely studied for predictive analytics with remote sensing images, which can be further applied in different domains for ground object detection, population mapping, etc. These methods usually train predicting models with the supervision of a large set of training examples. However, finding ground truths especially for developing and rural areas is quite hard and manually labeling a large set of training data is costly. On the other hand Volunteered Geographic Information (VGI) (e.g., OpenStreetMap (OSM) and MapSwipe) which is the geographic data provided voluntarily by individuals, provides a free approach for such big data.
In our project
DeepVGI, we study predictive analytics methods with remote sensing images, VGI, deep neural networks as well as other learning algorithms. It aims at deeply learning from satellite imageries with the supervision of such Volunteered Geographic Information.
VGI data from OpenStreetMap (OSM) and the mobile crowdsourcing application MapSwipe which allows volunteers to label images with buildings or roads for humanitarian aids are utilized. We develop an active learning framework with deep neural networks by incorporating both VGI data with more complete supervision knowledge. Our experiments show that DeepVGI can achieve high building detection performance for humanitarian mapping in rural African areas.
Figure 1 shows some initial results of DeepVGI, where OpenStreetMap and MapSwipe data are utilized for training together with multi-layer artificial neural networks and a VGI-based active learning strategy proposed by us. DeepVGI outperforms Deep-OSM (i.e. deep models trained with only OpenStreetMap data), and achieves close accuracy to the volunteers.
Figure 1: Initial Results of DeepVGI
On the other hand, such predictive analytics methods will be applied in geographic applications like humanitarian mapping. It can help improve VGI data quality, save volunteers’ time, etc. DeepVGI is also an attempt to explore the interaction between human beings and machines, between crowdsourcing and deep learning. Figure 2 shows the research framework of DeepVGI project, where we will first focus on learning and prediction between deep neural networks and big spatial data (including VGI data from our history OSM project).
Figure 2 shows the overal Research Framework of DeepVGI
- Chen, J., Zipf, A. (2017): DeepVGI: Deep Learning with Volunteered Geographic Information. 26. Int. World Wide Web Conference 2017 (WWW2017). Perth. Poster.
- Zipf, A, Chen, J. (2017): Humanitarian Mapping with Deep Learning and Volunteered Geographic Information. BIG 2017. (igData Innovators Gathering) . Perth. co-located with WWW2017.
- Chen, J., Zipf, A. (2017): Deep Learning with Satellite Images and Volunteered Geographic Information. In: Karimi, H. A. and Karimi, B. (eds.): Geospatial Data Science: Techniques and Applications. Taylor & Francis. Forthcoming.
- Chen, J., Y. Zhou, A. Zipf and H. Fan (2018, accepted): Deep Learning from Multiple Crowds: A Case Study of Humanitarian Mapping. IEEE Transactions on Geoscience and Remote Sensing (TGRS). accepted. vol/pp pending.