Pone 0147121
Pone 0147121
Abstract
Increasing awareness of the issue of deforestation and degradation in the tropics has
resulted in efforts to monitor forest resources in tropical countries. Advances in satellite-
OPEN ACCESS based remote sensing and ground-based technologies have allowed for monitoring of for-
Citation: DeVries B, Pratihast AK, Verbesselt J, ests with high spatial, temporal and thematic detail. Despite these advances, there is a
Kooistra L, Herold M (2016) Characterizing Forest need to engage communities in monitoring activities and include these stakeholders in
Change Using Community-Based Monitoring Data national forest monitoring systems. In this study, we analyzed activity data (deforestation
and Landsat Time Series. PLoS ONE 11(3):
and forest degradation) collected by local forest experts over a 3-year period in an Afro-
e0147121. doi:10.1371/journal.pone.0147121
montane forest area in southwestern Ethiopia and corresponding Landsat Time Series
Editor: Krishna Prasad Vadrevu, University of
(LTS). Local expert data included forest change attributes, geo-location and photo evidence
Maryland at College Park, UNITED STATES
recorded using mobile phones with integrated GPS and photo capabilities. We also assem-
Received: June 8, 2015
bled LTS using all available data from all spectral bands and a suite of additional indices
Accepted: December 29, 2015 and temporal metrics based on time series trajectory analysis. We predicted deforestation,
Published: March 28, 2016 degradation or stable forests using random forest models trained with data from local
Copyright: © 2016 DeVries et al. This is an open experts and LTS spectral-temporal metrics as model covariates. Resulting models pre-
access article distributed under the terms of the dicted deforestation and degradation with an out of bag (OOB) error estimate of 29% over-
Creative Commons Attribution License, which permits all, and 26% and 31% for the deforestation and degradation classes, respectively. By
unrestricted use, distribution, and reproduction in any
dividing the local expert data into training and operational phases corresponding to local
medium, provided the original author and source are
credited. monitoring activities, we found that forest change models improved as more local expert
data were used. Finally, we produced maps of deforestation and degradation using the
Data Availability Statement: All remote sensing
datasets are freely available from the USGS Earth most important spectral bands. The results in this study represent some of the first to com-
Explorer portal (http://earthexplorer.usgs.gov). Local bine local expert based forest change data and dense LTS, demonstrating the complemen-
expert monitoring data and code used for analysis tary value of both continuous data streams. Our results underpin the utility of both datasets
are available online at http://dx.doi.org/10.5281/
zenodo.44611.
and provide a useful foundation for integrated forest monitoring systems relying on data
streams from diverse sources.
Funding: This work was supported by German
Federal Ministry for the Environment, Nature
Conservation and Nuclear Safety (BMU) International
Climate Initiative (IKI) through the project:
"Biodiversity under Climate Change: Community
Based Conservation, Management and Development
Concepts for the Wild Coffee Forests", in partnership
AVHRR GIMMS3g data [30] or annual Landsat composites [27]. Few studies have applied
analogous techniques to time series with missing data (“irregular” time series) such as LTS data
using all available observations [31].
Even with increasingly sophisticated tools for quantifying and describing forest changes
using satellite image time series, the involvement of local people in monitoring activities (such
as in Community-Based Forestry projects) is necessary to ensure sustainability [32, 33] and
equity [34] in forest management programmes such as REDD+. Community involvement in
monitoring activities has also been shown to reduce overall monitoring costs with negligible
trade-offs in data quality for certain monitoring applications [35]. Use of community-based
monitoring (CBM) data or volunteered geo-information (VGI) data have been previously
shown to be promising in such applications as land cover validation [36], climate change
impact studies [37] or forest carbon stock estimation [35, 38]. Emerging technologies such as
smart phones [35, 39] improve the quality and consistency of these data through functionalities
such as integrated photos and geo-tagging capabilities [40].
Another area where CBM or VGI data could add considerable value is in the training and
validation of forest change detection methods, since the validation of historical change esti-
mates is often severely limited by a lack of reliable historical reference data [41]. However, very
few studies have been undertaken to demonstrate the utility of local monitoring data in such a
context. Pratihast et al. (2014) [42] showed that local forestry experts in southern Ethiopia can
describe forest changes with much higher thematic details than is possible with satellite time
series, but some trade-offs were encountered with regards to spatial coverage and temporal
accuracy. Notably, this study found that local experts were particularly adept at describing loca-
tions and drivers of low-level degradation [42], a great deal of which is not adequately captured
by satellite-based methods [13]. There is currently a need for more research on approaches to
integrate CBM or VGI data with satellite time series data to improve the spatial, temporal and
thematic quality of forest change estimates.
The objective of this study was to investigate the utility of local expert data combined with
LTS-based trajectory analysis to characterize forest change processes. To this end, we investi-
gated three overall research questions:
1. How well can we differentiate between deforestation and forest degradation using local
expert data and Landsat time series?
2. What impact does a continuous stream of local expert data have on predictions of forest
change types?
3. How can maps of forest change types be used to describe key change processes?
To address these research questions, we used forest disturbance reports collected from 2012
to 2015 by a team of 30 forest rangers in a montane forest area in southwestern Ethiopia and
compared them with LTS trajectories. Using all available LTS data, we first derived a series of
temporal trajectory metrics from time series of each spectral band and index using an adapted
version of the BFAST algorithm [29]. We derived these metrics to describe changes in trend
and seasonal amplitudes between time series segments as well as overall time series trend and
intercepts. To address the first research question, we combined all local disturbance reports
and time series metrics to train random forest models designed to predict deforestation, degra-
dation or stable forest (no change). To address the second research question, we divided the
local expert data into training and operational phases and measured the accuracies of predicted
models as new training data were added to the models. Finally, to explore the third research
question, we used the most important spectral-temporal covariates to map deforested and
degraded forests based on LTS as of March 2015.
We studied the relationship between community-based monitoring data and dense LTS
over a tropical montane forest system in southern Ethiopia (project setting described below).
This work builds upon the work of both DeVries et al. (2015) [13] and Pratihast et al. (2014)
[42]. DeVries et al. (2015) mapped annual forest disturbances in this system using dense LTS,
for which degradation proved elusive [13]. Pratihast et al. (2014), on the other hand, showed
that local rangers in the study area were able to capture degradation sooner than was possible
with manual interpretation of very high resolution optical imagery [42]. This study builds
upon both of these papers in its attempt to combine community-based monitoring data with
dense LTS towards mapping deforestation and low-level degradation with improved confi-
dence and consistency.
Methods
Study Area and Project Context
This study was carried out in the UNESCO Kafa Biosphere Reserve (hereafter referred to as “Kafa
BR”) in southwestern Ethiopia. The Kafa BR comprises an Afro-montane forest system consisting
mostly of highly fragmented moist evergreen forests, forest-cropland matrix landscapes, coffee
forests, tree plantations and wetlands. A detailed description of the study area as well as the driv-
ers of deforestation and forest degradation is provided in DeVries et al. (2015) [13].
The research in this study was carried out in the frame of a project implemented by the Ger-
man Nature and Biodiveristy Conservation Union (NABU), in partnership with the Kafa Zone
Bureau of Agriculture, the zonal office of the Ethiopian Ministry of Agriculture. This project
aimed to reduce carbon emissions from deforestation and forest degradation in the Kafa BR
and to promote conservation and sustainable management of remaining forest resources in the
area. In line with the projects goals, the region was inaugurated as a Biosphere Reserve in 2011
under the UNESCO Man and the Biosphere (MAB) programme and was zoned according to
land use (Fig 1).
As part of these initiatives, 30 forest rangers (hereafter referred to as “local experts”) were
recruited to implement forest management, monitoring and community outreach activities in
each of the 10 local districts (woredas) within the Kafa BR. As part of their monitoring man-
date, local experts were trained in methods and tools to report and describe forest changes,
including disturbances (deforestation and degradation) and positive changes (afforestation and
reforestation). Fig 1 shows the geo-location of the disturbance reports provided by local experts
between 2012 and 2015 which were used in this study. The details of these reports are described
below, and have also been described in detail in a previous study in the area [42]. The overall
goal of the current study was to develop an integrated monitoring system using the knowledge
of the local experts in combination with Landsat time series and very high resolution (VHR)
time series [42] to track forest change throughout the Kafa BR.
Fig 1. Study area located in the UNESCO Kafa Biosphere Reserve in the Southern Nations, Nationalities and Peoples Republic (SNNPR) state of
southwestern Ethiopia. Biosphere Reserve zones and location of local expert disturbance reports (deforestation and degradation) and additional reference
data (no-change) are shown. The locations of map tiles from Fig 9 are shown as boxes labeled A to D.
doi:10.1371/journal.pone.0147121.g001
In this study, we limited the definitions of deforestation and degradation to the tree canopy
dimension described above. In other words, if the forest canopy was reduced to below our for-
est definition canopy cover threshold of 20% at the pixel or plot level, we assigned a “deforesta-
tion” label, regardless of the total contiguous area cleared. Any negative changes evident that
still resulted in a canopy cover of above 20% thus resulted in a label of “degradation”. We
neglected the area-based definition in this study for two reasons. First, it was often difficult to
determine with certainty the total area affected from local expert disturbance reports, but can-
opy condition could be verified using plot photos submitted by local experts. Second, we sought
to derive relationships between temporal metrics derived from LTS and change classes derived
from local expert disturbance data, and spatial context was thus not considered here.
A summary of our methods is provided in Fig 2. We describe the datasets and individual
steps taken in detail below.
LTS Pre-processing
We downloaded all available Landsat imagery from the Landsat5-TM, Landsat7-ETM+ and
Landsat8-OLI sensors with cloud cover below 80% per scene and processing level L1T from
the USGS Earth Explorer system. We selected all available spectral bands except for the ther-
mal band (shown in Table 1). All TM and ETM+ scenes were already processed to surface
reflectance level using the Landsat Ecosystem Disturbance Adaptive Processing System
(LEDAPS) atmospheric and topographic correction algorithm [48]. OLI scenes were already
processed to surface reflectance level by the USGS internal L8SR algorithm. We applied a
cloud mask derived from the Function of Mask (FMASK) algorithm [49] to each of the
scenes, masking out clouds, cloud shadows and gaps due to the malfunctioning scan-line cor-
rector (SLC) of the ETM+ sensor. Since there were virtually no image acquisitions over our
study area during the 1990’s, leaving a large gap in the Landsat archive, we limited our time
series to all data after and including 1999, coinciding with the launch of the ETM+ sensor.
From a visual screening of all imagery in the archive, we identified cloud pixels frequently
missed by the FMASK-derived cloud mask, especially where these clouds coincided with
SLC-off gaps in ETM+ images. To reduce the number of these contaminations, we applied a
5-pixel sieve to all images, where pixel clusters surrounded by masked values of five pixels or
less were removed from the images. In our assessment, we did not find any significant geo-
location errors in the dataset. Since the noise component of the BFAST method [29] can
account for occasional outliers due to such errors, we did not carry out any further quality
assessment.
Fig 2. Flowchart of methods used in this study. Processes are shown as rectangles and data and results are shown as parallelograms.
doi:10.1371/journal.pone.0147121.g002
Fig 3. Photo evidence from local disturbance reports documenting deforestation (A) and degradation
(B). The location shown in panel A corresponds to the time series shown in Fig 4, and the location shown in
panel B corresponds to the time series shown in Fig 5.
doi:10.1371/journal.pone.0147121.g003
Using the pre-processed surface reflectance layers shown in Table 1, we computed a selec-
tion of spectral indices, shown in Table 2. These indices have been shown in previous research
to be sensitive to vegetation characteristics, states or change dynamics [50–57]. Coefficients for
the three basic tasseled cap indices (brightness, greenness and wetness) are shown as b, g and
w, respectively, in Table 2. Since data from all sensors were pre-preprocessed to surface reflec-
tance products, we used the same surface reflectance derived tasseled cap coefficients across all
sensors [27, 55], which are shown in S1 Table in the Supplemental Materials.
Since we used all spectral bands and derived indices in our forest change models, we refer to
the combination of bands and indices as “spectral bands” for the remainder of this study.
Table 1. Spectral bands on the Landsat TM, ETM+ and OLI sensors.
doi:10.1371/journal.pone.0147121.t001
doi:10.1371/journal.pone.0147121.t002
distribution of data with outliers [58]. This choice of fitting method was motivated by the fact
that full Landsat time series commonly contain noise due to unmasked clouds or other sources
[13, 19, 59]. The output of this method applied to each time series and spectral band thus con-
sisted of (1) the RLM intercept (using the baseline year 1999 as the origin), and (2) the RLM
slope.
While an overall RLM trend can help to describe gradual changes or to discriminate
between change and no-change classes, abrupt changes or onset of gradual changes late in a
time series may not be sufficiently captured using this method. To describe these changes, we
tested each pixel time series for each spectral band for the presence or absence of breaks using
the “breakpoints” method of Bai and Perron (2003) [60], which determines the optimal num-
ber of breaks in a time series based on the Bayesian Information Criterion (BIC; [60]). We
assumed that in the length of the time series (from 1999 to 2015), a land use or land cover
change event would occur only once, and were thus interested in identifying the most impor-
tant break. We therefore set the maximum number of breaks to one, generating a result repre-
senting the presence or absence of a break in the time series [61].
For each segment that resulted from the breakpoint computation above, we fit season-trend
models as in Verbesselt et al. (2010) [29] as follows. For a time-dependent response variable yt,
we fit the formula
2pt
yt ¼ aj þ bj t þ gj sinð þ dj Þ ð1Þ
f
where αj is the intercept, βj is the linear slope, γj is the amplitude, f is the frequency of the time
series (set to 365 days for LTS data) and δj is the phase for each segment j. Similarly to the over-
all trend fitting, we used RLM instead of ordinary least squares (OLS) in fitting the season-
trend models. The output of the time series segmented applied to each time series and spectral
band thus consisted of (1) the amplitude of the first segment (γ1), (2) the amplitude of the sec-
ond segment (γ2; equal to the first amplitude if no break was detected), (3) the trend of the first
segment (β1) and (4) the trend of the second segment (β2; equal to the first trend if no break
was detected). These outputs are shown for two sites (Fig 3) representing deforestation and
degradation in Figs 4 and 5.
Fig 4. Time series over a deforested site for four spectral bands: SWIR2, NDVI, NBR and TCW. The RLM-fitted season-trend model for each segment is
shown as a dotted line. Local disturbance photo evidence for this site is shown in Fig 3A.
doi:10.1371/journal.pone.0147121.g004
Fig 5. Time series over a degraded forest site for four spectral bands: SWIR2, NDVI, NBR and TCW. The RLM-fitted season-trend model for each
segment is shown as a dotted line. Local disturbance photo evidence for this site is shown in Fig 3B.
doi:10.1371/journal.pone.0147121.g005
Fig 6. Flowchart demonstrating the iterative updating of random forest models. Time of acquisition of local expert data (parallelograms) are shown in
the box on the right hand side. In each phase, a subset of the local expert data were used for model calibration (grey), and another subset was used for model
validation (white).
doi:10.1371/journal.pone.0147121.g006
Iterative Model Updating. Monitoring activities carried out by local experts were carried
out in phases according to project activities in the Kafa BR. Specifically, initial trainings were
held with local experts to collaboratively develop ODK-based tools for forest monitoring in
2012, after which several rounds of monitoring were carried out until 2014 [42]. From October
2014, a new Integrated Forest Monitoring System (IFMS) was piloted for the Kafa BR with
additional trainings in October, a demonstration phase in November and December 2014, and
an operational near real-time monitoring phase from January 2015 onwards. While the
research described in this paper takes place within the context of this IFMS, the details of the
system is the subject of future research in preparation, and is not the focus of this paper.
To demonstrate the use of a continuous data-stream from local experts, we ran the random
forest algorithm as described above for two time periods: (1) a training phase and (2) an opera-
tional phase roughly according to the project phases described above. We divided the local
expert data as outlined in Fig 6. During an initial “training” phase, we took all local expert data
acquired before July 2013 (“period A” in Fig 6) and used them with all LTS spectral-temporal
covariates to train a random forest model as described above. In addition to the OOB error esti-
mate, we used additional local expert data acquired during the period between July 2013 and
October 2014 (“period B” in Fig 6) to validate this model. Specifically, we compared the distri-
bution of predicted class probabilities for all disturbance locations reported in period B with
the actual change types reported by local experts. During a subsequent “operational” phase, we
fused the local expert data from periods A and B, and built a new random forest model using
all spectral-temporal covariates. We then used all local expert data acquired after October 2014
(“period C” in Fig 6) to compare predicted class probabilities with actual class labels as in the
training phase.
Selecting Important Variables. Mapping forest change classes requires that all covariates
used in the change type prediction are computed over all pixels in a scene. The computation of
breakpoints for each pixel necessary for deriving temporal metrics was computationally time-
consuming and not realistic for producing wall-to-wall change maps. We therefore decided to
produce maps using simplified random forest models built with only a subset of the most
important spectral-temporal covariates. The importance of individual covariates in random
forest models is measured either as the mean decrease in accuracy when each variable is
removed from the individual bagged decision trees or as a node impurity coefficient [62].
These measures suffer from two possible drawbacks. First, the model composition is different
with every run, resulting in different outcomes for every random forest model. Second, when
the covariates included in the model are tightly correlated with each other, interpretation of
importance can be problematic [63]. For example, if coefficients A and B are both seen to be
important predictor variables and are both highly correlated with each other, it is not clear if
the importance is due to this correlation or the underlying predictive power of either covariate.
To overcome this second drawback, Strobl et al. (2008) [63] proposed a conditional importance
measure which involves measuring importance among permuted samples of covariates. With a
large number of covariates, however, we found this approach to be computationally
unreasonable.
To circumvent this limitation, we derived a scoring algorithm based on iterations of random
forests run separately for each spectral band (Tables 1 and 2), using temporal metrics derived
from each respective band as model covariates. Specifically, we ran the algorithm 1000 times
for all temporal metrics derived from only the blue band, the green band, and so forth for all
other spectral bands. For each of the 1000 iterations, we ranked the bands based on the overall
accuracy as well as the class-specific accuracies. We then derived a score (S) for each band (j)
and change class (Δ) by taking the average normalized rank over all iterations as follows:
1XN
xi;j 1
Sj;D ¼ ð2Þ
N i n1
where xi,j is the rank of band j in iteration i, n is the total number of spectral bands and N is the
total number of iterations. xi,j was computed such that the bottom ranking band in iteration i
was assigned a value of 1, and the top ranking band was assigned a value equal to n. Since it is a
normalized rank, SΔ falls within the interval [0, 1], where a maximum score of one indicates a
top rank for all N iterations. We selected the most important spectral bands based on this scor-
ing algorithm and produced maps of change class probabilities for several sites. We applied a
forest mask produced from a Landsat ETM+ scene acquired on Feburary 2001 to filter out pix-
els representing stable non-forest from before 2001.
Results
Model Accuracies and Temporal Variable Importance
The random forest constructed with 7000 trees using all spectral-temporal covariates and train-
ing data gave an overall OOB error estimate of 29%. The deforestation class error was 26%, the
degradation class error was 31% and the no-change class error was 32%. Although subsequent
iterations of the modeling process showed inconsistencies in importance metrics, the overall
RLM trends from various spectral bands were consistently ranked as the most important pre-
dictors. The amplitude of the second segment (γ2) was also frequently highly ranked, followed
by trends of the first and second segments (β1 and β2).
Fig 7. Iterative calibration and validation of change classes. Boxplots of random forest class probabilities for the deforestation (P(DEF)), degradation (P
(DEG)) or no-change (P(NOCH)) computed for in situ data having DEF or DEG labels are shown for the training phase (top panel) and operational phase
(bottom panel) of the monitoring activities. The model updating approach is shown in Fig 6.
doi:10.1371/journal.pone.0147121.g007
degradation and 7% for no change. These class probabilities remained largely static during the
operational phase: 60% for deforestation, 34% for degradation and 2% for no change.
The median class probabilities for reference degradation locations in the training phase
were 21% for deforestation, 28% for degradation and 44% for no change. These probabilities
changed to 17% for deforestation, 46% for degradation and 31% for no change during the oper-
ational period.
Fig 8. Importance scores (S) for each band based on overall accuracies and class accuracies for deforestation (DEF), degradation (DEG) and no-
change (NOCH).
doi:10.1371/journal.pone.0147121.g008
classes into account). The most important bands for the individual change classes were SWIR2
for deforestation, TCG for degradation and G for no-change. SWIR2 achieved a perfect score
of 1 for the deforestation class, implying that it was ranked the highest in terms of deforestation
accuracy on every iteration. The NIR band, on the other hand, received a score of zero for the
no-change class, implying that it was consistently the lowest ranked band for that class over all
iterations.
Fig 9. Maps of deforestation and degradation at four sites. The probability of deforestation and degradation are shown as red and blue colour maps,
respectively. Local expert reports of deforestation (X) or degradation (+) collected between 2012 and 2015 are overlaid on the maps. The base images are
SPOT5 images (band 2; 2.5m spatial resolution) acquired between 2009 and 2011. Dark shaded areas represent forest in the SPOT5 image, and light areas
are non-forest land cover types (e.g. cropland or wetland). The locations of each tile (A to D) are shown in Fig 1.
doi:10.1371/journal.pone.0147121.g009
Fig 10. Random forest class probability histograms for deforestation (red) and degradation (blue) at each of the four sites shown in Fig 9.
doi:10.1371/journal.pone.0147121.g010
Discussion
Detecting changes using an integrated approach
Our first research question concerned the ability to distinguish deforestation and degradation
in our study area using local expert data in combination with LTS. In the current study, we pro-
vide evidence that deforestation and degradation are indeed separable using a random forest
approach, with OOB class accuracies for both deforestation and degradation on order of distur-
bance accuracies reported previously [13]. Two main factors contributed to this ability. While
a direct comparison between methods and results is difficult, a similar study conducted in the
same area achieved similar accuracies in disturbance monitoring using LTS (73% user’s and
producer’s accuracies) [13]. Similarly to DeVries et al. (2015) [13], we were able to track small-
scale deforestation (Fig 9), with the key difference that our models were able to predict degra-
dation above a 50% probability threshold in many cases. Using NDVI time series and an Ordi-
nary Logistic Regression approach, DeVries et al. (2015) [13] were unable to achieve predicted
class probabilities above 25% for degradation, precluding the mapping of degraded forest with
certainty. In Fig 9, on the other hand, we demonstrate how degradation can be mapped along-
side deforestation when prediction probabilities are sufficiently high.
Improvements in sensitivity to forest degradation are owed in part to our overall workflow.
Most other remote sensing method-related studies validate an existing method using ground-
data or visually interpreted data sampled from an existing map or result, and indeed use local
expert or community-based monitoring (CBM) data to validate samples selected from existing
results [64]. In this study, however, we used a priori training data to help to develop the method
itself. These existing data underscore the value of the local expert data stream featured in this
study. This bottom-up approach was especially important for examining the extent to which
we could track forest degradation, since local experts were able to identify cases of below-can-
opy disturbances independently of any remote sensing based datasets. Notably, with this
approach we found that SWIR-based indices are consistently more sensitive to changes in our
study area than indices based on the NIR or visible wavelengths, such as NDVI [13].
The flexibility of our bottom-up integration approach can be extended to land cover
changes not explored in this study. We assumed that significant land cover changes occur a
maximum of one time during a 16-year time series. While this assumption is generally reason-
able for Southern Ethiopia, where small-holder agriculture drives deforestation and tends
towards permanent agriculture [65], it does not hold true for other shifting agricultural sys-
tems, where multiple disturbance-recovery cycles would be expected in the time series [66].
Our approach can still be tuned to such cases, whereby in situ forest state observations (“defor-
ested” or “degraded” in this study) can be used to classify such patterns based on their spectral-
temporal signatures.
alerts. Such a system is expected to spur increased and enhanced local monitoring data, allow-
ing for further development and testing of forest change models.
canopy. Other forms of forest degradation, including alteration of ecosystem function by lianas
[69–71] or other invasive species [72], are unlikely to be captured by LTS spectral-temporal
covariates if the canopy itself is not sufficiently impacted. In such cases, the in situ data stream
discussed here plays an important role as an indicator of where such types of degradation are
occurring and not being sufficiently detected by LTS data.
Sampling considerations. The data used in the the iterative validation of the random for-
est models were not probabilistically sampled, but were rather based on purposive observations
by local experts. As can be expected from CBM-based data streams, local expert data were lim-
ited to locations that were accessible to the forest rangers in this study. Accessibility limitations
are not only limited to the spatial distribution of local expert observations, but also to the tim-
ing and frequency of observations [42]. Prescribing plot locations, on the other hand, could
lead to the temptation to either approximate site locations (negatively affecting the spatial data
quality) or to forgo monitoring altogether (negatively affecting the data stream). A purposive
sampling design was therefore necessary for preserving the quality and quantity of the local
expert data collected in this study.
Despite drawbacks in sampling and validation, the internal OOB sample provided by the
random forest models provide an alternative robust measure of model accuracy. Additionally,
we demonstrated the ability of continuously acquired local expert data to improve and validate
the random forest models over time (Fig 7). The maps produced by these models (Fig 9) can be
used to support the continuous training and validation of random forest models by directing
local experts to locations with high probability of forest change.
Timing of changes. The timing of change is an important feature of forest monitoring, for
which reference data often consist of visually interpreted imagery [41]. Even though local
experts also record disturbance timing, we did not attempt to model change timing in this study
due especially to uncertainties in the local expert data. These uncertainties arose largely because
of the way in which change types and onset times are defined. Pratihast et al. (2014) [42] found
that temporal discrepancies between change times recorded by local experts and those observed
using very high resolution imagery arose because of two possible differences. First, local rangers
are able to detect understorey degradation before this is visible to satellite sensors, causing a
temporal lag on the side of the satellite data. Second, local experts tended to define deforestation
in terms of land use, implying that preceding degradation activities (e.g. for fuelwood and tim-
ber harvesting or understorey coffee cultivation) were not interpreted as deforestation, causing a
temporal lag on the side of the local experts [42]. To avoid confusion in our change models, we
decided therefore to focus on the thematic dimension of forest change.
Continuity and Consistency of Time Series. The continuity of the Landsat observation
record is the motivation behind the launch of the eighth Landsat sensor in 2013 [73]. Since
some part of the Kafa BR are known to be Landsat data poor [13], the addition of OLI data at
the end of the LTS is seen as a distinct advantage in this study. The spectral resolution
(Table 1) and radiometric resolution (higher bit depth than that of Landsat 7 and 5) are two
major differences between Landsat 8 and its predecessors that were not taken into account in
this study, however. Research has shown that despite a difference in dynamic range of NIR
spectral reflectance values between OLI and ETM+ data, surface reflectance and derived met-
rics do not differ significantly between sensors [74]. Further research into the cross-sensor
comparability and need for normalization for other systems and objectives is still needed, how-
ever. Specifically, significant differences in spectral reflectance could have an impact on class
predictions made in this study.
Overcoming limitations using Integrated Forest Monitoring. Limitations in sampling
and change timing could be addressed by further exploring the idea of an interactive monitor-
ing system between local experts and remote sensing specialists. Future research is aimed at
demonstrating an operational IFMS for the Kafa BR that is designed to support such ongoing
monitoring activities. Such research should further investigate how the forest change outputs
of our method can be used in an interactive environment to support follow-up monitoring,
management and enforcement, including the temporal dimension of change in the context of a
near real-time interactive monitoring system, for example.
Conclusions
In this study, we have provided the first demonstration of local expert forest monitoring data
integrated with Landsat Time Series (LTS) using a machine learning (random forest) approach.
We found that local expert monitoring data and dense LTS are valuable in training and valida-
tion random forest models to predict deforestation and degradation in complex forest matrix
landscapes. Notably, we showed that as local expert monitoring data continued to be collected
and received, model results improved, demonstrating the potential of an ongoing forest moni-
toring system featuring both data streams. From the models, we determined that the SWIR2
and TCW spectral bands were the most important for differentiating deforestation and degra-
dation, and used temporal covariates based on these bands to produce spatial predictions of
forest change. This study provides a basis on which further research on integrated forest moni-
toring systems, particularly those seeking to integrate community-based monitoring (CBM) or
volunteered geo-information (VGI) data with dense satellite time series. Future research will
follow-up on our approach by incorporating other data sources using data fusion methods
[75], such as Sentinel-2, terrestrial or airborne LiDAR or other airborne remote sensing data-
sets. Furthermore, our approach is flexible to the types of predictions and can include other
types of forest change as needed, such as afforestation and reforestation activities.
Supporting Information
S1 Fig. Local expert data pre-precessing workflow. Decision flowchart for classification of
local disturbance reports. The primary class labels deforestation (DEF), degradation (DEG),
no change (stable forest) or non-forest were assigned based on automatic interpretation of
form attributes (circles with hatched outlines). Primary class labels were then verified using
plot photos, plot descriptions and very high resolution (VHR) satellite imagery and final class
labels (circles with solid outlines) were assigned.
(TIFF)
S1 Table. Tasseled Cap coefficients for surface reflectance data. Coefficients used to trans-
form reflectance bands from all Landsat sensors into tasseled cap indices.
(PDF)
S2 Table. Random forest importance scores. Random forest scores based on overall accura-
cies and class accuracies for deforestation (DEF), degradation (DEG), no-change (NOCH).
Spectral bands are shown from highest to lowest overall importance scores.
(PDF)
Acknowledgments
This research was conducted with a grant from the Nature and Biodiversity Conservation
Union (NABU) under the project entitled “Biodiversity under Climate Change: Community
Based Conservation, Management and Development Concepts for the Wild Coffee Forests”
with funding from the German Federal Ministry for the Environment, Nature Conservation
and Nuclear Safety (BMU) through the International Climate Initiative (IKI). Additional
support came through the project entitled “From Climate Research to Action under Multilevel
Governance: Building Knowledge and Capacity at Landscape Scale” in partnership with the
Center for International Forestry Research (CIFOR), also through the IKI, and through a Goo-
gle Earth Engine Research Award for the project “Interactive forest monitoring using satellite
data and community-observations in the Google platform”. Landsat Surface Reflectance prod-
ucts were provided free of charge by the U.S. Geological Survey (USGS). We are grateful to the
staff of NABU, Ethiopia and Germany, and the Kafa Zone Bureau of Agriculture, Ethiopia, for
their assistance in this research. Finally, we recognize the two anonymous reviewers whose
comments greatly improved this manuscript.
Author Contributions
Conceived and designed the experiments: BD AKP JV LK MH. Performed the experiments:
BD AKP. Analyzed the data: BD. Contributed reagents/materials/analysis tools: BD AKP.
Wrote the paper: BD.
References
1. Gullison RE, Frumhoff PC, Canadell JG, Field CB, Nepstad DC, Hayhoe K, et al. Tropical forests and
climate policy. Science. 2007; 316(5827):985–986. Available from: http://www.globalcarbonproject.org/
global/pdf/pep/Post2006/Gullison.2007.DeforestationAll.Science.pdf. doi: 10.1126/science.1136163
PMID: 17495140
2. van der Werf GR, Morton DC, DeFries RS, Olivier JGJ, Kasibhatla PS, Jackson RB, et al. CO2 emis-
sions from forest loss. Nature Geoscience. 2009; 2(11):737–738. doi: 10.1038/ngeo671
3. Laurance WF, Useche DC, Rendeiro J, Kalka M, Bradshaw CJa, Sloan SP, et al. Averting biodiversity
collapse in tropical forest protected areas. Nature. 2012 Sep; 489(7415):290–4. Available from: http://
www.ncbi.nlm.nih.gov/pubmed/22832582. doi: 10.1038/nature11318 PMID: 22832582
4. DeFries R, Hansen A, Newton AC, Hansen MC. Increasing Isolation of Protected Areas in Tropical For-
ests Over the Past Twenty Years. Ecological Applications. 2005 Feb; 15(1):19–26. Available from:
http://www.esajournals.org/doi/abs/10.1890/03-5258. doi: 10.1890/03-5258
5. Aerts R, Berecha G, Honnay O. Protecting coffee from intensification. Science. 2015; 347(6218):139.
doi: 10.1126/science.347.6218.139-b PMID: 25574013
6. Angelsen A. Realising REDD+: National strategy and policy options. Brockhaus M, Kanninen M, Sills
E, Sunderlin WD, Wertz-Kanounnikoff S, editors. Cifor; 2009.
7. Herold M, Skutsch M. Monitoring, reporting and verification for national REDD + programmes: two pro-
posals. Environmental Research Letters. 2011 Jan; 6(1):014002. Available from: http://stacks.iop.org/
1748-9326/6/i=1/a=014002?key=crossref.b8a06ec5da341082aacb4442178ff46f. doi: 10.1088/1748-
9326/6/1/014002
8. DeVries B, Herold M. The Science of Measuring, Reporting and Verification (MRV). In: Lyster R, Mac-
Kenzie C, McDermott C, editors. Law, Tropical Forests and Carbon: The Case of REDD+. Cambridge:
Cambridge Univ Press; 2013. p. 151–183.
9. Penman J, Gytarsky M, Hiraishi T, Krug T, Kruger D, Pipatti R, et al. Good Practice Guidance for Land
Use, Land-Use Change and Forestry. Intergovernmental Panel on Climate Change (IPCC); 2003.
10. De Sy V, Herold M, Achard F, Asner GP, Held A, Kellndorfer J, et al. Synergies of multiple remote sens-
ing data sources for REDD+ monitoring. Current Opinion in Environmental Sustainability. 2012 Oct;p.
1–11. Available from: http://linkinghub.elsevier.com/retrieve/pii/S1877343512001200.
11. Coppin P, Jonckheere I, Nackaerts K, Muys B, Lambin E. Digital change detection methods in ecosys-
tem monitoring: a review. International Journal of Remote Sensing. 2004 May; 25(9):1565–1596. Avail-
able from: http://www.informaworld.com/openurl?genre=article&doi=10.1080/0143116031000101675
&magic=crossref||D404A21C5BB053405B1A640AFFD44AE3. doi: 10.1080/0143116031000101675
12. Romijn E, Herold M, Kooistra L, Murdiyarso D, Verchot L. Assessing capacities of non-Annex I coun-
tries for national forest monitoring in the context of REDD+. Environmental Science & Policy. 2012
May; 19–20:33–48. Available from: http://linkinghub.elsevier.com/retrieve/pii/S1462901112000202.
doi: 10.1016/j.envsci.2012.01.005
13. DeVries B, Verbesselt J, Kooistra L, Herold M. Robust monitoring of small-scale forest disturbances in
a tropical montane forest using Landsat time series. Remote Sensing of Environment. 2015; 161:107–
32. Conrad CC, Hilchey KG. A review of citizen science and community-based environmental monitoring:
Issues and opportunities. Environmental Monitoring and Assessment. 2011; 176(1–4):273–291. doi:
10.1007/s10661-010-1582-5 PMID: 20640506
33. Boissière M, Beaudoin G, Hofstee C, Rafanoharana S. Participating in REDD+ Measurement, Report-
ing, and Verification (PMRV): Opportunities for local people? Forests. 2014; 5(8):1855–1878. doi: 10.
3390/f5081855
34. Skutsch M, Turnhout E, Vijge MJ, Herold M, Wits T, Den Besten JW, et al. Options for a national frame-
work for benefit distribution and their relation to community-based and national REDD+ monitoring. For-
ests. 2014; 5(7):1596–1617. doi: 10.3390/f5071596
35. Pratihast A, Herold M, Avitabile V, de Bruin S, Bartholomeus H, C Jr, et al. Mobile Devices for Commu-
nity-Based REDD+ Monitoring: A Case Study for Central Vietnam. Sensors. 2012 Dec; 13(1):21–38.
Available from: http://www.mdpi.com/1424-8220/13/1/21/. doi: 10.3390/s130100021 PMID: 23344371
36. Foody GM, Boyd DS. Using volunteered data in land cover map validation: Mapping west African for-
ests. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2013; 6
(3):1305–1312. doi: 10.1109/JSTARS.2013.2250257
37. Delbart N, Beaubien E, Kergoat L, Le Toan T. Comparing land surface phenology with leafing and flow-
ering observations from the PlantWatch citizen network. Remote Sensing of Environment. 2015;
160:273–280. Available from: http://linkinghub.elsevier.com/retrieve/pii/S0034425715000218. doi: 10.
1016/j.rse.2015.01.012
38. Brofeldt Sr, Theilade I, Burgess ND, Danielsen F, Poulsen MK, Adrian T, et al. Community monitoring
of carbon stocks for REDD+: Does accuracy and cost change over time? Forests. 2014; 5(8):1834–
1854. doi: 10.3390/f5081834
39. Ferster CJ, Coops NC. Integrating volunteered smartphone data with multispectral remote sensing to
estimate forest fuels. International Journal of Digital Earth. 2015;(February):1–26. Available from: http://
www.tandfonline.com/doi/abs/10.1080/17538947.2014.1002865.
40. Bigagli L, Santoro M, Mazzetti P, Nativi S. Architecture of a Process Broker for Interoperable Geospatial
Modeling on the Web. ISPRS International Journal of Geo-Information. 2015; 4(2):647–660. Available
from: http://www.mdpi.com/2220-9964/4/2/647/. doi: 10.3390/ijgi4020647
41. Cohen WB, Yang Z, Kennedy R. Detecting trends in forest disturbance and recovery using yearly Land-
sat time series: 2. TimeSync—Tools for calibration and validation. Remote Sensing of Environment.
2010 Dec; 114(12):2911–2924. Available from: http://linkinghub.elsevier.com/retrieve/pii/
S0034425710002269. doi: 10.1016/j.rse.2010.07.010
42. Pratihast A, DeVries B, Avitabile V, de Bruin S, Kooistra L, Tekle M, et al. Combining Satellite Data and
Community-Based Observations for Forest Monitoring. Forests. 2014 Oct; 5(10):2464–2489. Available
from: http://www.mdpi.com/1999-4907/5/10/2464/. doi: 10.3390/f5102464
43. Lambin EF. Monitoring forest degradation in tropical regions by remote sensing: some methodological
issues. Global Ecology and Biogeography. 1999 May; 8(3–4):191–198. Available from: http://doi.wiley.
com/10.1046/j.1365-2699.1999.00123.x. doi: 10.1046/j.1365-2699.1999.00123.x
44. Hirschmugl M, Steinegger M, Gallaun H, Schardt M. Mapping Forest Degradation due to Selective Log-
ging by Means of Time Series Analysis: Case Studies in Central Africa. Remote Sensing. 2014 Jan; 6
(1):756–775. Available from: http://www.mdpi.com/2072-4292/6/1/756/. doi: 10.3390/rs6010756
45. Morales-Barquero L, Skutsch M, Jardel-Peláez E, Ghilardi A, Kleinn C, Healey J. Operationalizing the
Definition of Forest Degradation for REDD+, with Application to Mexico. Forests. 2014 Jul; 5(7):1653–
1681. Available from: http://www.mdpi.com/1999-4907/5/7/1653/. doi: 10.3390/f5071653
46. Anokwa Y, Hartung C, Brunette W. Open Source Data Collection in the Developing World. Computer.
2009; 42(10):97–99. doi: 10.1109/MC.2009.328
47. Comber A, See L, Fritz S, Van der Velde M, Perger C, Foody G. Using control data to determine the reli-
ability of volunteered geographic information about land cover. International Journal of Applied Earth
Observation and Geoinformation. 2013 Aug; 23:37–48. Available from: http://linkinghub.elsevier.com/
retrieve/pii/S0303243412002358. doi: 10.1016/j.jag.2012.11.002
48. Vermote EF, Deuzé JL, Herman M, Morcrette JJ. Second simulation of the satellite signal in the solar
spectrum, 6S: An overview. IEEE Transactions on Geoscience and Remote Sensing. 1997; 35(3):675–
686. Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=581987. doi: 10.1109/36.
581987
49. Zhu Z, Woodcock CE. Object-based cloud and cloud shadow detection in Landsat imagery. Remote
Sensing of Environment. 2012 Mar; 118:83–94. Available from: http://linkinghub.elsevier.com/retrieve/
pii/S0034425711003853. doi: 10.1016/j.rse.2011.10.028
50. Tucker CJ. Red and photographic infrared linear combinations for monitoring vegetation. 1979;
150:127–150.
51. Wilson EH, Sader Sa. Detection of forest harvest type using multiple dates of Landsat TM imagery.
Remote Sensing of Environment. 2002 Jun; 80(3):385–396. Available from: http://linkinghub.elsevier.
com/retrieve/pii/S0034425701003182. doi: 10.1016/S0034-4257(01)00318-2
52. Jin S, Sader Sa. Comparison of time series tasseled cap wetness and the normalized difference mois-
ture index in detecting forest disturbances. Remote Sensing of Environment. 2005 Feb; 94(3):364–372.
Available from: http://linkinghub.elsevier.com/retrieve/pii/S0034425704003414. doi: 10.1016/j.rse.
2004.10.012
53. Key CH, Benson NC. Landscape assessment: Ground measure of severity, the composite burn index;
and remote sensing of severity, the Normalized Burn Ratio. FIREMON: Fire effects monitoring and
inventory system, USDA Forest Service General Technical Report RMRS-GTR-164-CD. Fort Collins,
CO: USDA Forest Service Rocky Mountain Research Station; 2006.
54. Crist EP, Cicone RC. A Physically-Based Transformation of Thematic Mapper Data—The TM Tasseled
Cap. IEEE Transactions on Geoscience and Remote Sensing. 1984 May; GE-22(3):256–263. Avail-
able from: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4157507. doi: 10.1109/
TGRS.1984.350619
55. Crist E. A TM Tasseled Cap Equivalent Transformation for Reflectance Factor Data. Remote Sensing
of Environment. 1985; 306:301–306. Available from: http://www.sciencedirect.com/science/article/pii/
0034425785901026. doi: 10.1016/0034-4257(85)90102-6
56. Gómez C, White JC, Wulder Ma, Alejandro P. Historical forest biomass dynamics modelled with Land-
sat spectral trajectories. ISPRS Journal of Photogrammetry and Remote Sensing. 2014 Jul; 93:14–28.
Available from: http://linkinghub.elsevier.com/retrieve/pii/S0924271614000719. doi: 10.1016/j.
isprsjprs.2014.03.008
57. Ahmed OS, Franklin SE, Wulder Ma. Interpretation of forest disturbance using a time series of Landsat
imagery and canopy structure from airborne lidar. Canadian Journal of Remote Sensing. 2014 Jun; 39
(6):521–542. Available from: http://www.tandfonline.com/doi/abs/10.5589/m14-004. doi: 10.5589/m14-
004
58. Huber PJ. Robust Estimation of a Location Parameter. The Annals of Mathematical Statistics. 1964; 35
(1):73–101. doi: 10.1214/aoms/1177703732
59. Broich M, Hansen MC, Potapov P, Adusei B, Lindquist E, Stehman SV. Time-series analysis of multi-
resolution optical imagery for quantifying forest cover loss in Sumatra and Kalimantan, Indonesia. Inter-
national Journal of Applied Earth Observation and Geoinformation. 2011 Apr; 13(2):277–291. Available
from: http://linkinghub.elsevier.com/retrieve/pii/S0303243410001340. doi: 10.1016/j.jag.2010.11.004
60. Bai J, Perron P. Computation and analysis of multiple structural change models. Journal of Applied
Econometrics. 2003 Jan; 18(1):1–22. Available from: http://doi.wiley.com/10.1002/jae.659. doi: 10.
1002/jae.659
61. de Jong R, Verbesselt J, Zeileis A, Schaepman M. Shifts in Global Vegetation Activity Trends. Remote
Sensing. 2013 Mar; 5(3):1117–1133. Available from: http://www.mdpi.com/2072-4292/5/3/1117/. doi:
10.3390/rs5031117
62. Breiman L. Random forests. Machine learning. 2001;p. 5–32. doi: 10.1023/A:1010933404324
63. Strobl C, Boulesteix AL, Kneib T, Augustin T, Zeileis A. Conditional variable importance for random for-
ests. BMC bioinformatics. 2008; 9:307. doi: 10.1186/1471-2105-9-307 PMID: 18620558
64. Bellfield H, Sabogal D, Goodman L, Leggett M. Case Study Report: Community-Based Monitoring Sys-
tems for REDD+ in Guyana. Forests. 2015; 6(1):133–156. Available from: http://www.mdpi.com/1999-
4907/6/1/133/. doi: 10.3390/f6010133
65. FAO. Changes in shifting cultivation in Africa. FAO forestry paper 50. Forestry department.; 1984.
66. Molinario G, Hansen MC, Potapov PV. Forest cover dynamics of shifting cultivation in the Democratic
Republic of Congo: a remote sensing-based assessment for 2000–2010. Environmental Research Let-
ters. 2015; 10(9):094009. Available from: http://stacks.iop.org/1748-9326/10/i=9/a=094009?
key=crossref.255fa2c946c3df8fed3e20ccd9dd3612. doi: 10.1088/1748-9326/10/9/094009
67. Gonsamo A, D’odorico P, Pellikka P. Measuring fractional forest canopy element cover and openness
—definitions and methodologies revisited. Oikos. 2013 Sep; 122(9):1283–1291. Available from: http://
doi.wiley.com/10.1111/j.1600-0706.2013.00369.x. doi: 10.1111/j.1600-0706.2013.00369.x
68. Confalonieri R, Foi M, Casa R, Aquaro S, Tona E, Peterle M, et al. Development of an app for estimat-
ing leaf area index using a smartphone. Trueness and precision determination and comparison with
other indirect methods. Computers and Electronics in Agriculture. 2013; 96:67–74. Available from:
http://dx.doi.org/10.1016/j.compag.2013.04.019. doi: 10.1016/j.compag.2013.04.019
69. Schnitzer SA, Bongers F. Increasing liana abundance and biomass in tropical forests: Emerging pat-
terns and putative mechanisms. Ecology Letters. 2011; 14(4):397–406. Cited By 117. Available from:
http://www.scopus.com/inward/record.url?eid=2-s2.0-79952504440&partnerID=40&md5=
f912dcd8681b8d1534e8489795b4d5df. doi: 10.1111/j.1461-0248.2011.01590.x PMID: 21314879
70. Schnitzer SA, Bongers F, Wright SJ. Community and ecosystem ramifications of increasing lianas in
neotropical forests. Plant Signaling and Behavior. 2011; 6(4):598–600. Cited By 13. Available from:
http://www.scopus.com/inward/record.url?eid=2-s2.0-79955578791&partnerID=40&md5=
5b0e77dfd34d0b3770c4a0f0113af0c1. doi: 10.4161/psb.6.4.15373 PMID: 21494089
71. Senbeta F, Schmitt C, Denich M, Demissew S, Velk PLG, Preisinger H, et al. The diversity and distribu-
tion of lianas in the Afromontane rain forests of Ethiopia. Diversity and Distributions. 2005 Jul; 11
(5):443–452. Available from: http://blackwell-synergy.com/doi/abs/10.1111/j.1366-9516.2005.00180.x.
doi: 10.1111/j.1366-9516.2005.00180.x
72. Morris RJ. Anthropogenic impacts on tropical forest biodiversity: A network structure and ecosystem
functioning perspective. Philosophical Transactions of the Royal Society B: Biological Sciences. 2010;
365(1558):3709–3718. Cited By 0. Available from: http://www.scopus.com/inward/record.url?eid=2-s2.
0-78650404299&partnerID=40&md5=d8e533f4d2df5529733b48c42bd31fa9. doi: 10.1098/rstb.2010.
0273
73. Irons JR, Dwyer JL, Barsi Ja. The next Landsat satellite: The Landsat Data Continuity Mission. Remote
Sensing of Environment. 2012 jul; 122:11–21. Available from: http://linkinghub.elsevier.com/retrieve/
pii/S0034425712000363. doi: 10.1016/j.rse.2011.08.026
74. Li P, Jiang L, Feng Z. Cross-comparison of vegetation indices derived from landsat-7 enhanced the-
matic mapper plus (ETM+) and landsat-8 operational land imager (OLI) sensors. Remote Sensing.
2013; 6(1):310–329. doi: 10.3390/rs6010310
75. Reiche J, Verbesselt J, Hoekman D, Herold M. Fusing Landsat and SAR time series to detect defores-
tation in the tropics. Remote Sensing of Environment. 2015 Jan; 156:276–293. Available from: http://
linkinghub.elsevier.com/retrieve/pii/S0034425714003885. doi: 10.1016/j.rse.2014.10.001