Jun 24, 2016 - Selected European Validation (EUVAL) Sites for biome assessment . ..... biome for LAI (top panel), FAPAR (bottom left panel) and FCover ...
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
Gio Global Land Component - Lot I ”Operation of the Global Land Component” Framework Service Contract N° 388533 (JRC)
Quality Assessment Report LAI, FAPAR, FCover Collection 300m Version 1
Issue I1.10
Organization name of lead contractor for this deliverable: EOLAB
Book Captain:
Fernando Camacho
Contributing Authors:
Jorge Sánchez, Consuelo Latorre (EOLAB)
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
Dissemination Level PU PP RE CO
Public Restricted to other programme participants (including the Commission Restricted Services) to a group specified by the consortium (including the Commission Confidential, only for members of the consortium (including the Commission Services) Services)
Document-No. Issue: I1.10
GIOGL1_QAR_LAI300m-V1 Date: 20.09.2016
X
© GIO-GL Lot1 consortium 2 of 116 Page:
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
Document Release Sheet
Book Captain:
Fernando Camacho
Approval:
Roselyne Lacaze
Endorsement:
Michael Cherlet
Distribution:
Public
Document-No. Issue: I1.10
GIOGL1_QAR_LAI300m-V1 Date: 20.09.2016
Sign
Date 20.09.2016
Sign
Date 28.09.2016
Sign
Date
© GIO-GL Lot1 consortium 3 of 116 Page:
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
Change Record
Issue/Rev
I1.00
I1.01
Date
Page(s)
Description of Change
Release
23.07.2015
All
Quality assessment of Collection 300m Version 1 products (GEOV3) over Europe
I1.00
Remove internal recommendations for public release of the document
I1.01
Update after external review: algorithms summary inserted; major axis regression, pvalue included; accuracy assessment improved
I1.10
24.06.2016
20.09.2016
Document-No. Issue: I1.10
27-33 39-49 58-80
GIOGL1_QAR_LAI300m-V1 Date: 20.09.2016
© GIO-GL Lot1 consortium 4 of 116 Page:
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
Table Of Contents 1
Background of the document ............................................................................................. 15 1.1
Executive Summary ............................................................................................................... 15
1.2
Scope and Objectives............................................................................................................. 15
1.3
Content of the document....................................................................................................... 16
1.4
Related documents ............................................................................................................... 16
1.4.1 1.4.2 1.4.3 1.4.4
Applicable documents ................................................................................................................................ 16 Input............................................................................................................................................................ 16 Output ......................................................................................................................................................... 17 External documents .................................................................................................................................... 17
2
Review of Users Requirements ........................................................................................... 19
3
Quality Assessment Method .............................................................................................. 22
4
3.1
Overvall procedure ................................................................................................................ 22
3.2
Satelite Products ................................................................................................................... 27
3.3
In-situ Reference Products ..................................................................................................... 33
3.4
Selected European Validation (EUVAL) Sites for biome assessment ......................................... 35
Results .............................................................................................................................. 37 4.1
Product Completeness ........................................................................................................... 37
4.2
Spatial Consistency ................................................................................................................ 39
4.2.1 4.2.2 4.2.3
4.3 4.3.1 4.3.2
Temporal Consistency analysis............................................................................................... 49 Temporal consistency of GEOV3 modes ..................................................................................................... 49 Temporal consistency of GEOV3 with reference products ......................................................................... 51
4.4
Intra-Annual Precision ........................................................................................................... 53
4.5
Overall statistical consistency ................................................................................................ 54
4.6
Analysis per biome type ........................................................................................................ 56
4.7
Accuracy Assessment ............................................................................................................ 58
4.7.1 4.7.2 4.7.3
5
Visual inspection of global maps................................................................................................................. 39 Spatial distribution of differences ............................................................................................................... 43 Distribution of retrievals and differences per Biome Type ......................................................................... 46
Direct Validation per site ............................................................................................................................ 59 Overall direct validation .............................................................................................................................. 77 2 Direct validation over averaged values (3x3 km ) for inter-comparison. ................................................... 78
Conclusions ....................................................................................................................... 81
Document-No. Issue: I1.10
GIOGL1_QAR_LAI300m-V1 Date: 20.09.2016
© GIO-GL Lot1 consortium 5 of 116 Page:
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
6
References ........................................................................................................................ 85
ANNEX I. Maps of PROBA-V GEOV3 Products ............................................................................ 89 ANNEX II. Difference Maps GEOV3-GEOV1 ................................................................................ 94 ANNEX III. Additional Temporal Profiles of GEOV3 at 333m (all modes) ..................................... 99 ANNEX IV. Temporal profiles of GEOV3, GEOV1, MODC5 (1 km2) ............................................. 102 ANNEX V. Scatter-Plots per Biome type & Statistical Analysis.................................................. 106 ANNEX VI. Temporal Evolution of (GEOV3 - GEOV1) Bias and Box-Plots of (GEOV3 - GEOV1) Bias and RMSE per biomes (All pixels) ............................................................................................ 111 ANNEX VII. Direct Validation at 333m for GEOV3 NRT ............................................................. 113
Document-No. Issue: I1.10
GIOGL1_QAR_LAI300m-V1 Date: 20.09.2016
© GIO-GL Lot1 consortium 6 of 116 Page:
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
LIST OF FIGURES Figure 1: Map of GEOV3 LAI over Europe displayed at reduced resolution (1/8), and the two regions (10ºx15º) screened at a full resolution of the product. ................................................ 23 Figure 2: Scheme showing the compositing used for GEOV3 real time estimates......................... 29 Figure 3: Map of aggregated land cover (from GLC-2000, Bartholome & Belward, 2005) over the European window. All the classes are aggregated in the following main biomes (up to down in the legend): Snow and Ice, Broadleaf Forest, Needle-leaf Forest, Croplands, Herbaceous, Shrublands and Sparse vegetation, Bare Areas and Other. ................................................... 36 Figure 4: Location of the 153 selected European validation (EUVAL) sites and their classification into the main biome type. ....................................................................................................... 36 Figure 5: Percentage of missing values during the January - December 2014 period for LAI PROBA-V GEOV3 products. Top: HIS mode. Bottom: NRT mode. The legend step is 10%. Grey colour indicates no PROBA-V data................................................................................ 37 Figure 6: Temporal variations of missing values for LAI PROBA-V GEOV3 products during the year 2014. HIS mode (red solid line) and NRT mode (grey dashed line). ....................................... 38 Figure 7: Temporal variations of missing values for LAI PROBA-V GEOV3 products during the year 2014 per biome type. HIS mode is shown. ............................................................................. 38 Figure 8: Distribution of the temporal length of the gaps (missing values) over the EUVAL network of sites during the year 2014. Left Side: FAPAR PROBA-V GEOV3 HIS and NRT modes at 333m resolution. Right side: FAPAR PROBA-V GEOV3 HIS, PROBA-V GEOV1 and MODIS C5 at 1 km resolution. ............................................................................................................ 39 Figure 9: Maps of GEOV3 (HIS) products over Europe for the 30th of April, 2014. ........................ 40 Figure 10: Maps of the GEOV3 products at full resolution over Central Europe for HIS (left side) and NRT (right side) modes. A different date is shown for each variable. .............................. 41 Figure 11: Maps of the GEOV3 products at full resolution over Iberian Peninsula for HIS (left side) and NRT (right side) modes. A different date is shown for each variable. .............................. 42 Figure 12: Maps of the GEOV3 products for HIS (left side) and NRT (right side) modes for three consecutive dekads. .............................................................................................................. 43 Figure 13: LAI difference maps between PROBA-V GEOV3 (HIS) and PROBA-V GEOV1 products for the 13th May, 2014 (left side - Top) and for the 13th September, 2014 (left side - Bottom). Histogram of residuals per month from January to December 2014 (right side). .................... 44 Figure 14: As in Figure 13 for FAPAR. .......................................................................................... 45 Figure 15: As in Figure 13 for FCover. .......................................................................................... 45
Document-No. Issue: I1.10
GIOGL1_QAR_LAI300m-V1 Date: 20.09.2016
© GIO-GL Lot1 consortium 7 of 116 Page:
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
Figure 16: Distribution of GEOV3 and GEOV1 LAI values (left panel) and differences (right panel) for the EUVAL sites during the year 2014 period for each biome type. The numbers in the residuals indicate the fraction of cases with differences lower than ±0.5 LAI units. ................ 46 Figure 17: Distribution of GEOV3 and GEOV1 FAPAR values (left panel) and differences (right panel) for the EUVAL sites during the year 2014 period for each biome type. The numbers in the residuals indicate the fraction of cases with differences lower than ±0.05 FAPAR units. .. 47 Figure 18: Distribution of GEOV3 and GEOV1 FCover values (left panel) and differences (right panel) for the EUVAL sites during the year 2014 period for each biome type. The numbers in the residuals indicate the fraction of cases with differences lower than ±0.05 FCover units. .. 47 Figure 19: Mean Bias between GEOV3 and GEOV1 per biome type along the 2014 year. Error bars represents the standard deviation of the mean bias. ...................................................... 48 Figure 20: Temporal profiles of GEOV3 LAI, FAPAR and FCover products for different biomes, all consolidated modes are displayed. Cross-correlation values between GEOV3 NRT and HIS estimates are shown in the figure. NRT stands for near-real time product & HIS stands for Historical product. .................................................................................................................. 50 Figure 21: Example of temporal profiles of GEOV3 (HIS) and reference products (GEOV1, MODC5) for a Broadleaf Deciduous Forest (left side) and a Need-leaf Forest (right side) site. Cross-correlation values between GEOV3 and GEOV1 (ρ13), GEOV3 and MODIS (ρ23), and GEOV1 and MODIS (ρ12) estimates are shown in the figure. .............................................. 52 Figure 22: As Figure 21 for a Cultivated (left side) and Herbaceous (right side) site. .................... 52 Figure 23: As Figure 21 for a Shrubland (left side) and Desert (right side) site. ............................. 52 Figure 24: Histograms of cross-correlation between GEOV3 and GEOV1 temporal variations per biome for LAI (top panel), FAPAR (bottom left panel) and FCover (bottom right panel). ........ 53 Figure 25: Histograms of the delta function (smoothness) for LAI, FAPAR and FCover PROBA-V GEOV3 products (all modes) for the EUVAL sites during the year 2014. The curves are adjusted to an exponential function and the exponential decay constant is presented in the figure...................................................................................................................................... 54 Figure 26: LAI, FAPAR and FCover PROBA-V GEOV3 versus PROBA-V GEOV1 products scatterplots over all EUVAL sites for the whole 2014 year. The terms B and S represent the mean and the standard deviation of the difference........................................................................... 55 Figure 27: LAI and FAPAR PROBA-V GEOV3 versus MODIS C5 products scatter-plots over all EUVAL sites for the whole 2014 year. The terms B and S represent the mean and the standard deviation of the difference. ...................................................................................... 56 Figure 28: Box-plots of performance statistics (Bias: left side. RMSE: right side) per main biome: comparison between GEOV3 and GEOV1 LAI during 2014 period and EUVAL sites. Red bars indicate median residuals, blue boxes stretch from the 25th percentile to the 75th percentile the data and whiskers include 99.3% of the coverage data (±2.7σ). Outliers are not displayed. .. 57 Document-No. Issue: I1.10
GIOGL1_QAR_LAI300m-V1 Date: 20.09.2016
© GIO-GL Lot1 consortium 8 of 116 Page:
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
Figure 29: As in Figure 28 for FAPAR. .......................................................................................... 58 Figure 30: As in Figure 28 for FCover. .......................................................................................... 58 Figure 31: Maps of TF (remapped to GEOV3) in 2014.05.20 and PROBA-V GEOV3 in 2014.05.20, and distribution of values over an area of 60x60 pixels in Córdoba - La Reina (Spain). ......... 60 Figure 32: PROBA-V GEOV3 products versus TF ground-based maps (best QF estimates) scatterplots over Córdoba - La Reina (Spain) in 2014.05.20............................................................. 60 Figure 33: Maps of TF (remapped to GEOV3) in 2014.05.31 and PROBA-V GEOV3 in 2014.05.29, and distribution of values over an area of 60x60 pixels in Barrax (Spain). Note that in Barrax the LAI TF maps corresponds to an effective LAI, due to the overestimation observed in TF LAI. ........................................................................................................................................ 61 Figure 34: PROBA-V GEOV3 products versus TF ground-based maps scatter-plots over Barrax (2014.05.31) .......................................................................................................................... 62 Figure 35: Maps of TF (remapped to GEOV3) in 2014.06.17 and PROBA-V GEOV3 in 2014.06.20, and distribution of values over an area of 60x60 pixels in Albufera (Spain). Histograms correspond only to the rice fields............................................................................................ 63 Figure 36: Maps of TF (remapped to GEOV3) in 2014.06.24 and PROBA-V GEOV3 in 2014.06.30, and distribution of values over an area of 60x60 pixels in Albufera (Spain). ........................... 64 Figure 37: Maps of TF (remapped to GEOV3) in 2014.07.15 and PROBA-V GEOV3 in 2014.07.20, and distribution of values over an area of 60x60 pixels in Albufera (Spain). Histograms correspond only to the rice fields............................................................................................ 65 Figure 38: Maps of TF (remapped to GEOV3) in 2014.08.07 and PROBA-V GEOV3 in 2014.08.10, and distribution of values over an area of 60x60 pixels in Albufera (Spain). ........................... 65 Figure 39: Maps of TF (remapped to GEOV3) in 2014.08.22 and PROBA-V GEOV3 in 2014.08.31, and distribution of values over an area of 60x60 pixels in Albufera (Spain). Histograms correspond only to the rice fields............................................................................................ 66 Figure 40: PROBA-V GEOV3 products (2014.06.20) versus TF ground-based maps scatter-plots (best QF estimates) over Albufera (Spain) in 2014.06.17. ...................................................... 67 Figure 41: PROBA-V GEOV3 products (2014.06.20) versus TF ground-based maps scatter-plots (best QF estimates) over Albufera (Spain) in 2014.06.24. ...................................................... 67 Figure 42: PROBA-V GEOV3 products (2014.07.20) versus TF ground-based maps scatter-plots (best QF estimates) over Albufera (Spain) in 2014.07.15. ...................................................... 67 Figure 43: PROBA-V GEOV3 products (2014.08.10) versus TF ground-based maps scatter-plots (best QF estimates) over Albufera (Spain) in 2014.08.07. ...................................................... 68 Figure 44: PROBA-V GEOV3 products (2014.08.20) versus TF ground-based maps scatter-plots (best QF estimates) over Albufera (Spain) in 2014.08.22. ...................................................... 68
Document-No. Issue: I1.10
GIOGL1_QAR_LAI300m-V1 Date: 20.09.2016
© GIO-GL Lot1 consortium 9 of 116 Page:
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
Figure 45: Maps of TF (resampled to GEOV3 resolution) in 2014.07.03 and PROBA-V GEOV3 in 2014.06.30, and distribution of values over an area of 60x60 pixels in Rosasco (Italy). ......... 69 Figure 46: PROBA-V GEOV3 products (2014.06.30) versus TF ground-based maps scatter-plots (best QF estimates) over Rosasco (Italy) in 2014.07.03. ........................................................ 69 Figure 47: Maps of TF (resampled to GEOV3 resolution) in 2014.06.12 and PROBA-V GEOV3 in 2014.06.10 and distribution of values over an area of 60x60 pixels in Pshenichne (Ukraine). 70 Figure 48: PROBA-V GEOV3 products (2014.06.10) versus TF ground-based maps scatter-plots (best QF estimates) over Pshenichne (Ukraine) in 2014.06.12. ............................................. 71 Figure 49: Maps of TF (resampled to GEOV3 resolution) in 2014.07.31 and PROBA-V GEOV3 in 2014.07.31 and distribution of values over an area of 60x60 pixels in Pshenichne (Ukraine). 72 Figure 50: PROBA-V GEOV3 products (2014.07.31) versus TF ground-based maps scatter-plots over Pshenichne (Ukraine) in 2014.07.31. ............................................................................. 73 Figure 51: Maps of TF (resampled to GEOV3 resolution) in 2014.01.21 and PROBA-V GEOV3 in 2014.07.20 and distribution of values over an area of 30x30 pixels in Merguellil (Tunisia). .... 73 Figure 52: PROBA-V GEOV3 LAI (2014.01.20) versus TF (LAIeff) ground-based maps scatterplots over Merguellil (Tunisia) in 2014.01.21. ......................................................................... 74 Figure 53: Maps of TF (resampled to GEOV3 resolution) in 2014.04.15 and PROBA-V GEOV3 in 2014.04.20 and distribution of values over an area of 30x30 pixels in Merguellil (Tunisia). .... 74 Figure 54: PROBA-V GEOV3 LAI (2014.04.20) versus TF (LAIeff) ground-based maps scatterplots over Merguellil (Tunisia) in 2014.04.15. ......................................................................... 74 Figure 55: Direct validation results: PROBA-V GEOV3 products vs ground-based maps scatterplots. Symbols represent the mean value and bars the standard deviation over 3x3 GEOV3 pixel. The site and date is identified in the legend (Alb: Albufera; LRe: LaReina; Bar: Barrax; Ros: Rossasco; Psh: Pshenichne; Mer: Mergellil). ................................................................. 77 Figure 56: Comparison of satellite LAI product with the ground-based maps at 3x3 km2. Left side: PROBA-V GEOV3 (HIS). Centre side: PROBA-V GEOV1. Right side: MODIS C5. Filled symbols correspond to concomitant values of 2014 from ImagineS database and unfilled symbols to a different year from OLIVE Direct database. Numbers identify the ground data (Table 10). Crosses identify outliers (weight < 0.3) not considered for statistics. .................... 79
Document-No. Issue: I1.10
GIOGL1_QAR_LAI300m-V1 Date: 20.09.2016
© GIO-GL Lot1 consortium 10 of 116 Page:
GIO-GL Lot 1, GMES Initial Operations Date Issued: 20.09.2016 Issue: I1.10
LIST OF TABLES Table 1: GCOS Requirements for LAI and FAPAR as Essential Climate Variables [GCOS-154, 2011]...................................................................................................................................... 20 Table 2: WMOS Requirements for Global LAI and FAPAR products (from http://www.wmosat.info/oscar/requirements); G=goal, B=breakthrough, T=threshold. .................................... 21 Table 3: geoland2 User Requirements for LAI, FAPAR and FCover (Low Resolution).1the relative accuracy is well suited for LAI values higher than 1.0. For the lower values (LAI
