Evaluation and Benchmarking of Sensors, Systems and Geospatial Data in Photogrammetry and Remote Sensing

16 - 17 September 2019 (Warsaw University of Technology)

Joint events aimed at a presentation of the newest solutions in the spatial data processing in the frame of the

  • Workshop on Evaluation and Benchmarking of Sensors, Systems and Geospatial Data in Photogrammetry and Remote Sensing, 16-17 September 2019, Warsaw University of Technology, ptfit.sgp.geodezja.org.pl/workshop2019/index.html,
  • VOLTA - innoVation in geOspatiaL and 3D daTA Summer School, 18-20 September 2019, University of Warsaw, Faculty of Geography and Regional Studies, Krakowskie Przedmieście 30, Warsaw, volta.uw.edu.pl.

The workshop report can be downloaded here.


The wide variety of sensors and systems available on the market for collecting spatial data makes the evaluation of provided information, calibration of sensors and benchmarking of systems and 3D data a critical task. It is also an important scientific issue for many professionals. In daily work, the assessment of tools for collecting spatial data resources is a crucial issue for National Mapping and Cadastral Agency officers and all professionals handling geospatial data. Workshop on Evaluation and Benchmarking of Sensors, Systems and Geospatial Data in Photogrammetry and Remote Sensing organized was therefore appropriate for potential attendees who wanted to extend their knowledge in the fields of photogrammetry and remote sensing.

This workshop was held in the Warsaw University of Technology, Faculty of Geodesy and Cartography on 16 - 17 September 2019. It was organized by the International Society for Photogrammetry and Remote Sensing (ISPRS) and European Spatial Data Research (EuroSDR) in support of Polish Society for Photogrammetry and Remote Sensing (PTFIT) and German Society for Photogrammetry, Remote Sensing, and Geoinformation (DGPF). 50 people from 15 countries participated in this two-day conference. The topic of the narrow substantive scope was the evaluation and comparison of photogrammetric and remote sensing sensors and data collected therefrom. The program started with keynotes’ lectures: dr Gottfried Mandlburger (University of Vienna/University of Stuttgart) and dr. Isabella Toschi (Bruno Kessler Foundation). After lectures presentations of attendees were placed in a program. They were related to the review of benchmarking initiatives, assessment of geospatial data processing and algorithms for image matching, orientation of low-altitude images from UAV platforms, issues associated with UAV calibration fields. Another interesting subject of presentations were: experience of national mapping agencies in evaluation of geodata, using Sentinel data in selected applications, assessing sensors in mobile mapping systems. Important topics were presentation new benchmarking initiatives aimed to scientists willing to participate which can help less experienced scientists or less well-known scientific institutions participate in research planned for a wide audience. Conference papers from this workshop has been published in The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, volume XLII-1/W2:



Program of workshop

September 16, 2019 - Workshop Day 1

9.00 - 10.00


10.00 - 10.15

Workshop Opening


Keynote presentations:
Dr. Gottfried Mandlburger
“Comparison of Single Photon and waveform LiDAR”
Dr. Isabella Toschi
“Airborne oblique imaging: towards the hybrid era”

11.35 - 12.00

Coffee/tea break

12.00 - 13.30

Session #1 – Past benchmarks of sensors, systems and 3D data

13.30 - 14.30


14.00 -15.30

Session #2 – Validation of sensors and systems: methods, results #1

17.30 - 19.00

Social trip in Warsaw Old Town

19:00 - 22.00



September 17, 2018 - Workshop Day 2

8:30 - 9:00  

News from INTERGEO 2019

9.00 - 10.30

Session #3 - Evaluation and benchmarking of geospatial data

10.30 - 11.00

Coffee/tea break

11.00 - 12.30

Session #4 - Validation of sensors and systems: methods, results #2

13.00 - 14.00


14.00 - 16.00

Session #5 - Benchmarks releases – presentations and discussions

16.00 - 16.30

Closing of Workshop


The main sponsor of the workshop was Polish photogrammetric company Gispro Sp. z o.o. Other sponsors were MGGP Aero Sp. z o.o., Vexcel and Hexagon.

Social events

Organizers also prepared social events. In the first day of workshop attendees participated in guided walk trip around Warsaw Old Town visiting: Tomb of the Unknown Solider, Presidential Palace, Adam Mickiewicz monument, Fryderyk Chopin's benches, King Sigismund's Column, Royal Castle, St. John's Cathedral, Old Town Square with monument of Warsaw Mermaid, house of birth Mary Skłodowska Curie and defensive walls with Barbican. After positively exhausting trip participants took part in Ice-breaker Dinner in restaurant Podwale 25 where they felt Polish hospitality and tasted Polish meals.



The idea of the Summer School was oriented on a presentation of theoretical backgrounds of the hyperspectral data acquisition, processing and analysis. In the morning session there were tutorials, and afternoon practical sessions presented by leading organisations on the field of hyperspectral technology (alphabetical order): Malvern Panalytical, MGGP Aero, Norsk Elektro Optikk AS., ReSe Applications, University of Warsaw and supported by the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 734687 of the VOLTA project and co-supported by the Polish Ministry of Science and Higher Education in the frame of H2020 co-financed projects No. 3934/H2020/2018/2 and 379067/PnH/2017.

Registration was limited due to an access to equipment and possibilities of interactive discussions between participants and tutors. 20 participants from: Austria, China, Czech Republic, Japan, Jordan, Poland, Portugal, Romania, Slovenia, Spain, Sweden, Turkey attended the Summer School.

Program of summer school

The program of the School covered 27 hours:

  • 18.09.2019, hyperspectral field data acquisition and processing: Brian Curtiss, Szymon Stolarek (Malvern Panalytical), Marlena Kycko (UW). The course was oriented on the ASD FieldSpec processing chain from the setup up to final products generation, including calibration, spectra acquisition, file export, spectral curves and indices calculation,
  • 19.09.2019, hyperspectral airborne data acquisition and preprocessing: Niels Christian Moen (NEO), Jan Niedzielko (MGGP Aero). The course was focused on the HySpex concept, flight planning, image data pre-, processing (atmospheric and geometric correction), final product generation,
  • 20.09.2019, hyperspectral airborne image classification: Edwin Raczko (UW). The course was oriented on hyperspectral image classification methods basing on the R software.

All course participants received the Summer School confirmations.
An important part of the School was the dinner, which was organised at the Dawne Smaki restaurant, which offers old style Polish meals. It was a proper place for discussions and an experience exchange.


Marie Skłodowska-Curie Actions, Research and Innovation Staff Exchange (RISE) H2020-MSCA-RISE-2016 - REA G.A. 734687
Activity of the University of Warsaw in the frame of the H2020 MSCA RISE VOLTA project is co-financed by the Polish Ministry of Science and Higher Education programs: 3934/H2020/2018/2 and 379067/PnH/2017

All materials (including Gallery) are presented on the web page: http://volta.uw.edu.pl


Scientific Committee


Prof. Zdzisław Kurczyński

Warsaw University of Technology, Poland


Dr Fabio Remondino

Bruno Kessler Foundation, Italy / EuroSDR / ISPRS

V-ce chair

Prof. Ralf Reulke

German Aerospace Center, Germany / ISPRS

V-ce chair

Prof. Jon Mills

Newcastle University, Great Britain / EuroSDR

more members >>

Organizing Committee


Dr. Krzysztof Bakuła

Warsaw University of Technology, Poland


Prof. Bogdan Zagajewski

University of Warsaw, Poland

V-ce chair

Dr. Dorota Iwaszczuk

Technical University of Munich, Germany

V-ce chair

Dr. Markéta Potůčková

Charles University in Prague, Czech Republic

more members >>


Information about workshop and summer school can be found at