Functional Plant Biology Functional Plant Biology Society
Plant function and evolutionary biology
RESEARCH ARTICLE

The significance of image compression in plant phenotyping applications

Massimo Minervini A D , Hanno Scharr B and Sotirios A. Tsaftaris A C
+ Author Affiliations
- Author Affiliations

A Pattern Recognition and Image Analysis, IMT Institute for Advanced Studies, Lucca, Piazza S. Francesco, 19, 55100 Lucca, Italy.

B Institute of Bio- and Geosciences: Plant Sciences, Forschungszentrum Jülich GmbH, Wilhelm-Johnen-Straße, 52428 Jülich, Germany.

C Present address: Institute of Digital Communications, School of Engineering, University of Edinburgh, Alexander Graham Bell, King’s Buildings, Edinburgh EH9 3JL, UK.

D Corresponding author. Email: m.minervini@imtlucca.it

Functional Plant Biology 42(10) 971-988 https://doi.org/10.1071/FP15033
Submitted: 11 February 2015  Accepted: 1 July 2015   Published: 7 September 2015

Abstract

We are currently witnessing an increasingly higher throughput in image-based plant phenotyping experiments. The majority of imaging data are collected using complex automated procedures and are then post-processed to extract phenotyping-related information. In this article, we show that the image compression used in such procedures may compromise phenotyping results and this needs to be taken into account. We use three illuminating proof-of-concept experiments that demonstrate that compression (especially in the most common lossy JPEG form) affects measurements of plant traits and the errors introduced can be high. We also systematically explore how compression affects measurement fidelity, quantified as effects on image quality, as well as errors in extracted plant visual traits. To do so, we evaluate a variety of image-based phenotyping scenarios, including size and colour of shoots, leaf and root growth. To show that even visual impressions can be used to assess compression effects, we use root system images as examples. Overall, we find that compression has a considerable effect on several types of analyses (albeit visual or quantitative) and that proper care is necessary to ensure that this choice does not affect biological findings. In order to avoid or at least minimise introduced measurement errors, for each scenario, we derive recommendations and provide guidelines on how to identify suitable compression options in practice. We also find that certain compression choices can offer beneficial returns in terms of reducing the amount of data storage without compromising phenotyping results. This may enable even higher throughput experiments in the future.

Additional keywords: computer vision, growth analysis, imaging sensor, lossless, lossy, optical flow.


References

Alenya G, Dellen B, Foix S, Torras C (2013) Robotized plant probing: leaf segmentation utilizing time-of-flight data. IEEE Robotics & Automation Magazine 20, 50–59.
Robotized plant probing: leaf segmentation utilizing time-of-flight data.CrossRef | open url image1

Andrade-Sanchez P, Gore MA, Heun JT, Thorp KR, Carmo-Silva AE, French AN, Salvucci ME, White JW (2014) Development and evaluation of a field-based high-throughput phenotyping platform. Functional Plant Biology 41, 68–79.
Development and evaluation of a field-based high-throughput phenotyping platform.CrossRef | open url image1

Bankoski J, Wilkins P, Xu Y (2011). Technical overview of VP8, an open source video codec for the web. In ‘International Conference on Multimedia and Expo’. pp. 1–6. (IEEE: Barcelona, Spain)

Berger B, Parent B, Tester M (2010) High-throughput shoot imaging to study drought responses. Journal of Experimental Botany 61, 3519–3528.
High-throughput shoot imaging to study drought responses.CrossRef | 1:CAS:528:DC%2BC3cXhtVert7vO&md5=bc0ea767a0c9dffc25799b3980096fbcCAS | 20660495PubMed | open url image1

Billiau K, Sprenger H, Schudoma C, Walther D, Köhl KI (2012) Data management pipeline for plant phenotyping in a multisite project. Functional Plant Biology 39, 948–957.
Data management pipeline for plant phenotyping in a multisite project.CrossRef | open url image1

Briese C, Bodewein T, Fiorani F (2013). Plant shoot image segmentation using colour features and support vector machines. In ‘2nd International Workshop on Image Analysis Methods for the Plant Sciences, Nottingham, England’.

Brown T, Zimmermann C, Panneton W, Noah N, Borevitz J (2012). High-resolution, time-lapse imaging for ecosystem-scale phenotyping in the field. In ‘High-throughput phenotyping in plants, Vol. 918 of Methods in molecular biology’. (Ed. J. Normanly) pp. 71–96. (Humana Press)

Bruhn A, Weickert J, Schnörr C (2005) Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods. International Journal of Computer Vision 61, 211–231.
Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods.CrossRef | open url image1

Bucksch A, Burridge J, York LM, Das A, Nord E, Weitz JS, Lynch JP (2014) Image-based high-throughput field phenotyping of crop roots. Plant Physiology 166, 470–486.
Image-based high-throughput field phenotyping of crop roots.CrossRef | 1:CAS:528:DC%2BC2cXhvFKrurvP&md5=107d06b8f18eb1235cb726ebabe3bd24CAS | 25187526PubMed | open url image1

Chavarría-Krauser A, Jäger W, Schurr U (2005) Primary root growth: a biophysical model of auxin-related control. Functional Plant Biology 32, 849–862.
Primary root growth: a biophysical model of auxin-related control.CrossRef | open url image1

Chavarría-Krauser A, Nagel KA, Palme K, Schurr U, Walter A, Scharr H (2008) Spatio-temporal quantification of differential growth processes in root growth zones based on a novel combination of image sequence processing and refined concepts describing curvature production. New Phytologist 177, 811–821.
Spatio-temporal quantification of differential growth processes in root growth zones based on a novel combination of image sequence processing and refined concepts describing curvature production.CrossRef | 18069960PubMed | open url image1

Christopoulos C, Askelöf J, Larsson M (2000) Efficient methods for encoding regions of interest in the upcoming JPEG2000 still image coding standard. IEEE Signal Processing Letters 7, 247–249.
Efficient methods for encoding regions of interest in the upcoming JPEG2000 still image coding standard.CrossRef | open url image1

Cobb J, DeClerck G, Greenberg A, Clark R, McCouch S (2013) Next-generation phenotyping: requirements and strategies for enhancing our understanding of genotype–phenotype relationships and its relevance to crop improvement. Theoretical and Applied Genetics 126, 867–887.
Next-generation phenotyping: requirements and strategies for enhancing our understanding of genotype–phenotype relationships and its relevance to crop improvement.CrossRef | 23471459PubMed | open url image1

Cwiek H, Pommier C, Scholz U, Lange M, Chen J, van Dijk AD, Nap J-P, van Oeveren J, Kersey PJ, Krajewski P (2014). On minimum reporting requirements and standard formatting of plant phenotypic data. In ‘International Plant & Animal Genome XXII Conference, San Diego, California’.

Dhondt S, Wuyts N, Inzé D (2013) Cell to whole-plant phenotyping: the best is yet to come. Trends in Plant Science 18, 428–439.
Cell to whole-plant phenotyping: the best is yet to come.CrossRef | 1:CAS:528:DC%2BC3sXot1Cnu70%3D&md5=8d6a397341b5b552363e274f5a5874c9CAS | 23706697PubMed | open url image1

Dhondt S, Gonzalez N, Blomme J, De Milde L, Van Daele T, Van Akoleyen D, Storme V, Coppens FTS, Beemster G, Inzé D (2014) High-resolution time-resolved imaging of in vitro Arabidopsis rosette growth. The Plant Journal 80, 172–184.
High-resolution time-resolved imaging of in vitro Arabidopsis rosette growth.CrossRef | 1:CAS:528:DC%2BC2cXhsFOnsbzM&md5=af6c2962bd350b30384686c81d7dcd07CAS | 25041085PubMed | open url image1

Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26, 297–302.
Measures of the amount of ecologic association between species.CrossRef | open url image1

Dornbusch T, Lorrain S, Kuznetsov D, Fortier A, Liechti R, Xenarios I, Fankhauser C (2012) Measuring the diurnal pattern of leaf hyponasty and growth in Arabidopsis – a novel phenotyping approach using laser scanning. Functional Plant Biology 39, 860–869.
Measuring the diurnal pattern of leaf hyponasty and growth in Arabidopsis – a novel phenotyping approach using laser scanning.CrossRef | open url image1

Fiorani F, Schurr U (2013) Future scenarios for plant phenotyping. Annual Review of Plant Biology 64, 267–291.
Future scenarios for plant phenotyping.CrossRef | 1:CAS:528:DC%2BC3sXosFSktLw%3D&md5=52d891a50728a7d059393c51d0d30852CAS | 23451789PubMed | open url image1

Furbank RT, Tester M (2011) Phenomics – technologies to relieve the phenotyping bottleneck. Trends in Plant Science 16, 635–644.
Phenomics – technologies to relieve the phenotyping bottleneck.CrossRef | 1:CAS:528:DC%2BC3MXhsFOhu7%2FJ&md5=f85d66b2177ad74d9a28ead5d0153e7dCAS | 22074787PubMed | open url image1

Goff SA, Vaughn M, McKay S, Lyons E, Stapleton AE, Gessler D, Matasci N, Wang L, Hanlon M, Lenards A, Muir A, Merchant N, Lowry S, Mock S, Helmke M, Kubach A, Narro M, Hopkins N, Micklos D, Hilgert U, Gonzales M, Jordan C, Skidmore E, Dooley R, Cazes J, McLay R, Lu Z, Pasternak S, Koesterke L, Piel WH, Grene R, Noutsos C, Gendler K, Feng X, Tang C, Lent M, Kim S-J, Kvilekval K, Manjunath B, Tannen V, Stamatakis A, Sanderson M, Welch SM, Cranston K, Soltis P, Soltis D, O’Meara B, Ane C, Brutnell T, Kleibenstein DJ, White JW, Leebens-Mack J, Donoghue MJ, Spalding EP, Vision TJ, Myers CR, Lowenthal D, Enquist BJ, Boyle B, Akoglu A, Andrews G, Ram S, Ware D, Stein L, Stanzione D (2011) The iPlant collaborative: cyberinfrastructure for plant biology. Frontiers in Plant Science 2, 34
The iPlant collaborative: cyberinfrastructure for plant biology.CrossRef | 22645531PubMed | open url image1

Granier C, Vile D (2014) Phenotyping and beyond: modelling the relationships between traits. Current Opinion in Plant Biology 18, 96–102.
Phenotyping and beyond: modelling the relationships between traits.CrossRef | 24637194PubMed | open url image1

Granier C, Aguirrezabal L, Chenu K, Cookson SJ, Dauzat M, Hamard P, Thioux J-J, Rolland G, Bouchier-Combaud S, Lebaudy A, Muller B, Simonneau T, Tardieu F (2006) Phenopsis, an automated platform for reproducible phenotyping of plant responses to soil water deficit in Arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deficit. New Phytologist 169, 623–635.
Phenopsis, an automated platform for reproducible phenotyping of plant responses to soil water deficit in Arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deficit.CrossRef | 16411964PubMed | open url image1

International Telecommunication Union (1992) ‘Information technology – digital compression and coding of continuous-tone still images. ITU-T recommendation T.81’. (International Telecommunication Union: Geneva)

International Telecommunication Union (1995) ‘Studio encoding parameters of digital television for standard 4?:?3 and wide-screen 16?:?9 aspect ratios. ITU-R recommendation BT.601–5’. (International Telecommunication Union: Geneva)

International Telecommunication Union (2013) High efficiency video coding. ITU-T recommendation H.265’. (International Telecommunication Union: Geneva)

Klukas C, Chen D, Pape J-M (2014) Integrated analysis platform: an open-source information system for high-throughput plant phenotyping. Plant Physiology 165, 506–518.
Integrated analysis platform: an open-source information system for high-throughput plant phenotyping.CrossRef | 1:CAS:528:DC%2BC2cXhtVWnurjJ&md5=a4da3e18b5afadc5d43e2ae5dbda2b16CAS | 24760818PubMed | open url image1

Knüfer J, Briese C, Jansen M, Kleinen S, Putz A, Kumar S, Stelling D, Schurr U, Wiese-Klinkenberg A (2013). A non-invasive imaging procedure to identify drought-stress tolerant oilseed rape plants expressing genes from high altitude plants. In ‘InterDrought-IV Conference, Crown Perth, Australia’.

Kullback S, Leibler RA (1951) On information and sufficiency. Annals of Mathematical Statistics 22, 79–86.
On information and sufficiency.CrossRef | open url image1

Lee J-S, Ebrahimi T (2012) Perceptual video compression: a survey. IEEE Journal of Selected Topics in Signal Processing 6, 684–697.
Perceptual video compression: a survey.CrossRef | open url image1

Lobet G, Draye X, Périlleux C (2013) An online database for plant image analysis software tools. Plant Methods 9, 38
An online database for plant image analysis software tools.CrossRef | 24107223PubMed | open url image1

Matos DA, Cole BJ, Whitney IP, MacKinnon KJ-M, Kay SA, Hazen SP (2014) Daily changes in temperature, not the circadian clock, regulate growth rate in brachypodium distachyon. PLoS One 9, e100072
Daily changes in temperature, not the circadian clock, regulate growth rate in brachypodium distachyon.CrossRef | 24927130PubMed | open url image1

Minervini M, Tsaftaris SA (2013). Application-aware image compression for low cost and distributed plant phenotyping. In ‘International Conference on Digital Signal Processing’. pp. 1–6. (IEEE: Santorini, Greece)

Minervini M, Abdelsamea MM, Tsaftaris SA (2014a) Image-based plant phenotyping with incremental learning and active contours. Ecological Informatics 23, 35–48.
Image-based plant phenotyping with incremental learning and active contours.CrossRef | open url image1

Minervini M, Rusu C, Tsaftaris SA (2014b). Unsupervised and supervised approaches to color space transformation for image coding. In ‘International Conference on Image Processing’. pp. 5576–5580. (IEEE: Paris, France)

Minervini M, Scharr H, Tsaftaris SA (2015) Image analysis: The new bottleneck in plant phenotyping. IEEE Signal Processing Magazine 32, 126–131.
Image analysis: The new bottleneck in plant phenotyping.CrossRef | open url image1

Mukherjee D, Bankoski J, Grange A, Han J, Koleszar J, Wilkins P, Xu Y, Bultje R (2013). The latest open-source video codec VP9 – an overview and preliminary results. In ‘Picture Coding Symposium’. pp. 390–393. (IEEE: San Jose, CA)

Murillo MJ, Paco JA, Wright D (2015) Long-distance telecommunication in remote poor areas: from partnerships and implementation to sustainability. IEEE Technology and Society Magazine 34, 19–30.
Long-distance telecommunication in remote poor areas: from partnerships and implementation to sustainability.CrossRef | open url image1

Nagel KA, Putz A, Gilmer F, Heinz K, Fischbach A, Pfeifer J, Faget M, Blossfeld S, Ernst M, Dimaki C, Kastenholz B, Kleinert A-K, Galinski A, Scharr H, Fiorani F, Schurr U (2012) GROWSCREEN-Rhizo is a novel phenotyping robot enabling simultaneous measurements of root and shoot growth for plants grown in soil-filled rhizotrons. Functional Plant Biology 39, 891–904.
GROWSCREEN-Rhizo is a novel phenotyping robot enabling simultaneous measurements of root and shoot growth for plants grown in soil-filled rhizotrons.CrossRef | open url image1

Ortega A, Ramchandran K (1998) Rate-distortion methods for image and video compression. IEEE Signal Processing Magazine 15, 23–50.
Rate-distortion methods for image and video compression.CrossRef | open url image1

Otte M, Nagel H-H (1994). Optical flow estimation: advances and comparisons. In ‘European Conference on Computer Vision. Vol I’. (Ed. J. OlofEklundh ) pp. 51–60. (Springer: Stockholm, Sweden)

Pal SK, Liput M, Piques M, Ishihara H, Obata T, Martins MCM, Sulpice R, van Dongen JT, Fernie AR, Yadav UP, Lunn JE, Usadel B, Stitt M (2013) Diurnal changes of polysome loading track sucrose content in the rosette of wild-type Arabidopsis and the starchless pgm mutant. Plant Physiology 162, 1246–1265.
Diurnal changes of polysome loading track sucrose content in the rosette of wild-type Arabidopsis and the starchless pgm mutant.CrossRef | 1:CAS:528:DC%2BC3sXhtFCmtLjN&md5=1676de302eeeacaf6571bd30894d7db2CAS | 23674104PubMed | open url image1

Paulus S, Behmann J, Mahlein A-K, Plümer L, Kuhlmann H (2014) Low-cost 3D systems: suitable tools for plant phenotyping. Sensors 14, 3001–3018.
Low-cost 3D systems: suitable tools for plant phenotyping.CrossRef | 24534920PubMed | open url image1

Peters WS, Bernstein N (1997) The determination of relative elemental growth rate profiles from segmental growth rates (a methodological evaluation). Plant Physiology 113, 1395–1404.

Pieruschka R, Poorter H (2012) Phenotyping plants: genes, phenes and machines. Functional Plant Biology 39, 813–820.
Phenotyping plants: genes, phenes and machines.CrossRef | open url image1

Pieruschka R, Klimov D, Berry JA, Osmond CB, Rascher U, Kolber ZS (2012). Remote chlorophyll fluorescence measurements with the laser-induced fluorescence transient approach. In ‘High-throughput phenotyping in plants. Vol. 918 of Methods in molecular biology’. (Ed. J. Normanly) pp. 51–59. (Humana Press)

Puhl J (2013) Im Silicon Savannah. Der Spiegel 2013, 118–122.

Rolland-Lagan A-G, Remmler L, Girard-Bock C (2014) Quantifying shape changes and tissue deformation in leaf development. Plant Physiology 165, 496–505.
Quantifying shape changes and tissue deformation in leaf development.CrossRef | 1:CAS:528:DC%2BC2cXhtVWnurjI&md5=8b1412f5fd6ab86555a5d064cb6700c8CAS | 24710066PubMed | open url image1

Sass L, Majer P, Hideg É (2012). Leaf hue measurements: a high-throughput screening of chlorophyll content. In ‘High-throughput phenotyping in plants. Vol. 918 of Methods in molecular biology’. (Ed. J. Normanly) pp. 61–69. (Humana Press)

Sayood K (2012). ‘Introduction to data compression.’ (Morgan Kaufmann: Burlington, Massachusetts)

Scharr H, Minervini M, Fischbach A, Tsaftaris SA (2014). ‘Annotated image datasets of rosette plants. Technical report FZJ-2014–03837.’ (Forschungszentrum Jülich GmbH: Jülich)

Schmundt D, Stitt M, Jähne B, Schurr U (1998) Quantitative analysis of the local rates of growth of dicot leaves at a high temporal and spatial resolution, using image sequence analysis. The Plant Journal 16, 505–514.
Quantitative analysis of the local rates of growth of dicot leaves at a high temporal and spatial resolution, using image sequence analysis.CrossRef | open url image1

Shirmohammadi S, Ferrero A (2014) Camera as the instrument: the rising trend of vision based measurement. IEEE Instrumentation & Measurement Magazine 17, 41–47.
Camera as the instrument: the rising trend of vision based measurement.CrossRef | open url image1

Skodras A, Christopoulos C, Ebrahimi T (2001) The JPEG 2000 still image compression standard. IEEE Signal Processing Magazine 18, 36–58.
The JPEG 2000 still image compression standard.CrossRef | open url image1

Slovak R, Göschl C, Su X, Shimotani K, Shiina T, Busch W (2014) A scalable open-source pipeline for large-scale root phenotyping of Arabidopsis. The Plant Cell 26, 2390–2403.
A scalable open-source pipeline for large-scale root phenotyping of Arabidopsis.CrossRef | 1:CAS:528:DC%2BC2cXhsVChsrjN&md5=2cae8cb4b39df8cdbde03f12107030f7CAS | 24920330PubMed | open url image1

Soyak E, Tsaftaris SA, Katsaggelos AK (2011) Low-complexity tracking-aware H.264 video compression for transportation surveillance. IEEE Transactions on Circuits and Systems for Video Technology 21, 1378–1389.
Low-complexity tracking-aware H.264 video compression for transportation surveillance.CrossRef | open url image1

Sozzani R, Busch W, Spalding EP, Benfey PN (2014) Advanced imaging techniques for the study of plant growth and development. Trends in Plant Science 19, 304–310.
Advanced imaging techniques for the study of plant growth and development.CrossRef | 1:CAS:528:DC%2BC2cXhtFSgt70%3D&md5=be65d496d626c56b8d24451e1f72f752CAS | 24434036PubMed | open url image1

Spalding EP, Miller ND (2013) Image analysis is driving a renaissance in growth measurement. Current Opinion in Plant Biology 16, 100–104.
Image analysis is driving a renaissance in growth measurement.CrossRef | 23352714PubMed | open url image1

Sullivan GJ, Ohm J, Han WJ, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Transactions on Circuits and Systems for Video Technology 22, 1649–1668.
Overview of the high efficiency video coding (HEVC) standard.CrossRef | open url image1

W3C (2003). Portable network graphics (PNG) specification. W3C recommendation ISO/IEC 15948 : 2003 (E). (World Wide Web Consortium: Cambridge, Massachusetts) Available at http://www.w3.org/TR/PNG/ [verified 17 July 2015].

Walter A, Schurr U (2005) Dynamics of leaf and root growth: endogenous control versus environmental impact. Annals of Botany 95, 891–900.
Dynamics of leaf and root growth: endogenous control versus environmental impact.CrossRef | 15767269PubMed | open url image1

Walter A, Scharr H, Gilmer F, Zierer R, Nagel KA, Ernst M, Wiese A, Virnich O, Christ MM, Uhlig B, Jünger S, Schurr U (2007) Dynamics of seedling growth acclimation towards altered light conditions can be quantified via GROWSCREEN: a setup and procedure designed for rapid optical phenotyping of different plant species. New Phytologist 174, 447–455.
Dynamics of seedling growth acclimation towards altered light conditions can be quantified via GROWSCREEN: a setup and procedure designed for rapid optical phenotyping of different plant species.CrossRef | 17388907PubMed | open url image1

Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13, 600–612.
Image quality assessment: from error visibility to structural similarity.CrossRef | 15376593PubMed | open url image1

Weinberger MJ, Seroussi G, Sapiro G (2000) The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS. IEEE Transactions on Image Processing 9, 1309–1324.
The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS.CrossRef | 1:STN:280:DC%2BD1c7gsV2isg%3D%3D&md5=54acd087fc422608e193bbd0a38caa8fCAS | 18262969PubMed | open url image1



Rent Article (via Deepdyve) Export Citation Cited By (3)