Information Theory of Cartography: An Information-theoretic Framework for Cartographic Communication

doi:10.11947/j.JGGS.2021.0101

Abstract

Abstract:

Map is one of the communication means created by human being. Cartographers have been making efforts on the comparison of maps to natural languages so as to establish a “cartographic language” or “map language”. One of such efforts is to adopt the Shannon’s Information Theory originated in digital communication into cartography so as to establish an entropy-based cartographic communication theory. However, success has been very limited although research work had started as early as the mid-1960s. It is then found that the bottleneck problem was the lack of appropriate measures for the spatial (configurational) information of (graphic and image) maps, as the classic Shannon entropy is only capable of characterizing statistical information but fails to capture the configurational information of (graphic and image) maps. Fortunately, after over 40-year development, some bottleneck problems have been solved. More precisely, generalized Shannon entropies for metric and thematic information of (graphic) maps have been developed and the first feasible solution for computing the Boltzmann entropy of image maps has been invented, which is capable of measuring the spatial information of not only numerical images but also categorical maps. With such progress, it is now feasible to build the “Information Theory of Cartography”. In this paper, a framework for such a theory is proposed and some key issues are identified. For these issues, some have already been tackled while others still need efforts. As a result, a research agenda is set for future action. After all these issues are tackled, the theory will become matured so as to become a theoretic basis of cartography. It is expected that the Information Theory of Cartography will play an increasingly important role in the discipline of cartography because more and more researchers have advocated that information is more fundamental than matter and energy.

Key words: Information Theory of Cartography; cartographic communication; spatial information of maps; generalized Shannon Entropy; Boltzmann entropy

Zhilin LI,Peichao GAO,Zhu XU. Information Theory of Cartography: An Information-theoretic Framework for Cartographic Communication[J]. Journal of Geodesy and Geoinformation Science, 2021, 4(1): 1-16.

Figures/Tables 21

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Fig.6

Fig.7

Fig.8

Fig.9

Fig.10

Fig.11

Fig.12

Fig.13

Fig.14

Fig.15

Fig.16

Fig.17

Fig.18

Fig.19

Fig.20

Fig.21

References 86

[1]	KENT A J. Form follows feedback: rethinking cartographic communication[J]. Westminster Papers in Communication and Culture, 2018,13(2):96-112.
[2]	HEAD C G. The map as natural language: a paradigm for understanding[J]. Cartographica: The International Journal for Geographic Information and Geovisualization, 1984,21(1):1-32.
[3]	ANDREWS J H. Map and language/a metaphor extended[J]. Cartographica: The International Journal for Geographic Information and Geovisualization, 1990,27(1):1-19.
[4]	RAMIREZ J R. Development of a cartographic language[M]//FRANK A U, CAMPARI I. Spatial Information Theory A Theoretical Basis for GIS. Berlin, Heidelberg:Springer, 1993: 92-112.
[5]	KENT A J, VUJAKOVIC P. Cartographic language: towards a new paradigm for understanding stylistic diversity in topographic maps[J]. The Cartographic Journal, 2011,48(1):21-40.
[6]	BERTIN J. Semiology of graphics: diagrams, networks, maps[M]. BERG W J, trans. Redlands, Calif: ESRI Press, 2011.
[7]	ROBINSON A H, MORRISON J L, MUEHRCKE P C, et al. Elements of cartography[M]. New York: John Wiley & SonsInc., 1995.
[8]	DIBIASE D, MACEACHREN A M, KRYGIER J B, et al. Animation and the role of map design in scientific visualization[J]. Cartography and Geographic Information Systems, 1992,19(4):201-214.
[9]	MACEACHREN A M, TAYLOR D R F. Visualization in modern cartography: setting the agenda[M]. Oxford: Elsevier Science Ltd, 1994,2:1-12.
[10]	LI Zhilin, KRAAK M J. Web-based exploratory data analysis (WEB-EDA): visualisation meets spatial analysis[C]// Proceedings of ISPRS Commission II Symposium (WG II/6).Xi’an, China:ISPRS, 2002: 281-285.
[11]	KEATES J S. Cartographic information[C]//Abstract of Paper Presented at the 20th International Geographical Congress. London: Thomas Nelson 9, 1964.
[12]	MOLES A A. Théorie de l’information et message cartographique[J]. Sciences et Enseignement des Sciences, 1964,5(32):11-16.
[13]	BOARD C. Maps as models[M]//CHORELY R J, HAGGETT P. Models in Geography. London: Methuen, 1967.
[14]	KOLÁČNÝA. Cartographic information-a fundamental concept and term in modern cartography[J]. The Cartographic Journal, 1969,6(1):47-49.
[15]	MUEHRCKEDP C. Trends in cartography[J]. Cartography, 1973,8(2):61-77.
[16]	ROBINSON A H, PETCHENIK B B. The map as a communication system[J]. The Cartographic Journal, 1975,12(1):7-15.
[17]	BOARD C. Cartographic communication[J]. Cartographica: The International Journal for Geographic Information and Geovisualization, 1981,18(2):42-78.
[18]	NUEMANN J. Genesis and definition of the technical term “Cartographic Communication”[C]//Proceedings of the 6th International Cartographic Conference. Ottawa: [s.n.], 1972.
[19]	FREITAG U. Can communication theory form the basis of a general theory of cartography?[J]. Inform. Relative to Cartography and Geodesy, 1980,2(17-35).
[20]	SHANNON C E. A mathematical theory of communication[J]. The Bell System Technical Journal, 1948,27(3):379-423.
[21]	KANAKUBO T. The development of contemporary theoretical cartography[R]. Shenyang: The Science Reports of Tohoku University. 1990: 1-19.
[22]	SUKHOV V I. Information capacity of a map entropy[J]. Geodesy and AeroPhotography, 1967,10(4):212-215.
[23]	SUKHOV V I. Application of information theory in generalization of map contents[J]. International Yearbook of Cartography, 1970,10:41-47.
[24]	BALASUBRAMANYAN V. Application of information theory to maps[J]. International Yearbook of Cartography, 1971,11:177-180.
[25]	PIPKIN J S. Research note/the map as information channel: ignorance before and after looking at a choropleth map[J]. Cartographica: The International Journal for Geographic Information and Geovisualization, 1975,12(1):80-82.
[26]	TAYLOR R M. Information theory and map evaluation[M]. International Yearbook of Cartography. [S.l.]: [s.n.], 1975,15:166-181.
[27]	KNOPFLI R. Communication theory and generalization[M]. Graphic Communication and Design in Contemporary Cartography. New York and Chichester: John Wiley & Sons, 1983: 177-218.
[28]	NEUMANN J. The topological information content of a map/an attempt at a rehabilitation of information theory in cartography[J]. Cartographica: The International Journal for Geographic Information and Geovisualization, 1994,31(1):26-34.
[29]	DEWEY G T, HERZEL H. Applications of information theory to biology[C]//Pacific Symposium on Biocomputing. Hawaii: World Scientific, 1999: 600-601.
[30]	RHEE A, CHEONG R, LEVCHENKO A. The application of information theory to biochemical signaling systems[J]. Physical Biology, 2012,9(4):045011. doi: 10.1088/1478-3975/9/4/045011 pmid: 22872091
[31]	BLOKH D, STAMBLER L. The application of information theory for the research of aging and aging-related diseases[J]. Progress in Neurobiology, 2017,157:158-173. pmid: 27004830
[32]	MAASOUMI E. A compendium to information theory in economics and econometrics[J]. Econometric Reviews, 1993,12(2):137-181.
[33]	YANG Jangho. Information theoretic approaches in economics[J]. Journal of Economic Surveys, 2018,32(3):940-960.
[34]	ULANOWICZ R E. The central role of information theory in ecology[M]//DEHMER M, EMMERT-STREIB F, MEHLER A. Towards an Information Theory of Complex Networks. Boston: Birkhäuser, 2011: 153-167.
[35]	O’CONNOR M I, PENNEL M W, ALTERMATT F, et al. Principles of ecology revisited: Integrating information and ecological theories for a more unified science[J]. Frontiers in Ecology and Evolution, 2019,7:219.
[36]	BOWDEN R. The information theory of comparisons with applications to statistics and the social sciences[M]. Berlin:Springer. 2018: 110.
[37]	HILBERT M. Special issue “information theory for human and social processes”[J/OL]. Entropy, 2020,22. https://www.mdpi.com/journal/entropy/special_issues/social_processes.
[38]	WARNER J. Analogies between linguistics and information theory[J]. Journal of the American Society for Information Science and Technology, 2007,58(3):309-321.
[39]	GROSSMAN L. Entropy is universal rule of language[EB/OL]. (2011-05-11). https://www.wired.com/2011/05/universal-entropy/.
[40]	MONTEMURRO M A, ZANETTE D H. Universal entropy of word ordering across linguistic families[J]. PLoS One, 2011,6(5):e19875. doi: 10.1371/journal.pone.0019875 pmid: 21603637
[41]	GARNER W R. The contribution of information theory to psychology[M] //The Making of Cognitive Science: Essays in Honor of George A. Miller. Cambridge: Cambridge University Press, 1988: 19-35.
[42]	SAYOOD K. Information theory and cognition: a review[J]. Entropy, 2018,20(9):706.
[43]	LI Zhilin, HUANG Peizhi. Quantitative measures for spatial information of maps[J]. International Journal of Geographical Information Science, 2002,16(7):699-709.
[44]	LEE Y C, LI Zhilin, LI Yilin. Taxonomy of space tessellation[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2000,55(3):139-149.
[45]	WANG Shaoyi, WANG Zhao, DU Qingyun. A measurement method of geometrical information considering multi-level map feature[J]. Science of Surveying and Mapping, 2007,32(4):60-62.
[46]	HARALICK R M, SHANMUGAM K, DINSTEIN I. Textural features for image classification[J]. IEEE Transactions on Systems, Man, Cybernetics, 1973, SMC-3(6):610-621.
[47]	BRINK A D. Using spatial information as an aid to maximum entropy image threshold selection[J]. Pattern Recognition Letters, 1996,17(1):29-36.
[48]	QUWEIDER M K. Spatial entropy-based cost function for gray and color image segmentation with dynamic optimal partitioning[J]. International Journal of Computer Science and Network Security, 2012,12(4):64-75.
[49]	OJALA T, PIETIKÄINEN M, HARWOOD D. A comparative study of texture measures with classification based on featured distributions[J]. Pattern Recognition, 1996,29(1):51-59.
[50]	RAKSHIT S, MISHRA A. Estimation of structural information content in images[M]//NARAYANAN PJ, NAYAR SK, SHUM HY. Proceedings of the Asian Conference on Computer Vision.Hyderabad: Springer, 2006: 265-275.
[51]	CLARAMUNT C. A spatial form of diversity[M]//COHN A G, MARK D M. Spatial Information Theory. Lecture Notes in Computer Science.Heidelberg, Berlin:Springer, 2005: 218-231.
[52]	LEIBOVICI D G, CLARAMUNT C, LE GUYADER D, et al. Local and global spatio-temporal entropy indices based on distance-ratios and co-occurrences distributions[J]. International Journal of Geographical Information Science, 2014,28(5):1061-1084.
[53]	GAO Peichao, LI Zhilin, ZHANG Hong. Thermodynamics-based evaluation of various improved Shannon entropies for configurational information of gray-level images[J]. Entropy, 2018,20(1):19.
[54]	CUSHMAN S A. Calculating the configurational entropy of a landscape mosaic[J]. Landscape Ecology, 2016,31(3):481-489.
[55]	GAO Peichao, ZHANG Hong, LI Zhilin. A hierarchy-based solution to calculate the configurational entropy of landscape gradients[J]. Landscape Ecology, 2017,32(6):1133-1146.
[56]	BANDT C, POMPE B. Permutation entropy: a natural complexity measure for time series[J]. Physical Review Letters, 2002,88(17):174102. doi: 10.1103/PhysRevLett.88.174102 pmid: 12005759
[57]	WU Huayi, ZHU Haijun, LIU Yi. A raster-based map information measurement for QoS[C]//Proceedings of International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences-ISPRS Archives. Istanbul: ISPRS, 2004: 365-370.
[58]	GAO Peichao, LI Zhilin. Computation of the boltzmann entropy of a landscape: a review and a generalization[J]. Landscape Ecology, 2019,34(9):2183-2196.
[59]	BATTY M. Spatial entropy[J]. Geographical Analysis, 1974,6(1):1-31.
[60]	TÖPFER F, PILLEWIZER W. The principles of selection[J]. The Cartographic Journal, 1966,3(1):10-16.
[61]	LI Zhilin, HUANG Peizhi. Transformations of spatial information in multi-scale representation[C]//Proceedings of the 20th International Cartographic Conference. Beijing, China, 2001: 3176-3189.
[62]	AI Tinghua, HE Yakun, DU Xin. Information entropy change in GIS data scale transformation[J]. Geography and Geo-Information Science, 2015,31(2):7-11.
[63]	TIAN Jing, GUO Qingsheng, FENG Ke, et al. Progressive selection approach of streets based on information loss[J]. Geomatics and Information Science of Wuhan University, 2009,34(3):362-365.
[64]	TIAN Jing, AI Tinghua. Communicative model for streets progressive selection[J]. Geomatics and Information Science of Wuhan University, 2010,35(4):415-418.
[65]	KEATES J S. Cartographic design and production[M]. 2nd ed. Harlow, New York: Longman Scientific & Technical, Wiley, 1989: 261.
[66]	LI Lianying, LI Bijun, WU Zhongheng, et al. Automatic placement of annotation in area feature by map spatial geometry information measurement[M]//Proceedings of SPIE 6751,Geoinformatics 2007: Cartographic Theory and Models. Nanjing: SPIE, 2007: 67511F.
[67]	WANG Zhao, WU Zhongheng, FEI Lifan, et al. Automatic name placement of area feature: a metric information approach[J]. Acta Geodaetica et Cartographica Sinica, 2009,38(2):183-188. Doi: 10.3321/j.issn:1001-1595.2009.02.015.
[68]	BJØRKE J T, MYKLEBUST I. Map generalization: information theoretic approach to feature elimination[C]//Proceedings of the 18th International Cartographic Conference (ICC1997). Stockholm: ICC, 2001: 480-486.
[69]	BISHOP T F A, MCBRATNEY A B, WHELAN B M. Measuring the quality of digital soil maps using information criteria[J]. Geoderma, 2001,103(1-2):95-111.
[70]	BATTERSBY S E, CLARKE K C. Quantifyinginformation content in linegeneralization[C]//Proceedings of the 21st International Cartographic Conference (ICC2003). Durban: ICC, 2003: 118-126.
[71]	BJØRKE J T. Generalization of road networks for mobile map services: an information theoretic approach[C]//Proceedings of the21st International Cartographic Conference. Durban: ICC, 2003: 127-135.
[72]	WANG Zhao, FEI Lifan. Syntax-based information quantity rule for automatic map generalization[J]. Science of Surveying and Mapping, 2007,32(6):21-23.
[73]	LIU Wanzeng, LU Chenni, HUO Liang, et al. Selection method of residential point features constrained by optimal information entropy[J]. Geomatics and Information Science of Wuhan University, 2020,37(10):101-105.
[74]	YU Jianwei, ZHU Haihong, JIANG Wenliang, et al. Color design of the Hill-shading map based on entropy[J]. Geomatics and Information Science of Wuhan University, 2008,33(3):302-305.
[75]	TAO Yang, TANG Guoan, WANG Chun, et al. Influence of DEM subset partition on terrain information content[J]. Geomatics and Information Science of Wuhan University, 2009,34(12):1463-1466.
[76]	BJØRKE J T. Exploration of information theoretic arguments for the limited amount of information in a map[J]. Cartography and Geographic Information Science, 2012,39(2):88-97.
[77]	BJØRKE J T. Framework for entropy-based map evaluation[J]. Cartography and Geographic Information Systems, 1996,23(2):78-95.
[78]	RUIZ M, LÓPEZ F, PÁEZ A. Comparison of thematic maps using symbolic entropy[J]. International Journal of Geographical Information Science, 2012,26(3):413-439.
[79]	LINDHOLM M, SARJAKOSKI T. User models and information theory in the design of a query interface for GIS[M]//FRANK A U, CAMPARI I, FORMENTINI U. Theories and Methods of Spatio-Temporal Reasoning in Geographic Space. Lecture Notes in Computer Science, Vol 639. Berlin, Heidelberg:Springer, 1992: 328-347.
[80]	WHEELER J A. Information, physics, quantum: the search for links[M]. Austin, Texas: University of Texas, 1990.
[81]	BECKER K. . Is information fundamental?[EB/OL]. (2014-04-26). http://www.pbs.org/wgbh/nova/blogs/physics/2014/04/is-information-fundamental/.
[82]	SEIFE C. Decoding the Universe: how the new science of information is explaining everything in the cosmos, from our brains to black holes[M]. New York: Penguin Publishing Group, 2007.
[83]	VEDRAL V. Decoding reality: the universe as quantum information[M]. Oxford, UK: Oxford University Press, 2012.
[84]	DAVIES P, GREGERSEN N H. Information and the nature of reality: from physics to metaphysics[M]. Cambridge, UK: Cambridge University Press, 2014.
[85]	LI Zhilin. Algorithmic foundation of multi-scale spatial representation[M]. Boca Raton: CRC Press (Taylor & Francis Group), 2007: 281.
[86]	MOLES A A, COHEN J E. Information theory and esthetic perception[M]. Urbana: University of Illinois Press, 1969: 221.