{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:30:46Z","timestamp":1760243446594,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2013,4,11]],"date-time":"2013-04-11T00:00:00Z","timestamp":1365638400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Evolutionary information theory is a constructive approach that studies information in the context of evolutionary processes, which are ubiquitous in nature and society. In this paper, we develop foundations of evolutionary information theory, building several measures of evolutionary information and obtaining their properties. These measures are based on mathematical models of evolutionary computations, machines and automata. To measure evolutionary information in an invariant form, we construct and study universal evolutionary machines and automata, which form the base for evolutionary information theory. The first class of measures introduced and studied in this paper is evolutionary information size of symbolic objects relative to classes of automata or machines. In particular, it is proved that there is an invariant and optimal evolutionary information size relative to different classes of evolutionary machines. As a rule, different classes of algorithms or automata determine different information size for the same object. The more powerful classes of algorithms or automata decrease the information size of an object in comparison with the information size of an object relative to weaker4 classes of algorithms or machines. The second class of measures for evolutionary information in symbolic objects is studied by introduction of the quantity of evolutionary information about symbolic objects relative to a class of automata or machines. To give an example of applications, we briefly describe a possibility of modeling physical evolution with evolutionary machines to demonstrate applicability of evolutionary information theory to all material processes. At the end of the paper, directions for future research are suggested.<\/jats:p>","DOI":"10.3390\/info4020124","type":"journal-article","created":{"date-parts":[[2013,4,11]],"date-time":"2013-04-11T12:00:21Z","timestamp":1365681621000},"page":"124-168","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Evolutionary Information Theory"],"prefix":"10.3390","volume":"4","author":[{"given":"Mark","family":"Burgin","sequence":"first","affiliation":[{"name":"Computer Science Department, University of California, Los Angeles, 405 Hilgard Ave. Los Angeles, CA 90095, USA"}]}],"member":"1968","published-online":{"date-parts":[[2013,4,11]]},"reference":[{"unstructured":"Garzon, M.H. (, January November). Evolutionary computation and the processes of life: On the role of evolutionary models in computing. Proceeding of Ubiquity Symposium.","key":"ref_1"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"53","DOI":"10.3233\/FI-2009-0033","article-title":"Universality for Turing machines, inductive Turing machines and evolutionary algorithms","volume":"91","author":"Burgin","year":"2009","journal-title":"Fundam. Inform."},{"doi-asserted-by":"crossref","unstructured":"Mo, H. (2009). Handbook of Research on Artificial Immune Systems and Natural Computing: Applying Complex Adaptive Technologies, IGI Global.","key":"ref_3","DOI":"10.4018\/978-1-60566-310-4"},{"doi-asserted-by":"crossref","unstructured":"Burgin, M., and Eberbach, E. (,  2010). Bounded and periodic evolutionary machines. Proceeding of 2010 Congress on Evolutionary Computation (CEC\u20322010), Barcelona, Spain.","key":"ref_4","DOI":"10.1109\/CEC.2010.5586271"},{"doi-asserted-by":"crossref","unstructured":"Chaitin, G.J. (1987). Algorithmic Information Theory, Cambridge University Press.","key":"ref_5","DOI":"10.1017\/CBO9780511608858"},{"doi-asserted-by":"crossref","unstructured":"Li, M., and Vitanyi, P. (1997). An Introduction to Kolmogorov Complexity and its Applications, Springer-Verlag.","key":"ref_6","DOI":"10.1007\/978-1-4757-2606-0"},{"unstructured":"Burgin, M. (2005). Superrecursive Algorithms, Springer.","key":"ref_7"},{"doi-asserted-by":"crossref","unstructured":"Burgin, M. (2010). Theory of Information: Fundamentality, Diversity and Unification, World Scientific Publishing.","key":"ref_8","DOI":"10.1142\/7048"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/s11023-011-9235-1","article-title":"Significance of models of computation from Turing model to natural computation","volume":"21","year":"2011","journal-title":"Minds Mach."},{"doi-asserted-by":"crossref","unstructured":"Dodig-Crnkovic, G., and Burgin, M. (2011). Information and Computation, World Scientific.","key":"ref_10","DOI":"10.1142\/7637"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/0167-2789(90)90186-S","article-title":"Digital mechanics","volume":"45","author":"Fredkin","year":"1990","journal-title":"Physica D"},{"unstructured":"Lloyd, S. A theory of quantum gravity based on quantum computation. Available online:http:\/\/arxiv.org\/abs\/quant-ph\/0501135.","key":"ref_12"},{"unstructured":"Wolfram, S.A. (2002). New Kind of Science, Wolfram Media.","key":"ref_13"},{"doi-asserted-by":"crossref","unstructured":"Zuse, K. (1969). Rechnender Raum, Friedrich Vieweg & Sohn.","key":"ref_14","DOI":"10.1007\/978-3-663-02723-2"},{"unstructured":"Smolin, L. (2001). Three Roads to Quantum Gravity, Basic Books.","key":"ref_15"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1038\/scientificamerican0104-66","article-title":"Atoms of space and time","volume":"15","author":"Smolin","year":"2004","journal-title":"Sci. Am."},{"doi-asserted-by":"crossref","unstructured":"Rovelli, C. (2004). Quantum Gravity, Cambridge University Press.","key":"ref_17","DOI":"10.1017\/CBO9780511755804"},{"key":"ref_18","first-page":"793","article-title":"Multiple computations and Kolmogorov complexity for such processes","volume":"27","author":"Burgin","year":"1983","journal-title":"Not. Acad. Sci. USSR"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.tcs.2003.12.003","article-title":"Algorithmic complexity of recursive and inductive algorithms","volume":"317","author":"Burgin","year":"2004","journal-title":"Theor. Comput. Sci."},{"unstructured":"Burgin, M. (2010). Measuring Power of Algorithms, Computer Programs, and Information Automata, Nova Science Publishers.","key":"ref_20"},{"key":"ref_21","first-page":"1357","article-title":"The theory of logical nets","volume":"41","author":"Burks","year":"1953","journal-title":"Proc. Inst. Radio Eng."},{"doi-asserted-by":"crossref","unstructured":"Blum, L., Cucker, F., Shub, M., and Smale, S. (1997). Complexity and Real Computation, Springer-Verlag.","key":"ref_22","DOI":"10.1007\/978-1-4612-0701-6"},{"key":"ref_23","first-page":"654","article-title":"Universal limit Turing machines","volume":"325","author":"Burgin","year":"1992","journal-title":"Not. Rus. Acad. Sci."},{"key":"ref_24","first-page":"504","article-title":"Negative information","volume":"10","author":"Wright","year":"1996","journal-title":"Rasch Meas. Trans."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1038\/nature03909","article-title":"Partial quantum information","volume":"436","author":"Horodecki","year":"2005","journal-title":"Nature"},{"unstructured":"Hintikka, J. (1973). Logic, Language Games and Information, Clarendon.","key":"ref_26"},{"doi-asserted-by":"crossref","unstructured":"Michalewicz, Z. (1996). Genetic Algorithms + Data Structures = Evolution Programs, Springer-Verlag.","key":"ref_27","DOI":"10.1007\/978-3-662-03315-9"},{"doi-asserted-by":"crossref","unstructured":"Michalewicz, Z., and Fogel, D.B. (2004). How to Solve It: Modern Heuristics, Springer-Verlag. [2nd].","key":"ref_28","DOI":"10.1007\/978-3-662-07807-5"},{"unstructured":"Burgin, M. (2011). Theory of Named Sets, Nova Science Publisher.","key":"ref_29"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1038\/scientificamerican0402-62","article-title":"Ripples in spacetime","volume":"286","author":"Gibbs","year":"2002","journal-title":"Sci. Am."},{"key":"ref_31","first-page":"175","article-title":"On the concept of algorithm","volume":"8","author":"Kolmogorov","year":"1953","journal-title":"Rus. Math. Surv."},{"unstructured":"Nielsen, J. (1990). Hypertext and Hypermedia, Academic Press.","key":"ref_32"},{"unstructured":"Peterson, J.L. (1981). Petri Net Theory and the Modeling of Systems, Prentice-Hall, Inc.","key":"ref_33"},{"unstructured":"Petri, C. (1962). Kommunikation mit Automaten. [Ph.D. Thesis, University of Bonn].","key":"ref_34"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.biosystems.2007.06.003","article-title":"Cooperative combinatorial optimization: Evolutionary computation case study","volume":"91","author":"Burgin","year":"2008","journal-title":"BioSystems"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/S1364-6613(03)00136-0","article-title":"Language evolution: Consensus and controversies","volume":"7","author":"Christiansen","year":"2003","journal-title":"Trends Cogn. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"8028","DOI":"10.1073\/pnas.96.14.8028","article-title":"The evolution of language","volume":"96","author":"Nowak","year":"1999","journal-title":"Proc. Natl. Acad. Sci. USA"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/4\/2\/124\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:46:05Z","timestamp":1760219165000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/4\/2\/124"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,4,11]]},"references-count":37,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2013,6]]}},"alternative-id":["info4020124"],"URL":"https:\/\/doi.org\/10.3390\/info4020124","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2013,4,11]]}}}