Systems biology: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>Gareth Leng
No edit summary
mNo edit summary
 
(49 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{subpages}}
{{subpages}}
{|align="right" cellpadding="10" style="background:lightgray; width:35%; border: 1px solid #aaa; margin:20px; font-size: 93%; font-family: Gill Sans MT;"
| The properties of systems are the result of two important characteristics: systems have a hierarchical structure, and the structure is held together by numerous linkages to construct very complex networks.
: <p align="right">&mdash;Anthony Trewavas<ref name=trewavas2006> Trewavas A. (2006) [http://dx.doi.org/10.1105/tpc.106.042267 A Brief History of Systems Biology]. ''Plant Cell'' 18:2420-2430].</ref></p>
|}
As an academic discipline, '''systems biology''',<ref> Kitano H (2002) [http://dx.doi.org/10.1126/science.1069492 Systems biology: a brief overview]. Science 295(5560):1662-1664.PMID</ref> aims to explain, predict, and control the properties, functions and behaviors<ref>''Property'': quality or trait peculiar to a thing (e.g., mass, volume, ability to reproduce, structure, lifespan, etc.; ''function'': activity specially fitted for a thing (e.g., locomotion, phagocytosis, phototropism, functioning as a molecular motor, energy transduction, etc.); ''behavior'': the activity detected by the observer (e.g., deception, flight, chemotaxis, etc.).  The distinctions among those often blur, ''property'' serving generically in many instances.</ref> of [[Life|living systems]] and their subsystems.<ref name=kitano2002a>Kitano H (2002) Systems biology: a brief overview. ''Science'' [http://www.sciencemag.org/cgi/content/full/295/5560/1662/ 295:1662-4] PMID 11872829 </ref>
From the systems biology perspective, living systems are [[Complexity (biology)|complex adaptive system]]s, compartmented, self-assembled and [[Self-organization|self-organized]] [[Biological networks|networks]] of interconnected, interacting, interdependent diverse types of components, all naturally generated and [[Natural selection|naturally selected]], interacting physico-chemically in a dynamic, coordinated, and hierarchical pattern, in part orchestrated and constrained by the system-as-a-whole. Living systems exhibit [[Emergence (Biology)|emergent]] properties and behaviors &mdash; [[Emergence (biology)|emergent]] in the sense that the system-as-a-whole, in comparison with its components, exhibits properties and behaviors unique to itself, often unexpected and novel.<ref name=kitano2002a/>&nbsp;<ref name=reid07>Reid RGB (2007) ''Biological Emergences: Evolution by Natural Experiment.'' A Bradford Book, Cambridge ISBN 10: 0-262-18257-2</ref>&nbsp;<ref name=bruggeman02pp>Bruggeman FJ ''et al.'' (2002) [http://dx.doi.org/10.1080/0951508021000041996 BioComplexity: a pluralist research strategy is necessary for a mechanistic explanation of the "live" state'.] ''Phil Psychol'' 15:411-40
:*"The organizational '''hierarchy''' in cell biology starts with the properties of individual organic molecules (e.g. amino acids, nucleotides), and goes via oligomers and polymers (e.g. enzymes, structural proteins, DNA, RNA, fats) to cell organelles (e.g. mitochondria, plastids, nuclei) and finally to the whole cell, which then interacts with its environment."
:*"Apart from a '''hierarchy''' based on the size and nature of cellular constituents, other useful '''hierarchies''' can be formulated. Cellular function can also be divided in functional units that group many processes together. For instance, a broad division in transport, anabolism, catabolism, and maintenance is sometimes useful."
:*"Alternatively, one may distinguish between replication, transcription, translation, and metabolism. The borders of the various levels in the organizational '''hierarchy''' are not strictly defined."
::*One might view the different types of hierarchies together as making up the system.</ref>&nbsp;&nbsp;
Biological systems studied by systems biologists range from the level of the molecular subsystems of cells (e.g.,[[Mitochondria|mitochondrial]] production of [[energy]]; [[Ribosome|ribosomal]] protein synthesis; circuits of biochemical reactions regulating [[gene]] expression; cell-to-cell and within-cell signaling pathways); to the Earth's biosphere, and include many intermediate system levels (e.g., unicellular organisms, multicellular organs, multicellular-multiorgan organisms, ecosystems).
Scientists engaged in [[bioengineering]], [[synthetic biology]], [[biophysics]], [[bioinformatics]] and related fields consider systems biology as part of their disciplines.
{{-}}
{{TOC|center}}
{{-}}


{|align="right" cellpadding="10" style="background-color:#CCFFFF; width:30%; border: 1px solid #aaa; margin:20px; font-size: 92%;"
==The Scope of Systems biology==
{|align="left" cellpadding="10" style="background-color:#CCFFFF; width:30%; border: 1px solid #aaa; margin:20px; font-size: 92%; font-family: Gill Sans MT;"
|
|
<center>'''Reductionism and Holism'''</center>
<center>'''Reductionism and Holism'''</center>
Line 7: Line 27:
<center><span class="plainlinks">Gilbert SF, Sarkar S (2000) [http://www3.interscience.wiley.com/cgi-bin/abstract/72513248/ABSTRACT Embracing complexity: organicism for the 21st century.] ''Dev Dyn'' 219:1-9 PMID 10974666]'''</span></center>
<center><span class="plainlinks">Gilbert SF, Sarkar S (2000) [http://www3.interscience.wiley.com/cgi-bin/abstract/72513248/ABSTRACT Embracing complexity: organicism for the 21st century.] ''Dev Dyn'' 219:1-9 PMID 10974666]'''</span></center>


*'''Reductionism:''' ''“…imagine a materialistic philosophy that claims that all complex entities (including proteins, cells, organisms, ecosystems) can be completely explained by the properties of their component parts. Such an epistemological position is called reductionism, and it is the basis for most of physics and chemistry, and much of biology….. In the reductionist epistemology of science, chemistry and biology are not ultimately independent disciplines, because they will eventually have all their explanations “reduced” to the terms of physics. The reductionist epistemology and methodology is strictly analytical.”''
<font face="Gill Sans MT">'''Reductionism:''' “…imagine a materialistic philosophy that claims that all complex entities (including proteins, cells, organisms, ecosystems) can be completely explained by the properties of their component parts. Such an epistemological position is called reductionism, and it is the basis for most of physics and chemistry, and much of biology….. In the reductionist epistemology of science, chemistry and biology are not ultimately independent disciplines, because they will eventually have all their explanations “reduced” to the terms of physics. The reductionist epistemology and methodology is strictly analytical.”


*'''Holism:'''  ''”Let us imagine, though, another (ontologically) materialistic philosophy. Here, complex wholes are inherently greater than the sum of their parts in the sense that the properties of each part are dependent upon the context of the part within the whole in which they operate. Thus, when we try to explain how the whole system behaves, we have to talk about the context of the whole and cannot get away talking only about the parts. This philosophical stance is variously called wholism, holism, or organicism.”
'''Holism:'''  ”Let us imagine, though, another (ontologically) materialistic philosophy. Here, complex wholes are inherently greater than the sum of their parts in the sense that the properties of each part are dependent upon the context of the part within the whole in which they operate. Thus, when we try to explain how the whole system behaves, we have to talk about the context of the whole and cannot get away talking only about the parts. This philosophical stance is variously called wholism, holism, or organicism.”</font>
|}
|}
As an academic discipline, '''systems biology''' aims to explain, predict and control the properties, functions and behaviors<ref>''Property'': quality or trait peculiar to a thing (e.g., mass, volume, ability to reproduce, structure, lifespan, etc.; ''function'': activity specially fitted for a thing (e.g., locomotion, phagocytosis, phototropism, functioning as a molecular motor, energy transduction, etc.); ''behavior'': the activity detected by the observer (e.g., deception, flight, chemotaxis, etc.).  The distinctions among those often blur, ‘''property''’ serving generically in many instances.</ref> of living [[system]]s. From the systems biology perspective, living systems are complex, compartmented, self-organized assemblages of interrelated biological components, naturally generated and naturally selected, that interact molecularly in a dynamic, coordinated and hierarchical pattern, and exhibit [[Emergence (Biology)|emergent]] properties, functions and behaviors &mdash; emergent in the sense of unique to the system-as-a-whole in comparison with those of its individuated components.<ref name=kitano2002a>Kitano H (2002) Systems biology: a brief overview. ''Science'' [http://www.sciencemag.org/cgi/content/full/295/5560/1662/ 295:1662-4] PMID 11872829 </ref>&nbsp;<ref name=reid07>Reid RGB (2007) ''Biological Emergences: Evolution by Natural Experiment.'' A Bradford Book, Cambridge ISBN 10: 0-262-18257-2</ref>&nbsp;<ref name=bruggeman02pp>Bruggeman FJ ''et al.'' (2002) [http://dx.doi.org/10.1080/0951508021000041996 BioComplexity: a pluralist research strategy is necessary for a mechanistic explanation of the "live" state'.] ''Philosophical Psychology'' 15:411-40
:*”The organizational '''hierarchy''' in cell biology starts with the properties of individual organic molecules (e.g. amino acids, nucleotides), and goes via oligomers and polymers (e.g. enzymes, structural proteins, DNA, RNA, fats) to cell organelles (e.g. mitochondria, plastids, nuclei) and finally to the whole cell, which then interacts with its environment [which influences the organization of the system].
:*"Apart from a '''hierarchy''' based on the size and nature of cellular constituents, other useful '''hierarchies''' can be formulated. Cellular function can also be divided in functional units that group together large numbers of processes. For instance, a broad division in transport, anabolism, catabolism, and maintenance is sometimes useful.
:*"Alternatively, one may distinguish between replication, transcription, translation, and metabolism. The borders of the various levels in the biological organizational '''hierarchy''' are not strictly defined."
::*One might view the different types of hierarchies together as making up the system.</ref>&nbsp;&nbsp;Biological systems studied range from the level of the molecular subsystems of cells (e.g., mitochondrial production of versatilely usable energy; ribosomal protein synthesis; circuits of biochemical reactions regulating gene expression; cell-to-cell and within-cell signaling (communicational) pathways); to the Earth's biosphere, and include a large number of intermediate system levels (e.g., unicellular organisms, multicellular organs, multicellular-multiorgan organisms, ecosystems).


Scientists engaged in [[bioengineering]], [[synthetic biology]], [[biophysics]], [[bioinformatics]] and related fields consider systems biology as part of their disciplines.
Systems biology developed in part because of the recognition that knowledge of the properties of a system’s components, separated from the system embedding them, could never yield a satisfying explanation of the organized behavior of the system. The behavior of a system as a whole depends not only on the properties of its components, but also on how they interrelate and interact dynamically and coordinately spatio-temporally. It also depends on how the organized behavior of the system (influenced in part by the larger system embedding ''it'') influences the properties and interactions of the components. The novel and unpredictable properties (including functions and behaviors) of systems [[Emergence (biology)|emerge]] from its dynamic organization, and to understand them requires a ‘holistic’ <ref name=gilbert00>Gilbert SF, Sarkar S (2000) Embracing complexity: organicism for the 21st century. ''Dev Dyn'' 219:1-9 PMID 10974666
 
:*'''Reductionism:''' ''“…imagine a materialistic philosophy that claims that all complex entities (including proteins, cells, organisms, ecosystems) can be completely explained by the properties of their component parts. Such an epistemological position is called ''reductionism''', and it is the basis for most of physics and chemistry, and much of biology…. In the reductionist epistemology of science, chemistry and biology are not ultimately independent disciplines, because they will eventually have all their explanations “reduced” to physics. The reductionist epistemology and methodology is strictly analytical.”''
==The Scope of Systems biology==
Systems biology developed as a scientific endeavor in part because of the recognition that knowledge of the properties of a system’s components, separated from the system embedding them, however complete that knowledge, could not yield a satisfying explanation of the organized behavior of the system. The behavior of a system as a whole depends not only on the properties of the system’s components, but also on how they interrelate and interact dynamically and coordinately spatio-temporally, and also on how the organized behavior of the system (influenced in part by the larger system embedding ''it'') itself influences the properties and interactions of the components. The novel and unpredictable properties (including functions and behaviors) of systems [[Emergence|emerge]] from its dynamic organization, and to understand them requires a ‘holistic’ <ref name=gilbert00>Gilbert SF, Sarkar S (2000) Embracing complexity: organicism for the 21st century. ''Dev Dyn'' 219:1-9 PMID 10974666
:*'''Reductionism:''' ''“…imagine a materialistic philosophy that claims that all complex entities (including proteins, cells, organisms, ecosystems) can be completely explained by the properties of their component parts. Such an epistemological position is called reductionism, and it is the basis for most of physics and chemistry, and much of biology….. In the reductionist epistemology of science, chemistry and biology are not ultimately independent disciplines, because they will eventually have all their explanations “reduced” to the terms of physics. The reductionist epistemology and methodology is strictly analytical.”''
:*'''Holism:'''  ''”Let us imagine, though, another (ontologically) materialistic philosophy. Here, complex wholes are inherently greater than the sum of their parts in the sense that the properties of each part are dependent upon the context of the part within the whole in which they operate. Thus, when we try to explain how the whole system behaves, we have to talk about the context of the whole and cannot get away talking only about the parts. This philosophical stance is variously called wholism, holism, or organicism.”''</ref>  approach in coordination with the traditional ‘reductionistic’<ref name=gilbert00/> approach.
:*'''Holism:'''  ''”Let us imagine, though, another (ontologically) materialistic philosophy. Here, complex wholes are inherently greater than the sum of their parts in the sense that the properties of each part are dependent upon the context of the part within the whole in which they operate. Thus, when we try to explain how the whole system behaves, we have to talk about the context of the whole and cannot get away talking only about the parts. This philosophical stance is variously called wholism, holism, or organicism.”''</ref>  approach in coordination with the traditional ‘reductionistic’<ref name=gilbert00/> approach.


"Humpty-Dumpty has been smashed into billions of fragments...Can we put Humpty-Dumpty back together again?" <ref name=nobel06bk>Nobel D. (2006) [http://www.us.oup.com/us/catalog/general/subject/LifeSciences/~~/dmlldz11c2EmY2k9OTc4MDE5OTIyODM2Mg==  The Music of Life: Biology Beyond the Genome.] Oxford University Press, New York. ISBN 978-0-19-929573-9 [http://www.dpag.ox.ac.uk/academic_staff/denis_noble Brief Biography] [http://books.google.com/books?id=0TRl4gsKYXMC&dq=%22denis+noble%22+%22music+of+life%22&printsec=frontcover&source=web&ots=0P20oX8q-Y&sig=rJ-8xkC4SSPAf346NnoAAlACSX4 Multiple Chapter Excerpts Online]</ref>&nbsp;&nbsp;('''''See text-box at right.''''')
"Humpty-Dumpty has been smashed into billions of fragments...Can we put Humpty-Dumpty back together again?" <ref name=nobel06bk>Nobel D. (2006) [http://www.us.oup.com/us/catalog/general/subject/LifeSciences/~~/dmlldz11c2EmY2k9OTc4MDE5OTIyODM2Mg==  ''The Music of Life: Biology Beyond the Genome.''] Oxford University Press, New York. ISBN 978-0-19-929573-9 [http://www.dpag.ox.ac.uk/academic_staff/denis_noble Brief Biography] [http://books.google.com/books?id=0TRl4gsKYXMC&dq=%22denis+noble%22+%22music+of+life%22&printsec=frontcover&source=web&ots=0P20oX8q-Y&sig=rJ-8xkC4SSPAf346NnoAAlACSX4 Multiple Chapter Excerpts Online]</ref>&nbsp;&nbsp;('''''See text-box at left.''''')


Systems biologists try to achieve their aims in part through developing ''models'' (descriptions, representations, simulations) of systems &mdash; including graphical, mathematical, algorithmical, and computer-based computational simulation models. The models aspire to 'describe' systems, or 'translate' them into the ''cognitively knowable'' 'language' or 'symbolism' of the model. The moldels enable interpretation of the systems' components' organization and the systems' behavior by human cognition.  The models aspire to do that well enough to account for experimentally derived data about a system’s coordinated dynamically interacting components, and to allow predictions of the system's properties, functions and behaviors in response to given stimuli or given sets of conditions.  
Systems biologists try to achieve their aims in part through developing ''models'' (descriptions, representations, simulations) of systems &mdash; including graphical, mathematical, algorithmical, and computer-based computational simulation models. The models 'describe' systems, or 'translate' them into the ''cognitively knowable'' 'language' or 'symbolism' of the model. They enable interpretation of the systems' components' organization and the systems' behavior by human cognition.  The models aspire to do that well enough to account for experimental data about a system’s coordinated dynamically interacting components, and to allow predictions of the system's properties, functions and behaviors in response to stimuli or in particular conditions.  


Systems biologists use sophisticated mathematical, statistical and computational tools in diverse modeling approaches, in mathematical network analyses, in [[computer simulation|computer simulations]]. The invention and improvement of high-speed digital computers and advances in [[Biology's next microscope: Mathematics|mathematical reasoning]] has changed classical scientific experimentation by providing a medium in which scientists can explore systems by implementing their components, interrelations and interactions in a dynamic reality composed solely of binary digits.  The scientist can create a particular reality to implement a physical system from known properties of the system and known principles of the interactions of matter.  They can enable the digital reality to ‘imitate’, or ‘simulate’, the system’s behavior in response to simulated changes in environmental conditions, and to output the simulation in various formats readily interpretable by human cognition. Nuclear scientists, aerodynamicists, chemists, economists, as well as biologists, more and more rely on computer simulations to examine the behavior of systems.  Modeling permits design and building of synthetic networks from biomolecules.  Modeling refinements occur as systems biologists iteratively incorporate new data derived from experiments inspired by systems analysis.
Systems biologists use mathematical, statistical and computational tools in diverse modeling approaches, in mathematical network analyses, in [[computer simulation|computer simulations]]. High-speed digital computers and advances in [[Biology's next microscope: Mathematics|mathematical reasoning]] have changed classical experimentation by enabling scientists to explore systems by implementing their components, interrelations and interactions in a dynamic reality composed of binary digits.  The scientist can create a particular reality to implement a physical system from known properties of the system and known principles of the interactions of matter.  They can thus  ‘imitate’, or ‘simulate’, the system’s behavior in response to simulated changes in environmental conditions, and to output the simulation in readily interpretable formats. Nuclear scientists, aerodynamicists, chemists, economists, as well as biologists, more and more rely on computer simulations to understand systems.  Modeling permits design and building of synthetic networks from biomolecules.  Modeling refinements occur as systems biologists iteratively incorporate new data from experiments inspired by systems analysis.


Mathematical modeling permits a kind of formal integrative analysis of a biological system that also facilitates the development of conceptual frameworks to integrate large amounts of data. That can permit identification of the gaps in the information known about a system.  Without models, the human mind can comprehend little of the complex organization-as-a-whole of a living system.  In speaking specifically about the subsystems of signaling pathways in living cells, Weng ''et al.'' put it this way:  ''There is simply too much essential detail in biological signaling for the unaided human mind to organize and understand.''<ref>Weng G ''et al.''(1999) Complexity in biological signaling systems. ''Science'' [http://dx.doi.org/10.1126/science.284.5411.92 284:92-6] PMID 10102825</ref> Models provide metaphors for explanation of systems, powerful metaphors with remarkable potential for predicting and managing the behavior of living systems.
Mathematical modeling permits a kind of formal integrative analysis of a biological system that also facilitates the development of conceptual frameworks that can permit identification of gaps in knowledge or understanding.  Without models, the human mind can comprehend little of the complex organization-as-a-whole of a living system.  In speaking about the signaling pathways in living cells, Weng ''et al.'' put it this way:  ''There is simply too much essential detail in biological signaling for the unaided human mind to organize and understand.''<ref>Weng G ''et al.''(1999) Complexity in biological signaling systems. ''Science'' [http://dx.doi.org/10.1126/science.284.5411.92 284:92-6] PMID 10102825</ref> Models provide [[metaphor]]s for explanation of systems, powerful metaphors with remarkable potential for predicting and managing the behavior of living systems.


Systems biologists often work with scientists from other disciplines in developing models and conceptual frameworks. Some of those non-biological disciplines (e.g., mathematics, physics and chemistry) have developed systems approaches to explore systems in their own domains.   
Systems biologists often work with scientists from other disciplines in developing models and conceptual frameworks. Some of those non-biological disciplines (e.g., mathematics, physics and chemistry) have developed systems approaches to explore systems in their own domains.   


No definition or succinct description can capture the breadth and depth of the interdisciplinary enterprise of systems biology. Indeed, historian and philosopher of science Evelyn Fox Keller argues that “so far, ‘systems biology’ is a concept waiting for definition".<ref name=keller2005> Keller EF (2005) The century beyond the gene. ''J Biosci'' 30:3-10 PMID 15824435</ref>&nbsp;&nbsp;This article elaborates on the above description of the discipline.
No definition or succinct description can capture the breadth and depth of systems biology. Indeed, historian and philosopher of science Evelyn Fox Keller argues that “so far, ‘systems biology’ is a concept waiting for definition".<ref name=keller2005> Keller EF (2005) The century beyond the gene. ''J Biosci'' 30:3-10 PMID 15824435</ref>&nbsp;&nbsp;This article elaborates on the above description of the discipline.


== Methodologies in general terms ==
== Methodologies in general terms ==
Line 40: Line 52:
Systems biologists try to accomplish their aims in part:
Systems biologists try to accomplish their aims in part:


:*by identifying and quantifying the system's components &mdash; for cells, acquiring so-called '-omics' data, including the numbers and types of nucleic acids, proteins, and metabolites;
:*by identifying and quantifying the system's components &mdash; for cells, acquiring so-called '-omics' data, including the numbers and types of nucleic acids ([[genomics]]), proteins ([[Proteome|proteomics]]), and metabolites ([[metabolomics]]);


:*by identifying, characterizing, and to the extent possible, quantifying the interrelations (structural) and interactions (dynamical, coordinated, hierarchical) among the components of a system; for example, (a) for molecular components: gene and protein interactions involved in a cell’s [[metabolic pathways]]; (b) for organism components: organ interactions resulting in blood pressure homeostasis; (c) for ecosystem components: predator and prey behaviors;
:*by identifying, characterizing, and to the extent possible, quantifying the interrelations (structural) and interactions (dynamical, coordinated, hierarchical) among the components of a system; for example, (a) for molecular components: gene and protein interactions involved in a cell’s [[metabolic pathways]]; (b) for organism components: organ interactions resulting in blood pressure homeostasis; (c) for ecosystem components: predator and prey behaviors;
Line 54: Line 66:
:*Review of synthetic biology: “…''for biologists, the ability to design and construct synthetic biological systems provides a direct and compelling method for testing our current understanding of natural biological systems.''”</ref>
:*Review of synthetic biology: “…''for biologists, the ability to design and construct synthetic biological systems provides a direct and compelling method for testing our current understanding of natural biological systems.''”</ref>


:*by developing new experimental technologies and new theoretical methods as required to answer new questions that inevitably arise in the study of the unfathomable complexity of living systems.<ref>Westerhoff HV, Kell DB. (2007) "The methodologies of systems biology."  In: Boogerd FC, Bruggeman FJ, Hofmeyr J-HS, Westerhoff HV (eds) ''Systems Biology: Philosophical Foundations.'' Elsevier ISBN 0444520856</ref>.
:*by developing new experimental technologies and new theoretical methods as required to answer new questions that inevitably arise in the study of the unfathomable complexity of living systems.<ref>Westerhoff HV, Kell DB. (2007) "The methodologies of systems biology."  In: Boogerd FC ''et al.'' (eds) ''Systems Biology: Philosophical Foundations.'' Elsevier ISBN 0444520856</ref>.


Modeling may take either ‘bottom-up’ or ‘top-down’ approaches.<ref name=bruggeman06>Bruggeman FJ, Westerhoff HV (2006) [http://dx.doi.org/10.1016/j.tim.2006.11.003 The nature of systems biology.] PMID 17113776</ref>&nbsp;&nbsp;  Systems biologists use both approaches in trying to put the puzzle of the whole together.
Modeling may take either ‘bottom-up’ or ‘top-down’ approaches.<ref name=bruggeman06>Bruggeman FJ, Westerhoff HV (2006) [http://dx.doi.org/10.1016/j.tim.2006.11.003 The nature of systems biology.] PMID 17113776</ref>&nbsp;&nbsp;  Systems biologists use both approaches in trying to put the puzzle of the whole together.
Line 60: Line 72:
In bottom-up approaches, biologists start from the properties and interactions of molecules, or of elemental subsystems, and use that data to design models that try to explain the how the interactions (e.g., those in a  factually-rich kinetic model of reaction network) account, at least in part, for functional behaviors of the system that embeds them (e.g., accounts for a behaviors stability despite perturbing environmental changes). They then evaluate the model’s predictions through experiments on the real system, and, depending on the results, they adjust the model and repeat the process, or they try to obtain additional experimental data that the model reveals as required for a better model.  The computer models allow for exploring the behavior of the model-system under different environmental conditions, sometimes even leading to discovery of new levels of organization in the system modeled.
In bottom-up approaches, biologists start from the properties and interactions of molecules, or of elemental subsystems, and use that data to design models that try to explain the how the interactions (e.g., those in a  factually-rich kinetic model of reaction network) account, at least in part, for functional behaviors of the system that embeds them (e.g., accounts for a behaviors stability despite perturbing environmental changes). They then evaluate the model’s predictions through experiments on the real system, and, depending on the results, they adjust the model and repeat the process, or they try to obtain additional experimental data that the model reveals as required for a better model.  The computer models allow for exploring the behavior of the model-system under different environmental conditions, sometimes even leading to discovery of new levels of organization in the system modeled.


In top-down approaches, biologists start from the properties, functions and behaviors of the system-as-a-whole (system-data), making top-down a data-rich enterprise.  They try to design models of component composition and interactions that reveal both the experimentally-derived component/interaction-data and the correlations between component properties and system behavior, which then suggest new hypotheses. Often the system-data includes the responses of the system to typical perturbations. Deficiencies of the model’s accordance and accounting may suggest possibilities for the kinds of component-composition and interactions needed to make the model work, leading to targeted experimentation to discover new molecular or subsystem mechanisms operating in the system. As the model becomes refined, through iterations of model-adjustment and targeted experimentation, it inspires better and better testable hypotheses about the system’s organization, potentially leading to both a complete description of the component-composition and its organizational dynamics and functionality.  However, the complete data complement of the system often greatly outstrips the sometimes enormous data-sets available, or technologically acquirable, such that the most refined models offer only a glimpse of the system’s complexity.  
In top-down approaches, biologists start from the properties, functions and behaviors of the system-as-a-whole (system-data), making 'top-down' a data-rich enterprise.  They try to design models of component composition and interactions that reveal both the experimentally-derived component/interaction-data and the correlations between component properties and system behavior, which then suggest new hypotheses. Often the system-data includes the responses of the system to typical perturbations. Deficiencies of the model’s accordance and accounting may suggest possibilities for the kinds of component-composition and interactions needed to make the model work, leading to targeted experimentation to discover new molecular or subsystem mechanisms operating in the system. As the model advances in its predictive ability, through iterations of model-adjustment and targeted experimentation, it inspires better and better testable hypotheses about the system’s organization, potentially leading to both a complete description of the component-composition and its organizational dynamics and functionality.  Yet, except for very small subsystems, however much data we may have acquired or can acquire about a biological system, it can only ever be a small part of all the data that would be needed to completely specify the system.


Modeling sophistication continues to develop rapidly in the early 21st century.  For some systems, modeling uses multiple datasets distributed in cyberspace, more than one mathematical or computational methodology, and even an array of interlinked computers having different architectures.<ref name=burrage06>Burrage K ''et al.'' (2006) Advanced computing for systems biology. ''Briefings in Bioinformatics'' [http://dx.doi.org/10.1093/bib/bbl033 7:390-8]  
Modeling sophistication continues to develop rapidly in the early 21st century.  For some systems, modeling uses multiple datasets distributed in cyberspace, more than one mathematical or computational methodology, and even an array of interlinked computers having different architectures.<ref name=burrage06>Burrage K ''et al.'' (2006) Advanced computing for systems biology. ''Briefings in Bioinformatics'' [http://dx.doi.org/10.1093/bib/bbl033 7:390-8]  
:*See also: TeraGrid project, http://www.teragrid.org</ref>&nbsp;&nbsp; Many of the books and articles listed for further reading at the end of this article provide detailed descriptions and examples of the vast array of specific mathematical, graphical, computational, and biostatistical tools that systems biologists use to study biological systems.
:*See also: TeraGrid project, http://www.teragrid.org</ref>&nbsp;&nbsp; Many of the books and articles listed for further reading at the end of this article provide detailed descriptions and examples of the vast array of mathematical, graphical, computational, and biostatistical tools that systems biologists use.


Systems biologists expect progress in the field to yield explanations of biological systems exploitable for applications in [[ecology]], ethology, medicine, agriculture, business, the environment and technology &mdash; and to a considerable extent it has already done so. Some systems biologists consider the discipline critical to further progress in biology.<ref name=wester2004>Westerhoff HV, Palsson BO (2004) The evolution of molecular biology into systems biology. ''Nature Biotechnol'' [http://dx.doi.org/10.1038/nbt1020 22:1249-52]</ref>
Systems biologists expect progress in the field to yield explanations of biological systems exploitable for applications in [[ecology]], ethology, medicine, agriculture, business, the environment and technology &mdash; and to a considerable extent it has already done so. Some systems biologists consider the discipline critical to further progress in biology.<ref name=wester2004>Westerhoff HV, Palsson BO (2004) The evolution of molecular biology into systems biology. ''Nature Biotechnol'' [http://dx.doi.org/10.1038/nbt1020 22:1249-52]</ref>


The study of biological systems biology/physiology has expanded greatly as the result of major advances in molecular biology and data processing/analysis in the late 20th and early 21st century. Those include sequencing of genomes, developments in genetic engineering, developments of technologies for generating massive amounts of data on the structure and interactions of cellular components, and developments in bioinformatics &mdash; all fueled by increasing interest by non-biological scientists (mathematicians, statisticians, computer scientists, physicists, chemists, and engineers, among others) in applying the principles and methods of their disciplines to the explanation of the improbable adaptive complexity of living systems (see illustration below on rate of growth of publications on systems biology).
The study of biological systems expanded greatly as the result of advances in molecular biology and data processing/analysis in the late 20th and early 21st century. Those include sequencing of genomes, developments in genetic engineering, developments of technologies for generating massive amounts of data on the structure and interactions of cellular components, and developments in bioinformatics &mdash; all fueled by increasing interest by non-biological scientists (mathematicians, statisticians, computer scientists, physicists, chemists, and engineers, among others) in applying the principles and methods of their disciplines to the explanation of the improbable adaptive complexity of living systems (see illustration below on growth of publications on systems biology).


==On the nature of biological "systems"==
==On the nature of biological "systems"==
A 'system' in biology is any interconnected, interacting, coordinated and hierarchical assembly of biological components or elements—an organized assemblage with identifiable behavior. For example, the vertebrate body is an assembly of diverse, interacting organs, among other components, behaving to survive and reproduce. The mitochondria of cells comprise a system for converting food energy into a general-use molecule for energizing biochemical reactions.  Each component in a biological system interacts in some way(s) with one or more components in the system--a dynamical assembly of components. In a cell, proteins are the products of genes, but they also interact with genes, affecting their expression, as well as interacting with other proteins. Systems can exhibit behaviors that are characteristic of the system-as-a-whole (see below), but which are not shared by any of its components (so-called emergent behaviors). A tree fruits, for example, because its dynamically interacting components enable it to, but no single component of a tree can.   
A 'system' in biology is any interconnected, interacting, coordinated and hierarchical assembly of biological components or elements—an organized assemblage with identifiable behavior. For example, the vertebrate body is an assembly of diverse, interacting organs, among other components, behaving to survive and reproduce. The [[mitochondria]] of [[cell]]s comprise a system for converting food energy into a general-use molecule for energizing biochemical reactions.  Each component in a biological system interacts in some way(s) with one or more components in the system--a dynamical assembly of components. In a cell, proteins are the products of genes, but they also interact with genes, affecting their expression, as well as interacting with other proteins. Systems can exhibit behaviors that are characteristic of the system-as-a-whole (see below), but which are not shared by any of its components (so-called emergent behaviors). A tree fruits, for example, because its dynamically interacting components enable it to, but no single component of a tree can.   


Subsystems consist of smaller (less complex) systems embedded in a larger (more complex) system, and constitute at least part of the components or elements of the larger system. Whether a systems biologist treats a given assembly of components  as a subsystem or as a system depends on the 'level' at which she focuses her attention. If she focuses her research at the level of a whole vertebrate organism, for example, she treats its organs as subsystems. If she focuses her research at the level of the heart, she treats the heart's interacting components as a system, while recognizing that the heart remains part of a larger system (the circulatory system).   
Subsystems consist of smaller (less complex) systems embedded in a larger (more complex) system, and constitute at least part of the components or elements of the larger system. Whether a systems biologist treats a given assembly of components  as a subsystem or as a system depends on the 'level' at which she focuses her attention. If she focuses her research at the level of a whole vertebrate organism, for example, she treats its organs as subsystems. If she focuses her research at the level of the heart, she treats the heart's interacting components as a system, while recognizing that the heart remains part of a larger system (the circulatory system).   


Even the larger systems, such as the vertebrate body system, are components or elements of even larger systems, a species of vertebrates, say, where individual members of the species interact with each other, as components, to generate a set of behaviors or properties characteristic of the species but not of the individual members of the species.  The flocking behavior of birds illustrates a species behavior--technically the behavior of a [[deme]].  One bird cannot flock.  Reproduction among sexually reproducing species requires the emergent behavior of two individuals.
Even the larger systems, such as the vertebrate body system, are components or elements of even larger systems, a species of vertebrates, say, where individual members of the species interact with each other, as components, to generate a set of behaviors or properties characteristic of the species but not of its individual members.  The flocking behavior of birds illustrates a species behavior--technically the behavior of a [[deme]].  One bird cannot flock.  Reproduction among sexually reproducing species requires the emergent behavior of two individuals.


When trying to understand biological systems, systems biologists need not treat the components or elements of a system (or subsystem) exclusively as discrete or concrete objects or entities (e.g., molecules, organelles, cells, etc.), but may also treat them as abstracted concepts of organizational collections or activity patterns of those entities (e.g., networks), which admit of study by graphical, mathematical, computational and statistical tools. Those include such concepts as circuits, networks and modules. Such concepts have a way of appearing less abstract or hypothetical as biologists more fully define them in terms of structure and coordinated dynamical interactions; predict systems behavior from them using quantitative models; and relate them functionally in the larger systems embedding them.  Indeed, Bruggeman and Westerhoff<ref name=bruggeman07>Bruggeman FJ, Westerhoff HV (2007)  [http://dx.doi.org/10.1016/j.tim.2006.11.003 The nature of systems biology.] ''Trends in Microbiol'' 15:45-50 PMID 17113776
When trying to understand biological systems, systems biologists need not treat the components or elements of a system (or subsystem) exclusively as discrete or concrete objects or entities (e.g., molecules, organelles, cells, etc.), but may also treat them as abstracted concepts of organizational collections or activity patterns of those entities (e.g., networks), which admit of study by graphical, mathematical, computational and statistical tools. Those include such concepts as circuits, networks and modules. Such concepts have a way of appearing less abstract or hypothetical as biologists more fully define them in terms of structure and coordinated dynamical interactions; predict systems behavior from them using quantitative models; and relate them functionally in the larger systems embedding them.  Indeed, Bruggeman and Westerhoff<ref name=bruggeman07>Bruggeman FJ, Westerhoff HV (2007)  [http://dx.doi.org/10.1016/j.tim.2006.11.003 The nature of systems biology.] ''Trends Microbiol'' 15:45-50 PMID 17113776
:*Outstanding introduction to systems biology &mdash; driving forces, challenges, future.</ref> remark that the advances in molecular biology and mathematical modeling have ''"...shifted the focus of research from molecules to networks..."'', citing Barabasi and Otvai's review<ref name=barabasi04>Barabasi AL, Oltvai ZN (2004)  Network biology: understanding the cell's functional organization. ''Nat Rev Genet'' [http://dx.do.org/10.1038/nrg1272 5:101-3]</ref> underscoring the importance of networks in understanding the organization of cells.
:*Outstanding introduction to systems biology &mdash; driving forces, challenges, future.</ref> remark that the advances in molecular biology and mathematical modeling have ''"...shifted the focus of research from molecules to networks..."'', citing Barabasi and Otvai's review<ref name=barabasi04>Barabasi AL, Oltvai ZN (2004)  Network biology: understanding the cell's functional organization. ''Nat Rev Genet'' [http://dx.do.org/10.1038/nrg1272 5:101-3]</ref> underscoring the importance of networks in understanding the organization of cells.


Line 97: Line 109:
:* ''Modules'' are subnetworks with a specific function and which connect with other modules often only at one input node and one output node. Modularity facilitates evolutionary adaptation to changing environments, for to produce an adaptation, evolution need tinker with just a few modules rather than with the whole system. Evolution can sometimes 'exapt' existing modules for new functions that contribute to reproductive fitness. For example, the swim bladder purportedly evolved as an adaptation for control of buoyancy later exapted as a respiratory organ in various groups of fish.<ref>[http://www.palaeos.com/Vertebrates/Lists/Glossary/GlossaryEo.html See definition]</ref>   
:* ''Modules'' are subnetworks with a specific function and which connect with other modules often only at one input node and one output node. Modularity facilitates evolutionary adaptation to changing environments, for to produce an adaptation, evolution need tinker with just a few modules rather than with the whole system. Evolution can sometimes 'exapt' existing modules for new functions that contribute to reproductive fitness. For example, the swim bladder purportedly evolved as an adaptation for control of buoyancy later exapted as a respiratory organ in various groups of fish.<ref>[http://www.palaeos.com/Vertebrates/Lists/Glossary/GlossaryEo.html See definition]</ref>   
:* ''Robustness'' describes how a network is able to maintain its functionality despite environmental perturbations that affect the components. Robustness also reduces the range of network types that researchers must consider, because only certain types of networks are robust.
:* ''Robustness'' describes how a network is able to maintain its functionality despite environmental perturbations that affect the components. Robustness also reduces the range of network types that researchers must consider, because only certain types of networks are robust.
:* ''Network motifs'' offer economy of network design, as the same circuit can have many different uses in cellular regulation, as in the case of autoregulatory circuits and feedforward loops. Nature selects motifs in part for their ability to make networks robust, so systems use motifs that work well over and over again in many different networks.'''<ref name=alon07nat>Alon U (2007) Simplicity in biology. ''Nature'' [http://dx.doi.org/10.1038/446497a 446:497]</ref>''' In several well-studied biological networks, the abundance of network motifs &mdash; small subnetworks &mdash; correlates with the degree of robustness.<ref>Prill RJ ''et al.'' (2004) Dynamic properties of network motifs contribute to biological network organization. ''PLoS Biol'' 3: [http://dx.doi.org/10.1371/journal.pbio.0030343 e343]</ref> Networks, like those in cells and those in neural networks in the brain,<ref>Sporns O, Kotter R (2004) Motifs in brain networks. ''PLoS Biol'' 2: [http://dx.doi.org/10.1371/journal.pbio.0020369 e369]</ref> use motifs as basic building blocks, like multicellular organisms use cells as basic building blocks. Motifs offer biologists a level of simplicity of biological functionality for their efforts to model the dynamics of organized hierarchies of networks.<ref name=alon07nat/>
:* ''Network motifs'' offer economy of network design, as the same circuit can have many different uses in cellular regulation, as in the case of autoregulatory circuits and feedforward loops. Nature selects motifs in part for their ability to make networks robust, so systems use motifs that work well over and over again in many different networks.'''<ref name=alon07nat>Alon U (2007) Simplicity in biology. ''Nature'' [http://dx.doi.org/10.1038/446497a 446:497]</ref>''' In several well-studied biological networks, the abundance of network motifs &mdash; small subnetworks &mdash; correlates with the degree of robustness.<ref>Prill RJ ''et al.''(2004) Dynamic properties of network motifs contribute to biological network organization. ''PLoS Biol'' 3: [http://dx.doi.org/10.1371/journal.pbio.0030343 e343]</ref> Networks, like those in cells and those in neural networks in the brain,<ref>Sporns O, Kotter R (2004) Motifs in brain networks. ''PLoS Biol'' 2: [http://dx.doi.org/10.1371/journal.pbio.0020369 e369]</ref> use motifs as basic building blocks, like multicellular organisms use cells as basic building blocks. Motifs offer biologists a level of simplicity of biological functionality for their efforts to model the dynamics of organized hierarchies of networks.<ref name=alon07nat/>


The view of the cell as an overlay of mathematically-definable (in principle) dynamic networks can reveal how a living system can exist as '''''an improbable, intricate, self-orchestrated dance of molecules'''''.<ref>Alon U (2007) ''An Introduction to Systems Biology: Design Principles of Biological Circuits.'' Boca Raton: Chapman and Hall/CRC</ref> The 'overlay of networks' view also suggests how the concept of self-organized networks can extend to all higher levels of living systems.
The view of the cell as an overlay of mathematically-definable (in principle) dynamic networks can reveal how a living system can exist as '''''an improbable, intricate, self-orchestrated dance of molecules'''''.<ref>Alon U (2007) ''An Introduction to Systems Biology: Design Principles of Biological Circuits.'' Boca Raton: Chapman and Hall/CRC</ref> The 'overlay of networks' view also suggests how the concept of self-organized networks can extend to all higher levels of living systems.


Biological system behaviors typically perform one or more evolution-informed functions (e.g., growth), so unraveling the evolutionary history of the networks in a biological system contributes importantly in fully explaining it.  Evolutionary history requires knowledge of the mechanisms of both generation and selection.
Biological system behaviors typically perform one or more evolution-informed functions (e.g., growth), so unraveling the evolutionary history of the networks in a biological system contributes importantly in explaining it.  Evolutionary history requires knowledge of the mechanisms of both ''generation'' and ''selection''.


===&nbsp;&nbsp;&nbsp;&nbsp;Examples of biological systems===
===&nbsp;&nbsp;&nbsp;&nbsp;Examples of biological systems===
Line 124: Line 136:
Knowing the historical path(s) that led to a modern scientific program can help in understanding the nature of the program, in particular, its goals and its methodologies, especially through considering the different focuses and approaches that different historians have taken when writing about the same topic.
Knowing the historical path(s) that led to a modern scientific program can help in understanding the nature of the program, in particular, its goals and its methodologies, especially through considering the different focuses and approaches that different historians have taken when writing about the same topic.


===&nbsp;&nbsp;&nbsp;&nbsp;Systems biology as part of General Systems Theory / Systems Science===
<ref name=skyttner05>Skyttner L (2005) ''General Systems Theory: Problems, Perspectives, Practice.'' World Scientific, New Jersey. ISBN 981-256-467-5</ref>
<ref name-bertalanffy50>von Bertalanffy L (1950) The theory of open systems in physics and biology. ''Science'' [http://dx.doi.org/10.1126/science.111.2872.23 111:23-9]</ref>


===&nbsp;&nbsp;&nbsp;&nbsp;The evolution of molecular biology into systems biology===
===&nbsp;&nbsp;&nbsp;&nbsp;The evolution of molecular biology into systems biology===
Line 135: Line 142:
They describe two pathways of enquiry that they see as having merged into modern systems biology of the cell.
They describe two pathways of enquiry that they see as having merged into modern systems biology of the cell.


One root is the advances in molecular biology that ultimately “…led to efforts toward [[genome]]-scale model building to analyze the systems properties of cellular function”:  recognition of DNA as the genetic material, identifying the structure of DNA, [[recombinant]] technology, automated determination of DNA base sequences, and high-throughput technologies yielding the sequences of entire [[genome]]s.
One is the advances in molecular biology that ultimately “…led to efforts toward [[genome]]-scale model building to analyze the systems properties of cellular function”:  recognition of DNA as the genetic material, identifying the structure of DNA, [[recombinant]] technology, automated determination of DNA base sequences, and high-throughput technologies yielding the sequences of entire [[genome]]s.


A second, parallel root is the development of non-equilibrium thermodynamics, a predictive mathematical theory for describing the behavior of systems that transfer energy from one place to another or convert energy from one form to another in processes the move towards an irreversible state of stability characterized by randomness or disorder—for biological systems, death. Because living systems produce order and maintain a state of non-randomness, they must carry out processes that keep them in a condition far from the equilibrium of randomness, and they achieve this by transforming energy (and matter and information) taken in from the environment.  The non-closed biological system produces order at the expense of the environment it opens to, while the environment becomes more disordered.
A second is the development of non-equilibrium thermodynamics, a predictive mathematical theory for describing the behavior of systems that transfer energy from one place to another or convert energy from one form to another in processes the move towards an irreversible state of stability characterized by randomness or disorder—for biological systems, death. Because living systems produce order and maintain a state of non-randomness, they must carry out processes that keep them in a condition far from the equilibrium of randomness, and they achieve this by transforming energy (and matter and information) taken in from the environment.  The non-closed biological system produces order at the expense of the environment it opens to, while the environment becomes more disordered.


Westerhoff and Palsson describe advances in the development of non-equilibrium thermodynamics as presaging molecular and cellular systems biology through ‘quantitative’ integration of system components and through the discovery of principles connecting molecular mechanisms and system behaviors.  Westerhoff and Alberghina<ref name=wester2005>Westerhoff HV, Alberghina L (2005) "Systems Biology: Did we know it all along?", in ''Topics in Current Genetics'' Vol. 13: Systems Biology, ed. Alberghina L, Westerhoff HV, pp.3-9. Berlin: Springer-Verlag. ISBN 978-3-540-22968-1</ref> ask of systems biology: “Did we know it all along?”
Westerhoff and Palsson describe advances in the development of non-equilibrium thermodynamics as presaging molecular and cellular systems biology through ‘quantitative’ integration of system components and through the discovery of principles connecting molecular mechanisms and system behaviors.  Westerhoff and Alberghina<ref name=wester2005>Westerhoff HV, Alberghina L (2005) "Systems Biology: Did we know it all along?", in ''Topics in Current Genetics'' Vol. 13: Systems Biology, ed. Alberghina L, Westerhoff HV, pp.3-9. Berlin: Springer-Verlag. ISBN 978-3-540-22968-1</ref> ask of systems biology: “Did we know it all along?”


===&nbsp;&nbsp;&nbsp;&nbsp;Historical milestones in the development of systems biology===  
===&nbsp;&nbsp;&nbsp;&nbsp;Historical milestones in the development of systems biology===  
Anthony Trewavas, a scientist conducting research in the molecular and systems biology of plant cells, emphasizes the following aspects of the history of systems biology:<ref name=trewavas2006>Trewavas AJ (2006), [http://www.plantcell.org/cgi/search?sortspec=relevance&author1=trewavas&fulltext=&pubdate_year=2006&volume=&firstpage= A Brief History of Systems Biology: "Every object that biology studies is a system of systems." Francois Jacob (1974) Plant Cell 18:2420-30 PMID 17088606]</ref>
Anthony Trewavas, a scientist conducting research in the molecular and systems biology of plant cells, emphasizes the following aspects of the history of systems biology:<ref name=trewavas2006b>Trewavas AJ (2006), [http://www.plantcell.org/cgi/search?sortspec=relevance&author1=trewavas&fulltext=&pubdate_year=2006&volume=&firstpage= A Brief History of Systems Biology: "Every object that biology studies is a system of systems." Francois Jacob (1974) ''Plant Cell'' 18:2420-30 PMID 17088606]</ref>


*How Rene Descartes’ formulation of reductionism—the concept that the properties of complex objects can be explained by reducing them into their parts and studying the properties of the parts —led biologists to assume that one could explain a complex biological system's behavior from the behavior of its subsystems;
*How Rene Descartes’ formulation of reductionism—the concept that the properties of complex objects can be explained by reducing them into their parts and studying the properties of the parts —led biologists to assume that one could explain a complex biological system's behavior from the behavior of its subsystems;
Line 170: Line 177:
*How the identification of feed-forward mechanisms led to advances in understanding the features characterizing the design of systems control mechanisms.
*How the identification of feed-forward mechanisms led to advances in understanding the features characterizing the design of systems control mechanisms.


===&nbsp;&nbsp;&nbsp;&nbsp;Growth of publications relating systems biology ===
===&nbsp;&nbsp;&nbsp;&nbsp;Growth of publications on systems biology ===
[[Image:Sysbiopubs.JPG|left|thumb|350px|{{#ifexist:Template:Sysbiopubs.JPG/credit|{{Sysbiopubs.JPG/credit}}<br/>|}}Growth in papers on systems biology.]]
{{Image|Sysbiopubs.JPG|left|350px|Growth in papers on systems biology.}}


The pace of research in systems biology greatly accelerated at the beginning of the 21st century.  
The pace of research in systems biology greatly accelerated at the beginning of the 21st century. The figure at left shows the [[exponential growth]] of publications relating to or discussing systems biology from 1996 through 2007. The data come from the National Library of Medicine's PubMed database, and probably underestimate annual "systems biology" publication rates by not including articles in journals in many non-biological disciplines. (PubMed searched through the bibliographic database manager, ''Reference Manager'', search term, 'systems biology', searched in 'All Fields.)
 
The figure at left shows the [[exponential growth]] of publications relating to or discussing systems biology from 1996 through 2007.
 
The data come from the National Library of Medicine's PubMed database, and probably underestimate annual "systems biology" publication rates by not including articles in journals in many non-biological disciplines. (PubMed searched through the bibliographic database manager, ''Reference Manager'', search term, 'systems biology', searched in 'All Fields.)


===&nbsp;&nbsp;&nbsp;&nbsp;Early systems modelers===
===&nbsp;&nbsp;&nbsp;&nbsp;Early systems modelers===
In 1952, the British neurophysiologists and Nobel laureates [[Alan Lloyd Hodgkin]] and ppAndrew Fielding Huxley]] constructed a mathematical model of the [[action potential]] &mdash; the fundamental mechanism underlying communication between nerve cells. In 1960, Denis Noble developed the first computer model of a beating heart.<ref>[http://noble.physiol.ox.ac.uk/People/DNoble/ Denis Noble]</ref>  
In 1952, the British neurophysiologists and Nobel laureates [[Alan Lloyd Hodgkin]] and [[Andrew Fielding Huxley]] constructed a mathematical model of the [[action potential]] &mdash; the fundamental mechanism underlying communication between nerve cells. In 1960, Denis Noble developed the first computer model of a beating heart.<ref>[http://noble.physiol.ox.ac.uk/People/DNoble/ Denis Noble]</ref>  


Computerized mathematical modeling of metabolic networks (''Metabolic Control Analysis'') began as early as 1960<ref>Chance B ''et al.'' (1960) Metabolic control mechanisms. 5. A solution for the equations representing interaction between glycolysis and respiration in ascites tumor cells. ''J Biol Chem'' 235:2426–39</ref>.  Metabolic Control Analysis's aim was to quantify the effect of the differing chemical reactions in the network on the concentrations of the network metabolites and on the flow of metabolites through the network, in particular in response to various perturbations (see review by Visser and Heijnen).<ref>Visser D, Heijnen JJ (2002) The mathematics of metabolic control analysis revisited. ''Metabolic Engineering'' [http://dx.doi.org/10.1006/mben.2001.0216 4:114-23] PMID 12009791</ref>
Computerized mathematical modeling of metabolic networks (''Metabolic Control Analysis'') began as early as 1960<ref>Chance B ''et al.'' (1960) Metabolic control mechanisms. 5. A solution for the equations representing interaction between glycolysis and respiration in ascites tumor cells. ''J Biol Chem'' 235:2426–39</ref>.  Metabolic Control Analysis's aim was to quantify the effect of the differing chemical reactions in the network on the concentrations of the network metabolites and on the flow of metabolites through the network, in particular in response to various perturbations (see review by Visser and Heijnen).<ref>Visser D, Heijnen JJ (2002) The mathematics of metabolic control analysis revisited. ''Metabolic Engineering'' [http://dx.doi.org/10.1006/mben.2001.0216 4:114-23] PMID 12009791</ref>


Henrik Kacser (1918-1995) is usually credited with publishing the signal paper in Metabolic Control Analysis:
Henrik Kacser (1918-1995) is usually credited with publishing the signal paper in Metabolic Control Analysis:


<blockquote>''By the end of the 1960s, he [Henrik Kacser] and Jim Burns were working on the theory of how the rates of metabolic pathways were affected by changes in the amounts or activities of pathway enzymes. Their landmark paper, '''The control of flux''' (Kacser & Burns, 1973)<ref> Kacser H, Burns JA (1973) The control of flux. ''Symp Soc Exp Biol'' 27:65-104. Updated: Kacser H ''et al.'' (1995) The control of flux. ''Biochem Soc Trans'' 23:341-66 PMID 7672373</ref> was presented before a sceptical audience of experimental biochemists in Oxford in 1973. In it they show that the expectation that a metabolic pathway will be controlled by a single pacemaker reaction is a fallacy, and most of the experimental criteria used in the supposed identification of such steps are misleading. Instead, varying amounts of control can be distributed over the enzymes of the pathway, but this is a property of the metabolic system as a whole and cannot be predicted from the characteristics of the enzymes in isolation.''<ref>Fell DA (1996) [http://bip.cnrs-mrs.fr/bip10/fellobit.htm Dr Henrik Kacser (1918-1995)]</ref></blockquote>
<blockquote>''By the end of the 1960s, he [Henrik Kacser] and Jim Burns were working on the theory of how the rates of metabolic pathways were affected by changes in the amounts or activities of pathway enzymes. Their landmark 1973 paper, '''The control of flux''' <ref> Kacser H, Burns JA (1973) The control of flux. ''Symp Soc Exp Biol'' 27:65-104. Updated: Kacser H ''et al.'' (1995) The control of flux. ''Biochem Soc Trans'' 23:341-66 PMID 7672373</ref> was presented before a sceptical audience of experimental biochemists in Oxford in 1973. In it they show that the expectation that a metabolic pathway will be controlled by a single pacemaker reaction is a fallacy, and most of the experimental criteria used in the supposed identification of such steps are misleading. Instead, varying amounts of control can be distributed over the enzymes of the pathway, but this is a property of the metabolic system as a whole and cannot be predicted from the characteristics of the enzymes in isolation.''<ref>Fell DA (1996) [http://bip.cnrs-mrs.fr/bip10/fellobit.htm Dr Henrik Kacser (1918-1995)]</ref></blockquote>


By 1957, Kacser had already revealed himself as a systems biologist, having written: “''The problem is therefore the investigation of '''systems''', i.e. components related or organised in a specific way. The properties of a system are in fact more than (or different from) the sum of the properties of its components, a fact often overlooked in zealous attempts to demonstrate additivity of certain phenomonena. It is with these systemic properties that we shall be mainly concerned...''”<ref>[http://bip.cnrs-mrs.fr/bip10/henrikbi.htm Henrik Kacser (1918–1995):  an Annotated Bibliography]</ref>
By 1957, Kacser had already revealed himself as a systems biologist, having written: “''The problem is therefore the investigation of '''systems''', i.e. components related or organised in a specific way. The properties of a system are in fact more than (or different from) the sum of the properties of its components, a fact often overlooked in zealous attempts to demonstrate additivity of certain phenomonena. It is with these systemic properties that we shall be mainly concerned...''”<ref>[http://bip.cnrs-mrs.fr/bip10/henrikbi.htm Henrik Kacser (1918–1995):  an Annotated Bibliography]</ref>


===&nbsp;&nbsp;&nbsp;&nbsp;Systems biology as an evolutionary trend of classical integrative physiology ===
===&nbsp;&nbsp;&nbsp;&nbsp;Systems biology as an evolutionary extension of classical integrative physiology ===
In the view of physiologists and bioengineers Daniel A. Beard and Marko Vendelin, <ref name=beardvend>Beard DA, Vendelin M (2006) Systems biology of the mitochondrion. Am J Physiol [http://ajpcell.physiology.org/cgi/content/full/291/6/C1101/ 291:C1101-3] PMID 17102034</ref> the term 'systems biology' and 'physiology' synonymize, as they argue:
Physiologists and bioengineers Daniel A. Beard and Marko Vendelin,<ref name=beardvend>Beard DA, Vendelin M (2006) [http://ajpcell.physiology.org/cgi/content/full/291/6/C1101/ Systems biology of the mitochondrion]. ''Am J Physiol'' 291:C1101-3. PMID 17102034</ref> regard the terms 'systems biology' and 'physiology' synonyms, as they argue:


:"In a nutshell, "systems biology" attempts to realize this [its] promise by measuring and mapping biological interactions within cells, tissues, organs, and organ systems, and predicting how integrated systems made up of many interacting components behave. Readers of the ''American Journal of Physiology'' may point out that, by such a definition, "systems biology" is essentially a synonym for "physiology." While we would not argue with that assessment, we suggest that the increasing attention being paid to the endeavor is at least in part due to the injection of a new term, and associated new techniques and technologies, into the well-established field of integrative physiology. It has been argued that this increase in attention places the discipline of physiology in a position where it will either be "superseded...by systems biology" or will enjoy a renaissance as it leads the way in research in this area..."
<blockquote>
<p style="margin-left:2.0%; margin-right:6%;font-size:0.99em;"><font face="Comic Sans MS, Trebuchet MS, Consolas">In a nutshell, "systems biology" attempts to realize this [its] promise by measuring and mapping biological interactions within cells, tissues, organs, and organ systems, and predicting how integrated systems made up of many interacting components behave. Readers of the ''American Journal of Physiology'' may point out that, by such a definition, "systems biology" is essentially a synonym for "physiology." While we would not argue with that assessment, we suggest that the increasing attention being paid to the endeavor is at least in part due to the injection of a new term, and associated new techniques and technologies, into the well-established field of integrative physiology. It has been argued that this increase in attention places the discipline of physiology in a position where it will either be "superseded...by systems biology" or will enjoy a renaissance as it leads the way in research in this area...</font></p>
</blockquote>


Molecular physiologist and biophysicist Kevin Strange."<ref name=strange05>Strange K (2005) The end of "naive reductionism": rise of systems biology or renaissance of physiology? ''Am J Physiol'' 288:C968-74 PMID 15840560 [http://ajpcell.physiology.org/cgi/content/full/288/5/C968/ Full-Text]</ref> earlier made the comparison:
Molecular physiologist and biophysicist Kevin Strange."<ref name=strange05>Strange K (2005) [http://ajpcell.physiology.org/cgi/content/full/288/5/C968/ The end of "naive reductionism": rise of systems biology or renaissance of physiology?] ''Am J Physiol'' 288:C968-74 PMID 15840560.</ref> earlier made the comparison:


:”''Physiology and systems biology share the goal of understanding the integrated function of complex, multicomponent biological systems ranging from interacting proteins that carry out specific tasks to whole organisms.''”
<blockquote>
<p style="margin-left:2.0%; margin-right:6%;font-size:0.99em;"><font face="Comic Sans MS, Trebuchet MS, Consolas">Physiology and systems biology share the goal of understanding the integrated function of complex, multicomponent biological systems ranging from interacting proteins that carry out specific tasks to whole organisms.</font></p>
</blockquote>
   
   
In writing of systems biology, Strange encourages 21st century physiology departments ''to embrace them as essential components''of their field, by ‘them’ referring specifically to ''“functional genomics, nonmammalian model organisms and computational biology''.  He sees a ‘critical mass’-type advantage to a diverse group of physiologists and post-genomics-brand systems biologists working as a group.   
In writing of systems biology, Strange encourages 21st century physiology departments "''to embrace them as essential components''" of their field, by 'them' referring specifically to "''functional genomics, nonmammalian model organisms and computational biology''".  He sees a 'critical mass'-type advantage to a diverse group of physiologists and post-genomics-brand systems biologists working as a group.   
 
Marine biologist, John Bothwell argues that:


Marine biologist, John Bothwell,<ref>Bothwell JHF (2006) The long past of systems biology. New Phytologist [http://www.blackwell-synergy.com/doi/abs/10.1111/j.1469-8137.2006.01676.x/ 170:6-10]</ref> “''…argue[s] that systems biology…retreads the conceptual ground covered by post-Darwinian physiology and resembles nothing more than the application of 19th century physiological reasoning to today’s molecular biological data.''”  He credits systems biologists for their focus on developing mathematical methodologies for the study of complex cellular networks.
<blockquote>
<p style="margin-left:2.0%; margin-right:6%;font-size:0.99em;"><font face="Comic Sans MS, Trebuchet MS, Consolas">...systems biology...retreads the conceptual ground covered by post-Darwinian physiology and resembles nothing more than the application of 19th century physiological reasoning to today’s molecular biological data.</font><ref name=bothwell2006>Bothwell JHF (2006) [http://www3.interscience.wiley.com/journal/118627159/abstract The long past of systems biology.] ''New Phytologist'' 170:6-10.</ref></p>
</blockquote>


Many others have likened physiology and systems biology.  Certainly physiology dates to the beginnings of biology as a discipline, and systems biology dates even to Aristotle. The process of homeostasis, of particular interest to systems biologists, has a long history in physiological studies.<ref>Editorial (1935) Homeostasis. ''The Lancet'' [http://dx.doi.org/10.1016/S0140-6736(00)57105-0/ 225:445-6]</ref> In the 19th century, the French physiologist, [[Claude Bernard]], who developed the concept of the ‘internal milieu’, or ‘internal environment’ (e.g., for maintaining blood composition), performed experiments showing animals maintaining their internal milieu within favorable limits &mdash; essentially recognizing the process of homeostasis.  The early 20th century physiologist Walter Cannon introduced the term 'homeostasis' and demonstrated the homeostatic role of the autonomic nervous system.
He credits systems biologists for their focus on developing mathematical methodologies for the study of complex cellular networks.


The mechanisms of homeostasis still remain central in research physiology, as exemplified by recent publications in the American Journal of Physiology's suite journals, even excluding cell and molecular physiology journals.  See:[[Systems biology/Addendum]]
Many others have likened physiology and systems biology.  Certainly physiology dates to the beginnings of biology as a discipline, and systems biology dates even to Aristotle.<ref name=bothwell2006/> The process of homeostasis, of particular interest to systems biologists, has a long history in physiological studies.<ref>Editorial (1935) [http://dx.doi.org/10.1016/S0140-6736(00)57105-0/ Homeostasis]. ''The Lancet''  225:445-6.</ref> In the 19th century, the French physiologist, [[Claude Bernard]], who developed the concept of the 'internal milieu', or 'internal environment' (e.g., for maintaining blood composition), performed experiments showing animals maintaining their internal milieu within favorable limits &mdash; essentially recognizing the process of homeostasis.  The early 20th century physiologist Walter Cannon introduced the term 'homeostasis' and demonstrated the homeostatic role of the autonomic nervous system.  The mechanisms of homeostasis remain central in research physiology, as exemplified by many recent publications in the ''American Journal of Physiology'''s suite of journals.   


Many organ systems physiologists can describe the history, going back to pre-WWII decades, of their fields’ progress in top-down discoveries of organ system components and organization.  The vital mammalian organ, the kidney serves as example. In the early decades of the 20th century, the English pharmacologist Arthur Cushny proposed that kidneys produced urine by a dual process of ultrafiltration of blood by the glomeruli and selective reabsorption of the filtrate's constituents by the tubules, and accumulated evidence supported that formulation.  Continuing, top-down, to explain the behavior of the organ, renal<ref>'''Note''': "renal" means relating to the kidney.</ref> physiologists developed in the 1930s micropuncture techniques to sample fluid in different segments of the countless ‘nephrons’ &mdash; each a unit of kidney anatomy comprising a glomerular filtration apparatus spilling into a variably convoluted tubule, all of which collects in ducts leading to the urinary bladder. That led to discoveries of transport processes that reabsorb and secrete constituents, and to better understanding of how the kidney produced urine of the composition that it did in varying circumstances. They developed quantitative methods for measuring glomerular filtration rate and kidney blood flow, which enabled tracking quantitatively constituents in the filtrate, including in humans. By the time publications had begun to appear by biologists using the term ‘systems biology’, renal physiologists had mathematically modeled numerous kidney systems behaviors, and applied them prevention and treatment of disease in humans.  They have learned about how the kidney behaves as a whole well enough to develop an artificial kidney that keeps people with death-threatening functionless kidneys alive and able for decades.   
Referring to pre-WWII decades, many organ systems physiologists can describe the history of progress in top-down discoveries of organ system components and organization.  The vital mammalian organ, the [[kidney]] serves as example. In the early 20th century, the English pharmacologist Arthur Cushny proposed that kidneys produced urine by a dual process of ultrafiltration of blood by the glomeruli and selective reabsorption of the filtrate's constituents by the tubules, and accumulated evidence supported that formulation.  Continuing, top-down, to explain the behavior of the organ, renal<ref>'''Note''': "renal" means relating to the kidney.</ref> in the 1930s, physiologists developed  micropuncture techniques to sample fluid in different segments of the countless 'nephrons' &mdash; each a unit of kidney anatomy comprising a glomerular filtration apparatus spilling ultrafiltrate into a variably convoluted tubule, all of which tubules ultimately converge in ducts leading to the urinary bladder. That led to discoveries of transport processes that reabsorb and secrete constituents, and to better understanding of how the kidney produced urine of the composition that it did in varying circumstances. They developed quantitative methods for measuring glomerular filtration rate and kidney blood flow, which enabled tracking quantitatively constituents in the filtrate, including in humans. By the time publications had begun to use the term ‘systems biology’, renal physiologists had mathematically modeled numerous kidney systems behaviors, and applied them to prevention and treatment of disease in humans.  They have learned about how the kidney behaves as a whole well enough to develop an artificial kidney that keeps people with death-threatening functionless kidneys alive and able for decades.   


Physiologists continue to study the systems biology of organs and organ systems, greatly benefiting from bottom-up explorations of molecular and cell biologists, and biochemists and a host of other disciplines.
Physiologists continue to study the systems biology of organs and organ systems, greatly benefiting from bottom-up explorations of molecular and cell biologists, and biochemists and a host of other disciplines.
Perhaps someone will write an integrated article combining the 'History of Physiology' and 'History of Systems Biology'. Constraints on prolixity discourage further development of issues pertaining to the relation of physiology and systems biology in this article.


==Modeling in systems biology==
==Modeling in systems biology==
Line 226: Line 235:




For systems biologists, modeling serves as the key to unlocking the system of interest, whether a cell, a species, or an ecosystem.
For systems biologists, modeling is the key to unlocking the system of interest, whether a cell, a species, or an ecosystem.
 
Reminding us of the story of the six blind men investigating a different part of an elephant and coming up with six different descriptions of the animal, James Haefner<ref name=haefner2005/> wrote:  
Reminding us of the story of the six blind men investigating a different part of an elephant and coming up with six different descriptions of the animal, James Haefner<ref name=haefner2005/> wrote:  


::<blockquote>One failure of the blind men was to ignore the relations between objects. A seventh man, one sensitive to the importance of testing alternative models, might have said: “Hmmm, ‘tree’, ‘snake’, ‘fan’, ‘spear’, ‘wall’, ‘rope’: It’s a single, big thing with columnar supports and appendages at the ends.”  The blind men, especially, need a systems approach, and with respect to the scientific unknown, we are all blind.</blockquote>
::<blockquote>One failure of the blind men was to ignore the relations between objects. A seventh man, one sensitive to the importance of testing alternative models, might have said: “Hmmm, ‘tree’, ‘snake’, ‘fan’, ‘spear’, ‘wall’, ‘rope’: It’s a single, big thing with columnar supports and appendages at the ends.”  The blind men, especially, need a systems approach, and with respect to the scientific unknown, we are all blind.</blockquote>


To understand a key systems approach, one must know something about model building, or simply, modeling. Models represent (re-present) reality in an abstract form, such as a narrative description (e.g., a theory, conceptualization, rule), a diagrammatic representation (e.g., a graph or network diagram), a physical representation (e.g., a scale model), a 'formal' representation (a mathematical or quantitative description), and simulation models. Most simulation models entail numerical approximations of sets of mathematical expressions potentially describing the system, and ‘stepping-through-time’ with imposed value changes in the states of the system &mdash; typically through computer-based computational processing.<ref name=morowitzemergence>Morowitz HJ (2002, 2004) ''The Emergence of Everything: How the World Became Complex.'' Oxford University Press, New York ISBN 0-19-513513-X [http://www.questia.com/read/103550370# Full-Text Available Online at Questia with Subscription]<br>'''Note from Text''': “There are those, myself included, who believe that high-speed computation is to biology and the social sciences what calculus was to physics. Computer science is the mathematically based or formal tool that seems to map best onto the structure of the questions asked by many modern natural sciences, and moves into the domain of the social sciences.”</ref>   
To understand a key systems approach, one must know something about model building, or simply, modeling. Models represent (re-present) reality in an abstract form, such as a narrative description (e.g., a theory), a diagrammatic representation (e.g., a graph), a physical representation (e.g., a scale model), a 'formal' representation (a mathematical or quantitative description), and simulation models. Most simulation models entail numerical approximations of sets of mathematical expressions potentially describing the system, and ‘stepping-through-time’ with imposed value changes in the states of the system &mdash; typically through computer-based computational processing.<ref name=morowitzemergence>Morowitz HJ (2002, 2004) ''The Emergence of Everything: How the World Became Complex.'' Oxford University Press, New York ISBN 0-19-513513-X [http://www.questia.com/read/103550370# Full-Text Available Online at Questia with Subscription]<br>'''Note from Text''': “There are those, myself included, who believe that high-speed computation is to biology and the social sciences what calculus was to physics. Computer science is the mathematically based or formal tool that seems to map best onto the structure of the questions asked by many modern natural sciences, and moves into the domain of the social sciences.”</ref>   


Systems biologists use numerous different diagrammatic and mathematical models as keys to understanding biological systems &mdash; their logic, say &mdash; as keys to explaining, predicting and controlling their behavior.
Systems biologists use numerous different diagrammatic and mathematical models as keys to understanding biological systems &mdash; their logic, say &mdash; as keys to explaining, predicting and controlling their behavior.


Mathematical models of a biological system employs sets of equations in describing the system. They posit a series of mathematical expressions (equations) to describe the activity of the system, they comprise analysis of the system by mathematical relations without resort to numerical approximation, and may have dynamic properties by describing the activity of the system over time. They can serve these main functions:
Mathematical models of a biological system employ ''equations''. They posit a series of mathematical expressions (equations) to describe the activity of the system, they comprise analysis of the system by mathematical relations without resort to numerical approximation, and may have dynamic properties by describing the activity of the system over time. They can serve these main functions:


*They allow management of data sets of structures and interactions too large and complex for the human mind to manage without the “exo-cortex” of mathematical formulations, often computer-based for quantitative outputs;
*They allow management of data sets of structures and interactions too large and complex for the human mind to manage without the “exo-cortex” of mathematical formulations, often computer-based for quantitative outputs;
Line 254: Line 262:
*They enable ‘prediction’ of the behavior of the system—predicting how it will respond to a given set of circumstances, especially predicting novel behaviors of the system.
*They enable ‘prediction’ of the behavior of the system—predicting how it will respond to a given set of circumstances, especially predicting novel behaviors of the system.


Despite the large datasets available for many biological systems, especially cell systems, they still fall short in quantity and quality for realizing the full potential of quantitative modeling in applying advanced methodologies for statistical analyses, testing of hypotheses, and estimating the values of equation constants and independent variables.<ref name=wellstead06>Wellstead P ''et al.'' (2006) [http://arxiv.org/abs/q-bio/0603032/ Feedback Medicine: Control Systems Concepts in Personalised, Predictive Medicine and Combinatorial Intervention.] </ref>   Wellstead ''et al.''<ref name=wellstead06/> note the “enormous challenges to bio-sensing for systems biology” that lie ahead.
Despite the large datasets available for many biological systems, especially cell systems, they still fall short in quantity and quality for realizing the full potential of quantitative modeling in applying advanced methodologies for statistical analyses, testing of hypotheses, and estimating the values of equation constants and independent variables.<ref name=wellstead06>Wellstead P ''et al.'' (2006) [http://arxiv.org/abs/q-bio/0603032/ Feedback Medicine: Control Systems Concepts in Personalised, Predictive Medicine and Combinatorial Intervention.] </ref> Wellstead ''et al.''<ref name=wellstead06/> note the “enormous challenges to bio-sensing for systems biology” that lie ahead.


Harvard biomathematician and philosopher of science, Richard Levins, speaks to the value of mathematical modeling:
Harvard biomathematician and philosopher of science, Richard Levins, speaks to the value of mathematical modeling:
<blockquote>Mathematics is used mostly in modeling in order to predict the outcomes of systems of equations. But it also has another use: educating the intuition so that the obscure becomes obvious. When we abstract from the reality of interest to create mathematical objects, we do this because some questions which would seem intractable now can be grasped immediately. We can look at the fluctuating abundance of insects and conclude ‘‘since these bugs vary by several orders of magnitude during the year and yet remain within bounds from year to year, there must be some density dependence operating (a negative feedback),’’ or see that in a particular patient insulin seems to increase blood sugar and we have to ask, ‘‘where is there a positive feedback loop at work?’’ This kind of qualitative mathematics is essential so that we are not overwhelmed by the sheer numbers of equations and variables of predictive models. The teaching of mathematics to scientists must include the mathematics that aims at understanding rather than solving equations or projecting numbers. <ref>Levins R (2006) Strategies of abstraction. ''Biol Philos'' [http://dx.doi.org/10.1007/s10539-006-9052-8 21:741–55]</ref></blockquote>
<blockquote>Mathematics is used mostly in modeling in order to predict the outcomes of systems of equations. But it also has another use: educating the intuition so that the obscure becomes obvious. When we abstract from the reality of interest to create mathematical objects, we do this because some questions which would seem intractable now can be grasped immediately. We can look at the fluctuating abundance of insects and conclude ‘‘since these bugs vary by several orders of magnitude during the year and yet remain within bounds from year to year, there must be some density dependence operating (a negative feedback),’’ or see that in a particular patient insulin seems to increase blood sugar and we have to ask, ‘‘where is there a positive feedback loop at work?’’ This kind of qualitative mathematics is essential so that we are not overwhelmed by the sheer numbers of equations and variables of predictive models. The teaching of mathematics to scientists must include the mathematics that aims at understanding rather than solving equations or projecting numbers. <ref>Levins R (2006) Strategies of abstraction. ''Biol Philos'' [http://dx.doi.org/10.1007/s10539-006-9052-8 21:741–55]</ref></blockquote>


Haefner<ref name=haefner05/> has provided a classification of mathematical models based on whether the mathematics explicitly represent (a) the mechanisms of the processes of interest, (b) the future states of the system, (c) time as continuous, (d) spatial aspects of the systems, and (e) the effects of random events. Yes/no answers correspond to mathematical structures yielding (a) mechanistic/descriptive models, (b) dynamic/static models, (c)continuous/discrete models, (d) heterogenous/homogenous models of space, and (e) stochastic (random)/deterministic models. A model might incorporate mathematical structures of any combination of (a) through (e).
Haefner has provided a classification of mathematical models based on whether the mathematics explicitly represent (a) the mechanisms of the processes of interest, (b) the future states of the system, (c) time as continuous, (d) spatial aspects of the systems, and (e) the effects of random events. Yes/no answers correspond to mathematical structures yielding (a) mechanistic/descriptive models, (b) dynamic/static models, (c)continuous/discrete models, (d) heterogenous/homogenous models of space, and (e) stochastic (random)/deterministic models. A model might incorporate mathematical structures of any combination of (a) through (e).


===&nbsp;&nbsp;&nbsp;&nbsp;Some examples of familiar models===
===&nbsp;&nbsp;&nbsp;&nbsp;Some examples of familiar models===
Line 266: Line 274:


====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''A road map of an urban complex'''''====
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''A road map of an urban complex'''''====
[[Image:Roadmap large.jpg|right|thumb|250px|{{#ifexist:Template:Roadmap large.jpg/credit|{{Roadmap large.jpg/credit}}<br/>|}}<!--ADD CAPTION HERE-->]]
{{Image|Roadmap large.jpg|right|250px|<!--ADD CAPTION HERE-->}}
For a given level of detail, a roadmap represents (re-presents, or models) the structure of the system of roads in a region of land at a given point in time, using the language of graphic illustration. In network parlance, cities and other points of interest (e.g., parks, lakes) serve as nodes and the connections between nodes serve as edges, some of which may indicate one-way connections only. Using the roadmap, one can control the system of roads in the sense that one can exploit the information to get from one place (node) to another, and predict how long it will take to get there.   
For a given level of detail, a roadmap represents (re-presents, or models) the structure of the system of roads in a region of land at a given point in time, using the language of graphic illustration. In network parlance, cities and other points of interest (e.g., parks, lakes) serve as nodes and the connections between nodes as edges, some of which may indicate one-way connections only. Using the roadmap, one can control the system of roads in the sense that one can exploit the information to get from one place (node) to another, and predict how long it will take to get there.   


The level of detail in a roadmap may not allow determination of the grades of the roads (steepness) or the degrees of curviness or the position of side roads or new roads added since the date of the map.
The level of detail in a roadmap may not allow determination of the grades of the roads (steepness) or the degrees of curviness or the position of side roads or new roads added since the date of the map.
Line 274: Line 282:


====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''A chemical formula'''''====
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''A chemical formula'''''====
[[Image:Water_molecule_dimensions.jpg|thumb|400px|left|Figure 2. Atomic dimensions of a water molecule.]]
{{Image|Water molecule dimensions.png|left|148px|Figure 2. Atomic dimensions of a water molecule.}}
 
 
 
 
 


Anyone reading this far knows the formula, H<sub>2</sub>O, as a model (representation) for the unit molecule of water.  As such it has many uses, in particular in modeling chemical reactions.  Other models of water, such as HOH, provide additional information for particular purposes.  Note that the model does not give any indication of the 'emergent' properties of interacting collections of H<sub>2</sub>O molecules, such as liquid water, water ice or steam.
Anyone reading this far knows the formula, H<sub>2</sub>O, as a model (representation) for the unit molecule of water.  As such it has many uses, in particular in modeling chemical reactions.  Other models of water, such as HOH, provide additional information for particular purposes.  Note that the model does not give any indication of the 'emergent' properties of interacting collections of H<sub>2</sub>O molecules, such as liquid water, water ice or steam.
Line 286: Line 289:
For a given level of detail, a computer-based flight simulator represents the multi-subsystem of an airplane, including its control characteristics, and the environment in which the flight vehicle must interact with in order to function stably and exhibit its system behavior of taking off, flying to destination, and landing.  The representation (model) uses the languages of engineering, mathematics, computer programs, and dynamical graphics, among others to enable control of the system and to predict its behavior in response to a given set of environmental conditions for comparison with the response to those conditions in real flight—testing the goodness of fit of the model.
For a given level of detail, a computer-based flight simulator represents the multi-subsystem of an airplane, including its control characteristics, and the environment in which the flight vehicle must interact with in order to function stably and exhibit its system behavior of taking off, flying to destination, and landing.  The representation (model) uses the languages of engineering, mathematics, computer programs, and dynamical graphics, among others to enable control of the system and to predict its behavior in response to a given set of environmental conditions for comparison with the response to those conditions in real flight—testing the goodness of fit of the model.


Systems biologists use computer-based simulators, for example, to predict the behavior of the human heart in response to drugs.<ref name=noble06a>Noble D (2006) “Multilevel Modeling in Systems Biology: From Cells to Whole Organs”. In, Szallasi Z, Stelling J, and Periwal V. (editors) (2006) ''System Modeling in Cell Biology From Concepts to Nuts and Bolts.'' A Bradford Book, MIT Press, Cambridge, MA ISBN 0262195488 Chapter 14, pp. 297-312</ref>
Systems biologists use computer-based simulators, for example, to predict the behavior of the human heart in response to drugs.<ref name=noble06a>Noble D (2006) “Multilevel Modeling in Systems Biology: From Cells to Whole Organs”. In Szallasi Z ''et al.'' (editors) (2006) ''System Modeling in Cell Biology From Concepts to Nuts and Bolts.'' A Bradford Book, MIT Press, Cambridge, MA ISBN 0262195488 Chapter 14, pp 297-312</ref>


====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Newton’s equations'''''====
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Newton’s equations'''''====
Line 299: Line 302:
[[Image:Watson-Crick_DNA_Metal_Model.png|thumb|300 px|left|Courtesy of the National Human Genome Research Institute, the National Institutes of Health. Original image at: http://www.genome.gov/25520255]]
[[Image:Watson-Crick_DNA_Metal_Model.png|thumb|300 px|left|Courtesy of the National Human Genome Research Institute, the National Institutes of Health. Original image at: http://www.genome.gov/25520255]]
<br>
<br>
Biologist and Biology Workgroup Editor, Gareth Leng, reminds us that a material structural model &mdash; Watson and Crick's 'metal stick' model of DNA (see image at left) &mdash; inspired the modern era of molecular biology.  Their model of the DNA molecule subsequently spawned alternative representations in numerous other visual and digital media, upon which molecular biologists built the edifice of their science.
A material structural model &mdash; Watson and Crick's 'metal stick' model of DNA (see image at left) &mdash; inspired the modern era of molecular biology.  Their model of the DNA molecule subsequently spawned alternative representations in numerous other visual and digital media, upon which molecular biologists built the edifice of their science.


For examples of web sites with modeling tools for cellular processes, see:<ref>[http://stke.sciencemag.org/cgi/ul/sigtransUl;CAT_7  ST (Signal Transduction) NetWatch: Modeling Tools]
For examples of web sites with modeling tools for cellular processes, see:<ref>[http://stke.sciencemag.org/cgi/ul/sigtransUl;CAT_7  ST (Signal Transduction) NetWatch: Modeling Tools]
Line 305: Line 308:


====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Darwin’s theory of evolution by means of natural and sexual selection'''''====
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Darwin’s theory of evolution by means of natural and sexual selection'''''====
Darwin’s theory, stated conceptually in words, and its 20th century amplification, stated genetically/molecularly often in quantitative terms, represents, or models, the behavior of nature in creating species and varieties sufficiently adapted to their environment to survive long enough to reproduce and care for their offspring and kin.  The theory enables understanding of an enormous range of behaviors of animals, plants, unicellular organisms, and cellular and subcellular systems, and has explanatory and predictive value in every biological discipline, and many non-biological disciplines.
Darwin’s theory, as amplified genetically/molecularly in the 20th century, represents, or models, the behavior of nature in creating species and varieties sufficiently adapted to their environment to survive long enough to reproduce and care for their offspring and kin.  The theory enables understanding of an enormous range of behaviors of animals, plants, unicellular organisms, and cellular and subcellular systems, and has explanatory and predictive value in every biological discipline, and many non-biological disciplines.


Evolutionary principles permeate the discipline of systems biology and have led to the emerging discipline of “evolutionary system biology”<ref name=medina05>Medina M (2005)  Genomes, phylogeny, and evolutionary systems biology. ''PNAS'' [http://www.pnas.org/cgi/content/full/102/suppl_1/6630/ 102:6630-5] PMID 15851668</ref>  A case in point: Determining whether natural selection operating at the molecular level has forged the structure of molecular networks may enhance understanding of their underlying design principles and thereby facilitate design of better predictive models.<ref name=wagner03>Wagner A (2003)[http://stke.sciencemag.org/cgi/content/full/2003/202/pe41/ Does Selection Mold Molecular Networks?] ''Sci.STKE'' 2003:e41 PMID 14519859</ref>
Evolutionary principles permeate the discipline of systems biology and have led to the emerging discipline of “evolutionary system biology”<ref name=medina05>Medina M (2005)  Genomes, phylogeny, and evolutionary systems biology. ''PNAS'' [http://www.pnas.org/cgi/content/full/102/suppl_1/6630/ 102:6630-5] PMID 15851668</ref>  A case in point: Determining whether natural selection operating at the molecular level has forged the structure of molecular networks may enhance understanding of their underlying design principles and thereby facilitate design of better predictive models.<ref name=wagner03>Wagner A (2003)[http://stke.sciencemag.org/cgi/content/full/2003/202/pe41/ Does Selection Mold Molecular Networks?] ''Sci.STKE'' 2003:e41 PMID 14519859</ref>


====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Bipedal and Quadrupedal Walking and Running'''''====
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Bipedal and Quadrupedal Walking and Running'''''====
In the human organism, walking and running emerge as system behaviors (no subsystem itself walks or runs).  The energy cost to the system of those locomotor behaviors defines a property of the system applicable to those behaviors. The energy cost owes to the appropriate forces the system must generate to support itself against gravity and to swing the locomoting limbs to achieve forward motion. Researchers have found that the rate at which the system produces those forces—shorthanded simply to ‘force production’—correlates with the system’s energy cost of locomotion. Thus, if one could develop a mathematical model that predicts force production from readily determined values of variables related to anatomy (e.g., limb length) and motion (e.g., forward speed), that model could then predict the system property of energy cost of locomotion.
In the human organism, walking and running emerge as system behaviors (no subsystem walks or runs).  The energy cost of those behaviors is a property of the system, and arises from the forces the system generates to support itself against gravity and to swing the limbs. The rate at which the system produces those forces  correlates with the system’s energy cost of locomotion. Thus, from a mathematical model that predicts force production from readily determined values of variables related to anatomy and motion, one could predict the energy cost. Harvard anthropologist Herman Pontzer<ref name=pontzer05>Pontzer H (2005) A new model predicting locomotor cost from limb length via force production. J Exp Biol 208:1513-24</ref> developed such a mathematical model &mdash; viz., an equation &mdash; that justified force production as a function of the rates of muscular force production in the vertical and horizontal directions, and the rate of muscular force production required to swing the limbs. He identified measureable anatomical and motor variables--length and proportion of limbs, speed, frequency of stride, and angle of excursion--that allowed estimation of the force variables. The model well predicted the observed cost of locomotion, somewhat better for running than walking. Subsequently, he tested the model in quadrupeds.<ref>Pontzer H (2007) Predicting the energy cost of terrestrial locomotion: a test of the LiMb model in humans and quadrupeds. ''J Exp Biol'' 210:484-94 PMID 17234618</ref>, confirming its predictive ability in estimating the rate of force production and energy cost of locomotion.  
 
Based on the findings of earlier studies, Harvard anthropologist Herman Pontzer<ref name=pontzer05>Pontzer H (2005) A new model predicting locomotor cost from limb length via force production. J Exp Biol 208:1513-24</ref> developed a mathematical model &mdash; viz., an equation &mdash; that justified force production as a function of three variables: the rate of muscular force production in the vertical direction, the rate of muscular force production in the horizontal direction, and the rate of muscular force production required to swing the limbs. From empirical data, knowledge of trigonometry and physics (force mechanics) and of muscle physiology, he identified measureable anatomical and motor variables--length and proportion of limbs, speed, frequency of stride, and angle of excursion--that allowed estimation of those required three force variables. Following earlier studies that linked force production with cost of locomotion, he generated the model &mdash; the equation &mdash; that he hoped would predict the latter from the former.  He found that the model well predicted the observed cost of locomotion, somewhat better for running than walking.
 
Subsequently, Professor Pontzer tested the model in quadrupeds as well as humans.<ref>Pontzer H (2007) Predicting the energy cost of terrestrial locomotion: a test of the LiMb model in humans and quadrupeds. ''J Exp Biol'' 210:484-94 PMID 17234618</ref> The model proved superior to previous models, extending it to quadrupeds, and confirming the predictive ability of considering the proposed anatomical variables in estimating the rate of force production and energy cost of locomotion.


With the development of quadruped and biped robots for human service, Professor Pontzer's model might help make decisions on energy-cost-effective robot locomotor anatomy and dynamics.
With the development of quadruped and biped robots for human service, Professor Pontzer's model might help make decisions on energy-cost-effective robot locomotor anatomy and dynamics.


====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Modeling Noise-Effects on Biochemical Processes and Cell Systems Behavior'''''====
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Modeling Noise-Effects on Biochemical Processes and Cell Systems Behavior'''''====
Randomness can influence the rate that a gene 'expresses' production of its encoded protein, for example, through random effects on the rate of DNA’s replication as messenger RNA.<ref name=vanzon06>van Zon JS ''et al.'' (2006) Diffusion of transcription factors can drastically enhance the noise in gene expression. Biophys J 91: [http://dx.doi.org/10.1529/biophysj.106.086157/ 4350-67]</ref>  Biologists refer to that as noise in the gene expression ‘molecular-machine’—fluctuations in expression rate (‘machine output’).  A protein repressor of DNA for producing messenger RNA might have a low number of molecules available for the binding to the DNA that effects the repression.  In that case, the total time of bound repressor-DNA will vary because of the random nature of molecules diffusing in a solution, which will also affect the time-pattern of messenger RNA production (how often and how long each time).  With fewer repressor molecules, random diffusion effects can dictate how rapidly repressor rebinds after diffusing off the DNA, and thereby can influence the total time DNA remains unrepressed and the time-pattern absent repression.  Because binding requires two molecules approaching, the spatial distribution of the low numbers of repressor molecules affected by the randomness of its diffusion patterns can produce fluctuating bursts of gene expression &mdash; noise.
Randomness can influence the rate that a gene 'expresses' production of its encoded protein, for example, through random effects on the rate of DNA’s replication as mRNA.<ref name=vanzon06>van Zon JS ''et al.'' (2006) Diffusion of transcription factors can drastically enhance the noise in gene expression. ''Biophys J'' 91: [http://dx.doi.org/10.1529/biophysj.106.086157/ 4350-67]</ref>  Biologists refer to that as "noise" in the gene expression ‘molecular-machine’.  A protein repressor of DNA for producing mRNA might have a low number of molecules available for binding to DNA.  In that case, the total time of bound repressor-DNA will vary because of the random nature of molecules diffusing in a solution, which will also affect the time-pattern of mRNA production.  With fewer repressor molecules, random diffusion can dictate how rapidly repressor rebinds after diffusing off the DNA, and thereby can influence the total time DNA remains unrepressed.  Because binding is an interaction between two molecules, the spatial distribution of the low numbers of repressor molecules affected by the randomness of its diffusion can produce fluctuating bursts of gene expression &mdash; noise. van Zon and colleagues<ref name=vanzon06/> developed a mathematical model to explain repressor-number-related noise in gene expression based on physical principles and statistical analyses of randomness.  Their model predicts burst-expression found experimentally, but does not allow for the more complicated effects of random diffusion. They point out that such noise in gene expression could have significant effects on cellular function.  Similarly, Samilov ''et al.'',<ref name=samoilov06>Samoilov MS ''et al.''(2006) From fluctuations to phenotypes: the physiology of noise. [http://dx.doi.org/10.1126/stke.3662006re17/ Sci.STKE 2006:re17]</ref> in their review of the ‘physiology of noise’, point out that “fluctuations in random biomolecular interactions” [noise] can lead to differences in the behavior of otherwise identical cells (clones) that enable the cells' tissue/organ more choices of adaptive response to environmental changes than a purely noise-free system would have.  Noise in biological machinery therefore can have positive effects.  


van Zon and colleagues<ref name=vanzon06/> developed a mathematical model to explain repressor-number-related noise in gene expression based on physical principles and statistical analyses of randomness based on probability theory. They show that their model, with its simplifying assumptions, predicts burst-expression found experimentally, but they admit that the model does not allow for the more complicated effects of random diffusion in cell systems.
Samilov ''et al.''<ref name=samoilov06/> describe other ways to model noise in biological systems. Rao ''et al.''<ref>Rao CV ''et al.'' (2002) Control, exploitation and tolerance of intracellular noise. ''Nature'' [http://dx.doi.org/10.1038/nature01258 420:231-7]</ref> reference many different modeling approaches to explore the control, rejection, elimination and exploitation of noise, and extensively highlight reasons we need to explain the role of noise in biological systems.


van Zon et al.<ref name=vanzon06/> point out that such noise in gene expression as in their model could have significant effects on cellular function, giving specific examples.  On that issue, Samilov et al.,<ref name=samoilov06>Samoilov MS, Price G, Arkin AP (2006) From fluctuations to phenotypes: the physiology of noise. [http://dx.doi.org/10.1126/stke.3662006re17/ Sci.STKE 2006:re17]</ref> in their review of the ‘physiology of noise’, point out that “fluctuations in random biomolecular interactions” [noise] can lead to differences in the behavior of otherwise identical cells (clones) that enable the cells' tissue/organ more choices of adaptive response to environmental changes than a purely noise-free system would have.  Noise in biological machinery therefore can have positive effects. Paradigmatic of that, random mutation of gene composition enables evolution by means of natural selection.
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Simulation modeling of an avian influenza pandemic'''''====
 
To consider the effects of an avian influenza outbreak in the U.S., researchers <ref>Germann TC ''et al.''(2006) Mitigation strategies for pandemic influenza in the USA. ''PNAS'' 103:5935-40 [PMID 16585506]</ref>&nbsp;&nbsp;using a supercomputer and specialized software, simulated the spread of a pandemic influenza viral strain through an artificial U.S. population (281 million people). They generated a model with realistic assumptions of transmissibility values, and considered the effect of variable antiviral and vaccine use, and of different modifications of social mobility (e.g., travel restrictions). They describe the basics of their model:
Samilov ''et al.''<ref name=samoilov06/> describe other ways to model noise in biological systems. Rao et al.<ref>Rao CV ''et al.'' (2002) Control, exploitation and tolerance of intracellular noise. ''Nature'' [http://dx.doi.org/10.1038/nature01258 420:231-7]</ref> reference many different modeling approaches to explore the control, rejection, elimination and exploitation of noise, and extensively highlight reasons we need to explain the role of noise in biological systems.
 
 
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Simulation modeling of an avian influenza pandemic in the United States'''''====
To consider the effects of an avian influenza outbreak in the U.S., workers at the Los Alamos National Laboratory, the Fred Hutchinson Cancer Research Center and the School of Public Health and Community Medicine at the University of Washington in Seattle,<ref>Germann TC ''et al.''(2006) Mitigation strategies for pandemic influenza in the USA. Proc Natl Acad Sci USA 103:5935-40 [PMID 16585506]</ref>&nbsp;&nbsp;using a supercomputer and specialized software, simulated the spread of a pandemic influenza viral strain through an artificial U.S. population (281 million people). To perform the simulation, they generated a model with realistic assumptions of transmissibility values, and considered the effect of variable antiviral and vaccine use, and of different modifications of social mobility (e.g., travel restrictions). They describe the basics of their model:


<blockquote> The three basic elements of our national-level simulation model are (i) a previously developed stochastic agent-based model for disease spread at the community level;<ref>'''Note''': To give the reader a sense of complexity of the computational technique, we quote the authors:  
<blockquote> The three basic elements of our national-level simulation model are (i) a previously developed stochastic agent-based model for disease spread at the community level;<ref>'''Note''': To give the reader a sense of complexity of the computational technique, we quote the authors:  
Line 341: Line 333:
:”With the rapidly increasing number of discovered molecular components [of mitochondria], computational models are also being developed to facilitate the organization and analysis of such data. Computational models of mitochondria have been accomplished with top-down [starting with a theoretical model of the system then tested against the data] and bottom-up [starting with the data and building up to the model] approaches and have been steadily improved in size and scope. Results from top-down methods tend to be more qualitative but are unbiased by prior knowledge about the system. Bottom-up methods often require the incorporation of a large amount of existing data but provide more rigorous and quantitative information, which can be used as hypotheses for subsequent experimental studies.”
:”With the rapidly increasing number of discovered molecular components [of mitochondria], computational models are also being developed to facilitate the organization and analysis of such data. Computational models of mitochondria have been accomplished with top-down [starting with a theoretical model of the system then tested against the data] and bottom-up [starting with the data and building up to the model] approaches and have been steadily improved in size and scope. Results from top-down methods tend to be more qualitative but are unbiased by prior knowledge about the system. Bottom-up methods often require the incorporation of a large amount of existing data but provide more rigorous and quantitative information, which can be used as hypotheses for subsequent experimental studies.”


To cite one example: Using massive data sets on mitochondrial components and chemical reactions, combined with mathematical assumptions and computer-based mathematical analyse, Vo ''et al.''<ref>Vo TD ''et al.'' (2004) Reconstruction and functional Characterization of the human mitochondrial metabolic network based on proteomic and biochemical data. J Biol Chem [http://www.jbc.org/cgi/content/full/279/38/39532?ijkey=352a9174685c0aea3f983d26f5d0ae981675c0a7#TBL2/ 279:39532-40] PMID 15205464 </ref> ‘constructed’ (aka modeled) a network of biochemical pathways that preserved the known interactions among the components. The constructed networked described mitochondrial energy production and other mitochondrial functions closely in accord with experimental results.
To cite one example: Using massive data sets on mitochondrial components and chemical reactions, combined with mathematical assumptions and computer-based mathematical analyse, Vo ''et al.''<ref>Vo TD ''et al.'' (2004) Reconstruction and functional Characterization of the human mitochondrial metabolic network based on proteomic and biochemical data. ''J Biol Chem'' [http://www.jbc.org/cgi/content/full/279/38/39532?ijkey=352a9174685c0aea3f983d26f5d0ae981675c0a7#TBL2/ 279:39532-40] PMID 15205464 </ref> ‘constructed’ (aka modeled) a network of biochemical pathways that preserved the known interactions among the components. The constructed networked described mitochondrial energy production and other mitochondrial functions closely in accord with experimental results.
 
The authors recognized the need for more experimental data of mitochondrial components and function to refine the model for predictability.


====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Modeling by Engineering Synthetic Systems'''''====
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Modeling by Engineering Synthetic Systems'''''====


"The goal of the emerging field of [[Synthetic biology]] synthetic biology is to produce and assemble biological parts and to create new life forms that will have a positive effect on people or the environment."<ref>Elisabeth Pain (2008) [http://sciencecareers.sciencemag.org/career_magazine/previous_issues/articles/2008_10_17/caredit.a0800153 A Multidisciplinary Approach to Life.] ''Science Career Magazine'' October 17, 2008.
"The goal of the emerging field of [[Synthetic biology]] synthetic biology is to produce and assemble biological parts and to create new life forms that will have a positive effect on people or the environment."<ref>Elisabeth Pain (2008) [http://sciencecareers.sciencemag.org/career_magazine/previous_issues/articles/2008_10_17/caredit.a0800153 A Multidisciplinary Approach to Life.] ''Science Career Magazine'' October 17, 2008
*See also:
*See also:
:*Elisabeth Pain (2008) [http://sciencecareers.sciencemag.org/career_magazine/previous_issues/articles/2008_10_17/caredit.a0800151 Special Feature: Opportunities in Synthetic Biology.] ''Science Career Magazine''. October 17, 2008.
:*Elisabeth Pain (2008) [http://sciencecareers.sciencemag.org/career_magazine/previous_issues/articles/2008_10_17/caredit.a0800151 Special Feature: Opportunities in Synthetic Biology.] ''Science Career Magazine''. October 17, 2008
:*Elisabeth Pain (2008) [http://sciencecareers.sciencemag.org/career_magazine/previous_issues/articles/2008_10_17/caredit.a0800152 Getting Ready for Synthetic Biology.] ''Science Career Magazine'' October 17, 2008.</ref>
:*Elisabeth Pain (2008) [http://sciencecareers.sciencemag.org/career_magazine/previous_issues/articles/2008_10_17/caredit.a0800152 Getting Ready for Synthetic Biology.] ''Science Career Magazine'' October 17, 2008</ref>


Systems biologists use advanced and innovative experimental techniques to construct synthetic versions of a subsystem with natural system elements &mdash; a unique modeling methodology. They propose a design blueprint for the synthetic subsystem based on empirical data about the system. With appropriate designs or tags, they can then observe and analyze the behavior of the synthetic system, in effect viewing it in isolation from the larger system embedding it.  That potentially leads to insights into ways of manipulating the system for desired ends, including inducing novel behaviors of the system and the larger system embedding it.<ref name=hasty02>Hasty J ''et al.'' (2002) Engineered gene circuits. ''Nature'' [http://www.nature.com/nature/journal/v420/n6912/abs/nature081257.html 420:224-30]</ref>
Systems biologists use advanced and innovative experimental techniques to construct synthetic versions of a subsystem with natural system elements &mdash; a unique modeling methodology. They propose a design blueprint for the synthetic subsystem based on empirical data about the system. With appropriate designs or tags, they can then observe and analyze the behavior of the synthetic system, in effect viewing it in isolation from the larger system embedding it.  That potentially leads to insights into ways of manipulating the system for desired ends, including inducing novel behaviors of the system and the larger system embedding it.<ref name=hasty02>Hasty J ''et al.'' (2002) Engineered gene circuits. ''Nature'' [http://www.nature.com/nature/journal/v420/n6912/abs/nature081257.html 420:224-30]</ref>
Line 366: Line 356:
<p style="margin-left: 2.0%; margin-right: 6%; font-size: 1.0em; font-family: Trebuchet MS;">Engineered biological systems have been used to manipulate information, construct materials, process chemicals, produce energy, provide food, and help maintain or enhance human health and our environment. Unfortunately, our ability to quickly and reliably engineer biological systems that behave as expected remains quite limited. Foundational technologies that make routine the engineering of biology are needed. Vibrant, open research communities and strategic leadership are necessary to ensure that the development and application of biological technologies remains overwhelmingly constructive.</p></blockquote>
<p style="margin-left: 2.0%; margin-right: 6%; font-size: 1.0em; font-family: Trebuchet MS;">Engineered biological systems have been used to manipulate information, construct materials, process chemicals, produce energy, provide food, and help maintain or enhance human health and our environment. Unfortunately, our ability to quickly and reliably engineer biological systems that behave as expected remains quite limited. Foundational technologies that make routine the engineering of biology are needed. Vibrant, open research communities and strategic leadership are necessary to ensure that the development and application of biological technologies remains overwhelmingly constructive.</p></blockquote>


Synthetic biology has the potential to construct artificial systems that can evolve through natural selection.<ref name=sismour05>Sismour AM, Benner SA. (2005) [http://dx.doi.org/10.1517/14712598.5.11.1409 Synthetic biology] ''Expert Opinion on Biological Therapy'' 5:1409-14</ref>
Synthetic biology has the potential to construct artificial systems that can evolve through natural selection.<ref name=sismour05>Sismour AM, Benner SA (2005) [http://dx.doi.org/10.1517/14712598.5.11.1409 Synthetic biology] ''Expert Opinion on Biological Therapy'' 5:1409-14</ref>


The articles cited in this section all describe specific examples of synthetic systems, and descriptions of the state-of-the-science.
The articles cited in this section all describe specific examples of synthetic systems, and descriptions of the state-of-the-science.


====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Simulation modeling to find functionality in complex networks''''====
====&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;'''''Simulation modeling to find functionality in complex networks''''====
As frequently occurs in this era when high-throughput data acquisition typically precedes elucidation of functionality, sometimes biologists can identify and characterize complex biological networks for which they have no clear evidence what the network does in terms of it biological functionality.  Using simulation modeling under the assumption that biological networks exhibit robustness, Paolo E. Barbano and co-workers at academic centers in New York and Connecticut have developed “''mathematical paradigms and computational tools that make use of high-throughput data to reveal the functional components embedded in complex networks and biochemical pathways.''” <ref name=barbanopnas07>Barbano PE ''et al.'' (2007) [http://dx.do.org/ A mathematical tool for exploring the dynamics of biological networks] ''PNAS U.S.A'' PMID 18032599</ref>
In this era when high-throughput data acquisition typically precedes elucidation of functionality, sometimes biologists can identify and characterize complex biological networks for which they have no clear evidence what the network actually ''does''.  Using simulation modeling under the assumption that biological networks exhibit robustness, Paolo Barbano and co-workers developed “''mathematical paradigms and computational tools that make use of high-throughput data to reveal the functional components embedded in complex networks and biochemical pathways.''” <ref name=barbanopnas07>Barbano PE ''et al.'' (2007) [http://dx.do.org/ A mathematical tool for exploring the dynamics of biological networks] ''PNAS U.S.A'' PMID 18032599</ref> Their methodology simulates the network response to input in the presence of noise to see what features remain robust, suggesting wherein lie the network’s important biological functions. As a target system they used a complex [[neurotransmitter]] signaling transduction cascade, trying to determine how to discover the robust features in the network through simulation.  Their computational tools incorporated “dimensionality reduction”, in which data in multiple dimensions of mathematical space maps to two or three dimensions, and employs “geometric intuition” to identify subnetworks with potentially interesting robustness. They conclude:
 
Their methodology simulates the network response to input in the presence of noise to see what features remain robust, suggesting wherein lie the network’s important biological functions. As a target system they used a complex brain neurotransmitter signaling transduction cascade, with the goal of trying to determine how to discover the robust features in the network through a simulation methodology.  Their computational tools incorporated “dimensionality reduction”, a method in which data in multiple dimensions of mathematical space maps to two or three dimensions, and employs the investigators’ “geometric intuition” to identify subnetworks with potentially interesting robustness. They conclude from the results of their study:


<blockquote> [O]ur results suggest that the entire topology of the network is needed to impart…stability to one portion of the network at the expense of the rest. This could have significant implications for systems biology, in that large, complex pathways may have properties that are not easily replicated with simple modules.<ref name=barbanopnas07/></blockquote>
<blockquote>...the entire topology of the network is needed to impart…stability to one portion of the network at the expense of the rest. This could have significant implications for systems biology, in that large, complex pathways may have properties that are not easily replicated with simple modules.<ref name=barbanopnas07/></blockquote>


==Interrelationships among key analytical methodologies used in systems biology==
==Interrelationships among key analytical methodologies used in systems biology==
Line 394: Line 382:
<br>
<br>
<br>
<br>
Some cell biologists might find it tempting to see a type of 'vitalism', or 'life force', in living systems, in view of the concept that some high-level features of organisms, including even the activity of living itself, exemplify [[Emergence|emergent]] phenomena &mdash; phenomena not explainable after exhaustively studying the properties of each of the chemical processes and subsystems that occur in the cell &mdash; studying them, that is, in isolation from the organization of the cell system embedding it. <ref>Berg EL ''et al.'' (2005) Biological complexity and drug discovery: a practical systems biology approach. Syst Biol 152:201-6 PMID 16986261</ref> One could not explain, for example, the action of an organism fleeing from a predator from a study of the properties of an organism's component subsystems. The properties of the component parts depend on the organization of those parts in the whole system. <ref name=gilbert00/>.  Because biologists and their co-scientists can explain emergent properties/phenomena, if only sometimes in principle, by mechanisms that do not transcend interactions of matter and energy, any such ‘vitalism’ properly qualifies only as a ‘materialistic vitalism’.
Some cell biologists might find it tempting to see a type of 'vitalism', or 'life force', in living systems, given that some high-level features of organisms, including even living itself, exemplify [[Emergence|emergent]] phenomena &mdash; phenomena not explainable after exhaustively studying the properties of each of the chemical processes and subsystems that occur in the cell &mdash; studying them, that is, in isolation from the organization of the cell system embedding it. <ref>Berg EL ''et al.'' (2005) Biological complexity and drug discovery: a practical systems biology approach. Syst Biol 152:201-6 PMID 16986261</ref> One could not explain, for example, the action of an organism fleeing from a predator from a study of the properties of an organism's component subsystems. The properties of the component parts depend on the organization of those parts in the whole system. <ref name=gilbert00/>.  Because biologists can explain emergent properties/phenomena, if only sometimes in principle, by mechanisms that do not transcend interactions of matter and energy, any such ‘vitalism’ qualifies only as a ‘materialistic vitalism’ - it does not involve any supernatural agency.


One example of emergence:  When components of signaling pathways, which allow within-cell and between-cell communication, interact to form signaling networks, properties can emerge &mdash; such as self-sustaining feedback loops and generation of novel signals &mdash; that one cannot explain from the individuated properties of the separate pathways. <ref name=bhalla99>Bhalla US, Iyengar R (1999) Emergent properties of networks of biological signaling pathways. 381-387 PMID 9888852 [http://www.sciencemag.org/cgi/content/abstract/283/5400/381 Link-1] [http://dx.doi.org/10.1126/science.283.5400.381 Link-2]</ref>
One example of emergence:  When components of signaling pathways, which allow within-cell and between-cell communication, interact to form signaling networks, properties can emerge &mdash; such as self-sustaining feedback loops and generation of novel signals &mdash; that one cannot explain from the individuated properties of the separate pathways. <ref name=bhalla99>Bhalla US, Iyengar R (1999) Emergent properties of networks of biological signaling pathways. 381-387 PMID 9888852 [http://www.sciencemag.org/cgi/content/abstract/283/5400/381 Link-1] [http://dx.doi.org/10.1126/science.283.5400.381 Link-2]</ref>
Line 413: Line 401:
:*evolution of complexity in living things <ref name=reid07/>   
:*evolution of complexity in living things <ref name=reid07/>   


Emergent phenomena appear even in non-biological physical systems. <ref>Cho YS ''et al.'' (2005) Self-organization of bidisperse colloids in water droplets. J Am Chem Soc 127:15968-75 PMID 16277541</ref>  &nbsp;Emergent phenomena attract the attention of cellular neuroscientists; <ref> see e.g. Burak Y, Fiete I (2006) Do we understand the emergent dynamics of grid cell activity? ''J Neurosci'' 26:9352-4 PMID 16977716</ref> &nbsp;and  cognitive scientists <ref> e.g. Courtney SM (2004) Attention and cognitive control as emergent properties of information representation in working memory. ''Cogn Affect Behav Neurosci'' 4:501-16 PMID 15849893 </ref>. &nbsp;At still higher systems levels, emergent properties appear for example in the behaviour of ant colonies and the concept of swarm intelligence, <ref>Theraulaz G ''et al.'' (2002) Spatial patterns in ant colonies. ''PNAS USA'' 99:9645-9 PMID 12114538</ref>  &nbsp;Artificial systems scientists have simulated emergent phenomena <ref>Theraulaz G, Bonabeau E (1999)A brief history of stigmergy. Artif Life 5:97-116 PMID 10633572</ref>  &nbsp;Emergent phenomena in human societies has also received attention. <ref>Bonabeau E, Meyer C (2001) Swarm intelligence. A whole new way to think about business. ''Harv Bus Rev'' 79:106-14 PMID 11345907</ref>.  &nbsp;Biologists even explain the biosphere itself as emergent. <ref>Field CB ''et al.''(1998) Primary Production of the Biosphere: Integrating Terrestrial and Oceanic Components. ''Science''  [http://www.sciencemag.org/cgi/content/full/281/5374/237/ 281:237-40]</ref>
Emergent phenomena appear even in non-biological physical systems. <ref>Cho YS ''et al.'' (2005) Self-organization of bidisperse colloids in water droplets. ''J Am Chem Soc'' 127:15968-75 PMID 16277541</ref>  &nbsp;Emergent phenomena attract the attention of cellular neuroscientists; <ref> see e.g. Burak Y, Fiete I (2006) Do we understand the emergent dynamics of grid cell activity? ''J Neurosci'' 26:9352-4 PMID 16977716</ref> &nbsp;and  cognitive scientists <ref> e.g. Courtney SM (2004) Attention and cognitive control as emergent properties of information representation in working memory. ''Cogn Affect Behav Neurosci'' 4:501-16 PMID 15849893 </ref>. &nbsp;At still higher systems levels, emergent properties appear for example in the behaviour of ant colonies and the concept of swarm intelligence, <ref>Theraulaz G ''et al.'' (2002) Spatial patterns in ant colonies. ''PNAS'' 99:9645-9 PMID 12114538</ref>  &nbsp;Artificial systems scientists have simulated emergent phenomena <ref>Theraulaz G, Bonabeau E (1999)A brief history of stigmergy. ''Artif Life'' 5:97-116 PMID 10633572</ref>  &nbsp;Emergent phenomena in human societies has also received attention. <ref>Bonabeau E, Meyer C (2001) Swarm intelligence. A whole new way to think about business. ''Harv Bus Rev'' 79:106-14 PMID 11345907</ref>.  &nbsp;Biologists even explain the biosphere itself as emergent. <ref>Field CB ''et al.''(1998) Primary Production of the Biosphere: Integrating Terrestrial and Oceanic Components. ''Science''  [http://www.sciencemag.org/cgi/content/full/281/5374/237/ 281:237-40]</ref>


We can elaborate on the principle that knowing the individuated properties of all the components of a system does not enable us to explain the properties of the system-as-a-whole &mdash; the opposite principle of the [[reductionist]] paradigm prevailing for centuries in physics and chemistry, and even in biology.<ref>Sarkar S (1998) ''Genetics and reductionism.'' Cambridge University Press, Cambridge. ISBN 0521631467</ref> &nbsp; Firstly, the intrinsic properties of a system’s components do ''not'' of themselves allow description of the properties of the whole system, any more than a shoebox of Lego pieces disassembled from its erstwhile airplane reveal the finished product.  Rather, the 'organizational dynamics' of the components explains the system, and those dynamics include not only the interrelations among the components themselves, but also interactions among the many different organizational units in the system. <ref>'''Note''': For example, physical chemists cannot predict the properties of water from knowledge of its components, hydrogen and oxygen. The way hydrogen and water interact to form H<sub>2</sub>O, and the way H<sub>2</sub>O molecules interact, enables the properties of water to 'emerge'.</ref>  Secondly, The novel properties, functions and behaviors that emerge in the system-as-whole in turn affect the properties, functions and behavior of the system's components, their 'organizational dynamics' &mdash; 'downward causation'.  For example, the emergent behavior of running by a land vertebrate alters cardiovascular and respiratory system dynamics and interactions.  Thirdly, the living system always operates in some context (its external environment, or surroundings), and that context, in turn, always affects the properties of the system-as-a-whole. For example, nutrient gradients influence the direction a bacterium’s locomotion. The impact of environmental context affects the organization of the components within the system &mdash; another level of 'downward causation'. <ref>'''Note''': Following up on the example of water, the properties of its environment (e.g., temperature, pressure) affect the way the H<sub>2</sub>O molecules organize themselves, as ice, or liquid, or steam</ref>  For another example, environmental signals can activate or suppress a metabolic pathway, reorganizing cellular activity<ref>'''Note''': In relation to downward causation, the environment’s effect can sometimes reach down to the genetic recipe with molecular signals, altering the recipe’s expression and consequently the characteristics of the cells &mdash; so-called 'epigenetic' effects. When [[epigenetic]] alterations of [[gene expression]] occur in the [[reproductive system|reproductive organs]], the system changes can be transmitted to the next generation. See   
We can elaborate on the principle that knowing the individuated properties of all the components of a system does not enable us to explain the properties of the system-as-a-whole &mdash; the opposite principle of the [[reductionist]] paradigm prevailing for centuries in physics and chemistry, and even in biology.<ref>Sarkar S (1998) ''Genetics and reductionism.'' Cambridge University Press, Cambridge. ISBN 0521631467</ref> &nbsp; Firstly, the intrinsic properties of a system’s components do ''not'' of themselves allow description of the properties of the whole system, any more than a shoebox of Lego pieces disassembled from its erstwhile airplane reveal the finished product.  Rather, the 'organizational dynamics' of the components explains the system, and those dynamics include not only the interrelations among the components, but also interactions among the many different organizational units in the system. <ref>'''Note''': For example, physical chemists cannot predict the properties of water from knowledge of its components, hydrogen and oxygen. The way hydrogen and water interact to form H<sub>2</sub>O, and the way H<sub>2</sub>O molecules interact, enables the properties of water to 'emerge'.</ref>  Secondly, The novel properties, functions and behaviors that emerge in the system-as-whole in turn affect the properties, functions and behavior of the system's components, their 'organizational dynamics' &mdash; 'downward causation'.  For example, the emergent behavior of running by a land vertebrate alters cardiovascular and respiratory system dynamics and interactions.  Thirdly, the living system always operates in some context (its external environment), and that context, in turn, always affects the properties of the system-as-a-whole. For example, nutrient gradients influence the direction of a bacterium’s locomotion. The impact of environmental context affects the organization of the components within the system &mdash; another level of 'downward causation'. <ref>'''Note''': Following up on the example of water, the properties of its environment (e.g., temperature, pressure) affect the way the H<sub>2</sub>O molecules organize themselves, as ice, or liquid, or steam</ref>  For another example, environmental signals can activate or suppress a metabolic pathway, reorganizing cellular activity<ref>'''Note''': In relation to downward causation, the environment’s effect can sometimes reach down to the genetic recipe with molecular signals, altering the recipe’s expression and consequently the characteristics of the cells &mdash; so-called 'epigenetic' effects. When [[epigenetic]] alterations of [[gene expression]] occur in the [[reproductive system|reproductive organs]], the system changes can be transmitted to the next generation. See   
:*Jablonka E, Lamb MJ (2005) ''Evolution in Four Dimensions: Genetic, Epigenetic, Behavioral, and Symbolic Variation in the History of Life.'' Cambridge: MIT Press
:*Jablonka E, Lamb MJ (2005) ''Evolution in Four Dimensions: Genetic, Epigenetic, Behavioral, and Symbolic Variation in the History of Life.'' Cambridge: MIT Press
:*Gorelick R (2004) Neo-Lamarckian medicine. Med Hypotheses 62:299-303 PMID 14962644</ref> One cannot simply take a living system apart and predict how it will behave.
:*Gorelick R (2004) Neo-Lamarckian medicine. ''Med Hypotheses'' 62:299-303 PMID 14962644</ref> One cannot simply take a living system apart and predict how it will behave.


According to philosopher of science D.M. Walsh: "The constituent parts and processes of a living thing are related to the organism as a whole by a kind of 'reciprocal causation'."<ref>Walsh DM (2006) Organisms as natural purposes: the contemporary evolutionary perspective. Stud Hist Philos Biol Biomed Sci 37: [http://dx.doi.org/doi:10.1016/j.shpsc.2006.09.009 771-91]</ref> In other words, the organization of the components determine the behavior of the system, but that organization arises from more than the set of its internal components. How the whole system behaves as it interacts with its environment determines how those components organize themselves, and so novel properties of the system 'emerge' that characterize neither the environment nor that set of internal components.  
According to philosopher of science D.M. Walsh: "The constituent parts and processes of a living thing are related to the organism as a whole by a kind of 'reciprocal causation'."<ref>Walsh DM (2006) Organisms as natural purposes: the contemporary evolutionary perspective. ''Stud Hist Philos Biol Biomed Sci'' 37: [http://dx.doi.org/doi:10.1016/j.shpsc.2006.09.009 771-91]</ref> In other words, the organization of the components determine the behavior of the system, but that organization arises from more than the set of its internal components. How the whole system behaves as it interacts with its environment determines how those components organize themselves, and so novel properties of the system 'emerge' that characterize neither the environment nor that set of internal components.  


For example, the behavior of a human kidney cell depends not only on its cellular physiology, but also on all the properties of the organ ([[kidney]]) which constitutes its environment. The kidney's overall structure and function influence the cell’s structure and behavior (e.g., by physical confinement and by cell-to-cell signaling), which in turn influence the organization of its intracellular components. The kidney in turn responds to ''its'' environment, namely the organism that it lives in, and that organism responds to ''its'' environment, which includes such factors as the availability of particular food items, fresh water, and ambient [[temperature]] and [[humidity]].  
For example, the behavior of a human kidney cell depends not only on its cellular physiology, but also on all the properties of the organ ([[kidney]]) which constitutes its environment. The kidney's overall structure and function influence the cell’s structure and behavior (e.g., by physical confinement and by cell-to-cell signaling), which in turn influence the organization of its intracellular components. The kidney in turn responds to ''its'' environment, namely the organism that it lives in, and that organism responds to ''its'' environment, which includes such factors as the availability of particular food items, fresh water, and ambient [[temperature]] and [[humidity]].  
Line 425: Line 413:
Systems biologists thus regard emergent properties as arising from from a combination of ''bottom-up'' and ''top-down'' effects &mdash; Walsh's 'reciprocal causation'.
Systems biologists thus regard emergent properties as arising from from a combination of ''bottom-up'' and ''top-down'' effects &mdash; Walsh's 'reciprocal causation'.


Using the example of termites out of whose combined individual behaviors without outside management emerge complex colony mounds, a recent National Research Council report on the role of theory in advancing 21st century biology commented on emergent behavior as follows:<ref name=naptheory>Committee on Defining and Advancing the Conceptual Basis of Biological Sciences in the 21st Century, National Research Council. (2008) [http://www.nap.edu/catalog.php?record_id=12026 The Role of Theory in Advancing 21st Century Biology: Catalyzing Transformative Research.] Board on Life Sciences, Division on Earth and Life Studies, National Research Council of the National Academies. The National Academies Press, Washington, D.C. ISBN 978-0-309-11249-9.</ref>
Using the example of termites out of whose combined individual behaviors without outside management emerge complex colony mounds, a recent National Research Council report commented on emergent behavior as follows:<ref name=naptheory>Committee on Defining and Advancing the Conceptual Basis of Biological Sciences in the 21st Century, National Research Council. (2008) [http://www.nap.edu/catalog.php?record_id=12026 The Role of Theory in Advancing 21st Century Biology: Catalyzing Transformative Research.] Board on Life Sciences, Division on Earth and Life Studies, National Research Council of the National Academies. The National Academies Press, Washington, D.C. ISBN 978-0-309-11249-9.</ref>


<blockquote>A reasonable way of thinking about emergent behavior might be to focus on the level or scale at which the rules reside. If the rules are specified at a low level, for example, the individual termites, and the patterns and structures, like termite mounds, emerge at a scale where there are no rules specified, we may call this emergent behavior.<ref name=naptheory/></blockquote>
<blockquote>A reasonable way of thinking about emergent behavior might be to focus on the level or scale at which the rules reside. If the rules are specified at a low level, for example, the individual termites, and the patterns and structures, like termite mounds, emerge at a scale where there are no rules specified, we may call this emergent behavior.<ref name=naptheory/></blockquote>
Line 431: Line 419:
Other examples of rule-free emergent behavior for which the 'rules' appear specified at a lower level than the emergent behavior itself include the flocking behavior of birds, and the folding of amino acid polymers into catalytic proteins.
Other examples of rule-free emergent behavior for which the 'rules' appear specified at a lower level than the emergent behavior itself include the flocking behavior of birds, and the folding of amino acid polymers into catalytic proteins.


Other basic concepts that systems biologists consider crucial in explaining living systems as-a-whole include 'robustness', 'modularity', and 'networks' &mdash; see [[Life]].  Quantitative modeling and simulation guided by experimental biological data provide the mainstay methodologies of systems biologists.
Other basic concepts that systems biologists consider crucial in explaining living systems include 'robustness', 'modularity', and 'networks' &mdash; see [[Life]].  Quantitative modeling and simulation guided by experimental biological data provide the mainstay methodologies of systems biologists.


Emergent systems always display what we recognize as ‘complexity’, a feature we have a difficult time precisely defining.  Complex systems appear to require more bits of information (words, sentences, lines of computer code, etc.) to describe than the bits of information in the system itself. <ref> (1991) Zurek WJ (ed) ''Complexity, Entropy, and the Physics of Information:'' The Proceedings of the Workshop on the Complexity, Entropy, and the Physics of Information  May-June, 1989, Santa Fe, New Mexico. Addison-Wesley Publishing Company, The Advanced Book Program, Redwood City. ISBN 0201515091</ref> &nbsp;The operation of the system itself supplies its own most economical model.
Emergent systems always display what we recognize as ‘complexity’, a feature we have a difficult time precisely defining.  Complex systems appear to require more bits of information (words, sentences, lines of computer code, etc.) to describe than the bits of information in the system itself. <ref> (1991) Zurek WJ (ed) ''Complexity, Entropy, and the Physics of Information:'' The Proceedings of the Workshop on the Complexity, Entropy, and the Physics of Information  May-June, 1989, Santa Fe, New Mexico. Addison-Wesley Publishing Company, The Advanced Book Program, Redwood City. ISBN 0201515091</ref> &nbsp;The operation of the system itself supplies its own most economical model.


According the paleontologist and origin of life researcher, Robert Hazen, four basic complexity elements underpin emergence in a system: <ref>Hazen RM (2005) ''Genesis: The Scientific Quest for Life's Origin.'' Joseph Henry Press, Washington DC. ISBN 0309094321</ref>
According to paleontologist Robert Hazen, four basic complexity elements underpin emergence in a system: <ref>Hazen RM (2005) ''Genesis: The Scientific Quest for Life's Origin.'' Joseph Henry Press, Washington DC. ISBN 0309094321</ref>


:*a sufficiently large ‘density’ of components, with increasing complexity as the concentration increases, up to a point;
:*a sufficiently large ‘density’ of components, with increasing complexity as the concentration increases, up to a point;
Line 448: Line 436:
In viewing living systems as a particular organization of its components &mdash; including the organization as influenced by its environment &mdash; ultimately systems biology provides an answer, at one level of explanation, to the perennial question, "what is life?"  Systems biologists have modified that question, though, to something more like: "What accounts for the activity of [[Life|living]]?" However put, neither neither molecular biology nor evolutionary theory seem to provide as satisfactory an explanation.
In viewing living systems as a particular organization of its components &mdash; including the organization as influenced by its environment &mdash; ultimately systems biology provides an answer, at one level of explanation, to the perennial question, "what is life?"  Systems biologists have modified that question, though, to something more like: "What accounts for the activity of [[Life|living]]?" However put, neither neither molecular biology nor evolutionary theory seem to provide as satisfactory an explanation.


==Philosophy of systems biology==
 
....


==References==
==References==
Line 457: Line 444:


'''NB''': ''Some links to online full-text sources may require individual subscription to the online source, or access through an institutional subscription. Often the linked page contains at least a summary or abstract of the source if not the full-text.''
'''NB''': ''Some links to online full-text sources may require individual subscription to the online source, or access through an institutional subscription. Often the linked page contains at least a summary or abstract of the source if not the full-text.''
[[Category:Suggestion Bot Tag]]

Latest revision as of 11:00, 24 October 2024

This article is developed but not approved.
Main Article
Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
 
This editable, developed Main Article is subject to a disclaimer.
The properties of systems are the result of two important characteristics: systems have a hierarchical structure, and the structure is held together by numerous linkages to construct very complex networks.

—Anthony Trewavas[1]

As an academic discipline, systems biology,[2] aims to explain, predict, and control the properties, functions and behaviors[3] of living systems and their subsystems.[4]

From the systems biology perspective, living systems are complex adaptive systems, compartmented, self-assembled and self-organized networks of interconnected, interacting, interdependent diverse types of components, all naturally generated and naturally selected, interacting physico-chemically in a dynamic, coordinated, and hierarchical pattern, in part orchestrated and constrained by the system-as-a-whole. Living systems exhibit emergent properties and behaviors — emergent in the sense that the system-as-a-whole, in comparison with its components, exhibits properties and behaviors unique to itself, often unexpected and novel.[4] [5] [6]  

Biological systems studied by systems biologists range from the level of the molecular subsystems of cells (e.g.,mitochondrial production of energy; ribosomal protein synthesis; circuits of biochemical reactions regulating gene expression; cell-to-cell and within-cell signaling pathways); to the Earth's biosphere, and include many intermediate system levels (e.g., unicellular organisms, multicellular organs, multicellular-multiorgan organisms, ecosystems).

Scientists engaged in bioengineering, synthetic biology, biophysics, bioinformatics and related fields consider systems biology as part of their disciplines.


The Scope of Systems biology

Reductionism and Holism
Gilbert SF, Sarkar S (2000) Embracing complexity: organicism for the 21st century. Dev Dyn 219:1-9 PMID 10974666]

Reductionism: “…imagine a materialistic philosophy that claims that all complex entities (including proteins, cells, organisms, ecosystems) can be completely explained by the properties of their component parts. Such an epistemological position is called reductionism, and it is the basis for most of physics and chemistry, and much of biology….. In the reductionist epistemology of science, chemistry and biology are not ultimately independent disciplines, because they will eventually have all their explanations “reduced” to the terms of physics. The reductionist epistemology and methodology is strictly analytical.”

Holism: ”Let us imagine, though, another (ontologically) materialistic philosophy. Here, complex wholes are inherently greater than the sum of their parts in the sense that the properties of each part are dependent upon the context of the part within the whole in which they operate. Thus, when we try to explain how the whole system behaves, we have to talk about the context of the whole and cannot get away talking only about the parts. This philosophical stance is variously called wholism, holism, or organicism.”

Systems biology developed in part because of the recognition that knowledge of the properties of a system’s components, separated from the system embedding them, could never yield a satisfying explanation of the organized behavior of the system. The behavior of a system as a whole depends not only on the properties of its components, but also on how they interrelate and interact dynamically and coordinately spatio-temporally. It also depends on how the organized behavior of the system (influenced in part by the larger system embedding it) influences the properties and interactions of the components. The novel and unpredictable properties (including functions and behaviors) of systems emerge from its dynamic organization, and to understand them requires a ‘holistic’ [7] approach in coordination with the traditional ‘reductionistic’[7] approach.

"Humpty-Dumpty has been smashed into billions of fragments...Can we put Humpty-Dumpty back together again?" [8]  (See text-box at left.)

Systems biologists try to achieve their aims in part through developing models (descriptions, representations, simulations) of systems — including graphical, mathematical, algorithmical, and computer-based computational simulation models. The models 'describe' systems, or 'translate' them into the cognitively knowable 'language' or 'symbolism' of the model. They enable interpretation of the systems' components' organization and the systems' behavior by human cognition. The models aspire to do that well enough to account for experimental data about a system’s coordinated dynamically interacting components, and to allow predictions of the system's properties, functions and behaviors in response to stimuli or in particular conditions.

Systems biologists use mathematical, statistical and computational tools in diverse modeling approaches, in mathematical network analyses, in computer simulations. High-speed digital computers and advances in mathematical reasoning have changed classical experimentation by enabling scientists to explore systems by implementing their components, interrelations and interactions in a dynamic reality composed of binary digits. The scientist can create a particular reality to implement a physical system from known properties of the system and known principles of the interactions of matter. They can thus ‘imitate’, or ‘simulate’, the system’s behavior in response to simulated changes in environmental conditions, and to output the simulation in readily interpretable formats. Nuclear scientists, aerodynamicists, chemists, economists, as well as biologists, more and more rely on computer simulations to understand systems. Modeling permits design and building of synthetic networks from biomolecules. Modeling refinements occur as systems biologists iteratively incorporate new data from experiments inspired by systems analysis.

Mathematical modeling permits a kind of formal integrative analysis of a biological system that also facilitates the development of conceptual frameworks that can permit identification of gaps in knowledge or understanding. Without models, the human mind can comprehend little of the complex organization-as-a-whole of a living system. In speaking about the signaling pathways in living cells, Weng et al. put it this way: There is simply too much essential detail in biological signaling for the unaided human mind to organize and understand.[9] Models provide metaphors for explanation of systems, powerful metaphors with remarkable potential for predicting and managing the behavior of living systems.

Systems biologists often work with scientists from other disciplines in developing models and conceptual frameworks. Some of those non-biological disciplines (e.g., mathematics, physics and chemistry) have developed systems approaches to explore systems in their own domains.

No definition or succinct description can capture the breadth and depth of systems biology. Indeed, historian and philosopher of science Evelyn Fox Keller argues that “so far, ‘systems biology’ is a concept waiting for definition".[10]  This article elaborates on the above description of the discipline.

Methodologies in general terms

Systems biologists try to accomplish their aims in part:

  • by identifying and quantifying the system's components — for cells, acquiring so-called '-omics' data, including the numbers and types of nucleic acids (genomics), proteins (proteomics), and metabolites (metabolomics);
  • by identifying, characterizing, and to the extent possible, quantifying the interrelations (structural) and interactions (dynamical, coordinated, hierarchical) among the components of a system; for example, (a) for molecular components: gene and protein interactions involved in a cell’s metabolic pathways; (b) for organism components: organ interactions resulting in blood pressure homeostasis; (c) for ecosystem components: predator and prey behaviors;
  • by attempting to organize the system’s components abstractly in the form of 'models'/'simulations' — typically mathematical and computational — which encode such concepts as 'modules', 'circuits' and 'networks', 'network motifs', 'feedback' and 'feedforward' loops, 'homeostasis', 'adaptability', hierarchies, 'robustness, 'complexity', 'adaptation', and 'emergence';
  • by conducting additional experiments to define interrelations and interactions of the real system that the model/simulation highlighted as knowledge gaps;
  • by refining the model/simulation on the basis of the data from those model-inspired experiments;
  • by designing, constructing and testing synthetic biological systems from biological components;[11]
  • by developing new experimental technologies and new theoretical methods as required to answer new questions that inevitably arise in the study of the unfathomable complexity of living systems.[12].

Modeling may take either ‘bottom-up’ or ‘top-down’ approaches.[13]   Systems biologists use both approaches in trying to put the puzzle of the whole together.

In bottom-up approaches, biologists start from the properties and interactions of molecules, or of elemental subsystems, and use that data to design models that try to explain the how the interactions (e.g., those in a factually-rich kinetic model of reaction network) account, at least in part, for functional behaviors of the system that embeds them (e.g., accounts for a behaviors stability despite perturbing environmental changes). They then evaluate the model’s predictions through experiments on the real system, and, depending on the results, they adjust the model and repeat the process, or they try to obtain additional experimental data that the model reveals as required for a better model. The computer models allow for exploring the behavior of the model-system under different environmental conditions, sometimes even leading to discovery of new levels of organization in the system modeled.

In top-down approaches, biologists start from the properties, functions and behaviors of the system-as-a-whole (system-data), making 'top-down' a data-rich enterprise. They try to design models of component composition and interactions that reveal both the experimentally-derived component/interaction-data and the correlations between component properties and system behavior, which then suggest new hypotheses. Often the system-data includes the responses of the system to typical perturbations. Deficiencies of the model’s accordance and accounting may suggest possibilities for the kinds of component-composition and interactions needed to make the model work, leading to targeted experimentation to discover new molecular or subsystem mechanisms operating in the system. As the model advances in its predictive ability, through iterations of model-adjustment and targeted experimentation, it inspires better and better testable hypotheses about the system’s organization, potentially leading to both a complete description of the component-composition and its organizational dynamics and functionality. Yet, except for very small subsystems, however much data we may have acquired or can acquire about a biological system, it can only ever be a small part of all the data that would be needed to completely specify the system.

Modeling sophistication continues to develop rapidly in the early 21st century. For some systems, modeling uses multiple datasets distributed in cyberspace, more than one mathematical or computational methodology, and even an array of interlinked computers having different architectures.[14]   Many of the books and articles listed for further reading at the end of this article provide detailed descriptions and examples of the vast array of mathematical, graphical, computational, and biostatistical tools that systems biologists use.

Systems biologists expect progress in the field to yield explanations of biological systems exploitable for applications in ecology, ethology, medicine, agriculture, business, the environment and technology — and to a considerable extent it has already done so. Some systems biologists consider the discipline critical to further progress in biology.[15]

The study of biological systems expanded greatly as the result of advances in molecular biology and data processing/analysis in the late 20th and early 21st century. Those include sequencing of genomes, developments in genetic engineering, developments of technologies for generating massive amounts of data on the structure and interactions of cellular components, and developments in bioinformatics — all fueled by increasing interest by non-biological scientists (mathematicians, statisticians, computer scientists, physicists, chemists, and engineers, among others) in applying the principles and methods of their disciplines to the explanation of the improbable adaptive complexity of living systems (see illustration below on growth of publications on systems biology).

On the nature of biological "systems"

A 'system' in biology is any interconnected, interacting, coordinated and hierarchical assembly of biological components or elements—an organized assemblage with identifiable behavior. For example, the vertebrate body is an assembly of diverse, interacting organs, among other components, behaving to survive and reproduce. The mitochondria of cells comprise a system for converting food energy into a general-use molecule for energizing biochemical reactions. Each component in a biological system interacts in some way(s) with one or more components in the system--a dynamical assembly of components. In a cell, proteins are the products of genes, but they also interact with genes, affecting their expression, as well as interacting with other proteins. Systems can exhibit behaviors that are characteristic of the system-as-a-whole (see below), but which are not shared by any of its components (so-called emergent behaviors). A tree fruits, for example, because its dynamically interacting components enable it to, but no single component of a tree can.

Subsystems consist of smaller (less complex) systems embedded in a larger (more complex) system, and constitute at least part of the components or elements of the larger system. Whether a systems biologist treats a given assembly of components as a subsystem or as a system depends on the 'level' at which she focuses her attention. If she focuses her research at the level of a whole vertebrate organism, for example, she treats its organs as subsystems. If she focuses her research at the level of the heart, she treats the heart's interacting components as a system, while recognizing that the heart remains part of a larger system (the circulatory system).

Even the larger systems, such as the vertebrate body system, are components or elements of even larger systems, a species of vertebrates, say, where individual members of the species interact with each other, as components, to generate a set of behaviors or properties characteristic of the species but not of its individual members. The flocking behavior of birds illustrates a species behavior--technically the behavior of a deme. One bird cannot flock. Reproduction among sexually reproducing species requires the emergent behavior of two individuals.

When trying to understand biological systems, systems biologists need not treat the components or elements of a system (or subsystem) exclusively as discrete or concrete objects or entities (e.g., molecules, organelles, cells, etc.), but may also treat them as abstracted concepts of organizational collections or activity patterns of those entities (e.g., networks), which admit of study by graphical, mathematical, computational and statistical tools. Those include such concepts as circuits, networks and modules. Such concepts have a way of appearing less abstract or hypothetical as biologists more fully define them in terms of structure and coordinated dynamical interactions; predict systems behavior from them using quantitative models; and relate them functionally in the larger systems embedding them. Indeed, Bruggeman and Westerhoff[16] remark that the advances in molecular biology and mathematical modeling have "...shifted the focus of research from molecules to networks...", citing Barabasi and Otvai's review[17] underscoring the importance of networks in understanding the organization of cells.

    'Complex' vs. 'Complicated'

Systems biologists distinguish between the complex and the complicated. A complicated system need not qualify as complex. It may have many parts, intricately interconnected, but no one part may play a critical role in the system's operation, each part more or less independent. A 1000-piece assembled jigsaw puzzle may represents a complicated scene, but a missing piece hardly affects the visual result. A biological cell with a missing chromosome, however, becomes seriously dysfunctional. John H. Miller, professor of economics and social sciences at Carnegie Mellon University, and Scott E. Page, professor of complex systems, political science, and economics at the University of Michigan, express the difference as follows:

We would, however, like to make a distinction between complicated worlds and complex ones. In a complicated world, the various elements that make up the system maintain a degree of independence from one another. Thus, removing one such element (which reduces the level of complication) does not fundamentally alter the system’s behavior apart from that which directly resulted from the piece that was removed. Complexity arises when the dependencies among the elements become important. In such a system, removing one such element destroys system behavior to an extent that goes well beyond what is embodied by the particular element that is removed. [18]


    Networks

Networks[19] ‘re-present’ or 'abstract' a system as an assemblage of 'nodes’ and ‘interactions’ among the nodes (also referred to as ‘edges’ or ‘arrows’ or ‘links’). In a spoken sentence, for example, words and phrases make up the nodes, and the interconnections of syntax (subject-to-predicate, preposition-to-object of preposition, etc.) make up the links. Molecular networks in cells represent specific functions in the cell; molecules make up the nodes, and their interactions with other nodes make up the edges or arrows. Networks accept inputs of one kind and return outputs of a different kind.

One finds networks everywhere in biology, from intracellular signaling pathways, to intraspecies networks, to ecosystems. Humans deliberately construct social networks of individuals working (more or less) to a common purpose, such as the U.S. Congress; they also construct networks of electronic parts to produce, for example, mobile phones; and networks of sentences and paragraphs to express messages, including this article. Researchers view the World Wide Web as a network, and study its characteristics and dynamics.[19][20]

According to Alon, "The cell can be viewed as an overlay of at least three types of networks, which describes protein-protein, protein-DNA, and protein-metabolite interactions."[21] Alon notes that cellular networks, like many human engineered networks, show 'modularity', 'robustness', and 'motifs':

  • Modules are subnetworks with a specific function and which connect with other modules often only at one input node and one output node. Modularity facilitates evolutionary adaptation to changing environments, for to produce an adaptation, evolution need tinker with just a few modules rather than with the whole system. Evolution can sometimes 'exapt' existing modules for new functions that contribute to reproductive fitness. For example, the swim bladder purportedly evolved as an adaptation for control of buoyancy later exapted as a respiratory organ in various groups of fish.[22]
  • Robustness describes how a network is able to maintain its functionality despite environmental perturbations that affect the components. Robustness also reduces the range of network types that researchers must consider, because only certain types of networks are robust.
  • Network motifs offer economy of network design, as the same circuit can have many different uses in cellular regulation, as in the case of autoregulatory circuits and feedforward loops. Nature selects motifs in part for their ability to make networks robust, so systems use motifs that work well over and over again in many different networks.[23] In several well-studied biological networks, the abundance of network motifs — small subnetworks — correlates with the degree of robustness.[24] Networks, like those in cells and those in neural networks in the brain,[25] use motifs as basic building blocks, like multicellular organisms use cells as basic building blocks. Motifs offer biologists a level of simplicity of biological functionality for their efforts to model the dynamics of organized hierarchies of networks.[23]

The view of the cell as an overlay of mathematically-definable (in principle) dynamic networks can reveal how a living system can exist as an improbable, intricate, self-orchestrated dance of molecules.[26] The 'overlay of networks' view also suggests how the concept of self-organized networks can extend to all higher levels of living systems.

Biological system behaviors typically perform one or more evolution-informed functions (e.g., growth), so unraveling the evolutionary history of the networks in a biological system contributes importantly in explaining it. Evolutionary history requires knowledge of the mechanisms of both generation and selection.

    Examples of biological systems

Examples of biological systems (subsystems) include:

  • the biosphere
  • ecosystems (e.g., a forest)
  • demes (e.g., a local population of a species)
  • organisms (e.g., humans; bacteria)
  • organs (e.g., brain; the vascular endothelium)
  • cells (e.g., epithelial cell)
  • metabolic pathways (e.g., glycolysis)
  • cellular organelles (e.g., mitochondria)
  • genomes (e.g., the entire complement of DNA in an organism, as the ’mouse genome')
  • gene complexes (e.g., co-expressing genes)
  • genes (e.g., protein blueprints)

History of systems biology

We can find many adumbrations of the systems view of nature in the writings of the ancients. Pliny the Elder (23-79 C.E.), Roman encyclopedist of ancient European science, wrote: "But it is the fact, that every moment of our existence we are distrusting the power and the majesty of Nature, if the mind, instead of grasping her in her entirety, considers her only in detail."[27]

Knowing the historical path(s) that led to a modern scientific program can help in understanding the nature of the program, in particular, its goals and its methodologies, especially through considering the different focuses and approaches that different historians have taken when writing about the same topic.


    The evolution of molecular biology into systems biology

Westerhoff and Palsson[15] introduce the school of thought “…that systems biology of the living cell has its origin in the expansion of molecular biology to genome-wide analyses.” They point out, however, that molecular biology has an earlier history of systems thinking, in particular in the elucidation of the many molecular regulatory circuits and of their contribution to the logic of the cell. They see technological advances that have permitted rapid collection of large data sets (so-called high-throughput technologies mapping the genome) as upping the scale of that research “…enabling us [molecular biologists] to view the genome as the ‘system’ to study.”

They describe two pathways of enquiry that they see as having merged into modern systems biology of the cell.

One is the advances in molecular biology that ultimately “…led to efforts toward genome-scale model building to analyze the systems properties of cellular function”: recognition of DNA as the genetic material, identifying the structure of DNA, recombinant technology, automated determination of DNA base sequences, and high-throughput technologies yielding the sequences of entire genomes.

A second is the development of non-equilibrium thermodynamics, a predictive mathematical theory for describing the behavior of systems that transfer energy from one place to another or convert energy from one form to another in processes the move towards an irreversible state of stability characterized by randomness or disorder—for biological systems, death. Because living systems produce order and maintain a state of non-randomness, they must carry out processes that keep them in a condition far from the equilibrium of randomness, and they achieve this by transforming energy (and matter and information) taken in from the environment. The non-closed biological system produces order at the expense of the environment it opens to, while the environment becomes more disordered.

Westerhoff and Palsson describe advances in the development of non-equilibrium thermodynamics as presaging molecular and cellular systems biology through ‘quantitative’ integration of system components and through the discovery of principles connecting molecular mechanisms and system behaviors. Westerhoff and Alberghina[28] ask of systems biology: “Did we know it all along?”

    Historical milestones in the development of systems biology

Anthony Trewavas, a scientist conducting research in the molecular and systems biology of plant cells, emphasizes the following aspects of the history of systems biology:[29]

  • How Rene Descartes’ formulation of reductionism—the concept that the properties of complex objects can be explained by reducing them into their parts and studying the properties of the parts —led biologists to assume that one could explain a complex biological system's behavior from the behavior of its subsystems;
  • How reductionism played hand-in-hand with the mechanistic view of reality, leading biologists to view systems as predetermined machines, like clocks;
  • How reaction against the reductionist-mechanistic view led to a holistic view of biological systems consistent with Aristotle’s dictum, commonly expressed as "the whole is greater than the sum of its parts";
  • Aristotle qualifies as a "systems biologist" as he viewed the behavior of a complex living system as finally explaining (final cause) why the system has the parts (material cause) interrelated (formal cause) and interacting coordinately (efficient cause) that it does;[30]
  • How experiments revealed that the averaged behavior of a population did not apply to individual members of the population, however homogeneous the population appeared, complementing experiments revealing non-machine-like toleration of large variability among kindred organisms, organs and cells with respect to behavior and function—each manifesting a so-called norm of reaction that overlapped among individuals;
  • How a system’s organization of subsystems itself exerts a level of control and constraint over the range of behaviors available to the subsystems in isolation;
  • How a system’s subsystems are organised in hierarchies, where the properties of a subsystem emerge from the dynamic interactions of subsystems at lower levels of the hierarchy;
  • How subsystems at lower levels of hierarchy exhibit more variability and how their behavior exhibits more order within the system than without—the higher level emergent properties orchestrate and constrain the behavior of the subsystems generating that emergence;
  • How Karl Ludwig von Bertalanffy (1901-1972) recognized that all systems share “…the common property of being composed of interlinked components, in which case they might share similarities in detailed structure and control design”;
  • How Michael Polyani (1891-1976) recognized that adjacent levels of a system’s subsystems constrain each other and that upper level behaviors require the lower level behaviors;
  • How psychologist and polymath Donald T. Campbell (1916-1996) coined the term “downward causation” to describe higher system level constraints on lower levels, as in constraints on gene expression by higher level subsystems—a prelude to understanding ‘emergent’ systems as having properties or behaviors that “make a difference”, i.e., have causal properties;
  • How Claude Bernard, Walter Cannon, and Norbert Weiner established the importance of negative feedback for maintaining stability within large systems, leading to subsequent demonstration of negative feedback at the molecular level;
  • How the identification of feed-forward mechanisms led to advances in understanding the features characterizing the design of systems control mechanisms.

    Growth of publications on systems biology

(CC) Image: Anthony.Sebastian
Growth in papers on systems biology.

The pace of research in systems biology greatly accelerated at the beginning of the 21st century. The figure at left shows the exponential growth of publications relating to or discussing systems biology from 1996 through 2007. The data come from the National Library of Medicine's PubMed database, and probably underestimate annual "systems biology" publication rates by not including articles in journals in many non-biological disciplines. (PubMed searched through the bibliographic database manager, Reference Manager, search term, 'systems biology', searched in 'All Fields.)

    Early systems modelers

In 1952, the British neurophysiologists and Nobel laureates Alan Lloyd Hodgkin and Andrew Fielding Huxley constructed a mathematical model of the action potential — the fundamental mechanism underlying communication between nerve cells. In 1960, Denis Noble developed the first computer model of a beating heart.[31]

Computerized mathematical modeling of metabolic networks (Metabolic Control Analysis) began as early as 1960[32]. Metabolic Control Analysis's aim was to quantify the effect of the differing chemical reactions in the network on the concentrations of the network metabolites and on the flow of metabolites through the network, in particular in response to various perturbations (see review by Visser and Heijnen).[33]

Henrik Kacser (1918-1995) is usually credited with publishing the signal paper in Metabolic Control Analysis:

By the end of the 1960s, he [Henrik Kacser] and Jim Burns were working on the theory of how the rates of metabolic pathways were affected by changes in the amounts or activities of pathway enzymes. Their landmark 1973 paper, The control of flux [34] was presented before a sceptical audience of experimental biochemists in Oxford in 1973. In it they show that the expectation that a metabolic pathway will be controlled by a single pacemaker reaction is a fallacy, and most of the experimental criteria used in the supposed identification of such steps are misleading. Instead, varying amounts of control can be distributed over the enzymes of the pathway, but this is a property of the metabolic system as a whole and cannot be predicted from the characteristics of the enzymes in isolation.[35]

By 1957, Kacser had already revealed himself as a systems biologist, having written: “The problem is therefore the investigation of systems, i.e. components related or organised in a specific way. The properties of a system are in fact more than (or different from) the sum of the properties of its components, a fact often overlooked in zealous attempts to demonstrate additivity of certain phenomonena. It is with these systemic properties that we shall be mainly concerned...[36]

    Systems biology as an evolutionary extension of classical integrative physiology

Physiologists and bioengineers Daniel A. Beard and Marko Vendelin,[37] regard the terms 'systems biology' and 'physiology' synonyms, as they argue:

In a nutshell, "systems biology" attempts to realize this [its] promise by measuring and mapping biological interactions within cells, tissues, organs, and organ systems, and predicting how integrated systems made up of many interacting components behave. Readers of the American Journal of Physiology may point out that, by such a definition, "systems biology" is essentially a synonym for "physiology." While we would not argue with that assessment, we suggest that the increasing attention being paid to the endeavor is at least in part due to the injection of a new term, and associated new techniques and technologies, into the well-established field of integrative physiology. It has been argued that this increase in attention places the discipline of physiology in a position where it will either be "superseded...by systems biology" or will enjoy a renaissance as it leads the way in research in this area...

Molecular physiologist and biophysicist Kevin Strange."[38] earlier made the comparison:

Physiology and systems biology share the goal of understanding the integrated function of complex, multicomponent biological systems ranging from interacting proteins that carry out specific tasks to whole organisms.

In writing of systems biology, Strange encourages 21st century physiology departments "to embrace them as essential components" of their field, by 'them' referring specifically to "functional genomics, nonmammalian model organisms and computational biology". He sees a 'critical mass'-type advantage to a diverse group of physiologists and post-genomics-brand systems biologists working as a group.

Marine biologist, John Bothwell argues that:

...systems biology...retreads the conceptual ground covered by post-Darwinian physiology and resembles nothing more than the application of 19th century physiological reasoning to today’s molecular biological data.[39]

He credits systems biologists for their focus on developing mathematical methodologies for the study of complex cellular networks.

Many others have likened physiology and systems biology. Certainly physiology dates to the beginnings of biology as a discipline, and systems biology dates even to Aristotle.[39] The process of homeostasis, of particular interest to systems biologists, has a long history in physiological studies.[40] In the 19th century, the French physiologist, Claude Bernard, who developed the concept of the 'internal milieu', or 'internal environment' (e.g., for maintaining blood composition), performed experiments showing animals maintaining their internal milieu within favorable limits — essentially recognizing the process of homeostasis. The early 20th century physiologist Walter Cannon introduced the term 'homeostasis' and demonstrated the homeostatic role of the autonomic nervous system. The mechanisms of homeostasis remain central in research physiology, as exemplified by many recent publications in the American Journal of Physiology's suite of journals.

Referring to pre-WWII decades, many organ systems physiologists can describe the history of progress in top-down discoveries of organ system components and organization. The vital mammalian organ, the kidney serves as example. In the early 20th century, the English pharmacologist Arthur Cushny proposed that kidneys produced urine by a dual process of ultrafiltration of blood by the glomeruli and selective reabsorption of the filtrate's constituents by the tubules, and accumulated evidence supported that formulation. Continuing, top-down, to explain the behavior of the organ, renal[41] in the 1930s, physiologists developed micropuncture techniques to sample fluid in different segments of the countless 'nephrons' — each a unit of kidney anatomy comprising a glomerular filtration apparatus spilling ultrafiltrate into a variably convoluted tubule, all of which tubules ultimately converge in ducts leading to the urinary bladder. That led to discoveries of transport processes that reabsorb and secrete constituents, and to better understanding of how the kidney produced urine of the composition that it did in varying circumstances. They developed quantitative methods for measuring glomerular filtration rate and kidney blood flow, which enabled tracking quantitatively constituents in the filtrate, including in humans. By the time publications had begun to use the term ‘systems biology’, renal physiologists had mathematically modeled numerous kidney systems behaviors, and applied them to prevention and treatment of disease in humans. They have learned about how the kidney behaves as a whole well enough to develop an artificial kidney that keeps people with death-threatening functionless kidneys alive and able for decades.

Physiologists continue to study the systems biology of organs and organ systems, greatly benefiting from bottom-up explorations of molecular and cell biologists, and biochemists and a host of other disciplines.

Modeling in systems biology

Building a model is like eating an elephant: it’s hard to know where to begin.
         --J. W. Haefner'
[42]




For systems biologists, modeling is the key to unlocking the system of interest, whether a cell, a species, or an ecosystem. Reminding us of the story of the six blind men investigating a different part of an elephant and coming up with six different descriptions of the animal, James Haefner[42] wrote:

One failure of the blind men was to ignore the relations between objects. A seventh man, one sensitive to the importance of testing alternative models, might have said: “Hmmm, ‘tree’, ‘snake’, ‘fan’, ‘spear’, ‘wall’, ‘rope’: It’s a single, big thing with columnar supports and appendages at the ends.” The blind men, especially, need a systems approach, and with respect to the scientific unknown, we are all blind.

To understand a key systems approach, one must know something about model building, or simply, modeling. Models represent (re-present) reality in an abstract form, such as a narrative description (e.g., a theory), a diagrammatic representation (e.g., a graph), a physical representation (e.g., a scale model), a 'formal' representation (a mathematical or quantitative description), and simulation models. Most simulation models entail numerical approximations of sets of mathematical expressions potentially describing the system, and ‘stepping-through-time’ with imposed value changes in the states of the system — typically through computer-based computational processing.[43]

Systems biologists use numerous different diagrammatic and mathematical models as keys to understanding biological systems — their logic, say — as keys to explaining, predicting and controlling their behavior.

Mathematical models of a biological system employ equations. They posit a series of mathematical expressions (equations) to describe the activity of the system, they comprise analysis of the system by mathematical relations without resort to numerical approximation, and may have dynamic properties by describing the activity of the system over time. They can serve these main functions:

  • They allow management of data sets of structures and interactions too large and complex for the human mind to manage without the “exo-cortex” of mathematical formulations, often computer-based for quantitative outputs;
  • They allow an iterative process whereby experimental data about a system inspires the model, and the output of the model reveals the need for further experimental research, the results of the latter inspiring changes in the model, which repeats the cycle as the output of the model approaches the realities of the system;
  • By failing to fully account for the targeted behavior of the system:
  • they raise the possibility of the existence of unknown subsystems of the system that require further experimental work, and may give direction to that further research;
  • they inspire refinements of the model to account for the gaps;
  • They provide an satisfying and usable ‘explanation’ of the system—an explanation of its properties, functions and behaviors in quantitative terms of its coordinated, dynamically interacting, hierarchically arranged components;
  • They enable ‘control’ of the system—the ability to induce a desired behavior or propensity with the appropriate manipulation;
  • They enable ‘prediction’ of the behavior of the system—predicting how it will respond to a given set of circumstances, especially predicting novel behaviors of the system.

Despite the large datasets available for many biological systems, especially cell systems, they still fall short in quantity and quality for realizing the full potential of quantitative modeling in applying advanced methodologies for statistical analyses, testing of hypotheses, and estimating the values of equation constants and independent variables.[44] Wellstead et al.[44] note the “enormous challenges to bio-sensing for systems biology” that lie ahead.

Harvard biomathematician and philosopher of science, Richard Levins, speaks to the value of mathematical modeling:

Mathematics is used mostly in modeling in order to predict the outcomes of systems of equations. But it also has another use: educating the intuition so that the obscure becomes obvious. When we abstract from the reality of interest to create mathematical objects, we do this because some questions which would seem intractable now can be grasped immediately. We can look at the fluctuating abundance of insects and conclude ‘‘since these bugs vary by several orders of magnitude during the year and yet remain within bounds from year to year, there must be some density dependence operating (a negative feedback),’’ or see that in a particular patient insulin seems to increase blood sugar and we have to ask, ‘‘where is there a positive feedback loop at work?’’ This kind of qualitative mathematics is essential so that we are not overwhelmed by the sheer numbers of equations and variables of predictive models. The teaching of mathematics to scientists must include the mathematics that aims at understanding rather than solving equations or projecting numbers. [45]

Haefner has provided a classification of mathematical models based on whether the mathematics explicitly represent (a) the mechanisms of the processes of interest, (b) the future states of the system, (c) time as continuous, (d) spatial aspects of the systems, and (e) the effects of random events. Yes/no answers correspond to mathematical structures yielding (a) mechanistic/descriptive models, (b) dynamic/static models, (c)continuous/discrete models, (d) heterogenous/homogenous models of space, and (e) stochastic (random)/deterministic models. A model might incorporate mathematical structures of any combination of (a) through (e).

    Some examples of familiar models

The examples below facilitate learning about modeling heuristically.

        A road map of an urban complex

(CC) Photo: Pierre-Yves Arnoux

For a given level of detail, a roadmap represents (re-presents, or models) the structure of the system of roads in a region of land at a given point in time, using the language of graphic illustration. In network parlance, cities and other points of interest (e.g., parks, lakes) serve as nodes and the connections between nodes as edges, some of which may indicate one-way connections only. Using the roadmap, one can control the system of roads in the sense that one can exploit the information to get from one place (node) to another, and predict how long it will take to get there.

The level of detail in a roadmap may not allow determination of the grades of the roads (steepness) or the degrees of curviness or the position of side roads or new roads added since the date of the map.

Systems biologists use maps, for example, to model the structure and interrelationships among biochemical molecules in cellular subsystems, such as the subsystems that convert glucose to usable energy and to other biochemical molecules (e.g., glycogen).

        A chemical formula

(CC) Drawing: Anthony Sebastian
Figure 2. Atomic dimensions of a water molecule.

Anyone reading this far knows the formula, H2O, as a model (representation) for the unit molecule of water. As such it has many uses, in particular in modeling chemical reactions. Other models of water, such as HOH, provide additional information for particular purposes. Note that the model does not give any indication of the 'emergent' properties of interacting collections of H2O molecules, such as liquid water, water ice or steam.

        A computer-based flight simulator

For a given level of detail, a computer-based flight simulator represents the multi-subsystem of an airplane, including its control characteristics, and the environment in which the flight vehicle must interact with in order to function stably and exhibit its system behavior of taking off, flying to destination, and landing. The representation (model) uses the languages of engineering, mathematics, computer programs, and dynamical graphics, among others to enable control of the system and to predict its behavior in response to a given set of environmental conditions for comparison with the response to those conditions in real flight—testing the goodness of fit of the model.

Systems biologists use computer-based simulators, for example, to predict the behavior of the human heart in response to drugs.[46]

        Newton’s equations

For macroscopic mechanical systems, Newton’s equations represent, or model, the behavior of bodies of mass in motion, allowing predictions of the trajectories of moving masses, including the masses comprising the solar system; allowing calculation of the strength of the mutual attraction of masses and the contribution of each of two masses to that attraction; enabling explanation of macroscopic properties of gases and liquids (e.g., pressure, temperature) from the average effects of microscopic particles interacting in conformity with Newton’s equations; and, enabling engineers to construct vehicles for transporting humans to the moon and back.

(Erwin Schrodinger's wave equation does for subatomic mechanics what Newton's equations did for macroscopic mechanics, and Albert Einstein's General Relativity theory explained away Newton's action at a distance--as models advance in capability.)

Systems biologists use mathematical expressions, often more complex than Newton’s equations, based on empirical data and theoretical principles, in numerous ways to model the behavior of biological systems at all hierarchical levels.[47] See below.

    Examples of modeling in systems biology

Courtesy of the National Human Genome Research Institute, the National Institutes of Health. Original image at: http://www.genome.gov/25520255


A material structural model — Watson and Crick's 'metal stick' model of DNA (see image at left) — inspired the modern era of molecular biology. Their model of the DNA molecule subsequently spawned alternative representations in numerous other visual and digital media, upon which molecular biologists built the edifice of their science.

For examples of web sites with modeling tools for cellular processes, see:[48]

        Darwin’s theory of evolution by means of natural and sexual selection

Darwin’s theory, as amplified genetically/molecularly in the 20th century, represents, or models, the behavior of nature in creating species and varieties sufficiently adapted to their environment to survive long enough to reproduce and care for their offspring and kin. The theory enables understanding of an enormous range of behaviors of animals, plants, unicellular organisms, and cellular and subcellular systems, and has explanatory and predictive value in every biological discipline, and many non-biological disciplines.

Evolutionary principles permeate the discipline of systems biology and have led to the emerging discipline of “evolutionary system biology”[49] A case in point: Determining whether natural selection operating at the molecular level has forged the structure of molecular networks may enhance understanding of their underlying design principles and thereby facilitate design of better predictive models.[50]

        Bipedal and Quadrupedal Walking and Running

In the human organism, walking and running emerge as system behaviors (no subsystem walks or runs). The energy cost of those behaviors is a property of the system, and arises from the forces the system generates to support itself against gravity and to swing the limbs. The rate at which the system produces those forces correlates with the system’s energy cost of locomotion. Thus, from a mathematical model that predicts force production from readily determined values of variables related to anatomy and motion, one could predict the energy cost. Harvard anthropologist Herman Pontzer[51] developed such a mathematical model — viz., an equation — that justified force production as a function of the rates of muscular force production in the vertical and horizontal directions, and the rate of muscular force production required to swing the limbs. He identified measureable anatomical and motor variables--length and proportion of limbs, speed, frequency of stride, and angle of excursion--that allowed estimation of the force variables. The model well predicted the observed cost of locomotion, somewhat better for running than walking. Subsequently, he tested the model in quadrupeds.[52], confirming its predictive ability in estimating the rate of force production and energy cost of locomotion.

With the development of quadruped and biped robots for human service, Professor Pontzer's model might help make decisions on energy-cost-effective robot locomotor anatomy and dynamics.

        Modeling Noise-Effects on Biochemical Processes and Cell Systems Behavior

Randomness can influence the rate that a gene 'expresses' production of its encoded protein, for example, through random effects on the rate of DNA’s replication as mRNA.[53] Biologists refer to that as "noise" in the gene expression ‘molecular-machine’. A protein repressor of DNA for producing mRNA might have a low number of molecules available for binding to DNA. In that case, the total time of bound repressor-DNA will vary because of the random nature of molecules diffusing in a solution, which will also affect the time-pattern of mRNA production. With fewer repressor molecules, random diffusion can dictate how rapidly repressor rebinds after diffusing off the DNA, and thereby can influence the total time DNA remains unrepressed. Because binding is an interaction between two molecules, the spatial distribution of the low numbers of repressor molecules affected by the randomness of its diffusion can produce fluctuating bursts of gene expression — noise. van Zon and colleagues[53] developed a mathematical model to explain repressor-number-related noise in gene expression based on physical principles and statistical analyses of randomness. Their model predicts burst-expression found experimentally, but does not allow for the more complicated effects of random diffusion. They point out that such noise in gene expression could have significant effects on cellular function. Similarly, Samilov et al.,[54] in their review of the ‘physiology of noise’, point out that “fluctuations in random biomolecular interactions” [noise] can lead to differences in the behavior of otherwise identical cells (clones) that enable the cells' tissue/organ more choices of adaptive response to environmental changes than a purely noise-free system would have. Noise in biological machinery therefore can have positive effects.

Samilov et al.[54] describe other ways to model noise in biological systems. Rao et al.[55] reference many different modeling approaches to explore the control, rejection, elimination and exploitation of noise, and extensively highlight reasons we need to explain the role of noise in biological systems.

        Simulation modeling of an avian influenza pandemic

To consider the effects of an avian influenza outbreak in the U.S., researchers [56]  using a supercomputer and specialized software, simulated the spread of a pandemic influenza viral strain through an artificial U.S. population (281 million people). They generated a model with realistic assumptions of transmissibility values, and considered the effect of variable antiviral and vaccine use, and of different modifications of social mobility (e.g., travel restrictions). They describe the basics of their model:

The three basic elements of our national-level simulation model are (i) a previously developed stochastic agent-based model for disease spread at the community level;[57] (ii) detailed U.S. Census demographics and worker flow data for daily commuter traffic at short distances and Bureau of Transportation Statistics data for less frequent long-range travel behavior; and (iii) high-performance parallel computing expertise in modeling millions to billions of particles on hundreds to thousands of processors.

        Modeling the mitochondrion

Vo and Palsson[58] reviewed the advances systems biology research has made in explaining the integrated workings of the complex cellular subsystem, the mitochondrion—the cell’s transformer of the external matter and energy taken up by the cell into a usable cellular energy-currency:

”With the rapidly increasing number of discovered molecular components [of mitochondria], computational models are also being developed to facilitate the organization and analysis of such data. Computational models of mitochondria have been accomplished with top-down [starting with a theoretical model of the system then tested against the data] and bottom-up [starting with the data and building up to the model] approaches and have been steadily improved in size and scope. Results from top-down methods tend to be more qualitative but are unbiased by prior knowledge about the system. Bottom-up methods often require the incorporation of a large amount of existing data but provide more rigorous and quantitative information, which can be used as hypotheses for subsequent experimental studies.”

To cite one example: Using massive data sets on mitochondrial components and chemical reactions, combined with mathematical assumptions and computer-based mathematical analyse, Vo et al.[59] ‘constructed’ (aka modeled) a network of biochemical pathways that preserved the known interactions among the components. The constructed networked described mitochondrial energy production and other mitochondrial functions closely in accord with experimental results.

        Modeling by Engineering Synthetic Systems

"The goal of the emerging field of Synthetic biology synthetic biology is to produce and assemble biological parts and to create new life forms that will have a positive effect on people or the environment."[60]

Systems biologists use advanced and innovative experimental techniques to construct synthetic versions of a subsystem with natural system elements — a unique modeling methodology. They propose a design blueprint for the synthetic subsystem based on empirical data about the system. With appropriate designs or tags, they can then observe and analyze the behavior of the synthetic system, in effect viewing it in isolation from the larger system embedding it. That potentially leads to insights into ways of manipulating the system for desired ends, including inducing novel behaviors of the system and the larger system embedding it.[61]

As articulated by the biologist-physicist team of David Sprinzak and Michael B. Elowitz,[62] synthesizing cellular subsystems has three main goals:

  1. to enhance understanding of a natural subsystem by comparing functionality with the synthetic system (e.g., a synthetic metabolic oscillatory circuit);
  2. to develop non-natural subsystems that potentially provide unique functionality in vivo (e.g., novel gene construction), possibly of value for biotechnology applications; and,
  3. to develop synthetic subsystems to replace the natural subsystems in the cell as an exploratory tool to see how it operates in the system-as-a-whole.

As the authors write: “. . . perhaps at this stage one can learn more by putting together a simple, if inaccurate, pendulum clock than one can by disassembling the finest Swiss timepiece.

The brief abstract of Drew Endy’s article on the foundations for a synthetic biology succinctly indicate its potential:[63]

Engineered biological systems have been used to manipulate information, construct materials, process chemicals, produce energy, provide food, and help maintain or enhance human health and our environment. Unfortunately, our ability to quickly and reliably engineer biological systems that behave as expected remains quite limited. Foundational technologies that make routine the engineering of biology are needed. Vibrant, open research communities and strategic leadership are necessary to ensure that the development and application of biological technologies remains overwhelmingly constructive.

Synthetic biology has the potential to construct artificial systems that can evolve through natural selection.[64]

The articles cited in this section all describe specific examples of synthetic systems, and descriptions of the state-of-the-science.

        Simulation modeling to find functionality in complex networks'

In this era when high-throughput data acquisition typically precedes elucidation of functionality, sometimes biologists can identify and characterize complex biological networks for which they have no clear evidence what the network actually does. Using simulation modeling under the assumption that biological networks exhibit robustness, Paolo Barbano and co-workers developed “mathematical paradigms and computational tools that make use of high-throughput data to reveal the functional components embedded in complex networks and biochemical pathways.[65] Their methodology simulates the network response to input in the presence of noise to see what features remain robust, suggesting wherein lie the network’s important biological functions. As a target system they used a complex neurotransmitter signaling transduction cascade, trying to determine how to discover the robust features in the network through simulation. Their computational tools incorporated “dimensionality reduction”, in which data in multiple dimensions of mathematical space maps to two or three dimensions, and employs “geometric intuition” to identify subnetworks with potentially interesting robustness. They conclude:

...the entire topology of the network is needed to impart…stability to one portion of the network at the expense of the rest. This could have significant implications for systems biology, in that large, complex pathways may have properties that are not easily replicated with simple modules.[65]

Interrelationships among key analytical methodologies used in systems biology

(PD) Image: Genomics:GTL Roadmap, U.S. Department of Energy Office of Science, August 2005, http://genomicsgtl.energy.gov/roadmap/ http://genomics.energy.gov/gallery/gtl/detail.np/detail-60.html

Emergent properties as ‘materialistic vitalism’

When the whole and the parts are seen at once, as mutually producing and
explaining each other as unity in multeity, there results shapeliness, forma formosa.

        --Samuel Taylor Coleridge , 1817, Biographia Literaria, p.309 [66]





Some cell biologists might find it tempting to see a type of 'vitalism', or 'life force', in living systems, given that some high-level features of organisms, including even living itself, exemplify emergent phenomena — phenomena not explainable after exhaustively studying the properties of each of the chemical processes and subsystems that occur in the cell — studying them, that is, in isolation from the organization of the cell system embedding it. [67] One could not explain, for example, the action of an organism fleeing from a predator from a study of the properties of an organism's component subsystems. The properties of the component parts depend on the organization of those parts in the whole system. [7]. Because biologists can explain emergent properties/phenomena, if only sometimes in principle, by mechanisms that do not transcend interactions of matter and energy, any such ‘vitalism’ qualifies only as a ‘materialistic vitalism’ - it does not involve any supernatural agency.

One example of emergence: When components of signaling pathways, which allow within-cell and between-cell communication, interact to form signaling networks, properties can emerge — such as self-sustaining feedback loops and generation of novel signals — that one cannot explain from the individuated properties of the separate pathways. [68]

For another example, in studying a protein separated from the system it belongs to, one can observe many of its properties, but in so studying the protein one cannot observe any of the properties it has only in the context of the system that embeds it, such as the property of catalyzing a biochemical reaction, or of binding to other proteins to form a functional protein complex. Those properties of the protein emerge in the context of the protein’s environment — how it interacts in the system as a whole. Moreover, those emergent properties may result in effects within the system that, in a feedback way, further alters the properties of the protein in the system, as when a reaction product alters the catalytic properties of the protein.

Every biological subsystem (e.g., a mitochondrion) resides in a larger, more complex system (e.g., a cell) — essentially its environment — whose properties and behaviors have effects on that subsystem. Those effects in turn can change the properties and behaviors of the subsystem's subsystems that would not have existed without the system in its environment — a kind of 'downward causation'.

As Gilbert and Sarkar[7] puts it: “Thus, when we try to explain how the whole system behaves, we have to talk about its parts the context of the whole and cannot get away talking only about the parts.”

Emergent processes have been recognised as, for example, contributing to understanding:

Emergent phenomena appear even in non-biological physical systems. [73]  Emergent phenomena attract the attention of cellular neuroscientists; [74]  and cognitive scientists [75].  At still higher systems levels, emergent properties appear for example in the behaviour of ant colonies and the concept of swarm intelligence, [76]  Artificial systems scientists have simulated emergent phenomena [77]  Emergent phenomena in human societies has also received attention. [78].  Biologists even explain the biosphere itself as emergent. [79]

We can elaborate on the principle that knowing the individuated properties of all the components of a system does not enable us to explain the properties of the system-as-a-whole — the opposite principle of the reductionist paradigm prevailing for centuries in physics and chemistry, and even in biology.[80]   Firstly, the intrinsic properties of a system’s components do not of themselves allow description of the properties of the whole system, any more than a shoebox of Lego pieces disassembled from its erstwhile airplane reveal the finished product. Rather, the 'organizational dynamics' of the components explains the system, and those dynamics include not only the interrelations among the components, but also interactions among the many different organizational units in the system. [81] Secondly, The novel properties, functions and behaviors that emerge in the system-as-whole in turn affect the properties, functions and behavior of the system's components, their 'organizational dynamics' — 'downward causation'. For example, the emergent behavior of running by a land vertebrate alters cardiovascular and respiratory system dynamics and interactions. Thirdly, the living system always operates in some context (its external environment), and that context, in turn, always affects the properties of the system-as-a-whole. For example, nutrient gradients influence the direction of a bacterium’s locomotion. The impact of environmental context affects the organization of the components within the system — another level of 'downward causation'. [82] For another example, environmental signals can activate or suppress a metabolic pathway, reorganizing cellular activity[83] One cannot simply take a living system apart and predict how it will behave.

According to philosopher of science D.M. Walsh: "The constituent parts and processes of a living thing are related to the organism as a whole by a kind of 'reciprocal causation'."[84] In other words, the organization of the components determine the behavior of the system, but that organization arises from more than the set of its internal components. How the whole system behaves as it interacts with its environment determines how those components organize themselves, and so novel properties of the system 'emerge' that characterize neither the environment nor that set of internal components.

For example, the behavior of a human kidney cell depends not only on its cellular physiology, but also on all the properties of the organ (kidney) which constitutes its environment. The kidney's overall structure and function influence the cell’s structure and behavior (e.g., by physical confinement and by cell-to-cell signaling), which in turn influence the organization of its intracellular components. The kidney in turn responds to its environment, namely the organism that it lives in, and that organism responds to its environment, which includes such factors as the availability of particular food items, fresh water, and ambient temperature and humidity.

Systems biologists thus regard emergent properties as arising from from a combination of bottom-up and top-down effects — Walsh's 'reciprocal causation'.

Using the example of termites out of whose combined individual behaviors without outside management emerge complex colony mounds, a recent National Research Council report commented on emergent behavior as follows:[85]

A reasonable way of thinking about emergent behavior might be to focus on the level or scale at which the rules reside. If the rules are specified at a low level, for example, the individual termites, and the patterns and structures, like termite mounds, emerge at a scale where there are no rules specified, we may call this emergent behavior.[85]

Other examples of rule-free emergent behavior for which the 'rules' appear specified at a lower level than the emergent behavior itself include the flocking behavior of birds, and the folding of amino acid polymers into catalytic proteins.

Other basic concepts that systems biologists consider crucial in explaining living systems include 'robustness', 'modularity', and 'networks' — see Life. Quantitative modeling and simulation guided by experimental biological data provide the mainstay methodologies of systems biologists.

Emergent systems always display what we recognize as ‘complexity’, a feature we have a difficult time precisely defining. Complex systems appear to require more bits of information (words, sentences, lines of computer code, etc.) to describe than the bits of information in the system itself. [86]  The operation of the system itself supplies its own most economical model.

According to paleontologist Robert Hazen, four basic complexity elements underpin emergence in a system: [87]

  • a sufficiently large ‘density’ of components, with increasing complexity as the concentration increases, up to a point;
  • sufficient interconnectivity of the components, with increasing complexity with greater and more varied types of interconnectivity, up to a point;
  • a sufficient energy flow through the system to enable the system’s components to perform the work of interacting in the self-organized way characteristic of the energized system;
  • flow of energy through the system in a cyclic manner, presumably facilitating the spatiotemporal patterning characteristic of organized systems.

Systems biology and the perennial question "what is life?"

In viewing living systems as a particular organization of its components — including the organization as influenced by its environment — ultimately systems biology provides an answer, at one level of explanation, to the perennial question, "what is life?" Systems biologists have modified that question, though, to something more like: "What accounts for the activity of living?" However put, neither neither molecular biology nor evolutionary theory seem to provide as satisfactory an explanation.


References

  1. Trewavas A. (2006) A Brief History of Systems Biology. Plant Cell 18:2420-2430].
  2. Kitano H (2002) Systems biology: a brief overview. Science 295(5560):1662-1664.PMID
  3. Property: quality or trait peculiar to a thing (e.g., mass, volume, ability to reproduce, structure, lifespan, etc.; function: activity specially fitted for a thing (e.g., locomotion, phagocytosis, phototropism, functioning as a molecular motor, energy transduction, etc.); behavior: the activity detected by the observer (e.g., deception, flight, chemotaxis, etc.). The distinctions among those often blur, property serving generically in many instances.
  4. 4.0 4.1 Kitano H (2002) Systems biology: a brief overview. Science 295:1662-4 PMID 11872829
  5. 5.0 5.1 Reid RGB (2007) Biological Emergences: Evolution by Natural Experiment. A Bradford Book, Cambridge ISBN 10: 0-262-18257-2
  6. Bruggeman FJ et al. (2002) BioComplexity: a pluralist research strategy is necessary for a mechanistic explanation of the "live" state'. Phil Psychol 15:411-40
    • "The organizational hierarchy in cell biology starts with the properties of individual organic molecules (e.g. amino acids, nucleotides), and goes via oligomers and polymers (e.g. enzymes, structural proteins, DNA, RNA, fats) to cell organelles (e.g. mitochondria, plastids, nuclei) and finally to the whole cell, which then interacts with its environment."
    • "Apart from a hierarchy based on the size and nature of cellular constituents, other useful hierarchies can be formulated. Cellular function can also be divided in functional units that group many processes together. For instance, a broad division in transport, anabolism, catabolism, and maintenance is sometimes useful."
    • "Alternatively, one may distinguish between replication, transcription, translation, and metabolism. The borders of the various levels in the organizational hierarchy are not strictly defined."
    • One might view the different types of hierarchies together as making up the system.
  7. 7.0 7.1 7.2 7.3 Gilbert SF, Sarkar S (2000) Embracing complexity: organicism for the 21st century. Dev Dyn 219:1-9 PMID 10974666
    • 'Reductionism: “…imagine a materialistic philosophy that claims that all complex entities (including proteins, cells, organisms, ecosystems) can be completely explained by the properties of their component parts. Such an epistemological position is called reductionism, and it is the basis for most of physics and chemistry, and much of biology…. In the reductionist epistemology of science, chemistry and biology are not ultimately independent disciplines, because they will eventually have all their explanations “reduced” to physics. The reductionist epistemology and methodology is strictly analytical.”
    • Holism: ”Let us imagine, though, another (ontologically) materialistic philosophy. Here, complex wholes are inherently greater than the sum of their parts in the sense that the properties of each part are dependent upon the context of the part within the whole in which they operate. Thus, when we try to explain how the whole system behaves, we have to talk about the context of the whole and cannot get away talking only about the parts. This philosophical stance is variously called wholism, holism, or organicism.”
  8. Nobel D. (2006) The Music of Life: Biology Beyond the Genome. Oxford University Press, New York. ISBN 978-0-19-929573-9 Brief Biography Multiple Chapter Excerpts Online
  9. Weng G et al.(1999) Complexity in biological signaling systems. Science 284:92-6 PMID 10102825
  10. Keller EF (2005) The century beyond the gene. J Biosci 30:3-10 PMID 15824435
  11. Endy D (2005) Foundations for engineering biology. Nature 438:449-53 PMID 16306983
    • Review of synthetic biology: “…for biologists, the ability to design and construct synthetic biological systems provides a direct and compelling method for testing our current understanding of natural biological systems.
  12. Westerhoff HV, Kell DB. (2007) "The methodologies of systems biology." In: Boogerd FC et al. (eds) Systems Biology: Philosophical Foundations. Elsevier ISBN 0444520856
  13. Bruggeman FJ, Westerhoff HV (2006) The nature of systems biology. PMID 17113776
  14. Burrage K et al. (2006) Advanced computing for systems biology. Briefings in Bioinformatics 7:390-8
  15. 15.0 15.1 Westerhoff HV, Palsson BO (2004) The evolution of molecular biology into systems biology. Nature Biotechnol 22:1249-52
  16. Bruggeman FJ, Westerhoff HV (2007) The nature of systems biology. Trends Microbiol 15:45-50 PMID 17113776
    • Outstanding introduction to systems biology — driving forces, challenges, future.
  17. Barabasi AL, Oltvai ZN (2004) Network biology: understanding the cell's functional organization. Nat Rev Genet 5:101-3
  18. Miller JH, Page SE. (2007) Complex Adaptive Systems: An Introduction to Computational Models of Social Life. Princeton University Press. ISBN 978-0-691-12702-6
  19. 19.0 19.1 Barabási AL (2002) Linked: The New Science of Networks. Cambridge, Mass: Perseus Pub. ISBN 0-7382-0667-9
  20. Watts DJ (2007) A twenty-first century science. Nature 445:489
  21. Alon U (2003) Biological networks: the tinkerer as an engineer. Science 301:1866-7 PMID 14512615
  22. See definition
  23. 23.0 23.1 Alon U (2007) Simplicity in biology. Nature 446:497
  24. Prill RJ et al.(2004) Dynamic properties of network motifs contribute to biological network organization. PLoS Biol 3: e343
  25. Sporns O, Kotter R (2004) Motifs in brain networks. PLoS Biol 2: e369
  26. Alon U (2007) An Introduction to Systems Biology: Design Principles of Biological Circuits. Boca Raton: Chapman and Hall/CRC
  27. Bostock, J and Riley HT (translators). (1855) Natural History of Pliny. Volume: 2. H.G. Bohn, London. Page 121
  28. Westerhoff HV, Alberghina L (2005) "Systems Biology: Did we know it all along?", in Topics in Current Genetics Vol. 13: Systems Biology, ed. Alberghina L, Westerhoff HV, pp.3-9. Berlin: Springer-Verlag. ISBN 978-3-540-22968-1
  29. Trewavas AJ (2006), A Brief History of Systems Biology: "Every object that biology studies is a system of systems." Francois Jacob (1974) Plant Cell 18:2420-30 PMID 17088606
  30. Aristotle On Causality.The Stanford Encyclopedia of Philosophy
  31. Denis Noble
  32. Chance B et al. (1960) Metabolic control mechanisms. 5. A solution for the equations representing interaction between glycolysis and respiration in ascites tumor cells. J Biol Chem 235:2426–39
  33. Visser D, Heijnen JJ (2002) The mathematics of metabolic control analysis revisited. Metabolic Engineering 4:114-23 PMID 12009791
  34. Kacser H, Burns JA (1973) The control of flux. Symp Soc Exp Biol 27:65-104. Updated: Kacser H et al. (1995) The control of flux. Biochem Soc Trans 23:341-66 PMID 7672373
  35. Fell DA (1996) Dr Henrik Kacser (1918-1995)
  36. Henrik Kacser (1918–1995): an Annotated Bibliography
  37. Beard DA, Vendelin M (2006) Systems biology of the mitochondrion. Am J Physiol 291:C1101-3. PMID 17102034
  38. Strange K (2005) The end of "naive reductionism": rise of systems biology or renaissance of physiology? Am J Physiol 288:C968-74 PMID 15840560.
  39. 39.0 39.1 Bothwell JHF (2006) The long past of systems biology. New Phytologist 170:6-10.
  40. Editorial (1935) Homeostasis. The Lancet 225:445-6.
  41. Note: "renal" means relating to the kidney.
  42. 42.0 42.1 Haefner JW (2005) Modeling Biological Systems: Principles and Applications. Springer, New York. ISBN 978-0-387-25011-5
    • From the publisher's description: "This is the second edition of a textbook currently published by Springer for a course in mathematical modeling and computer simulation for biologists at the advanced undergraduate and introductory graduate level. The audience for this edition is similar to that of the previous one: advanced level courses in computational biology, as well as researchers retooling themselves. This new edition includes a CD-ROM with real examples of models as teaching tools. Written for: Undergraduate and graduate students in the biological and environmental disciplines, cell biologists, ecologists, physiologists, conservation biologists, biological engineers, environmental engineers
  43. Morowitz HJ (2002, 2004) The Emergence of Everything: How the World Became Complex. Oxford University Press, New York ISBN 0-19-513513-X Full-Text Available Online at Questia with Subscription
    Note from Text: “There are those, myself included, who believe that high-speed computation is to biology and the social sciences what calculus was to physics. Computer science is the mathematically based or formal tool that seems to map best onto the structure of the questions asked by many modern natural sciences, and moves into the domain of the social sciences.”
  44. 44.0 44.1 Wellstead P et al. (2006) Feedback Medicine: Control Systems Concepts in Personalised, Predictive Medicine and Combinatorial Intervention.
  45. Levins R (2006) Strategies of abstraction. Biol Philos 21:741–55
  46. Noble D (2006) “Multilevel Modeling in Systems Biology: From Cells to Whole Organs”. In Szallasi Z et al. (editors) (2006) System Modeling in Cell Biology From Concepts to Nuts and Bolts. A Bradford Book, MIT Press, Cambridge, MA ISBN 0262195488 Chapter 14, pp 297-312
  47. Szallasi Z, Stelling J, Periwal V (eds) (2006) System Modeling in Cell Biology From Concepts to Nuts and Bolts. A Bradford Book, MIT Press, Cambridge, MA ISBN 0262195488
  48. ST (Signal Transduction) NetWatch: Modeling Tools
    • ” Web sites with tools for modeling and simulating cellular processes”
  49. Medina M (2005) Genomes, phylogeny, and evolutionary systems biology. PNAS 102:6630-5 PMID 15851668
  50. Wagner A (2003)Does Selection Mold Molecular Networks? Sci.STKE 2003:e41 PMID 14519859
  51. Pontzer H (2005) A new model predicting locomotor cost from limb length via force production. J Exp Biol 208:1513-24
  52. Pontzer H (2007) Predicting the energy cost of terrestrial locomotion: a test of the LiMb model in humans and quadrupeds. J Exp Biol 210:484-94 PMID 17234618
  53. 53.0 53.1 van Zon JS et al. (2006) Diffusion of transcription factors can drastically enhance the noise in gene expression. Biophys J 91: 4350-67
  54. 54.0 54.1 Samoilov MS et al.(2006) From fluctuations to phenotypes: the physiology of noise. Sci.STKE 2006:re17
  55. Rao CV et al. (2002) Control, exploitation and tolerance of intracellular noise. Nature 420:231-7
  56. Germann TC et al.(2006) Mitigation strategies for pandemic influenza in the USA. PNAS 103:5935-40 [PMID 16585506]
  57. Note: To give the reader a sense of complexity of the computational technique, we quote the authors:
    • To implement this computationally demanding model, we use the high-performance parallel molecular dynamics code “Scalable Parallel Short-range Molecular dynamics” (SPaSM) (8), written in C with message passing interface (MPI) communication. In recent years, this code has been used to model liquid- and solid-phase systems containing millions to billions (9) of atoms, yielding insights into such varied physical processes as dislocation dynamics (10), shock wave-induced plasticity (11), phase transformations (12) in metals, and fluid instabilities (13). The present epidemiological model is readily implemented in SPaSM (and presumably in similar particle-based codes) by replacing the C data structure for atoms (consisting of properties such as particle type, position, velocity, …) with one for persons (age, contact groups, immune system status, …), interatomic force field interactions with a social network and disease transmission model, and atomic classical mechanical trajectories with individual mobility rules (from residence to workplace on a regular basis and occasional long-range travel).
  58. Vo TD, Palsson BO (2007) Building the power house: recent advances in mitochondrial studies through proteomics and systems biology. Am J Physiol 292:C164-77 PMID 16885397
  59. Vo TD et al. (2004) Reconstruction and functional Characterization of the human mitochondrial metabolic network based on proteomic and biochemical data. J Biol Chem 279:39532-40 PMID 15205464
  60. Elisabeth Pain (2008) A Multidisciplinary Approach to Life. Science Career Magazine October 17, 2008
    • See also:
  61. Hasty J et al. (2002) Engineered gene circuits. Nature 420:224-30
  62. Sprinzak D, Elowitz MB (2005) Reconstruction of genetic circuits. Nature 10.1038/nature04335 438:443-448 [PMID 16306982
  63. Endy D (2005) Foundations for engineering biology. Nature 438:449-53 PMID 16306983
    See also: Synthetic Biology
  64. Sismour AM, Benner SA (2005) Synthetic biology Expert Opinion on Biological Therapy 5:1409-14
  65. 65.0 65.1 Barbano PE et al. (2007) A mathematical tool for exploring the dynamics of biological networks PNAS U.S.A PMID 18032599
  66. Coleridge ST. (1817) --Samuel Taylor Coleridge , 1817, Biographia Literaria; Or Biographical Sketches Of My Literary Life And Opinions. Vol. II, London: Rest Fenner, 23, Paternoster Row. Page 309.
    • Coleridge directed his words to explain the emergence of a beautiful thing, not specifically a living thing, beauty incarnate.
  67. Berg EL et al. (2005) Biological complexity and drug discovery: a practical systems biology approach. Syst Biol 152:201-6 PMID 16986261
  68. Bhalla US, Iyengar R (1999) Emergent properties of networks of biological signaling pathways. 381-387 PMID 9888852 Link-1 Link-2
  69. Tabony J (2006) Microtubules viewed as molecular ant colonies. Biol Cell 98:603-17 PMID 16968217
  70. e.g. Theise ND, d'Inverno M (2004) Understanding cell lineages as complex adaptive systems. Blood Cells Mol Dis 32:17-20 PMID 14757407 and Ruiz i Altaba A et al. (2003) The emergent design of the neural tube: prepattern, SHH morphogen and GLI code. Curr Opin Genet Dev 13:513-21 PMID 14550418
  71. Jeong H et al.(2000) The large scale organisation of metabolic networks. Nature 407:651-4
  72. e.g. Grindrod P, Kibble M (2004) Review of uses of network and graph theory concepts within proteomics. Expert Rev Proteomics 1:229-38 PMID 15966817 and Ye X et al.(2005) Multi-scale methodology: a key to deciphering systems biology. Front Biosci 10:961-5 PMID 15569634
  73. Cho YS et al. (2005) Self-organization of bidisperse colloids in water droplets. J Am Chem Soc 127:15968-75 PMID 16277541
  74. see e.g. Burak Y, Fiete I (2006) Do we understand the emergent dynamics of grid cell activity? J Neurosci 26:9352-4 PMID 16977716
  75. e.g. Courtney SM (2004) Attention and cognitive control as emergent properties of information representation in working memory. Cogn Affect Behav Neurosci 4:501-16 PMID 15849893
  76. Theraulaz G et al. (2002) Spatial patterns in ant colonies. PNAS 99:9645-9 PMID 12114538
  77. Theraulaz G, Bonabeau E (1999)A brief history of stigmergy. Artif Life 5:97-116 PMID 10633572
  78. Bonabeau E, Meyer C (2001) Swarm intelligence. A whole new way to think about business. Harv Bus Rev 79:106-14 PMID 11345907
  79. Field CB et al.(1998) Primary Production of the Biosphere: Integrating Terrestrial and Oceanic Components. Science 281:237-40
  80. Sarkar S (1998) Genetics and reductionism. Cambridge University Press, Cambridge. ISBN 0521631467
  81. Note: For example, physical chemists cannot predict the properties of water from knowledge of its components, hydrogen and oxygen. The way hydrogen and water interact to form H2O, and the way H2O molecules interact, enables the properties of water to 'emerge'.
  82. Note: Following up on the example of water, the properties of its environment (e.g., temperature, pressure) affect the way the H2O molecules organize themselves, as ice, or liquid, or steam
  83. Note: In relation to downward causation, the environment’s effect can sometimes reach down to the genetic recipe with molecular signals, altering the recipe’s expression and consequently the characteristics of the cells — so-called 'epigenetic' effects. When epigenetic alterations of gene expression occur in the reproductive organs, the system changes can be transmitted to the next generation. See
    • Jablonka E, Lamb MJ (2005) Evolution in Four Dimensions: Genetic, Epigenetic, Behavioral, and Symbolic Variation in the History of Life. Cambridge: MIT Press
    • Gorelick R (2004) Neo-Lamarckian medicine. Med Hypotheses 62:299-303 PMID 14962644
  84. Walsh DM (2006) Organisms as natural purposes: the contemporary evolutionary perspective. Stud Hist Philos Biol Biomed Sci 37: 771-91
  85. 85.0 85.1 Committee on Defining and Advancing the Conceptual Basis of Biological Sciences in the 21st Century, National Research Council. (2008) The Role of Theory in Advancing 21st Century Biology: Catalyzing Transformative Research. Board on Life Sciences, Division on Earth and Life Studies, National Research Council of the National Academies. The National Academies Press, Washington, D.C. ISBN 978-0-309-11249-9.
  86. (1991) Zurek WJ (ed) Complexity, Entropy, and the Physics of Information: The Proceedings of the Workshop on the Complexity, Entropy, and the Physics of Information May-June, 1989, Santa Fe, New Mexico. Addison-Wesley Publishing Company, The Advanced Book Program, Redwood City. ISBN 0201515091
  87. Hazen RM (2005) Genesis: The Scientific Quest for Life's Origin. Joseph Henry Press, Washington DC. ISBN 0309094321

NB: Some links to online full-text sources may require individual subscription to the online source, or access through an institutional subscription. Often the linked page contains at least a summary or abstract of the source if not the full-text.