Claude Shannon: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>Pat Palmer
No edit summary
mNo edit summary
 
(123 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{subpages}}
{{subpages}}


Claude Shannon was a theoretical  mathematician and electrical engineer who is considered by many to be one of the founding fathers of the computing age, beginning with his influential M.I.T. master's thesis of 1938, then a span of productive years in research at Bell Laboratories, followed by a return to M.I.T. as a professor.  In the 1940's during World War II, Shannon's research was funded additionally by the U. S. govenment to work on cryptography issues, culminating in a seminal paper, published in 1948, which arguably established a new area of study in engineering called [[information theory]].  Information theory was devoted to messages and signals using techniques drawn from the mathematical science of probability; it linked discrete and continuous math branches in ways that turned out to be highly useful later on in multiple areas of science.
{{Image|Pa cshannon 1 eugene daub.jpg|right|275px|Life-sized bust of Claude Shannon by sculptor [[Eugene Daub (sculptor)|Eugene Daub]].  At least six versions of this statue are on display at various institutions in the USA.  Eugene Daub described Claude Shannon as "the most famous person most people have never heard of" and admitted that he was quite fond of this particular work.}}


In addition the solid recognition among Shannon's contemporary colleagues, Shannon grew into a figure of some public and popular acclaim by the time of his retirement.  An enormous amount of material exists about him on the web, and also in the ''deep'' web (i.e., online resources which must be paid for).  The material overwhelmingly praises Shannon's influence, not just on communications and computers, but also on thinking about biological processes and linguistics.  This article will not attempt to create yet another biography of Claude Shannon, but it will provide pointers to multiple existing biographies which already describe his life in great detail.  This article will try to outline his seminal accomplishments and provide pointers to additional reading on each topic.
{{TOC|left}}


== Shannon's publications ==
'''Claude Shannon''' (1916-2001) was a theoretical mathematician and electrical engineer who is regarded as "the father of information theory".  In a creative burst beginning in 1938 and lasting for at least a dozen years, Shannon published a half dozen seminal papers that created a revolution in mathematics, communications, computer engineering, cryptography, and information science.  Shannon's effect on the world arguably can be considered to be at least as great as that of [[Albert Einstein|Einstein]], who is so much more widely known.  During his career, Shannon studied at [[Massachusetts_Institute_of_Technology|M.I.T.]], worked for a time at [[Bell Laboratories]], and later returned to M.I.T. as a professor.


Below is a list of some of Shannon's publications (in order of appearance):
Recognized as a premier voice in the engineering community from the 1940's onward, Shannon had become a figure of some public and popular acclaim by the time of his retirementAn enormous number of resources exist about him on the webIn his twilight years, Shannon suffered from [[Alzheimer's disease]].
# '''A symbolic analysis of relay and switching circuits'''<ref name="mastersthesis">{{cite web|url=http://dspace.mit.edu/handle/1721.1/11173|title="A symbolic analysis of relay and switching circuits" by Claude Elwood Shannon|
publisher=[[Massachusetts Institute of Technology]], Dept. of Electrical Engineering|year=1940|accessdate=2008-05-05}}
</ref>, Thesis (M.S.), Massachusetts Insitute of Technology, Dept. of Electrical Engineering, 1937 (graduation finalized in 1940).
# '''A Mathematical Theory of Cryptography''', Memorandum MM 45-110-02, 1 Sept. 1945, Bell Laboratories. Classified at the time of its publication; now available through the British Library.
# '''A Mathematical Theory of Communication''', Bell System Technical Journal, published in two parts: July, vol. 27, pp. 379-423, and Oct., vol. 28, pp. 623-656, 1948.
## This paper introduced what was later called the [[Shannon sampling theorem]], which described the required frequency needed to sample an analog signal before digitizing it, so that the receiver could perfectly reconstruct the analog signal at the other end of a transmission channel.
## This paper had important implications about the maximum amount of information that could be shoved into a given amount of spectrum before being overwhelmed by [[noise]], a fundamental limit that became known as [[Shannon's Law]].
# '''Communication Theory of Secrecy Systems,''' Bell System Technical J., vol. 28, pp. 656-715, 1949.
# '''Communication In The Presence Of Noise''', Proceedings of the Institute of Radio Engineers (IRE), vol. 37, pp. 10–21, Jan. 1949.   
## This paper extends and elaborates on ''A Mathematical Theory of Communication''
## Reprinted in Proceedings of the IEEE, vol. 72, Issue 9, pp, 1192-1201, Sept. 1984.
## Reprinted in Proceedings of the IEEE, vol. 86, Issue 2, pp. 447-457, Feb. 1998.
# '''Probability of error for optimal codes in a Gaussian channel''',  Bell Systems Technical Journal, vol. 38, pp. 611–656, 1959.


== Notes ==
== Switching algebra ==
<references />
 
Shannon made a critical step enabling hardware design of a computer in his 1938 MIT master's thesis, "A symbolic analysis of relay and switching circuits"<ref name=SymbolicAnalysis />, in which he associated [[boolean algebra]], a kind of mathematical system that had been known for centuries, with the design of logic gates in digital hardware.  Shannon called boolean algebra "switching algebra" in the context of digital hardware design.
 
== Information Theory ==
 
The field of [[information theory]] was launched in 1948 by Shannon's ground-breaking, two-part paper "A Mathematical Theory of Communication"<ref name=TheoryCommunication />.
It was shortly followed by a [http://www.press.uillinois.edu/books/catalog/67qhn3ym9780252725463.html book of the same name ] (ISBN 978-0-252-09803-1) which has since been reprinted many times. Information theory is devoted to messages and signals using techniques drawn from mathematical [[probability]], and linking discrete and continuous mathematics in ways that later turned out to be helpful, not just in the fields of communications and computers, but also on thinking about biological processes and linguistics. He was also a pioneer in developing methods for computers to play chess.
 
== Cryptography ==
 
During World War II, Shannon performed classified research for the U. S. government on [[cryptography]]. His "Communication Theory of Secrecy Systems" (1949)<ref name=TheorySecrecy /> became the seminal paper for cryptography as an academic discipline, and was later joined by his work on cryptography "A Mathematical Theory of Cryptography" (1945)<ref name=TheoryCryptography />, which had been classified during the war.
 
== Publications ==
 
This list is not at all complete, but it includes Shannon's most of his early and highly influential works.  Papers are shown in order of appearance:
* <big>"A symbolic analysis of relay and switching circuits" (1938)</big> - master's thesis in [[Electrical engineering|EE]] at [[Massachusetts Institute of Technology|MIT]]<ref name=SymbolicAnalysis />
**''This linked [[Boolean algebra]] to the design of digital circuits (and called it "Switching Algebra")''
* <big>"A Mathematical Theory of Cryptography" (1945)</big> - Bell Laboratories Memorandum MM 45-110-02. Classified at the time of its publication<ref name=TheoryCryptography />.
* <big>"A mathematical theory of communication" (1948)</big> - published in two parts in [[Bell System Technical Journal]]: July, vol. 27, pp. 379-423, and Oct., vol. 28, pp. 623-656.<ref name=TheoryCommunication />
** ''This paper coined the use of the word "bit" and had important implications about the maximum amount of information that could be shoved into a given amount of spectrum before being overwhelmed by [[noise]], a fundamental limit that became known as [[Shannon's Law]].  It would be 45 years before the scientific world was able to verify all the predictions in this paper.''
* <big>"Communication Theory of Secrecy Systems (1949)</big>, Bell System Technical Journal, vol. 28, pp. 656-715, 1949<ref name=TheorySecrecy />.
* <big>"Communication In The Presence Of Noise (1949)</big>, Proceedings of the Institute of Radio Engineers (IRE), vol. 37, pp. 10–21, Jan. 1949<ref name=PresenceNoise />. 
** ''This paper extends and elaborates on "A Mathematical Theory of Communication".  It was reprinted in Proceedings of the IEEE in 1984 and again in 1998.''
* <big>"Probability of error for optimal codes in a Gaussian channel" (1959)</big> originally in  Bell Systems Technical Journal, vol. 38, pp. 611–656, 1959<ref name=ProbGaussian />.
 
== Other statue instances ==
An instance of [[Eugene Daub (sculptor)|Eugene Daub]]'s life-sized sculture of Shannon stands at the entrance to Bell Laboratories (subsequently part of Alcatel-Lucent) in Murray Hill, NJ.  Visitors regularly photograph it, often with themselves standing beside it. 
{{#widget:Tweet
|id=291333261907611648
|align=right
|width=300px
}}
 
==References==
<references>
 
<ref name=SymbolicAnalysis>
[https://doi.org/10.1109/T-AIEE.1938.5057767 A symbolic analysis of relay and switching circuits], downloadable at [https://dspace.mit.edu/handle/1721.1/11173;jsessionid=1749D77E60D489A8D9B511EE79B1DDDE MIT]; DOI 10.1109/T-AIEE.1938.5057767
</ref>
 
<ref name=TheorySecrecy>
[https://doi.org/10.1002/j.1538-7305.1949.tb00928.x Communication theory of secrecy systems], downloadable at [https://typeset.io/papers/communication-theory-of-secrecy-systems-2y1h3cz20a typeset.io]; DOI j.1538-7305.1949.tb00928.x
</ref>
 
<ref name=TheoryCryptography>
Shannon, C.E. (1945) A Mathematical Theory of Cryptography. Bell System Technical Memo MM 45-110-02, September 1, downloadable at [https://evervault.com/papers/shannon.pdf Evervault].
</ref>
 
<ref name=TheoryCommunication>
[https://doi.org/10.1002/j.1538-7305.1948.tb01338.x A mathematical theory of communication], downloadable at [https://onlinelibrary.wiley.com/doi/10.1002/j.1538-7305.1948.tb01338.x Wiley]; DOI 10.1002/j.1538-7305.1948.tb01338.x
</ref>
 
<ref name=PresenceNoise>
[https://dx.doi.org/10.1109/JRPROC.1949.232969 Communication In The Presence Of Noise], downloadable at [https://fab.cba.mit.edu/classes/S62.12/docs/Shannon_noise.pdf MIT]; DOI 10.1109/JRPROC.1949.232969
</ref>
 
<ref name=ProbGaussian>
[https://doi.org/10.1002/j.1538-7305.1959.tb03905.x Probability of error for optimal codes in a Gaussian channel], downloadable at [https://onlinelibrary.wiley.com/doi/abs/10.1002/j.1538-7305.1959.tb03905.x Wiley]; DOI j.1538-7305.1959.tb03905.x
</ref>
 
</references>[[Category:Suggestion Bot Tag]]

Latest revision as of 11:01, 29 July 2024

This article is a stub and thus not approved.
Main Article
Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
 
This editable Main Article is under development and subject to a disclaimer.
Life-sized bust of Claude Shannon by sculptor Eugene Daub. At least six versions of this statue are on display at various institutions in the USA. Eugene Daub described Claude Shannon as "the most famous person most people have never heard of" and admitted that he was quite fond of this particular work.

Claude Shannon (1916-2001) was a theoretical mathematician and electrical engineer who is regarded as "the father of information theory". In a creative burst beginning in 1938 and lasting for at least a dozen years, Shannon published a half dozen seminal papers that created a revolution in mathematics, communications, computer engineering, cryptography, and information science. Shannon's effect on the world arguably can be considered to be at least as great as that of Einstein, who is so much more widely known. During his career, Shannon studied at M.I.T., worked for a time at Bell Laboratories, and later returned to M.I.T. as a professor.

Recognized as a premier voice in the engineering community from the 1940's onward, Shannon had become a figure of some public and popular acclaim by the time of his retirement. An enormous number of resources exist about him on the web. In his twilight years, Shannon suffered from Alzheimer's disease.

Switching algebra

Shannon made a critical step enabling hardware design of a computer in his 1938 MIT master's thesis, "A symbolic analysis of relay and switching circuits"[1], in which he associated boolean algebra, a kind of mathematical system that had been known for centuries, with the design of logic gates in digital hardware. Shannon called boolean algebra "switching algebra" in the context of digital hardware design.

Information Theory

The field of information theory was launched in 1948 by Shannon's ground-breaking, two-part paper "A Mathematical Theory of Communication"[2]. It was shortly followed by a book of the same name (ISBN 978-0-252-09803-1) which has since been reprinted many times. Information theory is devoted to messages and signals using techniques drawn from mathematical probability, and linking discrete and continuous mathematics in ways that later turned out to be helpful, not just in the fields of communications and computers, but also on thinking about biological processes and linguistics. He was also a pioneer in developing methods for computers to play chess.

Cryptography

During World War II, Shannon performed classified research for the U. S. government on cryptography. His "Communication Theory of Secrecy Systems" (1949)[3] became the seminal paper for cryptography as an academic discipline, and was later joined by his work on cryptography "A Mathematical Theory of Cryptography" (1945)[4], which had been classified during the war.

Publications

This list is not at all complete, but it includes Shannon's most of his early and highly influential works. Papers are shown in order of appearance:

  • "A symbolic analysis of relay and switching circuits" (1938) - master's thesis in EE at MIT[1]
    • This linked Boolean algebra to the design of digital circuits (and called it "Switching Algebra")
  • "A Mathematical Theory of Cryptography" (1945) - Bell Laboratories Memorandum MM 45-110-02. Classified at the time of its publication[4].
  • "A mathematical theory of communication" (1948) - published in two parts in Bell System Technical Journal: July, vol. 27, pp. 379-423, and Oct., vol. 28, pp. 623-656.[2]
    • This paper coined the use of the word "bit" and had important implications about the maximum amount of information that could be shoved into a given amount of spectrum before being overwhelmed by noise, a fundamental limit that became known as Shannon's Law. It would be 45 years before the scientific world was able to verify all the predictions in this paper.
  • "Communication Theory of Secrecy Systems (1949), Bell System Technical Journal, vol. 28, pp. 656-715, 1949[3].
  • "Communication In The Presence Of Noise (1949), Proceedings of the Institute of Radio Engineers (IRE), vol. 37, pp. 10–21, Jan. 1949[5].
    • This paper extends and elaborates on "A Mathematical Theory of Communication". It was reprinted in Proceedings of the IEEE in 1984 and again in 1998.
  • "Probability of error for optimal codes in a Gaussian channel" (1959) originally in Bell Systems Technical Journal, vol. 38, pp. 611–656, 1959[6].

Other statue instances

An instance of Eugene Daub's life-sized sculture of Shannon stands at the entrance to Bell Laboratories (subsequently part of Alcatel-Lucent) in Murray Hill, NJ. Visitors regularly photograph it, often with themselves standing beside it.

References

  1. 1.0 1.1 A symbolic analysis of relay and switching circuits, downloadable at MIT; DOI 10.1109/T-AIEE.1938.5057767
  2. 2.0 2.1 A mathematical theory of communication, downloadable at Wiley; DOI 10.1002/j.1538-7305.1948.tb01338.x
  3. 3.0 3.1 Communication theory of secrecy systems, downloadable at typeset.io; DOI j.1538-7305.1949.tb00928.x
  4. 4.0 4.1 Shannon, C.E. (1945) A Mathematical Theory of Cryptography. Bell System Technical Memo MM 45-110-02, September 1, downloadable at Evervault.
  5. Communication In The Presence Of Noise, downloadable at MIT; DOI 10.1109/JRPROC.1949.232969
  6. Probability of error for optimal codes in a Gaussian channel, downloadable at Wiley; DOI j.1538-7305.1959.tb03905.x