4) Theory of information [DEL: Theory of information :DEL] [INS: Information theory :INS] [DEL: can be understood as :DEL] [INS: is :INS] a scientific discipline which [DEL: is :DEL] deal[INS: s :INS] with [DEL: „information“ and specifically with :DEL] [INS: the :INS] formation, movement, transfer and processing of information. The main way [DEL: how :DEL] [INS: in which :INS] information[DEL: s are :DEL] [INS: is :INS] transmitted is communication[INS: , :INS] [DEL: so :DEL] [INS: therefore information :INS] theory[DEL: of information :DEL] [DEL: deal with :DEL] [INS: draws upon :INS] [INS: the :INS] mat[INS: h :INS] emathical theory [DEL: os :DEL] [INS: of :INS] communication, but also [DEL: with mathematical theory of :DEL] [INS: upon :INS] probability and statistics[INS: . :INS] [DEL: o rit could be studied as essential component of :DEL] [INS: Another approach treats information theory as a field of :INS] [DEL: Cybernetics :DEL] [INS: cybernetics :INS] . [DEL: One of :DEL] [INS: A :INS] key term [DEL: for :DEL] [INS: in information :INS] theory[DEL: of information :DEL] is entropy. Entropy can be understood as [DEL: extent :DEL] [INS: a measure :INS] of [INS: the :INS] uncertainty of [DEL: the :DEL] [INS: a :INS] system or [DEL: the :DEL] scheme. When [DEL: the :DEL] entropy is high[INS: , :INS] systems are less organized and conversely highly probable[DEL: , :DEL] [INS: ; :INS] when [DEL: the :DEL] entropy is low[INS: , :INS] system[INS: s :INS] are orderly and unlikely. We can [DEL: say :DEL] [INS: observe :INS] that [DEL: in growth of information entropy fall and conversly :DEL] [INS: the relation between information and entropy is one of inverse proportion :INS] [INS: : :INS] [DEL: . :DEL] [DEL: During removal uncertainty we obtain information :DEL] [INS: as uncertainty falls, the volume of information rises :INS] . [DEL: Just i :DEL] [INS: I :INS] nformation entropy, often called [DEL: like :DEL] Shannon[DEL: ’s :DEL] entropy, [DEL: very :DEL] [INS: is :INS] closely relate[INS: d :INS] [DEL: with :DEL] [INS: to :INS] thermodynamic entropy. [DEL: Origin of t :DEL] [INS: T :INS] his scientific discipline [DEL: is attributed at first to :DEL] [INS: has its origins in the work of the :INS] mathematician Claude Shannon[INS: , :INS] who first [DEL: prepared :DEL] [INS: presented information theory :INS] [DEL: ideas :DEL] [INS: concepts :INS] [DEL: dealing with theory of information :DEL] in his work A Mathematical Theory of Communication. [DEL: We o :DEL] [INS: O :INS] f course [INS: we :INS] can[DEL: :DEL] not [INS: dis :INS] miss [INS: the contributions of :INS] other scientists[INS: , such :INS] as Harry Nyquist and Ralph Hartley. [DEL: One of inspirer of :DEL] [INS: A key influence on :INS] Claude Shannon [DEL: i salso well known :DEL] [INS: wa :INS] [INS: s the equally celebrated :INS] Alan Turing[INS: , :INS] who is most[DEL: e :DEL] ly known [DEL: because of :DEL] [INS: for :INS] his calculating machine and [DEL: his :DEL] Turing[DEL: ’s :DEL] test. This test [DEL: should show :DEL] [INS: is intended to demonstrate :INS] whether [DEL: is :DEL] [INS: a :INS] computer [INS: is capable of :INS] intelligent [INS: behaviour comparable to that of a human :INS] [DEL: or not :DEL] (this test was [DEL: first time :DEL] passed [INS: for the first time :INS] by [INS: a :INS] computer [DEL: only a few months ago, :DEL] in June[INS: 2014 :INS] ). [DEL: Also i :DEL] [INS: I :INS] t is [INS: also :INS] important [INS: to note :INS] that Alan Turing invented [INS: the :INS] [DEL: Binary :DEL] [INS: binary :INS] systém[DH1] and [DEL: he used them :DEL] [INS: deployed it :INS] in his imaginary machine ([DEL: we can say :DEL] [INS: which we would now call a :INS] computer). [DEL: The :DEL] [INS: Shannon formulated his information :INS] [DEL: theory of :DEL] [DEL: information :DEL] [INS: theory :INS] [DEL: was field which Claude Shannon studied couple of years :DEL] [INS: over a period of years :INS] and [DEL: he wrote a work with official name :DEL] [INS: published the results in :INS] A Mathematical Theory of Communication. [DEL: And :DEL] [INS: Subsequently, :INS] [DEL: invention of Mathematical theory of Communication and theory of information :DEL] [INS: the development of the field :INS] led to the formation of new word[DEL: , today well known word :DEL] [INS: widely used in the contemporary world :INS] : bit[DEL: . Bit became :DEL] [INS: , the :INS] basic unit of measurement of information. After Shannon[INS: , :INS] [DEL: started coming :DEL] other scientists [INS: followed :INS] who [DEL: wanted state :DEL] [INS: sought to establish :INS] [INS: information :INS] theory [DEL: of :DEL] [INS: on :INS] [DEL: information on :DEL] solid mathematical foundation[INS: s :INS] . [INS: Moreover, :INS] [DEL: Theory :DEL] [INS: information theory :INS] [DEL: of information became for many others industry :DEL] [INS: led to many industrial applications, :INS] and [INS: its influence spread to :INS] many other[DEL: s :DEL] [DEL: sciences :DEL] [INS: scientific fields, :INS] [DEL: like :DEL] [INS: such as :INS] psychology, linguistics, genetics, anthropology, economics and neurology. In first half of twentieth century[INS: , :INS] [DEL: Theory :DEL] [INS: information theory :INS] [DEL: of information :DEL] [DEL: became fashionable :DEL] [INS: enjoyed great vogue, :INS] and many [DEL: representatives of :DEL] social [DEL: sciences :DEL] [INS: scientists :INS] started to examine [DEL: this theory :DEL] [INS: it :INS] in [INS: the :INS] context of their field. [INS: Indeed, :INS] [DEL: In first half of twentieth century took Theory of information for their also psychologists. At this time :DEL] [INS: it was in this period when psychologists :INS] [DEL: started diversion :DEL] [INS: turned away :INS] from behaviourist [DEL: direction :DEL] [INS: models :INS] and [DEL: scientists started :DEL] return[DEL: ing :DEL] [INS: ed :INS] to [INS: the investigation of states of mind, :INS] spirituality [DEL: and started examine states of mind again :DEL] [INS: in particular :INS] . Various experimental psychologists ([INS: among them :INS] I. P. Pavlov, G. Mill, S. Freud, [INS: and :INS] W. James) [DEL: are assailed to new research :DEL] [INS: embark :INS] [INS: ed :INS] [INS: on research of this kind, :INS] [DEL: . A :DEL] [INS: a :INS] nd [INS: in the context of :INS] [DEL: follow up :DEL] this [DEL: trend :DEL] [INS: movement, :INS] [DEL: there was :DEL] [INS: a :INS] new psychological field[INS: , :INS] cognitive psychology[INS: , emerge :INS] [INS: d :INS] which [DEL: is :DEL] combin[DEL: ation :DEL] [INS: es :INS] [DEL: os :DEL] psychology, informatics and also philosophy. [INS: Subsequently, :INS] [INS: quantitative information theory emerge :INS] [INS: d :INS] [INS: from a number of sources: :INS] [INS: the :INS] [DEL: Generalization :DEL] [INS: general :INS] [DEL: ideas :DEL] [INS: theories :INS] of Harry Nyquist and Ralph Hartley[INS: ; :INS] [DEL: with assistance of :DEL] statistics[INS: ; :INS] [DEL: and :DEL] [INS: and the :INS] [INS: :INS] probability [DEL: theory :DEL] [INS: theories :INS] [DEL: by :DEL] [INS: of :INS] Shannon, Wiener and [DEL: for example also by biogolist :DEL] Fisher[DEL: is considered for formation of quantitative theory of information :DEL] . This theory deal[INS: s :INS] [DEL: with problem of quantity :DEL] [INS: quantitative aspects :INS] of information and [DEL: omits character of information :DEL] [INS: eschews qualitative considerations (such as the nature of information) :INS] . [DEL: Emerging :DEL] [INS: The emergence of general and quantitative :INS] [DEL: theory :DEL] [INS: theories :INS] of information [DEL: (also quantitative theory of information) initiated :DEL] [INS: inspired the first :INS] development[INS: s :INS] [DEL: of :DEL] [INS: in :INS] software[DEL: resources :DEL] [INS: , :INS] and [INS: also :INS] [DEL: because there was to unify techniques :DEL] [INS: the development of techniques :INS] [DEL: . :DEL] [INS: and :INS] [DEL: Methods :DEL] [INS: methods :INS] [DEL: also :DEL] [INS: of :INS] processing [DEL: of :DEL] [INS: and storing :INS] information[DEL: storage :DEL] . [INS: In addition to this, :INS] [DEL: Grom :DEL] [INS: the findings of information :INS] theory[DEL: of information :DEL] [DEL: begun :DEL] [INS: made it possible :INS] to [DEL: build :DEL] [INS: establish a :INS] new [DEL: complex :DEL] field[INS: , :INS] [DEL: – :DEL] informatics, which [DEL: id :DEL] deal[DEL: ing :DEL] [INS: s :INS] [DEL: with :DEL] [INS: not only :INS] [INS: with :INS] general problems [DEL: :DEL] related to knowledge[INS: , :INS] [DEL: and :DEL] [INS: but also with the :INS] implementation of the objects[DEL: , phenomens :DEL] [INS: :INS] and processes concern[INS: ed :INS] [DEL: to :DEL] [INS: with the :INS] acquisition, processing, transmission and use of information and knowledge. [INS: In summary, information theory :INS] [INS: has opened up whole new fields of human enquiry :INS] [INS: which have :INS] [DEL: Aboved described fields which arised or :DEL] enriched [DEL: yourself because of theory of information are selected at random :DEL] [INS: and transformed the contemporary world :INS] [DEL: . All of this was :DEL] [INS: , and it was :INS] [DEL: invented just :DEL] [INS: elaborated :INS] in [DEL: couple of :DEL] [INS: a :INS] [INS: short space of time :INS] [DEL: years :DEL] [DEL: and everything :DEL] based on [INS: the :INS] work of [DEL: ona :DEL] [INS: one :INS] amazing[INS: :INS] [DEL: :DEL] scientist: Claude Shannon.[INS: :INS] [INS: :INS] [INS: Feedback: :INS] [INS: :INS] * [INS: You’re right to repeat keywords (e.g. “information theory”) but don’t overdo this. :INS] * [INS: Overall, you should make greater use of cohesive devices (therefore, however etc) in order to give your writing greater structure and clarity. :INS] * [INS: Pay attention to the use of commas with dependent clauses and coordinators. :INS] Literature: 1) BENEŠ, Pavel. Informace o informaci, aneb, Nový pohled na tento svět. 1. vyd. Praha: BEN- technická literatura, 2010, 123 s. ISBN 978-80-7300-263-3. 2) CURRÁS, Emilia. Informační věda - retrospektivní ohlédnutí. Vyd. 1. Opava: Slezská univerzita v Opavě, Filozoficko-přírodovědecká fakulta, Ústav bohemistiky a knihovnictví, 2006, 121 s. ISBN 80-724-8384-6. 3) GLEICK, James. Informace: historie, teorie, záplava. 1. vyd. v českém jazyce. Praha: Dokořán, 2013, 396 s. Zip (Argo: Dokořán). ISBN 978-80-7363-415-5. 4) LORENZ, Michal. Informační věda - předmět neznámý. In: InFlow [online]. 2012 [cit. 2014-05-12]. Dostupné z: http://www.inflow.cz/informacni-veda-predmet-neznamy 5) POSPÍŠIL, Jaroslav. Teorie informace: určeno pro stud. fyziky specializace Aplikovaná fyzika PřF UP. 1. vyd. Olomouc: Univerzita Palackého, 1993, 106 s. ISBN 80-706-7270-6. 6) SHANNON, Claude. A Mathematical Theory of Communication. The Bell system technical journal. New York: American Telephone and Telegraph Company, 1922-1983, č. 27. Dostupné z: http://cm.bell-labs.com/cm/ms/what/shannonday/shannon1948.pdf ________________________________ [DH1]You should check the accuracy of this claim.