Lecture 4 Order and probability. Information and entropy Flashcards
All natural processes lead to a net increase in…
Entropy
There exists a natural tendency for an ordered set of things to get disordered through…
Interplay of natural forces
What is entropy?
Entropy is a measure of the degree of randomness or disorder of a system.
When does the entropy of a system increase?
The entropy of a system increases when it becomes more disordered
Under what condition can a process only occur spontaneously in?
A process can occur spontaneously only if the sum of the entropies of the system and its surroundings increases.
The probability of any kind of distribution will be larger if ?
It can be realized in a larger number of ways.
The number of ways, which lead to the realization of a definite situation is a measure of …
The probability of the occurrence of it
What is the Boltzmann equation of entropy
S=k.lnW
Boltzmann’s constant k was defined as a universal constant later by…
Max Planck
Boltzmann’s constant k must have the same unit of measure as…
Entropy
What is the Shannon equation of information theory?
I=K ln P
In the Shannon equation of information theory, the unit I is determined by…
The unit of the factor K.
Which unit is most commonly used for I in the Shannon equation of information theory and what does it express?
The bit (“binary digit”) is most commonly used. It expresses the number of binary yes-no decisions, which are needed to determine a given message
The idea of a link between information and entropy was first suggested
Boltzmann
Erwin Schrodinger (1944) made the frequently quoted statement…
The living system feeds on negative entropy
What is Erwin Schrodinger (1944) quoted statement the reason of?
This is the reason why sometimes the term “negentropy” is used.
What is the real importance of Shannon’s information equation in biophysics?
Ans: It is possible to calculate the information content of a protein by the above approach. The requirements are, firstly, a statistical record of the frequency of the occurrence of the individual amino acids in proteins.
Using Shanon equation the information content of ……… can be calculated
Using Shanon equation the information content of each monomer can be calculated
The information content of a ……….. can be obtained in the same way
Nucleic acid
One mammalian mitochondrial DNA molecule consists of about
15000 Nucleotides
Assuming that the four possible types of nucleoside bases (adenine, cytosine, guanine, thymine) have an equal probability of occurrence, then the information content of each single nucleotide will have a value
Of 2 bits.
