Novelty, Information and Surprise

Surprise and Information of Descriptions: Prerequisites.- Improbability and Novelty of Descriptions.- Conditional Novelty and Information.- Coding and Information Transmission: On Guessing and Coding.- Information Transmission.- Information Rate and Channel Capacity: Stationary Processes and Information Rate.- Channel Capacity.- Shannon's Theorem.- Repertoires and Covers: Repertoires and Descriptions.- Novelty, Information and Surprise of Repertoires.- Conditioning, Mutual Information and Information Gain.- Information, Novelty and Surprise in Science: Information, Novelty and Surprise in Brain Theory.- Surprise from Repetitions and Combination of Surprises.- Entropy in Physics.-  Generalized Information Theory: Order- and Lattice-Structures.-  Three Orderings on Repertoires.- Information Theory on Lattices of Covers.- Bibliography.- Index.