Elementi di Teoria dell'Informazione
The course represents an introduction to classical results of Shannon information theory. At
the end of the course the student will have the capacity to apply
information theory tools and approaches to both theoretical and
practical problems related to information management, coding,
representation, protection and information metrics. The course is structured in two parts. The
course will be based on theretical lessons followed by in class
exercises and computer based experiments. Personal training on assigned
exercises is important for the success in this class. The assesment comprises a written test followed by an oral examination. Other referencesCourse objectives
Results of learning outcomes
Syllabus
The
first part of the course is devoted to the classical information
theory. In particular, the addressed topics are: definition of
information and source types, the concept of entropy, source coding,
Shannon's first theorem (source coding), uniquely decodable codes,
optimality of Huffman coding, models of noisy channels, definition of
the channel capacity according to Shannon's theorem (channel coding).
The
second part of the course is devoted to the study of source coding and
channel coding algorithms used in many applications, communication
systems and networks. The selected topics include arithmetic coding, the
Lempel-Ziv-Welch algorithms and state of the art standards for image
and video compression. As far as channel coding is regarded the course
will introduce linear block codes, cyclic codes, convolutional codes and
fountain codes.Course delivery
Learning assessment methods
Suggested readings and bibliography