Information Theory

3 ECTS credits
75 h study time

Offer 1 with catalog number 1015224ANR for all students in the 2nd semester at a (A) Bachelor - preliminary level.

Semester

2nd semester

Enrollment based on exam contract

Impossible

Grading method

Grading (scale from 0 to 20)

Can retake in second session

Yes

Enrollment Requirements

The enrolment requirement is only valid for bachelor students mathematics and data science. Students must have followed 'Discrete Mathematics', 'Linear Algebra', 'Mathematical Analysis I' and 'Mathematical Analysis II'

Taught in

Dutch

Faculty

Faculty of Sciences and Bioengineering Sciences

Department

Mathematics

Educational team

Ingrid Daubechies
Philippe Cara (course titular)

Activities and contact hours

13 contact hours Lecture
13 contact hours Seminar, Exercises or Practicals

Course Content

Measure theory, Shannon capacity, entropy, compression.

Additional info

see webpage Book by McKay and lecture notes, see website http://homepages.ulb.ac.be/~pcara/teaching.html#WisTech

Learning Outcomes

General competencies

The student understands the main concepts of information theory and the mathematical models for information.

The student can prove bounds on how much information can be transported over a given channel, how much (lossless) compression is possible, ...

The student can translate the mathematical results into practical language for technology.

Grading

The final grade is composed based on the following categories:
Other Exam determines 100% of the final mark.

Within the Other Exam category, the following assignments need to be completed:

examen (schrift. of mond.) with a relative weight of 1 which comprises 100% of the final mark.

Note: Zowel oefeningen als theorie.

Additional info regarding evaluation

Written exam (theory + exercises). In case Prof. Daubechies does not teach the course, the theory exam will be oral.

Allowed unsatisfactory mark

The supplementary Teaching and Examination Regulations of your faculty stipulate whether an allowed unsatisfactory mark for this programme unit is permitted.

Academic context