DS625 Comp. for Data Compression, Image/Signal Processing / Spring 2023

Course Instructor: Prashant Shekhar, PhD

Contact:

Updates

  • New Lecture is up: Lecture 26 Gradient Descent for Deep Learning III
  • New Lecture is up: Lecture 25 Gradient Descent for Deep Learning II [Notes]
  • New Lecture is up: Lecture 24 Gradient Descent for Deep Learning I [Notes]
  • New Lecture is up: Lecture 23 VAE conclusion
  • New Lecture is up: Lecture 21 Variational Autoencoders V [Notes]
  • New Lecture is up: Lecture 20 Variational Autoencoders IV [Notes]
  • New Lecture is up: Lecture 19 Variational Autoencoders III [Notes]

Class Details


Course Description

This is a project-based course. Broadly, major topics covered in this course include:

  1. Linear Data Compression
  2. Non-Linear Data Compression
  3. Computing for Data Compression
  4. Deep Generative Models

The concepts that you learn in this course can be utilized to solve problems in the general area of machine learning and data science. Starting from the concepts of linear data compression, we will look into applications such as image compression, image encoding and general dimensionality reduction. Then we will explore the concepts related to non-linear data reduction, particularly studying the concepts related to autoencoders and variational autoencoders. We will look into a variety of applications such as image/data sampling, image compression, anomaly detection etc.

Text Book

The study material for the course would be provided to the students in the form of jupyter notebooks, pdfs and handwritten notes. Additionally, students are encouraged to refer the textbooks menntioned below for a much deeper understanding

  1. Jakub M. Tomczak, Deep Generative Modeling, Springer, 18 February 2022 Link
  2. Diederik P. Kingma and Max Welling, An Introduction to Variational Autoencoders, 2019 Link
  3. Python and Machine Learning: Aurelien Geron, Hands-on Machine Learning with Scikit-learn, Keras & TensorFlow. O’Reilly, second edition, September 2019.

Grading

Your course grade will be determined as follows:

  1. Project: 50%
    1. Homework 1: 10%
    2. Homework 2: 10%
    3. Final Submission: 30%
      1. Class Presentation: 10%
      2. Project report: 10%
      3. Slides + Code: 10%
  2. Quizzes (4): 40%
  3. Class participation and attendance: 10%

The grading is expected to follow the standard scale

  • A: 90% - 100%
  • B: 80% - 89.5%
  • C: 70% - 79.5%
  • D: 60% - 69.5%
  • F: <60%

However, based on the performance of the entire class, I might curve the grading scale later.

Attendance

I will take attendance in every class. I encourage you to participate in class activities because attendance is usually found to be heavily correlated with the course grade. Additionally, a portion of the course grade depends on class participation making attendance very important.

Quizzes

You will have 4 quizzes. Make-ups on the quizzes may be allowed only for valid extenuating circumstances when I am informed before the test takes place – please see me about conflicts as soon as they occur. In case you are missing a quiz, it is your responsibility to schedule a makeup quiz with me within one week of the actual quiz date. After that makeup quiz is not possible.

Project and Presentation

During the semester you will be supervised to work on a project which combines classroom materials and real-world applications. It is supposed to be a group project and I will work with each group separately to identify a topic of your interest and find a relevant project in that domain. I will announce project topics, guidelines, and rubric soon.

Project

During the semester you will be supervised to work on a project which combines classroom materials and real-world applications. It is supposed to be an individual project and I will work with each of you separately to identify a topic of your interest and find a relevant project in that domain. I will announce project topics, guidelines, and rubric soon. The project will be divided in 3 stages:

  1. Homework 1 (Stage 1): Here you will finalize the project topic and will present your understanding of the topic with some preliminary results and a proposed timeline for the remaining semester.
  2. Homework 2 (Stage 2): Here you will present your progress, additional results. If you are stuck in some particular research related problem, then describe that as well.
  3. Finals (Stage 3): Here you will give a class presentation of your research project. Along with these slides, you will submit the project report and the code.

Academic Integrity

Embry-Riddle Aeronautical University maintains high standards of academic honesty and integrity in higher education. To preserve academic excellence and integrity, the University prohibits academic dishonesty in any form, including, but not limited to, cheating and plagiarism. More specific definitions of these violations and their consequences are described in detail in the Dean of Students’ Honor Codes and Student Policies.

Disability Services

DSS Administration Office: Bldg 500; Contact: (386) 226-7916; email: dbdss@erau.edu

  1. Student Disability Services: Students with disabilities who believe that they may need accommodations in this class are encouraged to contact the Office of Disability Services. Professors cannot make appropriate disability accommodations. Students are encouraged to register with DSS at the beginning of the term to better ensure that such accommodations are implemented in a timely fashion. Accommodations are not granted until official notice is received from DSS.
  2. It is the responsibility of the student to notify DSS the date and time of test once s/he has been made aware of the scheduled test. DSS requires: (a) 2 business days minimum notification for tests and quizzes and (b) 5 business days minimum notification for final exams. Professors cannot make appropriate testing modification without notification from DSS.