CS7641 Homework 3 -Image compression with SVD Solved

CS 4641\7641 A: Machine Learning Homework 3

Instructions for the assignment

• In this assignment, we have programming and writing questions.
• To switch between cell for code and for markdown, see the menu -> Cell -> Cell Type
• You could directly type the Latex equations in the markdown cell.
• Typing with Latex\markdown is required for all the written questions. Handwritten answers would not be accepted.
• If a question requires a picture, you could use this syntax “<imgsrc=””style=”width:300px;“/>”“<imgsrc=””style=”width:300px;”/>” to include them within your ipython notebook.
• Questions marked with **[P]** are programming only and should be submitted to the autograder. Questions marked with **[W]** may required that you code a small function or generate plots, but should NOT be submitted to the autograder. It should be submitted on the writing portion of the assignment on gradescope
• The outline of the assignment is as follows:
  • Q1 [30 pts] > Image compression with SVD **[W]** 1.2 and 1.3 | **[P]** items 1.1
  • Q2 [15 pts] > Understanding PCA **[W]** items 2.2 | **[P]** 2.1
  • Q3 [55+(20 bonus for undergrads)]> Regression and regularization **[W]** items 3.2, 3.3, 3.4 and 3.5 | **[P]** items 3.1
  • Q4 [20 pts] > Naive Bayes classification. **[W]** items 4.1 | **[P]** items 4.2
  • Q5 [15 pts] > Noise in PCA and Linear Regression. **[W]** items 5.1, 5.2 and 5.3
  • Q6 [Bonus for all][30 pts] > Manifold learning with Isomap **[W]** items 6.2 | **[P]** items 6.1
  • Q7 [No Points] > Feature Selection. **[P]** items 7