Description

The Course Project is an opportunity for you to practice what you have learned from this course and apply to some problems that you are interested in. There are two types of projects, Type-A and Type-B.

• Type-A Project: This type of project is about small-size neural network on small-size dataset. To finish this type of project, you do not need a powerful GPU as computing platform. The aim of this project is to help you have a deeper understanding the basic principle of deep neural network and how it works.
• Type-B Project: This type of project is about some advanced topics of neural network and its applications. This type of work might be challenging since it may require train and test large-size neural network on large-size dataset. You may need GPU for your experiment.

Topics of Type‐A and Type‐B Projects

The following is some example topics you can use for your Type-A and Type-B.

Available Type-A Project Topics

• Evaluate the performance of different types of optimizer on a LeNet-5 network using MNIST data. At least you need to evaluate SGD, AdaGrad, RMSprop.
• Evaluate the performance of model ensemble on a LeNet-5 network using MNIST dataset. You need to evaluate and compare the performance when ensembling 3, 5, 7 network models.
• Evaluate the performance of dropout on fully-connected layers and batch normalization on convolutional layers. The model is LeNet-5 on MNIST dataset. Among four options 1) FC with dropout, CONV with BN; 2) FC with dropout, CONV without BN; 3) FC without dropout, CONV with BN; 4) FC without dropout, CONV without dropout, identify which one has the best performance?

Available Type-B Project Topics

• Manually implement a convolutional NN using Numpy (no automatic gradient). Train and test on MNIST dataset. The 93% accuracy should be achieved.
• Manually implement a Recurrent NN using Numpy (no automatic gradient) on MNIST dataset. 90% accuracy should be achieved.
• Prune a LeNet-5 convolutional NN on MNIST dataset with high compression ratio and negligible performance loss.
• Launch one type of adversarial attack for LeNet-5 on MNIST dataset.
• Apply deep neural network to a domain problem: e.g. plate number recognition, image caption, blood cell recognition, digital communication, transportation etc.

Name Your Own Type‐B Project

• You can propose a topic for your Type-B project. The complexity of your proposed Type-B project should be higher than Type-A project.
• A one-page project proposal is needed if you would like to name your own Type-B project. The project proposal should include: the motivation of this topic, the planned used data, the state-of-the-art approaches and your planned selection, evaluation metrics.
• The project proposal should be submitted and approved by instructor.