AI6127 Assignment 1 Solved

1. Question One

1. Download a named entity recognition dataset from

   https://github.com/leondz/emerging_entities_17, modify the format of the dataset as input to the hands-on implementation of “Named entity recognition by using CRF” of Lecture 3 Slide 38 and run the hands-on implementation, reporting F-score [15 marks]

   i. Training data: wnut17train.conll (Twitter)
   ii. Development data: emerging.dev.conll (YouTube)

   iii. Test data: emerging.test.conll (YouTube)

2. Modify the format of the dataset as input to the Softmax classifier of Tutorial 3 and

   run the Softmax classifier, comparing with the CRF model’s performance in terms of

   F-score

3. Optimize the hyper-parameters of the Softmax classifier in terms of F-score, by

   alternating at least two values of each of the following hyper-parameters [20 marks]:

   1. Window size
   2. Embedding size
   3. Hidden layer size
   4. Number of hidden layers
   5. Freeze word embeddings or not
   6. Learning rate
   7. Number of epochs

   You may select small numbers of epochs for the optimization experiments if each experiment takes long time. Display the experiment results in a tabular format which compares alternative values of the hyper-parameters.

1