COMP9444 Neural Networks and Deep Learning

Quiz 5 (Recurrent Networks)

This is an optional quiz to test your understanding of Recurrent Networks from Week 5.
  1. Explain the format and method by which input was fed to the NetTalk system, and the target output.

  2. Explain the role of the context layer in an Elman network.

  3. Draw a diagram of an LSTM and write the equations for its operation.

  4. Draw a diagram of a Gated Recurrent Unit and write the equitions for its operation.

  5. Briefly describe the problem of long range dependencies, and discuss how well each of the following architectures is able to deal with long range dependencies:
    1. sliding window approach
    2. Simple Recurrent (Elman) Network
    3. Long Short Term Memory (LSTM)
    4. Gated Recurrent Unit (GRU)