I knew the mechanics but doing it by hand under pressure is a different thing.
Start by clearly restating the network architecture and the given input vector. Then, for each layer, compute the pre-activation values (z = Wx + b) and apply the activation function to get the layer output, which becomes the input to the next layer. Finally, present the output of the last layer as the network's prediction.
Pro tip: Double-check your matrix multiplication by verifying dimensions and using a systematic approach (e.g., row-by-column dot products). Also, mention that in practice you'd use a library like NumPy or PyTorch, but manual computation helps debug and understand the model.
Identify the number of layers, the size of each layer, the weight matrices, bias vectors, and activation functions for each layer.
For the first layer, compute z1 = W1 * x + b1, where x is the input vector, W1 is the weight matrix, and b1 is the bias vector.
Apply the activation function (e.g., ReLU, sigmoid, tanh) element-wise to z1 to obtain the first layer output a1.
For each subsequent layer i, compute zi = Wi * a_{i-1} + bi and apply the activation function to get ai, until the final layer.
The output of the last layer is the network's prediction. Present it clearly, and if applicable, interpret it (e.g., probabilities for classification).
AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.