Practice quiz: Controls and checks

4 questions. Pick an answer to see if it is right. You can try as many times as you like. These are for practice: the final test has different questions.

1. 1.An ablation table should be planned...

   after the paper is acceptedbefore you start, around the parts your claim depends onneveronly if reviewers ask
2. 2.You train on shuffled labels and still get high accuracy on the test set. This suggests...

   a great modelleakage or a bugtoo few epochsa strong baseline
3. 3.What did Adebayo et al. (2018) find about some saliency methods?

   They were perfectTheir maps barely changed even when model weights were randomisedThey were too slowThey needed more data
4. 4.A positive control...

   should show no effectshould show a known effect, proving the setup can detect oneis the test setis the largest group