c17 · E3

Open: Going Downhill on Purpose

c17.E3.1E3 · open

Section 17.6 leaves you with a test, not a recipe. The conditions and remove schedules that cannot work, but they do not say which of the survivors is fastest. The constants in the convergence bounds are unknown in practice, and the section says batch size is settled by what the hardware does well rather than by a theorem about accuracy. Section 17.5 adds the reason: a constant step settles at a noise floor whose size moves with the step and the batch, and the two knobs trade against each other.

You have a fixed compute budget and a new model, and you must choose the step schedule , the batch size , and the number of steps. Design a protocol for making those choices and for reporting the result. In your answer: say what you measure during the run and what you compute from the measurements; say what your protocol promises and over what range of runs; state what result would make you change the schedule; and name one way the protocol can mislead you even when every step is followed.

Rubric. Tick each criterion your answer meets, then save the self-assessment. The platform does not grade it.

Other tiers

E1 Practise · E2 Derive

Every hint opened, solution viewed and answer checked is recorded in this browser only. See Progress to export or delete it.