Put the verb in brackets into the past simple or the past continuous.
We were having breakfast when our neighbours ... \(work\) in the garden.