To do something that makes people angry

• To let the cat out of the bag
• While the cat is away, the mice will play
• To put the cat among the pigeons