Can you come to lunch on Sunday?

• I'm not afraid to
• I'm afraid not
• I'm sorry not
• I'm sorry that not