Instead of disconnecting from Slack, you can simply snooze notifications from Slack.

Click on the down arrow next to your project and choose Slack Configuration.

Then click on Snooze activity.