Click on the comment you want to resolve. Click "Resolve" to resolve the comment.

Your sidebar will act as a task list of outstanding comments yet to be resolved.