Ensure we properly set the "shutting down" flag so connection drops by downstream peers are properly handled.