These issues were major obstacles to training deep networks before the introduction of ReLU activations, residual connections (ResNets), and normalisation techniques.
