AWS Certification Exam AI Practitioner (Practice Questions) set16

問題 54 / 65

What are the primary causes of the vanishing gradient problem in deep neural networks and the common remedies?

①The main cause is that the learning rate is too high, and the remedy is to lower the learning rate.
②The primary cause is insufficient data, and the countermeasure is data augmentation.
③The main cause is that the weight initialization is excessively large, and the remedy is to use small initial values.
④To counteract vanishing gradients caused by the choice of activation function and network depth, ReLU, batch normalization, and residual connections are used.
⑤The primary cause is that the loss function is non-convex, and the remedy is to change it to a convex function.

当サイトでは、ユーザー体験の向上を目的としてCookieを使用しています。サイトの利用を継続することで、Cookieの使用に同意したものとみなされます。