Discussions

Machine Learning Foundations · Q&A forum · 142 topics

Topics
Top contributors
DRDr. Daniel ReyesTeacher
PSPriya Sharma38 answers
MLMarcus Lee21 answers
Forum guidelines
Be kind, search before posting, and don't share graded solutions.
AI thread summary
  • “Dying ReLU” = neurons stuck outputting 0, so their gradient is 0 forever.
  • Usual cause: learning rate too high or bad initialisation.
  • Fixes: Leaky ReLU / GELU, He init, lower LR.
Summarised from 24 replies · accepted answer by teacher
Views1,204
Replies24
Linked lesson6.2 Backprop
Start a discussion
Ask a question or share something with the class.
Similar question found: “Loss becomes NaN after a few epochs” — answered