I've been following Andrej Karpathy's Neural Networks: Zero to Hero YouTube lecture series. Throughout the course, he shares insights, including common pitfalls and practical tips. I am noting these points hoping that they might be useful for me in the future.
Here is the Jupyter notebook.