DayZ was a cultural phenomenon when it launched as a mod for ARMA 2 in mid-2012. A strategy used to select the hyperparameters is to randomly sample them (uniformly or logscale) and see the testing error after a few epoch. The Best DayZ Server Hosting Providers: Survival Servers PingPerfect. What: The learning rate is probably the most important hyperparameter to tune. The excellent CS231n Stanford course already has a good list of training tricks. Those would really have helped me when I started. Most of the tricks may seem trivial for those who have some experience in machine learning but I feel like while there is a lot of very good theoretical material available for machine learning, there is still a lack of practical advice. This should be a collaborative work so feel free to complete or correct. My knowledge is quite limited so this is prone to errors/imprecisions. The goal is to briefly give a description of the trick as well as an intuition about why it is working.
This is an attempt to enumerate different machine learning training tricks I gather around as well as some network architectures.
Deep-Learning-Tricks - Enumerate diverse machine learning training tricks.