https://avanwyk.com/tag/tensorflow/ Recent content in TensorFlow on avanwyk Hugo -- gohugo.io en andrich@avanwyk.com (Andrich van Wyk) andrich@avanwyk.com (Andrich van Wyk) © 2026 Andrich van Wyk Mon, 02 Sep 2019 21:45:00 +0000 https://avanwyk.com/tensorflow-2-super-convergence-with-the-1cycle-policy/ Mon, 02 Sep 2019 21:45:00 +0000 andrich@avanwyk.com (Andrich van Wyk) https://avanwyk.com/tensorflow-2-super-convergence-with-the-1cycle-policy/ Implementing super-convergence for deep neural network training in Tensorflow 2 with the 1Cycle learning rate policy. https://avanwyk.com/finding-a-learning-rate-in-tensorflow-2/ Sun, 28 Jul 2019 11:05:37 +0000 andrich@avanwyk.com (Andrich van Wyk) https://avanwyk.com/finding-a-learning-rate-in-tensorflow-2/ Implementing the technique in Tensorflow 2 is straightforward. Start from a low learning rate, increase the learning rate and record the loss. Stop when a very high learning rate is reached. Plot the losses and learning rates choosing a learning rate where the loss is decreasing at a rapid rate.