2019 HUAWEI DIGIX Nurbs Solutions
原生的adam与Lookahead配合较好,效果比较为adam<AdamW<RAdam<RAdam + Lookahead<AdamW + Lookahead<adam + lookahead,效率是纯AdamW最快
Sites: chizhu : https://github.com/chizhu nurbs: https://github.com/suncostanx deepctr : https://github.com/shenweichen/DeepCTR/