piecewise_decay

paddle.fluid.layers.piecewise_decay(boundaries, values)[源代码]

对初始学习率进行分段衰减。

该算法可用如下代码描述。

boundaries = [10000, 20000]
values = [1.0, 0.5, 0.1]
if step < 10000:
    learning_rate = 1.0
elif 10000 <= step < 20000:
    learning_rate = 0.5
else:
    learning_rate = 0.1

参数

• boundaries(list) - 代表步数的数字
• values(list) - 学习率的值，不同的步边界中的学习率值

返回

衰减的学习率

代码示例

import paddle.fluid as fluid
boundaries = [10000, 20000]
values = [1.0, 0.5, 0.1]
optimizer = fluid.optimizer.Momentum(
    momentum=0.9,
    learning_rate=fluid.layers.piecewise_decay(boundaries=boundaries, values=values),
    regularization=fluid.regularizer.L2Decay(1e-4))