BasicOptimizer.scala:89 executed in 218.63 seconds (3.346 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 692198915373000
Reset training subject: 692203429183600
Adding measurement 45ec4d13 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-1284.7450136116504;dx=-0.010292726881120887
New Minimum: -1284.7450136116504 > -1284.7684616303438
WOLFE (weak): th(2.154434690031884)=-1284.7684616303438; dx=-0.010091862299018137 evalInputDelta=0.023448018693443373
New Minimum: -1284.7684616303438 > -1284.7920065131166
WOLFE (weak): th(4.308869380063768)=-1284.7920065131166; dx=-0.010092192409031834 evalInputDelta=0.04699290146618296
New Minimum: -1284.7920065131166 > -1284.8860358023976
WOLFE (weak): th(12.926608140191302)=-1284.8860358023976; dx=-0.010089669920128767 evalInputDelta=0.1410221907472078
New Minimum: -1284.8860358023976 > -1285.3091067910473
WOLFE (weak): th(51.70643256076521)=-1285.3091067910473; dx=-0.01008808638708875 evalInputDelta=0.5640931793968775
New Minimum: -1285.3091067910473 > -1287.5624742124166
WOLFE (weak): th(258.53216280382605)=-1287.5624742124166; dx=-0.010066919873665117 evalInputDelta=2.8174606007662533
New Minimum: -1287.5624742124166 > -1301.528908630154
WOLFE (weak): th(1551.1929768229563)=-1301.528908630154; dx=-0.009909814630482298 evalInputDelta=16.7838950185037
New Minimum: -1301.528908630154 > -1394.7333078406066
END: th(10858.350837760694)=-1394.7333078406066; dx=-0.008570063730926603 evalInputDelta=109.98829422895619
Fitness changed from -1284.7450136116504 to -1394.7333078406066
Iteration 1 complete. Error: -1394.7333078406066 Total: 50.1943; Orientation: 0.0977; Line Search: 36.3901
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 35512f69 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1394.7333078406066;dx=-0.007736892160260419
New Minimum: -1394.7333078406066 > -1562.310708533997
END: th(23393.607721408407)=-1562.310708533997; dx=-0.005532375231784776 evalInputDelta=167.57740069339047
Fitness changed from -1394.7333078406066 to -1562.310708533997
Iteration 2 complete. Error: -1562.310708533997 Total: 14.6111; Orientation: 0.0974; Line Search: 8.9960
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2bcd5c23 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1562.310708533997;dx=-0.004816872850445691
New Minimum: -1562.310708533997 > -1779.8405125179054
END: th(50400.00000000001)=-1779.8405125179054; dx=-0.0032119696373878515 evalInputDelta=217.52980398390832
Fitness changed from -1562.310708533997 to -1779.8405125179054
Iteration 3 complete. Error: -1779.8405125179054 Total: 14.9026; Orientation: 0.1012; Line Search: 9.1826
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement cf20382 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.109e+04, gradient 5.577e-02, dot -0.885; [19a2a9b4-d144-48d2-8dc6-5cc3774ffdce = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1779.8405125179054, -1562.310708533997, -1394.7333078406066, -1284.7450136116504
LBFGS Accumulation History: 3 points
Removed measurement cf20382 to history. Total: 3
th(0)=-1779.8405125179054;dx=-0.0031079592857346846
New Minimum: -1779.8405125179054 > -2069.6674853705367
END: th(108583.50837760697)=-2069.6674853705367; dx=-0.0019018002423854784 evalInputDelta=289.82697285263134
Fitness changed from -1779.8405125179054 to -2069.6674853705367
Iteration 4 complete. Error: -2069.6674853705367 Total: 16.3191; Orientation: 1.7613; Line Search: 9.0529
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 14a518f8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.386e+04, gradient 4.881e-02, dot -0.750; [19a2a9b4-d144-48d2-8dc6-5cc3774ffdce = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2069.6674853705367, -1562.310708533997, -1394.7333078406066, -1284.7450136116504
LBFGS Accumulation History: 3 points
Removed measurement 14a518f8 to history. Total: 3
th(0)=-2069.6674853705367;dx=-0.002380561144122669
New Minimum: -2069.6674853705367 > -2405.773576212026
END: th(233936.07721408413)=-2405.773576212026; dx=-7.130100702927161E-4 evalInputDelta=336.1060908414893
Fitness changed from -2069.6674853705367 to -2405.773576212026
Iteration 5 complete. Error: -2405.773576212026 Total: 16.6764; Orientation: 1.7996; Line Search: 9.3228
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 46be1649 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.497e+04, gradient 5.610e-02, dot -0.461; [19a2a9b4-d144-48d2-8dc6-5cc3774ffdce = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2405.773576212026, -1562.310708533997, -1394.7333078406066, -1284.7450136116504
LBFGS Accumulation History: 3 points
Removed measurement 46be1649 to history. Total: 3
th(0)=-2405.773576212026;dx=-0.00314595081536474
Armijo: th(504000.0000000002)=-2379.847264006663; dx=6.127456818985609E-4 evalInputDelta=-25.926312205363047
New Minimum: -2405.773576212026 > -2553.998140171602
WOLF (strong): th(252000.0000000001)=-2553.998140171602; dx=5.109883717432486E-4 evalInputDelta=148.2245639595758
New Minimum: -2553.998140171602 > -2582.6199875320413
END: th(84000.00000000003)=-2582.6199875320413; dx=-8.772899755763832E-4 evalInputDelta=176.84641132001525
Fitness changed from -2405.773576212026 to -2582.6199875320413
Iteration 6 complete. Error: -2582.6199875320413 Total: 25.5098; Orientation: 1.7165; Line Search: 18.2919
Adding measurement 365693b5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.074e+04, gradient 4.460e-02, dot -0.591; [19a2a9b4-d144-48d2-8dc6-5cc3774ffdce = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2582.6199875320413, -1562.310708533997, -1394.7333078406066, -1284.7450136116504
LBFGS Accumulation History: 3 points
Removed measurement 365693b5 to history. Total: 3
th(0)=-2582.6199875320413;dx=-0.00198763935111691
New Minimum: -2582.6199875320413 > -2753.8401369723697
END: th(180972.5139626783)=-2753.8401369723697; dx=-2.287197545027551E-4 evalInputDelta=171.22014944032844
Fitness changed from -2582.6199875320413 to -2753.8401369723697
Iteration 7 complete. Error: -2753.8401369723697 Total: 15.1329; Orientation: 1.6283; Line Search: 9.2112
Adding measurement 1ab1267e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.448e+04, gradient 5.597e-02, dot -0.440; [19a2a9b4-d144-48d2-8dc6-5cc3774ffdce = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2753.8401369723697, -1562.310708533997, -1394.7333078406066, -1284.7450136116504
LBFGS Accumulation History: 3 points
Removed measurement 1ab1267e to history. Total: 3
th(0)=-2753.8401369723697;dx=-0.0031306054676728235
Armijo: th(389893.4620234736)=-2679.778908790798; dx=6.953584353559454E-4 evalInputDelta=-74.06122818157155
New Minimum: -2753.8401369723697 > -2849.3302721867817
WOLF (strong): th(194946.7310117368)=-2849.3302721867817; dx=7.625266697790572E-4 evalInputDelta=95.49013521441202
New Minimum: -2849.3302721867817 > -2892.5221693186727
END: th(64982.24367057893)=-2892.5221693186727; dx=-9.150239868002854E-4 evalInputDelta=138.682032346303
Fitness changed from -2753.8401369723697 to -2892.5221693186727
Iteration 8 complete. Error: -2892.5221693186727 Total: 24.5564; Orientation: 1.6086; Line Search: 18.3410
Adding measurement 1ec5789e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.943e+04, gradient 3.947e-02, dot -0.621; [19a2a9b4-d144-48d2-8dc6-5cc3774ffdce = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2892.5221693186727, -1562.310708533997, -1394.7333078406066, -1284.7450136116504
LBFGS Accumulation History: 3 points
Removed measurement 1ec5789e to history. Total: 3
th(0)=-2892.5221693186727;dx=-0.001556672252738245
New Minimum: -2892.5221693186727 > -3029.7983431245057
END: th(140000.00000000006)=-3029.7983431245057; dx=-4.877188223655027E-4 evalInputDelta=137.27617380583297
Fitness changed from -2892.5221693186727 to -3029.7983431245057
Iteration 9 complete. Error: -3029.7983431245057 Total: 15.3395; Orientation: 1.6439; Line Search: 9.1047
Adding measurement 43777407 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.215e+04, gradient 4.463e-02, dot -0.524; [19a2a9b4-d144-48d2-8dc6-5cc3774ffdce = 1.000/1.000e+00]
Orientation rejected. Popping history element from -3029.7983431245057, -1562.310708533997, -1394.7333078406066, -1284.7450136116504
LBFGS Accumulation History: 3 points
Removed measurement 43777407 to history. Total: 3
th(0)=-3029.7983431245057;dx=-0.0019901804082598103
New Minimum: -3029.7983431245057 > -3072.5463381371483
WOLF (strong): th(301620.8566044639)=-3072.5463381371483; dx=3.7525120304666634E-4 evalInputDelta=42.747995012642605
New Minimum: -3072.5463381371483 > -3129.684009608638
WOLF (strong): th(150810.42830223194)=-3129.684009608638; dx=1.3463658456664123E-4 evalInputDelta=99.88566648413234
END: th(50270.142767410645)=-3105.290485606781; dx=-9.043183767397726E-4 evalInputDelta=75.49214248227554
Fitness changed from -3029.7983431245057 to -3129.684009608638
Iteration 10 complete. Error: -3129.684009608638 Total: 24.5154; Orientation: 1.5895; Line Search: 18.5517
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -3129.684009608638 (> -Infinity) after 218.634s (< 5400.000s)
Returns
-3129.684009608638