BasicOptimizer.scala:89 executed in 290.16 seconds (3.553 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 649852928284100
Reset training subject: 649858896577100
Adding measurement 7036acca to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-34.730723139706555;dx=-1.7739798418617198E-6
New Minimum: -34.730723139706555 > -34.73072640168499
END: th(2.154434690031884)=-34.73072640168499; dx=-1.5398981613522273E-6 evalInputDelta=3.2619784349208203E-6
Fitness changed from -34.730723139706555 to -34.73072640168499
Iteration 1 complete. Error: -34.73072640168499 Total: 30.9296; Orientation: 0.1438; Line Search: 13.1220
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3525d7a7 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-34.73072640168499;dx=-1.5381306290038817E-6
New Minimum: -34.73072640168499 > -34.73073618761846
WOLFE (weak): th(4.641588833612779)=-34.73073618761846; dx=-1.537443938949979E-6 evalInputDelta=9.785933471562203E-6
New Minimum: -34.73073618761846 > -34.73074488622367
WOLFE (weak): th(9.283177667225559)=-34.73074488622367; dx=-1.53730769404984E-6 evalInputDelta=1.848453867836497E-5
New Minimum: -34.73074488622367 > -34.73077750597381
WOLFE (weak): th(27.849533001676676)=-34.73077750597381; dx=-1.5361843570590243E-6 evalInputDelta=5.1104288822045874E-5
New Minimum: -34.73077750597381 > -34.730919945190465
WOLFE (weak): th(111.3981320067067)=-34.730919945190465; dx=-1.5358420727353325E-6 evalInputDelta=1.9354350547473587E-4
New Minimum: -34.730919945190465 > -34.73167997357884
WOLFE (weak): th(556.9906600335335)=-34.73167997357884; dx=-1.5357373610335413E-6 evalInputDelta=9.535718938522564E-4
New Minimum: -34.73167997357884 > -34.73643765606713
WOLFE (weak): th(3341.9439602012008)=-34.73643765606713; dx=-1.5353296136211795E-6 evalInputDelta=0.005711254382141817
New Minimum: -34.73643765606713 > -34.77066810500876
WOLFE (weak): th(23393.607721408407)=-34.77066810500876; dx=-1.53315549577711E-6 evalInputDelta=0.03994170332376967
New Minimum: -34.77066810500876 > -35.04815483757476
WOLFE (weak): th(187148.86177126726)=-35.04815483757476; dx=-1.5112120305273558E-6 evalInputDelta=0.31742843588976655
New Minimum: -35.04815483757476 > -37.37710649307384
END: th(1684339.7559414054)=-37.37710649307384; dx=-1.2743176898225854E-6 evalInputDelta=2.646380091388849
Fitness changed from -34.73072640168499 to -37.37710649307384
Iteration 2 complete. Error: -37.37710649307384 Total: 68.1490; Orientation: 0.1437; Line Search: 60.8833
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 54e4c436 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-37.37710649307384;dx=-1.2056218279311103E-6
New Minimum: -37.37710649307384 > -41.26308909925205
END: th(3628800.0000000005)=-41.26308909925205; dx=-7.577212295920607E-7 evalInputDelta=3.88598260617821
Fitness changed from -37.37710649307384 to -41.26308909925205
Iteration 3 complete. Error: -41.26308909925205 Total: 19.0947; Orientation: 0.1397; Line Search: 12.1078
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 6b32c6c8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.434e+03, gradient 8.616e-04, dot -0.769; [a806ee00-ce12-4cac-ac5e-aabfa055e329 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -41.26308909925205, -37.37710649307384, -34.73072640168499, -34.730723139706555
LBFGS Accumulation History: 3 points
Removed measurement 6b32c6c8 to history. Total: 3
th(0)=-41.26308909925205;dx=-7.413479106915084E-7
New Minimum: -41.26308909925205 > -46.09661763618489
END: th(7818012.603187701)=-46.09661763618489; dx=-4.018464940745695E-7 evalInputDelta=4.833528536932839
Fitness changed from -41.26308909925205 to -46.09661763618489
Iteration 4 complete. Error: -46.09661763618489 Total: 21.8163; Orientation: 2.5726; Line Search: 11.9116
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 36a44bd5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.432e+03, gradient 7.873e-04, dot -0.587; [a806ee00-ce12-4cac-ac5e-aabfa055e329 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.09661763618489, -37.37710649307384, -34.73072640168499, -34.730723139706555
LBFGS Accumulation History: 3 points
Removed measurement 36a44bd5 to history. Total: 3
th(0)=-46.09661763618489;dx=-6.196126362622544E-7
New Minimum: -46.09661763618489 > -51.06763536117242
END: th(1.6843397559414055E7)=-51.06763536117242; dx=-1.0380447812097767E-7 evalInputDelta=4.971017724987533
Fitness changed from -46.09661763618489 to -51.06763536117242
Iteration 5 complete. Error: -51.06763536117242 Total: 21.6639; Orientation: 2.6262; Line Search: 12.1590
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 76499439 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.031e+04, gradient 1.008e-03, dot -0.302; [a806ee00-ce12-4cac-ac5e-aabfa055e329 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -51.06763536117242, -37.37710649307384, -34.73072640168499, -34.730723139706555
LBFGS Accumulation History: 3 points
Removed measurement 76499439 to history. Total: 3
th(0)=-51.06763536117242;dx=-1.0145243955333015E-6
Armijo: th(3.628800000000001E7)=-47.81700113866837; dx=2.0050188805577473E-7 evalInputDelta=-3.250634222504054
New Minimum: -51.06763536117242 > -53.46629581964606
WOLF (strong): th(1.8144000000000004E7)=-53.46629581964606; dx=3.04375375913595E-7 evalInputDelta=2.3986604584736355
New Minimum: -53.46629581964606 > -55.56916887538476
END: th(6048000.000000001)=-55.56916887538476; dx=-2.823334739110084E-7 evalInputDelta=4.5015335142123405
Fitness changed from -51.06763536117242 to -55.56916887538476
Iteration 6 complete. Error: -55.56916887538476 Total: 33.8784; Orientation: 2.5262; Line Search: 24.3910
Adding measurement e5d5b88 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.169e+04, gradient 7.181e-04, dot -0.596; [a806ee00-ce12-4cac-ac5e-aabfa055e329 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -55.56916887538476, -37.37710649307384, -34.73072640168499, -34.730723139706555
LBFGS Accumulation History: 3 points
Removed measurement e5d5b88 to history. Total: 3
th(0)=-55.56916887538476;dx=-5.154974941250858E-7
New Minimum: -55.56916887538476 > -59.43363207263676
END: th(1.3030021005312836E7)=-59.43363207263676; dx=-1.0092023581997214E-7 evalInputDelta=3.8644631972520003
Fitness changed from -55.56916887538476 to -59.43363207263676
Iteration 7 complete. Error: -59.43363207263676 Total: 20.2910; Orientation: 2.7806; Line Search: 11.6578
Adding measurement 36fd3873 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.772e+04, gradient 8.765e-04, dot -0.440; [a806ee00-ce12-4cac-ac5e-aabfa055e329 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.43363207263676, -37.37710649307384, -34.73072640168499, -34.730723139706555
LBFGS Accumulation History: 3 points
Removed measurement 36fd3873 to history. Total: 3
th(0)=-59.43363207263676;dx=-7.676307313309835E-7
Armijo: th(2.8072329265690096E7)=-58.53869051123214; dx=1.973560536360775E-7 evalInputDelta=-0.8949415614046217
New Minimum: -59.43363207263676 > -62.113792137077084
WOLF (strong): th(1.4036164632845048E7)=-62.113792137077084; dx=1.8553140661487992E-7 evalInputDelta=2.6801600644403223
New Minimum: -62.113792137077084 > -62.33139671171134
END: th(4678721.544281683)=-62.33139671171134; dx=-3.2467736490372374E-7 evalInputDelta=2.8977646390745804
Fitness changed from -59.43363207263676 to -62.33139671171134
Iteration 8 complete. Error: -62.33139671171134 Total: 31.8305; Orientation: 2.4658; Line Search: 23.4619
Adding measurement 42435a4e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.962e+04, gradient 6.056e-04, dot -0.720; [a806ee00-ce12-4cac-ac5e-aabfa055e329 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -62.33139671171134, -37.37710649307384, -34.73072640168499, -34.730723139706555
LBFGS Accumulation History: 3 points
Removed measurement 42435a4e to history. Total: 3
th(0)=-62.33139671171134;dx=-3.665259629835174E-7
New Minimum: -62.33139671171134 > -65.55265818044639
END: th(1.0080000000000004E7)=-65.55265818044639; dx=-2.3537514804675596E-7 evalInputDelta=3.221261468735044
Fitness changed from -62.33139671171134 to -65.55265818044639
Iteration 9 complete. Error: -65.55265818044639 Total: 20.8225; Orientation: 2.4806; Line Search: 12.2079
Adding measurement 2f293776 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.770e+04, gradient 6.426e-04, dot -0.655; [a806ee00-ce12-4cac-ac5e-aabfa055e329 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -65.55265818044639, -37.37710649307384, -34.73072640168499, -34.730723139706555
LBFGS Accumulation History: 3 points
Removed measurement 2f293776 to history. Total: 3
th(0)=-65.55265818044639;dx=-4.125224952395528E-7
New Minimum: -65.55265818044639 > -69.43482560767688
END: th(2.1716701675521396E7)=-69.43482560767688; dx=-5.539025864051265E-8 evalInputDelta=3.882167427230499
Fitness changed from -65.55265818044639 to -69.43482560767688
Iteration 10 complete. Error: -69.43482560767688 Total: 20.5864; Orientation: 2.4802; Line Search: 12.3258
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -69.43482560767688 (> -Infinity) after 290.159s (< 5400.000s)
Returns
-69.43482560767688