BasicOptimizer.scala:89 executed in 306.16 seconds (4.024 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 648804120285400
Reset training subject: 648810080124500
Adding measurement 64200141 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-37.61191380049099;dx=-1.8373575569313637E-6
New Minimum: -37.61191380049099 > -37.61191580855813
END: th(2.154434690031884)=-37.61191580855813; dx=-1.6229902845504927E-6 evalInputDelta=2.0080671419009377E-6
Fitness changed from -37.61191380049099 to -37.61191580855813
Iteration 1 complete. Error: -37.61191580855813 Total: 30.3103; Orientation: 0.1462; Line Search: 12.2070
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2b82e5c8 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-37.61191580855813;dx=-1.6207340107101454E-6
New Minimum: -37.61191580855813 > -37.61192584889222
WOLFE (weak): th(4.641588833612779)=-37.61192584889222; dx=-1.6203687143476202E-6 evalInputDelta=1.0040334089467251E-5
New Minimum: -37.61192584889222 > -37.61193388115756
WOLFE (weak): th(9.283177667225559)=-37.61193388115756; dx=-1.6194642022482157E-6 evalInputDelta=1.807259943120698E-5
New Minimum: -37.61193388115756 > -37.611968018266126
WOLFE (weak): th(27.849533001676676)=-37.611968018266126; dx=-1.619259420759613E-6 evalInputDelta=5.220970799513225E-5
New Minimum: -37.611968018266126 > -37.61211862278698
WOLFE (weak): th(111.3981320067067)=-37.61211862278698; dx=-1.6182828180164741E-6 evalInputDelta=2.0281422884949052E-4
New Minimum: -37.61211862278698 > -37.6129218367137
WOLFE (weak): th(556.9906600335335)=-37.6129218367137; dx=-1.618611380927285E-6 evalInputDelta=0.0010060281555723805
New Minimum: -37.6129218367137 > -37.61793551196132
WOLFE (weak): th(3341.9439602012008)=-37.61793551196132; dx=-1.618205847904223E-6 evalInputDelta=0.006019703403190135
New Minimum: -37.61793551196132 > -37.65400744709212
WOLFE (weak): th(23393.607721408407)=-37.65400744709212; dx=-1.6158210682433374E-6 evalInputDelta=0.04209163853398934
New Minimum: -37.65400744709212 > -37.946720676110985
WOLFE (weak): th(187148.86177126726)=-37.946720676110985; dx=-1.5973696647887569E-6 evalInputDelta=0.33480486755285455
New Minimum: -37.946720676110985 > -40.431072483529334
END: th(1684339.7559414054)=-40.431072483529334; dx=-1.3758864167276882E-6 evalInputDelta=2.819156674971204
Fitness changed from -37.61191580855813 to -40.431072483529334
Iteration 2 complete. Error: -40.431072483529334 Total: 70.0195; Orientation: 0.1478; Line Search: 62.6900
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7b0f4d66 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-40.431072483529334;dx=-1.2997746242779798E-6
New Minimum: -40.431072483529334 > -44.74132678909488
END: th(3628800.0000000005)=-44.74132678909488; dx=-8.631263902628756E-7 evalInputDelta=4.310254305565543
Fitness changed from -40.431072483529334 to -44.74132678909488
Iteration 3 complete. Error: -44.74132678909488 Total: 19.9471; Orientation: 0.1435; Line Search: 12.4417
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 274c5fc7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.186e+03, gradient 9.049e-04, dot -0.807; [66947a0a-54e5-48ab-a778-6fc5dab593fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -44.74132678909488, -40.431072483529334, -37.61191580855813, -37.61191380049099
LBFGS Accumulation History: 3 points
Removed measurement 274c5fc7 to history. Total: 3
th(0)=-44.74132678909488;dx=-8.1789424775528E-7
New Minimum: -44.74132678909488 > -50.224161036020234
END: th(7818012.603187701)=-50.224161036020234; dx=-4.658212787231835E-7 evalInputDelta=5.482834246925357
Fitness changed from -44.74132678909488 to -50.224161036020234
Iteration 4 complete. Error: -50.224161036020234 Total: 22.3080; Orientation: 2.6181; Line Search: 12.4327
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 6c30a7ce to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.997e+03, gradient 7.932e-04, dot -0.616; [66947a0a-54e5-48ab-a778-6fc5dab593fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -50.224161036020234, -40.431072483529334, -37.61191580855813, -37.61191380049099
LBFGS Accumulation History: 3 points
Removed measurement 6c30a7ce to history. Total: 3
th(0)=-50.224161036020234;dx=-6.275249492492518E-7
New Minimum: -50.224161036020234 > -56.355703168751475
END: th(1.6843397559414055E7)=-56.355703168751475; dx=-1.628717783529398E-7 evalInputDelta=6.131542132731241
Fitness changed from -50.224161036020234 to -56.355703168751475
Iteration 5 complete. Error: -56.355703168751475 Total: 22.0945; Orientation: 2.6806; Line Search: 12.1558
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 14287f2f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.264e+04, gradient 9.620e-04, dot -0.360; [66947a0a-54e5-48ab-a778-6fc5dab593fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -56.355703168751475, -40.431072483529334, -37.61191580855813, -37.61191380049099
LBFGS Accumulation History: 3 points
Removed measurement 14287f2f to history. Total: 3
th(0)=-56.355703168751475;dx=-9.24856519455706E-7
Armijo: th(3.628800000000001E7)=-54.28898731131093; dx=1.8837938621947618E-7 evalInputDelta=-2.066715857440542
New Minimum: -56.355703168751475 > -59.227307975626076
WOLF (strong): th(1.8144000000000004E7)=-59.227307975626076; dx=2.418345368106028E-7 evalInputDelta=2.8716048068746005
New Minimum: -59.227307975626076 > -60.50301798199119
END: th(6048000.000000001)=-60.50301798199119; dx=-2.878833995864882E-7 evalInputDelta=4.147314813239717
Fitness changed from -56.355703168751475 to -60.50301798199119
Iteration 6 complete. Error: -60.50301798199119 Total: 34.4830; Orientation: 2.6038; Line Search: 24.6469
Adding measurement 24f209ff to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.153e+04, gradient 7.009e-04, dot -0.626; [66947a0a-54e5-48ab-a778-6fc5dab593fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -60.50301798199119, -40.431072483529334, -37.61191580855813, -37.61191380049099
LBFGS Accumulation History: 3 points
Removed measurement 24f209ff to history. Total: 3
th(0)=-60.50301798199119;dx=-4.906646628950633E-7
New Minimum: -60.50301798199119 > -64.60350753777567
END: th(1.3030021005312836E7)=-64.60350753777567; dx=-1.451500229849925E-7 evalInputDelta=4.100489555784478
Fitness changed from -60.50301798199119 to -64.60350753777567
Iteration 7 complete. Error: -64.60350753777567 Total: 21.2046; Orientation: 2.5452; Line Search: 12.6223
Adding measurement 1a91252e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.812e+04, gradient 8.366e-04, dot -0.479; [66947a0a-54e5-48ab-a778-6fc5dab593fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -64.60350753777567, -40.431072483529334, -37.61191580855813, -37.61191380049099
LBFGS Accumulation History: 3 points
Removed measurement 1a91252e to history. Total: 3
th(0)=-64.60350753777567;dx=-6.999445434650333E-7
New Minimum: -64.60350753777567 > -64.82818052477367
WOLF (strong): th(2.8072329265690096E7)=-64.82818052477367; dx=1.606205942368158E-7 evalInputDelta=0.22467298699800153
New Minimum: -64.82818052477367 > -67.56057771486094
WOLF (strong): th(1.4036164632845048E7)=-67.56057771486094; dx=1.1907301227105307E-7 evalInputDelta=2.9570701770852708
END: th(4678721.544281683)=-67.28492682732455; dx=-3.21704067017833E-7 evalInputDelta=2.6814192895488844
Fitness changed from -64.60350753777567 to -67.56057771486094
Iteration 8 complete. Error: -67.56057771486094 Total: 33.7521; Orientation: 2.6823; Line Search: 24.8037
Adding measurement 4c42f15e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.835e+04, gradient 9.715e-04, dot -0.345; [66947a0a-54e5-48ab-a778-6fc5dab593fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -67.56057771486094, -40.431072483529334, -37.61191580855813, -37.61191380049099
LBFGS Accumulation History: 3 points
Removed measurement 4c42f15e to history. Total: 3
th(0)=-67.56057771486094;dx=-9.437711915205371E-7
New Minimum: -67.56057771486094 > -72.71121096799854
WOLF (strong): th(1.0080000000000004E7)=-72.71121096799854; dx=6.974618338180089E-8 evalInputDelta=5.150633253137599
END: th(5040000.000000002)=-71.67401738982542; dx=-4.887734760680265E-7 evalInputDelta=4.113439674964482
Fitness changed from -67.56057771486094 to -72.71121096799854
Iteration 9 complete. Error: -72.71121096799854 Total: 28.4898; Orientation: 2.7594; Line Search: 19.5031
Adding measurement 1c9ac78 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.395e+04, gradient 7.545e-04, dot -0.507; [66947a0a-54e5-48ab-a778-6fc5dab593fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -72.71121096799854, -40.431072483529334, -37.61191580855813, -37.61191380049099
LBFGS Accumulation History: 3 points
Removed measurement 1c9ac78 to history. Total: 3
th(0)=-72.71121096799854;dx=-5.684235580054665E-7
New Minimum: -72.71121096799854 > -75.89182915171176
END: th(1.0858350837760698E7)=-75.89182915171176; dx=-6.6972221202402386E-9 evalInputDelta=3.1806181837132215
Fitness changed from -72.71121096799854 to -75.89182915171176
Iteration 10 complete. Error: -75.89182915171176 Total: 22.3553; Orientation: 3.0685; Line Search: 13.0007
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -75.89182915171176 (> -Infinity) after 306.161s (< 5400.000s)
Returns
-75.89182915171176