BasicOptimizer.scala:89 executed in 205.31 seconds (1.955 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 7767800598191
Reset training subject: 7771876348132
Adding measurement 5dad5ef2 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-0.4330551326274872;dx=-5.967537032073021E-7
New Minimum: -0.4330551326274872 > -0.43305550515651703
WOLFE (weak): th(2.154434690031884)=-0.43305550515651703; dx=-5.580934561548387E-7 evalInputDelta=3.725290298461914E-7
New Minimum: -0.43305550515651703 > -0.43305614590644836
WOLFE (weak): th(4.308869380063768)=-0.43305614590644836; dx=-5.580931901116106E-7 evalInputDelta=1.0132789611816406E-6
New Minimum: -0.43305614590644836 > -0.4330587387084961
WOLFE (weak): th(12.926608140191302)=-0.4330587387084961; dx=-5.580908780413004E-7 evalInputDelta=3.606081008911133E-6
New Minimum: -0.4330587387084961 > -0.4330696165561676
WOLFE (weak): th(51.70643256076521)=-0.4330696165561676; dx=-5.5809470404867E-7 evalInputDelta=1.4483928680419922E-5
New Minimum: -0.4330696165561676 > -0.4331273287534714
WOLFE (weak): th(258.53216280382605)=-0.4331273287534714; dx=-5.580631142770505E-7 evalInputDelta=7.21961259841919E-5
New Minimum: -0.4331273287534714 > -0.4334879517555237
WOLFE (weak): th(1551.1929768229563)=-0.4334879517555237; dx=-5.578904919045066E-7 evalInputDelta=4.32819128036499E-4
New Minimum: -0.4334879517555237 > -0.4360809624195099
WOLFE (weak): th(10858.350837760694)=-0.4360809624195099; dx=-5.565392699738363E-7 evalInputDelta=0.003025829792022705
New Minimum: -0.4360809624195099 > -0.45702432096004486
WOLFE (weak): th(86866.80670208555)=-0.45702432096004486; dx=-5.454512150921894E-7 evalInputDelta=0.023969188332557678
New Minimum: -0.45702432096004486 > -0.6274642795324326
END: th(781801.26031877)=-0.6274642795324326; dx=-4.3348580314743685E-7 evalInputDelta=0.19440914690494537
Fitness changed from -0.4330551326274872 to -0.6274642795324326
Iteration 1 complete. Error: -0.6274642795324326 Total: 55.3073; Orientation: 0.0455; Line Search: 42.8490
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 39f79057 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-0.6274642795324326;dx=-3.8315554084036486E-7
New Minimum: -0.6274642795324326 > -0.8923050165176392
END: th(1684339.7559414052)=-0.8923050165176392; dx=-2.5140292449450875E-7 evalInputDelta=0.2648407369852066
Fitness changed from -0.6274642795324326 to -0.8923050165176392
Iteration 2 complete. Error: -0.8923050165176392 Total: 12.7041; Orientation: 0.0455; Line Search: 8.5434
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 705c59a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-0.8923050165176392;dx=-2.2450252885062573E-7
New Minimum: -0.8923050165176392 > -1.2007073312997818
END: th(3628800.0)=-1.2007073312997818; dx=-1.2488194588628827E-7 evalInputDelta=0.30840231478214264
Fitness changed from -0.8923050165176392 to -1.2007073312997818
Iteration 3 complete. Error: -1.2007073312997818 Total: 13.0878; Orientation: 0.0484; Line Search: 8.6368
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3f9ec941 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.135e+03, gradient 3.601e-04, dot -0.838; [958c8a44-96d7-4298-9463-ab3372a39010 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.2007073312997818, -0.8923050165176392, -0.6274642795324326, -0.4330551326274872
LBFGS Accumulation History: 3 points
Removed measurement 3f9ec941 to history. Total: 3
th(0)=-1.2007073312997818;dx=-1.2969701327759003E-7
New Minimum: -1.2007073312997818 > -1.50901098549366
END: th(7818012.6031877)=-1.50901098549366; dx=-4.550517620992755E-8 evalInputDelta=0.3083036541938782
Fitness changed from -1.2007073312997818 to -1.50901098549366
Iteration 4 complete. Error: -1.50901098549366 Total: 14.0170; Orientation: 1.0423; Line Search: 8.6526
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 7c18ec86 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.526e+03, gradient 2.978e-04, dot -0.634; [958c8a44-96d7-4298-9463-ab3372a39010 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.50901098549366, -0.8923050165176392, -0.6274642795324326, -0.4330551326274872
LBFGS Accumulation History: 3 points
Removed measurement 7c18ec86 to history. Total: 3
th(0)=-1.50901098549366;dx=-8.871069996225931E-8
New Minimum: -1.50901098549366 > -1.7081336677074432
WOLF (strong): th(1.684339755941405E7)=-1.7081336677074432; dx=2.7687915617030233E-9 evalInputDelta=0.19912268221378326
END: th(8421698.779707026)=-1.6912335455417633; dx=-1.3592758262318176E-8 evalInputDelta=0.18222256004810333
Fitness changed from -1.50901098549366 to -1.7081336677074432
Iteration 5 complete. Error: -1.7081336677074432 Total: 18.8513; Orientation: 1.0485; Line Search: 13.0503
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2a0570ef to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.649e+03, gradient 3.149e-04, dot -0.398; [958c8a44-96d7-4298-9463-ab3372a39010 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.7081336677074432, -0.8923050165176392, -0.6274642795324326, -0.4330551326274872
LBFGS Accumulation History: 3 points
Removed measurement 2a0570ef to history. Total: 3
th(0)=-1.7081336677074432;dx=-9.91629450866186E-8
New Minimum: -1.7081336677074432 > -1.8063000813126564
WOLF (strong): th(1.8144E7)=-1.8063000813126564; dx=3.079683014390764E-8 evalInputDelta=0.09816641360521317
New Minimum: -1.8063000813126564 > -1.887973926961422
END: th(9072000.0)=-1.887973926961422; dx=-8.541369265486258E-10 evalInputDelta=0.17984025925397873
Fitness changed from -1.7081336677074432 to -1.887973926961422
Iteration 6 complete. Error: -1.887973926961422 Total: 18.5635; Orientation: 1.0117; Line Search: 13.2405
Adding measurement 736f4810 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.939e+03, gradient 2.145e-04, dot -0.423; [958c8a44-96d7-4298-9463-ab3372a39010 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.887973926961422, -0.8923050165176392, -0.6274642795324326, -0.4330551326274872
LBFGS Accumulation History: 3 points
Removed measurement 736f4810 to history. Total: 3
th(0)=-1.887973926961422;dx=-4.6012076639390675E-8
New Minimum: -1.887973926961422 > -1.9731296971440315
WOLF (strong): th(1.954503150796925E7)=-1.9731296971440315; dx=1.8204506379167507E-8 evalInputDelta=0.08515577018260956
New Minimum: -1.9731296971440315 > -2.0064035058021545
END: th(9772515.753984625)=-2.0064035058021545; dx=-6.986787889507107E-9 evalInputDelta=0.11842957884073257
Fitness changed from -1.887973926961422 to -2.0064035058021545
Iteration 7 complete. Error: -2.0064035058021545 Total: 17.7944; Orientation: 1.0350; Line Search: 12.5072
Adding measurement 73ade122 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.226e+03, gradient 1.668e-04, dot -0.476; [958c8a44-96d7-4298-9463-ab3372a39010 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2.0064035058021545, -0.8923050165176392, -0.6274642795324326, -0.4330551326274872
LBFGS Accumulation History: 3 points
Removed measurement 73ade122 to history. Total: 3
th(0)=-2.0064035058021545;dx=-2.7807532706988056E-8
New Minimum: -2.0064035058021545 > -2.074452593922615
WOLF (strong): th(2.1054246949267566E7)=-2.074452593922615; dx=6.997363624755921E-9 evalInputDelta=0.06804908812046051
New Minimum: -2.074452593922615 > -2.0852510780096054
END: th(1.0527123474633783E7)=-2.0852510780096054; dx=-4.4301431145348686E-9 evalInputDelta=0.07884757220745087
Fitness changed from -2.0064035058021545 to -2.0852510780096054
Iteration 8 complete. Error: -2.0852510780096054 Total: 18.0859; Orientation: 1.0099; Line Search: 13.0159
Adding measurement 246854e1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.317e+03, gradient 1.537e-04, dot -0.473; [958c8a44-96d7-4298-9463-ab3372a39010 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2.0852510780096054, -0.8923050165176392, -0.6274642795324326, -0.4330551326274872
LBFGS Accumulation History: 3 points
Removed measurement 246854e1 to history. Total: 3
th(0)=-2.0852510780096054;dx=-2.3633310397641937E-8
New Minimum: -2.0852510780096054 > -2.1166150718927383
WOLF (strong): th(2.2680000000000004E7)=-2.1166150718927383; dx=8.592657841909183E-9 evalInputDelta=0.031363993883132935
New Minimum: -2.1166150718927383 > -2.145007446408272
WOLF (strong): th(1.1340000000000002E7)=-2.145007446408272; dx=1.5264534624930694E-10 evalInputDelta=0.05975636839866638
END: th(3780000.0000000005)=-2.121089719235897; dx=-1.4292770568771358E-8 evalInputDelta=0.035838641226291656
Fitness changed from -2.0852510780096054 to -2.145007446408272
Iteration 9 complete. Error: -2.145007446408272 Total: 22.4618; Orientation: 1.0317; Line Search: 17.3211
Adding measurement 1f431701 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.324e+03, gradient 1.564e-04, dot -0.429; [958c8a44-96d7-4298-9463-ab3372a39010 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2.145007446408272, -0.8923050165176392, -0.6274642795324326, -0.4330551326274872
LBFGS Accumulation History: 3 points
Removed measurement 1f431701 to history. Total: 3
th(0)=-2.145007446408272;dx=-2.4453174838746897E-8
New Minimum: -2.145007446408272 > -2.1953457295894623
END: th(8143763.128320522)=-2.1953457295894623; dx=-1.7194584176660778E-9 evalInputDelta=0.05033828318119049
Fitness changed from -2.145007446408272 to -2.1953457295894623
Iteration 10 complete. Error: -2.1953457295894623 Total: 14.3635; Orientation: 1.1082; Line Search: 8.5610
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2.1953457295894623 (> -Infinity) after 205.308s (< 5400.000s)
Returns
-2.1953457295894623