BasicOptimizer.scala:89 executed in 208.26 seconds (2.943 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 15307458657753
Reset training subject: 15312205032558
Adding measurement 4adf7ecc to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-0.2307037115097046;dx=-7.50555699145585E-7
New Minimum: -0.2307037115097046 > -0.23070435225963593
END: th(2.154434690031884)=-0.23070435225963593; dx=-6.73750342104482E-7 evalInputDelta=6.407499313354492E-7
Fitness changed from -0.2307037115097046 to -0.23070435225963593
Iteration 1 complete. Error: -0.23070435225963593 Total: 23.1353; Orientation: 0.0484; Line Search: 8.4491
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 766575e5 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-0.23070435225963593;dx=-6.738034318953546E-7
New Minimum: -0.23070435225963593 > -0.23070600628852844
WOLFE (weak): th(4.641588833612779)=-0.23070600628852844; dx=-6.737561519039989E-7 evalInputDelta=1.6540288925170898E-6
New Minimum: -0.23070600628852844 > -0.2307075560092926
WOLFE (weak): th(9.283177667225559)=-0.2307075560092926; dx=-6.73749249910371E-7 evalInputDelta=3.203749656677246E-6
New Minimum: -0.2307075560092926 > -0.2307138442993164
WOLFE (weak): th(27.849533001676676)=-0.2307138442993164; dx=-6.737437168362993E-7 evalInputDelta=9.492039680480957E-6
New Minimum: -0.2307138442993164 > -0.23074208199977875
WOLFE (weak): th(111.3981320067067)=-0.23074208199977875; dx=-6.737672917636773E-7 evalInputDelta=3.7729740142822266E-5
New Minimum: -0.23074208199977875 > -0.230892151594162
WOLFE (weak): th(556.9906600335335)=-0.230892151594162; dx=-6.736930229462882E-7 evalInputDelta=1.87799334526062E-4
New Minimum: -0.230892151594162 > -0.2318299412727356
WOLFE (weak): th(3341.9439602012008)=-0.2318299412727356; dx=-6.733101443153893E-7 evalInputDelta=0.0011255890130996704
New Minimum: -0.2318299412727356 > -0.2385636419057846
WOLFE (weak): th(23393.607721408407)=-0.2385636419057846; dx=-6.699343848911099E-7 evalInputDelta=0.007859289646148682
New Minimum: -0.2385636419057846 > -0.2922115623950958
WOLFE (weak): th(187148.86177126726)=-0.2922115623950958; dx=-6.38909092651245E-7 evalInputDelta=0.0615072101354599
New Minimum: -0.2922115623950958 > -0.6385607868432999
END: th(1684339.7559414054)=-0.6385607868432999; dx=-3.185239185796125E-7 evalInputDelta=0.40785643458366394
Fitness changed from -0.23070435225963593 to -0.6385607868432999
Iteration 2 complete. Error: -0.6385607868432999 Total: 47.8103; Orientation: 0.0453; Line Search: 43.0221
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 78641d85 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-0.6385607868432999;dx=-3.356851443729027E-7
New Minimum: -0.6385607868432999 > -1.02544304728508
END: th(3628800.0000000005)=-1.02544304728508; dx=-1.3226418646123372E-7 evalInputDelta=0.3868822604417801
Fitness changed from -0.6385607868432999 to -1.02544304728508
Iteration 3 complete. Error: -1.02544304728508 Total: 13.0643; Orientation: 0.0458; Line Search: 8.3945
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2aea04da to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.072e+03, gradient 4.016e-04, dot -0.605; [cbdf252f-d393-4f0f-b298-cc02015236d6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.02544304728508, -0.6385607868432999, -0.23070435225963593, -0.2307037115097046
LBFGS Accumulation History: 3 points
Removed measurement 2aea04da to history. Total: 3
th(0)=-1.02544304728508;dx=-1.6126523950489437E-7
New Minimum: -1.02544304728508 > -1.367430105805397
END: th(7818012.603187701)=-1.367430105805397; dx=-4.1733301968563184E-8 evalInputDelta=0.3419870585203171
Fitness changed from -1.02544304728508 to -1.367430105805397
Iteration 4 complete. Error: -1.367430105805397 Total: 13.6769; Orientation: 1.0172; Line Search: 8.4042
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 12a6dead to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.697e+03, gradient 3.151e-04, dot -0.434; [cbdf252f-d393-4f0f-b298-cc02015236d6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.367430105805397, -0.6385607868432999, -0.23070435225963593, -0.2307037115097046
LBFGS Accumulation History: 3 points
Removed measurement 12a6dead to history. Total: 3
th(0)=-1.367430105805397;dx=-9.929926046624587E-8
New Minimum: -1.367430105805397 > -1.5847120136022568
WOLF (strong): th(1.6843397559414055E7)=-1.5847120136022568; dx=5.519591261518139E-9 evalInputDelta=0.21728190779685974
END: th(8421698.779707028)=-1.5721375793218613; dx=-1.642589643748006E-8 evalInputDelta=0.20470747351646423
Fitness changed from -1.367430105805397 to -1.5847120136022568
Iteration 5 complete. Error: -1.5847120136022568 Total: 18.3788; Orientation: 1.0879; Line Search: 13.0640
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement eacc199 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.012e+03, gradient 3.151e-04, dot -0.142; [cbdf252f-d393-4f0f-b298-cc02015236d6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.5847120136022568, -0.6385607868432999, -0.23070435225963593, -0.2307037115097046
LBFGS Accumulation History: 3 points
Removed measurement eacc199 to history. Total: 3
th(0)=-1.5847120136022568;dx=-9.931752174063084E-8
New Minimum: -1.5847120136022568 > -1.7262345254421234
WOLF (strong): th(1.8144000000000004E7)=-1.7262345254421234; dx=2.5222792638888067E-8 evalInputDelta=0.14152251183986664
New Minimum: -1.7262345254421234 > -1.7772052735090256
END: th(9072000.000000002)=-1.7772052735090256; dx=-7.207665098221082E-9 evalInputDelta=0.1924932599067688
Fitness changed from -1.5847120136022568 to -1.7772052735090256
Iteration 6 complete. Error: -1.7772052735090256 Total: 19.0497; Orientation: 1.0061; Line Search: 14.2120
Adding measurement 33304463 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.481e+03, gradient 2.010e-04, dot -0.282; [cbdf252f-d393-4f0f-b298-cc02015236d6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.7772052735090256, -0.6385607868432999, -0.23070435225963593, -0.2307037115097046
LBFGS Accumulation History: 3 points
Removed measurement 33304463 to history. Total: 3
th(0)=-1.7772052735090256;dx=-4.038652852199946E-8
New Minimum: -1.7772052735090256 > -1.8873852044343948
WOLF (strong): th(1.9545031507969253E7)=-1.8873852044343948; dx=9.887899282130363E-9 evalInputDelta=0.11017993092536926
New Minimum: -1.8873852044343948 > -1.8927147090435028
END: th(9772515.753984626)=-1.8927147090435028; dx=-9.416711412306283E-9 evalInputDelta=0.11550943553447723
Fitness changed from -1.7772052735090256 to -1.8927147090435028
Iteration 7 complete. Error: -1.8927147090435028 Total: 18.6177; Orientation: 1.0116; Line Search: 13.0446
Adding measurement 68fddd4c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.885e+03, gradient 1.642e-04, dot -0.378; [cbdf252f-d393-4f0f-b298-cc02015236d6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.8927147090435028, -0.6385607868432999, -0.23070435225963593, -0.2307037115097046
LBFGS Accumulation History: 3 points
Removed measurement 68fddd4c to history. Total: 3
th(0)=-1.8927147090435028;dx=-2.6959239298536987E-8
New Minimum: -1.8927147090435028 > -1.979693442583084
WOLF (strong): th(2.105424694926757E7)=-1.979693442583084; dx=1.9381997452167724E-9 evalInputDelta=0.0869787335395813
END: th(1.0527123474633785E7)=-1.9717979580163956; dx=-6.0373274992547466E-9 evalInputDelta=0.07908324897289276
Fitness changed from -1.8927147090435028 to -1.979693442583084
Iteration 8 complete. Error: -1.979693442583084 Total: 17.7176; Orientation: 1.0254; Line Search: 12.8447
Adding measurement 4f8a3e9a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.384e+03, gradient 2.037e-04, dot -0.186; [cbdf252f-d393-4f0f-b298-cc02015236d6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.979693442583084, -0.6385607868432999, -0.23070435225963593, -0.2307037115097046
LBFGS Accumulation History: 3 points
Removed measurement 4f8a3e9a to history. Total: 3
th(0)=-1.979693442583084;dx=-4.147580829795677E-8
New Minimum: -1.979693442583084 > -1.9861271232366562
WOLF (strong): th(2.2680000000000007E7)=-1.9861271232366562; dx=2.1905438849655018E-8 evalInputDelta=0.0064336806535720825
New Minimum: -1.9861271232366562 > -2.0716856569051743
WOLF (strong): th(1.1340000000000004E7)=-2.0716856569051743; dx=4.189353203524007E-9 evalInputDelta=0.09199221432209015
END: th(3780000.0000000014)=-2.040597140789032; dx=-2.2958672339161358E-8 evalInputDelta=0.060903698205947876
Fitness changed from -1.979693442583084 to -2.0716856569051743
Iteration 9 complete. Error: -2.0716856569051743 Total: 22.6537; Orientation: 1.0031; Line Search: 17.0614
Adding measurement 3a96b135 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.878e+03, gradient 1.579e-04, dot -0.286; [cbdf252f-d393-4f0f-b298-cc02015236d6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2.0716856569051743, -0.6385607868432999, -0.23070435225963593, -0.2307037115097046
LBFGS Accumulation History: 3 points
Removed measurement 3a96b135 to history. Total: 3
th(0)=-2.0716856569051743;dx=-2.494802331966408E-8
New Minimum: -2.0716856569051743 > -2.1281568855047226
END: th(8143763.128320524)=-2.1281568855047226; dx=-4.808106654876507E-9 evalInputDelta=0.05647122859954834
Fitness changed from -2.0716856569051743 to -2.1281568855047226
Iteration 10 complete. Error: -2.1281568855047226 Total: 14.0867; Orientation: 1.0005; Line Search: 8.6142
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2.1281568855047226 (> -Infinity) after 208.262s (< 5400.000s)
Returns
-2.1281568855047226