BasicOptimizer.scala:89 executed in 131.15 seconds (2.219 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 108922948800500
Reset training subject: 108925751849200
Adding measurement 1f41742f to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-40.240939994753;dx=-1.04943286797741E-6
New Minimum: -40.240939994753 > -40.240942096210226
END: th(2.154434690031884)=-40.240942096210226; dx=-8.551875265658897E-7 evalInputDelta=2.1014572268995835E-6
Fitness changed from -40.240939994753 to -40.240942096210226
Iteration 1 complete. Error: -40.240942096210226 Total: 13.4050; Orientation: 0.0652; Line Search: 5.3535
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6f1f1a7d to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-40.240942096210226;dx=-8.532888635865154E-7
New Minimum: -40.240942096210226 > -40.24094840058125
WOLFE (weak): th(4.641588833612779)=-40.24094840058125; dx=-8.530569533402368E-7 evalInputDelta=6.3043710269994335E-6
New Minimum: -40.24094840058125 > -40.24095050203804
WOLFE (weak): th(9.283177667225559)=-40.24095050203804; dx=-8.526773592417841E-7 evalInputDelta=8.40582781336252E-6
New Minimum: -40.24095050203804 > -40.2409694151442
WOLFE (weak): th(27.849533001676676)=-40.2409694151442; dx=-8.52328690249041E-7 evalInputDelta=2.7318933973674575E-5
New Minimum: -40.2409694151442 > -40.241045067479945
WOLFE (weak): th(111.3981320067067)=-40.241045067479945; dx=-8.526614547605042E-7 evalInputDelta=1.0297126971892112E-4
New Minimum: -40.241045067479945 > -40.24146745707401
WOLFE (weak): th(556.9906600335335)=-40.24146745707401; dx=-8.518248741979848E-7 evalInputDelta=5.253608637829643E-4
New Minimum: -40.24146745707401 > -40.24408365205491
WOLFE (weak): th(3341.9439602012008)=-40.24408365205491; dx=-8.518037801876239E-7 evalInputDelta=0.0031415558446852287
New Minimum: -40.24408365205491 > -40.26290053550365
WOLFE (weak): th(23393.607721408407)=-40.26290053550365; dx=-8.504018488198196E-7 evalInputDelta=0.021958439293420895
New Minimum: -40.26290053550365 > -40.41354078540739
WOLFE (weak): th(187148.86177126726)=-40.41354078540739; dx=-8.19434302295416E-7 evalInputDelta=0.1725986891971658
New Minimum: -40.41354078540739 > -41.61089938692511
END: th(1684339.7559414054)=-41.61089938692511; dx=-6.501591077700657E-7 evalInputDelta=1.3699572907148863
Fitness changed from -40.240942096210226 to -41.61089938692511
Iteration 2 complete. Error: -41.61089938692511 Total: 30.0775; Orientation: 0.0557; Line Search: 26.8852
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 5125159e to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-41.61089938692511;dx=-6.413654183768909E-7
New Minimum: -41.61089938692511 > -43.69906249152686
END: th(3628800.0000000005)=-43.69906249152686; dx=-4.4187334643928536E-7 evalInputDelta=2.0881631046017475
Fitness changed from -41.61089938692511 to -43.69906249152686
Iteration 3 complete. Error: -43.69906249152686 Total: 8.6189; Orientation: 0.1077; Line Search: 5.4762
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 69bb8812 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.152e+03, gradient 6.728e-04, dot -0.812; [c0d337b7-5562-4364-a6d5-615feb3d529f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -43.69906249152686, -41.61089938692511, -40.240942096210226, -40.240939994753
LBFGS Accumulation History: 3 points
Removed measurement 69bb8812 to history. Total: 3
th(0)=-43.69906249152686;dx=-4.5159112716754025E-7
New Minimum: -43.69906249152686 > -46.79518214380811
END: th(7818012.603187701)=-46.79518214380811; dx=-2.93166533114679E-7 evalInputDelta=3.096119652281253
Fitness changed from -43.69906249152686 to -46.79518214380811
Iteration 4 complete. Error: -46.79518214380811 Total: 9.4190; Orientation: 1.1348; Line Search: 5.2700
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5b3f2fe1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.166e+04, gradient 6.232e-04, dot -0.711; [c0d337b7-5562-4364-a6d5-615feb3d529f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.79518214380811, -41.61089938692511, -40.240942096210226, -40.240939994753
LBFGS Accumulation History: 3 points
Removed measurement 5b3f2fe1 to history. Total: 3
th(0)=-46.79518214380811;dx=-3.8796601058986573E-7
New Minimum: -46.79518214380811 > -50.735338138570874
END: th(1.6843397559414055E7)=-50.735338138570874; dx=-1.3201380618226245E-7 evalInputDelta=3.940155994762762
Fitness changed from -46.79518214380811 to -50.735338138570874
Iteration 5 complete. Error: -50.735338138570874 Total: 10.1733; Orientation: 1.3619; Line Search: 5.5556
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7ee0a60a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.263e+04, gradient 7.092e-04, dot -0.414; [c0d337b7-5562-4364-a6d5-615feb3d529f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -50.735338138570874, -41.61089938692511, -40.240942096210226, -40.240939994753
LBFGS Accumulation History: 3 points
Removed measurement 7ee0a60a to history. Total: 3
th(0)=-50.735338138570874;dx=-5.021371471275561E-7
New Minimum: -50.735338138570874 > -51.4656729743659
WOLF (strong): th(3.628800000000001E7)=-51.4656729743659; dx=8.255093435164605E-8 evalInputDelta=0.730334835795027
New Minimum: -51.4656729743659 > -53.24065215742996
WOLF (strong): th(1.8144000000000004E7)=-53.24065215742996; dx=5.908936670491344E-8 evalInputDelta=2.5053140188590888
END: th(6048000.000000001)=-53.04085397551968; dx=-1.9423934567398404E-7 evalInputDelta=2.305515836948807
Fitness changed from -50.735338138570874 to -53.24065215742996
Iteration 6 complete. Error: -53.24065215742996 Total: 14.8146; Orientation: 1.1014; Line Search: 10.6013
Adding measurement 31fafc3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.385e+04, gradient 8.098e-04, dot -0.270; [c0d337b7-5562-4364-a6d5-615feb3d529f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.24065215742996, -41.61089938692511, -40.240942096210226, -40.240939994753
LBFGS Accumulation History: 3 points
Removed measurement 31fafc3 to history. Total: 3
th(0)=-53.24065215742996;dx=-6.557662901832275E-7
New Minimum: -53.24065215742996 > -57.32321794851353
WOLF (strong): th(1.3030021005312836E7)=-57.32321794851353; dx=6.73496697791644E-8 evalInputDelta=4.082565791083567
END: th(6515010.502656418)=-56.717154725974716; dx=-2.88105512721746E-7 evalInputDelta=3.4765025685447526
Fitness changed from -53.24065215742996 to -57.32321794851353
Iteration 7 complete. Error: -57.32321794851353 Total: 11.8279; Orientation: 1.0768; Line Search: 8.0601
Adding measurement 76419338 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.355e+04, gradient 6.872e-04, dot -0.391; [c0d337b7-5562-4364-a6d5-615feb3d529f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -57.32321794851353, -41.61089938692511, -40.240942096210226, -40.240939994753
LBFGS Accumulation History: 3 points
Removed measurement 76419338 to history. Total: 3
th(0)=-57.32321794851353;dx=-4.717478393121905E-7
New Minimum: -57.32321794851353 > -59.79580061318947
WOLF (strong): th(1.4036164632845048E7)=-59.79580061318947; dx=8.549008640785304E-8 evalInputDelta=2.47258266467594
END: th(7018082.316422524)=-59.74248325072495; dx=-1.5167865834461013E-7 evalInputDelta=2.4192653022114214
Fitness changed from -57.32321794851353 to -59.79580061318947
Iteration 8 complete. Error: -59.79580061318947 Total: 11.7787; Orientation: 1.0755; Line Search: 7.9283
Adding measurement 4f900cf9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.777e+04, gradient 7.061e-04, dot -0.363; [c0d337b7-5562-4364-a6d5-615feb3d529f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.79580061318947, -41.61089938692511, -40.240942096210226, -40.240939994753
LBFGS Accumulation History: 3 points
Removed measurement 4f900cf9 to history. Total: 3
th(0)=-59.79580061318947;dx=-4.979446744793256E-7
New Minimum: -59.79580061318947 > -61.81539874508476
WOLF (strong): th(1.5120000000000006E7)=-61.81539874508476; dx=1.507220324011544E-7 evalInputDelta=2.019598131895286
New Minimum: -61.81539874508476 > -62.330047294824
END: th(7560000.000000003)=-62.330047294824; dx=-1.0110142515324517E-7 evalInputDelta=2.534246681634528
Fitness changed from -59.79580061318947 to -62.330047294824
Iteration 9 complete. Error: -62.330047294824 Total: 11.8245; Orientation: 1.0669; Line Search: 8.0354
Adding measurement 181ae1b4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.847e+04, gradient 4.800e-04, dot -0.611; [c0d337b7-5562-4364-a6d5-615feb3d529f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -62.330047294824, -41.61089938692511, -40.240942096210226, -40.240939994753
LBFGS Accumulation History: 3 points
Removed measurement 181ae1b4 to history. Total: 3
th(0)=-62.330047294824;dx=-2.298974180783315E-7
New Minimum: -62.330047294824 > -64.37760475955272
END: th(1.6287526256641047E7)=-64.37760475955272; dx=-4.581388813243844E-8 evalInputDelta=2.047557464728726
Fitness changed from -62.330047294824 to -64.37760475955272
Iteration 10 complete. Error: -64.37760475955272 Total: 8.7737; Orientation: 1.0736; Line Search: 5.2460
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -64.37760475955272 (> -Infinity) after 131.153s (< 5400.000s)
Returns
-64.37760475955272