BasicOptimizer.scala:89 executed in 136.00 seconds (1.765 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 75015671333500
Reset training subject: 75018301922200
Adding measurement 285e50f5 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-18.523749229825643;dx=-7.770582306034454E-7
New Minimum: -18.523749229825643 > -18.52374992659921
END: th(2.154434690031884)=-18.52374992659921; dx=-6.365564322623734E-7 evalInputDelta=6.967735650675877E-7
Fitness changed from -18.523749229825643 to -18.52374992659921
Iteration 1 complete. Error: -18.52374992659921 Total: 12.8820; Orientation: 0.0608; Line Search: 5.1913
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 55553667 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-18.52374992659921;dx=-6.345929168355987E-7
New Minimum: -18.52374992659921 > -18.52375410724004
WOLFE (weak): th(4.641588833612779)=-18.52375410724004; dx=-6.342774908216559E-7 evalInputDelta=4.180640832629479E-6
New Minimum: -18.52375410724004 > -18.523756894333403
WOLFE (weak): th(9.283177667225559)=-18.523756894333403; dx=-6.342336234936534E-7 evalInputDelta=6.967734194063269E-6
New Minimum: -18.523756894333403 > -18.523771526566684
WOLFE (weak): th(27.849533001676676)=-18.523771526566684; dx=-6.341291790186703E-7 evalInputDelta=2.1599967475083304E-5
New Minimum: -18.523771526566684 > -18.523829358613668
WOLFE (weak): th(111.3981320067067)=-18.523829358613668; dx=-6.338389587084864E-7 evalInputDelta=7.943201445925752E-5
New Minimum: -18.523829358613668 > -18.524145689748174
WOLFE (weak): th(556.9906600335335)=-18.524145689748174; dx=-6.33863252935159E-7 evalInputDelta=3.957631489655E-4
New Minimum: -18.524145689748174 > -18.52611810851676
WOLFE (weak): th(3341.9439602012008)=-18.52611810851676; dx=-6.335024442925692E-7 evalInputDelta=0.0023681819175500607
New Minimum: -18.52611810851676 > -18.54029230550166
WOLFE (weak): th(23393.607721408407)=-18.54029230550166; dx=-6.31109145974395E-7 evalInputDelta=0.01654237890245014
New Minimum: -18.54029230550166 > -18.653539626110728
WOLFE (weak): th(187148.86177126726)=-18.653539626110728; dx=-6.048783245084064E-7 evalInputDelta=0.12978969951151953
New Minimum: -18.653539626110728 > -19.374398446728406
END: th(1684339.7559414054)=-19.374398446728406; dx=-2.5809425810834106E-7 evalInputDelta=0.850648520129198
Fitness changed from -18.52374992659921 to -19.374398446728406
Iteration 2 complete. Error: -19.374398446728406 Total: 28.9505; Orientation: 0.0592; Line Search: 25.7684
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2dac1057 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-19.374398446728406;dx=-6.133453567015404E-7
New Minimum: -19.374398446728406 > -20.110837808462506
END: th(3628800.0000000005)=-20.110837808462506; dx=-4.5791852529802846E-8 evalInputDelta=0.7364393617340994
Fitness changed from -19.374398446728406 to -20.110837808462506
Iteration 3 complete. Error: -20.110837808462506 Total: 7.9983; Orientation: 0.0582; Line Search: 5.0793
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement dba3e1e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.678e+03, gradient 7.919e-04, dot -0.427; [b9280121-3c5b-4bf3-b5fc-6f1a80f613ff = 1.000/1.000e+00]
Orientation rejected. Popping history element from -20.110837808462506, -19.374398446728406, -18.52374992659921, -18.523749229825643
LBFGS Accumulation History: 3 points
Removed measurement dba3e1e to history. Total: 3
th(0)=-20.110837808462506;dx=-6.270199179651109E-7
New Minimum: -20.110837808462506 > -20.84916244711673
WOLF (strong): th(7818012.603187701)=-20.84916244711673; dx=3.012224339773983E-8 evalInputDelta=0.7383246386542233
New Minimum: -20.84916244711673 > -21.125049394073653
WOLF (strong): th(3909006.3015938504)=-21.125049394073653; dx=7.069499166919248E-8 evalInputDelta=1.0142115856111467
END: th(1303002.1005312835)=-20.886795738756103; dx=-3.8227286963813665E-7 evalInputDelta=0.7759579302935968
Fitness changed from -20.110837808462506 to -21.125049394073653
Iteration 4 complete. Error: -21.125049394073653 Total: 14.5191; Orientation: 1.0746; Line Search: 10.5091
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement c64b44b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.365e+03, gradient 8.332e-04, dot -0.290; [b9280121-3c5b-4bf3-b5fc-6f1a80f613ff = 1.000/1.000e+00]
Orientation rejected. Popping history element from -21.125049394073653, -19.374398446728406, -18.52374992659921, -18.523749229825643
LBFGS Accumulation History: 3 points
Removed measurement c64b44b to history. Total: 3
th(0)=-21.125049394073653;dx=-6.938239059615684E-7
New Minimum: -21.125049394073653 > -22.16748569607757
WOLF (strong): th(2807232.926569009)=-22.16748569607757; dx=1.0377116042311213E-7 evalInputDelta=1.0424363020039173
END: th(1403616.4632845046)=-22.018173222042705; dx=-3.470558891345593E-7 evalInputDelta=0.8931238279690525
Fitness changed from -21.125049394073653 to -22.16748569607757
Iteration 5 complete. Error: -22.16748569607757 Total: 11.8722; Orientation: 1.1089; Line Search: 7.6757
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 554eccb4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.172e+03, gradient 7.946e-04, dot -0.410; [b9280121-3c5b-4bf3-b5fc-6f1a80f613ff = 1.000/1.000e+00]
Orientation rejected. Popping history element from -22.16748569607757, -19.374398446728406, -18.52374992659921, -18.523749229825643
LBFGS Accumulation History: 3 points
Removed measurement 554eccb4 to history. Total: 3
th(0)=-22.16748569607757;dx=-6.312119470764762E-7
New Minimum: -22.16748569607757 > -22.628262803831216
WOLF (strong): th(3024000.0000000005)=-22.628262803831216; dx=2.2248255491800882E-7 evalInputDelta=0.4607771077536462
New Minimum: -22.628262803831216 > -22.858992010461954
END: th(1512000.0000000002)=-22.858992010461954; dx=-7.877720611872904E-8 evalInputDelta=0.6915063143843838
Fitness changed from -22.16748569607757 to -22.858992010461954
Iteration 6 complete. Error: -22.858992010461954 Total: 11.7312; Orientation: 0.9961; Line Search: 7.5234
Adding measurement c8c6f5c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.235e+04, gradient 6.491e-04, dot -0.586; [b9280121-3c5b-4bf3-b5fc-6f1a80f613ff = 1.000/1.000e+00]
Orientation rejected. Popping history element from -22.858992010461954, -19.374398446728406, -18.52374992659921, -18.523749229825643
LBFGS Accumulation History: 3 points
Removed measurement c8c6f5c to history. Total: 3
th(0)=-22.858992010461954;dx=-4.211322823932497E-7
New Minimum: -22.858992010461954 > -23.07004955299655
WOLF (strong): th(3257505.251328209)=-23.07004955299655; dx=5.848458622668878E-8 evalInputDelta=0.21105754253459708
New Minimum: -23.07004955299655 > -23.172172957635347
WOLF (strong): th(1628752.6256641045)=-23.172172957635347; dx=1.8167493244948493E-8 evalInputDelta=0.31318094717339306
END: th(542917.5418880348)=-23.06942965870975; dx=-2.5705060475251043E-7 evalInputDelta=0.21043764824779743
Fitness changed from -22.858992010461954 to -23.172172957635347
Iteration 7 complete. Error: -23.172172957635347 Total: 14.0987; Orientation: 0.9837; Line Search: 10.4298
Adding measurement 32c6d928 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.254e+04, gradient 7.294e-04, dot -0.500; [b9280121-3c5b-4bf3-b5fc-6f1a80f613ff = 1.000/1.000e+00]
Orientation rejected. Popping history element from -23.172172957635347, -19.374398446728406, -18.52374992659921, -18.523749229825643
LBFGS Accumulation History: 3 points
Removed measurement 32c6d928 to history. Total: 3
th(0)=-23.172172957635347;dx=-5.317566678946207E-7
New Minimum: -23.172172957635347 > -23.53980201152955
WOLF (strong): th(1169680.3860704205)=-23.53980201152955; dx=3.2716406549030944E-8 evalInputDelta=0.367629053894202
END: th(584840.1930352102)=-23.460935200087153; dx=-3.103593237768089E-7 evalInputDelta=0.2887622424518064
Fitness changed from -23.172172957635347 to -23.53980201152955
Iteration 8 complete. Error: -23.53980201152955 Total: 11.0889; Orientation: 0.9966; Line Search: 7.7106
Adding measurement 428b4c95 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.580e+04, gradient 6.539e-04, dot -0.583; [b9280121-3c5b-4bf3-b5fc-6f1a80f613ff = 1.000/1.000e+00]
Orientation rejected. Popping history element from -23.53980201152955, -19.374398446728406, -18.52374992659921, -18.523749229825643
LBFGS Accumulation History: 3 points
Removed measurement 428b4c95 to history. Total: 3
th(0)=-23.53980201152955;dx=-4.271927389196436E-7
New Minimum: -23.53980201152955 > -23.776693693727218
WOLF (strong): th(1260000.0000000002)=-23.776693693727218; dx=3.9828127004474136E-8 evalInputDelta=0.23689168219766898
END: th(630000.0000000001)=-23.753989027320223; dx=-1.4958309227989782E-7 evalInputDelta=0.21418701579067445
Fitness changed from -23.53980201152955 to -23.776693693727218
Iteration 9 complete. Error: -23.776693693727218 Total: 10.8813; Orientation: 0.9921; Line Search: 7.4441
Adding measurement 238cf2ef to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.565e+04, gradient 7.066e-04, dot -0.521; [b9280121-3c5b-4bf3-b5fc-6f1a80f613ff = 1.000/1.000e+00]
Orientation rejected. Popping history element from -23.776693693727218, -19.374398446728406, -18.52374992659921, -18.523749229825643
LBFGS Accumulation History: 3 points
Removed measurement 238cf2ef to history. Total: 3
th(0)=-23.776693693727218;dx=-4.990153261063796E-7
New Minimum: -23.776693693727218 > -24.04008692328405
WOLF (strong): th(1357293.854720087)=-24.04008692328405; dx=1.1147463028770863E-7 evalInputDelta=0.26339322955683286
New Minimum: -24.04008692328405 > -24.053152325691965
END: th(678646.9273600435)=-24.053152325691965; dx=-1.5752471959061783E-7 evalInputDelta=0.27645863196474707
Fitness changed from -23.776693693727218 to -24.053152325691965
Iteration 10 complete. Error: -24.053152325691965 Total: 11.4786; Orientation: 0.9669; Line Search: 7.7883
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -24.053152325691965 (> -Infinity) after 136.003s (< 5400.000s)
Returns
-24.053152325691965