BasicOptimizer.scala:89 executed in 301.36 seconds (3.395 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 573774810479500
Reset training subject: 573780885782300
Adding measurement b0528a6 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-39.21736704324554;dx=-2.115809138756563E-6
New Minimum: -39.21736704324554 > -39.217370894970024
END: th(2.154434690031884)=-39.217370894970024; dx=-1.8403995013632208E-6 evalInputDelta=3.851724486025887E-6
Fitness changed from -39.21736704324554 to -39.217370894970024
Iteration 1 complete. Error: -39.217370894970024 Total: 31.0713; Orientation: 0.1456; Line Search: 12.9173
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement a69f059 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-39.217370894970024;dx=-1.840178845816674E-6
New Minimum: -39.217370894970024 > -39.217380524279584
WOLFE (weak): th(4.641588833612779)=-39.217380524279584; dx=-1.8378057098365355E-6 evalInputDelta=9.629309559500143E-6
New Minimum: -39.217380524279584 > -39.217390153586784
WOLFE (weak): th(9.283177667225559)=-39.217390153586784; dx=-1.8381348592911775E-6 evalInputDelta=1.9258616759998404E-5
New Minimum: -39.217390153586784 > -39.21742867079192
WOLFE (weak): th(27.849533001676676)=-39.21742867079192; dx=-1.8358804496690152E-6 evalInputDelta=5.777582189381292E-5
New Minimum: -39.21742867079192 > -39.21759622019409
WOLFE (weak): th(111.3981320067067)=-39.21759622019409; dx=-1.8358096510490824E-6 evalInputDelta=2.2532522406493172E-4
New Minimum: -39.21759622019409 > -39.21849365653071
WOLFE (weak): th(556.9906600335335)=-39.21849365653071; dx=-1.8357111936252997E-6 evalInputDelta=0.0011227615606870245
New Minimum: -39.21849365653071 > -39.22409928013422
WOLFE (weak): th(3341.9439602012008)=-39.22409928013422; dx=-1.8354851895338175E-6 evalInputDelta=0.006728385164194606
New Minimum: -39.22409928013422 > -39.26443960786178
WOLFE (weak): th(23393.607721408407)=-39.26443960786178; dx=-1.8319055405134893E-6 evalInputDelta=0.047068712891757514
New Minimum: -39.26443960786178 > -39.59170905554334
WOLFE (weak): th(187148.86177126726)=-39.59170905554334; dx=-1.8107326427904096E-6 evalInputDelta=0.37433816057331626
New Minimum: -39.59170905554334 > -42.366963909977244
END: th(1684339.7559414054)=-42.366963909977244; dx=-1.5623167457920892E-6 evalInputDelta=3.1495930150072198
Fitness changed from -39.217370894970024 to -42.366963909977244
Iteration 2 complete. Error: -42.366963909977244 Total: 68.5930; Orientation: 0.1521; Line Search: 61.3388
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 42f3942d to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-42.366963909977244;dx=-1.4962446967070249E-6
New Minimum: -42.366963909977244 > -47.212007485898106
END: th(3628800.0000000005)=-47.212007485898106; dx=-9.80249818170767E-7 evalInputDelta=4.845043575920862
Fitness changed from -42.366963909977244 to -47.212007485898106
Iteration 3 complete. Error: -47.212007485898106 Total: 19.6220; Orientation: 0.1391; Line Search: 12.2314
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 50d0222c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.042e+04, gradient 9.695e-04, dot -0.802; [7b0c419d-b09c-4b83-91fc-289392fd45b6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -47.212007485898106, -42.366963909977244, -39.217370894970024, -39.21736704324554
LBFGS Accumulation History: 3 points
Removed measurement 50d0222c to history. Total: 3
th(0)=-47.212007485898106;dx=-9.391263070582278E-7
New Minimum: -47.212007485898106 > -53.22817231545653
END: th(7818012.603187701)=-53.22817231545653; dx=-4.981679787195759E-7 evalInputDelta=6.016164829558427
Fitness changed from -47.212007485898106 to -53.22817231545653
Iteration 4 complete. Error: -53.22817231545653 Total: 21.8632; Orientation: 2.5778; Line Search: 12.1979
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 329f60ca to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.326e+03, gradient 8.433e-04, dot -0.584; [7b0c419d-b09c-4b83-91fc-289392fd45b6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.22817231545653, -42.366963909977244, -39.217370894970024, -39.21736704324554
LBFGS Accumulation History: 3 points
Removed measurement 329f60ca to history. Total: 3
th(0)=-53.22817231545653;dx=-7.097122680396571E-7
New Minimum: -53.22817231545653 > -59.189123533184045
END: th(1.6843397559414055E7)=-59.189123533184045; dx=-1.225227365506805E-7 evalInputDelta=5.960951217727512
Fitness changed from -53.22817231545653 to -59.189123533184045
Iteration 5 complete. Error: -59.189123533184045 Total: 22.2660; Orientation: 2.5530; Line Search: 12.6186
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement a3c4f86 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.102e+04, gradient 1.030e-03, dot -0.314; [7b0c419d-b09c-4b83-91fc-289392fd45b6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.189123533184045, -42.366963909977244, -39.217370894970024, -39.21736704324554
LBFGS Accumulation History: 3 points
Removed measurement a3c4f86 to history. Total: 3
th(0)=-59.189123533184045;dx=-1.0592240864744196E-6
Armijo: th(3.628800000000001E7)=-55.31746184755268; dx=2.624981553506169E-7 evalInputDelta=-3.8716616856313664
New Minimum: -59.189123533184045 > -61.94325697401277
WOLF (strong): th(1.8144000000000004E7)=-61.94325697401277; dx=3.202269576712227E-7 evalInputDelta=2.754133440828724
New Minimum: -61.94325697401277 > -63.860936793391446
END: th(6048000.000000001)=-63.860936793391446; dx=-3.207483252304554E-7 evalInputDelta=4.671813260207401
Fitness changed from -59.189123533184045 to -63.860936793391446
Iteration 6 complete. Error: -63.860936793391446 Total: 34.4964; Orientation: 2.4544; Line Search: 24.9559
Adding measurement 542f70c9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.933e+04, gradient 7.179e-04, dot -0.597; [7b0c419d-b09c-4b83-91fc-289392fd45b6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -63.860936793391446, -42.366963909977244, -39.217370894970024, -39.21736704324554
LBFGS Accumulation History: 3 points
Removed measurement 542f70c9 to history. Total: 3
th(0)=-63.860936793391446;dx=-5.14813227432624E-7
New Minimum: -63.860936793391446 > -67.95341263082474
END: th(1.3030021005312836E7)=-67.95341263082474; dx=-1.3628156643629816E-7 evalInputDelta=4.092475837433298
Fitness changed from -63.860936793391446 to -67.95341263082474
Iteration 7 complete. Error: -67.95341263082474 Total: 20.8044; Orientation: 2.5689; Line Search: 12.1621
Adding measurement 2a9ba715 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.440e+04, gradient 8.470e-04, dot -0.464; [7b0c419d-b09c-4b83-91fc-289392fd45b6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -67.95341263082474, -42.366963909977244, -39.217370894970024, -39.21736704324554
LBFGS Accumulation History: 3 points
Removed measurement 2a9ba715 to history. Total: 3
th(0)=-67.95341263082474;dx=-7.15873918771239E-7
Armijo: th(2.8072329265690096E7)=-67.7203897321349; dx=1.97020892241139E-7 evalInputDelta=-0.23302289868983905
New Minimum: -67.95341263082474 > -70.83055613072285
WOLF (strong): th(1.4036164632845048E7)=-70.83055613072285; dx=1.2699242727106152E-7 evalInputDelta=2.8771434998981107
END: th(4678721.544281683)=-70.62355821772806; dx=-3.183365384713838E-7 evalInputDelta=2.670145586903317
Fitness changed from -67.95341263082474 to -70.83055613072285
Iteration 8 complete. Error: -70.83055613072285 Total: 32.7191; Orientation: 2.4932; Line Search: 24.3819
Adding measurement 67a95d70 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.578e+04, gradient 9.766e-04, dot -0.344; [7b0c419d-b09c-4b83-91fc-289392fd45b6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -70.83055613072285, -42.366963909977244, -39.217370894970024, -39.21736704324554
LBFGS Accumulation History: 3 points
Removed measurement 67a95d70 to history. Total: 3
th(0)=-70.83055613072285;dx=-9.533894666772802E-7
New Minimum: -70.83055613072285 > -75.89913751975773
WOLF (strong): th(1.0080000000000004E7)=-75.89913751975773; dx=6.759028051350664E-8 evalInputDelta=5.068581389034875
END: th(5040000.000000002)=-74.89278013778649; dx=-4.806884318947658E-7 evalInputDelta=4.062224007063634
Fitness changed from -70.83055613072285 to -75.89913751975773
Iteration 9 complete. Error: -75.89913751975773 Total: 27.4884; Orientation: 2.5539; Line Search: 18.5751
Adding measurement 7dfd17e7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.709e+04, gradient 7.559e-04, dot -0.499; [7b0c419d-b09c-4b83-91fc-289392fd45b6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.89913751975773, -42.366963909977244, -39.217370894970024, -39.21736704324554
LBFGS Accumulation History: 3 points
Removed measurement 7dfd17e7 to history. Total: 3
th(0)=-75.89913751975773;dx=-5.705208369869936E-7
New Minimum: -75.89913751975773 > -79.01899464419199
END: th(1.0858350837760698E7)=-79.01899464419199; dx=-9.232969804782478E-9 evalInputDelta=3.1198571244342617
Fitness changed from -75.89913751975773 to -79.01899464419199
Iteration 10 complete. Error: -79.01899464419199 Total: 21.2293; Orientation: 2.5142; Line Search: 12.6069
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -79.01899464419199 (> -Infinity) after 301.361s (< 5400.000s)
Returns
-79.01899464419199