BasicOptimizer.scala:89 executed in 132.48 seconds (1.630 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 72176380239000
Reset training subject: 72179074640600
Adding measurement 2eed6083 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-13.653644645968328;dx=-6.67148688521249E-7
New Minimum: -13.653644645968328 > -13.653646536578263
END: th(2.154434690031884)=-13.653646536578263; dx=-5.8964488766053E-7 evalInputDelta=1.8906099352733463E-6
Fitness changed from -13.653644645968328 to -13.653646536578263
Iteration 1 complete. Error: -13.653646536578263 Total: 13.1175; Orientation: 0.0658; Line Search: 5.0994
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2048ca9d to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-13.653646536578263;dx=-5.886796615743444E-7
New Minimum: -13.653646536578263 > -13.653649372492676
WOLFE (weak): th(4.641588833612779)=-13.653649372492676; dx=-5.885159285692824E-7 evalInputDelta=2.83591441352371E-6
New Minimum: -13.653649372492676 > -13.653652681058746
WOLFE (weak): th(9.283177667225559)=-13.653652681058746; dx=-5.885171380085138E-7 evalInputDelta=6.144480483527559E-6
New Minimum: -13.653652681058746 > -13.653664970011416
WOLFE (weak): th(27.849533001676676)=-13.653664970011416; dx=-5.884325300449884E-7 evalInputDelta=1.843343315321988E-5
New Minimum: -13.653664970011416 > -13.65371932486173
WOLFE (weak): th(111.3981320067067)=-13.65371932486173; dx=-5.883982947262633E-7 evalInputDelta=7.27882834663518E-5
New Minimum: -13.65371932486173 > -13.654008583555775
WOLFE (weak): th(556.9906600335335)=-13.654008583555775; dx=-5.88094304348368E-7 evalInputDelta=3.6204697751252013E-4
New Minimum: -13.654008583555775 > -13.655814421266857
WOLFE (weak): th(3341.9439602012008)=-13.655814421266857; dx=-5.87671514311462E-7 evalInputDelta=0.0021678846885944125
New Minimum: -13.655814421266857 > -13.668764935482276
WOLFE (weak): th(23393.607721408407)=-13.668764935482276; dx=-5.83557756290327E-7 evalInputDelta=0.01511839890401312
New Minimum: -13.668764935482276 > -13.770770359921348
WOLFE (weak): th(187148.86177126726)=-13.770770359921348; dx=-5.435692323726191E-7 evalInputDelta=0.11712382334308558
New Minimum: -13.770770359921348 > -14.27051764786569
END: th(1684339.7559414054)=-14.27051764786569; dx=-1.5860277342209955E-7 evalInputDelta=0.616871111287427
Fitness changed from -13.653646536578263 to -14.27051764786569
Iteration 2 complete. Error: -14.27051764786569 Total: 29.1027; Orientation: 0.0588; Line Search: 26.1280
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 332e83ec to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-14.27051764786569;dx=-6.046540862537219E-7
New Minimum: -14.27051764786569 > -14.953233758811423
END: th(3628800.0000000005)=-14.953233758811423; dx=-6.881238145519895E-8 evalInputDelta=0.6827161109457336
Fitness changed from -14.27051764786569 to -14.953233758811423
Iteration 3 complete. Error: -14.953233758811423 Total: 8.2781; Orientation: 0.0586; Line Search: 5.2430
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 253f25f2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.709e+03, gradient 7.486e-04, dot -0.569; [20b6ef7c-4b21-41fb-a311-dd58f8d01b53 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -14.953233758811423, -14.27051764786569, -13.653646536578263, -13.653644645968328
LBFGS Accumulation History: 3 points
Removed measurement 253f25f2 to history. Total: 3
th(0)=-14.953233758811423;dx=-5.596496145898129E-7
New Minimum: -14.953233758811423 > -16.201383576074335
END: th(7818012.603187701)=-16.201383576074335; dx=-2.0483553705370816E-8 evalInputDelta=1.2481498172629113
Fitness changed from -14.953233758811423 to -16.201383576074335
Iteration 4 complete. Error: -16.201383576074335 Total: 8.9893; Orientation: 1.0210; Line Search: 5.0231
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 70af4617 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.854e+03, gradient 6.870e-04, dot -0.261; [20b6ef7c-4b21-41fb-a311-dd58f8d01b53 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -16.201383576074335, -14.27051764786569, -13.653646536578263, -13.653644645968328
LBFGS Accumulation History: 3 points
Removed measurement 70af4617 to history. Total: 3
th(0)=-16.201383576074335;dx=-4.7166277921606175E-7
New Minimum: -16.201383576074335 > -18.13680846902223
END: th(1.6843397559414055E7)=-18.13680846902223; dx=-2.539815021702735E-9 evalInputDelta=1.9354248929478963
Fitness changed from -16.201383576074335 to -18.13680846902223
Iteration 5 complete. Error: -18.13680846902223 Total: 9.5557; Orientation: 1.0148; Line Search: 5.3738
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2824cfd1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.192e+03, gradient 6.059e-04, dot -0.273; [20b6ef7c-4b21-41fb-a311-dd58f8d01b53 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -18.13680846902223, -14.27051764786569, -13.653646536578263, -13.653644645968328
LBFGS Accumulation History: 3 points
Removed measurement 2824cfd1 to history. Total: 3
th(0)=-18.13680846902223;dx=-3.6711112842769433E-7
New Minimum: -18.13680846902223 > -20.946217931879666
WOLF (strong): th(3.628800000000001E7)=-20.946217931879666; dx=9.90871266809233E-10 evalInputDelta=2.8094094628574346
New Minimum: -20.946217931879666 > -21.101170025593436
END: th(1.8144000000000004E7)=-21.101170025593436; dx=-7.038896346143989E-10 evalInputDelta=2.9643615565712054
Fitness changed from -18.13680846902223 to -21.101170025593436
Iteration 6 complete. Error: -21.101170025593436 Total: 11.9854; Orientation: 1.1048; Line Search: 7.9387
Adding measurement 562790a1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.338e+04, gradient 5.891e-04, dot -0.292; [20b6ef7c-4b21-41fb-a311-dd58f8d01b53 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -21.101170025593436, -14.27051764786569, -13.653646536578263, -13.653644645968328
LBFGS Accumulation History: 3 points
Removed measurement 562790a1 to history. Total: 3
th(0)=-21.101170025593436;dx=-3.4685144813956787E-7
New Minimum: -21.101170025593436 > -22.88621465246661
WOLF (strong): th(3.9090063015938506E7)=-22.88621465246661; dx=1.199735596021921E-8 evalInputDelta=1.785044626873173
New Minimum: -22.88621465246661 > -23.46381777002796
WOLF (strong): th(1.9545031507969253E7)=-23.46381777002796; dx=3.2876217100357756E-8 evalInputDelta=2.362647744434522
END: th(6515010.502656418)=-23.147755773238956; dx=-1.731256845659055E-7 evalInputDelta=2.046585747645519
Fitness changed from -21.101170025593436 to -23.46381777002796
Iteration 7 complete. Error: -23.46381777002796 Total: 13.8686; Orientation: 0.9961; Line Search: 10.3416
Adding measurement 11be3e08 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.788e+04, gradient 5.769e-04, dot -0.294; [20b6ef7c-4b21-41fb-a311-dd58f8d01b53 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -23.46381777002796, -14.27051764786569, -13.653646536578263, -13.653644645968328
LBFGS Accumulation History: 3 points
Removed measurement 11be3e08 to history. Total: 3
th(0)=-23.46381777002796;dx=-3.3244653931833344E-7
New Minimum: -23.46381777002796 > -26.22389714042842
WOLF (strong): th(1.4036164632845048E7)=-26.22389714042842; dx=2.4166907941649585E-9 evalInputDelta=2.7600793704004616
END: th(7018082.316422524)=-25.644380581873513; dx=-1.7931251302653687E-7 evalInputDelta=2.1805628118455544
Fitness changed from -23.46381777002796 to -26.22389714042842
Iteration 8 complete. Error: -26.22389714042842 Total: 11.4470; Orientation: 1.0115; Line Search: 7.9781
Adding measurement 31676d07 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.762e+04, gradient 5.729e-04, dot -0.343; [20b6ef7c-4b21-41fb-a311-dd58f8d01b53 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -26.22389714042842, -14.27051764786569, -13.653646536578263, -13.653644645968328
LBFGS Accumulation History: 3 points
Removed measurement 31676d07 to history. Total: 3
th(0)=-26.22389714042842;dx=-3.281447158049897E-7
New Minimum: -26.22389714042842 > -27.42267710678967
WOLF (strong): th(1.5120000000000006E7)=-27.42267710678967; dx=6.675791884949897E-8 evalInputDelta=1.1987799663612506
New Minimum: -27.42267710678967 > -27.84337038014752
END: th(7560000.000000003)=-27.84337038014752; dx=-1.7010258915919246E-8 evalInputDelta=1.619473239719099
Fitness changed from -26.22389714042842 to -27.84337038014752
Iteration 9 complete. Error: -27.84337038014752 Total: 11.5111; Orientation: 0.9907; Line Search: 8.0059
Adding measurement 574bfa99 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.612e+04, gradient 5.463e-04, dot -0.394; [20b6ef7c-4b21-41fb-a311-dd58f8d01b53 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -27.84337038014752, -14.27051764786569, -13.653646536578263, -13.653644645968328
LBFGS Accumulation History: 3 points
Removed measurement 574bfa99 to history. Total: 3
th(0)=-27.84337038014752;dx=-2.983238946620757E-7
New Minimum: -27.84337038014752 > -28.114439788043175
WOLF (strong): th(1.6287526256641047E7)=-28.114439788043175; dx=3.1075682536010096E-8 evalInputDelta=0.2710694078956557
New Minimum: -28.114439788043175 > -28.583936022055518
WOLF (strong): th(8143763.128320524)=-28.583936022055518; dx=5.71248328019175E-8 evalInputDelta=0.7405656419079989
END: th(2714587.7094401745)=-28.580547447048467; dx=-1.529462106593688E-7 evalInputDelta=0.7371770669009479
Fitness changed from -27.84337038014752 to -28.583936022055518
Iteration 10 complete. Error: -28.583936022055518 Total: 14.1461; Orientation: 1.0459; Line Search: 10.3933
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -28.583936022055518 (> -Infinity) after 132.480s (< 5400.000s)
Returns
-28.583936022055518