BasicOptimizer.scala:89 executed in 151.13 seconds (2.588 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 456703775919100
Reset training subject: 456706608418400
Adding measurement 3c86682 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-144.82990792265537;dx=-1.1213151783846758E-5
New Minimum: -144.82990792265537 > -144.82993861529107
WOLFE (weak): th(2.154434690031884)=-144.82993861529107; dx=-1.1050428791068247E-5 evalInputDelta=3.06926357040993E-5
New Minimum: -144.82993861529107 > -144.82995396160646
WOLFE (weak): th(4.308869380063768)=-144.82995396160646; dx=-1.0996432105535714E-5 evalInputDelta=4.603895109767109E-5
New Minimum: -144.82995396160646 > -144.83006138576883
WOLFE (weak): th(12.926608140191302)=-144.83006138576883; dx=-1.1007187468145897E-5 evalInputDelta=1.5346311346320363E-4
New Minimum: -144.83006138576883 > -144.83052177413364
WOLFE (weak): th(51.70643256076521)=-144.83052177413364; dx=-1.1050132245105794E-5 evalInputDelta=6.138514782776383E-4
New Minimum: -144.83052177413364 > -144.83295413503646
WOLFE (weak): th(258.53216280382605)=-144.83295413503646; dx=-1.1034457849492258E-5 evalInputDelta=0.0030462123810934827
New Minimum: -144.83295413503646 > -144.8481919081884
WOLFE (weak): th(1551.1929768229563)=-144.8481919081884; dx=-1.10469502566623E-5 evalInputDelta=0.018283985533031455
New Minimum: -144.8481919081884 > -144.95777839335256
WOLFE (weak): th(10858.350837760694)=-144.95777839335256; dx=-1.0963171480224053E-5 evalInputDelta=0.12787047069718938
New Minimum: -144.95777839335256 > -145.84574765394868
WOLFE (weak): th(86866.80670208555)=-145.84574765394868; dx=-1.0871243743122263E-5 evalInputDelta=1.0158397312933118
New Minimum: -145.84574765394868 > -153.35232114223373
END: th(781801.26031877)=-153.35232114223373; dx=-9.393535636668317E-6 evalInputDelta=8.522413219578368
Fitness changed from -144.82990792265537 to -153.35232114223373
Iteration 1 complete. Error: -153.35232114223373 Total: 37.5728; Orientation: 0.1112; Line Search: 29.1372
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 378d868b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-153.35232114223373;dx=-8.736028333403968E-6
New Minimum: -153.35232114223373 > -166.83604044230162
END: th(1684339.7559414052)=-166.83604044230162; dx=-6.403060580759946E-6 evalInputDelta=13.48371930006789
Fitness changed from -153.35232114223373 to -166.83604044230162
Iteration 2 complete. Error: -166.83604044230162 Total: 9.4482; Orientation: 0.0960; Line Search: 5.6399
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 26016d95 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-166.83604044230162;dx=-6.089832232486295E-6
New Minimum: -166.83604044230162 > -185.19348536724547
END: th(3628800.0)=-185.19348536724547; dx=-3.690315910518587E-6 evalInputDelta=18.35744492494385
Fitness changed from -166.83604044230162 to -185.19348536724547
Iteration 3 complete. Error: -185.19348536724547 Total: 9.3526; Orientation: 0.0963; Line Search: 5.6946
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 436017fd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.769e+04, gradient 2.099e-03, dot -0.802; [3a8f3749-da5a-4f35-9a05-d7ddb2feed93 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -185.19348536724547, -166.83604044230162, -153.35232114223373, -144.82990792265537
LBFGS Accumulation History: 3 points
Removed measurement 436017fd to history. Total: 3
th(0)=-185.19348536724547;dx=-4.3929416239282945E-6
New Minimum: -185.19348536724547 > -207.2232341274342
END: th(7818012.6031877)=-207.2232341274342; dx=-1.6309190481746563E-6 evalInputDelta=22.02974876018874
Fitness changed from -185.19348536724547 to -207.2232341274342
Iteration 4 complete. Error: -207.2232341274342 Total: 11.5166; Orientation: 2.0085; Line Search: 5.7421
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 7a24380a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.707e+04, gradient 2.129e-03, dot -0.588; [3a8f3749-da5a-4f35-9a05-d7ddb2feed93 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -207.2232341274342, -166.83604044230162, -153.35232114223373, -144.82990792265537
LBFGS Accumulation History: 3 points
Removed measurement 7a24380a to history. Total: 3
th(0)=-207.2232341274342;dx=-4.525377728832224E-6
New Minimum: -207.2232341274342 > -214.65166859219383
WOLF (strong): th(1.684339755941405E7)=-214.65166859219383; dx=9.205836319875674E-7 evalInputDelta=7.4284344647596185
New Minimum: -214.65166859219383 > -221.3248118587133
WOLF (strong): th(8421698.779707026)=-221.3248118587133; dx=6.428376313212299E-8 evalInputDelta=14.101577731279093
END: th(2807232.9265690087)=-217.0043491147097; dx=-2.2266365103300588E-6 evalInputDelta=9.781114987275487
Fitness changed from -207.2232341274342 to -221.3248118587133
Iteration 5 complete. Error: -221.3248118587133 Total: 17.3778; Orientation: 2.0329; Line Search: 11.8488
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 73fb3707 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.650e+04, gradient 2.251e-03, dot -0.462; [3a8f3749-da5a-4f35-9a05-d7ddb2feed93 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -221.3248118587133, -166.83604044230162, -153.35232114223373, -144.82990792265537
LBFGS Accumulation History: 3 points
Removed measurement 73fb3707 to history. Total: 3
th(0)=-221.3248118587133;dx=-5.064805922947453E-6
New Minimum: -221.3248118587133 > -236.24136877261662
END: th(6048000.0)=-236.24136877261662; dx=-4.7486292915530854E-8 evalInputDelta=14.916556913903321
Fitness changed from -221.3248118587133 to -236.24136877261662
Iteration 6 complete. Error: -236.24136877261662 Total: 11.2258; Orientation: 2.1090; Line Search: 5.7858
Adding measurement 6283a204 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.248e+04, gradient 1.749e-03, dot -0.547; [3a8f3749-da5a-4f35-9a05-d7ddb2feed93 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -236.24136877261662, -166.83604044230162, -153.35232114223373, -144.82990792265537
LBFGS Accumulation History: 3 points
Removed measurement 6283a204 to history. Total: 3
th(0)=-236.24136877261662;dx=-3.049208524602233E-6
New Minimum: -236.24136877261662 > -241.82686389858398
WOLF (strong): th(1.3030021005312834E7)=-241.82686389858398; dx=8.83701323507414E-7 evalInputDelta=5.5854951259673555
New Minimum: -241.82686389858398 > -245.86947601013154
END: th(6515010.502656417)=-245.86947601013154; dx=-1.9497118245655659E-7 evalInputDelta=9.62810723751491
Fitness changed from -236.24136877261662 to -245.86947601013154
Iteration 7 complete. Error: -245.86947601013154 Total: 13.3791; Orientation: 1.7974; Line Search: 8.7743
Adding measurement 30371558 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.434e+04, gradient 1.649e-03, dot -0.537; [3a8f3749-da5a-4f35-9a05-d7ddb2feed93 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -245.86947601013154, -166.83604044230162, -153.35232114223373, -144.82990792265537
LBFGS Accumulation History: 3 points
Removed measurement 30371558 to history. Total: 3
th(0)=-245.86947601013154;dx=-2.7165060283390216E-6
New Minimum: -245.86947601013154 > -248.05734834834217
WOLF (strong): th(1.4036164632845046E7)=-248.05734834834217; dx=9.393402586103829E-7 evalInputDelta=2.1878723382106386
New Minimum: -248.05734834834217 > -253.62659670709718
WOLF (strong): th(7018082.316422523)=-253.62659670709718; dx=9.343285690410348E-8 evalInputDelta=7.757120696965643
END: th(2339360.772140841)=-250.9679505922397; dx=-1.5680484555904486E-6 evalInputDelta=5.098474582108167
Fitness changed from -245.86947601013154 to -253.62659670709718
Iteration 8 complete. Error: -253.62659670709718 Total: 16.3103; Orientation: 1.9615; Line Search: 11.6568
Adding measurement 54e65922 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.506e+04, gradient 1.647e-03, dot -0.492; [3a8f3749-da5a-4f35-9a05-d7ddb2feed93 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -253.62659670709718, -166.83604044230162, -153.35232114223373, -144.82990792265537
LBFGS Accumulation History: 3 points
Removed measurement 54e65922 to history. Total: 3
th(0)=-253.62659670709718;dx=-2.6926012706815846E-6
New Minimum: -253.62659670709718 > -261.0296655137882
END: th(5040000.000000001)=-261.0296655137882; dx=-3.219875720951161E-7 evalInputDelta=7.40306880669101
Fitness changed from -253.62659670709718 to -261.0296655137882
Iteration 9 complete. Error: -261.0296655137882 Total: 10.4850; Orientation: 1.8042; Line Search: 5.6240
Adding measurement 661a3b3a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.692e+04, gradient 1.294e-03, dot -0.588; [3a8f3749-da5a-4f35-9a05-d7ddb2feed93 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -261.0296655137882, -166.83604044230162, -153.35232114223373, -144.82990792265537
LBFGS Accumulation History: 3 points
Removed measurement 661a3b3a to history. Total: 3
th(0)=-261.0296655137882;dx=-1.6694636836783145E-6
New Minimum: -261.0296655137882 > -266.56898182831156
WOLF (strong): th(1.0858350837760696E7)=-266.56898182831156; dx=1.0591796215545713E-7 evalInputDelta=5.539316314523376
END: th(5429175.418880348)=-266.34323963377693; dx=-4.6989611432798696E-7 evalInputDelta=5.313574119988743
Fitness changed from -261.0296655137882 to -266.56898182831156
Iteration 10 complete. Error: -266.56898182831156 Total: 13.8486; Orientation: 1.9897; Line Search: 9.1725
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -266.56898182831156 (> -Infinity) after 151.132s (< 5400.000s)
Returns
-266.56898182831156