BasicOptimizer.scala:89 executed in 154.88 seconds (3.130 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 467089952625900
Reset training subject: 467092884315700
Adding measurement 73075580 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-43.34267324564018;dx=-1.671029445851374E-5
New Minimum: -43.34267324564018 > -43.342706898032525
WOLFE (weak): th(2.154434690031884)=-43.342706898032525; dx=-1.534939818021961E-5 evalInputDelta=3.365239234653927E-5
New Minimum: -43.342706898032525 > -43.342743755384646
WOLFE (weak): th(4.308869380063768)=-43.342743755384646; dx=-1.5348638011880167E-5 evalInputDelta=7.050974446798364E-5
New Minimum: -43.342743755384646 > -43.34288477452947
WOLFE (weak): th(12.926608140191302)=-43.34288477452947; dx=-1.5349395228049417E-5 evalInputDelta=2.115288892952094E-4
New Minimum: -43.34288477452947 > -43.343517752539206
WOLFE (weak): th(51.70643256076521)=-43.343517752539206; dx=-1.5327554933684367E-5 evalInputDelta=8.445068990283744E-4
New Minimum: -43.343517752539206 > -43.34688920624602
WOLFE (weak): th(258.53216280382605)=-43.34688920624602; dx=-1.5348550779796126E-5 evalInputDelta=0.0042159606058405075
New Minimum: -43.34688920624602 > -43.36796766622082
WOLFE (weak): th(1551.1929768229563)=-43.36796766622082; dx=-1.5330234521837535E-5 evalInputDelta=0.025294420580642907
New Minimum: -43.36796766622082 > -43.51957707448423
WOLFE (weak): th(10858.350837760694)=-43.51957707448423; dx=-1.5310481829452904E-5 evalInputDelta=0.1769038288440541
New Minimum: -43.51957707448423 > -44.74608213979404
WOLFE (weak): th(86866.80670208555)=-44.74608213979404; dx=-1.5041201748686605E-5 evalInputDelta=1.4034088941538627
New Minimum: -44.74608213979404 > -54.51171208868159
END: th(781801.26031877)=-54.51171208868159; dx=-1.1237104309261252E-5 evalInputDelta=11.169038843041413
Fitness changed from -43.34267324564018 to -54.51171208868159
Iteration 1 complete. Error: -54.51171208868159 Total: 37.7512; Orientation: 0.1041; Line Search: 28.9574
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 17158be4 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-54.51171208868159;dx=-1.1482100381207042E-5
New Minimum: -54.51171208868159 > -69.78213569684858
END: th(1684339.7559414052)=-69.78213569684858; dx=-5.841365264258908E-6 evalInputDelta=15.270423608166993
Fitness changed from -54.51171208868159 to -69.78213569684858
Iteration 2 complete. Error: -69.78213569684858 Total: 9.9361; Orientation: 0.1003; Line Search: 6.0560
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7a719254 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-69.78213569684858;dx=-8.059664123076084E-6
New Minimum: -69.78213569684858 > -86.21065357676946
END: th(3628800.0)=-86.21065357676946; dx=-2.005863093622614E-6 evalInputDelta=16.428517879920875
Fitness changed from -69.78213569684858 to -86.21065357676946
Iteration 3 complete. Error: -86.21065357676946 Total: 9.4310; Orientation: 0.0929; Line Search: 5.8710
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2d716bac to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.263e+04, gradient 2.861e-03, dot -0.503; [82992ccc-008b-491f-99e4-e08a6255f16d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.21065357676946, -69.78213569684858, -54.51171208868159, -43.34267324564018
LBFGS Accumulation History: 3 points
Removed measurement 2d716bac to history. Total: 3
th(0)=-86.21065357676946;dx=-8.182048055322424E-6
New Minimum: -86.21065357676946 > -94.5407503007589
WOLF (strong): th(7818012.6031877)=-94.5407503007589; dx=1.070447510843594E-6 evalInputDelta=8.330096723989442
New Minimum: -94.5407503007589 > -98.34723761993585
WOLF (strong): th(3909006.30159385)=-98.34723761993585; dx=5.3738039608742803E-8 evalInputDelta=12.136584043166394
END: th(1303002.1005312833)=-94.54391227601299; dx=-4.0696929464606654E-6 evalInputDelta=8.33325869924353
Fitness changed from -86.21065357676946 to -98.34723761993585
Iteration 4 complete. Error: -98.34723761993585 Total: 17.0339; Orientation: 1.9036; Line Search: 11.4038
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 3aa78329 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.569e+04, gradient 2.864e-03, dot -0.442; [82992ccc-008b-491f-99e4-e08a6255f16d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -98.34723761993585, -69.78213569684858, -54.51171208868159, -43.34267324564018
LBFGS Accumulation History: 3 points
Removed measurement 3aa78329 to history. Total: 3
th(0)=-98.34723761993585;dx=-8.194152181131874E-6
New Minimum: -98.34723761993585 > -110.93879592207429
END: th(2807232.9265690087)=-110.93879592207429; dx=-8.195888159903037E-7 evalInputDelta=12.591558302138438
Fitness changed from -98.34723761993585 to -110.93879592207429
Iteration 5 complete. Error: -110.93879592207429 Total: 11.3807; Orientation: 1.8234; Line Search: 5.7714
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 45164828 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.608e+04, gradient 2.208e-03, dot -0.548; [82992ccc-008b-491f-99e4-e08a6255f16d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -110.93879592207429, -69.78213569684858, -54.51171208868159, -43.34267324564018
LBFGS Accumulation History: 3 points
Removed measurement 45164828 to history. Total: 3
th(0)=-110.93879592207429;dx=-4.866156371928558E-6
New Minimum: -110.93879592207429 > -119.56119625317312
WOLF (strong): th(6048000.0)=-119.56119625317312; dx=4.090412582903957E-7 evalInputDelta=8.62240033109883
END: th(3024000.0)=-119.47922478266337; dx=-1.0052412217992773E-6 evalInputDelta=8.540428860589074
Fitness changed from -110.93879592207429 to -119.56119625317312
Iteration 6 complete. Error: -119.56119625317312 Total: 14.4696; Orientation: 1.8102; Line Search: 8.9309
Adding measurement bc4f09d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.542e+04, gradient 2.786e-03, dot -0.376; [82992ccc-008b-491f-99e4-e08a6255f16d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -119.56119625317312, -69.78213569684858, -54.51171208868159, -43.34267324564018
LBFGS Accumulation History: 3 points
Removed measurement bc4f09d to history. Total: 3
th(0)=-119.56119625317312;dx=-7.75321225362996E-6
New Minimum: -119.56119625317312 > -128.07167361528167
WOLF (strong): th(6515010.502656417)=-128.07167361528167; dx=2.4061167795919135E-6 evalInputDelta=8.510477362108546
New Minimum: -128.07167361528167 > -133.44458526569954
END: th(3257505.2513282085)=-133.44458526569954; dx=-4.595001030045947E-7 evalInputDelta=13.883389012526422
Fitness changed from -119.56119625317312 to -133.44458526569954
Iteration 7 complete. Error: -133.44458526569954 Total: 13.5288; Orientation: 1.7572; Line Search: 8.7458
Adding measurement 1585d61a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.700e+04, gradient 1.916e-03, dot -0.535; [82992ccc-008b-491f-99e4-e08a6255f16d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -133.44458526569954, -69.78213569684858, -54.51171208868159, -43.34267324564018
LBFGS Accumulation History: 3 points
Removed measurement 1585d61a to history. Total: 3
th(0)=-133.44458526569954;dx=-3.6579431224405652E-6
New Minimum: -133.44458526569954 > -141.31827684934436
WOLF (strong): th(7018082.316422523)=-141.31827684934436; dx=3.5230313016977666E-7 evalInputDelta=7.873691583644813
END: th(3509041.1582112615)=-141.1380251214207; dx=-8.748086845704301E-7 evalInputDelta=7.693439855721152
Fitness changed from -133.44458526569954 to -141.31827684934436
Iteration 8 complete. Error: -141.31827684934436 Total: 13.6880; Orientation: 1.7976; Line Search: 9.1877
Adding measurement 49338260 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.881e+04, gradient 2.487e-03, dot -0.377; [82992ccc-008b-491f-99e4-e08a6255f16d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -141.31827684934436, -69.78213569684858, -54.51171208868159, -43.34267324564018
LBFGS Accumulation History: 3 points
Removed measurement 49338260 to history. Total: 3
th(0)=-141.31827684934436;dx=-6.179566908766353E-6
New Minimum: -141.31827684934436 > -147.33745797073036
WOLF (strong): th(7560000.000000002)=-147.33745797073036; dx=2.206582449119106E-6 evalInputDelta=6.019181121385998
New Minimum: -147.33745797073036 > -153.51167367706694
END: th(3780000.000000001)=-153.51167367706694; dx=-1.1148226241710886E-7 evalInputDelta=12.19339682772258
Fitness changed from -141.31827684934436 to -153.51167367706694
Iteration 9 complete. Error: -153.51167367706694 Total: 13.5724; Orientation: 1.8190; Line Search: 8.9721
Adding measurement 739f4c5f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.909e+04, gradient 1.760e-03, dot -0.523; [82992ccc-008b-491f-99e4-e08a6255f16d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -153.51167367706694, -69.78213569684858, -54.51171208868159, -43.34267324564018
LBFGS Accumulation History: 3 points
Removed measurement 739f4c5f to history. Total: 3
th(0)=-153.51167367706694;dx=-3.088923475405187E-6
New Minimum: -153.51167367706694 > -160.05275980971862
WOLF (strong): th(8143763.128320523)=-160.05275980971862; dx=4.995424784315039E-7 evalInputDelta=6.541086132651685
New Minimum: -160.05275980971862 > -160.70928224441815
END: th(4071881.5641602613)=-160.70928224441815; dx=-5.963884041687041E-7 evalInputDelta=7.19760856735121
Fitness changed from -153.51167367706694 to -160.70928224441815
Iteration 10 complete. Error: -160.70928224441815 Total: 13.3507; Orientation: 1.7397; Line Search: 8.7534
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -160.70928224441815 (> -Infinity) after 154.884s (< 5400.000s)
Returns
-160.70928224441815