BasicOptimizer.scala:89 executed in 596.24 seconds (4.239 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 1288832435831
Reset training subject: 1301328302777
Adding measurement 6956b01a to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-33.32337337732315;dx=-1.5962175428188316E-6
New Minimum: -33.32337337732315 > -33.32337749004364
WOLFE (weak): th(2.154434690031884)=-33.32337749004364; dx=-1.491092701324033E-6 evalInputDelta=4.112720489501953E-6
New Minimum: -33.32337749004364 > -33.32338094711304
WOLFE (weak): th(4.308869380063768)=-33.32338094711304; dx=-1.49117168295434E-6 evalInputDelta=7.569789886474609E-6
New Minimum: -33.32338094711304 > -33.32339510321617
WOLFE (weak): th(12.926608140191302)=-33.32339510321617; dx=-1.4911492289550841E-6 evalInputDelta=2.1725893020629883E-5
New Minimum: -33.32339510321617 > -33.32346174120903
WOLFE (weak): th(51.70643256076521)=-33.32346174120903; dx=-1.4911582220387415E-6 evalInputDelta=8.83638858795166E-5
New Minimum: -33.32346174120903 > -33.32381524145603
WOLFE (weak): th(258.53216280382605)=-33.32381524145603; dx=-1.4910406520589813E-6 evalInputDelta=4.4186413288116455E-4
New Minimum: -33.32381524145603 > -33.326028764247894
WOLFE (weak): th(1551.1929768229563)=-33.326028764247894; dx=-1.4908380997263896E-6 evalInputDelta=0.0026553869247436523
New Minimum: -33.326028764247894 > -33.34194403886795
WOLFE (weak): th(10858.350837760694)=-33.34194403886795; dx=-1.488596791210117E-6 evalInputDelta=0.018570661544799805
New Minimum: -33.34194403886795 > -33.47064217925072
WOLFE (weak): th(86866.80670208555)=-33.47064217925072; dx=-1.4598962527445336E-6 evalInputDelta=0.14726880192756653
New Minimum: -33.47064217925072 > -34.51080325245857
END: th(781801.26031877)=-34.51080325245857; dx=-1.1475479485302031E-6 evalInputDelta=1.1874298751354218
Fitness changed from -33.32337337732315 to -34.51080325245857
Iteration 1 complete. Error: -34.51080325245857 Total: 165.6268; Orientation: 0.0749; Line Search: 128.7152
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 442a99f7 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-34.51080325245857;dx=-1.074858131877357E-6
New Minimum: -34.51080325245857 > -36.19316506385803
END: th(1684339.7559414052)=-36.19316506385803; dx=-6.833498321069919E-7 evalInputDelta=1.6823618113994598
Fitness changed from -34.51080325245857 to -36.19316506385803
Iteration 2 complete. Error: -36.19316506385803 Total: 37.9199; Orientation: 0.0861; Line Search: 24.9031
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 22da4d15 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-36.19316506385803;dx=-7.153675661897401E-7
New Minimum: -36.19316506385803 > -38.28414985537529
END: th(3628800.0)=-38.28414985537529; dx=-3.62570810961339E-7 evalInputDelta=2.0909847915172577
Fitness changed from -36.19316506385803 to -38.28414985537529
Iteration 3 complete. Error: -38.28414985537529 Total: 38.0716; Orientation: 0.0815; Line Search: 24.6860
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 58ea097 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.914e+03, gradient 7.201e-04, dot -0.732; [37e6cb9b-b4f5-4177-820d-17e3afc2d1b7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -38.28414985537529, -36.19316506385803, -34.51080325245857, -33.32337337732315
LBFGS Accumulation History: 3 points
Removed measurement 58ea097 to history. Total: 3
th(0)=-38.28414985537529;dx=-5.184859052771782E-7
New Minimum: -38.28414985537529 > -40.52907171845436
END: th(7818012.6031877)=-40.52907171845436; dx=-1.3730229403590663E-7 evalInputDelta=2.244921863079071
Fitness changed from -38.28414985537529 to -40.52907171845436
Iteration 4 complete. Error: -40.52907171845436 Total: 39.9625; Orientation: 1.6701; Line Search: 24.9674
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 71cfafca to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.439e+03, gradient 6.811e-04, dot -0.534; [37e6cb9b-b4f5-4177-820d-17e3afc2d1b7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -40.52907171845436, -36.19316506385803, -34.51080325245857, -33.32337337732315
LBFGS Accumulation History: 3 points
Removed measurement 71cfafca to history. Total: 3
th(0)=-40.52907171845436;dx=-4.637946960172556E-7
New Minimum: -40.52907171845436 > -42.03780469298363
WOLF (strong): th(1.684339755941405E7)=-42.03780469298363; dx=1.287400791308964E-8 evalInputDelta=1.5087329745292664
New Minimum: -42.03780469298363 > -42.14076140522957
END: th(8421698.779707026)=-42.14076140522957; dx=-1.1610688912422138E-8 evalInputDelta=1.6116896867752075
Fitness changed from -40.52907171845436 to -42.14076140522957
Iteration 5 complete. Error: -42.14076140522957 Total: 54.4246; Orientation: 1.6490; Line Search: 39.3488
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 44168752 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.142e+03, gradient 6.559e-04, dot -0.439; [37e6cb9b-b4f5-4177-820d-17e3afc2d1b7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -42.14076140522957, -36.19316506385803, -34.51080325245857, -33.32337337732315
LBFGS Accumulation History: 3 points
Removed measurement 44168752 to history. Total: 3
th(0)=-42.14076140522957;dx=-4.3017259616527787E-7
New Minimum: -42.14076140522957 > -42.68500888347626
WOLF (strong): th(1.8144E7)=-42.68500888347626; dx=8.96166889965308E-8 evalInputDelta=0.5442474782466888
New Minimum: -42.68500888347626 > -43.645615726709366
WOLF (strong): th(9072000.0)=-43.645615726709366; dx=4.906878467959486E-8 evalInputDelta=1.5048543214797974
END: th(3024000.0)=-43.25308012962341; dx=-2.099034854268446E-7 evalInputDelta=1.1123187243938446
Fitness changed from -42.14076140522957 to -43.645615726709366
Iteration 6 complete. Error: -43.645615726709366 Total: 64.8782; Orientation: 1.6508; Line Search: 50.4332
Adding measurement 3229aeb3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.594e+03, gradient 5.856e-04, dot -0.421; [37e6cb9b-b4f5-4177-820d-17e3afc2d1b7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -43.645615726709366, -36.19316506385803, -34.51080325245857, -33.32337337732315
LBFGS Accumulation History: 3 points
Removed measurement 3229aeb3 to history. Total: 3
th(0)=-43.645615726709366;dx=-3.428415104484142E-7
New Minimum: -43.645615726709366 > -44.95161917805672
END: th(6515010.502656417)=-44.95161917805672; dx=-3.821013229702862E-8 evalInputDelta=1.306003451347351
Fitness changed from -43.645615726709366 to -44.95161917805672
Iteration 7 complete. Error: -44.95161917805672 Total: 39.7397; Orientation: 1.5755; Line Search: 26.2943
Adding measurement ffeeee9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.784e+03, gradient 3.947e-04, dot -0.572; [37e6cb9b-b4f5-4177-820d-17e3afc2d1b7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -44.95161917805672, -36.19316506385803, -34.51080325245857, -33.32337337732315
LBFGS Accumulation History: 3 points
Removed measurement ffeeee9 to history. Total: 3
th(0)=-44.95161917805672;dx=-1.5578412615793167E-7
New Minimum: -44.95161917805672 > -45.93853801488876
WOLF (strong): th(1.4036164632845046E7)=-45.93853801488876; dx=4.259481033135699E-9 evalInputDelta=0.9869188368320465
END: th(7018082.316422523)=-45.776586920022964; dx=-5.4341456344271734E-8 evalInputDelta=0.8249677419662476
Fitness changed from -44.95161917805672 to -45.93853801488876
Iteration 8 complete. Error: -45.93853801488876 Total: 51.2623; Orientation: 1.5805; Line Search: 37.7534
Adding measurement 38e8c94 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.565e+03, gradient 4.731e-04, dot -0.409; [37e6cb9b-b4f5-4177-820d-17e3afc2d1b7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -45.93853801488876, -36.19316506385803, -34.51080325245857, -33.32337337732315
LBFGS Accumulation History: 3 points
Removed measurement 38e8c94 to history. Total: 3
th(0)=-45.93853801488876;dx=-2.2382291608413996E-7
New Minimum: -45.93853801488876 > -46.43658781051636
WOLF (strong): th(1.5120000000000004E7)=-46.43658781051636; dx=8.394405651905507E-8 evalInputDelta=0.498049795627594
New Minimum: -46.43658781051636 > -46.87148833274841
END: th(7560000.000000002)=-46.87148833274841; dx=-7.0100655283042286E-9 evalInputDelta=0.9329503178596497
Fitness changed from -45.93853801488876 to -46.87148833274841
Iteration 9 complete. Error: -46.87148833274841 Total: 51.2323; Orientation: 1.5539; Line Search: 37.2220
Adding measurement 784e87b4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.235e+03, gradient 3.304e-04, dot -0.543; [37e6cb9b-b4f5-4177-820d-17e3afc2d1b7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.87148833274841, -36.19316506385803, -34.51080325245857, -33.32337337732315
LBFGS Accumulation History: 3 points
Removed measurement 784e87b4 to history. Total: 3
th(0)=-46.87148833274841;dx=-1.0916627718518841E-7
New Minimum: -46.87148833274841 > -47.44932585954666
WOLF (strong): th(1.6287526256641045E7)=-47.44932585954666; dx=2.2265401514091192E-8 evalInputDelta=0.5778375267982483
New Minimum: -47.44932585954666 > -47.480276346206665
END: th(8143763.128320523)=-47.480276346206665; dx=-2.5276976274073274E-8 evalInputDelta=0.608788013458252
Fitness changed from -46.87148833274841 to -47.480276346206665
Iteration 10 complete. Error: -47.480276346206665 Total: 52.4147; Orientation: 1.6131; Line Search: 37.7037
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -47.480276346206665 (> -Infinity) after 596.234s (< 5400.000s)
Returns
-47.480276346206665