BasicOptimizer.scala:89 executed in 151.13 seconds (2.557 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 468729062881400
Reset training subject: 468732161115600
Adding measurement 361a8fc to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-91.40464059040714;dx=-1.1888778625565375E-5
New Minimum: -91.40464059040714 > -91.40466490652203
END: th(2.154434690031884)=-91.40466490652203; dx=-1.0101882249336938E-5 evalInputDelta=2.4316114888733864E-5
Fitness changed from -91.40464059040714 to -91.40466490652203
Iteration 1 complete. Error: -91.40466490652203 Total: 14.4928; Orientation: 0.1075; Line Search: 5.6975
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3a8a8b87 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-91.40466490652203;dx=-1.00746545866342E-5
New Minimum: -91.40466490652203 > -91.40471657824467
WOLFE (weak): th(4.641588833612779)=-91.40471657824467; dx=-1.0080544596592423E-5 evalInputDelta=5.1671722644641704E-5
New Minimum: -91.40471657824467 > -91.40476824993812
WOLFE (weak): th(9.283177667225559)=-91.40476824993812; dx=-1.007715423413177E-5 evalInputDelta=1.0334341608597697E-4
New Minimum: -91.40476824993812 > -91.40496277840438
WOLFE (weak): th(27.849533001676676)=-91.40496277840438; dx=-1.0080835920434816E-5 evalInputDelta=2.978718823527515E-4
New Minimum: -91.40496277840438 > -91.40585030927835
WOLFE (weak): th(111.3981320067067)=-91.40585030927835; dx=-1.007636543459306E-5 evalInputDelta=0.0011854027563202862
New Minimum: -91.40585030927835 > -91.41059176658192
WOLFE (weak): th(556.9906600335335)=-91.41059176658192; dx=-1.0064828676694504E-5 evalInputDelta=0.0059268600598869625
New Minimum: -91.41059176658192 > -91.44021726615021
WOLFE (weak): th(3341.9439602012008)=-91.44021726615021; dx=-1.0069115980139048E-5 evalInputDelta=0.03555235962818415
New Minimum: -91.44021726615021 > -91.65305691018571
WOLFE (weak): th(23393.607721408407)=-91.65305691018571; dx=-1.0036635877189525E-5 evalInputDelta=0.24839200366368175
New Minimum: -91.65305691018571 > -93.36393994198538
WOLFE (weak): th(187148.86177126726)=-93.36393994198538; dx=-9.743096282813433E-6 evalInputDelta=1.9592750354633495
New Minimum: -93.36393994198538 > -106.52724061650684
END: th(1684339.7559414054)=-106.52724061650684; dx=-6.903146361898961E-6 evalInputDelta=15.122575709984815
Fitness changed from -91.40466490652203 to -106.52724061650684
Iteration 2 complete. Error: -106.52724061650684 Total: 32.8706; Orientation: 0.0969; Line Search: 28.9909
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 32c81c9b to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-106.52724061650684;dx=-6.897159249843869E-6
New Minimum: -106.52724061650684 > -125.36266731711837
END: th(3628800.0000000005)=-125.36266731711837; dx=-3.408867176573839E-6 evalInputDelta=18.83542670061152
Fitness changed from -106.52724061650684 to -125.36266731711837
Iteration 3 complete. Error: -125.36266731711837 Total: 9.4895; Orientation: 0.0907; Line Search: 5.7600
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3ee6311d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.129e+04, gradient 2.112e-03, dot -0.603; [3153709e-68c0-4627-ad7a-b31da4f3978c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -125.36266731711837, -106.52724061650684, -91.40466490652203, -91.40464059040714
LBFGS Accumulation History: 3 points
Removed measurement 3ee6311d to history. Total: 3
th(0)=-125.36266731711837;dx=-4.439864919419326E-6
New Minimum: -125.36266731711837 > -145.52739139343672
END: th(7818012.603187701)=-145.52739139343672; dx=-1.2134501952191827E-6 evalInputDelta=20.16472407631835
Fitness changed from -125.36266731711837 to -145.52739139343672
Iteration 4 complete. Error: -145.52739139343672 Total: 11.4578; Orientation: 1.9112; Line Search: 5.8782
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 416057c1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.304e+04, gradient 2.137e-03, dot -0.372; [3153709e-68c0-4627-ad7a-b31da4f3978c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -145.52739139343672, -106.52724061650684, -91.40466490652203, -91.40464059040714
LBFGS Accumulation History: 3 points
Removed measurement 416057c1 to history. Total: 3
th(0)=-145.52739139343672;dx=-4.554437284550728E-6
New Minimum: -145.52739139343672 > -153.25230537977603
WOLF (strong): th(1.6843397559414055E7)=-153.25230537977603; dx=7.778493802957613E-7 evalInputDelta=7.724913986339317
New Minimum: -153.25230537977603 > -159.12725662035712
WOLF (strong): th(8421698.779707028)=-159.12725662035712; dx=1.4029034906907346E-7 evalInputDelta=13.5998652269204
END: th(2807232.926569009)=-155.28690206630696; dx=-2.147582282238983E-6 evalInputDelta=9.759510672870249
Fitness changed from -145.52739139343672 to -159.12725662035712
Iteration 5 complete. Error: -159.12725662035712 Total: 17.0329; Orientation: 1.9488; Line Search: 11.7392
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2d40b6d7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.535e+04, gradient 2.223e-03, dot -0.290; [3153709e-68c0-4627-ad7a-b31da4f3978c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -159.12725662035712, -106.52724061650684, -91.40466490652203, -91.40464059040714
LBFGS Accumulation History: 3 points
Removed measurement 2d40b6d7 to history. Total: 3
th(0)=-159.12725662035712;dx=-4.919885347231624E-6
New Minimum: -159.12725662035712 > -174.1636213299731
END: th(6048000.000000001)=-174.1636213299731; dx=-1.42555707140179E-7 evalInputDelta=15.036364709615981
Fitness changed from -159.12725662035712 to -174.1636213299731
Iteration 6 complete. Error: -174.1636213299731 Total: 11.2868; Orientation: 1.7420; Line Search: 5.8876
Adding measurement ed8c923 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.445e+04, gradient 1.762e-03, dot -0.427; [3153709e-68c0-4627-ad7a-b31da4f3978c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -174.1636213299731, -106.52724061650684, -91.40466490652203, -91.40464059040714
LBFGS Accumulation History: 3 points
Removed measurement ed8c923 to history. Total: 3
th(0)=-174.1636213299731;dx=-3.0956796494766356E-6
New Minimum: -174.1636213299731 > -180.94452352745603
WOLF (strong): th(1.3030021005312836E7)=-180.94452352745603; dx=7.374615953567834E-7 evalInputDelta=6.780902197482931
New Minimum: -180.94452352745603 > -184.07672382222023
END: th(6515010.502656418)=-184.07672382222023; dx=-1.9584439525549986E-7 evalInputDelta=9.913102492247134
Fitness changed from -174.1636213299731 to -184.07672382222023
Iteration 7 complete. Error: -184.07672382222023 Total: 13.2036; Orientation: 1.8652; Line Search: 8.6835
Adding measurement 74624aee to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.883e+04, gradient 1.704e-03, dot -0.431; [3153709e-68c0-4627-ad7a-b31da4f3978c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -184.07672382222023, -106.52724061650684, -91.40466490652203, -91.40464059040714
LBFGS Accumulation History: 3 points
Removed measurement 74624aee to history. Total: 3
th(0)=-184.07672382222023;dx=-2.8960506639668783E-6
New Minimum: -184.07672382222023 > -187.4363305562135
WOLF (strong): th(1.4036164632845048E7)=-187.4363305562135; dx=8.679335864366544E-7 evalInputDelta=3.3596067339932745
New Minimum: -187.4363305562135 > -192.49409475078227
WOLF (strong): th(7018082.316422524)=-192.49409475078227; dx=1.2971551135669857E-7 evalInputDelta=8.417370928562036
END: th(2339360.7721408415)=-189.61683584056823; dx=-1.6577639079776063E-6 evalInputDelta=5.5401120183479975
Fitness changed from -184.07672382222023 to -192.49409475078227
Iteration 8 complete. Error: -192.49409475078227 Total: 16.4007; Orientation: 1.8689; Line Search: 11.7195
Adding measurement 50c88b3f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.154e+04, gradient 1.731e-03, dot -0.392; [3153709e-68c0-4627-ad7a-b31da4f3978c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -192.49409475078227, -106.52724061650684, -91.40466490652203, -91.40464059040714
LBFGS Accumulation History: 3 points
Removed measurement 50c88b3f to history. Total: 3
th(0)=-192.49409475078227;dx=-2.9909357825418487E-6
New Minimum: -192.49409475078227 > -200.85213415714762
END: th(5040000.000000002)=-200.85213415714762; dx=-3.1619523694909705E-7 evalInputDelta=8.35803940636535
Fitness changed from -192.49409475078227 to -200.85213415714762
Iteration 9 complete. Error: -200.85213415714762 Total: 10.8590; Orientation: 1.7760; Line Search: 5.9583
Adding measurement 40a9262c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.735e+04, gradient 1.373e-03, dot -0.514; [3153709e-68c0-4627-ad7a-b31da4f3978c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -200.85213415714762, -106.52724061650684, -91.40466490652203, -91.40464059040714
LBFGS Accumulation History: 3 points
Removed measurement 40a9262c to history. Total: 3
th(0)=-200.85213415714762;dx=-1.8818278155820138E-6
New Minimum: -200.85213415714762 > -207.36193485214864
WOLF (strong): th(1.0858350837760698E7)=-207.36193485214864; dx=1.4916166136473745E-7 evalInputDelta=6.509800695001019
END: th(5429175.418880349)=-207.03693146441086; dx=-4.788538249349794E-7 evalInputDelta=6.1847973072632385
Fitness changed from -200.85213415714762 to -207.36193485214864
Iteration 10 complete. Error: -207.36193485214864 Total: 13.4182; Orientation: 1.8054; Line Search: 8.8657
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -207.36193485214864 (> -Infinity) after 151.128s (< 5400.000s)
Returns
-207.36193485214864