BasicOptimizer.scala:89 executed in 129.66 seconds (1.563 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 26417501075500
Reset training subject: 26420120133800
Adding measurement 5bacb374 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-73.70806997886906;dx=-4.621858933172777E-6
New Minimum: -73.70806997886906 > -73.70807926384896
END: th(2.154434690031884)=-73.70807926384896; dx=-3.1976574158579826E-6 evalInputDelta=9.284979896051482E-6
Fitness changed from -73.70806997886906 to -73.70807926384896
Iteration 1 complete. Error: -73.70807926384896 Total: 12.9116; Orientation: 0.0617; Line Search: 5.0509
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 49359878 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-73.70807926384896;dx=-3.1731750580264117E-6
New Minimum: -73.70807926384896 > -73.70809319131658
WOLFE (weak): th(4.641588833612779)=-73.70809319131658; dx=-3.171727833642311E-6 evalInputDelta=1.392746762007846E-5
New Minimum: -73.70809319131658 > -73.70811176126932
WOLFE (weak): th(9.283177667225559)=-73.70811176126932; dx=-3.1704767094352357E-6 evalInputDelta=3.2497420363597485E-5
New Minimum: -73.70811176126932 > -73.70818139855044
WOLFE (weak): th(27.849533001676676)=-73.70818139855044; dx=-3.1685645891781025E-6 evalInputDelta=1.0213470147846238E-4
New Minimum: -73.70818139855044 > -73.70848083810954
WOLFE (weak): th(111.3981320067067)=-73.70848083810954; dx=-3.167020207595229E-6 evalInputDelta=4.015742605787409E-4
New Minimum: -73.70848083810954 > -73.7101010403623
WOLFE (weak): th(556.9906600335335)=-73.7101010403623; dx=-3.1660321280179837E-6 evalInputDelta=0.0020217765133452303
New Minimum: -73.7101010403623 > -73.72022069553438
WOLFE (weak): th(3341.9439602012008)=-73.72022069553438; dx=-3.1654095747993344E-6 evalInputDelta=0.012141431685421367
New Minimum: -73.72022069553438 > -73.79298791877265
WOLFE (weak): th(23393.607721408407)=-73.79298791877265; dx=-3.1606222823259667E-6 evalInputDelta=0.08490865492369437
New Minimum: -73.79298791877265 > -74.3821505629248
WOLFE (weak): th(187148.86177126726)=-74.3821505629248; dx=-3.1087357688098217E-6 evalInputDelta=0.6740712990758482
New Minimum: -74.3821505629248 > -79.24859870298235
END: th(1684339.7559414054)=-79.24859870298235; dx=-2.5214369009077086E-6 evalInputDelta=5.540519439133391
Fitness changed from -73.70807926384896 to -79.24859870298235
Iteration 2 complete. Error: -79.24859870298235 Total: 28.5740; Orientation: 0.0616; Line Search: 25.4522
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement db49f76 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-79.24859870298235;dx=-2.4531449222147114E-6
New Minimum: -79.24859870298235 > -87.1470221122091
END: th(3628800.0000000005)=-87.1470221122091; dx=-1.4303221250417579E-6 evalInputDelta=7.898423409226751
Fitness changed from -79.24859870298235 to -87.1470221122091
Iteration 3 complete. Error: -87.1470221122091 Total: 8.3004; Orientation: 0.0619; Line Search: 5.3986
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 74770ba0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.065e+04, gradient 1.237e-03, dot -0.707; [23b81267-1fbe-4041-970c-94b29efe710e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -87.1470221122091, -79.24859870298235, -73.70807926384896, -73.70806997886906
LBFGS Accumulation History: 3 points
Removed measurement 74770ba0 to history. Total: 3
th(0)=-87.1470221122091;dx=-1.5290085859621145E-6
New Minimum: -87.1470221122091 > -96.79623489043749
END: th(7818012.603187701)=-96.79623489043749; dx=-6.892528713192919E-7 evalInputDelta=9.649212778228389
Fitness changed from -87.1470221122091 to -96.79623489043749
Iteration 4 complete. Error: -96.79623489043749 Total: 9.0586; Orientation: 1.0641; Line Search: 5.1328
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2e0b601f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.353e+04, gradient 1.187e-03, dot -0.510; [23b81267-1fbe-4041-970c-94b29efe710e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -96.79623489043749, -79.24859870298235, -73.70807926384896, -73.70806997886906
LBFGS Accumulation History: 3 points
Removed measurement 2e0b601f to history. Total: 3
th(0)=-96.79623489043749;dx=-1.409283234140594E-6
New Minimum: -96.79623489043749 > -100.8534345368553
WOLF (strong): th(1.6843397559414055E7)=-100.8534345368553; dx=2.836517505903478E-7 evalInputDelta=4.057199646417814
New Minimum: -100.8534345368553 > -102.43837374491044
END: th(8421698.779707028)=-102.43837374491044; dx=-6.894524174340495E-8 evalInputDelta=5.642138854472947
Fitness changed from -96.79623489043749 to -102.43837374491044
Iteration 5 complete. Error: -102.43837374491044 Total: 11.4994; Orientation: 1.0707; Line Search: 7.5105
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 492b94f6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.279e+04, gradient 1.416e-03, dot -0.332; [23b81267-1fbe-4041-970c-94b29efe710e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -102.43837374491044, -79.24859870298235, -73.70807926384896, -73.70806997886906
LBFGS Accumulation History: 3 points
Removed measurement 492b94f6 to history. Total: 3
th(0)=-102.43837374491044;dx=-2.002535207636334E-6
Armijo: th(1.8144000000000004E7)=-95.58046659914831; dx=9.460633249444017E-7 evalInputDelta=-6.857907145762127
New Minimum: -102.43837374491044 > -105.7642607702615
WOLF (strong): th(9072000.000000002)=-105.7642607702615; dx=7.80720718278334E-7 evalInputDelta=3.325887025351065
New Minimum: -105.7642607702615 > -107.36093044800748
END: th(3024000.0000000005)=-107.36093044800748; dx=-7.957690399371938E-7 evalInputDelta=4.922556703097044
Fitness changed from -102.43837374491044 to -107.36093044800748
Iteration 6 complete. Error: -107.36093044800748 Total: 14.3093; Orientation: 1.0559; Line Search: 10.3405
Adding measurement 699ef3f1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.299e+04, gradient 9.187e-04, dot -0.661; [23b81267-1fbe-4041-970c-94b29efe710e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -107.36093044800748, -79.24859870298235, -73.70807926384896, -73.70806997886906
LBFGS Accumulation History: 3 points
Removed measurement 699ef3f1 to history. Total: 3
th(0)=-107.36093044800748;dx=-8.422489123606543E-7
New Minimum: -107.36093044800748 > -111.92862368524429
END: th(6515010.502656418)=-111.92862368524429; dx=-4.3448215216327024E-7 evalInputDelta=4.56769323723681
Fitness changed from -107.36093044800748 to -111.92862368524429
Iteration 7 complete. Error: -111.92862368524429 Total: 8.4714; Orientation: 0.9983; Line Search: 4.9681
Adding measurement 5c5c1d6c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.657e+04, gradient 9.520e-04, dot -0.588; [23b81267-1fbe-4041-970c-94b29efe710e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -111.92862368524429, -79.24859870298235, -73.70807926384896, -73.70806997886906
LBFGS Accumulation History: 3 points
Removed measurement 5c5c1d6c to history. Total: 3
th(0)=-111.92862368524429;dx=-9.050654234528257E-7
New Minimum: -111.92862368524429 > -115.46660706041051
WOLF (strong): th(1.4036164632845048E7)=-115.46660706041051; dx=1.0109036213504555E-7 evalInputDelta=3.5379833751662204
New Minimum: -115.46660706041051 > -115.57334564046141
END: th(7018082.316422524)=-115.57334564046141; dx=-1.5568100941327906E-7 evalInputDelta=3.644721955217122
Fitness changed from -111.92862368524429 to -115.57334564046141
Iteration 8 complete. Error: -115.57334564046141 Total: 11.0973; Orientation: 1.0289; Line Search: 7.5792
Adding measurement 75253c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.706e+04, gradient 1.097e-03, dot -0.459; [23b81267-1fbe-4041-970c-94b29efe710e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -115.57334564046141, -79.24859870298235, -73.70807926384896, -73.70806997886906
LBFGS Accumulation History: 3 points
Removed measurement 75253c to history. Total: 3
th(0)=-115.57334564046141;dx=-1.2019317410505521E-6
Armijo: th(1.5120000000000006E7)=-113.87815137572836; dx=5.894702726474252E-7 evalInputDelta=-1.695194264733047
New Minimum: -115.57334564046141 > -118.47732232096992
WOLF (strong): th(7560000.000000003)=-118.47732232096992; dx=3.1092983112807886E-7 evalInputDelta=2.9039766805085065
END: th(2520000.000000001)=-118.18864504839743; dx=-6.237573677620841E-7 evalInputDelta=2.6152994079360212
Fitness changed from -115.57334564046141 to -118.47732232096992
Iteration 9 complete. Error: -118.47732232096992 Total: 13.8133; Orientation: 1.0271; Line Search: 10.3382
Adding measurement aae1f32 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.642e+04, gradient 1.312e-03, dot -0.329; [23b81267-1fbe-4041-970c-94b29efe710e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -118.47732232096992, -79.24859870298235, -73.70807926384896, -73.70806997886906
LBFGS Accumulation History: 3 points
Removed measurement aae1f32 to history. Total: 3
th(0)=-118.47732232096992;dx=-1.721814306059902E-6
New Minimum: -118.47732232096992 > -122.69829000611104
WOLF (strong): th(5429175.418880349)=-122.69829000611104; dx=3.421087129393585E-7 evalInputDelta=4.220967685141119
END: th(2714587.7094401745)=-122.33393598217785; dx=-7.105104182579225E-7 evalInputDelta=3.8566136612079305
Fitness changed from -118.47732232096992 to -122.69829000611104
Iteration 10 complete. Error: -122.69829000611104 Total: 11.1756; Orientation: 1.0255; Line Search: 7.6014
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -122.69829000611104 (> -Infinity) after 129.659s (< 5400.000s)
Returns
-122.69829000611104