BasicOptimizer.scala:89 executed in 111.97 seconds (1.586 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 47818704526900
Reset training subject: 47821099572800
Corrupt weights measurement
LBFGS Accumulation History: 0 points
Constructing line search parameters: GD+Trust
New Minimum: -46.2315405589375 > -46.41219929422553
th(0)=-46.41219929422553;dx=-1.805835449754406E-6
New Minimum: -46.41219929422553 > -46.41220306271448
END: th(2.154434690031884)=-46.41220306271448; dx=-1.530003699141688E-6 evalInputDelta=3.7684889520051E-6
Fitness changed from -46.2315405589375 to -46.41220306271448
Iteration 1 complete. Error: -46.41220306271448 Total: 11.8566; Orientation: 0.0383; Line Search: 4.6898
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3917c8d to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-46.41220306271448;dx=-1.5280484295929161E-6
New Minimum: -46.41220306271448 > -46.412208715447335
WOLFE (weak): th(4.641588833612779)=-46.412208715447335; dx=-1.5246432067013782E-6 evalInputDelta=5.652732852468034E-6
New Minimum: -46.412208715447335 > -46.41221813666723
WOLFE (weak): th(9.283177667225559)=-46.41221813666723; dx=-1.5251791278266127E-6 evalInputDelta=1.507395274558121E-5
New Minimum: -46.41221813666723 > -46.41224828455803
WOLFE (weak): th(27.849533001676676)=-46.41224828455803; dx=-1.5241981266508346E-6 evalInputDelta=4.522184354982528E-5
New Minimum: -46.41224828455803 > -46.412385834061325
WOLFE (weak): th(111.3981320067067)=-46.412385834061325; dx=-1.5229565646446853E-6 evalInputDelta=1.8277134684296925E-4
New Minimum: -46.412385834061325 > -46.41312256487285
WOLFE (weak): th(556.9906600335335)=-46.41312256487285; dx=-1.5219973887342332E-6 evalInputDelta=9.195021583678908E-4
New Minimum: -46.41312256487285 > -46.41772545450541
WOLFE (weak): th(3341.9439602012008)=-46.41772545450541; dx=-1.5214870795958557E-6 evalInputDelta=0.005522391790925951
New Minimum: -46.41772545450541 > -46.45083283918538
WOLFE (weak): th(23393.607721408407)=-46.45083283918538; dx=-1.5203587635633425E-6 evalInputDelta=0.03862977647089849
New Minimum: -46.45083283918538 > -46.71959260771111
WOLFE (weak): th(187148.86177126726)=-46.71959260771111; dx=-1.5020271295418493E-6 evalInputDelta=0.3073895449966244
New Minimum: -46.71959260771111 > -49.019303545741174
END: th(1684339.7559414054)=-49.019303545741174; dx=-1.3310559699464883E-6 evalInputDelta=2.6071004830266915
Fitness changed from -46.41220306271448 to -49.019303545741174
Iteration 2 complete. Error: -49.019303545741174 Total: 26.3723; Orientation: 0.0652; Line Search: 23.4233
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 540ec689 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-49.019303545741174;dx=-1.3199029799514316E-6
New Minimum: -49.019303545741174 > -53.41740466679497
END: th(3628800.0000000005)=-53.41740466679497; dx=-9.800798211350271E-7 evalInputDelta=4.398101121053799
Fitness changed from -49.019303545741174 to -53.41740466679497
Iteration 3 complete. Error: -53.41740466679497 Total: 7.5720; Orientation: 0.0614; Line Search: 4.8452
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 69c3e7c3 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-53.41740466679497;dx=-9.240133422871541E-7
New Minimum: -53.41740466679497 > -59.81153181539776
END: th(7818012.603187701)=-59.81153181539776; dx=-6.130069113501874E-7 evalInputDelta=6.394127148602784
Fitness changed from -53.41740466679497 to -59.81153181539776
Iteration 4 complete. Error: -59.81153181539776 Total: 7.7060; Orientation: 0.0661; Line Search: 4.8668
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4d56dfab to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.984e+04, gradient 7.913e-04, dot -0.809; [37020a23-911e-4dff-82e6-6fc2e55984cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.81153181539776, -53.41740466679497, -49.019303545741174, -46.41220306271448
LBFGS Accumulation History: 3 points
Removed measurement 4d56dfab to history. Total: 3
th(0)=-59.81153181539776;dx=-6.249610102612952E-7
New Minimum: -59.81153181539776 > -68.1625691856552
END: th(1.6843397559414055E7)=-68.1625691856552; dx=-3.363132728071534E-7 evalInputDelta=8.351037370257444
Fitness changed from -59.81153181539776 to -68.1625691856552
Iteration 5 complete. Error: -68.1625691856552 Total: 8.6577; Orientation: 1.1126; Line Search: 4.9400
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6fe55bc1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.889e+04, gradient 6.985e-04, dot -0.638; [37020a23-911e-4dff-82e6-6fc2e55984cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -68.1625691856552, -53.41740466679497, -49.019303545741174, -46.41220306271448
LBFGS Accumulation History: 3 points
Removed measurement 6fe55bc1 to history. Total: 3
th(0)=-68.1625691856552;dx=-4.873631346587637E-7
New Minimum: -68.1625691856552 > -76.63941078565003
END: th(3.628800000000001E7)=-76.63941078565003; dx=-8.5428703038455E-8 evalInputDelta=8.476841599994827
Fitness changed from -68.1625691856552 to -76.63941078565003
Iteration 6 complete. Error: -76.63941078565003 Total: 8.3543; Orientation: 1.0771; Line Search: 4.6395
Adding measurement 499d7eda to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.870e+04, gradient 8.359e-04, dot -0.363; [37020a23-911e-4dff-82e6-6fc2e55984cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -76.63941078565003, -53.41740466679497, -49.019303545741174, -46.41220306271448
LBFGS Accumulation History: 3 points
Removed measurement 499d7eda to history. Total: 3
th(0)=-76.63941078565003;dx=-6.984286453665249E-7
Armijo: th(7.818012603187701E7)=-70.73083398500044; dx=1.6236432184292096E-7 evalInputDelta=-5.908576800649584
New Minimum: -76.63941078565003 > -79.47693506742145
WOLF (strong): th(3.9090063015938506E7)=-79.47693506742145; dx=1.9919293264642894E-7 evalInputDelta=2.8375242817714224
New Minimum: -79.47693506742145 > -82.49846732198564
END: th(1.3030021005312836E7)=-82.49846732198564; dx=-1.6139781359052324E-7 evalInputDelta=5.859056536335615
Fitness changed from -76.63941078565003 to -82.49846732198564
Iteration 7 complete. Error: -82.49846732198564 Total: 12.3617; Orientation: 1.0721; Line Search: 9.1228
Adding measurement 532555df to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.954e+04, gradient 5.899e-04, dot -0.538; [37020a23-911e-4dff-82e6-6fc2e55984cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -82.49846732198564, -53.41740466679497, -49.019303545741174, -46.41220306271448
LBFGS Accumulation History: 3 points
Removed measurement 532555df to history. Total: 3
th(0)=-82.49846732198564;dx=-3.4676355403518156E-7
New Minimum: -82.49846732198564 > -87.359970483315
END: th(2.8072329265690096E7)=-87.359970483315; dx=-3.972816410895423E-8 evalInputDelta=4.8615031613293525
Fitness changed from -82.49846732198564 to -87.359970483315
Iteration 8 complete. Error: -87.359970483315 Total: 7.8922; Orientation: 1.0521; Line Search: 4.6975
Adding measurement 415db1a8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.424e+04, gradient 7.279e-04, dot -0.399; [37020a23-911e-4dff-82e6-6fc2e55984cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -87.359970483315, -53.41740466679497, -49.019303545741174, -46.41220306271448
LBFGS Accumulation History: 3 points
Removed measurement 415db1a8 to history. Total: 3
th(0)=-87.359970483315;dx=-5.2794488757294E-7
Armijo: th(6.048000000000002E7)=-83.13647831805329; dx=1.662306371381857E-7 evalInputDelta=-4.223492165261703
New Minimum: -87.359970483315 > -89.59124027576411
WOLF (strong): th(3.024000000000001E7)=-89.59124027576411; dx=1.6755777172488758E-7 evalInputDelta=2.231269792449112
New Minimum: -89.59124027576411 > -91.06328881305902
END: th(1.0080000000000004E7)=-91.06328881305902; dx=-1.6684479300337545E-7 evalInputDelta=3.7033183297440218
Fitness changed from -87.359970483315 to -91.06328881305902
Iteration 9 complete. Error: -91.06328881305902 Total: 12.6701; Orientation: 1.1088; Line Search: 9.4109
Adding measurement 443d5097 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.220e+04, gradient 4.829e-04, dot -0.611; [37020a23-911e-4dff-82e6-6fc2e55984cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -91.06328881305902, -53.41740466679497, -49.019303545741174, -46.41220306271448
LBFGS Accumulation History: 3 points
Removed measurement 443d5097 to history. Total: 3
th(0)=-91.06328881305902;dx=-2.3248190909998289E-7
New Minimum: -91.06328881305902 > -94.69952801113376
END: th(2.1716701675521396E7)=-94.69952801113376; dx=-1.1234992574290753E-7 evalInputDelta=3.6362391980747475
Fitness changed from -91.06328881305902 to -94.69952801113376
Iteration 10 complete. Error: -94.69952801113376 Total: 7.9369; Orientation: 1.0014; Line Search: 4.4937
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -94.69952801113376 (> -Infinity) after 111.968s (< 5400.000s)
Returns
-94.69952801113376