BasicOptimizer.scala:89 executed in 130.52 seconds (1.710 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 29584492561900
Reset training subject: 29587150380700
Adding measurement 51e5c56c to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-70.63115952631283;dx=-4.600080254992468E-6
New Minimum: -70.63115952631283 > -70.63116679340952
END: th(2.154434690031884)=-70.63116679340952; dx=-3.1694727242902084E-6 evalInputDelta=7.2670966915211466E-6
Fitness changed from -70.63115952631283 to -70.63116679340952
Iteration 1 complete. Error: -70.63116679340952 Total: 12.8882; Orientation: 0.0641; Line Search: 5.3110
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 472326f0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-70.63116679340952;dx=-3.1376239627167785E-6
New Minimum: -70.63116679340952 > -70.63118617233039
WOLFE (weak): th(4.641588833612779)=-70.63118617233039; dx=-3.135305997606028E-6 evalInputDelta=1.93789208680073E-5
New Minimum: -70.63118617233039 > -70.63119828415323
WOLFE (weak): th(9.283177667225559)=-70.63119828415323; dx=-3.1352743881798456E-6 evalInputDelta=3.149074370867311E-5
New Minimum: -70.63119828415323 > -70.63127095504666
WOLFE (weak): th(27.849533001676676)=-70.63127095504666; dx=-3.1335763305194885E-6 evalInputDelta=1.0416163713955484E-4
New Minimum: -70.63127095504666 > -70.63157617198259
WOLFE (weak): th(111.3981320067067)=-70.63157617198259; dx=-3.131472711322896E-6 evalInputDelta=4.0937857306744263E-4
New Minimum: -70.63157617198259 > -70.63320397336629
WOLFE (weak): th(556.9906600335335)=-70.63320397336629; dx=-3.1298153447686268E-6 evalInputDelta=0.002037179956772661
New Minimum: -70.63320397336629 > -70.64335750663255
WOLFE (weak): th(3341.9439602012008)=-70.64335750663255; dx=-3.1302721687716404E-6 evalInputDelta=0.012190713223034777
New Minimum: -70.64335750663255 > -70.71643345919476
WOLFE (weak): th(23393.607721408407)=-70.71643345919476; dx=-3.1255148876026964E-6 evalInputDelta=0.085266665785241
New Minimum: -70.71643345919476 > -71.30814689966056
WOLFE (weak): th(187148.86177126726)=-71.30814689966056; dx=-3.074947203054832E-6 evalInputDelta=0.6769801062510368
New Minimum: -71.30814689966056 > -76.19345310912438
END: th(1684339.7559414054)=-76.19345310912438; dx=-2.4944113760020574E-6 evalInputDelta=5.562286315714857
Fitness changed from -70.63116679340952 to -76.19345310912438
Iteration 2 complete. Error: -76.19345310912438 Total: 28.6044; Orientation: 0.2829; Line Search: 25.4555
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 25bfee00 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-76.19345310912438;dx=-2.4508828479995953E-6
New Minimum: -76.19345310912438 > -84.06256085323956
END: th(3628800.0000000005)=-84.06256085323956; dx=-1.3867105447567222E-6 evalInputDelta=7.869107744115183
Fitness changed from -76.19345310912438 to -84.06256085323956
Iteration 3 complete. Error: -84.06256085323956 Total: 8.1340; Orientation: 0.0595; Line Search: 5.1049
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 674040fa to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.015e+04, gradient 1.225e-03, dot -0.691; [fa13a9ed-fa2e-4ebd-99af-540fa7c748d9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -84.06256085323956, -76.19345310912438, -70.63116679340952, -70.63115952631283
LBFGS Accumulation History: 3 points
Removed measurement 674040fa to history. Total: 3
th(0)=-84.06256085323956;dx=-1.495936702627246E-6
New Minimum: -84.06256085323956 > -93.39992800481912
END: th(7818012.603187701)=-93.39992800481912; dx=-6.434500756824522E-7 evalInputDelta=9.337367151579556
Fitness changed from -84.06256085323956 to -93.39992800481912
Iteration 4 complete. Error: -93.39992800481912 Total: 9.1469; Orientation: 1.1055; Line Search: 5.0279
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4d543753 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.272e+04, gradient 1.181e-03, dot -0.492; [fa13a9ed-fa2e-4ebd-99af-540fa7c748d9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -93.39992800481912, -76.19345310912438, -70.63116679340952, -70.63115952631283
LBFGS Accumulation History: 3 points
Removed measurement 4d543753 to history. Total: 3
th(0)=-93.39992800481912;dx=-1.3942214103134954E-6
New Minimum: -93.39992800481912 > -96.67242907726032
WOLF (strong): th(1.6843397559414055E7)=-96.67242907726032; dx=2.821257822174552E-7 evalInputDelta=3.2725010724412016
New Minimum: -96.67242907726032 > -98.62340699983967
END: th(8421698.779707028)=-98.62340699983967; dx=-2.0901989516650113E-8 evalInputDelta=5.223478995020557
Fitness changed from -93.39992800481912 to -98.62340699983967
Iteration 5 complete. Error: -98.62340699983967 Total: 11.7126; Orientation: 1.0900; Line Search: 7.6093
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 51f2ee21 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.142e+04, gradient 1.420e-03, dot -0.316; [fa13a9ed-fa2e-4ebd-99af-540fa7c748d9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -98.62340699983967, -76.19345310912438, -70.63116679340952, -70.63115952631283
LBFGS Accumulation History: 3 points
Removed measurement 51f2ee21 to history. Total: 3
th(0)=-98.62340699983967;dx=-2.0142622112068206E-6
Armijo: th(1.8144000000000004E7)=-91.5987767998481; dx=8.663115034670192E-7 evalInputDelta=-7.024630199991577
New Minimum: -98.62340699983967 > -101.79269667152622
WOLF (strong): th(9072000.000000002)=-101.79269667152622; dx=8.040952527161557E-7 evalInputDelta=3.169289671686542
New Minimum: -101.79269667152622 > -103.69519640125237
END: th(3024000.0000000005)=-103.69519640125237; dx=-8.035853867076015E-7 evalInputDelta=5.071789401412701
Fitness changed from -98.62340699983967 to -103.69519640125237
Iteration 6 complete. Error: -103.69519640125237 Total: 14.3112; Orientation: 1.0614; Line Search: 10.1566
Adding measurement 64159078 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.200e+04, gradient 9.120e-04, dot -0.658; [fa13a9ed-fa2e-4ebd-99af-540fa7c748d9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -103.69519640125237, -76.19345310912438, -70.63116679340952, -70.63115952631283
LBFGS Accumulation History: 3 points
Removed measurement 64159078 to history. Total: 3
th(0)=-103.69519640125237;dx=-8.298952280456459E-7
New Minimum: -103.69519640125237 > -108.15447272906438
END: th(6515010.502656418)=-108.15447272906438; dx=-4.15048051086984E-7 evalInputDelta=4.459276327812006
Fitness changed from -103.69519640125237 to -108.15447272906438
Iteration 7 complete. Error: -108.15447272906438 Total: 8.5942; Orientation: 1.0889; Line Search: 5.0991
Adding measurement a335807 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.550e+04, gradient 9.417e-04, dot -0.584; [fa13a9ed-fa2e-4ebd-99af-540fa7c748d9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -108.15447272906438, -76.19345310912438, -70.63116679340952, -70.63115952631283
LBFGS Accumulation History: 3 points
Removed measurement a335807 to history. Total: 3
th(0)=-108.15447272906438;dx=-8.860014820574608E-7
New Minimum: -108.15447272906438 > -111.45236759060157
WOLF (strong): th(1.4036164632845048E7)=-111.45236759060157; dx=9.852974480756215E-8 evalInputDelta=3.2978948615371877
New Minimum: -111.45236759060157 > -111.69463114995699
END: th(7018082.316422524)=-111.69463114995699; dx=-1.429342452065518E-7 evalInputDelta=3.5401584208926096
Fitness changed from -108.15447272906438 to -111.69463114995699
Iteration 8 complete. Error: -111.69463114995699 Total: 11.4765; Orientation: 1.0464; Line Search: 7.7650
Adding measurement 2b71cf7f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.591e+04, gradient 1.083e-03, dot -0.458; [fa13a9ed-fa2e-4ebd-99af-540fa7c748d9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -111.69463114995699, -76.19345310912438, -70.63116679340952, -70.63115952631283
LBFGS Accumulation History: 3 points
Removed measurement 2b71cf7f to history. Total: 3
th(0)=-111.69463114995699;dx=-1.1720725395903557E-6
Armijo: th(1.5120000000000006E7)=-109.92009767177437; dx=5.524446213721625E-7 evalInputDelta=-1.7745334781826188
New Minimum: -111.69463114995699 > -114.47230477163221
WOLF (strong): th(7560000.000000003)=-114.47230477163221; dx=2.9814047877118436E-7 evalInputDelta=2.77767362167522
END: th(2520000.000000001)=-114.2640559532165; dx=-5.994027187600658E-7 evalInputDelta=2.5694248032595084
Fitness changed from -111.69463114995699 to -114.47230477163221
Iteration 9 complete. Error: -114.47230477163221 Total: 14.2045; Orientation: 1.2481; Line Search: 10.5522
Adding measurement 6d219d95 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.535e+04, gradient 1.288e-03, dot -0.328; [fa13a9ed-fa2e-4ebd-99af-540fa7c748d9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -114.47230477163221, -76.19345310912438, -70.63116679340952, -70.63115952631283
LBFGS Accumulation History: 3 points
Removed measurement 6d219d95 to history. Total: 3
th(0)=-114.47230477163221;dx=-1.6578303549826324E-6
New Minimum: -114.47230477163221 > -118.62685526679554
WOLF (strong): th(5429175.418880349)=-118.62685526679554; dx=3.1592841414703223E-7 evalInputDelta=4.154550495163335
END: th(2714587.7094401745)=-118.25219668793162; dx=-6.986823700948066E-7 evalInputDelta=3.7798919162994054
Fitness changed from -114.47230477163221 to -118.62685526679554
Iteration 10 complete. Error: -118.62685526679554 Total: 11.0237; Orientation: 1.0719; Line Search: 7.5230
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -118.62685526679554 (> -Infinity) after 130.519s (< 5400.000s)
Returns
-118.62685526679554