BasicOptimizer.scala:89 executed in 109.88 seconds (1.269 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 40979428243400
Reset training subject: 40981763795100
Adding measurement 25a963b to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-48.56674318704635;dx=-1.6644670453614693E-6
New Minimum: -48.56674318704635 > -48.566744987701
END: th(2.154434690031884)=-48.566744987701; dx=-1.2766516458741785E-6 evalInputDelta=1.8006546511628585E-6
Fitness changed from -48.56674318704635 to -48.566744987701
Iteration 1 complete. Error: -48.566744987701 Total: 11.4245; Orientation: 0.0688; Line Search: 4.5876
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 66ddd652 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-48.566744987701;dx=-1.2616702564803543E-6
New Minimum: -48.566744987701 > -48.566752190318944
WOLFE (weak): th(4.641588833612779)=-48.566752190318944; dx=-1.2591270266161997E-6 evalInputDelta=7.20261794384669E-6
New Minimum: -48.566752190318944 > -48.5667575922817
WOLFE (weak): th(9.283177667225559)=-48.5667575922817; dx=-1.258474028680151E-6 evalInputDelta=1.2604580696518042E-5
New Minimum: -48.5667575922817 > -48.56678460208646
WOLFE (weak): th(27.849533001676676)=-48.56678460208646; dx=-1.2568065518592202E-6 evalInputDelta=3.961438545729834E-5
New Minimum: -48.56678460208646 > -48.56689624245344
WOLFE (weak): th(111.3981320067067)=-48.56689624245344; dx=-1.2558589154426078E-6 evalInputDelta=1.5125475243848996E-4
New Minimum: -48.56689624245344 > -48.567504858005634
WOLFE (weak): th(556.9906600335335)=-48.567504858005634; dx=-1.2561085968134252E-6 evalInputDelta=7.598703046340916E-4
New Minimum: -48.567504858005634 > -48.571298629755645
WOLFE (weak): th(3341.9439602012008)=-48.571298629755645; dx=-1.256022909434841E-6 evalInputDelta=0.004553642054645479
New Minimum: -48.571298629755645 > -48.59860252460659
WOLFE (weak): th(23393.607721408407)=-48.59860252460659; dx=-1.2535327692490774E-6 evalInputDelta=0.03185753690559068
New Minimum: -48.59860252460659 > -48.8200827869491
WOLFE (weak): th(187148.86177126726)=-48.8200827869491; dx=-1.2374332407509973E-6 evalInputDelta=0.25333779924810074
New Minimum: -48.8200827869491 > -50.709750636107835
END: th(1684339.7559414054)=-50.709750636107835; dx=-1.095931499602389E-6 evalInputDelta=2.1430056484068345
Fitness changed from -48.566744987701 to -50.709750636107835
Iteration 2 complete. Error: -50.709750636107835 Total: 25.4443; Orientation: 0.0656; Line Search: 22.7333
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2659ccf4 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-50.709750636107835;dx=-1.0930856147154452E-6
New Minimum: -50.709750636107835 > -54.32965991533409
END: th(3628800.0000000005)=-54.32965991533409; dx=-8.104623926729987E-7 evalInputDelta=3.619909279226256
Fitness changed from -50.709750636107835 to -54.32965991533409
Iteration 3 complete. Error: -54.32965991533409 Total: 7.3459; Orientation: 0.0652; Line Search: 4.4700
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 735e4ad6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.466e+04, gradient 8.783e-04, dot -0.883; [eca050c2-29b7-401b-9373-d07fa54fcace = 1.000/1.000e+00]
Orientation rejected. Popping history element from -54.32965991533409, -50.709750636107835, -48.566744987701, -48.56674318704635
LBFGS Accumulation History: 3 points
Removed measurement 735e4ad6 to history. Total: 3
th(0)=-54.32965991533409;dx=-7.694524491236592E-7
New Minimum: -54.32965991533409 > -59.692785893531216
END: th(7818012.603187701)=-59.692785893531216; dx=-5.242952815792449E-7 evalInputDelta=5.363125978197125
Fitness changed from -54.32965991533409 to -59.692785893531216
Iteration 4 complete. Error: -59.692785893531216 Total: 8.4748; Orientation: 1.1247; Line Search: 4.3826
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 3593b86d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.354e+04, gradient 7.411e-04, dot -0.767; [eca050c2-29b7-401b-9373-d07fa54fcace = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.692785893531216, -50.709750636107835, -48.566744987701, -48.56674318704635
LBFGS Accumulation History: 3 points
Removed measurement 3593b86d to history. Total: 3
th(0)=-59.692785893531216;dx=-5.476720460859509E-7
New Minimum: -59.692785893531216 > -67.1363939979654
END: th(1.6843397559414055E7)=-67.1363939979654; dx=-3.111248555390766E-7 evalInputDelta=7.443608104434183
Fitness changed from -59.692785893531216 to -67.1363939979654
Iteration 5 complete. Error: -67.1363939979654 Total: 8.0375; Orientation: 1.0881; Line Search: 4.3655
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 396e83d6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.842e+04, gradient 6.870e-04, dot -0.612; [eca050c2-29b7-401b-9373-d07fa54fcace = 1.000/1.000e+00]
Orientation rejected. Popping history element from -67.1363939979654, -50.709750636107835, -48.566744987701, -48.56674318704635
LBFGS Accumulation History: 3 points
Removed measurement 396e83d6 to history. Total: 3
th(0)=-67.1363939979654;dx=-4.7137936254244026E-7
New Minimum: -67.1363939979654 > -75.04712544177812
END: th(3.628800000000001E7)=-75.04712544177812; dx=-8.104381461079016E-8 evalInputDelta=7.910731443812722
Fitness changed from -67.1363939979654 to -75.04712544177812
Iteration 6 complete. Error: -75.04712544177812 Total: 8.2761; Orientation: 1.0546; Line Search: 4.5092
Adding measurement 68c2e680 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.956e+04, gradient 8.581e-04, dot -0.287; [eca050c2-29b7-401b-9373-d07fa54fcace = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.04712544177812, -50.709750636107835, -48.566744987701, -48.56674318704635
LBFGS Accumulation History: 3 points
Removed measurement 68c2e680 to history. Total: 3
th(0)=-75.04712544177812;dx=-7.356043793045974E-7
Armijo: th(7.818012603187701E7)=-69.0861467069247; dx=1.5068328158391118E-7 evalInputDelta=-5.960978734853427
New Minimum: -75.04712544177812 > -77.58567956301921
WOLF (strong): th(3.9090063015938506E7)=-77.58567956301921; dx=2.0162394792633386E-7 evalInputDelta=2.5385541212410914
New Minimum: -77.58567956301921 > -81.09229769638613
END: th(1.3030021005312836E7)=-81.09229769638613; dx=-1.5108555548302703E-7 evalInputDelta=6.045172254608005
Fitness changed from -75.04712544177812 to -81.09229769638613
Iteration 7 complete. Error: -81.09229769638613 Total: 12.4216; Orientation: 1.1352; Line Search: 9.1703
Adding measurement 4e16ad82 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.311e+04, gradient 6.035e-04, dot -0.525; [eca050c2-29b7-401b-9373-d07fa54fcace = 1.000/1.000e+00]
Orientation rejected. Popping history element from -81.09229769638613, -50.709750636107835, -48.566744987701, -48.56674318704635
LBFGS Accumulation History: 3 points
Removed measurement 4e16ad82 to history. Total: 3
th(0)=-81.09229769638613;dx=-3.635436762132064E-7
New Minimum: -81.09229769638613 > -85.9144842661968
END: th(2.8072329265690096E7)=-85.9144842661968; dx=-2.8951308126220536E-8 evalInputDelta=4.822186569810668
Fitness changed from -81.09229769638613 to -85.9144842661968
Iteration 8 complete. Error: -85.9144842661968 Total: 7.8614; Orientation: 1.0726; Line Search: 4.5731
Adding measurement 1d964202 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.553e+04, gradient 7.605e-04, dot -0.352; [eca050c2-29b7-401b-9373-d07fa54fcace = 1.000/1.000e+00]
Orientation rejected. Popping history element from -85.9144842661968, -50.709750636107835, -48.566744987701, -48.56674318704635
LBFGS Accumulation History: 3 points
Removed measurement 1d964202 to history. Total: 3
th(0)=-85.9144842661968;dx=-5.770392422619968E-7
Armijo: th(6.048000000000002E7)=-81.31168466271593; dx=1.6470300746115585E-7 evalInputDelta=-4.602799603480861
New Minimum: -85.9144842661968 > -88.04002148057083
WOLF (strong): th(3.024000000000001E7)=-88.04002148057083; dx=1.8161428451336375E-7 evalInputDelta=2.1255372143740345
New Minimum: -88.04002148057083 > -89.90232891092505
END: th(1.0080000000000004E7)=-89.90232891092505; dx=-1.6826988725108222E-7 evalInputDelta=3.9878446447282556
Fitness changed from -85.9144842661968 to -89.90232891092505
Iteration 9 complete. Error: -89.90232891092505 Total: 12.3759; Orientation: 1.0716; Line Search: 9.1532
Adding measurement 200437e8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.669e+04, gradient 4.931e-04, dot -0.610; [eca050c2-29b7-401b-9373-d07fa54fcace = 1.000/1.000e+00]
Orientation rejected. Popping history element from -89.90232891092505, -50.709750636107835, -48.566744987701, -48.56674318704635
LBFGS Accumulation History: 3 points
Removed measurement 200437e8 to history. Total: 3
th(0)=-89.90232891092505;dx=-2.426415372969524E-7
New Minimum: -89.90232891092505 > -93.64234055221286
END: th(2.1716701675521396E7)=-93.64234055221286; dx=-1.1377155965338833E-7 evalInputDelta=3.7400116412878077
Fitness changed from -89.90232891092505 to -93.64234055221286
Iteration 10 complete. Error: -93.64234055221286 Total: 7.7689; Orientation: 1.1093; Line Search: 4.5192
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -93.64234055221286 (> -Infinity) after 109.876s (< 5400.000s)
Returns
-93.64234055221286