BasicOptimizer.scala:89 executed in 228.88 seconds (2.514 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 4064828336913
Reset training subject: 4070047615230
Adding measurement 79bce404 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-11.301979929208755;dx=-3.851666114588346E-6
New Minimum: -11.301979929208755 > -11.301990017294884
WOLFE (weak): th(2.154434690031884)=-11.301990017294884; dx=-3.704231766322945E-6 evalInputDelta=1.0088086128234863E-5
New Minimum: -11.301990017294884 > -11.301999270915985
WOLFE (weak): th(4.308869380063768)=-11.301999270915985; dx=-3.7042273520245806E-6 evalInputDelta=1.9341707229614258E-5
New Minimum: -11.301999270915985 > -11.302037686109543
WOLFE (weak): th(12.926608140191302)=-11.302037686109543; dx=-3.705442043056933E-6 evalInputDelta=5.7756900787353516E-5
New Minimum: -11.302037686109543 > -11.302210748195648
WOLFE (weak): th(51.70643256076521)=-11.302210748195648; dx=-3.7036339171484875E-6 evalInputDelta=2.308189868927002E-4
New Minimum: -11.302210748195648 > -11.303134799003601
WOLFE (weak): th(258.53216280382605)=-11.303134799003601; dx=-3.7029468163764123E-6 evalInputDelta=0.001154869794845581
New Minimum: -11.303134799003601 > -11.30890429019928
WOLFE (weak): th(1551.1929768229563)=-11.30890429019928; dx=-3.697654113162531E-6 evalInputDelta=0.006924360990524292
New Minimum: -11.30890429019928 > -11.350111797451973
WOLFE (weak): th(10858.350837760694)=-11.350111797451973; dx=-3.6450207228130934E-6 evalInputDelta=0.04813186824321747
New Minimum: -11.350111797451973 > -11.660247325897217
END: th(86866.80670208555)=-11.660247325897217; dx=-3.0935281990653744E-6 evalInputDelta=0.3582673966884613
Fitness changed from -11.301979929208755 to -11.660247325897217
Iteration 1 complete. Error: -11.660247325897217 Total: 61.2459; Orientation: 0.0290; Line Search: 45.8261
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6661a55e to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-11.660247325897217;dx=-2.8739093726954194E-6
New Minimum: -11.660247325897217 > -12.223496064543724
END: th(187148.86177126726)=-12.223496064543724; dx=-2.118103923657103E-6 evalInputDelta=0.5632487386465073
Fitness changed from -11.660247325897217 to -12.223496064543724
Iteration 2 complete. Error: -12.223496064543724 Total: 15.2137; Orientation: 0.0294; Line Search: 9.8419
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2cb03e4b to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-12.223496064543724;dx=-2.1232588309259887E-6
New Minimum: -12.223496064543724 > -13.014801621437073
END: th(403200.00000000006)=-13.014801621437073; dx=-1.2872436385225215E-6 evalInputDelta=0.7913055568933487
Fitness changed from -12.223496064543724 to -13.014801621437073
Iteration 3 complete. Error: -13.014801621437073 Total: 15.7701; Orientation: 0.0321; Line Search: 9.9652
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1e4797ae to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.256e+03, gradient 1.328e-03, dot -0.793; [725055c7-d7ee-4363-8f77-44facf6f9c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -13.014801621437073, -12.223496064543724, -11.660247325897217, -11.301979929208755
LBFGS Accumulation History: 3 points
Removed measurement 1e4797ae to history. Total: 3
th(0)=-13.014801621437073;dx=-1.7618136586298755E-6
New Minimum: -13.014801621437073 > -13.946696668863297
END: th(868668.0670208557)=-13.946696668863297; dx=-6.385521940655175E-7 evalInputDelta=0.9318950474262238
Fitness changed from -13.014801621437073 to -13.946696668863297
Iteration 4 complete. Error: -13.946696668863297 Total: 15.8948; Orientation: 0.6114; Line Search: 10.1059
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 11fca5fb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.717e+03, gradient 1.153e-03, dot -0.648; [725055c7-d7ee-4363-8f77-44facf6f9c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -13.946696668863297, -12.223496064543724, -11.660247325897217, -11.301979929208755
LBFGS Accumulation History: 3 points
Removed measurement 11fca5fb to history. Total: 3
th(0)=-13.946696668863297;dx=-1.3278535503289172E-6
New Minimum: -13.946696668863297 > -14.98145616054535
END: th(1871488.617712673)=-14.98145616054535; dx=-1.1774138391365486E-7 evalInputDelta=1.0347594916820526
Fitness changed from -13.946696668863297 to -14.98145616054535
Iteration 5 complete. Error: -14.98145616054535 Total: 16.1944; Orientation: 0.6278; Line Search: 9.9858
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 17d7f1bd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.735e+03, gradient 1.209e-03, dot -0.385; [725055c7-d7ee-4363-8f77-44facf6f9c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -14.98145616054535, -12.223496064543724, -11.660247325897217, -11.301979929208755
LBFGS Accumulation History: 3 points
Removed measurement 17d7f1bd to history. Total: 3
th(0)=-14.98145616054535;dx=-1.460184217978292E-6
Armijo: th(4032000.0000000014)=-14.699999034404755; dx=2.6682144021755833E-7 evalInputDelta=-0.2814571261405945
New Minimum: -14.98145616054535 > -15.496028870344162
WOLF (strong): th(2016000.0000000007)=-15.496028870344162; dx=2.857974983436883E-7 evalInputDelta=0.5145727097988129
New Minimum: -15.496028870344162 > -15.668557614088058
END: th(672000.0000000002)=-15.668557614088058; dx=-3.2218262769015164E-7 evalInputDelta=0.6871014535427094
Fitness changed from -14.98145616054535 to -15.668557614088058
Iteration 6 complete. Error: -15.668557614088058 Total: 26.4994; Orientation: 0.6113; Line Search: 20.6587
Adding measurement 5d8e6312 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.013e+03, gradient 8.683e-04, dot -0.504; [725055c7-d7ee-4363-8f77-44facf6f9c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -15.668557614088058, -12.223496064543724, -11.660247325897217, -11.301979929208755
LBFGS Accumulation History: 3 points
Removed measurement 5d8e6312 to history. Total: 3
th(0)=-15.668557614088058;dx=-7.530839861401337E-7
New Minimum: -15.668557614088058 > -16.195466458797455
END: th(1447780.1117014263)=-16.195466458797455; dx=-7.153815869712813E-8 evalInputDelta=0.5269088447093964
Fitness changed from -15.668557614088058 to -16.195466458797455
Iteration 7 complete. Error: -16.195466458797455 Total: 15.8122; Orientation: 0.6105; Line Search: 10.1648
Adding measurement dccbb18 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.080e+03, gradient 8.820e-04, dot -0.459; [725055c7-d7ee-4363-8f77-44facf6f9c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -16.195466458797455, -12.223496064543724, -11.660247325897217, -11.301979929208755
LBFGS Accumulation History: 3 points
Removed measurement dccbb18 to history. Total: 3
th(0)=-16.195466458797455;dx=-7.771255979973751E-7
New Minimum: -16.195466458797455 > -16.19611695408821
WOLF (strong): th(3119147.6961877886)=-16.19611695408821; dx=2.396622005892518E-7 evalInputDelta=6.504952907562256E-4
New Minimum: -16.19611695408821 > -16.64838793873787
WOLF (strong): th(1559573.8480938943)=-16.64838793873787; dx=1.2473336996885389E-7 evalInputDelta=0.45292147994041443
END: th(519857.94936463144)=-16.557213723659515; dx=-3.7716805747500303E-7 evalInputDelta=0.36174726486206055
Fitness changed from -16.195466458797455 to -16.64838793873787
Iteration 8 complete. Error: -16.64838793873787 Total: 25.8649; Orientation: 0.6206; Line Search: 19.8886
Adding measurement 8823bfb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.178e+03, gradient 9.070e-04, dot -0.404; [725055c7-d7ee-4363-8f77-44facf6f9c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -16.64838793873787, -12.223496064543724, -11.660247325897217, -11.301979929208755
LBFGS Accumulation History: 3 points
Removed measurement 8823bfb to history. Total: 3
th(0)=-16.64838793873787;dx=-8.219230240519228E-7
New Minimum: -16.64838793873787 > -17.14996236562729
END: th(1120000.0000000005)=-17.14996236562729; dx=-1.860456986408381E-8 evalInputDelta=0.5015744268894196
Fitness changed from -16.64838793873787 to -17.14996236562729
Iteration 9 complete. Error: -17.14996236562729 Total: 15.7861; Orientation: 0.6129; Line Search: 10.3566
Adding measurement 5de9ff06 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.362e+03, gradient 6.145e-04, dot -0.555; [725055c7-d7ee-4363-8f77-44facf6f9c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -17.14996236562729, -12.223496064543724, -11.660247325897217, -11.301979929208755
LBFGS Accumulation History: 3 points
Removed measurement 5de9ff06 to history. Total: 3
th(0)=-17.14996236562729;dx=-3.771620277355844E-7
New Minimum: -17.14996236562729 > -17.48453253507614
WOLF (strong): th(2412966.852835711)=-17.48453253507614; dx=6.576312478165919E-8 evalInputDelta=0.33457016944885254
New Minimum: -17.48453253507614 > -17.48815566301346
END: th(1206483.4264178555)=-17.48815566301346; dx=-1.038780862420613E-7 evalInputDelta=0.33819329738616943
Fitness changed from -17.14996236562729 to -17.48815566301346
Iteration 10 complete. Error: -17.48815566301346 Total: 20.3243; Orientation: 0.6065; Line Search: 14.9064
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -17.48815566301346 (> -Infinity) after 228.874s (< 5400.000s)
Returns
-17.48815566301346