BasicOptimizer.scala:89 executed in 98.55 seconds (1.265 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 286450439573600
Reset training subject: 286452386077700
Adding measurement 26c70aae to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-54.287586431094894;dx=-4.9520968199011795E-6
New Minimum: -54.287586431094894 > -54.287593335802875
END: th(2.154434690031884)=-54.287593335802875; dx=-3.6519646121523134E-6 evalInputDelta=6.904707980481817E-6
Fitness changed from -54.287586431094894 to -54.287593335802875
Iteration 1 complete. Error: -54.287593335802875 Total: 9.4961; Orientation: 0.0583; Line Search: 3.8637
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6d045237 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-54.287593335802875;dx=-3.6519602209670864E-6
New Minimum: -54.287593335802875 > -54.28761059756901
WOLFE (weak): th(4.641588833612779)=-54.28761059756901; dx=-3.6519604977905343E-6 evalInputDelta=1.7261766132037337E-5
New Minimum: -54.28761059756901 > -54.28762613315382
WOLFE (weak): th(9.283177667225559)=-54.28762613315382; dx=-3.651962642600664E-6 evalInputDelta=3.279735094707803E-5
New Minimum: -54.28762613315382 > -54.28769518014368
WOLFE (weak): th(27.849533001676676)=-54.28769518014368; dx=-3.6519730155390916E-6 evalInputDelta=1.0184434080429128E-4
New Minimum: -54.28769518014368 > -54.2880007120197
WOLFE (weak): th(111.3981320067067)=-54.2880007120197; dx=-3.651960620285993E-6 evalInputDelta=4.0737621682751524E-4
New Minimum: -54.2880007120197 > -54.28962846020631
WOLFE (weak): th(556.9906600335335)=-54.28962846020631; dx=-3.651899201580966E-6 evalInputDelta=0.0020351244034344518
New Minimum: -54.28962846020631 > -54.29979776072814
WOLFE (weak): th(3341.9439602012008)=-54.29979776072814; dx=-3.6505489002203793E-6 evalInputDelta=0.0122044249252653
New Minimum: -54.29979776072814 > -54.372916802866406
WOLFE (weak): th(23393.607721408407)=-54.372916802866406; dx=-3.6429334853506256E-6 evalInputDelta=0.08532346706353167
New Minimum: -54.372916802866406 > -54.96326236713794
WOLFE (weak): th(187148.86177126726)=-54.96326236713794; dx=-3.5674510929768274E-6 evalInputDelta=0.6756690313350688
New Minimum: -54.96326236713794 > -59.71573240372885
END: th(1684339.7559414054)=-59.71573240372885; dx=-2.769172971299176E-6 evalInputDelta=5.428139067925976
Fitness changed from -54.287593335802875 to -59.71573240372885
Iteration 2 complete. Error: -59.71573240372885 Total: 21.3938; Orientation: 0.0612; Line Search: 19.1365
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7ff07c29 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-59.71573240372885;dx=-2.455253518755009E-6
New Minimum: -59.71573240372885 > -66.86163978601438
END: th(3628800.0000000005)=-66.86163978601438; dx=-1.4776184029399545E-6 evalInputDelta=7.145907382285529
Fitness changed from -59.71573240372885 to -66.86163978601438
Iteration 3 complete. Error: -66.86163978601438 Total: 5.9601; Orientation: 0.0577; Line Search: 3.7285
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5b7a9082 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.495e+03, gradient 1.214e-03, dot -0.746; [29dda4d9-b1c7-4a48-b769-25999305f199 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -66.86163978601438, -59.71573240372885, -54.287593335802875, -54.287586431094894
LBFGS Accumulation History: 3 points
Removed measurement 5b7a9082 to history. Total: 3
th(0)=-66.86163978601438;dx=-1.4740358617237165E-6
New Minimum: -66.86163978601438 > -74.83951796167163
END: th(7818012.603187701)=-74.83951796167163; dx=-6.331853687391902E-7 evalInputDelta=7.977878175657253
Fitness changed from -66.86163978601438 to -74.83951796167163
Iteration 4 complete. Error: -74.83951796167163 Total: 7.1309; Orientation: 1.0137; Line Search: 3.7234
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2e557434 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.705e+03, gradient 1.122e-03, dot -0.496; [29dda4d9-b1c7-4a48-b769-25999305f199 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.83951796167163, -59.71573240372885, -54.287593335802875, -54.287586431094894
LBFGS Accumulation History: 3 points
Removed measurement 2e557434 to history. Total: 3
th(0)=-74.83951796167163;dx=-1.2594169343116137E-6
New Minimum: -74.83951796167163 > -79.94168742790873
WOLF (strong): th(1.6843397559414055E7)=-79.94168742790873; dx=9.533111854293741E-8 evalInputDelta=5.1021694662371
END: th(8421698.779707028)=-79.90178885243783; dx=-1.6181944187131154E-7 evalInputDelta=5.0622708907662
Fitness changed from -74.83951796167163 to -79.94168742790873
Iteration 5 complete. Error: -79.94168742790873 Total: 8.9277; Orientation: 1.0201; Line Search: 5.7947
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6a0b2a65 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.078e+03, gradient 1.478e-03, dot -0.154; [29dda4d9-b1c7-4a48-b769-25999305f199 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -79.94168742790873, -59.71573240372885, -54.287593335802875, -54.287586431094894
LBFGS Accumulation History: 3 points
Removed measurement 6a0b2a65 to history. Total: 3
th(0)=-79.94168742790873;dx=-2.183516480291618E-6
New Minimum: -79.94168742790873 > -81.87791589566253
WOLF (strong): th(1.8144000000000004E7)=-81.87791589566253; dx=8.542660002836477E-7 evalInputDelta=1.9362284677537929
New Minimum: -81.87791589566253 > -88.31271720855206
WOLF (strong): th(9072000.000000002)=-88.31271720855206; dx=2.8300408396401515E-7 evalInputDelta=8.371029780643326
END: th(3024000.0000000005)=-85.41382381079953; dx=-1.385945657121673E-6 evalInputDelta=5.472136382890795
Fitness changed from -79.94168742790873 to -88.31271720855206
Iteration 6 complete. Error: -88.31271720855206 Total: 10.8513; Orientation: 1.0755; Line Search: 7.5871
Adding measurement a2c58ad to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.405e+04, gradient 1.213e-03, dot -0.290; [29dda4d9-b1c7-4a48-b769-25999305f199 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -88.31271720855206, -59.71573240372885, -54.287593335802875, -54.287586431094894
LBFGS Accumulation History: 3 points
Removed measurement a2c58ad to history. Total: 3
th(0)=-88.31271720855206;dx=-1.4715239399382075E-6
New Minimum: -88.31271720855206 > -93.48473169726282
END: th(6515010.502656418)=-93.48473169726282; dx=-9.424029645027498E-8 evalInputDelta=5.172014488710758
Fitness changed from -88.31271720855206 to -93.48473169726282
Iteration 7 complete. Error: -93.48473169726282 Total: 6.5370; Orientation: 0.9783; Line Search: 3.7138
Adding measurement 2cc0e76a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.157e+04, gradient 8.974e-04, dot -0.491; [29dda4d9-b1c7-4a48-b769-25999305f199 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -93.48473169726282, -59.71573240372885, -54.287593335802875, -54.287586431094894
LBFGS Accumulation History: 3 points
Removed measurement 2cc0e76a to history. Total: 3
th(0)=-93.48473169726282;dx=-8.053686865899188E-7
New Minimum: -93.48473169726282 > -96.70145863153955
WOLF (strong): th(1.4036164632845048E7)=-96.70145863153955; dx=1.364348785666097E-7 evalInputDelta=3.2167269342767355
New Minimum: -96.70145863153955 > -96.78676073919104
END: th(7018082.316422524)=-96.78676073919104; dx=-1.6548695809696485E-7 evalInputDelta=3.302029041928222
Fitness changed from -93.48473169726282 to -96.78676073919104
Iteration 8 complete. Error: -96.78676073919104 Total: 8.7873; Orientation: 0.9527; Line Search: 5.7346
Adding measurement 7a05dabc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.507e+04, gradient 8.650e-04, dot -0.502; [29dda4d9-b1c7-4a48-b769-25999305f199 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -96.78676073919104, -59.71573240372885, -54.287593335802875, -54.287586431094894
LBFGS Accumulation History: 3 points
Removed measurement 7a05dabc to history. Total: 3
th(0)=-96.78676073919104;dx=-7.482581434066643E-7
New Minimum: -96.78676073919104 > -99.25260529116305
WOLF (strong): th(1.5120000000000006E7)=-99.25260529116305; dx=1.4765349817521582E-7 evalInputDelta=2.465844551972012
New Minimum: -99.25260529116305 > -99.71487920902304
END: th(7560000.000000003)=-99.71487920902304; dx=-7.732900789608795E-8 evalInputDelta=2.9281184698320004
Fitness changed from -96.78676073919104 to -99.71487920902304
Iteration 9 complete. Error: -99.71487920902304 Total: 8.5672; Orientation: 0.9855; Line Search: 5.8114
Adding measurement 5b0dc7f6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.721e+04, gradient 8.891e-04, dot -0.471; [29dda4d9-b1c7-4a48-b769-25999305f199 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -99.71487920902304, -59.71573240372885, -54.287593335802875, -54.287586431094894
LBFGS Accumulation History: 3 points
Removed measurement 5b0dc7f6 to history. Total: 3
th(0)=-99.71487920902304;dx=-7.904330351489712E-7
New Minimum: -99.71487920902304 > -101.02431467258025
WOLF (strong): th(1.6287526256641047E7)=-101.02431467258025; dx=2.4861249227314874E-7 evalInputDelta=1.3094354635572074
New Minimum: -101.02431467258025 > -102.47453902693954
WOLF (strong): th(8143763.128320524)=-102.47453902693954; dx=4.1517927681312E-8 evalInputDelta=2.7596598179165
END: th(2714587.7094401745)=-101.45781969424766; dx=-4.832463021074454E-7 evalInputDelta=1.7429404852246222
Fitness changed from -99.71487920902304 to -102.47453902693954
Iteration 10 complete. Error: -102.47453902693954 Total: 10.5833; Orientation: 1.0071; Line Search: 7.7626
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -102.47453902693954 (> -Infinity) after 98.550s (< 5400.000s)
Returns
-102.47453902693954