BasicOptimizer.scala:89 executed in 95.78 seconds (1.175 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 281352473493300
Reset training subject: 281354341299400
Adding measurement 325d6cb6 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-56.93106257014178;dx=-4.863693102341126E-6
New Minimum: -56.93106257014178 > -56.93106915424397
END: th(2.154434690031884)=-56.93106915424397; dx=-3.728623244518602E-6 evalInputDelta=6.584102187900953E-6
Fitness changed from -56.93106257014178 to -56.93106915424397
Iteration 1 complete. Error: -56.93106915424397 Total: 9.1285; Orientation: 0.0605; Line Search: 3.6601
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1cfa6625 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-56.93106915424397;dx=-3.728624246173636E-6
New Minimum: -56.93106915424397 > -56.93108561449612
WOLFE (weak): th(4.641588833612779)=-56.93108561449612; dx=-3.7286249491440633E-6 evalInputDelta=1.6460252147965093E-5
New Minimum: -56.93108561449612 > -56.9311053667924
WOLFE (weak): th(9.283177667225559)=-56.9311053667924; dx=-3.728626419629568E-6 evalInputDelta=3.6212548430114566E-5
New Minimum: -56.9311053667924 > -56.93117449977546
WOLFE (weak): th(27.849533001676676)=-56.93117449977546; dx=-3.7286009851350393E-6 evalInputDelta=1.0534553148744408E-4
New Minimum: -56.93117449977546 > -56.93148395114688
WOLFE (weak): th(111.3981320067067)=-56.93148395114688; dx=-3.728510671416128E-6 evalInputDelta=4.147969029091314E-4
New Minimum: -56.93148395114688 > -56.93314310853774
WOLFE (weak): th(556.9906600335335)=-56.93314310853774; dx=-3.728298024008657E-6 evalInputDelta=0.0020739542937704414
New Minimum: -56.93314310853774 > -56.94352491229099
WOLFE (weak): th(3341.9439602012008)=-56.94352491229099; dx=-3.726965017156035E-6 evalInputDelta=0.01245575804701815
New Minimum: -56.94352491229099 > -57.01815958855264
WOLFE (weak): th(23393.607721408407)=-57.01815958855264; dx=-3.7178294707263076E-6 evalInputDelta=0.0870904343086707
New Minimum: -57.01815958855264 > -57.6206335311899
WOLFE (weak): th(187148.86177126726)=-57.6206335311899; dx=-3.63779475624344E-6 evalInputDelta=0.6895643769459312
New Minimum: -57.6206335311899 > -62.46691462459174
END: th(1684339.7559414054)=-62.46691462459174; dx=-2.8211904208746455E-6 evalInputDelta=5.535845470347766
Fitness changed from -56.93106915424397 to -62.46691462459174
Iteration 2 complete. Error: -62.46691462459174 Total: 20.3762; Orientation: 0.0608; Line Search: 18.1866
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 5ad77b04 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-62.46691462459174;dx=-2.483778487731704E-6
New Minimum: -62.46691462459174 > -69.6458449906129
END: th(3628800.0000000005)=-69.6458449906129; dx=-1.4796721819177365E-6 evalInputDelta=7.178930366021163
Fitness changed from -62.46691462459174 to -69.6458449906129
Iteration 3 complete. Error: -69.6458449906129 Total: 5.9556; Orientation: 0.0600; Line Search: 3.8454
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3b0178da to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.185e+03, gradient 1.205e-03, dot -0.747; [4f840588-4b06-460b-b25a-d19444a3dcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -69.6458449906129, -62.46691462459174, -56.93106915424397, -56.93106257014178
LBFGS Accumulation History: 3 points
Removed measurement 3b0178da to history. Total: 3
th(0)=-69.6458449906129;dx=-1.4520404496165188E-6
New Minimum: -69.6458449906129 > -77.61164301404357
END: th(7818012.603187701)=-77.61164301404357; dx=-6.507125903998199E-7 evalInputDelta=7.965798023430665
Fitness changed from -69.6458449906129 to -77.61164301404357
Iteration 4 complete. Error: -77.61164301404357 Total: 7.0046; Orientation: 1.0547; Line Search: 3.8601
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 25e42f4c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.789e+03, gradient 1.104e-03, dot -0.522; [4f840588-4b06-460b-b25a-d19444a3dcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -77.61164301404357, -62.46691462459174, -56.93106915424397, -56.93106257014178
LBFGS Accumulation History: 3 points
Removed measurement 25e42f4c to history. Total: 3
th(0)=-77.61164301404357;dx=-1.219680494161772E-6
New Minimum: -77.61164301404357 > -82.96155792572738
WOLF (strong): th(1.6843397559414055E7)=-82.96155792572738; dx=6.404828858382367E-8 evalInputDelta=5.349914911683811
END: th(8421698.779707028)=-82.68466560878096; dx=-1.8109361979009096E-7 evalInputDelta=5.073022594737395
Fitness changed from -77.61164301404357 to -82.96155792572738
Iteration 5 complete. Error: -82.96155792572738 Total: 8.7252; Orientation: 1.0574; Line Search: 5.5538
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4bb17e28 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.034e+03, gradient 1.455e-03, dot -0.163; [4f840588-4b06-460b-b25a-d19444a3dcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -82.96155792572738, -62.46691462459174, -56.93106915424397, -56.93106257014178
LBFGS Accumulation History: 3 points
Removed measurement 4bb17e28 to history. Total: 3
th(0)=-82.96155792572738;dx=-2.1168371310306993E-6
New Minimum: -82.96155792572738 > -84.94638778952411
WOLF (strong): th(1.8144000000000004E7)=-84.94638778952411; dx=8.093273646879796E-7 evalInputDelta=1.9848298637967332
New Minimum: -84.94638778952411 > -91.09954330754819
WOLF (strong): th(9072000.000000002)=-91.09954330754819; dx=2.8023362058485424E-7 evalInputDelta=8.137985381820812
END: th(3024000.0000000005)=-88.27472959412043; dx=-1.3531042131381137E-6 evalInputDelta=5.313171668393053
Fitness changed from -82.96155792572738 to -91.09954330754819
Iteration 6 complete. Error: -91.09954330754819 Total: 10.4669; Orientation: 1.0505; Line Search: 7.3240
Adding measurement 56ef755d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.356e+04, gradient 1.216e-03, dot -0.296; [4f840588-4b06-460b-b25a-d19444a3dcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -91.09954330754819, -62.46691462459174, -56.93106915424397, -56.93106257014178
LBFGS Accumulation History: 3 points
Removed measurement 56ef755d to history. Total: 3
th(0)=-91.09954330754819;dx=-1.4784981145421727E-6
New Minimum: -91.09954330754819 > -96.29279322172886
END: th(6515010.502656418)=-96.29279322172886; dx=-9.218981010047519E-8 evalInputDelta=5.193249914180669
Fitness changed from -91.09954330754819 to -96.29279322172886
Iteration 7 complete. Error: -96.29279322172886 Total: 6.6800; Orientation: 1.1302; Line Search: 3.7747
Adding measurement 7e97bc23 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.091e+04, gradient 9.045e-04, dot -0.496; [4f840588-4b06-460b-b25a-d19444a3dcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -96.29279322172886, -62.46691462459174, -56.93106915424397, -56.93106257014178
LBFGS Accumulation History: 3 points
Removed measurement 7e97bc23 to history. Total: 3
th(0)=-96.29279322172886;dx=-8.180990088320614E-7
New Minimum: -96.29279322172886 > -99.40200191845004
WOLF (strong): th(1.4036164632845048E7)=-99.40200191845004; dx=1.597104627578817E-7 evalInputDelta=3.1092086967211827
New Minimum: -99.40200191845004 > -99.6120556789506
END: th(7018082.316422524)=-99.6120556789506; dx=-1.556454740933399E-7 evalInputDelta=3.3192624572217397
Fitness changed from -96.29279322172886 to -99.6120556789506
Iteration 8 complete. Error: -99.6120556789506 Total: 8.5809; Orientation: 1.0593; Line Search: 5.7069
Adding measurement 30685a1d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.444e+04, gradient 8.723e-04, dot -0.504; [4f840588-4b06-460b-b25a-d19444a3dcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -99.6120556789506, -62.46691462459174, -56.93106915424397, -56.93106257014178
LBFGS Accumulation History: 3 points
Removed measurement 30685a1d to history. Total: 3
th(0)=-99.6120556789506;dx=-7.609690739287087E-7
New Minimum: -99.6120556789506 > -101.90189580599403
WOLF (strong): th(1.5120000000000006E7)=-101.90189580599403; dx=1.6983360096682433E-7 evalInputDelta=2.2898401270434334
New Minimum: -101.90189580599403 > -102.50979496187031
END: th(7560000.000000003)=-102.50979496187031; dx=-6.211793233997752E-8 evalInputDelta=2.8977392829197157
Fitness changed from -99.6120556789506 to -102.50979496187031
Iteration 9 complete. Error: -102.50979496187031 Total: 8.3714; Orientation: 1.0459; Line Search: 5.5999
Adding measurement 27ff9d35 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.617e+04, gradient 9.004e-04, dot -0.468; [4f840588-4b06-460b-b25a-d19444a3dcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -102.50979496187031, -62.46691462459174, -56.93106915424397, -56.93106257014178
LBFGS Accumulation History: 3 points
Removed measurement 27ff9d35 to history. Total: 3
th(0)=-102.50979496187031;dx=-8.106536336591909E-7
New Minimum: -102.50979496187031 > -103.59158926622155
WOLF (strong): th(1.6287526256641047E7)=-103.59158926622155; dx=2.735605122743973E-7 evalInputDelta=1.0817943043512344
New Minimum: -103.59158926622155 > -105.25416079446661
WOLF (strong): th(8143763.128320524)=-105.25416079446661; dx=6.694378265637284E-8 evalInputDelta=2.7443658325963014
END: th(2714587.7094401745)=-104.29340378719463; dx=-4.923883937808609E-7 evalInputDelta=1.7836088253243219
Fitness changed from -102.50979496187031 to -105.25416079446661
Iteration 10 complete. Error: -105.25416079446661 Total: 10.1819; Orientation: 1.0361; Line Search: 7.3682
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -105.25416079446661 (> -Infinity) after 95.776s (< 5400.000s)
Returns
-105.25416079446661