BasicOptimizer.scala:89 executed in 133.29 seconds (1.140 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 327799955261400
Reset training subject: 327802682292700
Adding measurement 3b274af0 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-127.85799790510876;dx=-2.9447577477771078E-5
New Minimum: -127.85799790510876 > -127.85805070934981
END: th(2.154434690031884)=-127.85805070934981; dx=-2.1750035861736385E-5 evalInputDelta=5.280424105080783E-5
Fitness changed from -127.85799790510876 to -127.85805070934981
Iteration 1 complete. Error: -127.85805070934981 Total: 13.0185; Orientation: 0.0654; Line Search: 5.1306
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7b5ba7b0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-127.85805070934981;dx=-2.1637751352403386E-5
New Minimum: -127.85805070934981 > -127.85816386122148
WOLFE (weak): th(4.641588833612779)=-127.85816386122148; dx=-2.163088165908935E-5 evalInputDelta=1.1315187167326712E-4
New Minimum: -127.85816386122148 > -127.8582845564409
WOLFE (weak): th(9.283177667225559)=-127.8582845564409; dx=-2.1628981178626388E-5 evalInputDelta=2.3384709109564028E-4
New Minimum: -127.8582845564409 > -127.85872961907782
WOLFE (weak): th(27.849533001676676)=-127.85872961907782; dx=-2.160760510113234E-5 evalInputDelta=6.789097280091028E-4
New Minimum: -127.85872961907782 > -127.86075878333129
WOLFE (weak): th(111.3981320067067)=-127.86075878333129; dx=-2.1608320901206887E-5 evalInputDelta=0.002708073981480652
New Minimum: -127.86075878333129 > -127.87156033508492
WOLFE (weak): th(556.9906600335335)=-127.87156033508492; dx=-2.1591389432785638E-5 evalInputDelta=0.01350962573511083
New Minimum: -127.87156033508492 > -127.93904937226738
WOLFE (weak): th(3341.9439602012008)=-127.93904937226738; dx=-2.1584620422881495E-5 evalInputDelta=0.08099866291756541
New Minimum: -127.93904937226738 > -128.42278190893117
WOLFE (weak): th(23393.607721408407)=-128.42278190893117; dx=-2.1393639020738034E-5 evalInputDelta=0.5647311995813595
New Minimum: -128.42278190893117 > -132.21428136509323
WOLFE (weak): th(187148.86177126726)=-132.21428136509323; dx=-1.9805843070382746E-5 evalInputDelta=4.356230655743417
New Minimum: -132.21428136509323 > -152.3726103990675
END: th(1684339.7559414054)=-152.3726103990675; dx=-5.642682298139027E-6 evalInputDelta=24.514559689717686
Fitness changed from -127.85805070934981 to -152.3726103990675
Iteration 2 complete. Error: -152.3726103990675 Total: 28.6618; Orientation: 0.0684; Line Search: 25.5861
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 712be8d8 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-152.3726103990675;dx=-9.705853064398986E-6
New Minimum: -152.3726103990675 > -169.8290408678173
END: th(3628800.0000000005)=-169.8290408678173; dx=-9.293615836333883E-7 evalInputDelta=17.4564304687498
Fitness changed from -152.3726103990675 to -169.8290408678173
Iteration 3 complete. Error: -169.8290408678173 Total: 7.9089; Orientation: 0.0632; Line Search: 4.9345
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 33db3671 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.529e+03, gradient 3.061e-03, dot -0.316; [b3363a6d-cb6b-4a81-81a7-aae3e2d3819b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -169.8290408678173, -152.3726103990675, -127.85805070934981, -127.85799790510876
LBFGS Accumulation History: 3 points
Removed measurement 33db3671 to history. Total: 3
th(0)=-169.8290408678173;dx=-9.359806611278197E-6
Armijo: th(7818012.603187701)=-166.44140498761718; dx=3.3962002429417037E-6 evalInputDelta=-3.387635880200122
New Minimum: -169.8290408678173 > -179.981019950164
WOLF (strong): th(3909006.3015938504)=-179.981019950164; dx=1.7315443285822396E-6 evalInputDelta=10.151979082346713
END: th(1303002.1005312835)=-179.0541773236435; dx=-3.7183267422301595E-6 evalInputDelta=9.225136455826203
Fitness changed from -169.8290408678173 to -179.981019950164
Iteration 4 complete. Error: -179.981019950164 Total: 14.2753; Orientation: 1.0957; Line Search: 10.1860
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 61767737 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.728e+03, gradient 3.203e-03, dot -0.217; [b3363a6d-cb6b-4a81-81a7-aae3e2d3819b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -179.981019950164, -152.3726103990675, -127.85805070934981, -127.85799790510876
LBFGS Accumulation History: 3 points
Removed measurement 61767737 to history. Total: 3
th(0)=-179.981019950164;dx=-1.0258400717785435E-5
New Minimum: -179.981019950164 > -193.56409917035162
WOLF (strong): th(2807232.926569009)=-193.56409917035162; dx=7.75960085206993E-7 evalInputDelta=13.583079220187614
END: th(1403616.4632845046)=-191.324708006251; dx=-4.222922423953465E-6 evalInputDelta=11.34368805608699
Fitness changed from -179.981019950164 to -193.56409917035162
Iteration 5 complete. Error: -193.56409917035162 Total: 11.9493; Orientation: 1.0623; Line Search: 7.9130
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 27181d4d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.159e+04, gradient 2.497e-03, dot -0.352; [b3363a6d-cb6b-4a81-81a7-aae3e2d3819b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -193.56409917035162, -152.3726103990675, -127.85805070934981, -127.85799790510876
LBFGS Accumulation History: 3 points
Removed measurement 27181d4d to history. Total: 3
th(0)=-193.56409917035162;dx=-6.2165432765828344E-6
New Minimum: -193.56409917035162 > -201.8734191108299
WOLF (strong): th(3024000.0000000005)=-201.8734191108299; dx=5.353474836026672E-7 evalInputDelta=8.309319940478275
END: th(1512000.0000000002)=-200.68076270561573; dx=-2.440091847851288E-6 evalInputDelta=7.116663535264109
Fitness changed from -193.56409917035162 to -201.8734191108299
Iteration 6 complete. Error: -201.8734191108299 Total: 11.5642; Orientation: 1.0864; Line Search: 7.5996
Adding measurement 3bac6f13 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.676e+04, gradient 2.406e-03, dot -0.397; [b3363a6d-cb6b-4a81-81a7-aae3e2d3819b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -201.8734191108299, -152.3726103990675, -127.85805070934981, -127.85799790510876
LBFGS Accumulation History: 3 points
Removed measurement 3bac6f13 to history. Total: 3
th(0)=-201.8734191108299;dx=-5.785497192693976E-6
New Minimum: -201.8734191108299 > -208.12073635905205
WOLF (strong): th(3257505.251328209)=-208.12073635905205; dx=1.470741901001382E-6 evalInputDelta=6.247317248222146
New Minimum: -208.12073635905205 > -208.4896142353621
END: th(1628752.6256641045)=-208.4896142353621; dx=-1.6453578789601434E-6 evalInputDelta=6.616195124532197
Fitness changed from -201.8734191108299 to -208.4896142353621
Iteration 7 complete. Error: -208.4896142353621 Total: 11.1240; Orientation: 1.0841; Line Search: 7.5933
Adding measurement 5ec3184c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.196e+04, gradient 1.643e-03, dot -0.644; [b3363a6d-cb6b-4a81-81a7-aae3e2d3819b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -208.4896142353621, -152.3726103990675, -127.85805070934981, -127.85799790510876
LBFGS Accumulation History: 3 points
Removed measurement 5ec3184c to history. Total: 3
th(0)=-208.4896142353621;dx=-2.692348076886414E-6
New Minimum: -208.4896142353621 > -215.21981315065895
END: th(3509041.158211262)=-215.21981315065895; dx=-1.1289603825310378E-6 evalInputDelta=6.730198915296853
Fitness changed from -208.4896142353621 to -215.21981315065895
Iteration 8 complete. Error: -215.21981315065895 Total: 8.7835; Orientation: 1.1174; Line Search: 5.2163
Adding measurement 4af183b5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.278e+04, gradient 1.857e-03, dot -0.512; [b3363a6d-cb6b-4a81-81a7-aae3e2d3819b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -215.21981315065895, -152.3726103990675, -127.85805070934981, -127.85799790510876
LBFGS Accumulation History: 3 points
Removed measurement 4af183b5 to history. Total: 3
th(0)=-215.21981315065895;dx=-3.440180632765067E-6
Armijo: th(7560000.000000003)=-214.71284146974546; dx=1.414663709387879E-6 evalInputDelta=-0.5069716809134945
New Minimum: -215.21981315065895 > -219.54319155647102
WOLF (strong): th(3780000.0000000014)=-219.54319155647102; dx=3.589378608953671E-7 evalInputDelta=4.323378405812065
END: th(1260000.0000000005)=-218.61705408392928; dx=-1.6390181311289401E-6 evalInputDelta=3.397240933270325
Fitness changed from -215.21981315065895 to -219.54319155647102
Iteration 9 complete. Error: -219.54319155647102 Total: 14.0826; Orientation: 1.1326; Line Search: 10.4817
Adding measurement 10e92aef to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.094e+04, gradient 2.288e-03, dot -0.350; [b3363a6d-cb6b-4a81-81a7-aae3e2d3819b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -219.54319155647102, -152.3726103990675, -127.85805070934981, -127.85799790510876
LBFGS Accumulation History: 3 points
Removed measurement 10e92aef to history. Total: 3
th(0)=-219.54319155647102;dx=-5.235564611568487E-6
New Minimum: -219.54319155647102 > -225.37690744235812
WOLF (strong): th(2714587.7094401745)=-225.37690744235812; dx=9.479691764735815E-7 evalInputDelta=5.833715885887102
END: th(1357293.8547200873)=-224.94899135003047; dx=-1.9839774193796032E-6 evalInputDelta=5.405799793559453
Fitness changed from -219.54319155647102 to -225.37690744235812
Iteration 10 complete. Error: -225.37690744235812 Total: 11.4376; Orientation: 1.0627; Line Search: 7.8321
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -225.37690744235812 (> -Infinity) after 133.288s (< 5400.000s)
Returns
-225.37690744235812