BasicOptimizer.scala:89 executed in 112.57 seconds (1.654 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 45892806474300
Reset training subject: 45895150437800
Adding measurement 4e3c2723 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-49.702458206242405;dx=-1.6724047692918512E-6
New Minimum: -49.702458206242405 > -49.70245996575159
END: th(2.154434690031884)=-49.70245996575159; dx=-1.2810084060005805E-6 evalInputDelta=1.7595091890143522E-6
Fitness changed from -49.702458206242405 to -49.70245996575159
Iteration 1 complete. Error: -49.70245996575159 Total: 11.7283; Orientation: 0.0618; Line Search: 4.9657
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1327a7c3 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-49.70245996575159;dx=-1.2668233454538104E-6
New Minimum: -49.70245996575159 > -49.70246876329663
WOLFE (weak): th(4.641588833612779)=-49.70246876329663; dx=-1.2630416864165401E-6 evalInputDelta=8.797545035577059E-6
New Minimum: -49.70246876329663 > -49.702474041822896
WOLFE (weak): th(9.283177667225559)=-49.702474041822896; dx=-1.2628058980879313E-6 evalInputDelta=1.4076071302326909E-5
New Minimum: -49.702474041822896 > -49.70249867493808
WOLFE (weak): th(27.849533001676676)=-49.70249867493808; dx=-1.2612027400792794E-6 evalInputDelta=3.8709186483743E-5
New Minimum: -49.70249867493808 > -49.70261304281294
WOLFE (weak): th(111.3981320067067)=-49.70261304281294; dx=-1.2599958781467219E-6 evalInputDelta=1.530770613484833E-4
New Minimum: -49.70261304281294 > -49.70322358686174
WOLFE (weak): th(556.9906600335335)=-49.70322358686174; dx=-1.2603490984213843E-6 evalInputDelta=7.63621110145607E-4
New Minimum: -49.70322358686174 > -49.70702920101584
WOLFE (weak): th(3341.9439602012008)=-49.70702920101584; dx=-1.2601970132991046E-6 evalInputDelta=0.004569235264249016
New Minimum: -49.70702920101584 > -49.73442348841073
WOLFE (weak): th(23393.607721408407)=-49.73442348841073; dx=-1.2579320525722073E-6 evalInputDelta=0.03196352265913305
New Minimum: -49.73442348841073 > -49.9567517719337
WOLFE (weak): th(187148.86177126726)=-49.9567517719337; dx=-1.2419227564931662E-6 evalInputDelta=0.2542918061821098
New Minimum: -49.9567517719337 > -51.85552182663169
END: th(1684339.7559414054)=-51.85552182663169; dx=-1.1007887335767314E-6 evalInputDelta=2.1530618608800935
Fitness changed from -49.70245996575159 to -51.85552182663169
Iteration 2 complete. Error: -51.85552182663169 Total: 26.5387; Orientation: 0.0624; Line Search: 23.7966
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2b0d025d to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-51.85552182663169;dx=-1.1045228790715256E-6
New Minimum: -51.85552182663169 > -55.496248313273554
END: th(3628800.0000000005)=-55.496248313273554; dx=-8.161949096053729E-7 evalInputDelta=3.640726486641867
Fitness changed from -51.85552182663169 to -55.496248313273554
Iteration 3 complete. Error: -55.496248313273554 Total: 7.2924; Orientation: 0.0632; Line Search: 4.6013
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4df1e443 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.507e+04, gradient 8.798e-04, dot -0.886; [a8d2f0c7-6de6-4b3b-8645-bd989ad96162 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -55.496248313273554, -51.85552182663169, -49.70245996575159, -49.702458206242405
LBFGS Accumulation History: 3 points
Removed measurement 4df1e443 to history. Total: 3
th(0)=-55.496248313273554;dx=-7.718401290204956E-7
New Minimum: -55.496248313273554 > -60.87245941281821
END: th(7818012.603187701)=-60.87245941281821; dx=-5.271345118209026E-7 evalInputDelta=5.376211099544655
Fitness changed from -55.496248313273554 to -60.87245941281821
Iteration 4 complete. Error: -60.87245941281821 Total: 8.4861; Orientation: 1.0583; Line Search: 4.5707
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2e1d7826 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.356e+04, gradient 7.419e-04, dot -0.765; [a8d2f0c7-6de6-4b3b-8645-bd989ad96162 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -60.87245941281821, -51.85552182663169, -49.70245996575159, -49.702458206242405
LBFGS Accumulation History: 3 points
Removed measurement 2e1d7826 to history. Total: 3
th(0)=-60.87245941281821;dx=-5.48831837860818E-7
New Minimum: -60.87245941281821 > -68.35544028083991
END: th(1.6843397559414055E7)=-68.35544028083991; dx=-3.1538651465218686E-7 evalInputDelta=7.482980868021706
Fitness changed from -60.87245941281821 to -68.35544028083991
Iteration 5 complete. Error: -68.35544028083991 Total: 8.3035; Orientation: 1.0936; Line Search: 4.6107
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 368e5ef0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.866e+04, gradient 6.787e-04, dot -0.621; [a8d2f0c7-6de6-4b3b-8645-bd989ad96162 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -68.35544028083991, -51.85552182663169, -49.70245996575159, -49.702458206242405
LBFGS Accumulation History: 3 points
Removed measurement 368e5ef0 to history. Total: 3
th(0)=-68.35544028083991;dx=-4.603649095402294E-7
New Minimum: -68.35544028083991 > -76.53924952812041
END: th(3.628800000000001E7)=-76.53924952812041; dx=-8.461189354127033E-8 evalInputDelta=8.183809247280493
Fitness changed from -68.35544028083991 to -76.53924952812041
Iteration 6 complete. Error: -76.53924952812041 Total: 8.3786; Orientation: 1.0407; Line Search: 4.7057
Adding measurement 469a38e6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.913e+04, gradient 8.531e-04, dot -0.285; [a8d2f0c7-6de6-4b3b-8645-bd989ad96162 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -76.53924952812041, -51.85552182663169, -49.70245996575159, -49.702458206242405
LBFGS Accumulation History: 3 points
Removed measurement 469a38e6 to history. Total: 3
th(0)=-76.53924952812041;dx=-7.262321903643251E-7
Armijo: th(7.818012603187701E7)=-69.77456109148622; dx=1.582959925168216E-7 evalInputDelta=-6.764688436634188
New Minimum: -76.53924952812041 > -78.60069871829307
WOLF (strong): th(3.9090063015938506E7)=-78.60069871829307; dx=2.018397180419278E-7 evalInputDelta=2.0614491901726666
New Minimum: -78.60069871829307 > -82.32246506667504
END: th(1.3030021005312836E7)=-82.32246506667504; dx=-1.310236242761251E-7 evalInputDelta=5.783215538554629
Fitness changed from -76.53924952812041 to -82.32246506667504
Iteration 7 complete. Error: -82.32246506667504 Total: 12.5575; Orientation: 0.9934; Line Search: 9.3602
Adding measurement 6bef157 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.280e+04, gradient 5.988e-04, dot -0.523; [a8d2f0c7-6de6-4b3b-8645-bd989ad96162 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -82.32246506667504, -51.85552182663169, -49.70245996575159, -49.702458206242405
LBFGS Accumulation History: 3 points
Removed measurement 6bef157 to history. Total: 3
th(0)=-82.32246506667504;dx=-3.583448781567167E-7
New Minimum: -82.32246506667504 > -86.89902698643691
END: th(2.8072329265690096E7)=-86.89902698643691; dx=-2.6345907913410363E-8 evalInputDelta=4.576561919761872
Fitness changed from -82.32246506667504 to -86.89902698643691
Iteration 8 complete. Error: -86.89902698643691 Total: 7.8095; Orientation: 1.1396; Line Search: 4.5346
Adding measurement 328de623 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.477e+04, gradient 7.540e-04, dot -0.350; [a8d2f0c7-6de6-4b3b-8645-bd989ad96162 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.89902698643691, -51.85552182663169, -49.70245996575159, -49.702458206242405
LBFGS Accumulation History: 3 points
Removed measurement 328de623 to history. Total: 3
th(0)=-86.89902698643691;dx=-5.677611511539206E-7
Armijo: th(6.048000000000002E7)=-82.20177472781045; dx=1.6986364779293031E-7 evalInputDelta=-4.697252258626463
New Minimum: -86.89902698643691 > -89.1237900370337
WOLF (strong): th(3.024000000000001E7)=-89.1237900370337; dx=1.8006272789332362E-7 evalInputDelta=2.224763050596792
New Minimum: -89.1237900370337 > -90.88159131350803
END: th(1.0080000000000004E7)=-90.88159131350803; dx=-1.7722931416213355E-7 evalInputDelta=3.982564327071117
Fitness changed from -86.89902698643691 to -90.88159131350803
Iteration 9 complete. Error: -90.88159131350803 Total: 13.1451; Orientation: 1.3081; Line Search: 9.6327
Adding measurement 4fc49e6f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.628e+04, gradient 4.886e-04, dot -0.609; [a8d2f0c7-6de6-4b3b-8645-bd989ad96162 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -90.88159131350803, -51.85552182663169, -49.70245996575159, -49.702458206242405
LBFGS Accumulation History: 3 points
Removed measurement 4fc49e6f to history. Total: 3
th(0)=-90.88159131350803;dx=-2.383528468421506E-7
New Minimum: -90.88159131350803 > -94.57506623548406
END: th(2.1716701675521396E7)=-94.57506623548406; dx=-1.1693518842136578E-7 evalInputDelta=3.6934749219760334
Fitness changed from -90.88159131350803 to -94.57506623548406
Iteration 10 complete. Error: -94.57506623548406 Total: 7.9273; Orientation: 1.0545; Line Search: 4.7382
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -94.57506623548406 (> -Infinity) after 112.573s (< 5400.000s)
Returns
-94.57506623548406