BasicOptimizer.scala:89 executed in 129.55 seconds (1.556 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 26966872062300
Reset training subject: 26969569967400
Adding measurement 1dccb281 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-60.95163472401563;dx=-4.719361116553188E-6
New Minimum: -60.95163472401563 > -60.95164595222846
END: th(2.154434690031884)=-60.95164595222846; dx=-3.2825358621112275E-6 evalInputDelta=1.1228212827063544E-5
Fitness changed from -60.95163472401563 to -60.95164595222846
Iteration 1 complete. Error: -60.95164595222846 Total: 12.9405; Orientation: 0.0639; Line Search: 5.2794
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 30f02965 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-60.95164595222846;dx=-3.2597063262905227E-6
New Minimum: -60.95164595222846 > -60.95165998749159
WOLFE (weak): th(4.641588833612779)=-60.95165998749159; dx=-3.2593363665354644E-6 evalInputDelta=1.403526312770964E-5
New Minimum: -60.95165998749159 > -60.95167963685453
WOLFE (weak): th(9.283177667225559)=-60.95167963685453; dx=-3.257575635788902E-6 evalInputDelta=3.368462606800904E-5
New Minimum: -60.95167963685453 > -60.95174700605082
WOLFE (weak): th(27.849533001676676)=-60.95174700605082; dx=-3.256475907770745E-6 evalInputDelta=1.0105382236247351E-4
New Minimum: -60.95174700605082 > -60.95206139464897
WOLFE (weak): th(111.3981320067067)=-60.95206139464897; dx=-3.2549490187159407E-6 evalInputDelta=4.1544242051116953E-4
New Minimum: -60.95206139464897 > -60.95372032905833
WOLFE (weak): th(556.9906600335335)=-60.95372032905833; dx=-3.2545127059821548E-6 evalInputDelta=0.0020743768298672194
New Minimum: -60.95372032905833 > -60.96408273501968
WOLFE (weak): th(3341.9439602012008)=-60.96408273501968; dx=-3.2527535575421523E-6 evalInputDelta=0.012436782791219514
New Minimum: -60.96408273501968 > -61.038622186706306
WOLFE (weak): th(23393.607721408407)=-61.038622186706306; dx=-3.246582236887211E-6 evalInputDelta=0.08697623447784508
New Minimum: -61.038622186706306 > -61.640752925026085
WOLFE (weak): th(187148.86177126726)=-61.640752925026085; dx=-3.181493329997033E-6 evalInputDelta=0.6891069727976245
New Minimum: -61.640752925026085 > -66.46829014556825
END: th(1684339.7559414054)=-66.46829014556825; dx=-2.414579485032842E-6 evalInputDelta=5.516644193339786
Fitness changed from -60.95164595222846 to -66.46829014556825
Iteration 2 complete. Error: -66.46829014556825 Total: 28.8711; Orientation: 0.0599; Line Search: 25.8362
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 208e6245 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-66.46829014556825;dx=-2.3176731908311725E-6
New Minimum: -66.46829014556825 > -73.59637291719504
END: th(3628800.0000000005)=-73.59637291719504; dx=-1.2112115200522967E-6 evalInputDelta=7.128082771626794
Fitness changed from -66.46829014556825 to -73.59637291719504
Iteration 3 complete. Error: -73.59637291719504 Total: 8.1424; Orientation: 0.0601; Line Search: 5.0276
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 37bc7415 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.341e+03, gradient 1.203e-03, dot -0.627; [594943a8-eadb-4249-8077-27820c79fa4e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -73.59637291719504, -66.46829014556825, -60.95164595222846, -60.95163472401563
LBFGS Accumulation History: 3 points
Removed measurement 37bc7415 to history. Total: 3
th(0)=-73.59637291719504;dx=-1.4439828127421554E-6
New Minimum: -73.59637291719504 > -81.68809867227058
END: th(7818012.603187701)=-81.68809867227058; dx=-4.966261520374011E-7 evalInputDelta=8.091725755075544
Fitness changed from -73.59637291719504 to -81.68809867227058
Iteration 4 complete. Error: -81.68809867227058 Total: 8.9400; Orientation: 1.0609; Line Search: 4.9615
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 297157a6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.227e+04, gradient 1.304e-03, dot -0.452; [594943a8-eadb-4249-8077-27820c79fa4e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -81.68809867227058, -66.46829014556825, -60.95164595222846, -60.95163472401563
LBFGS Accumulation History: 3 points
Removed measurement 297157a6 to history. Total: 3
th(0)=-81.68809867227058;dx=-1.6993037377128755E-6
Armijo: th(1.6843397559414055E7)=-80.32056916612257; dx=5.00903211707606E-7 evalInputDelta=-1.367529506148017
New Minimum: -81.68809867227058 > -85.12648158675084
WOLF (strong): th(8421698.779707028)=-85.12648158675084; dx=3.6218993867154347E-7 evalInputDelta=3.4383829144802576
New Minimum: -85.12648158675084 > -85.38864934894184
END: th(2807232.926569009)=-85.38864934894184; dx=-6.050284717581934E-7 evalInputDelta=3.7005506766712557
Fitness changed from -81.68809867227058 to -85.38864934894184
Iteration 5 complete. Error: -85.38864934894184 Total: 14.2413; Orientation: 1.0875; Line Search: 10.0503
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6676fabe to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.528e+04, gradient 9.816e-04, dot -0.645; [594943a8-eadb-4249-8077-27820c79fa4e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -85.38864934894184, -66.46829014556825, -60.95164595222846, -60.95163472401563
LBFGS Accumulation History: 3 points
Removed measurement 6676fabe to history. Total: 3
th(0)=-85.38864934894184;dx=-9.624318803633294E-7
New Minimum: -85.38864934894184 > -89.74634005361843
END: th(6048000.000000001)=-89.74634005361843; dx=-3.972343380531575E-7 evalInputDelta=4.357690704676585
Fitness changed from -85.38864934894184 to -89.74634005361843
Iteration 6 complete. Error: -89.74634005361843 Total: 9.0887; Orientation: 1.0055; Line Search: 5.1913
Adding measurement a29b7ba to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.042e+04, gradient 1.151e-03, dot -0.516; [594943a8-eadb-4249-8077-27820c79fa4e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -89.74634005361843, -66.46829014556825, -60.95164595222846, -60.95163472401563
LBFGS Accumulation History: 3 points
Removed measurement a29b7ba to history. Total: 3
th(0)=-89.74634005361843;dx=-1.3217712890656547E-6
New Minimum: -89.74634005361843 > -90.02645594430003
WOLF (strong): th(1.3030021005312836E7)=-90.02645594430003; dx=3.646949338543557E-7 evalInputDelta=0.2801158906815999
New Minimum: -90.02645594430003 > -92.52408886963465
WOLF (strong): th(6515010.502656418)=-92.52408886963465; dx=1.9709419246027494E-7 evalInputDelta=2.777748816016228
END: th(2171670.167552139)=-92.12600085969241; dx=-5.939271559046873E-7 evalInputDelta=2.3796608060739857
Fitness changed from -89.74634005361843 to -92.52408886963465
Iteration 7 complete. Error: -92.52408886963465 Total: 13.6118; Orientation: 1.0300; Line Search: 10.1889
Adding measurement 19bbc7c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.572e+04, gradient 1.385e-03, dot -0.325; [594943a8-eadb-4249-8077-27820c79fa4e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -92.52408886963465, -66.46829014556825, -60.95164595222846, -60.95163472401563
LBFGS Accumulation History: 3 points
Removed measurement 19bbc7c to history. Total: 3
th(0)=-92.52408886963465;dx=-1.917592805201202E-6
New Minimum: -92.52408886963465 > -97.1263320847932
WOLF (strong): th(4678721.544281682)=-97.1263320847932; dx=2.7204295684928894E-7 evalInputDelta=4.602243215158552
END: th(2339360.772140841)=-96.40848684988069; dx=-9.233625120040872E-7 evalInputDelta=3.8843979802460353
Fitness changed from -92.52408886963465 to -97.1263320847932
Iteration 8 complete. Error: -97.1263320847932 Total: 11.1422; Orientation: 1.1054; Line Search: 7.5630
Adding measurement f457cc1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.603e+04, gradient 1.133e-03, dot -0.462; [594943a8-eadb-4249-8077-27820c79fa4e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.1263320847932, -66.46829014556825, -60.95164595222846, -60.95163472401563
LBFGS Accumulation History: 3 points
Removed measurement f457cc1 to history. Total: 3
th(0)=-97.1263320847932;dx=-1.2819864266171578E-6
New Minimum: -97.1263320847932 > -99.99863701420945
WOLF (strong): th(5040000.000000001)=-99.99863701420945; dx=1.8193934912953005E-7 evalInputDelta=2.872304929416245
END: th(2520000.0000000005)=-99.6889581563204; dx=-4.918773091790382E-7 evalInputDelta=2.562626071527191
Fitness changed from -97.1263320847932 to -99.99863701420945
Iteration 9 complete. Error: -99.99863701420945 Total: 11.0520; Orientation: 1.0187; Line Search: 7.5685
Adding measurement 3ac2c5f8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.602e+04, gradient 1.157e-03, dot -0.427; [594943a8-eadb-4249-8077-27820c79fa4e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -99.99863701420945, -66.46829014556825, -60.95164595222846, -60.95163472401563
LBFGS Accumulation History: 3 points
Removed measurement 3ac2c5f8 to history. Total: 3
th(0)=-99.99863701420945;dx=-1.3367893294850972E-6
New Minimum: -99.99863701420945 > -102.57592746327857
WOLF (strong): th(5429175.418880348)=-102.57592746327857; dx=3.601054482061347E-7 evalInputDelta=2.5772904490691246
New Minimum: -102.57592746327857 > -102.73222478920603
END: th(2714587.709440174)=-102.73222478920603; dx=-3.9962904469040714E-7 evalInputDelta=2.733587774996579
Fitness changed from -99.99863701420945 to -102.73222478920603
Iteration 10 complete. Error: -102.73222478920603 Total: 11.0266; Orientation: 1.0449; Line Search: 7.5839
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -102.73222478920603 (> -Infinity) after 129.545s (< 5400.000s)
Returns
-102.73222478920603