BasicOptimizer.scala:89 executed in 215.43 seconds (4.182 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 691767511434500
Reset training subject: 691772241088100
Adding measurement 2e1492aa to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-894.0366323590997;dx=-0.0065475466249528096
New Minimum: -894.0366323590997 > -894.0510332190215
WOLFE (weak): th(2.154434690031884)=-894.0510332190215; dx=-0.006131391339556746 evalInputDelta=0.014400859921806841
New Minimum: -894.0510332190215 > -894.0654687996847
WOLFE (weak): th(4.308869380063768)=-894.0654687996847; dx=-0.006135057917727688 evalInputDelta=0.028836440584996126
New Minimum: -894.0654687996847 > -894.1231039403914
WOLFE (weak): th(12.926608140191302)=-894.1231039403914; dx=-0.006133345776764788 evalInputDelta=0.08647158129167565
New Minimum: -894.1231039403914 > -894.3826082835019
WOLFE (weak): th(51.70643256076521)=-894.3826082835019; dx=-0.0061329669137174195 evalInputDelta=0.3459759244021825
New Minimum: -894.3826082835019 > -895.7655943381617
WOLFE (weak): th(258.53216280382605)=-895.7655943381617; dx=-0.0061189856680611224 evalInputDelta=1.7289619790619781
New Minimum: -895.7655943381617 > -904.3579905103952
WOLFE (weak): th(1551.1929768229563)=-904.3579905103952; dx=-0.00605731187456485 evalInputDelta=10.321358151295499
New Minimum: -904.3579905103952 > -963.6022260248261
END: th(10858.350837760694)=-963.6022260248261; dx=-0.005576450063408691 evalInputDelta=69.5655936657264
Fitness changed from -894.0366323590997 to -963.6022260248261
Iteration 1 complete. Error: -963.6022260248261 Total: 49.8015; Orientation: 0.0987; Line Search: 36.3318
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 39b64ce5 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-963.6022260248261;dx=-0.0053190414389202014
New Minimum: -963.6022260248261 > -1087.440802986535
END: th(23393.607721408407)=-1087.440802986535; dx=-0.004339842209935838 evalInputDelta=123.83857696170878
Fitness changed from -963.6022260248261 to -1087.440802986535
Iteration 2 complete. Error: -1087.440802986535 Total: 14.5462; Orientation: 0.0839; Line Search: 9.0016
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 675d8e78 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1087.440802986535;dx=-0.00406859895930483
New Minimum: -1087.440802986535 > -1278.4538024504445
END: th(50400.00000000001)=-1278.4538024504445; dx=-0.0028675932027337155 evalInputDelta=191.01299946390964
Fitness changed from -1087.440802986535 to -1278.4538024504445
Iteration 3 complete. Error: -1278.4538024504445 Total: 14.7790; Orientation: 0.0969; Line Search: 9.1782
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 505f8b8c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.554e+04, gradient 5.390e-02, dot -0.847; [3c076a7d-8a02-45af-9ffa-74c503c3f71d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1278.4538024504445, -1087.440802986535, -963.6022260248261, -894.0366323590997
LBFGS Accumulation History: 3 points
Removed measurement 505f8b8c to history. Total: 3
th(0)=-1278.4538024504445;dx=-0.0028989951274768907
New Minimum: -1278.4538024504445 > -1544.5797162982558
END: th(108583.50837760697)=-1544.5797162982558; dx=-0.0016798068087972534 evalInputDelta=266.12591384781126
Fitness changed from -1278.4538024504445 to -1544.5797162982558
Iteration 4 complete. Error: -1544.5797162982558 Total: 16.4970; Orientation: 1.7524; Line Search: 9.2399
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 452b5b0c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.673e+04, gradient 5.003e-02, dot -0.646; [3c076a7d-8a02-45af-9ffa-74c503c3f71d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1544.5797162982558, -1087.440802986535, -963.6022260248261, -894.0366323590997
LBFGS Accumulation History: 3 points
Removed measurement 452b5b0c to history. Total: 3
th(0)=-1544.5797162982558;dx=-0.0025011811166111486
New Minimum: -1544.5797162982558 > -1862.3414026434573
END: th(233936.07721408413)=-1862.3414026434573; dx=-6.533932254463472E-4 evalInputDelta=317.7616863452015
Fitness changed from -1544.5797162982558 to -1862.3414026434573
Iteration 5 complete. Error: -1862.3414026434573 Total: 17.2601; Orientation: 1.8574; Line Search: 9.4544
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 17daed39 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.746e+04, gradient 5.646e-02, dot -0.383; [3c076a7d-8a02-45af-9ffa-74c503c3f71d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1862.3414026434573, -1087.440802986535, -963.6022260248261, -894.0366323590997
LBFGS Accumulation History: 3 points
Removed measurement 17daed39 to history. Total: 3
th(0)=-1862.3414026434573;dx=-0.003186049579052489
New Minimum: -1862.3414026434573 > -1994.260389217015
WOLF (strong): th(504000.0000000002)=-1994.260389217015; dx=3.0630060059458537E-4 evalInputDelta=131.91898657355773
New Minimum: -1994.260389217015 > -2078.5309716239494
WOLF (strong): th(252000.0000000001)=-2078.5309716239494; dx=1.3131199448918138E-4 evalInputDelta=216.18956898049214
END: th(84000.00000000003)=-2042.274589765049; dx=-9.81210359946755E-4 evalInputDelta=179.9331871215918
Fitness changed from -1862.3414026434573 to -2078.5309716239494
Iteration 6 complete. Error: -2078.5309716239494 Total: 26.0038; Orientation: 1.7144; Line Search: 18.7549
Adding measurement 226d77f9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.185e+04, gradient 6.091e-02, dot -0.303; [3c076a7d-8a02-45af-9ffa-74c503c3f71d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2078.5309716239494, -1087.440802986535, -963.6022260248261, -894.0366323590997
LBFGS Accumulation History: 3 points
Removed measurement 226d77f9 to history. Total: 3
th(0)=-2078.5309716239494;dx=-0.0037073314886693666
New Minimum: -2078.5309716239494 > -2353.2367071758845
WOLF (strong): th(180972.5139626783)=-2353.2367071758845; dx=1.7589241824370841E-4 evalInputDelta=274.70573555193505
END: th(90486.25698133915)=-2317.682463151499; dx=-0.00118714931336649 evalInputDelta=239.15149152754975
Fitness changed from -2078.5309716239494 to -2353.2367071758845
Iteration 7 complete. Error: -2353.2367071758845 Total: 19.7043; Orientation: 1.6266; Line Search: 13.6735
Adding measurement 1005f60e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.706e+04, gradient 5.608e-02, dot -0.319; [3c076a7d-8a02-45af-9ffa-74c503c3f71d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2353.2367071758845, -1087.440802986535, -963.6022260248261, -894.0366323590997
LBFGS Accumulation History: 3 points
Removed measurement 1005f60e to history. Total: 3
th(0)=-2353.2367071758845;dx=-0.003143243643447295
New Minimum: -2353.2367071758845 > -2556.2777626854245
WOLF (strong): th(194946.7310117368)=-2556.2777626854245; dx=4.970611154692501E-4 evalInputDelta=203.04105550954
END: th(97473.3655058684)=-2554.44397080852; dx=-7.912955518618672E-4 evalInputDelta=201.20726363263566
Fitness changed from -2353.2367071758845 to -2556.2777626854245
Iteration 8 complete. Error: -2556.2777626854245 Total: 20.6601; Orientation: 1.6353; Line Search: 14.3582
Adding measurement 5f15070a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.401e+04, gradient 5.824e-02, dot -0.305; [3c076a7d-8a02-45af-9ffa-74c503c3f71d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2556.2777626854245, -1087.440802986535, -963.6022260248261, -894.0366323590997
LBFGS Accumulation History: 3 points
Removed measurement 5f15070a to history. Total: 3
th(0)=-2556.2777626854245;dx=-0.00338860321527148
New Minimum: -2556.2777626854245 > -2715.134803283255
WOLF (strong): th(210000.0000000001)=-2715.134803283255; dx=9.472301590765818E-4 evalInputDelta=158.85704059783075
New Minimum: -2715.134803283255 > -2762.2841997158803
END: th(105000.00000000004)=-2762.2841997158803; dx=-4.840271206742534E-4 evalInputDelta=206.0064370304558
Fitness changed from -2556.2777626854245 to -2762.2841997158803
Iteration 9 complete. Error: -2762.2841997158803 Total: 20.0211; Orientation: 1.6227; Line Search: 13.7337
Adding measurement 3a2d49e6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.646e+04, gradient 4.186e-02, dot -0.451; [3c076a7d-8a02-45af-9ffa-74c503c3f71d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2762.2841997158803, -1087.440802986535, -963.6022260248261, -894.0366323590997
LBFGS Accumulation History: 3 points
Removed measurement 3a2d49e6 to history. Total: 3
th(0)=-2762.2841997158803;dx=-0.0017496950742186886
New Minimum: -2762.2841997158803 > -2912.0757201693777
END: th(226215.6424533479)=-2912.0757201693777; dx=-5.270603968501129E-6 evalInputDelta=149.79152045349747
Fitness changed from -2762.2841997158803 to -2912.0757201693777
Iteration 10 complete. Error: -2912.0757201693777 Total: 15.1513; Orientation: 1.6205; Line Search: 9.2021
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2912.0757201693777 (> -Infinity) after 215.433s (< 5400.000s)
Returns
-2912.0757201693777