BasicOptimizer.scala:89 executed in 110.89 seconds (1.356 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 42156703938400
Reset training subject: 42159119187600
Corrupt weights measurement
LBFGS Accumulation History: 0 points
Constructing line search parameters: GD+Trust
New Minimum: -48.968941253536414 > -49.299936408632384
th(0)=-49.299936408632384;dx=-1.856855491410636E-6
New Minimum: -49.299936408632384 > -49.29994173025764
WOLFE (weak): th(2.154434690031884)=-49.29994173025764; dx=-1.7295197715268043E-6 evalInputDelta=5.321625259568918E-6
WOLFE (weak): th(4.308869380063768)=-49.29994173025764; dx=-1.7290112864082588E-6 evalInputDelta=5.321625259568918E-6
New Minimum: -49.29994173025764 > -49.29995946900436
WOLFE (weak): th(12.926608140191302)=-49.29995946900436; dx=-1.7286768670893064E-6 evalInputDelta=2.3060371972860594E-5
New Minimum: -49.29995946900436 > -49.3000357455425
WOLFE (weak): th(51.70643256076521)=-49.3000357455425; dx=-1.7292729773275587E-6 evalInputDelta=9.933691011809742E-5
New Minimum: -49.3000357455425 > -49.300422448036386
WOLFE (weak): th(258.53216280382605)=-49.300422448036386; dx=-1.729131620806106E-6 evalInputDelta=4.8603940400226975E-4
New Minimum: -49.300422448036386 > -49.302849025643354
WOLFE (weak): th(1551.1929768229563)=-49.302849025643354; dx=-1.729531843193012E-6 evalInputDelta=0.002912617010970564
New Minimum: -49.302849025643354 > -49.320322888747974
WOLFE (weak): th(10858.350837760694)=-49.320322888747974; dx=-1.7290323126166904E-6 evalInputDelta=0.02038648011559019
New Minimum: -49.320322888747974 > -49.46270104366904
WOLFE (weak): th(86866.80670208555)=-49.46270104366904; dx=-1.7182428076097522E-6 evalInputDelta=0.16276463503665894
New Minimum: -49.46270104366904 > -50.715061998263096
END: th(781801.26031877)=-50.715061998263096; dx=-1.6046676196132159E-6 evalInputDelta=1.415125589630712
Fitness changed from -48.968941253536414 to -50.715061998263096
Iteration 1 complete. Error: -50.715061998263096 Total: 29.6517; Orientation: 0.0391; Line Search: 22.6045
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1ee86e06 to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-50.715061998263096;dx=-1.5562812668450296E-6
New Minimum: -50.715061998263096 > -53.37871151092142
END: th(1684339.7559414052)=-53.37871151092142; dx=-1.3640621398669642E-6 evalInputDelta=2.663649512658324
Fitness changed from -50.715061998263096 to -53.37871151092142
Iteration 2 complete. Error: -53.37871151092142 Total: 7.5377; Orientation: 0.0640; Line Search: 4.6849
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 67cafef7 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-53.37871151092142;dx=-1.2898453586493417E-6
New Minimum: -53.37871151092142 > -57.89526070350218
END: th(3628800.0)=-57.89526070350218; dx=-1.018075736983667E-6 evalInputDelta=4.5165491925807615
Fitness changed from -53.37871151092142 to -57.89526070350218
Iteration 3 complete. Error: -57.89526070350218 Total: 8.2566; Orientation: 0.0754; Line Search: 5.2839
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 514fb918 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-57.89526070350218;dx=-9.393960248565991E-7
New Minimum: -57.89526070350218 > -64.4720426069046
END: th(7818012.6031877)=-64.4720426069046; dx=-6.398221391706584E-7 evalInputDelta=6.576781903402413
Fitness changed from -57.89526070350218 to -64.4720426069046
Iteration 4 complete. Error: -64.4720426069046 Total: 7.7265; Orientation: 0.0701; Line Search: 4.8430
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 26400d52 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.954e+04, gradient 7.926e-04, dot -0.862; [0a4cefd4-f21a-458f-9a59-fabf7383b951 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -64.4720426069046, -57.89526070350218, -53.37871151092142, -50.715061998263096
LBFGS Accumulation History: 3 points
Removed measurement 26400d52 to history. Total: 3
th(0)=-64.4720426069046;dx=-6.268905935813978E-7
New Minimum: -64.4720426069046 > -73.15481308903409
END: th(1.684339755941405E7)=-73.15481308903409; dx=-3.6698270081516187E-7 evalInputDelta=8.682770482129499
Fitness changed from -64.4720426069046 to -73.15481308903409
Iteration 5 complete. Error: -73.15481308903409 Total: 8.4618; Orientation: 1.1302; Line Search: 4.6159
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6e6292b3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.874e+04, gradient 6.702e-04, dot -0.724; [0a4cefd4-f21a-458f-9a59-fabf7383b951 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -73.15481308903409, -57.89526070350218, -53.37871151092142, -50.715061998263096
LBFGS Accumulation History: 3 points
Removed measurement 6e6292b3 to history. Total: 3
th(0)=-73.15481308903409;dx=-4.479869113843534E-7
New Minimum: -73.15481308903409 > -82.96346980281704
END: th(3.6288E7)=-82.96346980281704; dx=-1.3742195151227534E-7 evalInputDelta=9.808656713782952
Fitness changed from -73.15481308903409 to -82.96346980281704
Iteration 6 complete. Error: -82.96346980281704 Total: 8.6887; Orientation: 1.1684; Line Search: 4.6438
Adding measurement 7bfdc6c6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.894e+04, gradient 7.350e-04, dot -0.458; [0a4cefd4-f21a-458f-9a59-fabf7383b951 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -82.96346980281704, -57.89526070350218, -53.37871151092142, -50.715061998263096
LBFGS Accumulation History: 3 points
Removed measurement 7bfdc6c6 to history. Total: 3
th(0)=-82.96346980281704;dx=-5.400776526741489E-7
Armijo: th(7.8180126031877E7)=-79.4202735844919; dx=1.4907711291615E-7 evalInputDelta=-3.54319621832515
New Minimum: -82.96346980281704 > -86.4351883266452
WOLF (strong): th(3.90900630159385E7)=-86.4351883266452; dx=1.2456431842154836E-7 evalInputDelta=3.4717185238281587
New Minimum: -86.4351883266452 > -87.71348770482953
END: th(1.3030021005312832E7)=-87.71348770482953; dx=-1.635422163909975E-7 evalInputDelta=4.7500179020124875
Fitness changed from -82.96346980281704 to -87.71348770482953
Iteration 7 complete. Error: -87.71348770482953 Total: 12.2056; Orientation: 1.0652; Line Search: 8.7584
Adding measurement 61265893 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.762e+04, gradient 5.538e-04, dot -0.610; [0a4cefd4-f21a-458f-9a59-fabf7383b951 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -87.71348770482953, -57.89526070350218, -53.37871151092142, -50.715061998263096
LBFGS Accumulation History: 3 points
Removed measurement 61265893 to history. Total: 3
th(0)=-87.71348770482953;dx=-3.052791410492968E-7
New Minimum: -87.71348770482953 > -92.5468640751838
END: th(2.807232926569009E7)=-92.5468640751838; dx=-7.191666804840893E-8 evalInputDelta=4.833376370354273
Fitness changed from -87.71348770482953 to -92.5468640751838
Iteration 8 complete. Error: -92.5468640751838 Total: 7.7131; Orientation: 1.0495; Line Search: 4.4505
Adding measurement 2e70f99a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.116e+04, gradient 6.654e-04, dot -0.462; [0a4cefd4-f21a-458f-9a59-fabf7383b951 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -92.5468640751838, -57.89526070350218, -53.37871151092142, -50.715061998263096
LBFGS Accumulation History: 3 points
Removed measurement 2e70f99a to history. Total: 3
th(0)=-92.5468640751838;dx=-4.4197657831231684E-7
Armijo: th(6.048000000000001E7)=-90.06455294479515; dx=1.3657515437440542E-7 evalInputDelta=-2.482311130388652
New Minimum: -92.5468640751838 > -95.11615183411025
WOLF (strong): th(3.0240000000000004E7)=-95.11615183411025; dx=1.0996751203253931E-7 evalInputDelta=2.56928775892645
New Minimum: -95.11615183411025 > -95.7730104100318
END: th(1.0080000000000002E7)=-95.7730104100318; dx=-1.6514987683641067E-7 evalInputDelta=3.2261463348479964
Fitness changed from -92.5468640751838 to -95.7730104100318
Iteration 9 complete. Error: -95.7730104100318 Total: 12.3853; Orientation: 1.0323; Line Search: 9.1306
Adding measurement 193760ee to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.735e+04, gradient 4.630e-04, dot -0.654; [0a4cefd4-f21a-458f-9a59-fabf7383b951 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -95.7730104100318, -57.89526070350218, -53.37871151092142, -50.715061998263096
LBFGS Accumulation History: 3 points
Removed measurement 193760ee to history. Total: 3
th(0)=-95.7730104100318;dx=-2.1387437562765569E-7
New Minimum: -95.7730104100318 > -99.28850950414679
END: th(2.1716701675521392E7)=-99.28850950414679; dx=-1.207828234951683E-7 evalInputDelta=3.515499094114986
Fitness changed from -95.7730104100318 to -99.28850950414679
Iteration 10 complete. Error: -99.28850950414679 Total: 7.8558; Orientation: 1.1021; Line Search: 4.5079
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -99.28850950414679 (> -Infinity) after 110.893s (< 5400.000s)
Returns
-99.28850950414679