BasicOptimizer.scala:89 executed in 148.42 seconds (2.249 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 462542611286400
Reset training subject: 462545489631600
Adding measurement 19080d61 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-106.47636153780786;dx=-1.563242391061435E-5
New Minimum: -106.47636153780786 > -106.47638763052146
END: th(2.154434690031884)=-106.47638763052146; dx=-1.2538138851110191E-5 evalInputDelta=2.6092713596881367E-5
Fitness changed from -106.47636153780786 to -106.47638763052146
Iteration 1 complete. Error: -106.47638763052146 Total: 13.9600; Orientation: 0.1066; Line Search: 5.5489
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7a26e7dc to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-106.47638763052146;dx=-1.2555896831488851E-5
New Minimum: -106.47638763052146 > -106.47645025300798
WOLFE (weak): th(4.641588833612779)=-106.47645025300798; dx=-1.253553196489596E-5 evalInputDelta=6.2622486524333E-5
New Minimum: -106.47645025300798 > -106.47651287545769
WOLFE (weak): th(9.283177667225559)=-106.47651287545769; dx=-1.252325319459248E-5 evalInputDelta=1.2524493622834143E-4
New Minimum: -106.47651287545769 > -106.47675292784037
WOLFE (weak): th(27.849533001676676)=-106.47675292784037; dx=-1.251826463135608E-5 evalInputDelta=3.652973189076647E-4
New Minimum: -106.47675292784037 > -106.47785403074802
WOLFE (weak): th(111.3981320067067)=-106.47785403074802; dx=-1.2483576452293996E-5 evalInputDelta=0.0014664002265618592
New Minimum: -106.47785403074802 > -106.48371421153163
WOLFE (weak): th(556.9906600335335)=-106.48371421153163; dx=-1.249366391166148E-5 evalInputDelta=0.007326581010175914
New Minimum: -106.48371421153163 > -106.52032390846598
WOLFE (weak): th(3341.9439602012008)=-106.52032390846598; dx=-1.2504861621439267E-5 evalInputDelta=0.043936277944524704
New Minimum: -106.52032390846598 > -106.78335900815019
WOLFE (weak): th(23393.607721408407)=-106.78335900815019; dx=-1.2433769479084203E-5 evalInputDelta=0.3069713776287273
New Minimum: -106.78335900815019 > -108.88933615873398
WOLFE (weak): th(187148.86177126726)=-108.88933615873398; dx=-1.2004903633613946E-5 evalInputDelta=2.4129485282125245
New Minimum: -108.88933615873398 > -124.44511015488936
END: th(1684339.7559414054)=-124.44511015488936; dx=-7.811036766290686E-6 evalInputDelta=17.968722524367905
Fitness changed from -106.47638763052146 to -124.44511015488936
Iteration 2 complete. Error: -124.44511015488936 Total: 32.5048; Orientation: 0.1090; Line Search: 28.8078
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2926153 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-124.44511015488936;dx=-7.946770589388414E-6
New Minimum: -124.44511015488936 > -144.61426971827288
END: th(3628800.0000000005)=-144.61426971827288; dx=-3.4069288059410694E-6 evalInputDelta=20.169159563383516
Fitness changed from -124.44511015488936 to -144.61426971827288
Iteration 3 complete. Error: -144.61426971827288 Total: 9.2054; Orientation: 0.1025; Line Search: 5.8132
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3ba9def0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.772e+03, gradient 2.254e-03, dot -0.534; [7cbab724-9ea2-4c48-85f4-72acba08de9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -144.61426971827288, -124.44511015488936, -106.47638763052146, -106.47636153780786
LBFGS Accumulation History: 3 points
Removed measurement 3ba9def0 to history. Total: 3
th(0)=-144.61426971827288;dx=-5.074799653578833E-6
New Minimum: -144.61426971827288 > -163.1633114562624
END: th(7818012.603187701)=-163.1633114562624; dx=-7.722103133976582E-7 evalInputDelta=18.549041737989512
Fitness changed from -144.61426971827288 to -163.1633114562624
Iteration 4 complete. Error: -163.1633114562624 Total: 11.1403; Orientation: 1.8377; Line Search: 5.7781
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 49debcc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.977e+03, gradient 2.462e-03, dot -0.284; [7cbab724-9ea2-4c48-85f4-72acba08de9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -163.1633114562624, -124.44511015488936, -106.47638763052146, -106.47636153780786
LBFGS Accumulation History: 3 points
Removed measurement 49debcc to history. Total: 3
th(0)=-163.1633114562624;dx=-6.0473942326976665E-6
Armijo: th(1.6843397559414055E7)=-158.2478999141956; dx=1.689019789051201E-6 evalInputDelta=-4.915411542066778
New Minimum: -163.1633114562624 > -174.44124555864715
WOLF (strong): th(8421698.779707028)=-174.44124555864715; dx=1.1945495109418113E-6 evalInputDelta=11.277934102384762
New Minimum: -174.44124555864715 > -175.14914215791484
END: th(2807232.926569009)=-175.14914215791484; dx=-2.2382121945512914E-6 evalInputDelta=11.985830701652446
Fitness changed from -163.1633114562624 to -175.14914215791484
Iteration 5 complete. Error: -175.14914215791484 Total: 16.8773; Orientation: 1.8162; Line Search: 11.5944
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 636da308 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.864e+04, gradient 1.741e-03, dot -0.555; [7cbab724-9ea2-4c48-85f4-72acba08de9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -175.14914215791484, -124.44511015488936, -106.47638763052146, -106.47636153780786
LBFGS Accumulation History: 3 points
Removed measurement 636da308 to history. Total: 3
th(0)=-175.14914215791484;dx=-3.0259026555354266E-6
New Minimum: -175.14914215791484 > -186.38530923325953
END: th(6048000.000000001)=-186.38530923325953; dx=-1.007197609601945E-6 evalInputDelta=11.236167075344696
Fitness changed from -175.14914215791484 to -186.38530923325953
Iteration 6 complete. Error: -186.38530923325953 Total: 10.7264; Orientation: 1.8142; Line Search: 5.6190
Adding measurement cc3fc0a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.254e+04, gradient 1.872e-03, dot -0.471; [7cbab724-9ea2-4c48-85f4-72acba08de9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -186.38530923325953, -124.44511015488936, -106.47638763052146, -106.47636153780786
LBFGS Accumulation History: 3 points
Removed measurement cc3fc0a to history. Total: 3
th(0)=-186.38530923325953;dx=-3.4958256092525027E-6
New Minimum: -186.38530923325953 > -190.44158248923273
WOLF (strong): th(1.3030021005312836E7)=-190.44158248923273; dx=7.668427179159089E-7 evalInputDelta=4.0562732559731955
New Minimum: -190.44158248923273 > -194.77706992724762
WOLF (strong): th(6515010.502656418)=-194.77706992724762; dx=4.628167178312397E-8 evalInputDelta=8.39176069398809
END: th(2171670.167552139)=-192.2113534551763; dx=-1.749078950831218E-6 evalInputDelta=5.82604422191676
Fitness changed from -186.38530923325953 to -194.77706992724762
Iteration 7 complete. Error: -194.77706992724762 Total: 16.1593; Orientation: 1.7838; Line Search: 11.6032
Adding measurement 1743ebf8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.473e+04, gradient 2.068e-03, dot -0.377; [7cbab724-9ea2-4c48-85f4-72acba08de9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -194.77706992724762, -124.44511015488936, -106.47638763052146, -106.47636153780786
LBFGS Accumulation History: 3 points
Removed measurement 1743ebf8 to history. Total: 3
th(0)=-194.77706992724762;dx=-4.258913815479351E-6
New Minimum: -194.77706992724762 > -204.90043410597676
END: th(4678721.544281682)=-204.90043410597676; dx=-1.3449093660115634E-7 evalInputDelta=10.123364178729133
Fitness changed from -194.77706992724762 to -204.90043410597676
Iteration 8 complete. Error: -204.90043410597676 Total: 10.1448; Orientation: 1.6995; Line Search: 5.7425
Adding measurement 4af3a277 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.143e+04, gradient 1.683e-03, dot -0.489; [7cbab724-9ea2-4c48-85f4-72acba08de9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -204.90043410597676, -124.44511015488936, -106.47638763052146, -106.47636153780786
LBFGS Accumulation History: 3 points
Removed measurement 4af3a277 to history. Total: 3
th(0)=-204.90043410597676;dx=-2.827972021000878E-6
New Minimum: -204.90043410597676 > -209.9218289457597
WOLF (strong): th(1.0080000000000002E7)=-209.9218289457597; dx=6.687110812939612E-7 evalInputDelta=5.021394839782943
New Minimum: -209.9218289457597 > -212.08861606152206
END: th(5040000.000000001)=-212.08861606152206; dx=-2.8870892856457443E-7 evalInputDelta=7.1881819555453035
Fitness changed from -204.90043410597676 to -212.08861606152206
Iteration 9 complete. Error: -212.08861606152206 Total: 13.3877; Orientation: 1.8126; Line Search: 8.8137
Adding measurement 26db4692 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.477e+04, gradient 1.644e-03, dot -0.485; [7cbab724-9ea2-4c48-85f4-72acba08de9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -212.08861606152206, -124.44511015488936, -106.47638763052146, -106.47636153780786
LBFGS Accumulation History: 3 points
Removed measurement 26db4692 to history. Total: 3
th(0)=-212.08861606152206;dx=-2.6945740974141474E-6
New Minimum: -212.08861606152206 > -215.32856078555568
WOLF (strong): th(1.0858350837760696E7)=-215.32856078555568; dx=7.667158355820846E-7 evalInputDelta=3.23994472403362
New Minimum: -215.32856078555568 > -218.60132890325403
END: th(5429175.418880348)=-218.60132890325403; dx=-3.511564107726188E-8 evalInputDelta=6.512712841731968
Fitness changed from -212.08861606152206 to -218.60132890325403
Iteration 10 complete. Error: -218.60132890325403 Total: 13.6292; Orientation: 1.8185; Line Search: 8.6734
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -218.60132890325403 (> -Infinity) after 148.418s (< 5400.000s)
Returns
-218.60132890325403