BasicOptimizer.scala:89 executed in 136.75 seconds (1.537 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 326900374780000
Reset training subject: 326903050094800
Adding measurement 62965c9f to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-28.453068277230678;dx=-2.3765995313970765E-5
New Minimum: -28.453068277230678 > -28.453124420165473
WOLFE (weak): th(2.154434690031884)=-28.453124420165473; dx=-2.2582704908887397E-5 evalInputDelta=5.614293479538901E-5
New Minimum: -28.453124420165473 > -28.45318056298949
WOLFE (weak): th(4.308869380063768)=-28.45318056298949; dx=-2.258595389532257E-5 evalInputDelta=1.122857588136128E-4
New Minimum: -28.45318056298949 > -28.453404073888592
WOLFE (weak): th(12.926608140191302)=-28.453404073888592; dx=-2.2584542871446597E-5 evalInputDelta=3.357966579145E-4
New Minimum: -28.453404073888592 > -28.454414617840392
WOLFE (weak): th(51.70643256076521)=-28.454414617840392; dx=-2.2587389585567693E-5 evalInputDelta=0.0013463406097145025
New Minimum: -28.454414617840392 > -28.45980040242042
WOLFE (weak): th(258.53216280382605)=-28.45980040242042; dx=-2.2587716977856774E-5 evalInputDelta=0.006732125189742533
New Minimum: -28.45980040242042 > -28.493456209868853
WOLFE (weak): th(1551.1929768229563)=-28.493456209868853; dx=-2.2585581321319496E-5 evalInputDelta=0.04038793263817553
New Minimum: -28.493456209868853 > -28.735416159098477
WOLFE (weak): th(10858.350837760694)=-28.735416159098477; dx=-2.2507137739660443E-5 evalInputDelta=0.2823478818677998
New Minimum: -28.735416159098477 > -30.681103550690057
WOLFE (weak): th(86866.80670208555)=-30.681103550690057; dx=-2.1838574898208496E-5 evalInputDelta=2.22803527345938
New Minimum: -30.681103550690057 > -43.96709664590647
END: th(781801.26031877)=-43.96709664590647; dx=-1.1342688938976747E-5 evalInputDelta=15.514028368675795
Fitness changed from -28.453068277230678 to -43.96709664590647
Iteration 1 complete. Error: -43.96709664590647 Total: 33.8873; Orientation: 0.0640; Line Search: 25.8176
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 256c45a6 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-43.96709664590647;dx=-1.666930741284353E-5
New Minimum: -43.96709664590647 > -62.42616615595201
END: th(1684339.7559414052)=-62.42616615595201; dx=-4.365676833662497E-6 evalInputDelta=18.459069510045538
Fitness changed from -43.96709664590647 to -62.42616615595201
Iteration 2 complete. Error: -62.42616615595201 Total: 8.0094; Orientation: 0.0567; Line Search: 5.0269
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7aaa6200 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-62.42616615595201;dx=-1.547052157915671E-5
New Minimum: -62.42616615595201 > -78.76246307389607
WOLF (strong): th(3628800.0)=-78.76246307389607; dx=4.5594063653685623E-7 evalInputDelta=16.33629691794406
END: th(1814400.0)=-77.66053232658228; dx=-2.1973133644012555E-6 evalInputDelta=15.234366170630274
Fitness changed from -62.42616615595201 to -78.76246307389607
Iteration 3 complete. Error: -78.76246307389607 Total: 10.6748; Orientation: 0.0577; Line Search: 7.6367
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 680fd480 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.618e+04, gradient 4.372e-03, dot -0.431; [061abedb-899a-4e92-b00e-4be86aed84b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -78.76246307389607, -62.42616615595201, -43.96709664590647, -28.453068277230678
LBFGS Accumulation History: 3 points
Removed measurement 680fd480 to history. Total: 3
th(0)=-78.76246307389607;dx=-1.9101257032782786E-5
New Minimum: -78.76246307389607 > -97.49602816342686
WOLF (strong): th(3909006.30159385)=-97.49602816342686; dx=4.164263135260478E-6 evalInputDelta=18.733565089530785
New Minimum: -97.49602816342686 > -101.41973154998902
END: th(1954503.150796925)=-101.41973154998902; dx=-2.253167783438001E-6 evalInputDelta=22.657268476092952
Fitness changed from -78.76246307389607 to -101.41973154998902
Iteration 4 complete. Error: -101.41973154998902 Total: 11.7595; Orientation: 1.1371; Line Search: 7.7057
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 11d2b5c7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.113e+04, gradient 3.306e-03, dot -0.474; [061abedb-899a-4e92-b00e-4be86aed84b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -101.41973154998902, -62.42616615595201, -43.96709664590647, -28.453068277230678
LBFGS Accumulation History: 3 points
Removed measurement 11d2b5c7 to history. Total: 3
th(0)=-101.41973154998902;dx=-1.0920172166807965E-5
New Minimum: -101.41973154998902 > -114.80152258663438
WOLF (strong): th(4210849.389853513)=-114.80152258663438; dx=1.8900143320189863E-6 evalInputDelta=13.381791036645353
New Minimum: -114.80152258663438 > -115.82476320494514
END: th(2105424.6949267564)=-115.82476320494514; dx=-1.979551883635645E-6 evalInputDelta=14.405031654956119
Fitness changed from -101.41973154998902 to -115.82476320494514
Iteration 5 complete. Error: -115.82476320494514 Total: 11.9210; Orientation: 1.1282; Line Search: 7.8287
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7b31035d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.296e+04, gradient 3.087e-03, dot -0.524; [061abedb-899a-4e92-b00e-4be86aed84b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -115.82476320494514, -62.42616615595201, -43.96709664590647, -28.453068277230678
LBFGS Accumulation History: 3 points
Removed measurement 7b31035d to history. Total: 3
th(0)=-115.82476320494514;dx=-9.523053731349072E-6
New Minimum: -115.82476320494514 > -124.93171687140004
WOLF (strong): th(4536000.0)=-124.93171687140004; dx=1.7579840782556815E-6 evalInputDelta=9.1069536664549
New Minimum: -124.93171687140004 > -127.30120182850881
END: th(2268000.0)=-127.30120182850881; dx=-7.595362469569979E-7 evalInputDelta=11.476438623563666
Fitness changed from -115.82476320494514 to -127.30120182850881
Iteration 6 complete. Error: -127.30120182850881 Total: 12.0729; Orientation: 1.0846; Line Search: 7.6034
Adding measurement 2571821a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.838e+04, gradient 3.104e-03, dot -0.487; [061abedb-899a-4e92-b00e-4be86aed84b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -127.30120182850881, -62.42616615595201, -43.96709664590647, -28.453068277230678
LBFGS Accumulation History: 3 points
Removed measurement 2571821a to history. Total: 3
th(0)=-127.30120182850881;dx=-9.621841320728289E-6
New Minimum: -127.30120182850881 > -131.01946821926663
WOLF (strong): th(4886257.876992312)=-131.01946821926663; dx=3.135789745929689E-6 evalInputDelta=3.718266390757819
New Minimum: -131.01946821926663 > -137.91810679740595
WOLF (strong): th(2443128.938496156)=-137.91810679740595; dx=7.041573208292562E-7 evalInputDelta=10.616904968897146
END: th(814376.312832052)=-134.34836577539292; dx=-5.57933498543094E-6 evalInputDelta=7.047163946884112
Fitness changed from -127.30120182850881 to -137.91810679740595
Iteration 7 complete. Error: -137.91810679740595 Total: 13.7596; Orientation: 1.2143; Line Search: 10.1662
Adding measurement 2517634b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.279e+04, gradient 3.203e-03, dot -0.459; [061abedb-899a-4e92-b00e-4be86aed84b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -137.91810679740595, -62.42616615595201, -43.96709664590647, -28.453068277230678
LBFGS Accumulation History: 3 points
Removed measurement 2517634b to history. Total: 3
th(0)=-137.91810679740595;dx=-1.0250778158705461E-5
New Minimum: -137.91810679740595 > -148.4536574605095
END: th(1754520.5791056305)=-148.4536574605095; dx=-8.497231763781887E-7 evalInputDelta=10.53555066310355
Fitness changed from -137.91810679740595 to -148.4536574605095
Iteration 8 complete. Error: -148.4536574605095 Total: 8.6517; Orientation: 1.1186; Line Search: 5.0897
Adding measurement 19d62cca to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.953e+04, gradient 2.471e-03, dot -0.566; [061abedb-899a-4e92-b00e-4be86aed84b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -148.4536574605095, -62.42616615595201, -43.96709664590647, -28.453068277230678
LBFGS Accumulation History: 3 points
Removed measurement 19d62cca to history. Total: 3
th(0)=-148.4536574605095;dx=-6.100309981059514E-6
New Minimum: -148.4536574605095 > -157.18396462149792
WOLF (strong): th(3780000.0000000005)=-157.18396462149792; dx=6.348525796460429E-7 evalInputDelta=8.730307160988417
END: th(1890000.0000000002)=-156.573657958582; dx=-1.7984408662409798E-6 evalInputDelta=8.1200004980725
Fitness changed from -148.4536574605095 to -157.18396462149792
Iteration 9 complete. Error: -157.18396462149792 Total: 11.5422; Orientation: 1.1606; Line Search: 7.7959
Adding measurement 3a1bd3a0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.549e+04, gradient 3.431e-03, dot -0.378; [061abedb-899a-4e92-b00e-4be86aed84b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -157.18396462149792, -62.42616615595201, -43.96709664590647, -28.453068277230678
LBFGS Accumulation History: 3 points
Removed measurement 3a1bd3a0 to history. Total: 3
th(0)=-157.18396462149792;dx=-1.1762088366796021E-5
New Minimum: -157.18396462149792 > -160.10819025969033
WOLF (strong): th(4071881.564160261)=-160.10819025969033; dx=5.018051953093566E-6 evalInputDelta=2.9242256381924108
New Minimum: -160.10819025969033 > -168.88418287057902
WOLF (strong): th(2035940.7820801304)=-168.88418287057902; dx=9.769811401537944E-7 evalInputDelta=11.700218249081104
END: th(678646.9273600435)=-164.62786886544498; dx=-7.347782503236277E-6 evalInputDelta=7.44390424394706
Fitness changed from -157.18396462149792 to -168.88418287057902
Iteration 10 complete. Error: -168.88418287057902 Total: 13.9847; Orientation: 1.0656; Line Search: 10.2288
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -168.88418287057902 (> -Infinity) after 136.748s (< 5400.000s)
Returns
-168.88418287057902