BasicOptimizer.scala:89 executed in 1723.12 seconds (236.100 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 450140498971000
Reset training subject: 450166664306400
Adding measurement 279c1d04 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-34.16109499287769;dx=-3.586695625987343E-6
New Minimum: -34.16109499287769 > -34.16110719209314
WOLFE (weak): th(2.154434690031884)=-34.16110719209314; dx=-3.4522437815301326E-6 evalInputDelta=1.2199215447594725E-5
New Minimum: -34.16110719209314 > -34.161119391304226
WOLFE (weak): th(4.308869380063768)=-34.161119391304226; dx=-3.4523863217946245E-6 evalInputDelta=2.439842653245705E-5
New Minimum: -34.161119391304226 > -34.16116615490636
WOLFE (weak): th(12.926608140191302)=-34.16116615490636; dx=-3.4523783111324403E-6 evalInputDelta=7.116202866797039E-5
New Minimum: -34.16116615490636 > -34.16137150735798
WOLFE (weak): th(51.70643256076521)=-34.16137150735798; dx=-3.4524265476823376E-6 evalInputDelta=2.7651448028365166E-4
New Minimum: -34.16137150735798 > -34.16247754289775
WOLFE (weak): th(258.53216280382605)=-34.16247754289775; dx=-3.438399725318605E-6 evalInputDelta=0.001382550020053941
New Minimum: -34.16247754289775 > -34.169391486603416
WOLFE (weak): th(1551.1929768229563)=-34.169391486603416; dx=-3.4494987562103758E-6 evalInputDelta=0.008296493725723053
New Minimum: -34.169391486603416 > -34.21916068352521
WOLFE (weak): th(10858.350837760694)=-34.21916068352521; dx=-3.4501787218104456E-6 evalInputDelta=0.05806569064751699
New Minimum: -34.21916068352521 > -34.62568429800054
WOLFE (weak): th(86866.80670208555)=-34.62568429800054; dx=-3.4525415592437524E-6 evalInputDelta=0.4645893051228498
New Minimum: -34.62568429800054 > -38.298264186757365
WOLFE (weak): th(781801.26031877)=-38.298264186757365; dx=-3.3608238667529793E-6 evalInputDelta=4.1371691938796715
New Minimum: -38.298264186757365 > -65.39322604089926
END: th(7818012.6031877)=-65.39322604089926; dx=-1.5439312667565168E-6 evalInputDelta=31.23213104802157
Fitness changed from -34.16109499287769 to -65.39322604089926
Iteration 1 complete. Error: -65.39322604089926 Total: 344.6675; Orientation: 0.1099; Line Search: 267.7264
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 155e21a3 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-65.39322604089926;dx=-3.0740476782631038E-6
New Minimum: -65.39322604089926 > -103.94343640908129
END: th(1.684339755941405E7)=-103.94343640908129; dx=-4.3919506869930444E-7 evalInputDelta=38.55021036818202
Fitness changed from -65.39322604089926 to -103.94343640908129
Iteration 2 complete. Error: -103.94343640908129 Total: 72.5833; Orientation: 0.1109; Line Search: 47.0804
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 25ae8782 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-103.94343640908129;dx=-2.7691681829008798E-6
New Minimum: -103.94343640908129 > -126.76050162349986
WOLF (strong): th(3.6288E7)=-126.76050162349986; dx=3.3694979460702055E-7 evalInputDelta=22.817065214418577
New Minimum: -126.76050162349986 > -134.2720374286692
END: th(1.8144E7)=-134.2720374286692; dx=-2.9962377280297732E-9 evalInputDelta=30.328601019587907
Fitness changed from -103.94343640908129 to -134.2720374286692
Iteration 3 complete. Error: -134.2720374286692 Total: 94.5543; Orientation: 0.1042; Line Search: 71.7331
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 70141cf4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.114e+04, gradient 1.550e-03, dot -0.411; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -134.2720374286692, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 70141cf4 to history. Total: 3
th(0)=-134.2720374286692;dx=-2.3987149184421187E-6
New Minimum: -134.2720374286692 > -142.92749103694115
WOLF (strong): th(3.90900630159385E7)=-142.92749103694115; dx=5.466420545715136E-7 evalInputDelta=8.655453608271955
New Minimum: -142.92749103694115 > -159.48421411049534
WOLF (strong): th(1.954503150796925E7)=-159.48421411049534; dx=2.533060240546651E-7 evalInputDelta=25.21217668182615
END: th(6515010.502656416)=-152.9477823086666; dx=-1.189167361767082E-6 evalInputDelta=18.67574487999741
Fitness changed from -134.2720374286692 to -159.48421411049534
Iteration 4 complete. Error: -159.48421411049534 Total: 125.5188; Orientation: 1.9917; Line Search: 97.6853
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 573fa580 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.189e+04, gradient 1.450e-03, dot -0.360; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -159.48421411049534, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 573fa580 to history. Total: 3
th(0)=-159.48421411049534;dx=-2.1026989582514036E-6
New Minimum: -159.48421411049534 > -182.91258333768516
END: th(1.4036164632845044E7)=-182.91258333768516; dx=-1.0157686556230255E-7 evalInputDelta=23.42836922718982
Fitness changed from -159.48421411049534 to -182.91258333768516
Iteration 5 complete. Error: -182.91258333768516 Total: 74.5723; Orientation: 1.9900; Line Search: 48.1311
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6b82ce26 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.432e+04, gradient 1.107e-03, dot -0.429; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -182.91258333768516, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 6b82ce26 to history. Total: 3
th(0)=-182.91258333768516;dx=-1.2216523628978643E-6
New Minimum: -182.91258333768516 > -194.06330335324094
WOLF (strong): th(3.0240000000000004E7)=-194.06330335324094; dx=2.805300228332487E-7 evalInputDelta=11.150720015555777
New Minimum: -194.06330335324094 > -197.90919193679179
END: th(1.5120000000000002E7)=-197.90919193679179; dx=-1.244058635456285E-7 evalInputDelta=14.996608599106622
Fitness changed from -182.91258333768516 to -197.90919193679179
Iteration 6 complete. Error: -197.90919193679179 Total: 100.2702; Orientation: 2.1505; Line Search: 73.1659
Adding measurement 288d6586 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.134e+04, gradient 1.053e-03, dot -0.427; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -197.90919193679179, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 288d6586 to history. Total: 3
th(0)=-197.90919193679179;dx=-1.1051873325267425E-6
New Minimum: -197.90919193679179 > -203.0918851381464
WOLF (strong): th(3.2575052513282087E7)=-203.0918851381464; dx=3.301092221821422E-7 evalInputDelta=5.182693201354624
New Minimum: -203.0918851381464 > -209.94769329771248
WOLF (strong): th(1.6287526256641043E7)=-209.94769329771248; dx=2.4253481109792712E-8 evalInputDelta=12.03850136092069
END: th(5429175.418880348)=-205.64050705563122; dx=-6.311092370072444E-7 evalInputDelta=7.731315118839433
Fitness changed from -197.90919193679179 to -209.94769329771248
Iteration 7 complete. Error: -209.94769329771248 Total: 128.1085; Orientation: 1.9810; Line Search: 103.0553
Adding measurement 6bc7c67f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.292e+04, gradient 1.071e-03, dot -0.397; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -209.94769329771248, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 6bc7c67f to history. Total: 3
th(0)=-209.94769329771248;dx=-1.1464950099747962E-6
New Minimum: -209.94769329771248 > -221.39155284010454
END: th(1.1696803860704206E7)=-221.39155284010454; dx=-1.0729804970993759E-7 evalInputDelta=11.443859542392062
Fitness changed from -209.94769329771248 to -221.39155284010454
Iteration 8 complete. Error: -221.39155284010454 Total: 81.8840; Orientation: 2.2713; Line Search: 52.5608
Adding measurement 5ce0a8b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.546e+04, gradient 8.590e-04, dot -0.456; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -221.39155284010454, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 5ce0a8b to history. Total: 3
th(0)=-221.39155284010454;dx=-7.377220381144576E-7
New Minimum: -221.39155284010454 > -229.23245562590387
WOLF (strong): th(2.5200000000000007E7)=-229.23245562590387; dx=1.0538922251358702E-7 evalInputDelta=7.840902785799329
New Minimum: -229.23245562590387 > -229.8317104028794
END: th(1.2600000000000004E7)=-229.8317104028794; dx=-1.52327463475023E-7 evalInputDelta=8.440157562774857
Fitness changed from -221.39155284010454 to -229.8317104028794
Iteration 9 complete. Error: -229.8317104028794 Total: 103.6224; Orientation: 2.0276; Line Search: 74.5365
Adding measurement 409dae13 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.745e+04, gradient 8.298e-04, dot -0.455; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -229.8317104028794, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 409dae13 to history. Total: 3
th(0)=-229.8317104028794;dx=-6.858266525192354E-7
New Minimum: -229.8317104028794 > -235.43959619640248
WOLF (strong): th(2.7145877094401743E7)=-235.43959619640248; dx=1.3185894758492422E-7 evalInputDelta=5.6078857935230815
New Minimum: -235.43959619640248 > -237.2411512444191
END: th(1.3572938547200872E7)=-237.2411512444191; dx=-7.77155665341535E-8 evalInputDelta=7.409440841539691
Fitness changed from -229.8317104028794 to -237.2411512444191
Iteration 10 complete. Error: -237.2411512444191 Total: 102.9474; Orientation: 2.1616; Line Search: 74.4894
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Adding measurement 5fe36dec to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.767e+04, gradient 8.469e-04, dot -0.426; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -237.2411512444191, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 5fe36dec to history. Total: 3
th(0)=-237.2411512444191;dx=-7.14623360862113E-7
New Minimum: -237.2411512444191 > -239.4853689289502
WOLF (strong): th(2.924200965176052E7)=-239.4853689289502; dx=2.415075675784857E-7 evalInputDelta=2.2442176845311224
New Minimum: -239.4853689289502 > -244.18622016667987
WOLF (strong): th(1.462100482588026E7)=-244.18622016667987; dx=2.066435086282999E-8 evalInputDelta=6.945068922260788
END: th(4873668.27529342)=-241.77930551590174; dx=-4.0875158143089733E-7 evalInputDelta=4.538154271482654
Fitness changed from -237.2411512444191 to -244.18622016667987
Iteration 11 complete. Error: -244.18622016667987 Total: 121.4093; Orientation: 2.0000; Line Search: 96.1852
Adding measurement 7a66905 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.828e+04, gradient 8.747e-04, dot -0.399; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -244.18622016667987, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 7a66905 to history. Total: 3
th(0)=-244.18622016667987;dx=-7.639979581799565E-7
New Minimum: -244.18622016667987 > -251.19027394729133
END: th(1.0500000000000006E7)=-251.19027394729133; dx=-8.743024646559789E-8 evalInputDelta=7.004053780611457
Fitness changed from -244.18622016667987 to -251.19027394729133
Iteration 12 complete. Error: -251.19027394729133 Total: 77.8400; Orientation: 2.0168; Line Search: 52.8212
Adding measurement 31de9ec6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.625e+04, gradient 7.042e-04, dot -0.458; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -251.19027394729133, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 31de9ec6 to history. Total: 3
th(0)=-251.19027394729133;dx=-4.942563955410088E-7
New Minimum: -251.19027394729133 > -256.63172017093973
WOLF (strong): th(2.2621564245334793E7)=-256.63172017093973; dx=4.009074600113307E-8 evalInputDelta=5.4414462236483985
END: th(1.1310782122667396E7)=-256.5073399396838; dx=-1.318860068691523E-7 evalInputDelta=5.3170659923924575
Fitness changed from -251.19027394729133 to -256.63172017093973
Iteration 13 complete. Error: -256.63172017093973 Total: 95.8361; Orientation: 2.0415; Line Search: 70.4804
Adding measurement 23395048 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.802e+04, gradient 9.554e-04, dot -0.340; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -256.63172017093973, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 23395048 to history. Total: 3
th(0)=-256.63172017093973;dx=-9.126562302410199E-7
New Minimum: -256.63172017093973 > -258.4283516393698
WOLF (strong): th(2.4368341376467105E7)=-258.4283516393698; dx=4.1252337444911275E-7 evalInputDelta=1.7966314684300642
New Minimum: -258.4283516393698 > -265.0261127480894
WOLF (strong): th(1.2184170688233553E7)=-265.0261127480894; dx=4.674960315628353E-8 evalInputDelta=8.394392577149688
END: th(4061390.2294111843)=-261.8001957846843; dx=-5.754523739099574E-7 evalInputDelta=5.16847561374459
Fitness changed from -256.63172017093973 to -265.0261127480894
Iteration 14 complete. Error: -265.0261127480894 Total: 120.7161; Orientation: 1.9650; Line Search: 96.2969
Adding measurement 64041e8b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.362e+04, gradient 7.207e-04, dot -0.403; [5f7b491b-bf57-48bd-95fa-7748ec269a66 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -265.0261127480894, -103.94343640908129, -65.39322604089926, -34.16109499287769
LBFGS Accumulation History: 3 points
Removed measurement 64041e8b to history. Total: 3
th(0)=-265.0261127480894;dx=-5.155637229983415E-7
New Minimum: -265.0261127480894 > -269.67599244460126
END: th(8750000.000000006)=-269.67599244460126; dx=-1.5644024688872768E-7 evalInputDelta=4.649879696511846
Fitness changed from -265.0261127480894 to -269.67599244460126
Iteration 15 complete. Error: -269.67599244460126 Total: 77.8333; Orientation: 2.0559; Line Search: 49.2955
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 16: -269.67599244460126 (> -Infinity) after 1723.117s (< 5400.000s)
Returns
-269.67599244460126