BasicOptimizer.scala:89 executed in 73.96 seconds (1.708 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 3093345496032
Reset training subject: 3093822225978
Adding measurement e621254 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-0.1421139087314211;dx=-8.63818641437912E-5
New Minimum: -0.1421139087314211 > -0.14211803795429329
WOLFE (weak): th(2.154434690031884)=-0.14211803795429329; dx=-8.636249439035659E-5 evalInputDelta=4.129222872184535E-6
New Minimum: -0.14211803795429329 > -0.14212474495479152
WOLFE (weak): th(4.308869380063768)=-0.14212474495479152; dx=-8.63462714670176E-5 evalInputDelta=1.0836223370419562E-5
New Minimum: -0.14212474495479152 > -0.1421471357424974
WOLFE (weak): th(12.926608140191302)=-0.1421471357424974; dx=-8.62789011763423E-5 evalInputDelta=3.3227011076303326E-5
New Minimum: -0.1421471357424974 > -0.1422503862755332
WOLFE (weak): th(51.70643256076521)=-0.1422503862755332; dx=-8.628830188627847E-5 evalInputDelta=1.3647754411211244E-4
New Minimum: -0.1422503862755332 > -0.1428043850961834
WOLFE (weak): th(258.53216280382605)=-0.1428043850961834; dx=-8.61617300361544E-5 evalInputDelta=6.904763647622991E-4
New Minimum: -0.1428043850961834 > -0.14643801753966776
WOLFE (weak): th(1551.1929768229563)=-0.14643801753966776; dx=-8.516337995318691E-5 evalInputDelta=0.004324108808246657
New Minimum: -0.14643801753966776 > -0.17711070467269938
END: th(10858.350837760694)=-0.17711070467269938; dx=-7.706235276489462E-5 evalInputDelta=0.034996795941278275
Fitness changed from -0.1421139087314211 to -0.17711070467269938
Iteration 1 complete. Error: -0.17711070467269938 Total: 6.2807; Orientation: 0.0164; Line Search: 4.8399
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement bd3100f to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-0.17711070467269938;dx=-9.469009297875298E-5
New Minimum: -0.17711070467269938 > -0.19758619570335742
END: th(23393.607721408407)=-0.19758619570335742; dx=-6.678045052665943E-5 evalInputDelta=0.020475491030658044
Fitness changed from -0.17711070467269938 to -0.19758619570335742
Iteration 2 complete. Error: -0.19758619570335742 Total: 1.5654; Orientation: 0.0217; Line Search: 1.0393
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2c99f1b0 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-0.19758619570335742;dx=-1.0104984742725016E-4
New Minimum: -0.19758619570335742 > -0.23272343984805252
END: th(50400.00000000001)=-0.23272343984805252; dx=-4.299402601928658E-5 evalInputDelta=0.0351372441446951
Fitness changed from -0.19758619570335742 to -0.23272343984805252
Iteration 3 complete. Error: -0.23272343984805252 Total: 1.5323; Orientation: 0.0175; Line Search: 1.0289
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 64cbcde to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.176e+04, gradient 9.640e-03, dot -0.379; [d3743c42-a31c-46f3-9bec-9a64a8711514 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.23272343984805252, -0.19758619570335742, -0.17711070467269938, -0.1421139087314211
LBFGS Accumulation History: 3 points
Removed measurement 64cbcde to history. Total: 3
th(0)=-0.23272343984805252;dx=-9.293683581856028E-5
New Minimum: -0.23272343984805252 > -0.2731637323092535
END: th(108583.50837760697)=-0.2731637323092535; dx=-1.7426992175052924E-5 evalInputDelta=0.04044029246120098
Fitness changed from -0.23272343984805252 to -0.2731637323092535
Iteration 4 complete. Error: -0.2731637323092535 Total: 1.9388; Orientation: 0.4228; Line Search: 1.0276
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5466e2cc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.443e+03, gradient 9.616e-03, dot -0.157; [d3743c42-a31c-46f3-9bec-9a64a8711514 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.2731637323092535, -0.19758619570335742, -0.17711070467269938, -0.1421139087314211
LBFGS Accumulation History: 3 points
Removed measurement 5466e2cc to history. Total: 3
th(0)=-0.2731637323092535;dx=-9.246304763239756E-5
Armijo: th(233936.07721408413)=-0.10743257406878161; dx=-4.882571345679908E-6 evalInputDelta=-0.1657311582404719
Armijo: th(116968.03860704206)=-0.27093555735623076; dx=-1.9664183082368822E-5 evalInputDelta=-0.0022281749530227435
New Minimum: -0.2731637323092535 > -0.43247148714571326
END: th(38989.346202347355)=-0.43247148714571326; dx=-5.972175144043522E-5 evalInputDelta=0.15930775483645976
Fitness changed from -0.2731637323092535 to -0.43247148714571326
Iteration 5 complete. Error: -0.43247148714571326 Total: 3.0117; Orientation: 0.4253; Line Search: 2.1132
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 77055fef to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.217e+03, gradient 1.103e-02, dot -0.158; [d3743c42-a31c-46f3-9bec-9a64a8711514 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.43247148714571326, -0.19758619570335742, -0.17711070467269938, -0.1421139087314211
LBFGS Accumulation History: 3 points
Removed measurement 77055fef to history. Total: 3
th(0)=-0.43247148714571326;dx=-1.2165582844968193E-4
Armijo: th(84000.00000000003)=-0.374096810820142; dx=-3.364360745942161E-5 evalInputDelta=-0.05837467632557125
New Minimum: -0.43247148714571326 > -0.4755876653048503
END: th(42000.000000000015)=-0.4755876653048503; dx=-6.260371739355702E-5 evalInputDelta=0.04311617815913704
Fitness changed from -0.43247148714571326 to -0.4755876653048503
Iteration 6 complete. Error: -0.4755876653048503 Total: 2.4727; Orientation: 0.4207; Line Search: 1.5651
Adding measurement 4a99d1a0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.198e+04, gradient 1.131e-02, dot -0.171; [d3743c42-a31c-46f3-9bec-9a64a8711514 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.4755876653048503, -0.19758619570335742, -0.17711070467269938, -0.1421139087314211
LBFGS Accumulation History: 3 points
Removed measurement 4a99d1a0 to history. Total: 3
th(0)=-0.4755876653048503;dx=-1.2782745360094216E-4
New Minimum: -0.4755876653048503 > -0.5074631725405341
END: th(90486.25698133915)=-0.5074631725405341; dx=-3.644364105004353E-5 evalInputDelta=0.031875507235683775
Fitness changed from -0.4755876653048503 to -0.5074631725405341
Iteration 7 complete. Error: -0.5074631725405341 Total: 1.9716; Orientation: 0.4225; Line Search: 1.0464
Adding measurement 372cb25 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.587e+04, gradient 1.273e-02, dot -0.159; [d3743c42-a31c-46f3-9bec-9a64a8711514 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.5074631725405341, -0.19758619570335742, -0.17711070467269938, -0.1421139087314211
LBFGS Accumulation History: 3 points
Removed measurement 372cb25 to history. Total: 3
th(0)=-0.5074631725405341;dx=-1.621615024343966E-4
Armijo: th(194946.7310117368)=-0.308267908284616; dx=-1.1489518861814582E-5 evalInputDelta=-0.1991952642559181
New Minimum: -0.5074631725405341 > -0.5096423083594023
END: th(97473.3655058684)=-0.5096423083594023; dx=-3.780299568765511E-5 evalInputDelta=0.002179135818868194
Fitness changed from -0.5074631725405341 to -0.5096423083594023
Iteration 8 complete. Error: -0.5096423083594023 Total: 2.5413; Orientation: 0.5278; Line Search: 1.5783
Adding measurement 7576d81d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.171e+04, gradient 1.017e-02, dot -0.162; [d3743c42-a31c-46f3-9bec-9a64a8711514 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.5096423083594023, -0.19758619570335742, -0.17711070467269938, -0.1421139087314211
LBFGS Accumulation History: 3 points
Removed measurement 7576d81d to history. Total: 3
th(0)=-0.5096423083594023;dx=-1.0337816808793265E-4
Armijo: th(210000.0000000001)=-0.250356643982349; dx=-1.1517666566052627E-5 evalInputDelta=-0.25928566437705325
Armijo: th(105000.00000000004)=-0.4226285470860528; dx=
...skipping 3904 bytes...
497E-5 evalInputDelta=-1.2309214929562273E-6
Armijo: th(1309.1769774330808)=-0.5784776386208846; dx=-9.61001889084656E-5 evalInputDelta=-1.717563301584235E-7
Armijo: th(1309.0117190415845)=-0.5784771233515882; dx=-9.610273871566008E-5 evalInputDelta=-6.870256266111596E-7
Armijo: th(1308.9290898458364)=-0.5784774668645035; dx=-9.610042979234232E-5 evalInputDelta=-3.4351271127608385E-7
Armijo: th(1308.8877752479625)=-0.5784776672469432; dx=-9.610115478617381E-5 evalInputDelta=-1.4313027163481706E-7
Armijo: th(1308.8671179490254)=-0.578477438238435; dx=-9.610043543114121E-5 evalInputDelta=-3.721387797916975E-7
Armijo: th(1308.856789299557)=-0.5784772664819944; dx=-9.610069315943932E-5 evalInputDelta=-5.43895220417312E-7
mu ~= nu (1308.8464606500884): th(1015.3475573527959)=-0.5785172843544254
Fitness changed from -0.5784778103772148 to -0.5785172843544254
Iteration 11 complete. Error: -0.5785172843544254 Total: 14.6228; Orientation: 0.4218; Line Search: 13.7022
Adding measurement 64aa5502 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.603e+04, gradient 9.828e-03, dot -0.203; [d3743c42-a31c-46f3-9bec-9a64a8711514 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.5785172843544254, -0.19758619570335742, -0.17711070467269938, -0.1421139087314211
LBFGS Accumulation History: 3 points
Removed measurement 64aa5502 to history. Total: 3
th(0)=-0.5785172843544254;dx=-9.658051738207909E-5
Armijo: th(2819.8353449503597)=-0.577981393414615; dx=-9.332602416179295E-5 evalInputDelta=-5.35890939810435E-4
Armijo: th(1409.9176724751799)=-0.5781717169119011; dx=-9.523083161912398E-5 evalInputDelta=-3.4556744252434157E-4
Armijo: th(469.9725574917266)=-0.5784325794486992; dx=-9.62796886735465E-5 evalInputDelta=-8.470490572620726E-5
Armijo: th(117.49313937293165)=-0.5784989932669462; dx=-9.645794908647105E-5 evalInputDelta=-1.8291087479194168E-5
Armijo: th(23.49862787458633)=-0.5785153092883243; dx=-9.652151922109494E-5 evalInputDelta=-1.9750661011119774E-6
Armijo: th(3.9164379790977217)=-0.5785162825101443; dx=-9.65438547693387E-5 evalInputDelta=-1.0018442810899586E-6
Armijo: th(0.5594911398711031)=-0.5785172557303272; dx=-9.652735258620793E-5 evalInputDelta=-2.8624098202811865E-8
Armijo: th(0.06993639248388789)=-0.5785168836169212; dx=-9.652740864936529E-5 evalInputDelta=-4.007375041803485E-7
Armijo: th(0.007770710275987543)=-0.578516940865153; dx=-9.65270732198985E-5 evalInputDelta=-3.4348927235861026E-7
Armijo: th(7.770710275987543E-4)=-0.5785172271062275; dx=-9.652746415116801E-5 evalInputDelta=-5.724819784891366E-8
Armijo: th(7.064282069079585E-5)=-0.5785170553615999; dx=-9.652768334512226E-5 evalInputDelta=-2.289928254795015E-7
Armijo: th(5.886901724232987E-6)=-0.578517083985708; dx=-9.651774607658454E-5 evalInputDelta=-2.0036871739570472E-7
Armijo: th(4.5283859417176823E-7)=-0.578517083985708; dx=-9.65278598044822E-5 evalInputDelta=-2.0036871739570472E-7
WOLFE (weak): th(3.234561386941202E-8)=-0.5785172843544254; dx=-9.652756697832084E-5 evalInputDelta=0.0
Armijo: th(2.425921040205901E-7)=-0.5785171126098148; dx=-9.652682813526446E-5 evalInputDelta=-1.7174461064417557E-7
Armijo: th(1.3746885894500106E-7)=-0.5785171126098148; dx=-9.652794703197135E-5 evalInputDelta=-1.7174461064417557E-7
WOLFE (weak): th(8.490723640720654E-8)=-0.5785172843544254; dx=-9.652806099007639E-5 evalInputDelta=0.0
WOLFE (weak): th(1.111880476761038E-7)=-0.5785172843544254; dx=-9.652747653112503E-5 evalInputDelta=0.0
WOLFE (weak): th(1.2432845331055243E-7)=-0.5785172843544254; dx=-9.652776378793023E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3089865612777676E-7)=-0.5785172843544254; dx=-9.652743134239096E-5 evalInputDelta=0.0
WOLFE (weak): th(1.341837575363889E-7)=-0.5785172843544254; dx=-9.652783475658713E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3582630824069497E-7)=-0.5785172843544254; dx=-9.652758575358515E-5 evalInputDelta=0.0
WOLFE (weak): th(1.36647583592848E-7)=-0.5785172843544254; dx=-9.65276263406026E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3705822126892453E-7)=-0.5785172843544254; dx=-9.652775907195314E-5 evalInputDelta=0.0
WOLFE (weak): th(1.372635401069628E-7)=-0.5785172843544254; dx=-9.652778223820155E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3736619952598194E-7)=-0.5785172843544254; dx=-9.652665776242254E-5 evalInputDelta=0.0
Armijo: th(1.374175292354915E-7)=-0.5785171126098148; dx=-9.652711884020629E-5 evalInputDelta=-1.7174461064417557E-7
Armijo: th(1.3739186438073673E-7)=-0.5785171126098148; dx=-9.652844722412809E-5 evalInputDelta=-1.7174461064417557E-7
WOLFE (weak): th(1.3737903195335933E-7)=-0.5785172843544254; dx=-9.652719438088052E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3738544816704802E-7)=-0.5785172843544254; dx=-9.652746843811933E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3738865627389237E-7)=-0.5785172843544254; dx=-9.652736562363345E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3739026032731455E-7)=-0.5785172843544254; dx=-9.652717819176075E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3739106235402565E-7)=-0.5785172843544254; dx=-9.652741935226626E-5 evalInputDelta=0.0
mu ~= nu (1.3739106235402565E-7): th(0.0)=-0.5785172843544254
Fitness changed from -0.5785172843544254 to -0.5785172843544254
Static Iteration Total: 19.3112; Orientation: 0.5805; Line Search: 18.2798
Iteration 12 failed. Error: -0.5785172843544254
Previous Error: 0.0 -> -0.5785172843544254
Retrying iteration 12
Reset training subject: 3153941168217
Adding measurement 5db425dc to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-0.5785172843544254;dx=-9.658171621443294E-5
Armijo: th(2.9600093479293084E-7)=-0.5785171126098148; dx=-9.652843855822982E-5 evalInputDelta=-1.7174461064417557E-7
Armijo: th(1.4800046739646542E-7)=-0.5785171126098148; dx=-9.652776513581531E-5 evalInputDelta=-1.7174461064417557E-7
WOLFE (weak): th(4.933348913215514E-8)=-0.5785172843544254; dx=-9.652788777719925E-5 evalInputDelta=0.0
WOLFE (weak): th(9.866697826431028E-8)=-0.5785172843544254; dx=-9.652812765237112E-5 evalInputDelta=0.0
WOLFE (weak): th(1.2333372283038786E-7)=-0.5785172843544254; dx=-9.652803504226577E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3566709511342665E-7)=-0.5785172843544254; dx=-9.652752496727137E-5 evalInputDelta=0.0
Armijo: th(1.4183378125494604E-7)=-0.5785171126098148; dx=-9.65281768598001E-5 evalInputDelta=-1.7174461064417557E-7
Armijo: th(1.3875043818418636E-7)=-0.5785171126098148; dx=-9.651480135197445E-5 evalInputDelta=-1.7174461064417557E-7
WOLFE (weak): th(1.372087666488065E-7)=-0.5785172843544254; dx=-9.652806274255755E-5 evalInputDelta=0.0
Armijo: th(1.3797960241649643E-7)=-0.5785171126098148; dx=-9.652775599873241E-5 evalInputDelta=-1.7174461064417557E-7
Armijo: th(1.3759418453265147E-7)=-0.5785171126098148; dx=-9.652771094728118E-5 evalInputDelta=-1.7174461064417557E-7
Armijo: th(1.3740147559072899E-7)=-0.5785171126098148; dx=-9.652738860682793E-5 evalInputDelta=-1.7174461064417557E-7
WOLFE (weak): th(1.3730512111976775E-7)=-0.5785172843544254; dx=-9.652805349954359E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3735329835524837E-7)=-0.5785172843544254; dx=-9.652815411739478E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3737738697298868E-7)=-0.5785172843544254; dx=-9.652768224186124E-5 evalInputDelta=0.0
WOLFE (weak): th(1.3738943128185883E-7)=-0.5785172843544254; dx=-9.652775072671741E-5 evalInputDelta=0.0
Armijo: th(1.373954534362939E-7)=-0.5785171126098148; dx=-9.652780999544632E-5 evalInputDelta=-1.7174461064417557E-7
Armijo: th(1.3739244235907638E-7)=-0.5785171126098148; dx=-9.652746453500023E-5 evalInputDelta=-1.7174461064417557E-7
WOLFE (weak): th(1.373909368204676E-7)=-0.5785172843544254; dx=-9.652861734045288E-5 evalInputDelta=0.0
Armijo: th(1.37391689589772E-7)=-0.5785171126098148; dx=-9.652773327221593E-5 evalInputDelta=-1.7174461064417557E-7
mu ~= nu (1.373909368204676E-7): th(0.0)=-0.5785172843544254
Fitness changed from -0.5785172843544254 to -0.5785172843544254
Static Iteration Total: 13.3604; Orientation: 0.0190; Line Search: 12.3815
Iteration 13 failed. Error: -0.5785172843544254
Previous Error: 0.0 -> -0.5785172843544254
Optimization terminated 13
Final threshold in iteration 13: -0.5785172843544254 (> -Infinity) after 73.956s (< 3600.000s)
Returns
-0.5785172843544254