BasicOptimizer.scala:89 executed in 305.10 seconds (4.227 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 648274225903600
Reset training subject: 648280345358200
Adding measurement 407c3b2f to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-39.38681772472876;dx=-1.7097665409027765E-6
New Minimum: -39.38681772472876 > -39.386821559882286
END: th(2.154434690031884)=-39.386821559882286; dx=-1.4965703263220842E-6 evalInputDelta=3.835153528086721E-6
Fitness changed from -39.38681772472876 to -39.386821559882286
Iteration 1 complete. Error: -39.386821559882286 Total: 30.4488; Orientation: 0.1485; Line Search: 12.2554
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7596155e to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-39.386821559882286;dx=-1.4946815402066407E-6
New Minimum: -39.386821559882286 > -39.386831147764475
WOLFE (weak): th(4.641588833612779)=-39.386831147764475; dx=-1.4941535967924781E-6 evalInputDelta=9.587882189521224E-6
New Minimum: -39.386831147764475 > -39.38683690049267
WOLFE (weak): th(9.283177667225559)=-39.38683690049267; dx=-1.493704496930367E-6 evalInputDelta=1.534061038199752E-5
New Minimum: -39.38683690049267 > -39.38686949926989
WOLFE (weak): th(27.849533001676676)=-39.38686949926989; dx=-1.4931584467482575E-6 evalInputDelta=4.793938760627725E-5
New Minimum: -39.38686949926989 > -39.38700564681251
WOLFE (weak): th(111.3981320067067)=-39.38700564681251; dx=-1.4922660315360914E-6 evalInputDelta=1.8408693022564648E-4
New Minimum: -39.38700564681251 > -39.38774582099325
WOLFE (weak): th(556.9906600335335)=-39.38774582099325; dx=-1.4925442201967569E-6 evalInputDelta=9.242611109669951E-4
New Minimum: -39.38774582099325 > -39.39235913203202
WOLFE (weak): th(3341.9439602012008)=-39.39235913203202; dx=-1.492294382637963E-6 evalInputDelta=0.00553757214973416
New Minimum: -39.39235913203202 > -39.425566315708835
WOLFE (weak): th(23393.607721408407)=-39.425566315708835; dx=-1.4907118000136571E-6 evalInputDelta=0.03874475582654924
New Minimum: -39.425566315708835 > -39.695155664113265
WOLFE (weak): th(187148.86177126726)=-39.695155664113265; dx=-1.4742133281846933E-6 evalInputDelta=0.30833410423097973
New Minimum: -39.695155664113265 > -42.001495581320384
END: th(1684339.7559414054)=-42.001495581320384; dx=-1.2956564222228995E-6 evalInputDelta=2.6146740214380984
Fitness changed from -39.386821559882286 to -42.001495581320384
Iteration 2 complete. Error: -42.001495581320384 Total: 69.9907; Orientation: 0.1499; Line Search: 62.1859
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 387a06fa to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-42.001495581320384;dx=-1.2336040975778711E-6
New Minimum: -42.001495581320384 > -46.17250249608344
END: th(3628800.0000000005)=-46.17250249608344; dx=-8.647299485557393E-7 evalInputDelta=4.171006914763055
Fitness changed from -42.001495581320384 to -46.17250249608344
Iteration 3 complete. Error: -46.17250249608344 Total: 19.7763; Orientation: 0.1509; Line Search: 12.3923
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1fb34196 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.095e+04, gradient 8.951e-04, dot -0.848; [f4575707-7dae-40dc-b5ac-9e6d60f25b0f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.17250249608344, -42.001495581320384, -39.386821559882286, -39.38681772472876
LBFGS Accumulation History: 3 points
Removed measurement 1fb34196 to history. Total: 3
th(0)=-46.17250249608344;dx=-8.008095139238583E-7
New Minimum: -46.17250249608344 > -51.643419027106205
END: th(7818012.603187701)=-51.643419027106205; dx=-4.7331789008055127E-7 evalInputDelta=5.470916531022766
Fitness changed from -46.17250249608344 to -51.643419027106205
Iteration 4 complete. Error: -51.643419027106205 Total: 23.2233; Orientation: 2.6944; Line Search: 12.7032
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 3878c24c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.085e+03, gradient 7.608e-04, dot -0.641; [f4575707-7dae-40dc-b5ac-9e6d60f25b0f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -51.643419027106205, -42.001495581320384, -39.386821559882286, -39.38681772472876
LBFGS Accumulation History: 3 points
Removed measurement 3878c24c to history. Total: 3
th(0)=-51.643419027106205;dx=-5.779249036650001E-7
New Minimum: -51.643419027106205 > -58.11278306260523
END: th(1.6843397559414055E7)=-58.11278306260523; dx=-1.990016187410343E-7 evalInputDelta=6.4693640354990265
Fitness changed from -51.643419027106205 to -58.11278306260523
Iteration 5 complete. Error: -58.11278306260523 Total: 21.9453; Orientation: 2.5586; Line Search: 12.1220
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6a4c2411 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.437e+04, gradient 8.805e-04, dot -0.419; [f4575707-7dae-40dc-b5ac-9e6d60f25b0f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -58.11278306260523, -42.001495581320384, -39.386821559882286, -39.38681772472876
LBFGS Accumulation History: 3 points
Removed measurement 6a4c2411 to history. Total: 3
th(0)=-58.11278306260523;dx=-7.74969930274827E-7
Armijo: th(3.628800000000001E7)=-57.8782867553319; dx=1.4702754228030215E-7 evalInputDelta=-0.23449630727333215
New Minimum: -58.11278306260523 > -61.38426939839718
WOLF (strong): th(1.8144000000000004E7)=-61.38426939839718; dx=1.4602141132676712E-7 evalInputDelta=3.2714863357919484
New Minimum: -61.38426939839718 > -61.68878633548432
END: th(6048000.000000001)=-61.68878633548432; dx=-2.80890157807951E-7 evalInputDelta=3.576003272879092
Fitness changed from -58.11278306260523 to -61.68878633548432
Iteration 6 complete. Error: -61.68878633548432 Total: 34.4592; Orientation: 2.6727; Line Search: 24.7708
Adding measurement 544eb8c9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.103e+04, gradient 6.648e-04, dot -0.656; [f4575707-7dae-40dc-b5ac-9e6d60f25b0f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -61.68878633548432, -42.001495581320384, -39.386821559882286, -39.38681772472876
LBFGS Accumulation History: 3 points
Removed measurement 544eb8c9 to history. Total: 3
th(0)=-61.68878633548432;dx=-4.419757789378717E-7
New Minimum: -61.68878633548432 > -65.75723934946389
END: th(1.3030021005312836E7)=-65.75723934946389; dx=-1.7901665799039568E-7 evalInputDelta=4.068453013979564
Fitness changed from -61.68878633548432 to -65.75723934946389
Iteration 7 complete. Error: -65.75723934946389 Total: 21.1958; Orientation: 2.5490; Line Search: 12.3542
Adding measurement 5bc7ba5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.871e+04, gradient 7.806e-04, dot -0.523; [f4575707-7dae-40dc-b5ac-9e6d60f25b0f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -65.75723934946389, -42.001495581320384, -39.386821559882286, -39.38681772472876
LBFGS Accumulation History: 3 points
Removed measurement 5bc7ba5 to history. Total: 3
th(0)=-65.75723934946389;dx=-6.083402905512571E-7
New Minimum: -65.75723934946389 > -67.25094469709082
WOLF (strong): th(2.8072329265690096E7)=-67.25094469709082; dx=9.952580906829887E-8 evalInputDelta=1.4937053476269284
New Minimum: -67.25094469709082 > -68.8416342109234
WOLF (strong): th(1.4036164632845048E7)=-68.8416342109234; dx=4.8522825437776383E-8 evalInputDelta=3.084394861459515
END: th(4678721.544281683)=-68.13635660145734; dx=-3.038348171747081E-7 evalInputDelta=2.379117251993449
Fitness changed from -65.75723934946389 to -68.8416342109234
Iteration 8 complete. Error: -68.8416342109234 Total: 33.0034; Orientation: 2.4639; Line Search: 24.4545
Adding measurement 5f2d3d7f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.892e+04, gradient 9.115e-04, dot -0.378; [f4575707-7dae-40dc-b5ac-9e6d60f25b0f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -68.8416342109234, -42.001495581320384, -39.386821559882286, -39.38681772472876
LBFGS Accumulation History: 3 points
Removed measurement 5f2d3d7f to history. Total: 3
th(0)=-68.8416342109234;dx=-8.302453550864628E-7
New Minimum: -68.8416342109234 > -73.45595088061198
WOLF (strong): th(1.0080000000000004E7)=-73.45595088061198; dx=3.702531336277457E-8 evalInputDelta=4.614316669688577
END: th(5040000.000000002)=-72.46460150444847; dx=-4.3754862045883793E-7 evalInputDelta=3.6229672935250647
Fitness changed from -68.8416342109234 to -73.45595088061198
Iteration 9 complete. Error: -73.45595088061198 Total: 27.5871; Orientation: 2.5246; Line Search: 18.8988
Adding measurement 5c33baf8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.394e+04, gradient 7.380e-04, dot -0.521; [f4575707-7dae-40dc-b5ac-9e6d60f25b0f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -73.45595088061198, -42.001495581320384, -39.386821559882286, -39.38681772472876
LBFGS Accumulation History: 3 points
Removed measurement 5c33baf8 to history. Total: 3
th(0)=-73.45595088061198;dx=-5.44655783585032E-7
New Minimum: -73.45595088061198 > -76.57196370333676
END: th(1.0858350837760698E7)=-76.57196370333676; dx=-1.9722703556908554E-8 evalInputDelta=3.116012822724784
Fitness changed from -73.45595088061198 to -76.57196370333676
Iteration 10 complete. Error: -76.57196370333676 Total: 22.3526; Orientation: 2.5210; Line Search: 13.5649
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -76.57196370333676 (> -Infinity) after 305.096s (< 5400.000s)
Returns
-76.57196370333676