BasicOptimizer.scala:89 executed in 135.68 seconds (1.753 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 329678662399700
Reset training subject: 329681326471800
Adding measurement 1e17f062 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-129.54296038857657;dx=-2.7297419253935473E-5
New Minimum: -129.54296038857657 > -129.5430050606502
END: th(2.154434690031884)=-129.5430050606502; dx=-2.117684240033574E-5 evalInputDelta=4.467207361358305E-5
Fitness changed from -129.54296038857657 to -129.5430050606502
Iteration 1 complete. Error: -129.5430050606502 Total: 13.0395; Orientation: 0.0600; Line Search: 5.2353
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement d6f6fcb to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-129.5430050606502;dx=-2.106547581486312E-5
New Minimum: -129.5430050606502 > -129.54311674076678
WOLFE (weak): th(4.641588833612779)=-129.54311674076678; dx=-2.1057813383242377E-5 evalInputDelta=1.1168011658924115E-4
New Minimum: -129.54311674076678 > -129.54322097545543
WOLFE (weak): th(9.283177667225559)=-129.54322097545543; dx=-2.1057882997944794E-5 evalInputDelta=2.1591480523852624E-4
New Minimum: -129.54322097545543 > -129.54366769459966
WOLFE (weak): th(27.849533001676676)=-129.54366769459966; dx=-2.10562983862709E-5 evalInputDelta=6.626339494744116E-4
New Minimum: -129.54366769459966 > -129.54564813091943
WOLFE (weak): th(111.3981320067067)=-129.54564813091943; dx=-2.1050129566790358E-5 evalInputDelta=0.002643070269243708
New Minimum: -129.54564813091943 > -129.55620498361426
WOLFE (weak): th(556.9906600335335)=-129.55620498361426; dx=-2.104136182577504E-5 evalInputDelta=0.013199922964076904
New Minimum: -129.55620498361426 > -129.62218443545638
WOLFE (weak): th(3341.9439602012008)=-129.62218443545638; dx=-2.1029033642645376E-5 evalInputDelta=0.07917937480618775
New Minimum: -129.62218443545638 > -130.09567783775094
WOLFE (weak): th(23393.607721408407)=-130.09567783775094; dx=-2.091470511385611E-5 evalInputDelta=0.5526727771007529
New Minimum: -130.09567783775094 > -133.83567994202144
WOLFE (weak): th(187148.86177126726)=-133.83567994202144; dx=-1.9600247514127445E-5 evalInputDelta=4.292674881371255
New Minimum: -133.83567994202144 > -155.00829164999482
END: th(1684339.7559414054)=-155.00829164999482; dx=-6.462344514369503E-6 evalInputDelta=25.46528658934463
Fitness changed from -129.5430050606502 to -155.00829164999482
Iteration 2 complete. Error: -155.00829164999482 Total: 29.4482; Orientation: 0.0598; Line Search: 26.2208
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 635901db to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-155.00829164999482;dx=-9.420252052373984E-6
New Minimum: -155.00829164999482 > -173.06113053321565
END: th(3628800.0000000005)=-173.06113053321565; dx=-1.1118414069791334E-6 evalInputDelta=18.05283888322083
Fitness changed from -155.00829164999482 to -173.06113053321565
Iteration 3 complete. Error: -173.06113053321565 Total: 8.2356; Orientation: 0.0601; Line Search: 5.2353
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 45048662 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.490e+03, gradient 2.993e-03, dot -0.297; [71b3fea3-bfb4-40ee-a072-d221c7dbf2a2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -173.06113053321565, -155.00829164999482, -129.5430050606502, -129.54296038857657
LBFGS Accumulation History: 3 points
Removed measurement 45048662 to history. Total: 3
th(0)=-173.06113053321565;dx=-8.94204496870155E-6
Armijo: th(7818012.603187701)=-170.0285190319592; dx=3.4092428101502717E-6 evalInputDelta=-3.03261150125644
New Minimum: -173.06113053321565 > -183.1394360160659
WOLF (strong): th(3909006.3015938504)=-183.1394360160659; dx=1.5903411682414576E-6 evalInputDelta=10.078305482850254
END: th(1303002.1005312835)=-181.98996791908397; dx=-3.672472302358227E-6 evalInputDelta=8.92883738586832
Fitness changed from -173.06113053321565 to -183.1394360160659
Iteration 4 complete. Error: -183.1394360160659 Total: 14.4374; Orientation: 1.0391; Line Search: 10.3864
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 59aafe7b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.980e+03, gradient 3.203e-03, dot -0.223; [71b3fea3-bfb4-40ee-a072-d221c7dbf2a2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -183.1394360160659, -155.00829164999482, -129.5430050606502, -129.54296038857657
LBFGS Accumulation History: 3 points
Removed measurement 59aafe7b to history. Total: 3
th(0)=-183.1394360160659;dx=-1.025312144205793E-5
New Minimum: -183.1394360160659 > -196.168205493368
WOLF (strong): th(2807232.926569009)=-196.168205493368; dx=1.0744142681476926E-6 evalInputDelta=13.028769477302092
END: th(1403616.4632845046)=-194.34142064691804; dx=-4.028430077216487E-6 evalInputDelta=11.201984630852138
Fitness changed from -183.1394360160659 to -196.168205493368
Iteration 5 complete. Error: -196.168205493368 Total: 11.7956; Orientation: 1.0200; Line Search: 7.6050
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 37419b03 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.121e+04, gradient 2.550e-03, dot -0.336; [71b3fea3-bfb4-40ee-a072-d221c7dbf2a2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -196.168205493368, -155.00829164999482, -129.5430050606502, -129.54296038857657
LBFGS Accumulation History: 3 points
Removed measurement 37419b03 to history. Total: 3
th(0)=-196.168205493368;dx=-6.504194132998561E-6
New Minimum: -196.168205493368 > -204.54024551754026
WOLF (strong): th(3024000.0000000005)=-204.54024551754026; dx=8.335746405591473E-7 evalInputDelta=8.372040024172264
END: th(1512000.0000000002)=-203.59512026395197; dx=-2.4593882372020497E-6 evalInputDelta=7.426914770583977
Fitness changed from -196.168205493368 to -204.54024551754026
Iteration 6 complete. Error: -204.54024551754026 Total: 11.7676; Orientation: 1.0205; Line Search: 7.7907
Adding measurement 64ad3375 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.686e+04, gradient 2.500e-03, dot -0.383; [71b3fea3-bfb4-40ee-a072-d221c7dbf2a2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -204.54024551754026, -155.00829164999482, -129.5430050606502, -129.54296038857657
LBFGS Accumulation History: 3 points
Removed measurement 64ad3375 to history. Total: 3
th(0)=-204.54024551754026;dx=-6.239168200029384E-6
New Minimum: -204.54024551754026 > -210.61998183979188
WOLF (strong): th(3257505.251328209)=-210.61998183979188; dx=1.9050608509697041E-6 evalInputDelta=6.07973632225162
New Minimum: -210.61998183979188 > -211.50380089880045
END: th(1628752.6256641045)=-211.50380089880045; dx=-1.5789268656749097E-6 evalInputDelta=6.963555381260193
Fitness changed from -204.54024551754026 to -211.50380089880045
Iteration 7 complete. Error: -211.50380089880045 Total: 11.5206; Orientation: 1.0017; Line Search: 7.9659
Adding measurement 2f036839 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.277e+04, gradient 1.674e-03, dot -0.644; [71b3fea3-bfb4-40ee-a072-d221c7dbf2a2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -211.50380089880045, -155.00829164999482, -129.5430050606502, -129.54296038857657
LBFGS Accumulation History: 3 points
Removed measurement 2f036839 to history. Total: 3
th(0)=-211.50380089880045;dx=-2.801481366271626E-6
New Minimum: -211.50380089880045 > -218.3601900144807
END: th(3509041.158211262)=-218.3601900144807; dx=-1.0846261893259368E-6 evalInputDelta=6.856389115680258
Fitness changed from -211.50380089880045 to -218.3601900144807
Iteration 8 complete. Error: -218.3601900144807 Total: 8.8712; Orientation: 1.0642; Line Search: 5.3503
Adding measurement 43bb0b99 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.328e+04, gradient 1.917e-03, dot -0.501; [71b3fea3-bfb4-40ee-a072-d221c7dbf2a2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -218.3601900144807, -155.00829164999482, -129.5430050606502, -129.54296038857657
LBFGS Accumulation History: 3 points
Removed measurement 43bb0b99 to history. Total: 3
th(0)=-218.3601900144807;dx=-3.665124921460347E-6
Armijo: th(7560000.000000003)=-216.64176962698932; dx=1.685359244462964E-6 evalInputDelta=-1.718420387491392
New Minimum: -218.3601900144807 > -222.5628120294637
WOLF (strong): th(3780000.0000000014)=-222.5628120294637; dx=5.720063789490348E-7 evalInputDelta=4.202622014982978
END: th(1260000.0000000005)=-221.9457571725321; dx=-1.6704558948553066E-6 evalInputDelta=3.58556715805139
Fitness changed from -218.3601900144807 to -222.5628120294637
Iteration 9 complete. Error: -222.5628120294637 Total: 14.6751; Orientation: 1.3085; Line Search: 10.7553
Adding measurement 13f26008 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.136e+04, gradient 2.397e-03, dot -0.336; [71b3fea3-bfb4-40ee-a072-d221c7dbf2a2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -222.5628120294637, -155.00829164999482, -129.5430050606502, -129.54296038857657
LBFGS Accumulation History: 3 points
Removed measurement 13f26008 to history. Total: 3
th(0)=-222.5628120294637;dx=-5.742772265126417E-6
New Minimum: -222.5628120294637 > -228.79960924373233
WOLF (strong): th(2714587.7094401745)=-228.79960924373233; dx=1.1932857755109343E-6 evalInputDelta=6.236797214268648
END: th(1357293.8547200873)=-228.4634671953589; dx=-2.1127550780527602E-6 evalInputDelta=5.900655165895216
Fitness changed from -222.5628120294637 to -228.79960924373233
Iteration 10 complete. Error: -228.79960924373233 Total: 11.4345; Orientation: 0.9992; Line Search: 7.9416
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -228.79960924373233 (> -Infinity) after 135.681s (< 5400.000s)
Returns
-228.79960924373233