You are not logged in.

> The forum rules have been updated. Please take a moment to read them.


#1 2010-09-20 20:53:44

gkaefer
Member
From: Salzburg
Registered: 2009-06-09
Posts: 2676
Website

[APG 2.5 B1] multicore CPU usage

hmm a little bit disapointing. no change in new 2.5 B1.

extrem example: adding 4410 images to a new group (294 images a 15 brackets.)
than CPU monitor of windows shows that one CPU is working 100% and 7 CPUs are empty on 0% load.
result expecting 8 times of waiting...

Georg

Offline

 

#2 2010-09-20 22:43:34

gkaefer
Member
From: Salzburg
Registered: 2009-06-09
Posts: 2676
Website

Re: [APG 2.5 B1] multicore CPU usage

currently running detection of the group containing 4410 images.

SIFT controlpoint extraction: 8 CPUs used 100%load
Coordination of controlpoints 4-8 CPU used up to 100% load - windows is partly freezing some minutes but get reanimated again, up to 8gig of 8gig ram used.
phase is ongoing since one hour currently, preditction on group status info says 2h 34m...
Georg

Offline

 

#3 2010-09-21 01:11:56

tived
Member
From: Dane in Western Australia
Registered: 2008-07-11
Posts: 835

Re: [APG 2.5 B1] multicore CPU usage

thanks for sharing this georg

its a bit odd, how are your hard drives configured? maybe we do need more memory :-) I max out 8GB too.

Henrik

Offline

 

#4 2010-09-21 09:03:48

gkaefer
Member
From: Salzburg
Registered: 2009-06-09
Posts: 2676
Website

Re: [APG 2.5 B1] multicore CPU usage

I've sadly on my DELL PC on my C:\ windows system partition installed an (software) raid 1 of two 1GB diskc.

after 10 hours in my test the adjustment of controllpoints phase is still ongoing. 7.6GB mem used and 16GB mem subscribed by autopano... so clear that this swapping causes delays I expect...
CPU usage is 5-10% currently in average with 25% peaks at 4 of the 8 CPU.

currently status in my test ... screenshot from 9am...

Georg


Uploaded Images

Offline

 

#5 2010-09-21 10:10:03

mediavets
Moderator
From: Isleham, Cambridgeshire, UK.
Registered: 2007-11-14
Posts: 9728
Website

Re: [APG 2.5 B1] multicore CPU usage

gkaefer wrote:

currently running detection of the group containing 4410 images.

SIFT controlpoint extraction: 8 CPUs used 100%load
Coordination of controlpoints 4-8 CPU used up to 100% load - windows is partly freezing some minutes but get reanimated again, up to 8gig of 8gig ram used.
phase is ongoing since one hour currently, preditction on group status info says 2h 34m...
Georg

That time - 2h 34m - is the time elapsed between shooting the first and last shots in the image set and not an indication of predicted time to detect the pano. You'll note it hasn't chnaged in all those many hours your system has been working on this image set.

Last edited by mediavets (2010-09-21 10:18:06)


Andrew Stephens
Nikon D40, Nikkor 10.5mm fisheye, Sigma 8mm f3.5 fisheye, Nikkor 18-55/50/35mm lenses, Nodal Ninja 5 Lite, Nodal Ninja 4 with R-D16, Agno's MrotatorTCS short.
Nikon P5100, CP5000, CP995, FC-E8, WC-E63,WC-E68, TC-E2, Kaidan Kiwi 995, Bophoto pano bracket, Agno's MrotatorA.
Merlin/Orion robotic pano head + Papywizard on Nokia 770/N800/N810 and Windows 8/XP/2K.

Offline

 

#6 2010-09-21 16:19:11

gkaefer
Member
From: Salzburg
Registered: 2009-06-09
Posts: 2676
Website

Re: [APG 2.5 B1] multicore CPU usage

mediavets wrote:

gkaefer wrote:

currently running detection of the group containing 4410 images.

SIFT controlpoint extraction: 8 CPUs used 100%load
Coordination of controlpoints 4-8 CPU used up to 100% load - windows is partly freezing some minutes but get reanimated again, up to 8gig of 8gig ram used.
phase is ongoing since one hour currently, preditction on group status info says 2h 34m...
Georg

That time - 2h 34m - is the time elapsed between shooting the first and last shots in the image set and not an indication of predicted time to detect the pano. You'll note it hasn't chnaged in all those many hours your system has been working on this image set.

thanks for enlightment ;-) yes it did not change ;-))
but on other side it took exact 5:30 hours to shoot 882 images live on location - I had an massive sunburn because I forgot the suncream....
perhaps the 2:34 hours is the time were I did take the 884 images to produce fake AEB images (882*5)

Liebe Gruesse,
Georg

Offline

 

#7 2010-09-21 23:44:07

gkaefer
Member
From: Salzburg
Registered: 2009-06-09
Posts: 2676
Website

Re: [APG 2.5 B1] multicore CPU usage

and finally preview of group got finished after 10-18hours (was not at home...)

so 900.000 controllpoints and around 20000 links between images for the 4410 images.
opening the group editor takes 5 minutes...
zooming from default 0.8% to 100% and finishing textzure reloading takes 3 minutes each move to right/left or down/up takes 1 minute.

so great to see that all this is working without bluescreen or bugsplash - perfect work done!
and also clear such amount of images for one pano your need far more memory than the 8gig ram I've, I would suggest the double of memory if you sum up the number of images * imagesize so 46gig RAM or more I would say and some big SSD for temp dirs and I would also install the APG itself offsite the windows partition on a SSD and additional the windows swap also on extra SSD...

Liebe Gruesse,
Georg


Uploaded Images

Offline

 

#8 2010-09-23 01:44:29

tived
Member
From: Dane in Western Australia
Registered: 2008-07-11
Posts: 835

Re: [APG 2.5 B1] multicore CPU usage

mediavets wrote:

gkaefer wrote:

currently running detection of the group containing 4410 images.

SIFT controlpoint extraction: 8 CPUs used 100%load
Coordination of controlpoints 4-8 CPU used up to 100% load - windows is partly freezing some minutes but get reanimated again, up to 8gig of 8gig ram used.
phase is ongoing since one hour currently, preditction on group status info says 2h 34m...
Georg

That time - 2h 34m - is the time elapsed between shooting the first and last shots in the image set and not an indication of predicted time to detect the pano. You'll note it hasn't chnaged in all those many hours your system has been working on this image set.

Hi Andrew, you really know how take the wind out a man's sails :-) here was Georg hoping! now he will be doing so for a whole lot longer :-)

thanks for clearing this up

Henrik

PS: It would be nice to have an ETA (at least as a guide of what to expect) (ETA estimated Time of Arrival - so make that ETTF, Estimated Time To Finish) :-)

Offline

 

#9 2010-09-23 01:51:23

tived
Member
From: Dane in Western Australia
Registered: 2008-07-11
Posts: 835

Re: [APG 2.5 B1] multicore CPU usage

Hi Georg et al...

When you look at those numbers, you have to admit its a pretty amazing program, though I have my own difficulties and often switch to PTGui for help, I still can't get over how well this program sometimes comes out and totally surprise me.

Interesting part here, that you break all this down.

QUESTION!! Alexandre and Kolor, in order to speed the process up, how can we improve on the hardware to make this go faster, I would think and correct me if I am wrong, that that Viewing of the image is GPU related and if it is would multiple GPU's help here?

In terms of rendering, it comes down to hard drive speed, so a really large (large = many disks) array RAID-0 would make a difference.

can anyone confirm this, please

Henrik

PS: I find the waiting business, such a waste of my time


gkaefer wrote:

and finally preview of group got finished after 10-18hours (was not at home...)

so 900.000 controllpoints and around 20000 links between images for the 4410 images.
opening the group editor takes 5 minutes...
zooming from default 0.8% to 100% and finishing textzure reloading takes 3 minutes each move to right/left or down/up takes 1 minute.

so great to see that all this is working without bluescreen or bugsplash - perfect work done!
and also clear such amount of images for one pano your need far more memory than the 8gig ram I've, I would suggest the double of memory if you sum up the number of images * imagesize so 46gig RAM or more I would say and some big SSD for temp dirs and I would also install the APG itself offsite the windows partition on a SSD and additional the windows swap also on extra SSD...

Liebe Gruesse,
Georg

Offline

 

#10 2010-10-05 11:20:17

AlexandreJ
Kolor CEO
From: Francin, France
Registered: 2005-11-14
Posts: 7911
Website

Re: [APG 2.5 B1] multicore CPU usage

To gkaefer, if you have a 15 brackets, just use the stack feature, it's here to help you in such big case and it really improves the results.

Offline

 

#11 2010-10-05 11:20:57

AlexandreJ
Kolor CEO
From: Francin, France
Registered: 2005-11-14
Posts: 7911
Website

Re: [APG 2.5 B1] multicore CPU usage

For detection, RAM is needed as well as fast CPU. Everything else won't really help, we don't do much I/O during detection.

Offline

 

#12 2010-10-05 11:54:09

tived
Member
From: Dane in Western Australia
Registered: 2008-07-11
Posts: 835

Re: [APG 2.5 B1] multicore CPU usage

Ok detection is RAM and CPU bound,
viewing is GPU bound
Now rendering is ???

Henrik

Offline

 

#13 2010-10-05 15:45:10

AlexandreJ
Kolor CEO
From: Francin, France
Registered: 2005-11-14
Posts: 7911
Website

Re: [APG 2.5 B1] multicore CPU usage

Rendering is CPU bound ( if enough RAM ), or harddrive IO speed limited if big panorama.

Offline

 

#14 2010-10-05 17:42:16

tived
Member
From: Dane in Western Australia
Registered: 2008-07-11
Posts: 835

Re: [APG 2.5 B1] multicore CPU usage

Thanks Alexandre

OK, so it is taxing on all cylinders, if one is doing big pano's.
What would be interesting is when it becomes I/O limited vs quantity of ram/ CPU speed.

I am still a few weeks away from my monster build, which hopefully will eat multi-gigabyte images for breakfast :-) without breaking out in a sweat

thanks

Henrik

Offline

 

#15 2010-10-05 18:20:36

mediavets
Moderator
From: Isleham, Cambridgeshire, UK.
Registered: 2007-11-14
Posts: 9728
Website

Re: [APG 2.5 B1] multicore CPU usage

tived wrote:

What would be interesting is when it becomes I/O limited vs quantity of ram/ CPU speed.

Henrik

It seems no-one knows yet:
http://www.autopano.net/forum/p69973-20 … -57#p69973


Andrew Stephens
Nikon D40, Nikkor 10.5mm fisheye, Sigma 8mm f3.5 fisheye, Nikkor 18-55/50/35mm lenses, Nodal Ninja 5 Lite, Nodal Ninja 4 with R-D16, Agno's MrotatorTCS short.
Nikon P5100, CP5000, CP995, FC-E8, WC-E63,WC-E68, TC-E2, Kaidan Kiwi 995, Bophoto pano bracket, Agno's MrotatorA.
Merlin/Orion robotic pano head + Papywizard on Nokia 770/N800/N810 and Windows 8/XP/2K.

Offline

 

#16 2010-10-05 19:53:59

tived
Member
From: Dane in Western Australia
Registered: 2008-07-11
Posts: 835

Re: [APG 2.5 B1] multicore CPU usage

thanks for that Andrew,

I have been away for a week and a bit, shooting pano's on a salt lake.

Henrik

Offline

 

#17 2010-10-06 08:47:45

AlexandreJ
Kolor CEO
From: Francin, France
Registered: 2005-11-14
Posts: 7911
Website

Re: [APG 2.5 B1] multicore CPU usage

I agree. This kind of relation could be measured with the release version, but we are still optimizing this now. Between beta 1 and beta 2, you'll get another boost in performance and lower IO needs.

Offline

 

Board footer

Powered by PunBB
© Copyright 2002–2005 Rickard Andersson