Image-stitching and virtual tour solutions My account Updates
It is currently Fri Oct 24, 2014 2:39 pm

All times are UTC + 1 hour




Post new topic Reply to topic  [ 14 posts ] 
Author Message
PostPosted: Wed Oct 05, 2011 11:45 pm 
Offline
Member

Joined: Mon Jan 15, 2007 4:43 am
Posts: 243
On my windows 7 x64 machines, I've noticed extended save as with the move files options can take quite a while for large numbers of images. I happened to have resource monitor open while doing it and noticed a high disk usage rate. I can see the system process reading the files and the autopano process writing the files between 5 and 30 MB/sec. I am moving the files within the same drive, from the image folder to a subfolder of image folder
e.g.
c:\images
to
c:\images\panos\img_0001_img_0010-10images\

via the %p/%a argument to the path

This isn't really a bug, more a question. Is autopano copying the file and then deleting it, when moving it? or is making a system call to move the file?


Last edited by foundation on Wed Oct 05, 2011 11:47 pm, edited 1 time in total.

Top
 Profile  
 
 Post subject:
PostPosted: Fri Oct 21, 2011 7:18 pm 
Offline
Member

Joined: Mon Jan 15, 2007 4:43 am
Posts: 243
Further evidence that it copies and deletes rather than moves:
I regularly have the program infinitely hang when doing an extended save as, as previously reported in a bug post here.
http://www.kolor.com/forum/t12569-apg-2.5.2,w7-64-extended-save-as-move-images-hangs
When I kill the process, the destination folder has a few of the images and the last image there is also in the source folder.

Is there anyway to speed up the extended save as process? I've tried disabling my anti-virus.

The slowest part of my workflow is moving the pano files in to sub directories (using %p/%a) so any suggestions on how to speed this up will help me greatly.


Top
 Profile  
 
 Post subject:
PostPosted: Mon Oct 24, 2011 12:44 pm 
Offline
Administrator
User avatar

Joined: Mon Nov 14, 2005 4:56 pm
Posts: 5901
Location: Francin, France
I've opened an issue to check that : issue 958


Top
 Profile  
 
 Post subject:
PostPosted: Thu Oct 27, 2011 10:57 am 
Offline
Administrator
User avatar

Joined: Mon Nov 14, 2005 4:56 pm
Posts: 5901
Location: Francin, France
In both case, it's a copy. If you decide to move it, then the first file is deleted once we are sure the copy has worked.


Top
 Profile  
 
 Post subject:
PostPosted: Thu Oct 27, 2011 5:28 pm 
Offline
Member

Joined: Mon Jan 15, 2007 4:43 am
Posts: 243
Thanks for looking Alexandre. Now I know why it takes so long to move panos. Doesn't the operating system take care of that with a move? for example if you interrupt a windows explorer move, you end up with a temp file at the destination and the original still there. So it seems to me a big performance hit when moving files within the same drive to have double security. If you decide to keep the double security, could I suggest you add a progress bar or some sort of ui feedback look to prevent the whole application from seeming locked up (windows thinks the app is not responding during the copy time).

The reason this is important to me is that when I get home from a day of landscape shooting (I shoot most things as panoramas even if they aren't wide or tall to get extra print size) I might have 3000 photos in the day's folder. I use autopano to find the panos and move them to a panos subfolder (each one has a subfolder of panos) so that when I go through in lightroom and review the images, I only have to review the non pano images and the final stitched ones. The going through and moving the files takes me almost as much time as it takes the computer to find the panos. Perhaps another way of making my workflow easier (if you don't want to change the move behavior) would be if I could batch "save extended as" so that all open files got saved to the %p/%a subfolder. Anyway, I understand my use case may not be common, but I appreciate you answering questions and all the community interaction you do, so thank you!


Top
 Profile  
 
 Post subject:
PostPosted: Mon Oct 31, 2011 9:05 am 
Offline
Administrator
User avatar

Joined: Mon Nov 14, 2005 4:56 pm
Posts: 5901
Location: Francin, France
I was missing in fact one function in Qt, something like Qfile::move. It doesn't exist, as it is called rename ...
So, there's place here for improvement. I'll see what I can do to speed up that part.


Top
 Profile  
 
 Post subject:
PostPosted: Mon Oct 31, 2011 10:35 am 
Offline
Member

Joined: Mon Jul 19, 2010 8:53 pm
Posts: 2137
I noticed that from time not all files are copied. I then have to manually move the files.

_________________
Regards, Hans Keesom
I stitch and render for other photographers. Price: RMS^3, no cure no pay. If you want to concentrate on your business let me do the stitching for you.


Top
 Profile  
 
 Post subject:
PostPosted: Mon Nov 07, 2011 9:10 am 
Offline
Administrator
User avatar

Joined: Mon Nov 14, 2005 4:56 pm
Posts: 5901
Location: Francin, France
We changed the underlying code for RC1. Now, it should go really faster.


Top
 Profile  
 
 Post subject:
PostPosted: Mon Mar 25, 2013 2:14 pm 
Offline
Member

Joined: Mon Jan 15, 2007 4:43 am
Posts: 243
Is it possible that in 3.0.5 the code ha reverted back to copying and then deleting (maybe all of 3.0 builds?)
It seems much slower to extended save as, and taskmgr shows a huge amount of reading and writing while it does it.
This is on windows 8.


Top
 Profile  
 
 Post subject:
PostPosted: Sun Apr 21, 2013 5:18 am 
Offline
Member

Joined: Mon Jan 15, 2007 4:43 am
Posts: 243
I'm looking at resource monitor in windows 7 while doing an extended save as that is going very slowly, and it's reading from source directory and writing to destination, rather than doing a move. This is with version 3.0.4 running on win7 x64 so it's not just a windows 8 issue


Last edited by foundation on Sun Apr 21, 2013 6:09 pm, edited 1 time in total.

Top
 Profile  
 
 Post subject:
PostPosted: Sun Jul 07, 2013 6:45 am 
Offline
Member

Joined: Mon Jan 15, 2007 4:43 am
Posts: 243
Checking back on this issue, I'm "moving" via extended save as some panos from one folder to a subfolder of that folder e.g. 2012-07-27 has the files, I do extended save choosing "move" to 2012-07-27/panos/B61p0875_B61P1003-123 images/ and I watch in resource manager .cr2 files being read and written. This is with version 3.0.6 on windows 7 x64


Last edited by foundation on Sun Jul 07, 2013 6:46 am, edited 1 time in total.

Top
 Profile  
 
PostPosted: Tue Jan 14, 2014 8:34 pm 
Offline
Member

Joined: Mon Jan 15, 2007 4:43 am
Posts: 243
Any chance the team could check if Qfile::rename has been reverted to qt:copy in extended save as before releasing 3.5 beta? Thanks!


Top
 Profile  
 
PostPosted: Mon May 12, 2014 4:53 pm 
Offline
Member

Joined: Mon Jan 15, 2007 4:43 am
Posts: 243
Wondering if this is getting missed or is low priority because focus is on video?


Top
 Profile  
 
PostPosted: Tue May 13, 2014 9:37 am 
Offline
Administrator
User avatar

Joined: Mon Nov 14, 2005 4:56 pm
Posts: 5901
Location: Francin, France
I opened a new Issue. 3509 Seems that we lost the first one.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 14 posts ] 

All times are UTC + 1 hour


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB® Forum Software © phpBB Group