[Win 7 x64 APG 2.5.2] Extended save as question  

This forum is dedicated to Autopano Pro / Giga bug reports and features discussion.
Please read the posting rules before starting a topic!
no avatar
foundation
Member
 
Posts: 244
Joined: Mon Jan 15, 2007 4:43 am

[Win 7 x64 APG 2.5.2] Extended save as question

by foundation » Wed Oct 05, 2011 11:45 pm

On my windows 7 x64 machines, I've noticed extended save as with the move files options can take quite a while for large numbers of images. I happened to have resource monitor open while doing it and noticed a high disk usage rate. I can see the system process reading the files and the autopano process writing the files between 5 and 30 MB/sec. I am moving the files within the same drive, from the image folder to a subfolder of image folder
e.g.
c:\images
to
c:\images\panos\img_0001_img_0010-10images\

via the %p/%a argument to the path

This isn't really a bug, more a question. Is autopano copying the file and then deleting it, when moving it? or is making a system call to move the file?
Last edited by foundation on Wed Oct 05, 2011 11:47 pm, edited 1 time in total.

no avatar
foundation
Member
 
Posts: 244
Joined: Mon Jan 15, 2007 4:43 am

by foundation » Fri Oct 21, 2011 7:18 pm

Further evidence that it copies and deletes rather than moves:
I regularly have the program infinitely hang when doing an extended save as, as previously reported in a bug post here.
http://www.kolor.com/forum/t12569-apg-2.5.2,w7-64-extended-save-as-move-images-hangs
When I kill the process, the destination folder has a few of the images and the last image there is also in the source folder.

Is there anyway to speed up the extended save as process? I've tried disabling my anti-virus.

The slowest part of my workflow is moving the pano files in to sub directories (using %p/%a) so any suggestions on how to speed this up will help me greatly.

User avatar
AlexandreJ
Kolor Team
 
Posts: 5917
Joined: Mon Nov 14, 2005 4:56 pm
Location: Francin, France

by AlexandreJ » Mon Oct 24, 2011 12:44 pm

I've opened an issue to check that : issue 958

User avatar
AlexandreJ
Kolor Team
 
Posts: 5917
Joined: Mon Nov 14, 2005 4:56 pm
Location: Francin, France

by AlexandreJ » Thu Oct 27, 2011 10:57 am

In both case, it's a copy. If you decide to move it, then the first file is deleted once we are sure the copy has worked.

no avatar
foundation
Member
 
Posts: 244
Joined: Mon Jan 15, 2007 4:43 am

by foundation » Thu Oct 27, 2011 5:28 pm

Thanks for looking Alexandre. Now I know why it takes so long to move panos. Doesn't the operating system take care of that with a move? for example if you interrupt a windows explorer move, you end up with a temp file at the destination and the original still there. So it seems to me a big performance hit when moving files within the same drive to have double security. If you decide to keep the double security, could I suggest you add a progress bar or some sort of ui feedback look to prevent the whole application from seeming locked up (windows thinks the app is not responding during the copy time).

The reason this is important to me is that when I get home from a day of landscape shooting (I shoot most things as panoramas even if they aren't wide or tall to get extra print size) I might have 3000 photos in the day's folder. I use autopano to find the panos and move them to a panos subfolder (each one has a subfolder of panos) so that when I go through in lightroom and review the images, I only have to review the non pano images and the final stitched ones. The going through and moving the files takes me almost as much time as it takes the computer to find the panos. Perhaps another way of making my workflow easier (if you don't want to change the move behavior) would be if I could batch "save extended as" so that all open files got saved to the %p/%a subfolder. Anyway, I understand my use case may not be common, but I appreciate you answering questions and all the community interaction you do, so thank you!

User avatar
AlexandreJ
Kolor Team
 
Posts: 5917
Joined: Mon Nov 14, 2005 4:56 pm
Location: Francin, France

by AlexandreJ » Mon Oct 31, 2011 9:05 am

I was missing in fact one function in Qt, something like Qfile::move. It doesn't exist, as it is called rename ...
So, there's place here for improvement. I'll see what I can do to speed up that part.

no avatar
HansKeesom
Member
 
Posts: 2162
Joined: Mon Jul 19, 2010 8:53 pm

by HansKeesom » Mon Oct 31, 2011 10:35 am

I noticed that from time not all files are copied. I then have to manually move the files.
Regards, Hans Keesom
I stitch and render for other photographers. Price: 25 euro or less, no cure no pay. If you want to concentrate on your business let me do the stitching for you. Free TB of Dropbox space when you have more then 250 euro business a year.

User avatar
AlexandreJ
Kolor Team
 
Posts: 5917
Joined: Mon Nov 14, 2005 4:56 pm
Location: Francin, France

by AlexandreJ » Mon Nov 07, 2011 9:10 am

We changed the underlying code for RC1. Now, it should go really faster.

no avatar
foundation
Member
 
Posts: 244
Joined: Mon Jan 15, 2007 4:43 am

by foundation » Mon Mar 25, 2013 2:14 pm

Is it possible that in 3.0.5 the code ha reverted back to copying and then deleting (maybe all of 3.0 builds?)
It seems much slower to extended save as, and taskmgr shows a huge amount of reading and writing while it does it.
This is on windows 8.

no avatar
foundation
Member
 
Posts: 244
Joined: Mon Jan 15, 2007 4:43 am

by foundation » Sun Apr 21, 2013 5:18 am

I'm looking at resource monitor in windows 7 while doing an extended save as that is going very slowly, and it's reading from source directory and writing to destination, rather than doing a move. This is with version 3.0.4 running on win7 x64 so it's not just a windows 8 issue
Last edited by foundation on Sun Apr 21, 2013 6:09 pm, edited 1 time in total.

no avatar
foundation
Member
 
Posts: 244
Joined: Mon Jan 15, 2007 4:43 am

by foundation » Sun Jul 07, 2013 6:45 am

Checking back on this issue, I'm "moving" via extended save as some panos from one folder to a subfolder of that folder e.g. 2012-07-27 has the files, I do extended save choosing "move" to 2012-07-27/panos/B61p0875_B61P1003-123 images/ and I watch in resource manager .cr2 files being read and written. This is with version 3.0.6 on windows 7 x64
Last edited by foundation on Sun Jul 07, 2013 6:46 am, edited 1 time in total.

no avatar
foundation
Member
 
Posts: 244
Joined: Mon Jan 15, 2007 4:43 am

Re: [Win 7 x64 APG 2.5.2] Extended save as question

by foundation » Tue Jan 14, 2014 8:34 pm

Any chance the team could check if Qfile::rename has been reverted to qt:copy in extended save as before releasing 3.5 beta? Thanks!

no avatar
foundation
Member
 
Posts: 244
Joined: Mon Jan 15, 2007 4:43 am

Re: [Win 7 x64 APG 2.5.2] Extended save as question

by foundation » Mon May 12, 2014 4:53 pm

Wondering if this is getting missed or is low priority because focus is on video?

User avatar
AlexandreJ
Kolor Team
 
Posts: 5917
Joined: Mon Nov 14, 2005 4:56 pm
Location: Francin, France

Re: [Win 7 x64 APG 2.5.2] Extended save as question

by AlexandreJ » Tue May 13, 2014 9:37 am

I opened a new Issue. 3509 Seems that we lost the first one.


Return to Autopano bug & discussion

Who is online

Users browsing this forum: No registered users and 1 guest