You are not logged in.

> The forum rules have been updated. Please take a moment to read them.


#1 2012-06-01 06:29:21

inMotion
Member
From: Shanghai / Miami
Registered: 2012-04-05
Posts: 46
Website

Sky replacement for 11 gigapixel image

You may have seen my previous post about this specific pano already, but I want to explore the possibility of saving it, as the weather will be horrible for the foreseeable future and I am on a tight schedule.

I shot this gigapano without a rotating head and didn't know that I needed to have the images aligned in a set number of rows and colunms to make sure everything turned out right.

Full size is about 11 gigapixels. about 600 images didn't stitch correctly. Most of those are in the sky. Does anybody have any ideas or workflow of how to replace the sky? Can I assemble one or two columns of the sky and copy/paste it throughout the image on another layer and have APG blend it with the rest of the sky near the buildings?


Uploaded Images


http://vimeo.com/11328214  - My Silk Road Timelapse: Two Months Across Tibet, Xinjiang, Yunnan, and China

Offline

 

#2 2012-06-01 09:22:06

AlexandreJ
Kolor CEO
From: Francin, France
Registered: 2005-11-14
Posts: 7917
Website

Re: Sky replacement for 11 gigapixel image

Some questions :
- Did you shoot the sky or not ?
If yes, perhaps an xml approach with papywizard if you recorded the location would do the trick
If no, then it is complicated to adjust.
Note : if the shooting has a structure ( row x columns matrice for example ), then one idea is to check 'put all image in the panorama' flag in group property.
This will include in the panorama all image even the one that don't have any control point.
Then go to the move mode and try 'location wizard', icon with the wizard wand. It will try to guess all sky image location alone ( by guessing the shooting structure ). It does work not so badly in fact.

Offline

 

#3 2012-06-01 11:54:10

inMotion
Member
From: Shanghai / Miami
Registered: 2012-04-05
Posts: 46
Website

Re: Sky replacement for 11 gigapixel image

Thanks for the advice Alexandre.

When xml with papywizard did not work at all.

Using the move mode is extreeemly unresponsive. Is that normal for a 1600 image gigapan? I have a 4.4ghz 8 core cpu, 32gb ram, 2 SSDs, and 1gb GF GFX 560.

There are like 600 images that would need to be manually placed. The wizard tool didn't work at all. Is there a trick to using it successively? It would have been nice if a traditional "wizard" style dialog box would show up with some options regarding how to place the images.


http://vimeo.com/11328214  - My Silk Road Timelapse: Two Months Across Tibet, Xinjiang, Yunnan, and China

Offline

 

#4 2012-06-01 11:57:22

AlexandreJ
Kolor CEO
From: Francin, France
Registered: 2005-11-14
Posts: 7917
Website

Re: Sky replacement for 11 gigapixel image

inMotion wrote:

When xml with papywizard did not work at all.

Just for confirmation : you did shoot in XML mode ?

If yes, please have a look at that tutorial : http://www.autopano.net/wiki-en/action/ … zard_Cases

Offline

 

#5 2012-06-01 12:29:07

klausesser
Member
From: Düsseldorf, Germany
Registered: 2006-05-22
Posts: 6431
Website

Re: Sky replacement for 11 gigapixel image

AlexandreJ wrote:

inMotion wrote:

When xml with papywizard did not work at all.

Just for confirmation : you did shoot in XML mode ?

If yes, please have a look at that tutorial : http://www.autopano.net/wiki-en/action/ … zard_Cases

Hi Alexandre!

He wrote:
"I shot this gigapano without a rotating head and didn't know that I needed to have the images aligned in a set number of rows and colunms to make sure everything turned out right."
Whatever that could mean . . cool

So i think he didn´t use xml.

best, Klaus


If you want something you´ve never had,
then you´ve got to do something you´ve never done.

Online

 

#6 2012-06-01 12:29:45

inMotion
Member
From: Shanghai / Miami
Registered: 2012-04-05
Posts: 46
Website

Re: Sky replacement for 11 gigapixel image

No, i didn't shoot in XML mode. The panogear head was stuck in customs until 2 days ago, and the weather has been horrible - so i can't reshoot now. I shot manually each exposure myself, which is also why there is an inconsistent number of images per row.


http://vimeo.com/11328214  - My Silk Road Timelapse: Two Months Across Tibet, Xinjiang, Yunnan, and China

Offline

 

#7 2012-06-01 12:40:30

klausesser
Member
From: Düsseldorf, Germany
Registered: 2006-05-22
Posts: 6431
Website

Re: Sky replacement for 11 gigapixel image

inMotion wrote:

You may have seen my previous post about this specific pano already, but I want to explore the possibility of saving it, as the weather will be horrible for the foreseeable future and I am on a tight schedule.

I shot this gigapano without a rotating head and didn't know that I needed to have the images aligned in a set number of rows and colunms to make sure everything turned out right.

Full size is about 11 gigapixels. about 600 images didn't stitch correctly. Most of those are in the sky. Does anybody have any ideas or workflow of how to replace the sky? Can I assemble one or two columns of the sky and copy/paste it throughout the image on another layer and have APG blend it with the rest of the sky near the buildings?

As Alexandre already mentioned: Did you use the option "all images in the same panorama" and the wizard?

If nothing works out stitch-wise: try Photoshop. It´s rather complicated, but you might be able to make a selection of the sky-part beginning at the buildings and to fake the sky by using some picture/pano you shoot sperately.
I did that several times and i worked well - you "just" need to mask-out the part very precisely because of the very large scaling.

Use a sky-image which looks like the sky in your pano colorwise - it´s easier to mask-out the buildings then. Use a feathered selection with 1px - not wider. It gives smoother edges than a sharp selection using 0pix.

If you want i can assist you by mail. Photoshop definitely can do it - but as said needs some skills.

best, Klaus

Last edited by klausesser (2012-06-01 12:41:52)


If you want something you´ve never had,
then you´ve got to do something you´ve never done.

Online

 

#8 2012-06-01 13:34:45

[bo]
community overseer
From: Bulgaria
Registered: 2006-05-05
Posts: 1839

Re: Sky replacement for 11 gigapixel image

Don't know about the sky, but the ground is disturbingly overshapened and overhdred... Also, I think this is the first time I've seen someone on those forums shoot thousands of images by hand (ie without some robo-help)! Amazing patience!


Some of my panoramas, posted in the Autopano Pro flickr group.

Offline

 

#9 2012-06-01 13:56:43

inMotion
Member
From: Shanghai / Miami
Registered: 2012-04-05
Posts: 46
Website

Re: Sky replacement for 11 gigapixel image

yeah, over sharpened and overHDRed is correct, and in this case, intentional.

after we shot these images, we were exhausted. we took turns, each person did a row. a row took around 10-15 min to shoot.


http://vimeo.com/11328214  - My Silk Road Timelapse: Two Months Across Tibet, Xinjiang, Yunnan, and China

Offline

 

#10 2012-06-01 14:32:30

mediavets
Moderator
From: Isleham, Cambridgeshire, UK.
Registered: 2007-11-14
Posts: 9730
Website

Re: Sky replacement for 11 gigapixel image

inMotion wrote:

No, i didn't shoot in XML mode. The panogear head was stuck in customs until 2 days ago, and the weather has been horrible - so i can't reshoot now. I shot manually each exposure myself, which is also why there is an inconsistent number of images per row.

How about duplicating some sky images so that there are the same number of images per row, renaming the image series as necessary so that the filenames are sequential, and then applying a Papywizard generated XML data file?


Andrew Stephens
Nikon D40, Nikkor 10.5mm fisheye, Sigma 8mm f3.5 fisheye, Nikkor 18-55/50/35mm lenses, Nodal Ninja 5 Lite, Nodal Ninja 4 with R-D16, Agno's MrotatorTCS short.
Nikon P5100, CP5000, CP995, FC-E8, WC-E63,WC-E68, TC-E2, Kaidan Kiwi 995, Bophoto pano bracket, Agno's MrotatorA.
Merlin/Orion robotic pano head + Papywizard on Nokia 770/N800/N810 and Windows 8/XP/2K.

Offline

 

#11 2012-06-01 14:48:24

klausesser
Member
From: Düsseldorf, Germany
Registered: 2006-05-22
Posts: 6431
Website

Re: Sky replacement for 11 gigapixel image

[bo] wrote:

Also, I think this is the first time I've seen someone on those forums shoot thousands of images by hand (ie without some robo-help)! Amazing patience!

Julian Kalmar shot his amazing Vienna 50gigapixel using a manual head:

http://photoartkalmar.com/Photoart%20Ka … uturm.html

best, Klaus


If you want something you´ve never had,
then you´ve got to do something you´ve never done.

Online

 

#12 2012-06-01 18:21:35

AlexandreJ
Kolor CEO
From: Francin, France
Registered: 2005-11-14
Posts: 7917
Website

Re: Sky replacement for 11 gigapixel image

Note : our Paris 26 gigapixels project with 2346 images were stitch manually too with the described workflow.
- 1600 images well located, some adjustment on wrong CPs
- using this wizard, a lot of image were then well located
- then the image move mode to adjust all out-of-focus images in rows by using multiple selection

Offline

 

#13 2012-06-01 23:57:16

lumelix
Member
From: Basel Switzerland
Registered: 2010-10-25
Posts: 405

Re: Sky replacement for 11 gigapixel image

@ bo: I shoot some panos with more than 1400 images manualy in 2010. I use my Arca-Head with a special scale on it for a more or less regular overlap
and move the camera with 600mm tele manually. Did this in less than one hour, faster than most motorized pano heads. But it's really a ordeal!

I think, inMotion haven 't do his pano this way and haven't the possibility I have told him, using the Gigapan Import Wizard.

@ inMotion: You can clone the sky upwards to the edge of the pano, using several image editors (eg. Photoshop).
But the problem is the size of this image. It's to big to work on it in one piece for most applications. So you have to cut it into subparts (-> NQ).


Regards
Martin

Offline

 

#14 2012-06-02 00:30:46

leifs
Member
From: Ørsta Norway
Registered: 2009-09-06
Posts: 464
Website

Re: Sky replacement for 11 gigapixel image

klausesser wrote:

Julian Kalmar shot his amazing Vienna 50gigapixel using a manual head:

http://photoartkalmar.com/Photoart%20Ka … uturm.html

best, Klaus

The pano is nice, and it would be even better without the vignetting-bands in the sky.

leifs


Olympus OM-D E-M5, Panasonic 8mm f3.5 fisheye, Olympus 12mm f2.0, Leica 25mm f1.4, Zeiss 50mm f1.4, Canon FD 85mm f1.8, Canon 100-400mm f/4.5-5.6 L
Seitz VRdrive2
Intel i7 980X, 48GB RAM, Win7 64bit, SSD RAIDs

Offline

 

#15 2012-06-02 10:12:36

inMotion
Member
From: Shanghai / Miami
Registered: 2012-04-05
Posts: 46
Website

Re: Sky replacement for 11 gigapixel image

first sky attempt. it's only at 3 gigapixels unfortunately. it's still saving in PS, so this is just a printscreen from PS. will update with higher res soon.

the weather might be nice tomorrow though!!


Uploaded Images


http://vimeo.com/11328214  - My Silk Road Timelapse: Two Months Across Tibet, Xinjiang, Yunnan, and China

Offline

 

#16 2012-06-02 15:39:51

John_Sauter
Member
From: New Hampshire, USA
Registered: 2007-07-28
Posts: 220
Website

Re: Sky replacement for 11 gigapixel image

I posted a sky synthesizer in 2008: see http://www.kolor.com/forum/t4515-synthesizing-the-sky.  With some effort it could create an artificial sky for you.

Last edited by John_Sauter (2012-06-02 15:43:48)

Offline

 

#17 2012-06-02 17:12:13

klausesser
Member
From: Düsseldorf, Germany
Registered: 2006-05-22
Posts: 6431
Website

Re: Sky replacement for 11 gigapixel image

inMotion wrote:

first sky attempt. it's only at 3 gigapixels unfortunately. it's still saving in PS, so this is just a printscreen from PS. will update with higher res soon.

the weather might be nice tomorrow though!!

Yep! Well done! :-)

best, Klaus (will be back home tonight for skyping)


If you want something you´ve never had,
then you´ve got to do something you´ve never done.

Online

 

#18 2012-06-02 19:19:22

inMotion
Member
From: Shanghai / Miami
Registered: 2012-04-05
Posts: 46
Website

Re: Sky replacement for 11 gigapixel image

John_Sauter wrote:

I posted a sky synthesizer in 2008: see http://www.kolor.com/forum/t4515-synthesizing-the-sky.  With some effort it could create an artificial sky for you.

wow, very cool! thanks! do you have any panos you could show that you've used that for??

here is a 5k preview of the pano. going to shoot again in 7 hours!


Uploaded Images


http://vimeo.com/11328214  - My Silk Road Timelapse: Two Months Across Tibet, Xinjiang, Yunnan, and China

Offline

 

#19 2012-06-03 16:05:45

John_Sauter
Member
From: New Hampshire, USA
Registered: 2007-07-28
Posts: 220
Website

Re: Sky replacement for 11 gigapixel image

inMotion wrote:

wow, very cool! thanks! do you have any panos you could show that you've used that for??

Sorry, I don't.  I wrote the program after having to create a sky by hand for a pano I made of Yankee Stadium, but I have not had an opportunity to actually use it.

Offline

 

#20 2012-06-03 18:15:13

lumelix
Member
From: Basel Switzerland
Registered: 2010-10-25
Posts: 405

Re: Sky replacement for 11 gigapixel image

Hi inMotion
The pano looks very nice! How have you filled in the sky in this version ?


Regards
Martin

Offline

 

#21 2012-06-03 19:48:14

inMotion
Member
From: Shanghai / Miami
Registered: 2012-04-05
Posts: 46
Website

Re: Sky replacement for 11 gigapixel image

lumelix wrote:

Hi inMotion
The pano looks very nice! How have you filled in the sky in this version ?

The image resolution was 3 gigapixel, so i just opened it in photoshop, and used the magic wand selection tool to delete the old sky used some gradients. fairly simple, just really time consuming due to the resolution. (around 180,000 x 30,000 i think) every operation took quite a while. i tried several techniques, the gradient worked the best and matched the low resolution reference pano i took at 100mm after i took the 400mm. i think this is a good thing to do on all shoots. takes 5 min and can save a lot of time.

also, John_Sauter - I have noooooo idea how to use your script. sad can you give me the basic run-down?


http://vimeo.com/11328214  - My Silk Road Timelapse: Two Months Across Tibet, Xinjiang, Yunnan, and China

Offline

 

#22 2012-06-03 21:42:28

lumelix
Member
From: Basel Switzerland
Registered: 2010-10-25
Posts: 405

Re: Sky replacement for 11 gigapixel image

Yes, it's a good idea. It looks really natural this way.
But when you use the XML-placement, the images in the sky shold work to.


Regards
Martin

Offline

 

#23 2012-06-03 23:41:02

gkaefer
Member
From: Salzburg
Registered: 2009-06-09
Posts: 2678
Website

Re: Sky replacement for 11 gigapixel image

and on commercial side there are also some solutions, like:
http://www.pixxsel.de/fotosoftware/bild … ffects-3.0
to simulate Rain, snow, Sun, Moon and Stars, Water and Waves, lightning, Clouds, fog, haze, light to heavy cloud, Ice, ice and frost, Fire.
if you combine it with the photo zoom 4 from same page gigapixel backgrounds are no big deal...

Georg

Offline

 

#24 2012-06-04 17:31:41

John_Sauter
Member
From: New Hampshire, USA
Registered: 2007-07-28
Posts: 220
Website

Re: Sky replacement for 11 gigapixel image

inMotion wrote:

also, John_Sauter - I have noooooo idea how to use your script. sad can you give me the basic run-down?

You will need to install Perl on your computer, and the Perl modules GD and Math:Random.  See http://www.perl.org/get.html to get Perl if it doesn't come with your operating system, and http://www.perl.org/cpan.html for the modules.

Download the texture_gradient program referenced in http://www.kolor.com/forum/t4515-synthesizing-the-sky and run it, specifying the height, width and output file: "perl texture_gradient --width 3000 --height 30000 --verbose big_sky.png".

Unfortunately, the GD package won't handle large PNG files, so you have to truncate the width to 3000; you can use The Gimp or Adobe Photoshop to tile the image horizontally to increase the width to 180,000.

The last step is similar to what you've already done with your gradient: load the tiled big_sky image behind yours, and erase everything in your picture that should be sky.  The texture_gradient program creates a sky gradient that is more realistic than the standard image manipulation gradient tools provide.  It also has an advanced mode in which you can use whatever scraps of sky you have in your picture to tailor its statistics--see the documentation for --picture_dir.

I edited this response to recognize the limitations of the GD package.  I really should recode the program in C so it can write large PNG files.

Last edited by John_Sauter (2012-06-05 05:54:23)

Offline

 

#25 2012-06-08 06:23:46

gerardm
Member
From: nyc
Registered: 2006-08-29
Posts: 133
Website

Re: Sky replacement for 11 gigapixel image

Thanks this is a great post. John Please clean it up so we all can use it.   These helpful additions keep moving everything  forward.

Offline

 

Board footer

Powered by PunBB
© Copyright 2002–2005 Rickard Andersson