Create a 360° video

[CriusT]

Hi. I am wondering whether your framework is able to create a 360° "surround" effect. For example, can I take pictures of a soda can from different angles as I walk around it and render a video using these pictures. I have tried so and I found that there would be a big black shadow on the edge of the video at the beginning and ending And it still looks like on a single plane. I want to know why that happens and if there is anyway I can fix this. If not, I am wondering what features of your framework hinder me to do so, that is to say, the reason why the pictures must be taken at a single plane.

[bmild]

You'll have to change the code that generates the new view rendering path, since the current options all assume roughly planar capture. I wrote some pointers on the relevant code in this issue. To do a 360 degree path, you'd want to pick a central viewing point (probably the centroid of your pose positions), an "up" vector, and a radius, and generate a circle of camera matrices all pointing inward toward that viewing point. The rendering code should have no problem generalizing to this type of path given sufficient density of input views.

[CriusT]

OK, I will try that. Thanks for your answer! Moreover, when I was trying to do a 360 degree rendering, there may be some pictures that cannot be registered by colmap. In the colmap_output, some records that 'could not register. see another image' while some pictures haven't been seen for once. I suppose this is because the similarities between pictures from 360 degree are too limited. Is there a way to solve this?