How to create or capture 360 images?

[YogeshHCR]

Hello there. I’m working on a project using the Insta360 X3 camera to capture images with the insta360_ros_driver. I have a few questions:

1. We are currently saving individual images (/front_camera_image/compressed, /back_camera_image/compressed) and trying to stitch them into a panorama using the MediaSDK. Since the header information is missing, the Media SDK is unable to create panoramas

5483 5483 I ExtraInfoAsset.cc:0263:  extrainfo asset Parse: iotool read header fail
5483 5483 E OffsetUtil.cc:0872:  merge offset v1v2v3 fail, offset v1 emtpy
5483 5483 I stitch_strategy.h:0071:

Is there a way to create panoramas using /front_camera_image/compressed, and the /back_camera_image/compressed
2. Is it possible to record panorama images directly from the camera (using the Camera SDK or the ROS driver)?

[Gaaaavin]

@YogeshHCR Thank you for your interest in out project!

1. We haven't tested with the MediaSDK as our project mostly uses the fisheye images. However, I think it's still possible to use the MediaSDK, if you first concatanate the two images and set up with correct parameters. Currently we don't have plan for this feature but any contribution is welcome! Moreover, we do have experience to stich the two fisheye images with ffmpeg. We are organizing the codebase and hopefully it will be made public soon.

2. As far as I know, it's not easy to get equirecutangular stream directly from the camera SDK.