Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

missing VIIRS data #34

Open
nbennasr opened this issue Mar 27, 2025 · 1 comment
Open

missing VIIRS data #34

nbennasr opened this issue Mar 27, 2025 · 1 comment
Assignees

Comments

@nbennasr
Copy link
Collaborator

nbennasr commented Mar 27, 2025

@MarcYin Could you please fix the following error
FYI pipeline is executed on:
'c6ca7420-1ddb-4ebb-8478-b19a5aa9205e': 'S2B_MSIL1C_20250226T100909_N0511_R022_T32TNR_20250226T120532'

2025-03-27 13:50:30,441 - SIAC-V2.3.6 - INFO - Preprocessing for S2B_MSIL1C_20250226T100909_N0511_R022_T32TNR_20250226T120532.SAFE
2025-03-27 13:50:30,441 - SIAC-V2.3.6 - INFO - Doing per pixel angle resampling.
2025-03-27 13:51:19,378 - SIAC-V2.3.6 - INFO - Getting cloud mask.
2025-03-27 13:51:31,084 - SIAC-V2.3.6 - INFO - Valid pixel percentage: 100.00
2025-03-27 13:51:31,084 - SIAC-V2.3.6 - INFO - Clean pixel percentage: 0.08
2025-03-27 13:51:41,823 - SIAC-V2.3.6 - INFO - Starting atmospheric corretion for S2B_MSIL1C_20250226T100909_N0511_R022_T32TNR_20250226T120532.SAFE
2025-03-27 13:51:41,823 - SIAC-V2.3.6 - INFO - VIIRS BRDF product is chosen
2025-03-27 13:51:41,823 - SIAC-V2.3.6 - INFO - Getting VNP43MA1 from NASA server
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): cmr.earthdata.nasa.gov:443
2025-03-27 13:51:41,859 DEBUG : Starting new HTTPS connection (1): cmr.earthdata.nasa.gov:443
DEBUG:urllib3.connectionpool:https://cmr.earthdata.nasa.gov:443 "GET /search/granules.json?short_name%09=VNP43MA1&temporal=2025-02-10T00%3A00%3A00Z%2C2025-03-14T00%3A00%3A00Z&page_size=2000
&provider=LPDAAC_ECS&version=001&polygon=10.394253870982087%2C45.05674859259375%2C10.418904144346577%2C46.044766226368196%2C8.999741460261882%2C46.05357436948499%2C8.999745953598584%2C45.06
5259994009416%2C10.394253870982087%2C45.05674859259375 HTTP/1.1" 200 None
2025-03-27 13:51:42,236 DEBUG : https://cmr.earthdata.nasa.gov:443 "GET /search/granules.json?short_name%09=VNP43MA1&temporal=2025-02-10T00%3A00%3A00Z%2C2025-03-14T00%3A00%3A00Z&page_size=2
000&provider=LPDAAC_ECS&version=001&polygon=10.394253870982087%2C45.05674859259375%2C10.418904144346577%2C46.044766226368196%2C8.999741460261882%2C46.05357436948499%2C8.999745953598584%2C45
.065259994009416%2C10.394253870982087%2C45.05674859259375 HTTP/1.1" 200 None
2025-03-27 13:51:42,237 - SIAC-V2.3.6 - INFO - filenames: []
2025-03-27 13:51:42,358 - SIAC-V2.3.6 - INFO - Set AOI.
2025-03-27 13:51:42,623 - SIAC-V2.3.6 - WARNING - AOI is not created and full band extend is used
2025-03-27 13:51:42,693 - SIAC-V2.3.6 - INFO - Get corresponding bands.
2025-03-27 13:51:42,693 - SIAC-V2.3.6 - INFO - Slice TOA bands based on AOI.
2025-03-27 13:51:47,382 - SIAC-V2.3.6 - INFO - Parsing angles.
2025-03-27 13:51:48,896 - SIAC-V2.3.6 - INFO - Mask bad pixeles.
2025-03-27 13:52:23,215 - SIAC-V2.3.6 - INFO - Get simulated BOA.
2025-03-27 13:52:23,216 - SIAC-V2.3.6 - INFO - Reading BRDF weighting parameters files.
ERROR:root:An exception occured during the execution of the pipeline
Traceback (most recent call last):
File "/opt/s2gm/siac/src/siac_pipeline.py", line 162, in siac_pipeline
SIAC_S2(
File "/opt/s2gm/modules/SIAC/SIAC/SIAC_S2.py", line 49, in SIAC_S2
aero_atmo = do_correction(ret)
File "/opt/s2gm/modules/SIAC/SIAC/SIAC_S2.py", line 224, in do_correction
example_file = aero._solving(cloud_mask)
File "/opt/s2gm/modules/SIAC/SIAC/the_aerosol.py", line 1216, in _solving
boa, boa_unc, hx, hy = self._get_boa(example_file, bad_pix)
File "/opt/s2gm/modules/SIAC/SIAC/the_aerosol.py", line 722, in _get_boa
das, ws, mg = read_VNP43MA1(self.VNP43_fnames_dates, bands, outputBounds, self.aero_res
0.5, self.aero_res*0.5, dstSRS, self.logger)
File "/opt/s2gm/modules/SIAC/SIAC/read_VNP43MA1.py", line 240, in read_VNP43MA1
geotransform = ret[0][2]
IndexError: list index out of range

@MarcYin MarcYin self-assigned this Mar 28, 2025
@MarcYin
Copy link
Owner

MarcYin commented Mar 31, 2025

Hi,

This is due to the fact that VIIRS BRDF product is only available till 2025-01-31, check: https://e4ftl01.cr.usgs.gov/VIIRS/VNP43MA1.001/

Maybe need to add a notification when there is not VIIRS data available rather than trigger an error, over here:
2025-03-27 13:51:42,237 - SIAC-V2.3.6 - INFO - filenames: []

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants