AIT_FW_Quicklooks issueshttps://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/-/issues2024-03-26T15:09:10Zhttps://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/-/issues/48Create quicklooks for new FW Himawari output2024-03-26T15:09:10ZEva SchifferCreate quicklooks for new FW Himawari outputNow that the FW is going to be able to process some kinds of Himawari data, we will need to be able to create quicklooks for that data. These quicklooks should be similar to the correlating ABI ones.
The products that are being added i...Now that the FW is going to be able to process some kinds of Himawari data, we will need to be able to create quicklooks for that data. These quicklooks should be similar to the correlating ABI ones.
The products that are being added include the cloud masks, some of the other cloud products (height, temperature, pressure), and winds data. This ticket will need to wait until the products are being appropriately converted to a PUG-like format by FW2PUG.Eva SchifferEva Schifferhttps://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/-/issues/44Add option to plot "no-data" plots on a map2023-08-29T16:56:40ZEva SchifferAdd option to plot "no-data" plots on a mapAdd a user configurable option that changes the "no-data" plots to show an empty map instead of the red no data message. By default the software would still show the red no data message plot unless the user actively asks for an empty map...Add a user configurable option that changes the "no-data" plots to show an empty map instead of the red no data message. By default the software would still show the red no data message plot unless the user actively asks for an empty mapped plot.
Note, in the case of winds, making this change will require first fixing how the domain is specified (issue #43) in order to get the correct plot range without any data in it.CSPP Geo AITF 2.1 ProductionJessica BraunJessica Braunhttps://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/-/issues/43When winds don't fill the whole domain, specify the domain range to show so t...2023-08-29T20:01:51ZEva SchifferWhen winds don't fill the whole domain, specify the domain range to show so the image isn't clippedSometimes when your data only fills part of the range, the image will be clipped (because cartopy is currently auto generating the range based on the lon/lat info it's given).
Investigate how difficult it will be to specify the domain ...Sometimes when your data only fills part of the range, the image will be clipped (because cartopy is currently auto generating the range based on the lon/lat info it's given).
Investigate how difficult it will be to specify the domain explicitly so we're plotting the full range expected for that type (full disk, CONUS, meso).CSPP Geo AITF 2.1 ProductionJessica BraunJessica Braunhttps://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/-/issues/41Exception on M2 scenes partially off-disk (G18 GND-008 test with Alaska MESO)2023-08-08T19:45:08ZRay GarciaException on M2 scenes partially off-disk (G18 GND-008 test with Alaska MESO)A test case for this is available as
`espresso:/data/users/rayg/Workspace/crashing-ql-g18-m2-gnd008/go.sh`
Douglas S. noted that the aitf-ql was crashing on at least some M2 scenes from GND-008 test case. Example traceback:
```
Traceb...A test case for this is available as
`espresso:/data/users/rayg/Workspace/crashing-ql-g18-m2-gnd008/go.sh`
Douglas S. noted that the aitf-ql was crashing on at least some M2 scenes from GND-008 test case. Example traceback:
```
Traceback (most recent call last):
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/python/ql/aitf_ql.py", line 925, in <module>
2022-07-07 19:23:01.593 (INFO) : -------------------------------------
sys.exit(main())
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/python/ql/aitf_ql.py", line 788, in main
_plot_winds(temp_path, version_msg, comment_msg, dpi_to_use, inch_dims,
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/python/ql/aitf_ql.py", line 703, in _plot_winds
figure_temp.savefig(os.path.join(output_path, output_file_prefix + os.path.basename(input_file_path)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/figure.py", line 3005, in savefig
self.canvas.print_figure(fname, **kwargs)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/backend_bases.py", line 2255, in print_figure
2022-07-07 19:23:01.594 (INFO) : Plotting quicklooks for file: /data/users/rayg/Workspace/gnd-008-transition/output/output/CG_ABI-L2-CMIPM2-M6C06_G18_s20221651728550_e20221651729013_c20221820748343.nc
result = print_method(
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/backend_bases.py", line 1669, in wrapper
return func(*args, **kwargs)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/backends/backend_agg.py", line 508, in print_png
FigureCanvasAgg.draw(self)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/backends/backend_agg.py", line 406, in draw
self.figure.draw(self.renderer)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/artist.py", line 74, in draw_wrapper
result = draw(artist, renderer, *args, **kwargs)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/artist.py", line 51, in draw_wrapper
return draw(artist, renderer, *args, **kwargs)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/figure.py", line 2780, in draw
2022-07-07 19:23:01.600 (INFO) : -------------------------------------
mimage._draw_list_compositing_images(
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/image.py", line 132, in _draw_list_compositing_images
a.draw(renderer)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/matplotlib/artist.py", line 51, in draw_wrapper
return draw(artist, renderer, *args, **kwargs)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/cartopy/mpl/geoaxes.py", line 465, in draw
gl._draw_gridliner(renderer=renderer)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/cartopy/mpl/gridliner.py", line 515, in _draw_gridliner
line = sgeom.LineString(line)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/shapely/geometry/linestring.py", line 48, in __init__
self._set_coords(coordinates)
File "/home/rayg/opt/cspp-geo-aitf-2.1beta1/lib/ShellB3/lib/python3.8/site-packages/shapely/geometry/linestring.py", line 97, in _set_coords
ret = geos_linestring_from_py(coordinates)
File "shapely/speedups/_speedups.pyx", line 92, in shapely.speedups._speedups.geos_linestring_from_py
ValueError: LineStrings must have at least 2 coordinate tuples
```
Our hypothesis is that this is grid lines and/or political boundaries having issue when the Meso scene is overlapping the limb. The plots succeed when the unnavigated flag is used.Eva SchifferEva Schifferhttps://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/-/issues/40v2beta4 winds quicklooks feedback2022-06-29T16:00:07ZGraeme Martinv2beta4 winds quicklooks feedbackFeedback on the winds quicklooks can be added to comments, but starting this off with a couple of questions.
1) Why are the arrows generally longer in the Clear Sky quicklooks compared to the Cloudy?
For example:
![CG_ABI-L2-DMWVC-M6C0...Feedback on the winds quicklooks can be added to comments, but starting this off with a couple of questions.
1) Why are the arrows generally longer in the Clear Sky quicklooks compared to the Cloudy?
For example:
![CG_ABI-L2-DMWVC-M6C08_G16_s20210600046152_e20210600048536_c20220082229370.nc.WINDS](/uploads/61e4bbe98caf60270e4dc8ceef7e3fef/CG_ABI-L2-DMWVC-M6C08_G16_s20210600046152_e20210600048536_c20220082229370.nc.WINDS.png)
![CG_ABI-L2-DMWC-M6C08_G16_s20210600046152_e20210600048536_c20220082203380.nc.WINDS](/uploads/9b4e4027cd112da86a004b62a232050f/CG_ABI-L2-DMWC-M6C08_G16_s20210600046152_e20210600048536_c20220082203380.nc.WINDS.png)
My assumption was that arrow length represents wind speed, but Panoply shows similar ranges of wind speeds in the two products, and with generally lower speeds in the Clear Sky:
![image](/uploads/4c1d69b665de29f5aa98961471dfe632/image.png)
![image](/uploads/1d85e6d233fd8ac238727d440027c497/image.png)
2) Are the arrow directions aligned to the projection or the plot? For example, would a vector pointing due north be a vertical line on the plot, or would it be aligned to the longitude lines? This becomes important where the longitude lines are less vertical.CSPP Geo AITF 2.1 BetaEva SchifferEva Schifferhttps://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/-/issues/35Label our gridlines now that cartopy can do that2023-06-01T15:14:22ZEva SchifferLabel our gridlines now that cartopy can do thatIt sounds like the new cartopy can label gridlines on arbitrary projections!
https://github.com/SciTools/cartopy/releases/tag/v0.18.0
I should fix our code to take advantage of that new functionality.It sounds like the new cartopy can label gridlines on arbitrary projections!
https://github.com/SciTools/cartopy/releases/tag/v0.18.0
I should fix our code to take advantage of that new functionality.Eva SchifferEva Schifferhttps://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/-/issues/16Future QL revisions2023-08-08T15:01:03ZEva SchifferFuture QL revisionsThis is stuff left over from https://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/issues/10 that we didn't need to do until after the beta is out.
Follow up from the meeting :
* [ ] Look at the ranges that Andy is using for various...This is stuff left over from https://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/issues/10 that we didn't need to do until after the beta is out.
Follow up from the meeting :
* [ ] Look at the ranges that Andy is using for various things and correct the ones I have, specifically the CTH ranges are intended to correlate with high/middle/low clouds by the color groups (my shifted ranges screwed this up some). (Get ranges from Andy so I can evaluate this.)
Here are some things we will probably want to do in the future, but we likely don't have time for the 1.0 release:
* [ ] Find out what the AWIPS colormap/range defaults are for these products and make that a command line option.
* [x] If matplotlib ever fixes the issue with extend and the PowerNorm ( https://github.com/matplotlib/matplotlib/issues/11486 ) remove my code that is avoiding that case.Eva SchifferEva Schifferhttps://gitlab.ssec.wisc.edu/cspp_geo/AIT_FW_Quicklooks/-/issues/13Add the option to have just a full resolution plot with no colorbar or labels2023-08-08T14:58:40ZEva SchifferAdd the option to have just a full resolution plot with no colorbar or labelsHave a command line option to make an image of the data at full resolution where one pixel = one pixel and there is no colorbar or other added labeling.
I should check with Dave before I do this to see if he's already made a tool to do...Have a command line option to make an image of the data at full resolution where one pixel = one pixel and there is no colorbar or other added labeling.
I should check with Dave before I do this to see if he's already made a tool to do so.
This was originally discussed in a separate ticket for the GRB quicklooks:
https://gitlab.ssec.wisc.edu/cspp_geo/cspp-geo-grb-catch-all/issues/41CSPP Geo GRB 1.1