| ... | ... | @@ -4,7 +4,7 @@ Activate your Python environment with `mamba activate LC`. |
|
|
|
|
|
|
|
### Using `w2alg`
|
|
|
|
|
|
|
|
You can now run the program, `src/predict_ltg.py`. Do `python predict_ltg.py -h` to see the help options. Typically, realtime processing is started and stopped using the `w2alg` utility, which should be in your `$PATH`. You can modify `src/realtime/w2algrun/w2alg.conf` to make changes to processes started and stopped by `w2alg`.
|
|
|
|
You can now run the program, `lightningcast/predict_ltg.py`. Do `python predict_ltg.py -h` to see the help options. Typically, realtime processing is started and stopped using the `w2alg` utility, which should be in your `$PATH`. You can modify `lightningcast/realtime/w2algrun/w2alg.conf` to make changes to processes started and stopped by `w2alg`.
|
|
|
|
|
|
|
|
In `w2alg.conf`, you will need to manually change the `MACHINE`, the "macros" (e.g., `M1`, `M2`), and the `LOG_DIR`. If you are using the default GOES-East and GOES-West models, `M3`\-`M6` don't need to be changed. You can also make changes to the commands themselves in `w2alg.conf`.
|
|
|
|
|
| ... | ... | @@ -17,7 +17,7 @@ group GLOBAL |
|
|
|
# each group or even manager if you want
|
|
|
|
set MACHINE "skynet.ssec.wisc.edu"
|
|
|
|
|
|
|
|
set M1 "/home/jcintineo/lightningcast/src/"
|
|
|
|
set M1 "/home/jcintineo/lightningcast/lightningcast/"
|
|
|
|
set M2 "/data/PLTG/"
|
|
|
|
set M3 "static/"
|
|
|
|
set M4 "fit_conv_model.h5"
|
| ... | ... | @@ -51,7 +51,7 @@ Thus, `~]$ w2alg start main clean` will begin `cleanup.py`, and `~]$ w2alg stop |
|
|
|
|
|
|
|
### Using `amqpfind`
|
|
|
|
|
|
|
|
`amqpfind` uses [RabbitMQ](https://www.rabbitmq.com/) messaging to receive notifications. This is the best way to receive file notifications (i.e., a new GOES-R file was written) at SSEC. Outside of SSEC, some other notification mechanism may be necessary. The files in `src/amqpfind/` were obtained from Ray Garcia's `flaregun` repository.
|
|
|
|
`amqpfind` uses [RabbitMQ](https://www.rabbitmq.com/) messaging to receive notifications. This is the best way to receive file notifications (i.e., a new GOES-R file was written) at SSEC. Outside of SSEC, some other notification mechanism may be necessary. The files in `lightningcast/amqpfind/` were obtained from Ray Garcia's `flaregun` repository.
|
|
|
|
|
|
|
|
- To start for GOES-East: `~]$ w2alg start ge amq`
|
|
|
|
- To stop for GOES-East: `~]$ w2alg stop ge amq`
|
| ... | ... | @@ -75,7 +75,7 @@ manager PROCESS-CONUS |
|
|
|
* The `PROCESS_EXE` (process executable) is just `python`. You should make sure your `TF` environment is activated.
|
|
|
|
* `$M1/predict_ltg.py`: the program it is excecuting.
|
|
|
|
* `$M2/logs/GE-AMQ-A1.log`: the log file that gets generated when you do `w2alg start ge amq`. This file gets modified when new GOES data are finished writing to a disk. So this is the file that `predict_ltg.py` "listens" to.
|
|
|
|
* `$M1/$M3/$M4`: the CNN model file. Expanded out, it might look like this: `/home/jcintineo/lightningcast/src/static/fit_conv_model.h5`. Note that GOES-17 model is in `static/GOES-West/`. GOES-18 can use `static/fit_conv_model.h5`.
|
|
|
|
* `$M1/$M3/$M4`: the CNN model file. Expanded out, it might look like this: `/home/jcintineo/lightningcast/lightningcast/static/fit_conv_model.h5`. Note that GOES-17 model is in `static/GOES-West/`. GOES-18 can use `static/fit_conv_model.h5`.
|
|
|
|
* `-o $M2/products` The output directory. In realtime, we can write netCDF and/or GeoJSON files.
|
|
|
|
* `-sec RadC`: The sector. Default is `RadC`.
|
|
|
|
* `-r`: a flag to run in realtime mode.
|
| ... | ... | |
| ... | ... | |