krawler-awc
Job scraping METAR and TAF data from the Aviation Weather Center.
Overview
The krawler-awc jobs allow to scrape data using the api provided by the Aviation Weather Center.
The downloaded data are stored within a MongoDB database and more precisely in 3 collections:
awc-metarsthat stores the METAR dataawc-tafsthat stores the TAF dataawc-stationsthat stores the stations data
All records are stored in GeoJson format.
The job is executed according a specific cron expression. By default, every hours.
Implementation
As far as possible, jobs use the cache files.
Configuration
Stations
| Variable | Description |
|---|---|
DB_URL | The mongoDB database URL. The default value is mongodb://127.0.0.1:27017/awc |
DEBUG | Enables debug output. Set it to krawler* to enable full output. By default it is undefined. |
metars-tafs
| Variable | Description |
|---|---|
DATA | The type of weather dataset to process (metars, tafs). The default value is metars. |
DB_URL | The mongoDB database URL. The default value is mongodb://127.0.0.1:27017/awc |
TTL | The data time to live. It must be expressed in seconds and the default value is 2592000 (30 days) |
DEBUG | Enables debug output. Set it to krawler* to enable full output. By default it is undefined. |