|
derive_year_sheet_ind()
|
Determine Sheet Prefix for Firepred Data Dictionary |
|
dl_extract_file()
|
Download file from specified url into specified path. If the directory
of the destination path is not specified then the function will create the
directory. Also gives the user the option to extract the contents of the
downloaded file |
|
format_transform_mtbs()
|
Format Specific MTBS Shapefile |
|
fpa_data_download()
|
Download data for FPA data |
|
fpa_extract()
|
Wrapper for FPA data extraction pipeline.
This function will setup global variables, gather information and urls on
data and metadata and download the data. |
|
fpa_metadata()
|
Download full data and metadata information for FPA data |
|
fpa_read_data()
|
Extracting information on the download URLs for FPA data |
|
fpa_setup_variables()
|
Setup the global variables for FPA data |
|
fpa_transform()
|
Wrapper for FPA FOD transformation pipeline. |
|
gen_query_fire_base_full_feat_180d()
|
Generate all fire features joined in the mtbs table for modeling the ground
process and fire size. This joins all of the lagged aggregated time summaries
mapped to individual MTBS fires by specified spatial degrees over a 180 day
lag period for each fire |
|
gen_query_fire_base_full_feat_tform_180d()
|
Generate all the transformed fire features joined in the mtbs table for
modeling the ground process and fire size. This joins all of the lagged
aggregated time summaries mapped to individual MTBS fires by specified
spatial degrees over a 180 day lag period for each fire. |
|
gen_query_fire_base_ghcnd_sfeat_180d()
|
Generate single feature GHCN-D lagged aggregated time summaries mapped to
individual MTBS fires by specified spatial degrees over a 180 day lag period
for each fire |
|
gen_query_fire_base_swdi_sfeat_180d()
|
Generate single feature NOAA SWDI lagged aggregated time summaries mapped to
individual MTBS fires by specified spatial degrees over a 180 day lag period
for each fire |
|
gen_query_ghcn_base_sfeat()
|
Generate SQL code for separate indexed NOAA GHCN tables for each feature
e.g. PRCP for precipitation |
|
geomac_data_download()
|
Download data for geomac data |
|
geomac_extract()
|
Wrapper for GEOMAC data extraction pipeline.
This function will setup global variables, gather information and urls on
data and metadata and download the data. |
|
geomac_format_shapefiles()
|
Format GEOMAC shapefiles given path |
|
geomac_metadata()
|
Download full data and metadata information for GEOMAC data |
|
geomac_read_data()
|
Extracting information on the metadata for GEOMAC data |
|
geomac_setup_variables()
|
Setup the global variables for GEOMAC data |
|
geomac_transform()
|
Full Pipeline for Transforming GEOMAC Shapefiles |
|
get_common_cols()
|
Gets the intersection or union of columns in a list of dataframes
This is used in the geomac and mtbs load code |
|
get_ddict()
|
Get data dictionary names from single Excel sheet |
|
get_ddict_geomac()
|
Get data dictionaries for column names given .xlxs file |
|
get_ddict_noaa_stormevents()
|
Get data dictionaries for column names given .xlxs file |
|
get_fpa_mtda_paths()
|
Provides a helper dataframe to list all of the extracted FPA FOD files |
|
get_geomac_mtda_paths()
|
Provides a helper dataframe to list all of the files extracted for geomac
for a specified year of download |
|
get_geomac_new_cnames()
|
Set Shapefile column names given dictionary names fetched from .xlsx
data dictionary file. |
|
get_ghcn_mtda_paths()
|
Provides a helper dataframe to list all of the files extracted for GHCN
for a specified year of download |
|
get_ghcn_stations_us_unq()
|
Get the unique United States station from our ghcn stations table |
|
get_mtbs_mtda_paths()
|
Provides a helper dataframe to list all of the files extracted for MTBS
for a specified year of download |
|
get_noaa_stormevents_mtda_paths()
|
Provides a helper dataframe to list all of the files extracted for NOAA STORMEVENTS
for a specified year of download |
|
get_noaa_stormevents_new_cnames()
|
Set Shapefile column names given dictionary names fetched from .xlsx
data dictionary file. |
|
get_noaa_swdi_mtda_paths()
|
Provides a helper dataframe to list all of the files extracted for NOAA SWDI
for a specified year of download |
|
get_sel_cols()
|
Selects the specified columns from the input data frame
This is used in the geomac and mtbs load code |
|
get_subset_cols()
|
Selects the specified columns from a list of input data frames.
This is used in the geomac and mtbs load code |
|
get_transform_dim_date()
|
Creates a Date Dimension table i.e. dim_date. This is useful to
get date attributes for a sequence of dates as specified by the user. This
table can be used for joining attributes by date for existing tables and
also for subsetting tables by date where this is faster by joining rather
than by filtering. |
|
get_transform_fpa()
|
Transform the FPA FOD fires file |
|
get_transform_ghcn()
|
Transform the GHCN file |
|
get_transform_ghcnd_stations()
|
Transformed GHCN-Daily Stations file. This is metadata for the GHCN-daily
file. It contains additional info on US/Canada states and country
information for each station. |
|
get_transform_mtbs()
|
Transform the MTBS file |
|
get_transform_noaa_swdi()
|
Transform the NOAA SWDI file |
|
ghcn_load_us_stations()
|
Read in GHCN-D data for a given year and filter to US stations for loading |
|
ghcn_transform()
|
Wrapper for GHCN transformation pipeline. |
|
ghcn_transform_col_names()
|
Setup the column names for GHCN. |
|
ind_re_match()
|
Indicator function to return a {0, 1} integer value if there is a
valid regex match for the given input string |
|
mtbs_data_download()
|
Download data for MTBS data |
|
mtbs_extract()
|
Wrapper for MTBS data extraction pipeline.
This function will setup global variables, gather information and urls on
data and metadata and download the data. |
|
mtbs_metadata()
|
Download full data and metadata information for MTBS data |
|
mtbs_read_data()
|
Extracting information on the download URLs for MTBS functions |
|
mtbs_setup_variables()
|
Setup the global variables for MTBS data |
|
mtbs_transform()
|
Wrapper for MTBS transformation pipeline.
This function will transform both mtbs files, i.e.
mtbs_perimeter_data, mtbs_fod_pts_data. |
|
mtbs_transform_col_names()
|
Setup the column names for MTBS.
There are two sets of names because there are two dataframes being returned.
These have to match the data dictionary names |
|
noaa_ghcn_data_download()
|
Download data for NOOA GHCN data |
|
noaa_ghcn_extract()
|
Wrapper for NOOA GCHN data extraction pipeline.
This function will setup global variables, gather information and urls on
data and metadata and download the data. |
|
noaa_ghcn_stations_extract()
|
This is a simply wrapper function to extract noaa ghcn
station, states, and countries metadata as individual tibbles.
This uses the rnoaa package directly to do this. |
|
noaa_stormevents_data_download()
|
Download data for NOOA STORMEVENTS CSV data |
|
noaa_stormevents_extract()
|
Wrapper for NOOA STORMEVENTS CSV data extraction pipeline.
This function will setup global variables, gather information and urls on
data and metadata and download the data. |
|
noaa_stormevents_identify()
|
Identify NOOA type from file name |
|
noaa_stormevents_metadata()
|
Download full data and metadata information for NOOA STORMEVENTS CSV data |
|
noaa_stormevents_parse_datetime()
|
Convert NOAA timestamps to R datetimes. |
|
noaa_stormevents_read_data()
|
Extracting information on the download URLs for NOOA STORMEVENTS CSV data |
|
noaa_stormevents_setup_variables()
|
Setup the global variables for NOOA STORMEVENTS CSV data |
|
noaa_stormevents_transform()
|
Wrapper for NOAA STORMEVENTS transformation pipeline. |
|
noaa_swdi_data_download()
|
Download data for NOAA SWDI data |
|
noaa_swdi_extract()
|
Wrapper for NOAA GCHN data extraction pipeline.
This function will setup global variables, gather information and urls on
data and metadata and download the data. |
|
noaa_swdi_metadata()
|
Download full data and metadata information for NOAA SWDI data |
|
noaa_swdi_read_data()
|
Extracting information on the download URLs for NOAA SWDI data |
|
noaa_swdi_setup_variables()
|
Setup the global variables for NOAA SWDI data |
|
noaa_swdi_transform()
|
Wrapper for NOAA SWDI transformation pipeline. |
|
noaa_swdi_transform_col_names()
|
Setup the column names for NOAA SWDI |
|
nooa_ghcn_metadata()
|
Download full data and metadata information for NOOA GHCN data |
|
nooa_ghcn_read_data()
|
Extracting information on the download URLs forNOOA GHCN data |
|
nooa_ghcn_setup_variables()
|
Setup the global variables for NOOA GHCN data |
|
setup_global_variables()
|
Setup the global variables for the various extract functions |
|
sp_transform_sf()
|
Transform sp shapefile to an sf shapefile object with
a given crs coordinate reference system. The column names are
converted to lowercase and non-trailing spaces replaced with underscores
via the janitor::clean_names function |
|
tigris_calc_areas()
|
Calculates areas of tigris state, county, and military geometry (polygons)
in units of square meters, square kilometers, square miles. It appends
these columns onto the input tigris tibble
(of either state, county, or military). |
|
tigris_extract()
|
Extracts the TIGER/Line Files and Shapefiles for US States, US Counties,
and US military lines for a given year, and resolution, in preparation
for transform purposes |
|
tigris_transform()
|
Transforms the TIGER/Line Files and Shapefiles for US States, US Counties,
and US military lines for a given year, and resolution, in preparation
for loading/modeling purposes |
|
wrap_gen_query_fire_base_full_feat_180d()
|
Wrapper function to generate a single combined or separate SQL files
for all fire features joined in the mtbs table for modeling the ground
process and fire size. This joins all of the lagged aggregated time summaries
mapped to individual MTBS fires by specified spatial degrees over a 180 day
lag period for each fire |
|
wrap_gen_query_fire_base_full_feat_tform_180d()
|
Wrapper function to generate a single combined or separate SQL files
for all transformed fire features joined in the mtbs table for modeling the
ground process and fire size. This joins all of the lagged aggregated
time summaries mapped to individual MTBS fires by specified spatial degrees
over a 180 day lag period for each fire |
|
wrap_gen_query_fire_base_ghcnd_sfeat_180d()
|
Wrapper function to generate a single combined or separate SQL files
for individual feature GHCN-D lagged aggregated time summaries mapped to
individual MTBS fires by specified spatial degrees over a 180 day lag period
for each fire |
|
wrap_gen_query_fire_base_swdi_sfeat_180d()
|
Wrapper function to generate a single combined or separate SQL files
for individual feature NOAA SWDI lagged aggregated time summaries mapped to
individual MTBS fires by specified spatial degrees over a 180 day lag period
for each fire |
|
wrap_gen_query_ghcn_base_sfeat()
|
Wrapper function to generate a single combined or separate SQL files
for individual feature NOAA SWDI lagged aggregated time summaries mapped to
individual MTBS fires by specified spatial degrees over a 180 day lag period
for each fire |