gw.dataset.generate_dataset_dag.configure_runs

gw.dataset.generate_dataset_dag.configure_runs(settings, num_jobs, temp_dir)

Prepare and save settings .yaml files for generating subsets of the dataset. Generally this will produce two .yaml files, one for generating the main dataset, one for the SVD training.

Parameters

Name Type Description Default
settings dict Settings for full dataset configuration. required
num_jobs int Number of jobs over which to split the run. required
temp_dir str Name of (temporary) directory in which to place temporary output files. required