detector_benchmark.pipeline.create_dataset_pipeline¶
Classes¶
Abstract class for an experiment pipeline. |
Module Contents¶
- class detector_benchmark.pipeline.create_dataset_pipeline.CreateDatasetPipeline(cfg: dict, dataset_loader: detector_benchmark.dataset_loader.FakeTruePairsDataLoader, attack: detector_benchmark.generation.ArticleGenerator, experiment_path: str, batch_size: int = 1, skip_cache: bool = False, skip_train_split: bool = False)¶
Bases:
detector_benchmark.pipeline.experiment_pipeline.ExperimentPipeline
Abstract class for an experiment pipeline.
- cfg¶
- dataset_loader¶
- attack¶
- experiment_path¶
- batch_size¶
- generator_name¶
- experiment_name¶
- skip_cache¶
- skip_train_split¶
- log¶
- create_experiment_dataset() datasets.Dataset ¶
Create the fake true dataset for the experiment by generating fake articles using the generator.
Returns:¶
- dataset: Dataset
The generated fake true dataset.
- run_pipeline()¶
Main function of the class, runs the pipeline. Creates the dataset for the experiment and saves it.