detector_benchmark.pipeline.create_dataset_pipeline¶

Classes¶

CreateDatasetPipeline

Abstract class for an experiment pipeline.

Module Contents¶

class detector_benchmark.pipeline.create_dataset_pipeline.CreateDatasetPipeline(cfg: dict, dataset_loader: detector_benchmark.dataset_loader.FakeTruePairsDataLoader, attack: detector_benchmark.generation.ArticleGenerator, experiment_path: str, batch_size: int = 1, skip_cache: bool = False, skip_train_split: bool = False)¶

Bases: detector_benchmark.pipeline.experiment_pipeline.ExperimentPipeline

Abstract class for an experiment pipeline.

cfg¶
dataset_loader¶
attack¶
experiment_path¶
batch_size¶
generator_name¶
experiment_name¶
skip_cache¶
skip_train_split¶
log¶
create_experiment_dataset() datasets.Dataset¶

Create the fake true dataset for the experiment by generating fake articles using the generator.

Returns:¶

dataset: Dataset

The generated fake true dataset.

run_pipeline()¶

Main function of the class, runs the pipeline. Creates the dataset for the experiment and saves it.