Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
LLM Detector Benchmark 🔎
LLM Detector Benchmark 🔎

Getting started

  • Getting Started

Contents

  • How to generate the benchmark
  • How to test a detector
  • How to extend the benchmark
    • How to add an attack
    • How to add a dataset
    • How to add a new detector on the detection benchmark
    • How to add a new LLM for generating the benchmark
    • How to add a watermarking scheme on the benchmark
  • List of supported generators, detectors, attacks and watermarks
    • List of supported evasion attacks
    • List of supported detectors
    • List of supported LLMs for generation
    • List of supported watermarking schemes
  • Class details
  • API Reference
    • utils
    • configs
    • gen_utils
    • openai_utils
    • detector_benchmark
      • detector_benchmark.conf
      • detector_benchmark.create_dataset
      • detector_benchmark.dataset_loader
        • detector_benchmark.dataset_loader.cnn_dataset
        • detector_benchmark.dataset_loader.dataset_loader_utils
        • detector_benchmark.dataset_loader.fake_true_dataset
      • detector_benchmark.detector
        • detector_benchmark.detector.bert_detector
        • detector_benchmark.detector.detector
        • detector_benchmark.detector.detector_loader
        • detector_benchmark.detector.fast_detect_gpt
        • detector_benchmark.detector.gpt_zero_detector
        • detector_benchmark.detector.watermark_detector
      • detector_benchmark.generate_mappings
      • detector_benchmark.generation
        • detector_benchmark.generation.article_generator
        • detector_benchmark.generation.attack_loader
        • detector_benchmark.generation.gen_loader
        • detector_benchmark.generation.gen_params_attack
        • detector_benchmark.generation.generator
        • detector_benchmark.generation.prompt_attack
        • detector_benchmark.generation.prompt_paraphrasing_attack
      • detector_benchmark.pipeline
        • detector_benchmark.pipeline.create_dataset_pipeline
        • detector_benchmark.pipeline.experiment_pipeline
        • detector_benchmark.pipeline.experiment_test_detector_pipeline
        • detector_benchmark.pipeline.pipeline_utils
        • detector_benchmark.pipeline.text_quality_pipeline
      • detector_benchmark.run_human_eval
      • detector_benchmark.run_human_eval_plus
      • detector_benchmark.test_detector
      • detector_benchmark.test_text_quality
      • detector_benchmark.text_quality_evaluation
        • detector_benchmark.text_quality_evaluation.scorer
        • detector_benchmark.text_quality_evaluation.scorer_utils
      • detector_benchmark.watermark
        • detector_benchmark.watermark.auto_watermark
        • detector_benchmark.watermark.base
        • detector_benchmark.watermark.dip
          • detector_benchmark.watermark.dip.dip
        • detector_benchmark.watermark.exp
          • detector_benchmark.watermark.exp.exp
        • detector_benchmark.watermark.kgw
          • detector_benchmark.watermark.kgw.kgw
        • detector_benchmark.watermark.sir
          • detector_benchmark.watermark.sir.sir
          • detector_benchmark.watermark.sir.transform_model
        • detector_benchmark.watermark.sweet
          • detector_benchmark.watermark.sweet.sweet
        • detector_benchmark.watermark.synth_id
          • detector_benchmark.watermark.synth_id.detector
          • detector_benchmark.watermark.synth_id.detector_bayesian_torch
          • detector_benchmark.watermark.synth_id.synth_id
        • detector_benchmark.watermark.unbiased
          • detector_benchmark.watermark.unbiased.unbiased
    • transformers_config
Back to top
View this page

detector_benchmark¶

Submodules¶

  • detector_benchmark.conf
  • detector_benchmark.create_dataset
  • detector_benchmark.dataset_loader
  • detector_benchmark.detector
  • detector_benchmark.generate_mappings
  • detector_benchmark.generation
  • detector_benchmark.pipeline
  • detector_benchmark.run_human_eval
  • detector_benchmark.run_human_eval_plus
  • detector_benchmark.test_detector
  • detector_benchmark.test_text_quality
  • detector_benchmark.text_quality_evaluation
  • detector_benchmark.watermark
Next
detector_benchmark.conf
Previous
openai_utils
Copyright © 2024, Marluxiaboss
Made with Sphinx and @pradyunsg's Furo
On this page
  • detector_benchmark
    • Submodules