Hide navigation sidebar

Hide table of contents sidebar

Skip to content

Toggle site navigation sidebar

LLM Detector Benchmark 🔎

Toggle table of contents sidebar

LLM Detector Benchmark 🔎

Getting started

Getting Started

Contents

How to generate the benchmark
How to test a detector
How to extend the benchmark
Toggle navigation of How to extend the benchmark
List of supported generators, detectors, attacks and watermarks
Toggle navigation of List of supported generators, detectors, attacks and watermarks
Class details
API Reference
Toggle navigation of API Reference
- utils
- configs
- gen_utils
- openai_utils
- detector_benchmark
  Toggle navigation of detector_benchmark
  - detector_benchmark.conf
  - detector_benchmark.create_dataset
  - detector_benchmark.dataset_loader
    Toggle navigation of detector_benchmark.dataset_loader
  - detector_benchmark.detector
    Toggle navigation of detector_benchmark.detector
  - detector_benchmark.generate_mappings
  - detector_benchmark.generation
    Toggle navigation of detector_benchmark.generation
  - detector_benchmark.pipeline
    Toggle navigation of detector_benchmark.pipeline
  - detector_benchmark.run_human_eval
  - detector_benchmark.run_human_eval_plus
  - detector_benchmark.test_detector
  - detector_benchmark.test_text_quality
  - detector_benchmark.text_quality_evaluation
    Toggle navigation of detector_benchmark.text_quality_evaluation
    - detector_benchmark.text_quality_evaluation.scorer
    - detector_benchmark.text_quality_evaluation.scorer_utils
  - detector_benchmark.watermark
    Toggle navigation of detector_benchmark.watermark
    - detector_benchmark.watermark.auto_watermark
    - detector_benchmark.watermark.base
    - detector_benchmark.watermark.dip
      Toggle navigation of detector_benchmark.watermark.dip
      - detector_benchmark.watermark.dip.dip
    - detector_benchmark.watermark.exp
      Toggle navigation of detector_benchmark.watermark.exp
      - detector_benchmark.watermark.exp.exp
    - detector_benchmark.watermark.kgw
      Toggle navigation of detector_benchmark.watermark.kgw
      - detector_benchmark.watermark.kgw.kgw
    - detector_benchmark.watermark.sir
      Toggle navigation of detector_benchmark.watermark.sir
      - detector_benchmark.watermark.sir.sir
      - detector_benchmark.watermark.sir.transform_model
    - detector_benchmark.watermark.sweet
      Toggle navigation of detector_benchmark.watermark.sweet
      - detector_benchmark.watermark.sweet.sweet
    - detector_benchmark.watermark.synth_id
      Toggle navigation of detector_benchmark.watermark.synth_id
    - detector_benchmark.watermark.unbiased
      Toggle navigation of detector_benchmark.watermark.unbiased
      - detector_benchmark.watermark.unbiased.unbiased
- transformers_config

detector_benchmark.conf¶