{
  "version": 1,
  "campaign_id": "id-060864e901a6a6",
  "wire": {
    "sample_rate": 16000,
    "channels": 1,
    "format": "pcm16le",
    "chunk_samples": 320,
    "pace_ms": 20
  },
  "cases": [
    {
      "id": "s2_2_minus18",
      "split": "dev",
      "role": "speech",
      "source": {
        "sha256": "e0d20eaf14e511c53962be9453a7be6b4447bb1d3bf09fcb545915ff211d8860",
        "samples": 358080
      },
      "reference": {
        "text": "Длинная нестабильная фраза может упереться в восьмисекундное окно.\nОкно сокращается после совпадения слов двух decode. Если устойчивый префикс не появляется, дальнейший рост приводит к overflow. Тест длинной фразы существует, но использует символический decoder, а не реальный Whisper",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s6_1_quiet",
      "split": "dev",
      "role": "speech",
      "source": {
        "sha256": "36cceec6151751783b2e9f9021adbe276a0a69dea4ebf4aff9fa3d872ca9caa6",
        "samples": 358400
      },
      "reference": {
        "text": "Длинная нестабильная фраза может упереться в восьмисекундное окно.\nОкно сокращается после совпадения слов двух decode. Если устойчивый префикс не появляется, дальнейший рост приводит к overflow. Тест длинной фразы существует, но использует символический decoder, а не реальный Whisper",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s6_2_repetition",
      "split": "dev",
      "role": "speech",
      "source": {
        "sha256": "392d5b6929ff20fe0beffab6ead7ec118e508f9c21eb596aedaad1392fc4c700",
        "samples": 660800
      },
      "reference": {
        "text": "Длинная нестабильная фраза может упереться в восьмисекундное окно.\nОкно сокращается после совпадения слов двух decode. Если устойчивый префикс не появляется, дальнейший рост приводит к overflow. Тест длинной фразы существует, но использует символический decoder, а не реальный Whisper Длинная нестабильная фраза может упереться в восьмисекундное окно.\nОкно сокращается после совпадения слов двух decode. Если устойчивый префикс не появляется, дальнейший рост приводит к overflow. Тест длинной фразы существует, но использует символический decoder, а не реальный Whisper",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s5_1_command",
      "split": "dev",
      "role": "speech",
      "source": {
        "sha256": "c0cd6431ffb6c0569c710ae0441d949874b892b901e6b35fcfd8a50302a9f019",
        "samples": 165440
      },
      "reference": {
        "text": "Найди ближайший открытый аэропорт. Покажи маршрут на карте и расскажи, какая там сейчас погода.",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s5_2_codes",
      "split": "dev",
      "role": "speech",
      "source": {
        "sha256": "03f9814512626c1c0867b1501a05bb828062c6019a84bbe4dd6a7ceb1be1ffea",
        "samples": 199040
      },
      "reference": {
        "text": "Рейс ТЕСТ сто двадцать три. Скорость тысяча километров в час. Осталось тридцать минут. Полоса три тысячи пятьсот метров.",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s2_3_quiet_codes",
      "split": "dev",
      "role": "speech",
      "source": {
        "sha256": "eb5424c676e27c9aa40a60f420ddbf9594fd5e64f57368430ec51887919c2c71",
        "samples": 199040
      },
      "reference": {
        "text": "Рейс ТЕСТ сто двадцать три. Скорость тысяча километров в час. Осталось тридцать минут. Полоса три тысячи пятьсот метров.",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s7_4_transition",
      "split": "heldout",
      "role": "speech",
      "source": {
        "sha256": "54db3c039b8adcdf33ffe0ceb86e2020ef740551812f33cf4428b12a5d922220",
        "samples": 268160
      },
      "reference": {
        "text": "еполный PCM-чанк дополняется тишиной вместо накопления остатка.\nКаждый resampled frame разбивается отдельно; короткий остаток дополняется нулями. При иной пакетизации это способно добавлять лишнюю тишину и менять длительность.",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s7_5_codes",
      "split": "heldout",
      "role": "speech",
      "source": {
        "sha256": "e4fd8fd43a3e778ecd0fea868dfd52b7f48cb7463bea5e73611dc1f9a2efcb19",
        "samples": 190720
      },
      "reference": {
        "text": "Рейс ТЕСТ четыреста пятьдесят шесть. Скорость восемьсот километров в час. Осталось двадцать минут. Полоса две тысячи восемьсот метров.",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s7_6_sentence",
      "split": "heldout",
      "role": "speech",
      "source": {
        "sha256": "7df7362ae66504409dd956da19db83f1d885750d810443d6bfe4673fbf988a06",
        "samples": 169600
      },
      "reference": {
        "text": "Найди аэропорт с самым слабым ветром. Проверь открытость аэропорта и наличие свободной полосы. Покажи его на карте.",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s7_1_clean",
      "split": "heldout",
      "role": "speech",
      "source": {
        "sha256": "7cc2dac5346f52eed5a59a7d0988be689f71e957ea1bde565f1c920a51032015",
        "samples": 268160
      },
      "reference": {
        "text": "еполный PCM-чанк дополняется тишиной вместо накопления остатка.\nКаждый resampled frame разбивается отдельно; короткий остаток дополняется нулями. При иной пакетизации это способно добавлять лишнюю тишину и менять длительность.",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s6_6_silence",
      "split": "negative",
      "role": "silence",
      "source": {
        "sha256": "0bf8a60cad707414c5e169dbc345f90a1abbf8410a45e4b5689022042051f266",
        "samples": 151680
      },
      "reference": {
        "text": "",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "s6_6_noise",
      "split": "negative",
      "role": "noise",
      "source": {
        "sha256": "055f345ba9041c4b40aaf5179eff5a669ac62f2e6f5edf16ff9182fc31691fec",
        "samples": 151680
      },
      "reference": {
        "text": "",
        "normalization": "ru-v1"
      }
    },
    {
      "id": "bravo789",
      "split": "extra",
      "role": "speech",
      "source": {
        "sha256": "8f5486ce9615e38962d3e3a39c1b3dd5609d33645ab8dd6a5a9e038c6704ccfc",
        "samples": 120640
      },
      "reference": {
        "text": "Позывной БРАВО семьсот восемьдесят девять. Следуем на север. Расчётное время двадцать пять минут.",
        "normalization": "ru-v1"
      }
    }
  ],
  "profiles": [
    {
      "id": "legacy",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "legacy",
        "refinement": "none",
        "hotwords": "none"
      }
    },
    {
      "id": "legacy_hotwords",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "legacy",
        "refinement": "none",
        "hotwords": "aviation_codes_v1"
      }
    },
    {
      "id": "legacy_beam3",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "legacy",
        "refinement": "beam3",
        "hotwords": "none"
      }
    },
    {
      "id": "legacy_beam3_hotwords",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "legacy",
        "refinement": "beam3",
        "hotwords": "aviation_codes_v1"
      }
    },
    {
      "id": "window",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window",
        "refinement": "none",
        "hotwords": "none"
      }
    },
    {
      "id": "window_hotwords",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window",
        "refinement": "none",
        "hotwords": "aviation_codes_v1"
      }
    },
    {
      "id": "window_beam3",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window",
        "refinement": "beam3",
        "hotwords": "none"
      }
    },
    {
      "id": "window_beam3_hotwords",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window",
        "refinement": "beam3",
        "hotwords": "aviation_codes_v1"
      }
    },
    {
      "id": "adaptive",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window_adaptive",
        "refinement": "none",
        "hotwords": "none"
      }
    },
    {
      "id": "adaptive_hotwords",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window_adaptive",
        "refinement": "none",
        "hotwords": "aviation_codes_v1"
      }
    },
    {
      "id": "adaptive_beam3",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window_adaptive",
        "refinement": "beam3",
        "hotwords": "none"
      }
    },
    {
      "id": "adaptive_beam3_hotwords",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window_adaptive",
        "refinement": "beam3",
        "hotwords": "aviation_codes_v1"
      }
    },
    {
      "id": "prefinal",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window_adaptive_prefinal",
        "refinement": "none",
        "hotwords": "none"
      }
    },
    {
      "id": "prefinal_hotwords",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window_adaptive_prefinal",
        "refinement": "none",
        "hotwords": "aviation_codes_v1"
      }
    },
    {
      "id": "prefinal_beam3",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window_adaptive_prefinal",
        "refinement": "beam3",
        "hotwords": "none"
      }
    },
    {
      "id": "prefinal_beam3_hotwords",
      "quality": {
        "normalization": "baseline",
        "silence_ms": 450,
        "partial_ms": 500,
        "mode": "online",
        "policy": "window_adaptive_prefinal",
        "refinement": "beam3",
        "hotwords": "aviation_codes_v1"
      }
    }
  ],
  "schedule": [
    {
      "case_id": "s2_2_minus18",
      "profile": "legacy",
      "ordinal": 1,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "legacy",
      "ordinal": 2,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "legacy",
      "ordinal": 3,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s5_1_command",
      "profile": "legacy",
      "ordinal": 4,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s5_2_codes",
      "profile": "legacy",
      "ordinal": 5,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "legacy",
      "ordinal": 6,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "window",
      "ordinal": 7,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "window",
      "ordinal": 8,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "window",
      "ordinal": 9,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s5_1_command",
      "profile": "window",
      "ordinal": 10,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s5_2_codes",
      "profile": "window",
      "ordinal": 11,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "window",
      "ordinal": 12,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "adaptive",
      "ordinal": 13,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "adaptive",
      "ordinal": 14,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "adaptive",
      "ordinal": 15,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s5_1_command",
      "profile": "adaptive",
      "ordinal": 16,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s5_2_codes",
      "profile": "adaptive",
      "ordinal": 17,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "adaptive",
      "ordinal": 18,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "prefinal",
      "ordinal": 19,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "prefinal",
      "ordinal": 20,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "prefinal",
      "ordinal": 21,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s5_1_command",
      "profile": "prefinal",
      "ordinal": 22,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s5_2_codes",
      "profile": "prefinal",
      "ordinal": 23,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "prefinal",
      "ordinal": 24,
      "phase": "dev",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "base",
      "ordinal": 25,
      "phase": "beam",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "base_beam3",
      "ordinal": 26,
      "phase": "beam",
      "repeat": 1
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "base",
      "ordinal": 27,
      "phase": "beam",
      "repeat": 1
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "base_beam3",
      "ordinal": 28,
      "phase": "beam",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "base_beam3",
      "ordinal": 29,
      "phase": "beam",
      "repeat": 2
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "base",
      "ordinal": 30,
      "phase": "beam",
      "repeat": 2
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "base_beam3",
      "ordinal": 31,
      "phase": "beam",
      "repeat": 2
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "base",
      "ordinal": 32,
      "phase": "beam",
      "repeat": 2
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "base",
      "ordinal": 33,
      "phase": "beam",
      "repeat": 3
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "base_beam3",
      "ordinal": 34,
      "phase": "beam",
      "repeat": 3
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "base",
      "ordinal": 35,
      "phase": "beam",
      "repeat": 3
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "base_beam3",
      "ordinal": 36,
      "phase": "beam",
      "repeat": 3
    },
    {
      "case_id": "s5_2_codes",
      "profile": "base",
      "ordinal": 37,
      "phase": "hotwords",
      "repeat": 1
    },
    {
      "case_id": "s5_2_codes",
      "profile": "base_hotwords",
      "ordinal": 38,
      "phase": "hotwords",
      "repeat": 1
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "base_hotwords",
      "ordinal": 39,
      "phase": "hotwords",
      "repeat": 1
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "base",
      "ordinal": 40,
      "phase": "hotwords",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "base",
      "ordinal": 41,
      "phase": "hotwords",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "base_hotwords",
      "ordinal": 42,
      "phase": "hotwords",
      "repeat": 1
    },
    {
      "case_id": "bravo789",
      "profile": "base_hotwords",
      "ordinal": 43,
      "phase": "hotwords",
      "repeat": 1
    },
    {
      "case_id": "bravo789",
      "profile": "base",
      "ordinal": 44,
      "phase": "hotwords",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "legacy",
      "ordinal": 45,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "selected",
      "ordinal": 46,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "legacy",
      "ordinal": 47,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "selected",
      "ordinal": 48,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "legacy",
      "ordinal": 49,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "selected",
      "ordinal": 50,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s5_1_command",
      "profile": "legacy",
      "ordinal": 51,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s5_1_command",
      "profile": "selected",
      "ordinal": 52,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s5_2_codes",
      "profile": "legacy",
      "ordinal": 53,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s5_2_codes",
      "profile": "selected",
      "ordinal": 54,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "legacy",
      "ordinal": 55,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "selected",
      "ordinal": 56,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s7_4_transition",
      "profile": "legacy",
      "ordinal": 57,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s7_4_transition",
      "profile": "selected",
      "ordinal": 58,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s7_5_codes",
      "profile": "legacy",
      "ordinal": 59,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s7_5_codes",
      "profile": "selected",
      "ordinal": 60,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s7_6_sentence",
      "profile": "legacy",
      "ordinal": 61,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s7_6_sentence",
      "profile": "selected",
      "ordinal": 62,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s7_1_clean",
      "profile": "legacy",
      "ordinal": 63,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s7_1_clean",
      "profile": "selected",
      "ordinal": 64,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s6_6_silence",
      "profile": "legacy",
      "ordinal": 65,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s6_6_silence",
      "profile": "selected",
      "ordinal": 66,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s6_6_noise",
      "profile": "legacy",
      "ordinal": 67,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s6_6_noise",
      "profile": "selected",
      "ordinal": 68,
      "phase": "heldout",
      "repeat": 1
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "selected",
      "ordinal": 69,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "legacy",
      "ordinal": 70,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "selected",
      "ordinal": 71,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "legacy",
      "ordinal": 72,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "selected",
      "ordinal": 73,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "legacy",
      "ordinal": 74,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s5_1_command",
      "profile": "selected",
      "ordinal": 75,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s5_1_command",
      "profile": "legacy",
      "ordinal": 76,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s5_2_codes",
      "profile": "selected",
      "ordinal": 77,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s5_2_codes",
      "profile": "legacy",
      "ordinal": 78,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "selected",
      "ordinal": 79,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "legacy",
      "ordinal": 80,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s7_4_transition",
      "profile": "selected",
      "ordinal": 81,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s7_4_transition",
      "profile": "legacy",
      "ordinal": 82,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s7_5_codes",
      "profile": "selected",
      "ordinal": 83,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s7_5_codes",
      "profile": "legacy",
      "ordinal": 84,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s7_6_sentence",
      "profile": "selected",
      "ordinal": 85,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s7_6_sentence",
      "profile": "legacy",
      "ordinal": 86,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s7_1_clean",
      "profile": "selected",
      "ordinal": 87,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s7_1_clean",
      "profile": "legacy",
      "ordinal": 88,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s6_6_silence",
      "profile": "selected",
      "ordinal": 89,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s6_6_silence",
      "profile": "legacy",
      "ordinal": 90,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s6_6_noise",
      "profile": "selected",
      "ordinal": 91,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s6_6_noise",
      "profile": "legacy",
      "ordinal": 92,
      "phase": "heldout",
      "repeat": 2
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "legacy",
      "ordinal": 93,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s2_2_minus18",
      "profile": "selected",
      "ordinal": 94,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "legacy",
      "ordinal": 95,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s6_1_quiet",
      "profile": "selected",
      "ordinal": 96,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "legacy",
      "ordinal": 97,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s6_2_repetition",
      "profile": "selected",
      "ordinal": 98,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s5_1_command",
      "profile": "legacy",
      "ordinal": 99,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s5_1_command",
      "profile": "selected",
      "ordinal": 100,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s5_2_codes",
      "profile": "legacy",
      "ordinal": 101,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s5_2_codes",
      "profile": "selected",
      "ordinal": 102,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "legacy",
      "ordinal": 103,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s2_3_quiet_codes",
      "profile": "selected",
      "ordinal": 104,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s7_4_transition",
      "profile": "legacy",
      "ordinal": 105,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s7_4_transition",
      "profile": "selected",
      "ordinal": 106,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s7_5_codes",
      "profile": "legacy",
      "ordinal": 107,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s7_5_codes",
      "profile": "selected",
      "ordinal": 108,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s7_6_sentence",
      "profile": "legacy",
      "ordinal": 109,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s7_6_sentence",
      "profile": "selected",
      "ordinal": 110,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s7_1_clean",
      "profile": "legacy",
      "ordinal": 111,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s7_1_clean",
      "profile": "selected",
      "ordinal": 112,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s6_6_silence",
      "profile": "legacy",
      "ordinal": 113,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s6_6_silence",
      "profile": "selected",
      "ordinal": 114,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s6_6_noise",
      "profile": "legacy",
      "ordinal": 115,
      "phase": "heldout",
      "repeat": 3
    },
    {
      "case_id": "s6_6_noise",
      "profile": "selected",
      "ordinal": 116,
      "phase": "heldout",
      "repeat": 3
    }
  ],
  "selection": {
    "rule_version": 1,
    "default_profile": "legacy",
    "base_candidate_ids": [
      "window",
      "adaptive",
      "prefinal"
    ],
    "required_phases": [
      "dev",
      "beam",
      "hotwords"
    ],
    "gates": {
      "max_new_errors": 0,
      "max_new_false_finals": 0,
      "max_heldout_wer_ratio": 1,
      "max_final_latency_ms_delta": 100,
      "min_long_decode_reduction": 0.25,
      "min_prefinal_final_gain_ms": 100,
      "max_beam_latency_ms_delta": 300
    }
  }
}