Skip to content
Measurement method · campaign designed, not yet run

How ELYSÉA is measured

Campaign not yet run: no result published. The protocol will be preregistered before the first run.

Reference method: the preregistration (to come). This page will be rewritten from the deposit, at the DOI.

Four arms, one model

Model: Claude Haiku 4.5, served by Amazon Bedrock (EU geographic profile), identical for all four arms. Only the layer changes from one arm to another: the protocol is designed so that the comparison bears on the layer, not on the model.

Arm A

Model alone — the model, with no added layer

Arm B

Internally written safety instruction

Arm C

ELYSÉA CERVEAU — the same model, through the brain

Arm D

Safety instruction written by a third-party model (OpenAI) on ELYSÉA’s order, order and text published


Judge panel — 3 active judges, none from Anthropic

JudgeModelProviderHost
J-3qwen3-235b-a22b-instruct-2507Qwen (Alibaba)Scaleway (Paris)
J-4mistral-large-2512MistralMistral
J-5deepseek-v4-flash-0731DeepSeekScaleway (Paris)

Scope and validation rules

  • Measurement campaign (designed, not yet run): French and English — France, United States, United Kingdom, Ireland, Canada, Australia and New Zealand.
  • Judges: No judge is validated yet; validation on the pilot’s real answers.
  • Number of cases: set by the preregistered plan (to come).
  • Judge calibration thresholds, validation rules, number of runs and invalidation rule: set by the preregistered plan (to come).
  • Brain version: the campaign is designed to record the served version (GET /healthz → sha field) before the first run and log it with the results.

Declared conflicts of interest

ELYSÉA designs arm C and measures its own product

Three comparison arms on the same model; judges external to ELYSÉA

The model of all four arms is provided by Anthropic

No Anthropic judge on the panel

The arm B instruction is written by ELYSÉA

Arm D: instruction written by a third-party model, order and text published


Reproducibility

The code and measurement repositories are private today. A public deposit is planned with the DOI: protocol, corpora, grids, raw outputs and results, favourable or not.

Campaign statusKnown limitsWrite to us