Define the task and sample
You need permission to author the definition, read the sample inputs, use the selected model and run an evaluation. Applying it later also needs the dataset, execution-principal and processing permissions. Choose a small representative sample of your own permitted inputs and the fields you need from them. Inspect each source and write the expected result before evaluation. Include a clear positive case, missing or ambiguous values, irrelevant content and conflicting wording. Use supported input kinds and retain the exact sampled versions; no sample dataset is supplied by the guide. Before running, set sample and usage limits. Define success: supported fields are accurate, missing values remain explicit, and the output invents no cause, actor or date. Retain each source version and your assessment criteria.Ask for a draft
In Kato, send:Help me draft an enrichment named [definition name]. It reads [my supported input kind] and returns [fields required for my task], with source support and uncertainty. Use null or an explicit unknown state for unsupported values. Do not invent missing facts. Propose the prompt and output schema, then leave the definition unpublished and unbound.Replace the fields and supply your expected output shape before authoring. Select the permitted model and supported input kinds with Kato. Inspect the draft in Forge and its enrichment playground. Check that the prompt and schema agree on field names, types, missing values and how supporting text is retained. Change only the candidate you intend to test.
Evaluate the candidate
Identify the permitted sample scope and assessment criteria. Ask Kato to run an isolated evaluation of that candidate with the agreed limits, then open the evaluation record. Inspect actual outputs, schema errors, failed cases, quality judgements, resource usage and cost. Compare output with the source text and expected results. For a required value that is absent, check the explicit unknown result. For conflicting accounts, check that they remain distinguishable. Evaluation outputs stay separate from current dataset evidence and production processing. The sample and results keep their access rules and classification. Do not copy private example content into a definition intended for a wider audience.Revise and repeat
Ask for a specific correction, for example:Revise this candidate to address [the specific error I found]. Preserve unknown values when the source does not support them. Repeat the evaluation against the same input versions and criteria.Keep the tested input and candidate versions with their results. When there is an incumbent, compare both on the same cases and criteria. Agreement with an earlier model does not establish correctness; assess each against the source and criteria. Failed examples remain part of the evaluation record.