Metric Definition Registry
Keep metric definitions, owners, filters and calculation versions together.
- Runtime
- Node.js 22+
- License
- MIT
Browse free tools for SEO, web accessibility, AI, cloud, testing and software delivery. Each repository has public code and a defined scope.
Showing 18 of 210 matching repositories, from 210 total
Keep metric definitions, owners, filters and calculation versions together.
Map dashboard tiles to source queries, models and freshness evidence.
Profile CSV data for outliers, missingness and unexpected category values.
Capture table and field lineage from a versioned transformation manifest.
Evaluate language model behavior with representative tasks and explicit pass rules.
Measure whether generated answers cite approved retrieval sources completely.
Check embedding records for source identity, model version and expiry metadata.
Remove secrets and personal data from model inputs and outputs in saved traces.
Find chunks that are too large, duplicated, stale or missing provenance.
Benchmark answer claims against evidence and classify unsupported statements.
Record model usage, token counts, prices and workflow cost per outcome.
Exercise fallback models for quality, latency, cost and error behavior.
Validate structured model output against JSON Schema and repair boundaries.
Sample evaluation cases by risk, coverage and recent failure history.
Check prompts for objective, context, constraints, output and verification fields.
Show prompt changes as readable diffs with affected tests and variables.
Exercise prompt injection fixtures at tool, retrieval and content boundaries.
Estimate input and output tokens before a workflow spends a model budget.
Follow a public example from a practical problem to a runnable repository.
View worked examples