Ownlayer
  • 👋Welcome
  • Getting Started
    • 💫Quickstart
  • Iterate
    • 💡Prompt
    • 📃Dataset
      • Dataset Creation
      • Data point Evaluation
      • Dataset Evaluation
  • Monitor
    • 🔬Evaluators
      • 🖌️Create Evaluators
      • 🔌Smart Trigger an online Evaluator
      • 🎛️Evaluator Playground
    • 🧐Analyzers
  • Integrations
    • Segment
    • Amplitude
    • Posthog
  • REST API
  • Python SDK
Powered by GitBook
On this page
  • Add Trigger Logic
  • Implement Trigger in Inference Stream
  1. Monitor
  2. Evaluators

Smart Trigger an online Evaluator

PreviousCreate EvaluatorsNextEvaluator Playground

Last updated 7 months ago

Note that only evaluators with input and output variables can be triggered for online evaluation in production

Add Trigger Logic

To automatically evaluate an inference, you can add Triggers on the Evaluator detail page.

  • Select the evaluator you just created.

  • Navigate to the 'Triggers' section within the evaluator's detail page, and click on 'Add tag'

Implement Trigger in Inference Stream

  • Ensure that the tags specified in the evaluators' triggers are included when you stream your inference data.

Follow the full for detailed instructions on how to implement triggers in your inference stream.

🔬
🔌
API documentation