Ownlayer
  • 👋Welcome
  • Getting Started
    • 💫Quickstart
  • Iterate
    • 💡Prompt
    • 📃Dataset
      • Dataset Creation
      • Data point Evaluation
      • Dataset Evaluation
  • Monitor
    • 🔬Evaluators
      • 🖌️Create Evaluators
      • 🔌Smart Trigger an online Evaluator
      • 🎛️Evaluator Playground
    • 🧐Analyzers
  • Integrations
    • Segment
    • Amplitude
    • Posthog
  • REST API
  • Python SDK
Powered by GitBook
On this page
  • Create an Analyzer
  • Analyzer Type
  • Analyzer Settings
  • Smart Trigger An Analyzer in Production
  • Add Trigger Logic
  • Implement Trigger in Inference Stream
  1. Monitor

Analyzers

Different from Evaluators, Analyzers do not have criteria and can be leveraged as a great tool to understand your product behavior. Ownlayer offers text classification and sentiment analysis

PreviousEvaluator PlaygroundNextSegment

Last updated 7 months ago

Create an Analyzer

To create a new Analyzer, click on the 'Analyzers' from the left panel and click on the 'Create analyzer' button. Fill out the form to create the desired analyzer. At minimum, this includes:

  • Name of the analyzer.

  • Description of what the analyzer does (optional).

  • Select the analyzer type

Analyzer Type

Name
Description

Text Classification

Uses a text classification model based on provided labels. It assesses the likelihood of the input text belonging to each label category. Multi-label is available in settings

Positive/Negative Analysis

Uses a fine-tuned RoBERTa model for sentiment analysis, returning a score between 0 to 1 for positive, negative, and neutral.

Emotion Identificaiton

Uses a fine-tuned DistilRoBERTa model for comprehensive sentiment analysis. It assesses the emotional tone of input text, providing scores for 7 distinct sentiment categories:

  • Anger 🤬

  • Disgust 🤢

  • Fear 😨

  • Joy 😀

  • Neutral 😐

  • Sadness 😭

  • Surprise 😲

Analyzer Settings

On Analyzer detail page, you can specify additional settings

Multiple Labels

If you anticipate the response may belong to more than one labels, you'd want to enable the multi-label toggle.

Inference Attribute

You can choose which variable to analyze

Name
Description

Input

The complete data submitted to the LLM.

Output

The generated response from the LLM

User Prompt

The user's query or input within the overall submission

Context

The context informtion within the submission

System Prompt

The instruction provided to the LLM as part of the entire input

Smart Trigger An Analyzer in Production

Add Trigger Logic

You can add Triggers on the Analyzer's detail page to automatically analyze an inference.

  • Select the Analyzer you just created.

  • Navigate to the 'Triggers' section within the Analyzer detail page, and click on 'Add tag'

Implement Trigger in Inference Stream

  • Ensure that the tags specified in the Analyzers' triggers are included when you stream your inference data.

Follow the full for detailed instructions on how to implement triggers in your inference stream.

🧐
API documentation