Ownlayer
  • 👋Welcome
  • Getting Started
    • 💫Quickstart
  • Iterate
    • 💡Prompt
    • 📃Dataset
      • Dataset Creation
      • Data point Evaluation
      • Dataset Evaluation
  • Monitor
    • 🔬Evaluators
      • 🖌️Create Evaluators
      • 🔌Smart Trigger an online Evaluator
      • 🎛️Evaluator Playground
    • 🧐Analyzers
  • Integrations
    • Segment
    • Amplitude
    • Posthog
  • REST API
  • Python SDK
Powered by GitBook
On this page
  • Automated Prompt Generation
  • Automated Prompt Optimization
  • Seamless Deployment
  1. Iterate

Prompt

Use Ownlayer to systematically version manage, optimize and iterate on the prompt you use in LLM application

PreviousQuickstartNextDataset

Last updated 6 months ago

Automated Prompt Generation

  • One-Click Prompt Generation: Effortlessly create prompts with a single click using proven and validated methodologies.

  • Supported Techniques:

    • Chain-of-Thought Reasoning: Generate prompts that encourage logical, step-by-step thinking to improve task accuracy.

    • Few-Shot Sentiment Classification: Design prompts with a few labeled examples to guide the model for sentiment analysis tasks.

    • Additional Established Approaches: Leverage other widely-recognized prompt engineering techniques (complete list available ).

Automated Prompt Optimization

  • Describe the Task: Clearly state the task or objective you aim to optimize for.

  • Provide Prompt Examples and Assign Scores: Include several example prompts and assign a score to each to establish a baseline for optimization.

  • Define Generative Settings:

    • Max Steps: Specify the maximum number of iterations the optimizer should perform.

    • Prompts per Step: Indicate the number of prompts to be generated or evaluated in each iteration.

    • Top K: Select the top K prompts to serve as the baseline for the next iteration.

  • Choose Your Scoring Agent:

    • Supervised Mode: Select a golden dataset to optimize prompt performance. Ensure the dataset includes at least two columns: inputs and references that represent your ideal output.

    • Unsupervised Mode: Provide a text description that clearly defines the goal or desired outcome for the prompts.

Seamless Deployment

  • Deploy your chosen prompt version directly to production

These features are designed to enhance your prompt engineering workflow, from initial creation to final deployment.

💡
here