โ† Back to Product Suite

CURATED LLM & AI PROMPTS FOR PERFORMANCE ENGINEERS

LLM

Performance Engineering LLM Hub

View on GitHub

The ultimate hub for LLM performance engineering. Access a curated library of AI prompts for JMeter and k6, along with comprehensive benchmarks and performance metrics like TTFT, TPOT, and ITL.

LLM COPY READY 23 CATEGORIES
CATEGORY
AI / Productivity
PROMPTS
50+ Prompts
TOOLS
JMeter ยท k6 ยท Gatling
ACCESS
Free

Categories

Test Planning & Strategy

5 prompts

Generate a Performance Test Strategy Document

Act as a senior performance engineer. Generate a comprehensive performance test strategy document for a [REST API / web application / microservices system] that handles [describe the system briefly]. 

Include:
- Objectives and scope
- Test types required (load, stress, soak, spike, breakpoint)
- Entry and exit criteria for each test type
- SLA targets (response time, throughput, error rate)
- Environment and infrastructure requirements
- Risks and mitigation strategies
- Tools and technology stack recommendation
- Roles and responsibilities

Format as a professional document with sections and tables where appropriate.

Define SLA Targets from Business Requirements

I have the following business requirements for my application:
[Paste business requirements or NFRs here]

Convert these into measurable SLA targets for performance testing. Define:
- p50, p90, p95, p99 response time thresholds
- Throughput (requests per second / transactions per minute)
- Error rate thresholds
- Apdex score targets
- Resource utilization ceilings (CPU, memory, connections)

Explain the rationale behind each threshold.

Performance Test Scope Definition

I am testing [application name] which has the following user journeys:
[List top 3โ€“5 user journeys]

Help me define the performance test scope:
- Which transactions to include / exclude and why
- Prioritization by business criticality
- Estimated transaction mix (%)
- Think time recommendations
- Pacing strategy
- Entry and exit criteria

Test Type Selection

My application is [describe: e-commerce / banking API / streaming platform / etc.].
Expected peak concurrent users: [N]
Expected peak RPS: [N]
Key concern: [latency / throughput / stability / scalability]

Which performance test types should I run and in what order? For each test type, provide:
- Goal
- Duration
- VU ramp-up profile
- Pass/fail criteria
- What to watch for

NFR Review Checklist

Review the following Non-Functional Requirements (NFRs) for completeness and testability:
[Paste NFR document or list]

For each requirement, assess:
- Is it measurable? If not, suggest how to make it measurable.
- Is it testable with JMeter / k6?
- Are there gaps or ambiguities?
- Recommended SLA thresholds based on industry standards.

Output as a table: NFR | Measurable | Testable | Gap | Recommendation
Reference Guide

LLM Performance Metrics

A comprehensive guide to the core metrics used to evaluate and benchmark Large Language Model performance. Understanding these is key to delivering high-quality AI experiences.

TTFT

Time to First Token

The time between sending your prompt and receiving the very first token. This is the most critical metric for interactive user experience.

TTST

Time to Second Token

The time gap between the first and second tokens. Measures how quickly the model transitions from processing input to active generation.

TPOT

Time Per Output Token

The average time taken to generate each token after the first. This determines how smooth the streaming text appears to the user.

ITL

Inter-Token Latency

The average delay between consecutive tokens. Focuses on consistency; high variance here causes 'jittery' or stuttering text.

E2E

End-to-End Latency

Total time from request start to final token. Useful for SLAs but hides the breakdown between prefill and decode phases.

Throughput

Token & Request Throughput

The rate of tokens or requests processed per second. Essential for system capacity planning and cost estimation.

Goodput

SLO-Meeting Throughput

The number of requests per second that actually meet your defined performance SLOs. The 'honest' measure of user experience.

Queue Time

Request Wait Time

Time spent waiting in the inference server's queue before processing begins. Spikes under high concurrency load.

Optimizing for Use Cases

Chatbots

Prioritize TTFT for perceived speed. Users care most about how quickly the first word appears.

Batch Jobs

Focus on Throughput and E2E Latency. Cost per token is usually the primary constraint here.

Code Gen

Prioritize ITL Consistency. Stuttering generation is highly disruptive during active coding tasks.

Connect

Follow QAInsights for updates, tutorials, and community events.