pattern

A/B Testing for LLM Applications

2 lines of code to solve the cost vs latency vs quality equation.

Save up to 99% on AI spend.

dashboard screen

You're in good company. Trusted by next gen startups.

True
pouncer
dotcal
Features

What does it do?

Enabling you to test any model and see the effect on your business metrics.

A/B test everything

Test any provider, model, prompt and parameter. We will show you the effect on the business metrics that matter to you.

Track what matters

We automatically track latency, errors and cost. You can also add custom metrics that matter to you such as NPS, CSAT or User Feedback.

Continuous testing

We can set up continuous tests that will automatically test new models as they are released so you will always have the cheapest, fastest and best quality model for your use case.

Full data analytics

We provide full analytics on the your application beyond just the experiments you run. Logs every request, response and error. Save data for fine tuning or run alternative evals on past data.

features diagram

Set up a demo with our team

Speak to a human about how Props can help you.

For Developers

Integrate in less than 5 minutes

Getting started is easy, just follow a few simples steps. We are here to help if there are any implementation issues you face.

Python
JS/TS
Step 1: Update configuration object
code block

Tokens Processed

200M+

Latency

~20ms

Uptime

99.999%
Step 2: Add unique identifier to each request
code block
Pricing

Options for everyone

We offer a range of plans to suit your needs. Whether you're just getting started or need to migrate a large user base, we have a plan that will work for you.

Trial

Pilot

No credit card required

Up to 10k requests per month

All Features

Prebuilt dashboards

Email Support

Custom

Startup

Call Us

Up to 100k request per month

Dedicated onboarding & support

Data processing & storage

Instant insight dashboards

Custom

Enterprise

Call Us

Custom integrations

Compliance & SLAs

Custom dashboards

Dedicated Support

Frequently asked questions

Everything you need to know about our product.

How does Props AI work?

Will Props add latency?

Do you support streaming?

Do you support image generation?

Do you support the assistant API?

Can I cancel my subscription at any time?

What payment methods do you accept?

avatars

Peter Kirkham

CEO & Founder

Book a call with the founder

Here to help you with any questions you have about Props AI

Schedule Demo