Best Practices

Tips for getting the most out of Versia

Best Practices

Simple tips that make a big difference.

Choosing Rewards

Match rewards to business outcomes

If you care about revenue, reward purchases, not clicks. If you care about engagement, reward actions, not page views.

Start with yes/no

Did the user convert? Yes = 1, no reward. Simple binary rewards work great for most flags.

One reward per flag

Each flag should have one clear success metric. Don’t try to optimize for multiple things at once.

Setting Up Flags

Start with 2-3 variants

Fewer variants = faster results. You can always add more later.

Use descriptive names

homepage-hero-cta is better than test-1. Future you will thank present you.

One experiment per page

Don’t run multiple reward-driven flags on the same page. It’s hard to tell which flag caused the conversion.

Running Experiments

Give it time

Reward-driven flags need traffic to learn. With moderate traffic (1,000+ evaluations/week), expect meaningful results within a few days.

Watch the dashboard

Check the traffic allocation chart. If traffic is shifting, the flag is learning. If it stays flat, check that reward events are being sent correctly.

Clean up finished experiments

Once a flag has clearly converged on a winner, you can convert it to a static flag. Keeps things tidy.

Common Mistakes

  1. No rewards. A flag without rewards can’t learn. Make sure you’re sending reward events.
  2. Wrong reward. Optimizing for clicks when you care about purchases. Match rewards to outcomes.
  3. Too many variants. 10 variants takes much longer to optimize than 3. Start small.
  4. Very low traffic. Reward-driven flags need data. If a flag gets <100 evaluations/week, a static flag might be better.

Next Steps

← Flag Configuration