An Ad Lab test got "Add To Carts" or "Purchases", but wasn't a top outlier. Should I use it?
Edited
Occasionally, an Ad Lab test (Headline/Creative/Primary Text) will receive add to carts or purchases while running, but not score a high "outlier probability" percentage.
So... the question is: should I use it?
Generally speaking, while Ad Labbing, we use Unique Outbound CTR as our core indicator of larger market intent. But ultimately, it is worth considering additional metrics like Add To Carts or Purchases that occur.
If there's a high volume of actions, then it's worth considering counting that test as an outlier, regardless of Unique Outbound CTR.
If there's a low volume of actions (ex: 1-2), then we don't consider it an outlier and proceed to select outliers based on Unique Outbound CTR.
outlier
ad lab
purchases