ABsolutely: A/B Testing

We spent some time evaluating different Apps that support A/B testing, and decided to go with ABsolutely as it seemed intuitive and easy to setup. It's been the right decision so far. Echoing other reviews, the support is fantastic. Ika and the team are extremely prompt and responsive in helping answer any questions you may have. Additionally, they took the time to implement a fix right away so that the price tests would not impact our blended B2B store pricing. The analytics are fantastic, with the ability to drill down/filter by individual products, and not only view the summary results but also view the raw data if needed. We've been extremely happy so far and are certain that we picked the right App.

Update: They did reply. Most issues are unresolved but may be outside of their control. 1 issue is arguably user error / arguably UX defect (my bias as a customer is that it's a UX defect).

Delay in response to a pri 1 issue seems to be from having recently switched support platforms.

I need more time to evaluate and test things out, but am updating to 3 stars until I have a few days to do so.

I will say, 1 big plus and consideration for me to reinstall is they still have a human [that cares] in the loop for issues like this - while most companies are opting into lower effort/quality support solutions.

--------------------------------------------
Original:
tl;dr site is now unreachable for returning customers.

I try to avoid leaving negative reviews unless there's something egregious.

A test was having 2 issues. 1. not aggregating sales results correctly. 2. Showing data "A" on site but data "B" at checkout, resulting in customer confusion. Not my first and only issue with the app, nor an issue bad enough to result in 1 star (though it's a pretty big customer impacting issue).

1 star because after ending this test in question, users can no longer reach our site (ERR_TOO_MANY_REDIRECTS). The only way to reach our site now is if the user clears cache, but realistically there's no way to share that information with a customer. The conclusion customers reach is that the website it down.

I've had suspicions that how they handled A/B testing was a bit of a hack for awhile now, but it wasn't a large enough issue to act on.

I messaged them via their support system on Sunday, got an auto response that I will be emailed back due to it being the weekend. It is now mid-day Tuesday with no response.

Arguably I could allow for more time, but imo a site being unreachable is a priority 1 issue for immediate response.

Uninstalling the application did not result in a fix.

Really easy to use app, quite intuiative and you can have tests up and running in minutes. The customer service is also great. I had a big issue blocking me from getting the test live and they quickly jumped on it, listen to my (very poorly explained!) issues and help deliver a fix within 24 hours. I have been very impressed with so far.

We have a heavily customized store with some non-standard checkout logic, and running a price test on top of it turned out to be technically complicated. Absolutely handled it far better than I expected.

When we hit a conflict, they dug in and found the actual root cause. They came back within 24 hours with a working fix and had tested it themselves before telling us it would work.

They'd also already gone out of their way earlier to accommodate our catalog size so we could test everything we needed to, which is why we picked them over several alternatives.

Fast, responsive, and they actually understand what's happening under the hood. If you've got a setup that isn't cookie-cutter, these are the people you want.

One of the best customer service experiences I had with a Shopify App provider. Highly recommend!

Only AB testing app that can support Checkout Champ Analytics, which has been a game changer for us. Great support. And looks like they're coming for the big AB testing apps!

Really, really good split testing app. We have been using it for almost a month now and we find it very helpfull for our business. Also, we saw that a feature that we needed a lot was not implemented, but they were quick to develop it for us. Really nice support overall. Definetly recomending this app to any business who is looking to increase their numbers.
Thank you !

Been using this for a few months and it's solved a real problem for us. We sell into several regions, so price testing used to be guesswork - now we just run the test and look at the numbers. Setup was quick, no dev needed. If you're doing 30k+/month, this pays for itself ultra fast.

By far the best A/B testing app on Shopify. The analytics are excellent, and it costs about half as much as similar apps.

Fantastic support, Ika crushes it. App does what it says, and give you great analytics to boot!

ABsolutely has been the one-stop-shop for all of our A/B testing needs. Everything is very intuitive and easy to setup and understand