ABsolutely: A/B Testing

We spent some time evaluating different Apps that support A/B testing, and decided to go with ABsolutely as it seemed intuitive and easy to setup. It's been the right decision so far. Echoing other reviews, the support is fantastic. Ika and the team are extremely prompt and responsive in helping answer any questions you may have. Additionally, they took the time to implement a fix right away so that the price tests would not impact our blended B2B store pricing. The analytics are fantastic, with the ability to drill down/filter by individual products, and not only view the summary results but also view the raw data if needed. We've been extremely happy so far and are certain that we picked the right App.

Update: They did reply. Most issues are unresolved but may be outside of their control. 1 issue is arguably user error / arguably UX defect (my bias as a customer is that it's a UX defect).

Delay in response to a pri 1 issue seems to be from having recently switched support platforms.

I need more time to evaluate and test things out, but am updating to 3 stars until I have a few days to do so.

I will say, 1 big plus and consideration for me to reinstall is they still have a human [that cares] in the loop for issues like this - while most companies are opting into lower effort/quality support solutions.

--------------------------------------------
Original:
tl;dr site is now unreachable for returning customers.

I try to avoid leaving negative reviews unless there's something egregious.

A test was having 2 issues. 1. not aggregating sales results correctly. 2. Showing data "A" on site but data "B" at checkout, resulting in customer confusion. Not my first and only issue with the app, nor an issue bad enough to result in 1 star (though it's a pretty big customer impacting issue).

1 star because after ending this test in question, users can no longer reach our site (ERR_TOO_MANY_REDIRECTS). The only way to reach our site now is if the user clears cache, but realistically there's no way to share that information with a customer. The conclusion customers reach is that the website it down.

I've had suspicions that how they handled A/B testing was a bit of a hack for awhile now, but it wasn't a large enough issue to act on.

I messaged them via their support system on Sunday, got an auto response that I will be emailed back due to it being the weekend. It is now mid-day Tuesday with no response.

Arguably I could allow for more time, but imo a site being unreachable is a priority 1 issue for immediate response.

Uninstalling the application did not result in a fix.

Really easy to use app, quite intuiative and you can have tests up and running in minutes. The customer service is also great. I had a big issue blocking me from getting the test live and they quickly jumped on it, listen to my (very poorly explained!) issues and help deliver a fix within 24 hours. I have been very impressed with so far.