Shopify Knowledge Base

Knowledge Base still needs a lot of foundational work, especially to be used reliably with Inbox.

Content hallucination. There's no control over AI hallucination, and the tool sometimes invents answers.
Test-and-learn scenarios should feed Knowledge Base more broadly. Right now they seem limited to a single conversation, when they should let the AI learn to adapt to the e-commerce store in question, for wider question coverage and training.
No control over the data source. We have no way to select or correct the data source used for a FAQ, which is surprising for a tool meant to accurately represent our brand. During testing, a URL was invented, along with other incorrect data. The FAQ creation system is a good idea, but it's missing key configuration options (data source, reliability, hallucination level...) to make the tool trustworthy.

A lot of non EN problems. It cannot compose a complex answer correctly. It relies on manual data to return actual information. It retries data from shopify injections not from actual store policies. Problems with EN questions versus real store language. As usual.

Excellent so far. Perfect as it logs all the questions and queries so you can see what customers are asking. Then you can add your custom "FAQ's" to help the Agentic system fill in its knowledge gaps.

It really simplifies the process for the front end Ai to help answer store relative and sensitive questions such as returns process, warranty, services and shipping information.

I think it could expand into some better training fields and add more but my sneaky feeling is Shopify is already building most of this into their features as they go.