What do you like best?
What we love the most of Dynamic Yield is how easy it is to create experiments that let us compare 2 or more variations. The feature of targeting the right users/pages/context for the experiment cover pretty much everything we wanted and the process of setting it up is very easy.
The recommendation engine is another feature that we love. It's very easy to try different strategies to understand what performs best in each case, and using the templates you can save tons of work to set up new recommendation experiments (yes, every feature is an experiment from now on). Moreover, the direct revenue and assisted revenue metrics give great insight on what is just holding the user on the site and what actually shows what users wanted to buy (both are great results though).
What do you dislike?
One thing that we find limited is the rules you can set in the strategy for the recommendation. Especially the similar products one has the possibility to define fields that must match and field that must not match: we'd like the configuration to be more flexible.
Another thing we struggled with is the product feed. We have a different price list for different countries and we handle multiple languages. Representing all those information in one feed is pretty hard, and moreover, there's a strong limitation on the number of fields available for the feed. Basically, the product feed engine should be boosted.
Talking about the reports, it would be amazing if the system would give the result of an experiment not only viewing it for all users, but even segmenting the audiences: in this case the system lets you see the raw data, but you have no indication whether the test is performing good, whether you have enough data to take decisions, and so on
Recommendations to others considering the product
If you want a tool that let you easily modify your UI, acting directly on your final HTML, personalizing the experience for your users and collecting data for understanding which variation performs better for which audiences, this is the tool for you.
Some of the goals we reached after 6 months:
- if we were using just the recommendation widget, we would have had a ROI of 2.5x considering the whole investment on Dynamic Yield.
- testing messages on the cart, we saw a 7% uplift of conversion rate for that page. Moreover, we discover that the message doesn't work at all in certain countries, and we are about to test other hypotheses for these countries
- testing new ways to make the user subscribe to our newsletter (basically different UIs and positions) we incremented the email subscription of 200%
What business problems are you solving with the product? What benefits have you realized?
It lets you testing hypothesis without having aa big impact on the development processes (generally). If a company want to dive in the CRO approach, testing almost everything, a tool like Dynamic Yield really help.
Moreover, it gives you some features like product recommendation right out of the box, with several strategies you can use and test to understand which one performs better