When you want to scale the number of A/B tests to do many experiments at the same time, you need to adopt your processes and platform, and it might also impact your culture. Doing product research with controlled experiments helps to confront your ideas about how customers will use your product in reality, and check if those ideas actually impact user behaviour.
Patrick Debois, founder of DevOps Days conferences, together with AWS's Trent Peterson and Etsy's Nassim Kammah, are organizing Mobile Delivery Days, a new conference for discussing the entire mobile delivery tool chain, from building and testing to publishing automation, production support (logging, instrumentation, monitoring) and (A/B) testing.
Parse has announced Push Experiments, a feature that allows to conduct A/B tests for campaigns based on the use of push notifications, which are often deployed to re-engage users in mobile apps. Push Experiments will allow to evaluate different messaging strategy and choose the one with the highest open rate, say Parse.
Facebook engineers Slobodan Predolac and Nicolas Spielberg have recently described how they "solved a long-term mobile debugging problem and reduced the crash rate ... by more than 50 percent." In the process, they show general useful techniques and a few Facebook tools that can help with large, rapidly evolving codebases.
Behavioral testing of mobile applications is becoming more and more important for a huge number of companies. Splitforce launched a tool suite to optimize mobile applications by A/B-testing in 2013. Now, Splitforce launched an updated version of its tool suite with functionalities like user-targeting, tests based on behavioral data or auto-optimization.
PlanOut is Facebook's language for online field experiments supporting "A/B tests," factorial designs, and more. According to Facebook, PlanOut makes possible to separate experimental design from application code and allows experimenters to concisely describe their designs. Facebook claims to be using PlanOut to run over a thousand experiments each day that involve hundreds of millions of people.
Best.ly offers support for A/B-testing mobile applications without the need for code changes and resubmitting to an app store. Currently, there is only a native library for the iOS platform but libraries for the Android eco-system are already in development and will be available soon. Experiments can be administrated online, adjusted during runtime and monitored in realtime.
Mobile Backend as a Service provider AnyPresence continues to hone their chops. Launching the fifth update to their self-titled platform geared for the enterprise. Co-founder Rich Mendis provides some insights for InfoQ readers…
Companies use "Canary Deployments" to test software in production by routing a subset of users to new functionality as part of continuous delivery according to Nolio in their 1st video in a series about DevOps Best Practices. A "Canary Deployment" is a type of incremental release performed by deploying a new version of software side by side with its production version counterpart.