Elevating the Impact of QA at Flipboard - Testlio · Flipboard is known for having a beautiful...
Transcript of Elevating the Impact of QA at Flipboard - Testlio · Flipboard is known for having a beautiful...
Elevating the Impact of QA at FlipboardHow Testlio Enables Consistent and Delightful User Experiences
CASE STUDY
Stories that Change the World
BACKGROUND
Digital magazine platform Flipboard is a fan favorite for curating and devouring content from a
variety of sources. Since its start in 2010, Flipboard has added thousands of publishers on its
platform, tens of thousands of topics and its community of 100 million active monthly users is
curating over 30 million magazines. Readers flip through, save, and share articles across mobile
(iOS and Android) devices and on the web.
“What makes our app unique is that the content on our platform is very dynamic,” says Anna
DeSilva, QA Software Engineer at Flipboard. “We have to make sure that no matter what
content is being displayed and how the user is interacting with it, that the app performs
perfectly.” Users can discover content based on their interests and can follow other users for
the latest in a vast array of niche categories, from aviation to zoology.
A Design-First Product
CHALLENGE
The variety of devices and environments puts extra pressure on the QA team to maintain an
excellent experience for Flipboard users across the globe. “We want to make sure that our
application is working great in every single environment,” says DeSilva. “That’s the most
challenging thing for us.”
Flipboard is known for having a beautiful interface so intuitive it’s almost addictive. “We’re a
design-first team,” says Barrie Levinson, Head of Program Management and Product
Operations. “Flipboard is a better way to collect a lot of information about all the things you’re
interested in or passionate about into one very pleasant and delightful reading experience. It’s
a very UI heavy app which means it can be hard to automate, so manual testing is a really
important aspect of promoting the user experience.”
Product complexity, device coverage, and UI
functionality all result in a high need for
manual testing, which can really overwhelm a
lean QA team. Flipboard had worked with an
external testing solution before but it felt
impersonal, lacked communication, and didn’t
impact the quality of the product.
In 2015, the team decided that it was time for
a change in how they approached quality
assurance. Levinson and others at Flipboard
identified several solutions, and chose Testlio
because of the dedicated team, customized
test management, and immediate feedback.
“That philosophy of really caring about the
product almost as much as we do is one of
the reasons that when we went through the
selection process a year and a half ago we felt
really comfortable working with Testlio,” says
Levinson.
Anna DeSilvaQA Software Engineer
at Flipboard
“The platform makes itvery easy to maintain
communication and very convenient for me to triage bugs. The reporting system
is great. The way it’s organized is very
straightforward. It’s a component of the commu-
nication flow as well.”
DeSilva provides a test plan for each cycle, and Testlio’s QA manager then divides up the
structured exploratory tasks. Use cases without set scripts allow Testlio’s skilled testers to
approach each case from multiple angles, while the test plan keeps everyone on track with
Flipboard’s upcoming releases.
DeSilva uses Testlio’s test management platform to communicate with the testing team. “The
platform makes it very easy to maintain communication and very convenient for me to triage
bugs,” says DeSilva. “The reporting system is great. The way it’s organized is very
straightforward. It’s a component of the communication flow as well.”
Testlio’s experienced testers deliver a focus on the customer that’s characteristic of the overall
partnership. In addition to receiving well-organized and prioritized issues, DeSilva’s team also
receive suggestions and improvements that can be forwarded to the developers. “The testers
do care if the user experience is good enough and the app is intuitive enough,” she says.
“Working with Testlio feels like working with another startup,” says Levinson. “The team is
dynamic, they care.”
Barrie LevinsonHead of Program Management
and Product Operations at Flipboard
“Testlio feels like an extension of our own team and capability.”
Fast and Flexible Testing (Weekends Included)
SOLUTION
By quickly adapting to release cycles, Testlio
offers a lot of flexibility to Flipboard. “We run
pretty lean so we count on Testlio,” says
Levinson. “From a project management point
of view, weekend cycles put Testlio squarely
on a critical path for us.” The team typically
submits to app stores on Monday or Tuesday,
and will spend those first couple days of the
week triaging the bugs found.
Testlio helps enterprises deliver amazing customer experiences by providing a community of highly vetted testers and an end-to-end QA management platform.
Learn more: testlio.com
fb.com/testlio
twitter.com/testlio
Ready for QA that feels like part of the team?Visit testlio.com
“Testlio feels like an extension of our own
team and capability,” says Levinson. Testlio
helps Flipboard improve quality on every
device in every location where users rely on
the app for stories that change the world
from inside its elegant interface. Barrie LevinsonHead of Program Management
and Product Operations at Flipboard
“Manual testing is a really important aspect of promoting
the user experience.”
Lean QA with Maximum Impact
RESULT
With Testlio on board, the Flipboard QA team has been able to improve on all methods of
quality assurance. “We can count on the coverage for manual testing that lets our employees
work on automation concurrently,” says Levinson.
Partnering with Testlio also means Flipboard can maintain an excellent user experience despite
organizational changes. “The company is growing and changing and we’re still trying to do very
aggressive things,” explains Levinson. “Even with some changes in the team—both with
engineering and QA—we’ve been able to keep a really consistent and high level of QA service
for the organization.”