Overview
At some point in the development of your apps from the Brightcove {{ site.product_short }} Experience you will be given test builds to be sure the apps are behaving as you wish. This document will provide information on each of the following:
- Testing categories: Define broad areas for testing.
- Tips: Suggestions and insights to follow when performing the testing.
- Reporting: The procedure to following if you encounter issues in your testing.
Before you start
Be sure you are setup for proper testing. Ensure the following:
- Testers have all the needed testing devices at hand.
- For compatibility's sake, the devices used for testing should be no more than three years old. Later in this document specific, required minimum versions will be specified for each platform.
Testing categories
Brightcove recommends the following areas be tested and questions answered:
-
Design and Features:
- Does the experience match the agreed upon mock-ups?
- Is all the requested functionality available?
-
Page Layout and Content:
- Are the pages setup as expected?
- Is the expected content showing up in each of the pages?
-
Monetization Setup:
- Are ads appearing as expected?
- Are subscriptions showing for correspondent assets?
- Can the users purchase and get entitled to content as expected?
Supported platforms and versions
The following lists the supported platforms and versions that should be used to guide your testing.
- Web
- Chrome – Current version and current-1 version
- Safari - Current version and current-1 version
- Edge - Current version and current-1 version
- Firefox - Current version and current-1 version
- Apple iOS (mobile/tablet)
- Apple iOS 13 and higher
- For additional information see the Installing an iOS/tvOS Test Build document
- Apple tvOS
- tvOS 12 and higher
- For additional information see the Installing an iOS/tvOS Test Build document
- Google Android
- Android 6.0 and higher
- For additional information see the Installing an Android Test Build document
- Google Android TV
- Android 6.0 and higher
- For additional information see the Installing an Android Test Build document
- Roku
- Roku OS 11 and higher
- For additional information see the Installing a Roku Test Build document
- Amazon Fire TV
- Fire OS 6.3 and higher
- For additional information see the Installing a Fire TV Test Build document
- Samsung Smart TV
- Tizen 2023, 2022, 2021
- Sony Bravia Smart TV
- Android TV 6.0 and higher
- Toshiba Smart TV
- Android TV 6.0+ and higher and/or Fire OS 6.3 and higher
- For additional information see the Installing an Android Test Build document
- LG Web Os
- 5.0 and higher.
Tips
Please consider the following tips when performing your validation:
- First pass: Choose ONE of the platforms and go through the different areas of testing on that platform. Start with Design and Features, then move on to Page Layout and Content and lastly to Monetization Setup testing.
- Additional rounds of testing: As you finish the first pass for each area, move on to other platforms that are available. If an issue is applicable to multiple platforms, please note that in any previously reported tickets.
-
Testing fixes: Fixes for reported issues will be in one of these three areas:
- The Brightcove {{ site.product_short }} Experience (no app updates needed)
- In the app(s)
- The Brightcove {{ site.product_short }} backend
If the fix is in the app, a new build will be provided with details of what was fixed. For other areas, Brightcove would provide details in the ticket on what was fixed. To speed up fixing and retesting, it is very important that the tickets provide details on the issue, and steps to help with retesting.
Reporting
Brightcove recommends that you report issues as you encounter them to keep the feedback flowing to Brightcove and have the issues fixed and turned around for validation as quickly as possible. Please report one issue/ticket per problem and provide the following information in each issue/ticket:
- Platform tested
- The app version in which the issue was found
- Steps to reproduce
- Please include screenshots or screen movies to help speed up identifying the problem and providing a resolution