HTL recommends the that you conduct the following QA steps before going live.
Pre-launch Staging Check
Setup HTL BID on a staging site before launching. This will give you the opportunity to compare staging and production side-by-side to ensure that all ads appear in precisely the correct location, before going live.
- https://htlbid.com/stage/v3/example.com/htlbid.js should be used on staging
- https://htlbid.com/v3/example.com/htlbid.js should be used on production
- Check each different page type (homepage, articles, etc)
- Ensure that all ads appear in exactly the right location
- Ensure that all GAM ad units are the same on staging vs production
- In the console, type
htlbid.versionId
to check the version number - Verify this number matches the version you expect to be live
- Append
?pbjs_debug=true
- Check that bid request are sent
- Check that prebid key-values are set
In the web developer tools console, you should see something like this
- Check in GAM
- Check Prebid placement contains ad units
is_testing=yes
for is_testing=no
)Launch check
Perform the following checks immediately after launching.
- https://htlbid.com/stage/v3/example.com/htlbid.js should be used on staging
- https://htlbid.com/v3/example.com/htlbid.js should be used on production
is_testing=no
Post-launch Check
Perform the following checks 24 hours after launching. This helps to ensure that nothing was dropped during the migration process.
Dimensions
- Ad Units
- Orders
- Date (using the last 7 days)
Metrics
- Impressions
- Revenue
- Requests
The report should show all ad units sending requests across all Prebid orders and other programmatic ad networks (I.e. AdX). If there are any blank, there could be a missing Prebid Group association in the HTL BID UI or another configuration error (I.e. Ads.Txt). It will also let you know if any SSPs could have issues (such as incorrect IDs in the system if no impressions are registering)
Process Best Practice
Perform a new deployment, HTL recommends that you perform a quick spot-check.
If the issue reported is critical, such as:
- Overlapping/floating ads blocking content
- Ads freezing the page
- Security redirects/page takeovers
Do the following:
- 1. In Version Control deploy the previous revision that was working to Production
- 2. Deploy the revision that caused issues to staging only
- 3. Use the staging site to debug the issue
- 4. If there is no staging site available, use a proxy such as Charles or the Chrome Dev Tools Sources Override to troubleshoot the problematic revision. If none of these are available, reach out to the HTL Team for assistance at cs@zendesk.hashtaglabs.com