No manual configuration or distribution of hardware needed. Simpler scaling: just add more hardware in order to get more capacity.Increased parallelism for the tests all steps for a given tryjob or waterfall build run in parallel.The Swarming infrastructure ( new docs, older but currently more complete docs) provides many benefits: The physical hardware for the GPU bots lives in the Swarming pool*. For more details about the configuration of the bots, see the GPU bot details. This single capability is a huge step forward from the previous configuration where new steps were added blindly, and could cause failures on the tryservers. Additionally, the chromium and chromium_trybot recipes make it possible to send try jobs which add new steps to the bots. Compared to the legacy master-side buildbot scripts, recipes make it easy to add new steps to the bots, change the bots’ configuration, and run the tests locally in the same way that they are run on the bots. The GPU bots use the Chrome infrastructure team‘s recipe framework, and specifically the chromium and chromium_trybot recipes, to describe what tests to execute. Some of these tests verify just a few pixels, using handwritten code, in order to use the same validation for all brands of GPUs. Where necessary, GPU-specific results are maintained for these tests. Using the full browser to execute tests, rather than smaller test harnesses, has yielded several advantages: testing what is shipped, improved reliability, and improved performance.Ī subset of the tests, called “pixel tests”, grab screen snapshots of the web page in order to validate Chromium's rendering architecture end-to-end. The GPU bots launch the full Chromium browser via Telemetry for the majority of the tests. Telemetry directs the browser to perform various operations, like page navigation and test execution, from external scripts written in Python. Telemetry was originally conceived as a performance testing framework, but has proven valuable for correctness testing as well. Most of the tests on the GPU bots are run via the Telemetry framework. The GPU bots specifically focus on tests which exercise the graphics processor, and whose results are likely to vary between graphics card vendors. The GPU bots run a different set of tests than the majority of the Chromium test machines. Updating and Adding New Pixel Tests to the GPU Bots.Debugging Pixel Test Failures on the GPU Bots.Adding a new test to one of the existing test harnesses.Moving Test Binaries from Machine to Machine.Running Locally Built Binaries on the GPU Bots.Debugging a Specific Subset of Tests on a Specific GPU Bot.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |