Smart-sized Benchmarking for Black-Box Optimization
author: Tome Eftimov, Computer System Department, Jožef Stefan Institute
published: Sept. 1, 2023, recorded: August 2023, views: 0
Related content
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Watch videos: (click on thumbnail to launch)
Description
Moving to the era of explainable AI, a comprehensive comparison of the performance of single- and multi-objective stochastic optimization algorithms has become an increasingly important task. A crucial role in performing a performance assessment is the benchmarking process. This course will focus on providing details for the following parts of the benchmarking process: which optimization problems should be selected for the analysis to decrease the bias in the analysis; which performance measures should be collected and analyzed; and what is the appropriate statistical approach to analyze the performance data that will lead to more robust and reproducible outcomes. This course will provide an overview of the current approaches for analyzing algorithms’ performance with special emphasis on caveats that should be more often noticed. The course will end with a demonstration of a web-service-based framework (i.e. DSCTool) for statistical comparison of single- and multi-objective stochastic optimization algorithms.
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !
Write your own review or comment: