It supports RandomSearch, BayesianOptimization, and Hyperband. Can run locally or in a distributed setting. It's possible to have both multi-device single-model training (one machine training one model over 8 GPUs) and distributed search (many models in parallel) at the same time