Derivative Free Methods of Optimization: Trust Region Method and Direct Search Method

Abstract

In this report, I applied non derivative methods as optimization techniques to find out the maximum or minimum value for different kinds of functions through computational methods. In the process, I have analyzed functions that are not differentiable or have high complexity with optimization output and tested the effectiveness of the methods during such cases. Also, I have analyzed the computational advantages of these methods over prevailing methods of optimization and its extent