sopt is a simple python optimizer libry.Currentlly,it includes some stochastic optimization algorithms,like Genetic Algorithm(GA),Particle Swarm Optimization(PSO),Simulated Anealing (SA),Random Walk(and its improvement version),and some gradient based optimizers,like Gradient Descent,Momentum,AdaGrad,RMSProp and Adam Optimizers.For the GA optimizers,it includes many kinds of different selected methods,mutation methods etc,as well as for PSO and other optimizers, so you can try many different kinds of optimizers with different settings,all the stochastic optimization also supports the non-linear complex constraints by using penalty methods or dropout-bad-solution methods.

Please go to sopt for more details!