Which type of optimization algorithm is commonly used in training deep neural networks to adjust weights based on gradients?

• A) Stochastic Gradient Descent (SGD)
• B) Genetic Algorithms
• C) Simulated Annealing
• D) Ant Colony Optimization