Preheat your oven to 350°F (175°C). Grease the 9x13 inch baking dish with cooking spray or butter.
In a large mixing bowl, combine the yellow cake mix, water, vegetable oil, and eggs. Beat with a whisk until smooth and well combined, about 2-3 minutes.
Pour the batter into the prepared baking dish, spreading it evenly.
In a small bowl, mix the ground cinnamon, brown sugar, and granulated sugar together. Sprinkle the cinnamon-sugar mixture evenly over the cake batter.
Using a knife or a spatula, gently swirl the cinnamon mixture into the batter, creating a marble effect.
Bake in the preheated oven for 25-30 minutes, or until a toothpick inserted into the center comes out clean.
While the cake is baking, prepare the glaze by whisking together the powdered sugar, milk, and vanilla extract in a small saucepan over low heat. Stir until smooth and heated through, then remove from heat.
Once the cake is done baking, allow it to cool in the pan for about 10-15 minutes on a cooling rack.
Drizzle the warm glaze over the warm cake before serving.