Preheat your oven to 350°F (175°C). Line a muffin tin with paper liners or grease with cooking spray.
In a large mixing bowl, whisk together the flour, baking soda, and salt.
In another bowl, combine the mashed bananas, granulated sugar, brown sugar, melted butter, egg, and vanilla extract. Mix well until fully combined.
Pour the wet ingredients into the dry ingredients and mix until just combined. Do not overmix.
In a small bowl, combine the flour, granulated sugar, brown sugar, and ground cinnamon. Cut in the cold butter using a fork or pastry cutter until the mixture resembles coarse crumbs. Stir in the nuts if using.
Divide the muffin batter evenly among the muffin cups, filling each about 3/4 full. Sprinkle the streusel topping generously over each muffin.
Bake in the preheated oven for 18-22 minutes, or until a toothpick inserted into the center comes out clean. Allow muffins to cool in the tin for a few minutes before transferring to a wire rack to cool completely.
In a small bowl, whisk together the powdered sugar, milk, and vanilla extract until smooth. Drizzle over the cooled muffins.