Preheat the Oven: Preheat your oven to 350°F (175°C). Line baking sheets with parchment paper or silicone mats.
Prepare the Dough: In a medium bowl, whisk together flour, baking powder, baking soda, and salt. In a large bowl, cream together the butter and sugar until light and fluffy. Add the egg, lemon zest, lemon juice, and vanilla extract; mix until incorporated. Gradually add the flour mixture to the butter mixture and mix until just combined.
Shape & Bake: Using a 1 ½ tablespoon scoop, drop dough onto prepared baking sheets, spacing about 2 inches apart. Bake for 10-12 minutes, or until edges are lightly browned. Cool on racks.
Prepare the Icing: In a small bowl, whisk together powdered sugar, lemon juice, milk, and lemon zest until smooth. Ice fully cooled cookies and let set on racks.