In mixing bowl cream together peanut butter and butter with mixer on medium speed until creamy.
Add in the vanilla and powdered sugar and mix to combine.
Add in the milk to make the frosting your desired consistency. You may need more or less depending on your preference.
Whip until smooth.