How to remove padding around button widgets in Android?

When using the default button widget in Android, you can see that the button comes with its own preset padding. When trying to stylize the button with a custom background, it gets really annoying to have this fixed background.

You can remove the padding around the button by using setting the minWidth and minHeight to 0.

<Button 
    android:minHeight="0dp" 
    android:minWidth="0dp" 
    ...

Now you can customize the padding by using the android:padding attribute