I know you can paint weights however it would be nice to be able to add or subtract verts from the attachment after its already been made
You were almost there. Painting a non-zero value "adds" the attachment point.
Painting a value of absolute zero "removes" it.
Use this one in the artisan tool to make sure it's painting absolute zero for removing:
hehe nice thats actually awesome. Thanks!