The SoundButton itself (which is a FrameLayout) is added to the GridLayout, so we have to remove the SoundButton and not its TextView. Further more the index of a SoundButton must be determined dynamically.