Spotify notes that this setting is device-specific, meaning your choice won’t sync to other devices. So you’ll need to turn the button off on all of your devices individually.