Tony Saxon claimed Ye didn’t pay him to deconstruct a $57 million mansion.