Yeah, it is obvious that you get money back from Cash app after cancelling the payment. But, you can see that the Square app works on instant deposit so the transaction gets successful within a second, so there is not any option to cancel payment. If you still want to cancel payment, then go to your activity feed section and search for any pending payment status.