Accidental thieving

After checking out the thieving levels of everyone at my location to see who would give me the quickest travel time across the island, I thieved someone and suceeded instead of getting my speedy travel to the jail.

You stole 1024 gold from xxxxxxxx, without anyone who saw you doing it

One half of me is thinking I should give the gold back, the other half is saying that its part of the game and the prize for spending time levelling the skill. The later half won the argument, im keeping the gold ;)