You should call the local Police in his town - explain to them what has happened and file a report.
Ask them for advise while you are on the phone.
Get it all on the record.
Then call that guy, and ask for your deposit back - give him your police report number.
Don't be intimidated - you have not done anything wrong.