That is something I'll probably look into later. At least for lawless districts or areas that are not deemed completely safe (like Hamilton Square, Whitehaven and future Crystal Hills). 

A retreat option will also be built into the combat revamp when I start working on that after the slave update (0.8).