Anxiety over federal immigration detentions has gripped thousands of residents in the area and led many to limit the time they spend in public.