Police have arrested a man who was allegedly armed with a gun and threatening residents at Bowraville, south of Coffs Harbour.