You can't delete departments, but you can filter the list show a smaller range of departments.
NOTE: In v29 and above, you can search for records within the Departments module.
- Click Departments then click Filter.
- Enter your filter, click Apply then click Close. Use our how do I filter my lists? article to do this.