No, you do not need to add all organizational units in caralegal. If certain organizational units do not process personal data, you can omit them from the system.
caralegal allows you to flexibly decide which units or departments should be included based on their involvement in the processing of personal data. Focus on including only the relevant organizational units involved in data processing and exclude those that are not.
Here you can find more information on setting up organizational units.