Users can't be permanently deleted from the system.
Instead, you can archive users, which hides them from active lists while preserving their profile and training history. See How do I archive a user?
As an employer, you're expected to keep records of your employees' training. Industry guidance recommends retaining these for 6 years after an employee's leaving date.