Handle Duplicate DID issue

**Is your feature request related to a problem? Please describe.**
Currently we are facing duplicate DID issue. So we want solve it dynamically from the jobs.

**Describe the solution you'd like**
Add a excpetion of duplicate did and then:
create a dataset to delete and attach the dataset to that file and delete the dataset via rule expiration.
@rahmans1 , the deletion on the backend will take some time.

Start by locating the job code that handles DIDs and the existing dataset and rule-expiration configuration. Reproduce the duplicate-DID case, then verify that the job records the duplicate, creates a deletion dataset, attaches it to the file, and relies on rule expiration for backend deletion.

Written by the indexing model from the issue text.