SP 2013 server Search Service Application configuration advice needed.

Hi SharePointers! I need your advice on how to configure Search Service Application on SP2013 server [15.0.4719.1000].

Servers: 1WFE, 1APP, 1 OWA all have 4 cores, 12GB RAM

My scenario: We have 2 site collections: one for Collaboration and one for Archiving. Content Organizer is used to root documents from Drop off to different folders based on rules. In Collaboration SC : When file meets all criteria and has all necessary metadata Content Organizer will move file to final location. This file will be processed by another team and marked as finished. Workflow will watch on file status and if it’s finished it will move the file to Archive SC drop off and leave an ASPX page with a link to moved file.

Also, in collaboration SC in library was enabled Enforce unique values on one field, and because we have an aspx page there after moving the file, this will prevent creating new duplications.

Tried index reset and no luck.

Now the ISSUE:

Incremental Crawl was scheduled to run every 15 min. Remove results duplication disabled. When users try to search by this unique filed ideally 2 results should come: one for ASPX(shortcut) page from Collaboration SC and one for file from Archive. But the reality is we have 3 results: previous 2 and result for moved file before it was moved with status different of Finished like it is a previous version. This last URL will display “The webpage cannot be found 404”. And this is normal file no longer exists there because it was moved to archive SC.

Issue is fixed every time full crawl is running, but I cannot run it every 4-6 hours to do the cleanup. Maybe you guys know any Search Service application configuration to improve the cleanup of moved files? Thanks a lot and really hope for your advice!