and removing the duplicatesNot worrying about duplicates makes my photo management easier. [0]
But not worrying about culling changed everything for the better. [1]
Basically, I treat photographic storage as write-only. Since every digital photograph is tagged with a date when it is made, date is the primary key. Sure sometimes it's wrong. So what? Being wrong is not going to launch the missiles.
Survival is why we manage photographs (otherwise we would just delete them and make our life easier). Dealing with duplicates and poor images when searching/viewing is a distant second. It is not the thing to optimize around (outside of commercial uses).
Deduplicating and culling are massively time consuming, require mental focus and our mistake prone. The mistakes are not just technical the are aesthetic and editorial. Editorial mistakes are of the "Now that they are dead I wish I had more pictures of them" variety.
Aesthetic mistakes are because my current aesthetic judgement is worse than my future aesthetic judgement...or my current aesthetic judgement is better than my past aesthetic judgement. I went through a period where I took a 25k photos a year and rated them all. In the years since, many many of those ratings were naive. Lower rated pictures are often much better than higher rated ones.
Thankfully I kept the lower rated ones and bought more storage to solve that problem. [2]
Good luck.
[0] The more copies you have the more likely an image is to survive.
[1] The only culling I do is of total garbage (e.g. the lens cap was on) and then only sometimes because usually it doesn't matter.
[2] and fortunately I don't do much video because then culling and deduplicating is economically more important.