Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Q&A

Welcome to the Power Users community on Codidact!

Power Users is a Q&A site for questions about the usage of computer software and hardware. We are still a small site and would like to grow, so please consider joining our community. We are looking forward to your questions and answers; they are the building blocks of a repository of knowledge we are building together.

Comments on Is running AllDup on two folders separately faster, than running it once on both folders together? How does splitting files affect performance?

Post

Is running AllDup on two folders separately faster, than running it once on both folders together? How does splitting files affect performance?

+0
−2

I use AllDup to find and delete duplicate or similar pictures. To keep my question simple, suppose I am searching two folders. I own both Asus and Lenovo computers, but their technicians gave opposite answers. Who’s correct?

My Asus technician claims that is it faster to run AllDup on the first folder and delete all duplicates before running AllDup on the second folder. Why? Because if you run AllDup once on n files, AllDup must compare files n! (n factorial) times – ths is called combinatorial explosion..

But my Dell technician said it does not matter whether I run AllDup on all files once, or separately on each folder. Both take the same time.

In general, how does

  1. running AllDup on n files

compare with

  1. dividing files into N subsets and running AllDup N times, once for each subset?
History

1 comment thread

Could you try both? (1 comment)
Could you try both?
trichoplax‭ wrote over 1 year ago

Have you considered copying the relevant folders, so you can try both approaches and see which is faster? You could then use your results to write an answer to your question (self answers are welcomed).