Physix Frontier · News Briefing Card (Hacker News · Oct 24, 2026)

H2O.ai forks jdupes, targeting data safety and dedup speed

KEY FACTS

H2O.ai has created a fork of jdupes on a code hosting platform.
jdupes identifies and handles duplicate files, supporting deletion, hard links, symbolic links, and block-level deduplication.
Tests show jdupes averages more than 7 times faster than fdupes-1.51.
jdupes offers a native Windows port with support for Unicode and other Windows features.
jdupes matches only 100% identical files and does not provide similarity matching.

KEY DATA

more than 7xAverage speed multiple vs fdupes-1.51

1023Max hard links per file on Windows

PHYSIX OBSERVATION

H2O.ai taking over the jdupes fork shows it values the balance between data safety and deduplication speed. For users, this means the tool may receive more sustained maintenance; but the fork also brings compatibility risks, and existing fdupes users should watch for differences in later versions. Deduplication tools are shifting from pure speed to safety first, a signal worth noting.

Source: Hacker News report