Text Deduplicator
Remove repeated lines. Keep the first occurrence.
Local processing · UTF-8 files · input up to 1 MiB · up to 20,000 lines or CSV records. Nothing you enter is uploaded.
Result
Your result will appear here after processing.
How do I remove duplicate lines?
Paste text or choose a UTF-8 text file, select your comparison options, then choose Remove duplicates. Copy or download the result.
What stays unchanged?
The first occurrence of each line keeps its original spelling and surrounding whitespace. Output keeps the original order and uses LF line endings. A final line terminator is not counted as an extra empty line.
How do comparison options work?
Ignore case compares lowercase text. Ignore surrounding whitespace trims only the comparison key. Ignore empty lines skips whitespace-only lines. With all options off, lines match exactly.
What are the limits?
Input is limited to 1 MiB and 20,000 lines. Empty results are valid when all lines are skipped. Text is processed locally and is cleared when you leave or reload this tool.