команда Uniq в Linux
The uniq command can count and print the number of repeated lines.
Just like duplicate lines, we can filter unique lines (non-duplicate lines)
as well
and can also ignore case sensitivity.
We can skip fields and characters before comparing duplicate lines
and also consider characters for filtering lines.
Vitalik-Hakim