For many reasons you may be dealing with a standard text file and you want to know if there are any duplicate lines:

Here's how you do it:

cat filename|uniq -c

The "uniq -c" program counts how many time each line occurs.