Is there a way to compare two text files?
For instance if I have one text file for urls to visit and another for urls already visited , is there a way to compare if the first file has urls from the second list, and if so scrub that list to a new text file?
Example:
urls_visited.txt contains:
url1.com
url2.com
url3.com
and
Urls_not_vitisted.txt contains:
url1.com
url5.com
url4.com
Result Needed: (Scrubbed)
Urls_To_Follow.txt contains:
url5.com
url4.com