Text file line sort/duplicate remove app? - GoFuckYourself.com

acctman · 07-18-2008, 05:26 PM

anyone know of an app that will remove all duplicate line in a text file and then sort everything?

I usually use UltraEdit but lately i've been noticing it does not sort properly when a like has a space is it (ie User 1 is sorted as User and then 1 on another line, when it should be User 1 together)

camgirlshide · 07-18-2008, 08:03 PM

I like php myself

fris · 07-18-2008, 08:34 PM

http://www.rightscripts.com/listrearrange/

brandonstills · 07-18-2008, 10:59 PM

sed and sort from the unix command line.

Zebra · 07-18-2008, 10:59 PM

EditPad Pro does it easy.

woj · 07-18-2008, 11:12 PM

like someone pointed out earlier, unix command line tools is the way to go

BigBen · 07-19-2008, 01:24 AM

In a shell:

Code:

&#37;sort -u file.txt

or output to another file:

Code:

%sort -u file.txt > newfile.txt

Supz · 07-19-2008, 01:30 AM

ms excel has a pretty good tool in it in office 2k7

acctman · 07-19-2008, 03:52 PM

Quote:

Originally Posted by fris

http://www.rightscripts.com/listrearrange/

thanks. i'm going to try this one out on my inhouse linux box

07-18-2008, 05:26 PM	#1
acctman Confirmed User Join Date: Oct 2003 Location: Atlanta Posts: 2,840	Text file line sort/duplicate remove app? anyone know of an app that will remove all duplicate line in a text file and then sort everything? I usually use UltraEdit but lately i've been noticing it does not sort properly when a like has a space is it (ie User 1 is sorted as User and then 1 on another line, when it should be User 1 together)

07-18-2008, 08:03 PM	#2
camgirlshide Confirmed User Join Date: Jan 2005 Posts: 1,558	I like php myself __________________ Useful adult webmaster links - Alphabetical list of solo models with webcam Stats on my best converting affiliate programs - camgirlshide webmaster blog complete list of affiliate programs I use.

07-18-2008, 10:59 PM	#4
brandonstills Confirmed User Join Date: Dec 2007 Location: Chatsworth, CA Posts: 1,964	sed and sort from the unix command line. __________________ Brandon Stills Industry and programming veteran [email protected] \| skype: brandonstills \| ICQ #495-171-318

07-18-2008, 10:59 PM	#5
Zebra Banned from Kimmy's couch Industry Role: Join Date: Oct 2001 Location: Down at Fraggle Rock Posts: 5,091	EditPad Pro does it easy. __________________ Old School

07-18-2008, 11:12 PM	#6
woj <&(©¿©)&> Industry Role: Join Date: Jul 2002 Location: Chicago Posts: 47,882	like someone pointed out earlier, unix command line tools is the way to go __________________ Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000 Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager

07-18-2008, 08:34 PM	#3
fris Too lazy to set a custom title Industry Role: Join Date: Aug 2002 Posts: 55,262	http://www.rightscripts.com/listrearrange/ __________________ Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence. WP Stuff

07-19-2008, 01:24 AM	#7
BigBen Confirmed User Join Date: Nov 2004 Location: scv Posts: 2,299	In a shell: Code: %sort -u file.txt or output to another file: Code: %sort -u file.txt > newfile.txt Last edited by BigBen; 07-19-2008 at 01:26 AM..

07-19-2008, 01:30 AM	#8
Supz Arthur Flegenheimer Industry Role: Join Date: Jul 2006 Location: New York City Posts: 11,056	ms excel has a pretty good tool in it in office 2k7