What programming language allows for multithreading on a Unix box? - GoFuckYourself.com

Angry Jew Cat - Banned for Life · 03-18-2011, 02:09 AM

I'm under the impression that PHP is not the way to go as it doesn't support real multithreading. So what language does and will run smoothly on a unix/linux server?

Kiopa_Matt · 03-18-2011, 02:11 AM

Perl. Google for Perl fork() examples.

And you're right, PHP doesn't support multi-threading.

PS. What do you need multi-threading for? Correct me if I'm wrong, but assuming you're a novice developer, you're going to want to put your head through a wall several times while trying to write a multi-threaded Perl application. Maybe it's not needed? What are doing?

k0nr4d · 03-18-2011, 02:18 AM

http://php.net/manual/en/book.pcntl.php you can use this to fake multithreading in php...

Brujah · 03-18-2011, 02:44 AM

php has more than adequate multithreaded support if you're doing scraping or fetching, so it depends what you're doing. python may also be a good candidate for your needs.

Angry Jew Cat - Banned for Life · 03-18-2011, 02:59 AM

I'm not touching this shit with a 10 foot pole, but I want to know what type of developer I want to be looking for. Will be fetching/scraping a large amount of data from multiple sources for SEO research. Needs to support a large proxy list and multi-threading to accomplish my goals. Will probably need to perform between 180-250k requests daily...

Brujah · 03-18-2011, 03:13 AM

I know a great multithreaded perl coder if you need one. He specializes in data mining. I know how to do this stuff, and I still use him myself.

Angry Jew Cat - Banned for Life · 03-18-2011, 03:14 AM

Quote:

Originally Posted by Brujah

I know a great multithreaded perl coder if you need one. He specializes in data mining. I know how to do this stuff, and I still use him myself.

You could just sell me your clickmojo script and cut through 90% of the shit... lol

Brujah · 03-18-2011, 03:16 AM

Quote:

Originally Posted by Angry Jew Cat

You could just sell me your clickmojo script and cut through 90% of the shit... lol

lol just join the site and use the scanner!

Angry Jew Cat - Banned for Life · 03-18-2011, 03:17 AM

Quote:

Originally Posted by Brujah

lol just join the site and use the scanner!

That come with resell rights? I'm sure it would be 1000% easier to just scrape your results...

jay23 · 03-18-2011, 04:36 AM

http://en.wikipedia.org/wiki/Erlang_...ng_language%29

but this may be over kill for what you want to do .

If you are looking for the best programming language to code multithreading apps on a Unix box nothing comes close to Erlang

nation-x · 03-18-2011, 05:29 AM

A java console application would also work but you could also use php and curl

http://php.net/manual/en/function.curl-multi-exec.php

GrouchyAdmin · 03-18-2011, 08:21 AM

Suggesting PCNTL use to someone who isn't familiar is like handing a 3 year old a Maserati, the keys, and a wrench. No good can come of this.

You can fork off several copies/etc, but seeing that you want to multiplex proxies and stuff.. nah, can't help ya man.

v0id · 03-18-2011, 09:10 AM

node.js http://nodejs.org/

blogman9 · 03-18-2011, 02:51 PM

Java .

Lassitor · 03-18-2011, 02:53 PM

Perl or Python would be my first choice. What exactly are you doing on the unix box?

WarChild · 03-18-2011, 02:55 PM

PHP is a scripting language, not really a programming language.

Why do you need to use a Unix box? This is a job for C# or VB

Angry Jew Cat - Banned for Life · 03-18-2011, 03:12 PM

Quote:

Originally Posted by WarChild

PHP is a scripting language, not really a programming language.

Why do you need to use a Unix box? This is a job for C# or VB

I'm assuming that this will be a resource hog necessitating it's own box, so Windows is an option, and it was something I had been considering as another alternative.

beta-tester · 03-18-2011, 03:19 PM

Python all the way

woj · 03-18-2011, 03:27 PM

just about any language will work, unless you are building the next google, which you probably aren't...

WarChild · 03-18-2011, 03:29 PM

Quote:

Originally Posted by Angry Jew Cat

I'm assuming that this will be a resource hog necessitating it's own box, so Windows is an option, and it was something I had been considering as another alternative.

I program in Windows. You won't really need a very big box. Since you're going to use direct http post and get you should be okay. It's not like you'll be running hundreds of conncurent instances of IE.

The submit box that runs my custom tube submitter software literally submits to hundreds of tube sites at the same time and it's nothing special.

WarChild · 03-18-2011, 03:35 PM

Depending on the complexity of the scraping and warehousing requirments, I don't think it would take that long to do.

Personally I'd start with a third party component like Chilkat HTTP library which has built in proxing support and makes working with http uber simple.

You could easily house it on a webair $99 unmanaged windows server with 10mbit included bandwidth. SQL Server license is another $40 a month or something like that.

Angry Jew Cat - Banned for Life · 03-18-2011, 04:31 PM

Quote:

Originally Posted by WarChild

Depending on the complexity of the scraping and warehousing requirments, I don't think it would take that long to do.

Personally I'd start with a third party component like Chilkat HTTP library which has built in proxing support and makes working with http uber simple.

You could easily house it on a webair $99 unmanaged windows server with 10mbit included bandwidth. SQL Server license is another $40 a month or something like that.

A lot of the data can be pulled from XML feeds and via a couple different APIs. I'm still researching my options for a while yet. I want to be sure I come at this from the right angle this first time. Windows is sounding like a good option. If it ever comes down to it, I could always run the software locally for my own use.

HarryMuff · 03-18-2011, 04:45 PM

Quote:

Originally Posted by blogman9

Java .

This ^. Unless u suck.

HarryMuff · 03-18-2011, 04:58 PM

Quote:

Originally Posted by WarChild

PHP is a scripting language, not really a programming language.

Why do you need to use a Unix box? This is a job for C# or VB

Sure you could use C#, but he has unix, might as well use Java, which is what C# copied.

GrouchyAdmin · 03-18-2011, 05:12 PM

Quote:

Originally Posted by HarryMuff

Sure you could use C#, but he has unix, might as well use Java, which is what C# copied.

Copied all the way down to being a resource hog and providing very little core functionality.

fris · 03-18-2011, 05:31 PM

python would be your best bet

HarryMuff · 03-18-2011, 10:14 PM

Quote:

Originally Posted by GrouchyAdmin

Copied all the way down to being a resource hog and providing very little core functionality.

Well that's it then, I'm going to do everything in assembly language from now on.

03-18-2011, 02:09 AM	#1
Angry Jew Cat - Banned for Life (felis madjewicus) Industry Role: Join Date: Jul 2006 Location: In Mom & Dad's Basement Posts: 20,368	What programming language allows for multithreading on a Unix box? I'm under the impression that PHP is not the way to go as it doesn't support real multithreading. So what language does and will run smoothly on a unix/linux server?

03-18-2011, 02:11 AM	#2
Kiopa_Matt Confirmed User Industry Role: Join Date: Oct 2007 Posts: 1,448	Perl. Google for Perl fork() examples. And you're right, PHP doesn't support multi-threading. PS. What do you need multi-threading for? Correct me if I'm wrong, but assuming you're a novice developer, you're going to want to put your head through a wall several times while trying to write a multi-threaded Perl application. Maybe it's not needed? What are doing? __________________ xMarkPro -- Ultimate Blog Network Management Streamline your marketing operations. Centralize management of domains, pages, Wordpress blogs, sponsors, link codes, media items, sales and traffic statistics, plus more! Last edited by Kiopa_Matt; 03-18-2011 at 02:16 AM..

03-18-2011, 02:18 AM	#3
k0nr4d Confirmed User Industry Role: Join Date: Aug 2006 Location: Poland Posts: 9,228	http://php.net/manual/en/book.pcntl.php you can use this to fake multithreading in php... __________________ Mechanical Bunny Media Mechbunny Tube Script \| Mechbunny Webcam Aggregator Script \| Custom Web Development Last edited by k0nr4d; 03-18-2011 at 02:20 AM..

03-18-2011, 02:44 AM	#4
Brujah Beer Money Baron Industry Role: Join Date: Jan 2001 Location: brujah / gmail Posts: 22,157	php has more than adequate multithreaded support if you're doing scraping or fetching, so it depends what you're doing. python may also be a good candidate for your needs. __________________ Free Premium Domain Lists and Tools at Clickmojo.com For Sale: Obscenity.com

03-18-2011, 03:13 AM	#6
Brujah Beer Money Baron Industry Role: Join Date: Jan 2001 Location: brujah / gmail Posts: 22,157	I know a great multithreaded perl coder if you need one. He specializes in data mining. I know how to do this stuff, and I still use him myself. __________________ Free Premium Domain Lists and Tools at Clickmojo.com For Sale: Obscenity.com

03-18-2011, 02:59 AM	#5
Angry Jew Cat - Banned for Life (felis madjewicus) Industry Role: Join Date: Jul 2006 Location: In Mom & Dad's Basement Posts: 20,368	I'm not touching this shit with a 10 foot pole, but I want to know what type of developer I want to be looking for. Will be fetching/scraping a large amount of data from multiple sources for SEO research. Needs to support a large proxy list and multi-threading to accomplish my goals. Will probably need to perform between 180-250k requests daily...

03-18-2011, 04:36 AM	#10
jay23 Confirmed User Join Date: Jun 2003 Posts: 1,444	http://en.wikipedia.org/wiki/Erlang_...ng_language%29 but this may be over kill for what you want to do . If you are looking for the best programming language to code multithreading apps on a Unix box nothing comes close to Erlang

03-18-2011, 05:29 AM	#11
nation-x Confirmed User Industry Role: Join Date: Mar 2004 Location: Rock Hill, SC Posts: 5,370	A java console application would also work but you could also use php and curl http://php.net/manual/en/function.curl-multi-exec.php

03-18-2011, 08:21 AM	#12
GrouchyAdmin Now choke yourself! Industry Role: Join Date: Apr 2006 Posts: 12,085	Suggesting PCNTL use to someone who isn't familiar is like handing a 3 year old a Maserati, the keys, and a wrench. No good can come of this. You can fork off several copies/etc, but seeing that you want to multiplex proxies and stuff.. nah, can't help ya man. __________________ AIM: GrouchyGfy

03-18-2011, 09:10 AM	#13
v0id Confirmed User Industry Role: Join Date: Sep 2006 Posts: 43	node.js http://nodejs.org/

03-18-2011, 02:51 PM	#14
blogman9 Confirmed User Join Date: Dec 2005 Posts: 1,261	Java . __________________ Adult industry news

03-18-2011, 02:53 PM	#15
Lassitor Confirmed User Join Date: Jun 2009 Posts: 278	Perl or Python would be my first choice. What exactly are you doing on the unix box?

03-18-2011, 02:55 PM	#16
WarChild Let slip the dogs of war. Industry Role: Join Date: Jan 2003 Location: Bermuda Posts: 17,263	PHP is a scripting language, not really a programming language. Why do you need to use a Unix box? This is a job for C# or VB __________________ .

03-18-2011, 03:19 PM	#18
beta-tester Rock 'n Roll Baby! Join Date: Sep 2004 Location: USA, temporarly Posts: 22,562	Python all the way __________________ Sig for sale. Affordable prices. Contact me and get a great deal ;) My contact: ICQ: 944-320-46 e-mail: manca {AT} HotFreeSex4All.com

03-18-2011, 03:27 PM	#19
woj <&(©¿©)&> Industry Role: Join Date: Jul 2002 Location: Chicago Posts: 47,882	just about any language will work, unless you are building the next google, which you probably aren't... __________________ Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000 Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager

03-18-2011, 03:35 PM	#21
WarChild Let slip the dogs of war. Industry Role: Join Date: Jan 2003 Location: Bermuda Posts: 17,263	Depending on the complexity of the scraping and warehousing requirments, I don't think it would take that long to do. Personally I'd start with a third party component like Chilkat HTTP library which has built in proxing support and makes working with http uber simple. You could easily house it on a webair $99 unmanaged windows server with 10mbit included bandwidth. SQL Server license is another $40 a month or something like that. __________________ .

03-18-2011, 05:31 PM	#26
fris Too lazy to set a custom title Industry Role: Join Date: Aug 2002 Posts: 55,359	python would be your best bet __________________ Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence. WP Stuff