GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   What programming language allows for multithreading on a Unix box? (https://gfy.com/showthread.php?t=1014722)

Angry Jew Cat - Banned for Life 03-18-2011 02:09 AM

What programming language allows for multithreading on a Unix box?
 
I'm under the impression that PHP is not the way to go as it doesn't support real multithreading. So what language does and will run smoothly on a unix/linux server?

Kiopa_Matt 03-18-2011 02:11 AM

Perl. Google for Perl fork() examples.

And you're right, PHP doesn't support multi-threading.

PS. What do you need multi-threading for? Correct me if I'm wrong, but assuming you're a novice developer, you're going to want to put your head through a wall several times while trying to write a multi-threaded Perl application. Maybe it's not needed? What are doing?

k0nr4d 03-18-2011 02:18 AM

http://php.net/manual/en/book.pcntl.php you can use this to fake multithreading in php...

Brujah 03-18-2011 02:44 AM

php has more than adequate multithreaded support if you're doing scraping or fetching, so it depends what you're doing. python may also be a good candidate for your needs.

Angry Jew Cat - Banned for Life 03-18-2011 02:59 AM

I'm not touching this shit with a 10 foot pole, but I want to know what type of developer I want to be looking for. Will be fetching/scraping a large amount of data from multiple sources for SEO research. Needs to support a large proxy list and multi-threading to accomplish my goals. Will probably need to perform between 180-250k requests daily...

Brujah 03-18-2011 03:13 AM

I know a great multithreaded perl coder if you need one. He specializes in data mining. I know how to do this stuff, and I still use him myself.

Angry Jew Cat - Banned for Life 03-18-2011 03:14 AM

Quote:

Originally Posted by Brujah (Post 17987745)
I know a great multithreaded perl coder if you need one. He specializes in data mining. I know how to do this stuff, and I still use him myself.

You could just sell me your clickmojo script and cut through 90% of the shit... lol

Brujah 03-18-2011 03:16 AM

Quote:

Originally Posted by Angry Jew Cat (Post 17987746)
You could just sell me your clickmojo script and cut through 90% of the shit... lol

lol just join the site and use the scanner!

Angry Jew Cat - Banned for Life 03-18-2011 03:17 AM

Quote:

Originally Posted by Brujah (Post 17987748)
lol just join the site and use the scanner!

That come with resell rights? I'm sure it would be 1000% easier to just scrape your results... :thumbsup

jay23 03-18-2011 04:36 AM

http://en.wikipedia.org/wiki/Erlang_...ng_language%29

but this may be over kill for what you want to do .

If you are looking for the best programming language to code multithreading apps on a Unix box nothing comes close to Erlang

nation-x 03-18-2011 05:29 AM

A java console application would also work but you could also use php and curl

http://php.net/manual/en/function.curl-multi-exec.php

GrouchyAdmin 03-18-2011 08:21 AM

Suggesting PCNTL use to someone who isn't familiar is like handing a 3 year old a Maserati, the keys, and a wrench. No good can come of this.

You can fork off several copies/etc, but seeing that you want to multiplex proxies and stuff.. nah, can't help ya man.

v0id 03-18-2011 09:10 AM

node.js http://nodejs.org/

blogman9 03-18-2011 02:51 PM

Java .

Lassitor 03-18-2011 02:53 PM

Perl or Python would be my first choice. What exactly are you doing on the unix box?

WarChild 03-18-2011 02:55 PM

PHP is a scripting language, not really a programming language.

Why do you need to use a Unix box? This is a job for C# or VB

Angry Jew Cat - Banned for Life 03-18-2011 03:12 PM

Quote:

Originally Posted by WarChild (Post 17989260)
PHP is a scripting language, not really a programming language.

Why do you need to use a Unix box? This is a job for C# or VB

I'm assuming that this will be a resource hog necessitating it's own box, so Windows is an option, and it was something I had been considering as another alternative.

beta-tester 03-18-2011 03:19 PM

Python all the way

woj 03-18-2011 03:27 PM

just about any language will work, unless you are building the next google, which you probably aren't...:2 cents:

WarChild 03-18-2011 03:29 PM

Quote:

Originally Posted by Angry Jew Cat (Post 17989297)
I'm assuming that this will be a resource hog necessitating it's own box, so Windows is an option, and it was something I had been considering as another alternative.

I program in Windows. You won't really need a very big box. Since you're going to use direct http post and get you should be okay. It's not like you'll be running hundreds of conncurent instances of IE.

The submit box that runs my custom tube submitter software literally submits to hundreds of tube sites at the same time and it's nothing special.

WarChild 03-18-2011 03:35 PM

Depending on the complexity of the scraping and warehousing requirments, I don't think it would take that long to do.

Personally I'd start with a third party component like Chilkat HTTP library which has built in proxing support and makes working with http uber simple.

You could easily house it on a webair $99 unmanaged windows server with 10mbit included bandwidth. SQL Server license is another $40 a month or something like that.

Angry Jew Cat - Banned for Life 03-18-2011 04:31 PM

Quote:

Originally Posted by WarChild (Post 17989360)
Depending on the complexity of the scraping and warehousing requirments, I don't think it would take that long to do.

Personally I'd start with a third party component like Chilkat HTTP library which has built in proxing support and makes working with http uber simple.

You could easily house it on a webair $99 unmanaged windows server with 10mbit included bandwidth. SQL Server license is another $40 a month or something like that.

A lot of the data can be pulled from XML feeds and via a couple different APIs. I'm still researching my options for a while yet. I want to be sure I come at this from the right angle this first time. Windows is sounding like a good option. If it ever comes down to it, I could always run the software locally for my own use.

HarryMuff 03-18-2011 04:45 PM

Quote:

Originally Posted by blogman9 (Post 17989252)
Java .

This ^. Unless u suck.

HarryMuff 03-18-2011 04:58 PM

Quote:

Originally Posted by WarChild (Post 17989260)
PHP is a scripting language, not really a programming language.

Why do you need to use a Unix box? This is a job for C# or VB

Sure you could use C#, but he has unix, might as well use Java, which is what C# copied.

GrouchyAdmin 03-18-2011 05:12 PM

Quote:

Originally Posted by HarryMuff (Post 17989526)
Sure you could use C#, but he has unix, might as well use Java, which is what C# copied.

Copied all the way down to being a resource hog and providing very little core functionality.

fris 03-18-2011 05:31 PM

python would be your best bet

HarryMuff 03-18-2011 10:14 PM

Quote:

Originally Posted by GrouchyAdmin (Post 17989551)
Copied all the way down to being a resource hog and providing very little core functionality.

Well that's it then, I'm going to do everything in assembly language from now on.


All times are GMT -7. The time now is 09:36 AM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123