Tech Try out the Open AI GPT-2 Small Model - AI Natural Language - GoFuckYourself.com

AdultKing · 02-21-2019, 08:49 PM

Lots of articles about this recently.

Unfortunately for many people this isn't really easy to set up so I decided to share the GPT-2 Small 117M Model here

https://repl.it/@rjkmelb/gpt-2

Just hit run, wait until you are prompted for input and start your story with a simple sentence.

The small 117M model can be underwhelming but it's interesting anyway.

Feel free to experiment with the code.

Original Open AI Github repo: https://github.com/openai/gpt-2

Articles:

https://www.theguardian.com/commenti...gpt2-elon-musk

https://www.theverge.com/2019/2/14/1...te-openai-gpt2

Bladewire · 02-21-2019, 09:02 PM

Ugh again?

You actually do want the worst for the world

Oh well. Have at it.

You're missing so much info this thread is virtually useless, and that's a good thing

AdultKing · 02-21-2019, 09:11 PM

Quote:

Originally Posted by Bladewire

Ugh again?

You actually do want the worst for the world

Oh well. Have at it.

You're missing so much info this thread is virtually useless, and that's a good thing

Do you want me to share a BERT model or an LSTM model instead?

Dude, I am about open source. State actors or people who want to do real harm already have the tools or could get them.

FWIW the 117M model mostly produces garbage unless you run lots of samples and pick the best of them.

AzteK · 02-21-2019, 11:45 PM

Thanks for putting this up. I was wondering how it worked in action. The output of this version is not very good but I look forward to seeing what people are able to to do with it. I think it would be great to be able to use it for filler content.

King Mark · 02-21-2019, 11:49 PM

I have no idea what's going on here. The way bladewire is having a jussie attack, I'm scared to click the links.

Bladewire · 02-21-2019, 11:52 PM

Quote:

Originally Posted by AdultKing

Do you want me to share a BERT model or an LSTM model instead?

Dude, I am about open source. State actors or people who want to do real harm already have the tools or could get them.

FWIW the 117M model mostly produces garbage unless you run lots of samples and pick the best of them.

It's a blessing that you don't know what you think you know. Carry on

AdultKing · 02-22-2019, 12:40 AM

Quote:

Originally Posted by Bladewire

It's a blessing that you don't know what you think you know. Carry on

https://github.com/huggingface/pytorch-pretrained-BERT

Includes GPT-2

Enjoy.

Mr Pheer · 02-22-2019, 01:36 AM

Quote:

Originally Posted by AdultKing

https://github.com/huggingface/pytorch-pretrained-BERT

Includes GPT-2

Enjoy.

Fuck yes!

Is it better than what I showed you in email?

AdultKing · 02-22-2019, 06:10 AM

Quote:

Originally Posted by Bladewire

It's a blessing that you don't know what you think you know. Carry on

Since when did you know anything about AI and coding?

I must have missed your posts about your technical skills in between all the hysterical drama queen meltdowns that you have almost daily.

Quote:

Originally Posted by Mr Pheer

Fuck yes!

Is it better than what I showed you in email?

I'll check my email and get back to you, I sent you the link above earlier today.

freecartoonporn · 02-22-2019, 01:19 PM

what does it do ?

Paul&John · 02-22-2019, 01:48 PM

Quote:

Originally Posted by freecartoonporn

what does it do ?

it sucks in air!

sorry for the OT

couldn't resist.

AdultKing · 02-22-2019, 02:46 PM

Quote:

Originally Posted by freecartoonporn

what does it do ?

It's an artificial intelligence model that will write a story/article/text continuing on from a prompt it is given.

The full model is supposed to be quite amazing, Open AI have not released that. The code I posted in my original post which you can try live for free at https://repl.it/@rjkmelb/gpt-2
is based on a much smaller sample model called 117M (the size of the model).

The text is good up until you are provided an <|endoftext|> marker as in the image below. (click the image to see it in readable form)

Mr Pheer · 02-22-2019, 03:34 PM

My 20 year old script is still better than this 117M version, I think. I was really ahead of my time when I wrote that.

It doesn't use AI, just used very cleverly placed randomizations, long before people came out with that "morphing text" as they called it.

One page had billions of combinations and 20 thousand page website built in minutes.

02-21-2019, 08:49 PM	#1
AdultKing Raise Your Weapon Industry Role: Join Date: Jun 2003 Location: Outback Australia Posts: 15,601	Try out the Open AI GPT-2 Small Model - AI Natural Language Lots of articles about this recently. Unfortunately for many people this isn't really easy to set up so I decided to share the GPT-2 Small 117M Model here https://repl.it/@rjkmelb/gpt-2 Just hit run, wait until you are prompted for input and start your story with a simple sentence. The small 117M model can be underwhelming but it's interesting anyway. Feel free to experiment with the code. Original Open AI Github repo: https://github.com/openai/gpt-2 Articles: https://www.theguardian.com/commenti...gpt2-elon-musk https://www.theverge.com/2019/2/14/1...te-openai-gpt2

02-22-2019, 01:19 PM	#10
freecartoonporn Confirmed User Industry Role: Join Date: Jan 2012 Location: NC Posts: 7,683	what does it do ? __________________ SSD Cloud Server, VPS Server, Simple Cloud Hosting \| DigitalOcean

02-21-2019, 09:02 PM	#2
Bladewire StraightBro Industry Role: Join Date: Aug 2003 Location: Monarch Beach, CA USA Posts: 56,229	Ugh again? You actually do want the worst for the world Oh well. Have at it. You're missing so much info this thread is virtually useless, and that's a good thing

02-21-2019, 11:45 PM	#4
AzteK Confirmed User Industry Role: Join Date: Feb 2001 Location: Northern Cali, USA Posts: 3,440	Thanks for putting this up. I was wondering how it worked in action. The output of this version is not very good but I look forward to seeing what people are able to to do with it. I think it would be great to be able to use it for filler content.

02-21-2019, 11:49 PM	#5
King Mark So Fucking Banned Industry Role: Join Date: Aug 2016 Posts: 27,033	I have no idea what's going on here. The way bladewire is having a jussie attack, I'm scared to click the links.

02-22-2019, 03:34 PM	#13
Mr Pheer I got bored here. Industry Role: Join Date: Dec 2002 Location: Las Vegas Posts: 20,733	My 20 year old script is still better than this 117M version, I think. I was really ahead of my time when I wrote that. It doesn't use AI, just used very cleverly placed randomizations, long before people came out with that "morphing text" as they called it. One page had billions of combinations and 20 thousand page website built in minutes.