According to david deutsch, one of the top minds in science - ever, and he's participated much in the realm and coined the term AGI artificial general intelligence, the quest for self-awareness (= skynet) is fundamentally flawed.
Deutsch explores why artificial general intelligence (AGI) must be possible, but hasn't yet been achieved. He calls it AGI to emphasize that he's talking about a mind like ours, that can think and feel and reason about anything, as opposed to a complex computer program that's very good at one or a few human-like tasks.
Simply put, his argument for why AGI is possible is this: Since our brains are made of matter, it must be possible, in principle at least, to recreate the functionality of our brains using another type of matter ? specifically circuits.
As for Skynet's self-awareness, Deutsch writes:
That's just another philosophical misconception, sufficient in itself to block any viable approach to AGI. The fact is that present-day software developers could straightforwardly program a computer to have 'self-awareness' in the behavioural sense ? for example, to pass the 'mirror test' of being able to use a mirror to infer facts about itself ? if they wanted to. As far as I am aware, no one has done so, presumably because it is a fairly useless ability as well as a trivial one.
We could make a machine to be "self-aware" in a technical sense, and it wouldn't possess any more human-level intelligence than a computer that's programmed to play the piano. Viewed this way, self-awareness is just another narrow, arbitrary skill ? not the Holy Grail it's made out to be in a lot of science fiction.
Deutsch persuasively argues that, as long as we're focused on self-awareness, we miss out on understanding how our brains actually work, stunting our ability to create artificially intelligent machines.
What matters, Deutsch argues, is "the ability to create new explanations," to generate theories about the world and all its particulars. In contrast with this, the idea that self-awareness ? let alone real intelligence ? will spontaneously emerge from a complex computer network is not just science fiction. It's pure fantasy.
David Deutsch On Artificial Intelligence
Philosophy will be the key that unlocks artificial intelligence | David Deutsch | Science | The Guardian