For sure, and this is where the 'magic' happens, eh? It's the point at which, for contemporary viewers, the illusion of intelligence is at its most seductive.
And that's the clincher for me - it may be different kind of instruction set; but the machine is still following a set of instructions, issued by the operator.
Of course, you could say that God set the basic conditions of the physical universe, and we just operate within that context. This, to my mind, is a pretty neat half-way house between free will and pre-determination.
A couple of things here, firstly, why so focused on where the instructions come from? I would definitely argue that humans function according to a basic set of rules from which their intelligence arises (in fact, what DOESN'T function according to some set of rules?), and that these rules are a result of the laws of physics plus a billion years of evolution (I'm leaving god out of the picture here, cuz that's how I roll). However, just because one set of rules comes from one source for humans and a different source for artificial constructs, why would that effect whether the resultant system is intelligent or not, when that intelligence is entirely and exclusively dependant upon the set of rules that governs it?
Secondly, just to make it clear, when you say "the machine is still following a set of instructions, issued by the operator" I don't really agree, as the whole point of a self-modifying network is that it can change the rules that it functions by, including the rules by which it decides which rules to change. So after a given period of time, absolutely all remnants of any instructions given by the original creator can be gone. Of course the original seed was still specified by a human (which I imagine will be your sticking point) but the actual instructions the system is following may not be anywhere near those issued by the operator.
Lastly, I think it's worth pointing out that all of your concerns about the difficulty in proving the intelligence or sentience of a system (or consciousness or whatever you want to call it), apply equally well to other humans as it does to machines. After all, it's mostly faith and/or occam's razor that let's me believe I'm actually having this debate with an sentient human being somewhere rather than just an intelligent chat-bot playing devil's advocate
Me too!Ah, I love this this shit![]()