When I think of how computational things that exist today, it also includes the power systems that power them, and the chips that computer algorithms run on, and the supply chains that build those things.
So I if was to do a thought experiment of what an aware and autonomous computational entity would look like, it would be able to extract these thing from the environment by itself and switch to a new source if the current source disappears. So it wouldn't be just an computer producing a chip design, it'd be a system that also manufactures that chip autonomously (mines the raw materials, refines them, etches them, packages them, etc). It would not be just producing a CAD model of a power station, it is also autonomously digging the foundation, pouring the concrete, etc.
That would mean matching humans in sensorimotor and long-term planning skills too, and given Moravec's paradox the outlook for that does not look as obvious as it looks for cognitive skills on well-defined problems.
I think there's plenty of middle ground between 'we can turn it off any time we want' and 'it has total control of its own entire supply chain with no human intervention required'.
That being said, I would expect the latter to eventually be possible in a very long time horizon, provided civilization as we know it isn't majorly crippled. It seems to me that the basic building blocks we now have, and trend lines we now see, point that way. I guess it's a matter of how much we try to prevent that from happening (if we can) more than anything else.