I came across this short clip of pianist Roberto Prosseda reflecting on his duel with a 53-fingered robot. His take lands at the intersection of craft, suffering, and whatever we think "intelligence" means.
I think mistakes are a treasure we have to be proud of our imperfections. Of course, we have to try to improve through the mistakes, but we can learn from mistakes. The robot doesn't suffer; even if a robot makes a mistake, the robot doesn't suffer from that, while we humans can learn much more from our mistakes, and we can be proud of that.
You know, I think we don't have to look for perfection. By example, we have to look for enjoying the emotional meanings of what we do. Music is just a sharing of emotions, and this robot will not understand yet.
The two things that struck me the most are:
a/ robots don’t suffer when they make mistakes. Suffering leads to learning. AGI will need models that can learn incrementally, on their own, online.
b/ the sharing aspect is deeply and uniquely human.