Thursday, August 10, 2023

The AI alignment effort

 I am not onboard with the current feverish alignment effort. I don't want AIs to share human values*, I want them to have something better.** Perhaps including Blackburn's plurality of concerns.***

* You only need to look at crazy Donald's cult of supporters by way of example. 

** See, for example, my blog of 25 October 2011.

*** A vector value system again. See chapter 8 of Think, OUP, 1999.

Tuesday, August 1, 2023

Vector values* again

Shuwa Miura has shown** that there may exist no scalar Markov reward function that characterizes some set of acceptable policies but that a set of deterministic policies can always be characterized by  multidimensional Markov rewards.

* See Capitalism is Wrong, chapter 2 of my book Twelve Papers, on my website www.robert-w-jones.com under "Book" and my blog of 19 February 2011.

** On the Expressivity of Multidimensional Markov Rewards, arXiv: 2307.12184v1, 22 July 2023.

Humanoid robots?

 Human looking robots have always been a popular form factor. I have two small humanoids and the makings of at least three more. These have not proven to be the best engineering choice for any of the experiments I've been doing so far. Of course much of my robotics work has been for symbol grounding of my A.s.a. H.