i'm generally worried about the upcoming shifts in society, eg i have a hard time imagining how society will function in a world where most of the work is done by ai and robots. i know nothing about economy or sociology but it seems like transitioning to this safely requires a lot of preparation and care which we don't have time for given how fast the models evolve. humans are adaptive, our society looks nothing like one 500 or 300 years ago, but this time the change is happening faster than ever, so we'd need to buckle up at least, but also don't vote for fucking idiots! just don't. especially in this critical time

btw, it might not seem like it but in the grand scheme of things we are all in this together. yeah i get it, you might say "easy for you to say". Sure, easiER, but given the anticipated scale of societal impacts and the ripple effects, whether i want it or not, EVERYONE will be impacted, including my family. i also care what kind of world my kids live in. anyway i'll continue.

fwiw personally i'm NOT worried about human extinction yet. while rsi is fast, diffusion is slow. it seems like enough sufficiently-eye-opening little disasters will happen before humans give ai enough power to end us. given the probabilistic nature of alignment, i expect some non-zero death rate at some point (chatgpt already had suicide cases, so we have precedents). what we need is systems of control over agents, similar to how human alignment with the rest of society is also probabilistic and thus we need police, fbi. systems of ai control include classifiers, permissions/police/investigation agents with special security-minded system prompt and/or special model, embedded into systems capable of agent swarms. 

is this fear mongering? no i’m just saying we should proceed with caution and demand mechanisms that ensure that model providers are being responsible.