OpenAI’s Sam Altman Says Personalized AI Brings New Privacy Challenges
Ek recent interview mein Stanford University ke saath, OpenAI ke CEO Sam Altman ne kaha ke AI security next phase of AI development ka sabse important aur defining issue banne wala hai. Unhone ye bhi suggest kiya ke agar koi student ya professional future ke liye best field choose karna chahta hai, toh AI security ek top choice ho sakti hai. Altman ne “personalized AI” ka example dete hue bataya ke ye un security concerns mein se ek hai jiske baare mein wo aaj kal kaafi soch rahe hain..
Table of Contents
What Does AI Security Mean Today?
Sam Altman said that concerns about AI safety will be reframed as AI Security issues that can be solvable by AI.
Interview host, Dan Boneh, asked:
“So what does it mean for an AI system to be secure? What does it mean for even trying to kind of make it do things it wasn’t designed to do?
How do we protect AI systems from prompt injections and other attacks like that? How do you think of AI security?
I guess the concrete question I want to ask is, among all the different things we can do with AI, this course is about learning one sliver of the field. Is this a good area? Should people go into this?”
Sam Altman encouraged today’s students to study AI security.
He answered:
“I think this is one of the best areas to go study. I think we are soon heading into a world where a lot of the AI safety problems that people have traditionally talked about are going to be recast as AI security problems in different ways.
I also think that given how capable these models are getting, if we want to be able to deploy them for wide use, the security problems are going to get really big. You mentioned many areas that I think are super important to figure out. Adversary robustness in particular seems like it’s getting quite serious.”
Altman ka matlab yeh hai ke log ab AI systems ko trick karne ke tareeqe dhoondhne lage hain, aur yeh problem itni serious ho gayi hai ke researchers aur engineers ko ab focus karna hoga AI ko zyada secure banane par — taake woh manipulation aur prompt injection jaise attacks se bach sake.
AI Personalization Becoming A Security Concern
Altman ne ye bhi kaha ke aaj kal wo AI personalization ke security issues pe kaafi soch rahe hain. Unka kehna hai ke logon ko AI ke personalized responses pasand aate hain, lekin isse ek risk bhi hota hai — hackers is personalization ka misuse karke sensitive data chura sakte hain (exfiltrate kar sakte hain).
He explained:
“One more that I will mention that you touched on a little bit, but just it’s been on my mind a lot recently. There are two things that people really love right now that taken together are a real security challenge.
Number one, people love how personalized these models are getting. So ChatGPT now really gets to know you. It personalizes over your conversational history, your data you’ve connected to it, whatever else.
And then number two is you can connect these models to other services. They can go off and like call things on the web and, you know, do stuff for you that’s helpful.
But what you really don’t want is someone to be able to exfiltrate data from your personal model that knows everything about you.
And humans, you can kind of trust to be reasonable at this. If you tell your spouse a bunch of secrets, you can sort of trust that they will know in what context what to tell to other people. The models don’t really do this very well yet.
And so if you’re telling like a model all about your, you know, private health care issues, and then it is off, and you have it like buying something for you, you don’t want that e-commerce site to know about all of your health issues or whatever.
But this is a very interesting security problem to solve this with like 100% robustness.”
Altman kehte hain ki personalization ek bada breakthrough hai, lekin ye cyber attacks ke liye bhi naya rasta khol sakta hai. Jo cheezein AI ko zyada useful banati hain, wahi ise target bhi bana deti hain, kyunki models jo individual histories se seekhte hain, unhe manipulate karke sensitive information leak ki ja sakti hai. Altman explain karte hain ki convenience ka matlab sirf easy use nahi, balki ye exposure ka source bhi ban sakta hai. Aaj privacy aur usability dono hi security ke challenges ban gaye hain.
Lastly, Altman circled back to AI as both the security problem and the solution.
He concluded:
“Yeah, by the way, it works both directions. Like you can use it to secure systems. I think it’s going to be a big deal for cyber attacks at various times.”
