{"id":43813,"date":"2024-06-20T14:34:12","date_gmt":"2024-06-20T18:34:12","guid":{"rendered":"https:\/\/mjtsai.com\/blog\/?p=43813"},"modified":"2024-09-10T10:11:51","modified_gmt":"2024-09-10T14:11:51","slug":"safe-superintelligence-inc","status":"publish","type":"post","link":"https:\/\/mjtsai.com\/blog\/2024\/06\/20\/safe-superintelligence-inc\/","title":{"rendered":"Safe Superintelligence Inc."},"content":{"rendered":"<p><a href=\"https:\/\/ssi.inc\/\">Ilya Sutskever et al.<\/a> (via <a href=\"https:\/\/news.ycombinator.com\/item?id=40730156\">Hacker News<\/a>):<\/p>\n<blockquote cite=\"https:\/\/ssi.inc\/\">\n<p>Building safe superintelligence (SSI) is the most important technical problem of our&#x200B;&#x200B; time.<\/p>\n<p>We have started the world&rsquo;s first straight-shot SSI lab, with one goal and one product: a safe superintelligence.<\/p>\n<p>[&#8230;]<\/p>\n<p>We approach safety and capabilities in tandem, as technical problems to be solved through revolutionary engineering and scientific breakthroughs. We plan to advance capabilities as fast as possible while making sure our safety always remains ahead.<\/p>\n<p>[&#8230;]<\/p>\n<p>Our singular focus means no distraction by management overhead or product cycles, and our business model means safety, security, and progress are all insulated from short-term commercial pressures.<\/p>\n<\/blockquote>\n<p>I don&rsquo;t really understand how they know whether what they are doing is &ldquo;safe.&rdquo; And currently, I think, people are more worried about what humans will do with AI&mdash;which they can&rsquo;t control&mdash;not with what the AI will do by itself. But, I guess, good luck to them in outrunning the other companies who have less focus on safety.<\/p>\n\n<p><a href=\"https:\/\/om.co\/2024\/06\/19\/openai-co-founder-launches-new-startup\/\">Om Malik<\/a>:<\/p>\n<blockquote cite=\"https:\/\/om.co\/2024\/06\/19\/openai-co-founder-launches-new-startup\/\">\n<p>Daniel Gross, former AI lead at Apple, and researcher Daniel Levy are co-founders of the company.<\/p>\n<p>[&#8230;]<\/p>\n<p>What does &ldquo;safe&rdquo; mean when it comes to superintelligence? [&#8230;] I have read fewer word that have more clarity.<\/p>\n<\/blockquote>\n\n<p><a href=\"https:\/\/www.theregister.com\/2024\/06\/20\/ilya_sutskever_safe_superintelligence\/\">Simon Sharwood<\/a>:<\/p>\n<blockquote cite=\"https:\/\/www.theregister.com\/2024\/06\/20\/ilya_sutskever_safe_superintelligence\/\"><p>Building an SSI &ldquo;is our mission, our name, and our entire product roadmap, because it is our sole focus. Our team, investors, and business model are all aligned to achieve SSI.&rdquo;<\/p><p>Who are those investors? The page doesn&rsquo;t indicate. Ditto the business model.<\/p><\/blockquote>\n\n<p>Previously:<\/p>\n<ul>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2024\/06\/18\/former-head-of-nsa-joins-openai-board\/\">Former Head of NSA Joins OpenAI Board<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2024\/05\/20\/sutskever-and-leike-out-at-openai\/\">Sutskever and Leike Out at OpenAI<\/a><\/li>\n<\/ul>\n\n<p id=\"safe-superintelligence-inc-update-2024-09-10\">Update (2024-09-10): <a href=\"https:\/\/www.reuters.com\/technology\/artificial-intelligence\/openai-co-founder-sutskevers-new-safety-focused-ai-startup-ssi-raises-1-billion-2024-09-04\/\">Reuters<\/a> (via <a href=\"https:\/\/news.ycombinator.com\/item?id=41445413\">Hacker News<\/a>):<\/p>\n<blockquote cite=\"https:\/\/www.reuters.com\/technology\/artificial-intelligence\/openai-co-founder-sutskevers-new-safety-focused-ai-startup-ssi-raises-1-billion-2024-09-04\/\"><p>Safe Superintelligence (SSI), newly co-founded by OpenAI&rsquo;s former chief scientist Ilya Sutskever, has raised $1 billion in cash to help develop safe artificial intelligence systems that far surpass human capabilities, company executives told Reuters.<\/p><p>SSI, which currently has 10 employees, plans to use the funds to acquire computing power and hire top talent.<\/p><\/blockquote>\n\n<p><a href=\"https:\/\/www.theregister.com\/2024\/09\/05\/ssi_funding\/\">Richard Speed<\/a>:<\/p>\n<blockquote cite=\"https:\/\/www.theregister.com\/2024\/09\/05\/ssi_funding\/\"><p>Exactly what those resources will do remains unclear at this stage. SSI intends to build safe superintelligence, describing it as &ldquo;the most important technical problem of our time.&rdquo;<\/p><p>[&#8230;]<\/p><p>Some estimates put the value of SSI at $5 billion following the investment, although the company itself has not commented. It is, however, an eye-watering sum to be poured into a business that has been around for just a few months, with barely enough employees to fill a minibus.<\/p><\/blockquote>\n\n<p>Previously:<\/p>\n<ul>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2024\/07\/10\/calling-ai-a-bubble\/\">Calling AI a Bubble<\/a><\/li>\n<\/ul>","protected":false},"excerpt":{"rendered":"<p>Ilya Sutskever et al. (via Hacker News): Building safe superintelligence (SSI) is the most important technical problem of our&#x200B;&#x200B; time. We have started the world&rsquo;s first straight-shot SSI lab, with one goal and one product: a safe superintelligence. [&#8230;] We approach safety and capabilities in tandem, as technical problems to be solved through revolutionary engineering [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"apple_news_api_created_at":"2024-06-20T18:34:14Z","apple_news_api_id":"8160d7d1-5eb3-4826-b8a0-0b739900b0bf","apple_news_api_modified_at":"2024-09-10T14:11:55Z","apple_news_api_revision":"AAAAAAAAAAAAAAAAAAAAAA==","apple_news_api_share_url":"https:\/\/apple.news\/AgWDX0V6zSCa4oAtzmQCwvw","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_is_hidden":false,"apple_news_is_paid":false,"apple_news_is_preview":false,"apple_news_is_sponsored":false,"apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":"\"\"","apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"footnotes":""},"categories":[2],"tags":[1351,101],"class_list":["post-43813","post","type-post","status-publish","format-standard","hentry","category-technology","tag-artificial-intelligence","tag-business"],"apple_news_notices":[],"_links":{"self":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/43813","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/comments?post=43813"}],"version-history":[{"count":2,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/43813\/revisions"}],"predecessor-version":[{"id":44783,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/43813\/revisions\/44783"}],"wp:attachment":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/media?parent=43813"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/categories?post=43813"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/tags?post=43813"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}