OpenAI is a non-profit artificial intelligence (AI) research company that aims to promote and develop friendly AI in such a way as to benefit humanity as a whole. The organization aims to "freely collaborate" with other institutions and researchers by making its patents and research open to the public. The founders (notably Elon Musk and Sam Altman) are motivated in part by concerns about existential risk from artificial general intelligence.
|Founded||December 11, 2015|
|Founders||Elon Musk, Sam Altman|
|Type||501(c)(3) Nonprofit organization|
|Ilya Sutskever, Greg Brockman|
|Endowment||$1 billion pledged (2015)|
|Mission||Friendly artificial intelligence|
In October 2015, Musk, Altman and other investors announced the formation of the organization, pledging over US$1 billion to the venture.
On December 5, 2016, OpenAI released Universe, a software platform for measuring and training an AI's general intelligence across the world's supply of games, websites and other applications.
During The International 2017 Dota 2 video game tournament in August 2017, OpenAI let a machine-learned bot play 1v1 demonstration game against professional Dota 2 player, Dendi, who played against it live and lost. After the demonstration, CTO Greg Brockman explained that the bot had learned by playing against itself for two weeks of real time, and that the learning software was a step in the direction of creating software that can handle complex tasks "like being a surgeon".
Some scientists, such as Stephen Hawking and Stuart Russell, believe that if advanced AI someday gains the ability to re-design itself at an ever-increasing rate, an unstoppable "intelligence explosion" could lead to human extinction. Musk characterizes AI as humanity's biggest existential threat. OpenAI's founders structured it as a non-profit so that they could focus its research on creating a positive long-term human impact.
OpenAI states that "it's hard to fathom how much human-level AI could benefit society," and that it's equally difficult to comprehend "how much it could damage society if built or used incorrectly". Research on safety cannot safely be postponed: "because of AI's surprising history, it's hard to predict when human-level AI might come within reach." OpenAI states that AI "should be an extension of individual human wills and, in the spirit of liberty, as broadly and evenly distributed as possible..." Co-chair Sam Altman expects the decades-long project to surpass human intelligence.
Vishal Sikka, former CEO of Infosys, stated that an "openness" where the endeavor would "produce results generally in the greater interest of humanity" was a fundamental requirement for his support, and that OpenAI "aligns very nicely with our long-held values" and their "endeavor to do purposeful work". Cade Metz of Wired suggests that corporations such as Amazon may be motivated by a desire to use open-source software and data to level the playing field against corporations such as Google and Facebook that own enormous supplies of proprietary data. Altman states that Y Combinator companies will share their data with OpenAI.
Musk poses the question: "what is the best thing we can do to ensure the future is good? We could sit on the sidelines or we can encourage regulatory oversight, or we could participate with the right structure with people who care deeply about developing AI in a way that is safe and is beneficial to humanity." Musk acknowledges that "there is always some risk that in actually trying to advance (friendly) AI we may create the thing we are concerned about"; nonetheless, the best defense is "to empower as many people as possible to have AI. If everyone has AI powers, then there's not any one person or a small set of individuals who can have AI superpower."
Musk and Altman's counter-intuitive strategy of trying to reduce the risk that AI will cause overall harm, by giving AI to everyone, is controversial among those who are concerned with existential risk from artificial intelligence. Philosopher Nick Bostrom is skeptical of Musk's approach: "If you have a button that could do bad things to the world, you don't want to give it to everyone." During a 2016 conversation about the technological singularity, Altman said that "we don’t plan to release all of our source code" and mentioned a plan to "allow wide swaths of the world to elect representatives to a new governance board". Greg Brockman stated that "Our goal right now... is to do the best thing there is to do. It’s a little vague."
Gym aims to provide an easy-to-setup general-intelligence benchmark with a wide variety of different environments (somewhat akin to, but broader than, the ImageNet Large Scale Visual Recognition Challenge used in supervised learning research), and that hopes to standardize the way in which environments are defined in AI research publications, so that published research becomes more easily reproducible. The project claims to provide the user with a simple interface. As of June 2017, the gym can only be used with Python. As of September 2017, the gym documentation site is not maintained, and active work is focused instead on its GitHub page.
OpenAI's Igor Mordatch argues for that competition between agents can create an intelligence "arms race" that can increase an agent's ability to function, even outside the context of the competition. In OpenAI's "RoboSumo", virtual humanoid "metalearning" robots initially lack knowledge of how to even walk, and given the goals of learning to move around, and pushing the opposing agent out of the ring. Through this adversial learning process, the agents learn how to adapt to changing conditions; when an agent is then removed from this virtual environment and placed in a new virtual environment with high winds, the agent braces to remain upright, suggesting it had learned how to balance in a generalized way.
The two co-chairs of the project are:
- Tesla and SpaceX founder Elon Musk
- Sam Altman, president of the startup accelerator Y Combinator
Other backers of the project include:
- LinkedIn co-founder Reid Hoffman
- PayPal co-founder Peter Thiel
- Greg Brockman, former chief technology officer at Stripe
- Jessica Livingston, a founding partner of Y Combinator
- Amazon Web Services, Amazon.com's cloud-services subsidiary
- Infosys, an Indian IT consulting firm
High-profile staff include:
- Research director: Ilya Sutskever, a former Google expert on machine learning
- CTO: Greg Brockman
The group started in early January 2016 with nine researchers. According to Wired, Brockman met with Yoshua Bengio, one of the "founding fathers" of the deep learning movement, and drew up a list of the "best researchers in the field". Microsoft's Peter Lee stated that the cost of a top AI researcher exceeds the cost of a top NFL quarterback prospect. While OpenAI pays corporate-level (rather than nonprofit-level) salaries, it doesn't currently pay AI researchers salaries comparable to those of Facebook or Google. Nevertheless, Sutskever stated that he was willing to leave Google for OpenAI "partly of because of the very strong group of people and, to a very large extent, because of its mission." Brockman stated that "the best thing that I could imagine doing was moving humanity closer to building real AI in a safe way." OpenAI researcher Wojciech Zaremba stated that he turned down "borderline crazy" offers of two to three times his market value to join OpenAI instead.
- Levy, Steven (December 11, 2015). "How Elon Musk and Y Combinator Plan to Stop Computers From Taking Over". Medium/Backchannel. Retrieved December 11, 2015.
Elon Musk: ...we came to the conclusion that having a 501(c)(3)... would probably be a good thing to do
- Greg Brockman
- Markoff, John (December 11, 2015). "Artificial-Intelligence Research Center Is Founded by Silicon Valley Investors". The New York Times. Retrieved December 12, 2015.
- "Tech giants pledge $1bn for 'altruistic AI' venture, OpenAI". BBC News. 12 December 2015. Retrieved 19 December 2015.
- Lewontin, Max (14 December 2015). "Open AI: Effort to democratize artificial intelligence research?". The Christian Science Monitor. Retrieved 19 December 2015.
- Cade Metz (27 April 2016). "Inside OpenAI, Elon Musk's Wild Plan to Set Artificial Intelligence Free". Wired magazine. Retrieved 28 April 2016.
- Dave Gershgorn (27 April 2016). "Elon Musk's Artificial Intelligence Group Opens A 'Gym' To Train A.I". Popular Science. Retrieved 29 April 2016.
- Metz, Cade. "Elon Musk's Lab Wants to Teach Computers to Use Apps Just Like Humans Do". WIRED. Retrieved 31 December 2016.
- Mannes, John. "OpenAI's Universe is the fun parent every artificial intelligence deserves". TechCrunch. Retrieved 31 December 2016.
- "OpenAI - Universe". Retrieved 31 December 2016.
- Claburn, Thomas. "Elon Musk-backed OpenAI reveals Universe – a universal training ground for computers". The Register. Retrieved 31 December 2016.
- "Dota 2". blog.openai.com. Retrieved 12 August 2017.
- Frank, Blair Hanley. "OpenAI's bot beats top Dota 2 player so badly that he quits". Venture Beat. Retrieved 12 August 2017.
- Mendoza, Jessica. "Tech leaders launch nonprofit to save the world from killer robots". The Christian Science Monitor.
- Metz, Cade (15 December 2015). "Elon Musk's Billion-Dollar AI Plan Is About Far More Than Saving the World". Wired. Retrieved 19 December 2015.
Altman said they expect this decades-long project to surpass human intelligence.
- Vishal Sikka (14 December 2015). "OpenAI: AI for All". InfyTalk. Infosys. Retrieved 22 December 2015.
- "Silicon Valley investors to bankroll artificial-intelligence center". The Seattle Times. 13 December 2015. Retrieved 19 December 2015.
- "Sam Altman's Manifest Destiny". The New Yorker (10 October 2016). Retrieved 4 October 2016.
- Greg Brockman; John Schulman (27 April 2016). "OpenAI Gym Beta". OpenAI Blog. OpenAI. Retrieved 29 April 2016.
- "OpenAI Gym". GitHub. Retrieved 8 May 2017.
- Brockman, Greg (12 Sep 2017). "Yep, the Github repo has been the focus of the project for the past year. The Gym site looks cool but hasn't been maintained". @gdb. Retrieved 2017-11-07.
- "AI Sumo Wrestlers Could Make Future Robots More Nimble". Wired. 11 October 2017. Retrieved 2 November 2017.
- "OpenAI's Goofy Sumo-Wrestling Bots Are Smarter Than They Look". MIT Technology Review. Retrieved 2 November 2017.
- Kraft, Amy (14 December 2015). "Elon Musk invests in $1B effort to thwart the dangers of AI". CBS News. Retrieved 19 December 2015.
- Liedtke, Michael. "Elon Musk, Peter Thiel, Reid Hoffman, others back $1 billion OpenAI research center". San Jose Mercury News. Retrieved 19 December 2015.