Andrew Yan-Tak Ng (Chinese: 吳恩達; born 1976) is a Chinese-American computer scientist and statistician, focusing on machine learning and AI. Also a business executive and investor in the Silicon Valley, Ng co-founded and led Google Brain and was a former Vice President and Chief Scientist at Baidu, building the company's Artificial Intelligence Group into a team of several thousand people.
Ng is an adjunct professor at Stanford University (formerly associate professor and Director of its AI Lab). Also a pioneer in online education, Ng co-founded Coursera and deeplearning.ai. With his online courses, he has successfully spearheaded many efforts to "democratize deep learning." Since 2018 he launched and currently heads AI Fund, initially a $175-million investment fund for backing artificial intelligence startups. He has founded Landing AI, which provides AI-powered SaaS products and Transformation Program to empower enterprises into cutting-edge AI companies.
Ng was born in London, UK in 1976. His parents are both immigrants from Hong Kong. Growing up, he spent time in Hong Kong and Singapore and later graduated from Raffles Institution in Singapore in 1992.
In 1997, he earned his undergraduate degree with a triple major in computer science, statistics, and economics at the top of his class from Carnegie Mellon University in Pittsburgh, Pennsylvania. Between 1996–1998 he also conducted research on reinforcement learning, model selection, and feature selection at the AT&T Bell Labs.
In 1998 Ng earned his master's degree from the Massachusetts Institute of Technology in Cambridge, Massachusetts. At MIT he built the first publicly available, automatically-indexed web-search engine for research papers on the web (it was a precursor to CiteSeer/ResearchIndex, but specialized in machine learning).
In 2002, he received his PhD from the UC, Berkeley under the supervision of Michael I. Jordan. His thesis is titled "Shaping and policy search in reinforcement learning" and is well cited to this day.
He currently lives in Los Altos Hills, California. In 2014, he married Carol E. Reiley and in February 2019 they had their first child, Nova. The MIT Tech Review named Ng and Reiley an "AI power couple."
Academia and TeachingEdit
Ng is a professor at Stanford University Department of Computer Science and Department of Electrical Engineering. He became Director of the Stanford Artificial Intelligence Lab, where he taught students and undertook research related to data mining, big data, and machine learning. His machine learning course CS229 at Stanford is one of the most popular courses offered on campus with over 1000 students enrolling some years.
Since joining Stanford in 2002, he has advised dozens of Ph.D and M.Sc students, including Ian Goodfellow, Quoc Le and many other students who have gone on to work for academia or companies like Google, Facebook, Apple, Twitter, and 23andme.
In 2008 his group at Stanford was one of the first in the US to start advocating the use of GPUs in deep learning. The rationale was that an efficient computation infrastructure could speed up statistical model training by orders of magnitude, ameliorating some of the scaling issues associated with big data. At the time it was a controversial and risky decision, but since then and following Ng's lead, GPUs have become a cornerstone in the field. Since 2017 Ng has been advocating the shift to High Performance Computing (HPC) for scaling up deep learning and accelerating progress in the field.
In 2012, along with Stanford computer scientist Daphne Koller he co-founded and was CEO of Coursera, a website that offers free online courses to everyone. It took off with over 100,000 students registered for Ng's popular CS229A course. Today, several million people have enrolled in Coursera courses, making the site one of the leading MOOC's in the world.
In 2014, he joined Baidu as Chief Scientist, and carried out research related to big data and A.I. There he set up several research teams for things like facial recognition and Melody, an AI chatbot for healthcare (like Siri or Amazon's Alexa). In March 2017, he announced his resignation from Baidu.
He soon afterwards launched Deeplearning.ai, an online series of deep learning courses. Then Ng launched Landing AI, which provides AI-powered SaaS products and Transformation Program to empower enterprises into cutting-edge AI companies.
Ng researches primarily in machine learning, deep learning, machine perception, computer vision, and natural language processing; and is one of the world's most famous and influential computer scientists.
His early work includes the Stanford Autonomous Helicopter project, which developed one of the most capable autonomous helicopters in the world. He also worked on the STAIR (STanford Artificial Intelligence Robot) project, which resulted in ROS, a widely used open-source robotics software platform. He is also one of the founding team members for the Stanford WordNet project, which uses machine learning to expand the Princeton WordNet database created by Christiane Fellbaum.
In 2011, Ng founded the Google Brain project at Google, which developed large scale artificial neural networks using Google's distributed computer infrastructure. Among its notable results was a neural network trained using deep learning algorithms on 16,000 CPU cores, which learned to recognize cats after watching only YouTube videos, and without ever having been told what a "cat" is. The project's technology is also currently used in the Android Operating System's speech recognition system.
Online education: MOOCsEdit
|Interview with Coursera Co-Founder Andrew Ng, Degree of Freedom|
In 2011, Stanford launched a total of three Massive open online courses (MOOCs) on machine learning (CS229a), databases, and AI, taught by Ng, Peter Norvig, Sebastian Thrun, and Jennifer Widom. This has led to the modern MOOC movement. Ng taught machine learning and Widom taught databases. The course on AI taught by Thrun led to the genesis of Udacity, and since then other MOOCs like edX, FUN, etc. have followed suit.Coursera was the 6th online education website that Ng built and arguably the most successful to date.
But we learned and learned and learned from the early prototypes, until in 2011 we managed to build something that really took off.
Founding of CourseraEdit
Key ideas drew from a variety of people. Within Stanford, they include Daphne Koller with her "blended learning experiences" and co-designing a peer-grading system, John Mitchell (Courseware, a Learning Management System), Dan Boneh (using machine learning to sync videos, later teaching cryptography on Coursera), Bernd Girod (ClassX), and others. Outside Stanford both Ng and Thrun credit Sal Khan of Khan Academy as a huge source of inspiration. Ng was also inspired by lynda.com and the design of the forums of Stack Overflow.
Ng started the Stanford Engineering Everywhere (SEE) program, which in 2008 published a number of Stanford courses online for free. Ng taught one of these courses, "Machine Learning", which includes his video lectures, along with the student materials used in the Stanford CS229 class. It offered a similar experience to MIT's Open Courseware except it aimed at providing a more "complete course" experience, equipped with lectures, course materials, problems and solutions, etc. The SEE videos were viewed by the millions and inspired Ng develop and iterate new versions of online tech.
Widom, Ng, and others were ardent advocates of Khan-styled tablet recordings, and between 2009–2011, several hundred hours of lecture videos recorded by Stanford instructors were recorded and uploaded. Ng tested some of the original designs with a local high school to figure the best practices for recording lessons.
In October 2011, the "applied" version of the Stanford class (CS229a) was hosted on ml-class.org and launched, with over 100,000 students registered for its first edition. The course featured quizzes and graded programming assignments and became one of the first and most successful Massive open online courses (MOOCs) created by a Stanford professor.
Two other courses on databases (db-class.org) and AI (ai-class.org) were launched. The ml-class and db-class ran on a platform developed by students, including Frank Chen, Jiquan Ngiam, Chuan-Yu Foo, and Yifan Mai. Word spread through social media and popular press. The three courses were 10 weeks long, and over 40,000 "Statements of Accomplishment" were awarded.
Ng tells the following story on the early days of Coursera:
In 2011, I was working with four Stanford students. We were under tremendous pressure to build new features for the 100,000+ students that were already signed up. One of the students (Frank Chen) claims another one (Jiquan Ngiam) frequently stranded him in the Stanford building and refused to give him a ride back to his dorm until very late at night, so that he no choice but to stick around and keep working. I neither confirm nor deny this story.
His work subsequently led to his founding of Coursera with Koller in 2012. As of 2019, the two most popular courses on the platform were taught and designed by Ng: "Machine Learning" (#1) and "Neural Networks and Deep Learning" (#2).
In 2019, Ng launched a new course "AI for Everyone." This is a non-technical course designed to help people understand AI's impact on society and its benefits and costs for companies, as well as how they can navigate through this technological revolution.
Ng is the chair of the board for Woebot Labs, a psychological clinic that uses data science to provide cognitive behavioral therapy. It provides a therapy chatbot to help treat depression, among other things.
Through Landing AI, he also focuses on democratizing AI technology and lowering the barrier for entrance to businesses and developers.
Publications and awardsEdit
Ng is also the author or co-author of over 300 published papers in machine learning, robotics, and related fields. His work in computer vision and deep learning has been frequently featured in press releases and reviews.
- 2007. Sloan Fellowship
- 2008. MIT Technology Review TR35
- 2009. IJCAI Computers and Thought Award
- 2013. Times 100 Most Influential People
- 2013. Fortune's 40 under 40 
- 2013. CNN 10
- 2014. Fast Company's Most Creative People in Business
- 2015. World Economics Forum Young Global Leaders
He has co-refereed hundreds of AI publications in journals like NIPS. He has also been the editor for the Journal of Artificial Intelligence Research (JAIR), Associate Editor for the IEEE Robotics and Automation Society Conference Editorial Board (ICRA), and much more.
He has given invited talks at NASA, Google, Microsoft, Lockheed Martin, the Max Planck Society, Stanford, Princeton, UPenn, Cornell, MIT, UC Berkeley, and dozens of other universities. Outside of the US, he has lectured in Spain, Germany, Israel, China, Japan, Korea, and Canada.
Other Awards and HonorsEdit
- IJCAI Computers and Thought award (highest award in AI given to a researcher under 35): 2009;
- ICML Best Paper Award: Best application paper: 2009;
- Vance D. & Arlene C. Coffman Faculty Scholar Award: 2009;
- TR35 (Technology Review, 35 innovators under 35): 2008;
- ICML Best Paper Award: Best application paper: 2008;
- Alfred P. Sloan Research Fellow: 2007;
- 3dRR Best Paper Award: 2007;
- ACL Best Paper Award: 2006;
- CEAS Best Student Paper Award: 2005;
- Microsoft Research Fellowship: 2001–2002;
- Berkeley Fellowship: 1998–2000;
- Phi Kappa Phi Honors Society: 1997;
- Student Leadership Award: 1997;
- Microsoft Technical Award: 1996;
- Andrew Carnegie Society Scholarship: 1996;
- Pi Mu Epsilon Honors Society: 1996;
- Microsoft Technical Scholarship Award: 1995;
- Phi Beta Kappa Honors Society: 1995;
- Bell Atlantic Network Services Scholarship: 1995;
- Omicron Delta Upsilon Honors Society: 1995.
Ng has filed patents in sundry things from text-to-speech (TTS) systems, compressed video and audio recordings, rechargeable batteries, electronic roll towel dispensers, an energy saving cooker, and a one-size-fits-all T-shirt. This suggests the versatility and scope of his research in addition to its depth.
He also wrote a book "Machine Learning Yearning", a practical guide for those interested in machine learning, which he distributed for free. In December 2018, he wrote a sequel called "AI Transformation Playbook".
Ng contributed one chapter to Architects of Intelligence: The Truth About AI from the People Building it (2018) by the American futurist Martin Ford.
Views on AIEdit
Ng is one of the scientists credited with bringing humanity to AI, and he sees AI as a technology that will improve the lives of people, not an anathema that will "enslave" the human race. To quote his Quora response:
Worrying about AI evil superintelligence today is like worrying about overpopulation on the planet Mars. We haven't even landed on the planet yet!
He sees the potential benefits of AI as outweighing the threats, which seem exaggerated. And that's one reason he set out on the mission to democratize AI learning so that people everywhere can learn more about it and understand how it can help us. Mark Zuckerberg has taken a similar stance, as opposed to Elon Musk.
In 2017, Ng said he supported basic income to provide people tools to learn about AI and spend time studying so that they can re-enter the workforce as productive members. He has enjoyed reading Erik Brynjolfsson and Andrew McAfee's "The Second Machine Age" which discusses issues such as AI displacement of jobs.
- Seligman, Katherine (December 3, 2006). "If Andrew Ng could just get his robot to assemble an Ikea bookshelf, we'd all buy one". SFGate. Retrieved February 12, 2013.
- Terdiman, Daniel (March 22, 2017). "Baidu's head of artificial intelligence is stepping down". Fast Company. Retrieved April 17, 2019.
- Mozur, Paul (March 22, 2017). "A.I. Expert at Baidu, Andrew Ng, Resigns From Chinese Search Giant". The New York Times. ISSN 0362-4331. Retrieved April 17, 2019.
- "Andrew Ng — Stanford University | Coursera". Coursera. Retrieved August 29, 2017.
- "Home". Landing AI. Retrieved April 17, 2019.
- Ng, Andrew. "Cirriculum Vitae—Andrew Y. Ng" (PDF).
- Ng, Andrew (2003). "Shaping and policy search in Reinforcement Learning" (PDF).
- "Inside The Mind That Built Google Brain: On Life, Creativity, And Failure". The Huffington Post. May 13, 2015. Retrieved December 19, 2015.
- Ng, Andrew (February 20, 2019). "Announcing Nova Ng, our first daughter. Plus, some thoughts on the AI-powered world she will grow up in..." @AndrewYNg. Retrieved March 7, 2019.
- https://twitter.com/AndrewYNg/status/804739157935276032. Missing or empty
- "Why Is Machine Learning (CS 229) The Most Popular Course At Stanford?". Forbes. 2013.
- "CS229: Machine Learning". cs229.stanford.edu. Retrieved April 17, 2019.
- "What does Andrew Ng think about Deep Learning? – Quora". quora.com. Retrieved April 17, 2019.
- Friedman, Thomas L. (May 15, 2012). "Opinion | Come the Revolution". The New York Times. ISSN 0362-4331. Retrieved February 19, 2018.
- Gannes, Liz (May 16, 2014). "Baidu Hires Coursera Founder Andrew Ng to Start Massive Research Lab". Recode. Retrieved August 29, 2017.
- "Opening a new chapter of my work in AI". 2017. Retrieved May 16, 2014.
- Ng, Andrew (August 8, 2017). "deeplearning.ai: Announcing new Deep Learning courses on Coursera". Medium. Retrieved February 19, 2018.
- "Andrew Ng unveils the AI Fund, with $175 million to back new startups | VentureBeat". venturebeat.com. January 30, 2018. Retrieved February 19, 2018.
- "One of the world's most famous computer scientists reveals his 'playbook' for bringing AI to every business". Business Insider. 2018.
- "From Self-Flying Helicopters to Classrooms of the Future". Chronicle of Higher Education. 2012.
- "Stanford Autonomous Helicopter Project".
- John Markoff (July 18, 2006). "Brainy Robots Start Stepping Into Daily Life". New York Times.
- "The Stanford Wordnet Project". ai.stanford.edu. Retrieved April 17, 2019.
- Claire Miller and Nick Bilton (November 3, 2011). "Google's Lab of Wildest Dreams". New York Times.
- John Markoff (June 25, 2012). "How Many Computers to Identify a Cat? 16,000". New York Times.
- Ng, Andrew; Dean, Jeff (2012). "Building High-level Features Using Large Scale Unsupervised Learning". arXiv:1112.6209 [cs.LG].
- "Speech Recognition and Deep Learning". Google Research Blog. August 6, 2012. Retrieved January 29, 2013.
- David M. Blei, Andrew Y. Ng, Michael I. Jordan. Latent Dirichlet allocation. The Journal of Machine Learning Research, Volume 3, January 3, 2003, which is one of the two papers that independently discovered Latent Dirichlet allocation
- "Interview with Coursera Co-Founder Andrew Ng". Degree of Freedom. May 17, 2013. Retrieved May 19, 2013.
- Ng, Andrew; Widom, Jennifer. "Origins of the Modern MOOC".
- Ng, Andrew; Widom, Jennifer. "Origins of the Modern MOOC (xMOOC)" (PDF).
- "What are some good stories from the early days of Coursera? – Quora". quora.com. Retrieved April 17, 2019.
- Theresa Johnson. "Stanford for All". Stanford Magazine.
- News, The PIE. "Online learning took a tech turn in 2017 – Coursera's most popular courses". thepienews.com. Retrieved December 14, 2018.
- "Year in Review: 10 Most Popular Courses in 2017". Coursera Blog. December 14, 2017. Retrieved December 14, 2018.
- Ng, Andrew (November 14, 2018). "Announcing "AI for Everyone": a new course from deeplearning.ai". Medium. Retrieved December 14, 2018.
- "Woebot – Your charming robot friend who is here for you, 24/7". woebot.io. Retrieved April 17, 2019.
- "Andrew Ng LinkedIn page".
- "Home » drive.ai » the self-driving car is here". drive.ai. Retrieved April 17, 2019.
- "Andrew Ng – Google Scholar Citations". scholar.google.com. Retrieved December 14, 2018.
- New algorithm improves robot vision
- "2008 Young Innovators Under 35". Technology Review. 2008. Retrieved August 15, 2011.
- Technology Review: TR35
- at the age of 37 Emanuel, Ezekiel. "The 2013 TIME 100". Time. ISSN 0040-781X. Retrieved February 19, 2018.
- "Fortune's 40 under 40 – The hottest young stars in business". Fortune. Retrieved February 19, 2018.
- "Andrew Ng – Quora". quora.com. Retrieved April 17, 2019.
- "Andrew Ng Inventions, Patents and Patent Applications – Justia Patents Search". patents.justia.com. Retrieved April 17, 2019.
- "Machine Learning Yearning". 2017.
- "AI Transformation Playbook How to lead your company into the AI era". Landing AI. December 13, 2018. Retrieved December 14, 2018.
- "Is AI an existential threat to humanity? – Quora". quora.com. Retrieved April 17, 2019.
- "How will work and jobs change by 2035? – Quora". quora.com. Retrieved April 17, 2019.
- Follow Andrew Ng on Twitter
- Ng's Quora profile
- Ng's Medium blog
- Ng's LinkedIn
- Curriculum Vitae
- Academic Genealogy
- STAIR Homepage
- From Self-Flying Helicopters to Classrooms of the Future
- Machine Learning (CS 229) Video Lecture
- Lecture videos
- http://cs229.stanford.edu/ (CS 229, perhaps the most popular introductory machine learning course in the world)