What's new in the world of AI
November 1, 2021Below is yesterday's 60 MINUTES interview with Yuval Noah Harari about the future of AI. AI is being increasingly given data not just about where we go, what we do, what we buy, and how we vote, but also biometric data about our biological makeup. The notion of hacking another human being (ethically or not), which Harari says it means knowing that person better than they know themselves, is identical with the concept of a digital twin in the merged national graphs, which is a central concept on our website.
June 3, 2021This is an interview with Dr. Henry Kissinger in which he explains how he got interested in AI. It brings a unique perspective to our topic from an icon of US diplomacy, and it's especially relevant to the article AI in a Bipolar World. You might also want to listen to his interview at the Bush Center about the US, Russia, China, and AI, for additional insights. In more recent interviews with Dr. Kissinger you will also find support for one of our main points, namely the need to ramp up our AI efforts in the US considerably, and not just in the private sector.
May 20, 2021Transformers have been the most interesting new development in neural networks, especially in language applications, where in the beginning neural networks did not enjoy the same success as in computer vision applications. I've started to write a short technical note about them here: Transformers.
February 15, 2021Will AI replace or augment humans in the workforce? This is a difficult question and many very different answers have been given. This is a thoughtful presentation of this dilemma: Artificial Intelligence And The End Of Work. Most technologists lean towards augmentation. But the author of the article is leaning towards replacement, not augmentation, and reflects on what this might mean for humanity. From the article: "The myth of augmentation has spread far and wide in real-world contexts, too. One powerful reason why: job loss from automation is a frightening prospect and a political hot potato. Let’s unpack that. Entrepreneurs, technologists, politicians and others have much to gain by believing—and by persuading others to believe—that AI will not replace but rather will supplement humans in the workforce. Employment is one of the most basic social and political necessities in every society in the world today. To be openly job-destroying is therefore a losing proposition for any technology or business."
February 10, 2021AI can pose new mathematical conjectures, a first result of this kind. Posing good conjectures in mathematics seemed to be a very creative human endeavor, so the fact that AI can sift through enough math and create interesting conjectures is pretty significant. Machines Are Inventing New Math We've Never Seen, published by researchers from the Technion in Haifa and from Google's operation in Tel Aviv.
December 17, 2020AI has been used in many ways to fight the COVID-19 pandemic, especially for the development of new vaccines. This time it is being used after the vaccines are administered, to track the after effects. From the article: "The technology will also track issues or trends related to ethnicity, age, gender, or other demographic factors that can come into play with the vaccine" : How AI is Helping with COVID-19 Vaccine Rollout and Tracking.
November 11, 2020Mathematics can be looked at as a game, played according to rules specified within what we call formal systems. In theory, a computer can be programmed to produce all the theorems of such a formal system. So it could produce all the algebra, the geometry, and the calculus you have learned in school. In practice though, mathematicians still have to rely on a great deal of inventiveness to find such proofs. Nevertheless, the strive to develop proof assistants has never ceased and there have been many notable but disparate successes. Now this work is being pushed even further, and in a more organized way.
From the article The Effort to Build the Mathematical Library of the Future: "Digitizing mathematics is a longtime dream. The expected benefits range from the mundane—computers grading students’ homework—to the transcendent: using artificial intelligence to discover new mathematics and find new solutions to old problems. Mathematicians expect that proof assistants could also review journal submissions, finding errors that human reviewers occasionally miss, and handle the tedious technical work that goes into filling in all the details of a proof."
If this interests you in a more serious way, I have written a program of study for formal software development, in which these ideas are treated in more depth: Formal Software Development Program. It's in a slide presentation format, which allows a smooth gradual viewing of each page; view it in Adobe Acrobat Reader (free download from Adobe), not in your browser.
November 3, 2020An interesting view on the future of Artificial Intelligence, in an interview with Geoffrey Hinton, a pioneer of deep learning techniques. For his contributions, Hinton was awarded the Turing Award last year, together with Yann LeCun and Yoshua Bengio.
Interviewer: "You think deep learning will be enough to replicate all of human intelligence. What makes you so sure?"
Hinton: "I do believe deep learning is going to be able to do everything, but I do think there’s going to have to be quite a few conceptual breakthroughs. For example, in 2017 Ashish Vaswani et al. introduced transformers, which derive really good vectors representing word meanings. It was a conceptual breakthrough. It’s now used in almost all the very best natural-language processing. We’re going to need a bunch more breakthroughs like that."
October 12, 2020A timely Forbes article on some future directions of AI, with an informative look at the types of networks called transformers, the recent success they have had in NLP, and their potential uses in other areas, like computer vision. The Next Generation Of Artificial Intelligence. I'll probably add it to the permanent "Further Reading" list as a complement to the Main AI Concepts article.
October 6, 2020NVIDIA Uses AI to Slash Bandwidth on Video Calls. Obviously, this is even more meaningful given the current reliance on video calls by businesses and individuals, given the covid health crisis. From the article:
"What the researchers have achieved has remarkable results: by replacing the traditional h.264 video codec with a neural network, they have managed to reduce the required bandwidth for a video call by an order of magnitude. In one example, the required data rate fell from 97.28 KB/frame to a measly 0.1165 KB/frame – a reduction to 0.1% of required bandwidth. The mechanism behind AI-assisted video conferencing is breathtakingly simple. The technology works by replacing traditional full video frames with neural data. Typically, video calls work by sending h.264 encoded frames to the recipient, and those frames are extremely data-heavy. With AI-assisted video calls, first, the sender sends a reference image of the caller. Then, instead of sending a stream of pixel-packed images, it sends specific reference points on the image around the eyes, nose, and mouth."