Research
Exploring the beauty of pure mathematics in novel ways
More than a century ago, Srinivasa Ramanujan shocked the mathematical world with his extraordinary ability to see remarkable patterns in numbers that no one else could see. The self-taught mathematician from India described his insights as deeply intuitive and spiritual, and patterns often came to him in vivid dreams. These observations captured the tremendous beauty and sheer possibility of the abstract world of pure mathematics. In recent years, we have begun to see AI make breakthroughs in areas involving deep human intuition, and more recently on some of the hardest problems across the sciences, yet until now, the latest AI techniques have not assisted in significant results in pure maths research.
As part of DeepMind's mission to solve intelligence, we explored the potential of machine learning (ML) to recognize mathematical structures and patterns, and help guide mathematicians toward discoveries they may otherwise never have found — demonstrating for the first time that AI can help at the forefront of pure mathematics.
Our research paper, published today in the journal Nature, details our collaboration with top mathematicians to apply AI toward discovering new insights in two areas of pure mathematics: topology and representation theory. With Professor Geordie Williamson at the University of Sydney, we discovered a new formula for a conjecture about permutations that has remained unsolved for decades. With Professor Marc Lackenby and Professor András Juhász at the University of Oxford, we have discovered an unexpected connection between different areas of mathematics by studying the structure of knots. These are the first significant mathematical discoveries made with machine learning, according to the top mathematicians who reviewed the work. We’re also releasing full companion papers on arXiv for each result that will be submitted to appropriate mathematical journals (permutations paper; knots paper). Through these examples, we propose a model for how these tools could be used by other mathematicians to achieve new results.
A knot is one of the fundamental objects in low-dimensional topology. It is a twisted loop embedded in 3 dimensional space.
A permutation is a re-arrangement of an ordered list of objects. The permutation “32415” puts the 1st element in the 3rd location, the 2nd element in the 2nd location and so on.
The two fundamental objects we investigated were knots and permutations.
For many years, computers have been used by mathematicians to generate data to help in the search for patterns. Known as experimental mathematics, this kind of research has resulted in well-known conjectures, such as the Birch and Swinnerton-Dyer conjecture — one of six Millennium Prize Problems, the most well-known open problems in mathematics (with a US$1 million prize attached to each). While this approach has been successful and is fairly common, the identification and discovery of patterns from this data has still relied mainly on mathematicians.
Finding patterns has become even more important in pure maths because it’s now possible to generate more data than any mathematician can reasonably expect to study in a lifetime. Some objects of interest — such as those with thousands of dimensions — can also simply be too unfathomable to reason about directly. With these constraints in mind, we believed that AI would be capable of augmenting mathematicians’ insights in entirely new ways.
It feels like Galileo picking up a telescope and being able to gaze deep into the universe of data and see things never detected before.
Marcus Du Sautoy, Simonyi Professor for the Public Understanding of Science and Professor of Mathematics, University of Oxford
Our results suggest that ML can complement maths research to guide intuition about a problem by detecting the existence of hypothesised patterns with supervised learning and giving insight into these patterns with attribution techniques from machine learning:
With Professor Williamson, we used AI to help discover a new approach to a long-standing conjecture in representation theory. Defying progress for nearly 40 years, the combinatorial invariance conjecturestates that a relationship should exist between certain directed graphs and polynomials. Using ML techniques, we were able to gain confidence that such a relationship does indeed exist and to identify that it might be related to structures known as broken dihedral intervals and extremal reflections. With this knowledge, Professor Williamson was able to conjecture a surprising and beautiful algorithm that would solve the combinatorial invariance conjecture. We have computationally verified the new algorithm across more than 3 million examples.
With Professor Lackenby and Professor Juhász, we explored knots - one of the fundamental objects of study in topology. Knots not only tell us about the many ways a rope can be tangled but also have surprising connections with quantum field theory and non-Euclidean geometry. Algebra, geometry, and quantum theory all share unique perspectives on these objects and a long standing mystery is how these different branches relate: for example, what does the geometry of the knot tell us about the algebra? We trained an ML model to discover such a pattern and surprisingly, this revealed that a particular algebraic quantity — the signature — was directly related to the geometry of the knot, which was not previously known or suggested by existing theory. By using attribution techniques from machine learning, we guided Professor Lackenby to discover a new quantity, which we call the natural slope, that hints at an important aspect of structure overlooked until now. Together we were then able to prove the exact nature of the relationship, establishing some of the first connections between these different branches of mathematics.
We investigated whether ML could shed light on relationships between different mathematical objects. Shown here are two “Bruhat intervals” and their associated “Kazhdan-Lusztig polynomials” - two fundamental objects in representation theory. A Bruhat interval is a diagram that represents all the different ways you could reverse the order of a collection of objects by only swapping two of them at a time. The KL polynomials tell mathematicians something deep and subtle about the different ways that this graph can exist in high dimensional space. Interesting structure only starts to emerge when the Bruhat intervals have 100s or 1000s of vertices.
Our models highlight previously undiscovered structure that guided us to surprising new mathematical results. Shown here is a striking relationship between the geometry and signature of a knot. The geometry of a knot has to do with its shape (e.g. it’s volume) when measured in a canonical way. The signature is an algebraic invariant which can be calculated by looking at the way the knot crosses itself and twists.
The use of learning techniques and AI systems holds great promise for the identification and discovery of patterns in mathematics. Even if certain kinds of patterns continue to elude modern ML, we hope our Nature paper can inspire other researchers to consider the potential for AI as a useful tool in pure maths. To replicate the results, anybody can access our interactive notebooks. Reflecting on the incredible mind of Ramanujan, George Frederick James Temple wrote, “The great advances in mathematics have not been made by logic but by creative imagination.” Working with mathematicians, we look forward to seeing how AI can further elevate the beauty of human intuition to new levels of creativity.