Kimon Fountoulakis
@kfountou.bsky.social
📤 1119
📥 87
📝 149
Associate Professor at CS UWaterloo Machine Learning Lab: opallab.ca
On the Statistical Query Complexity of Learning Semiautomata: a Random Walk Approach Link to the paper:
arxiv.org/abs/2510.04115
about 1 month ago
1
6
3
I wrote a blog post about it. Link:
medium.com/@kimon.fount...
add a skeleton here at some point
6 months ago
0
3
0
New paper: Learning to Add, Multiply, and Execute Algorithmic Instructions Exactly with Neural Networks
6 months ago
1
5
2
Update, 14 empirical papers added!
add a skeleton here at some point
6 months ago
0
3
0
The SIAM Conference on Optimization 2026 will be in Edinburgh! I don’t really work on optimization anymore (at least not directly), but it’s cool to see a major optimization conference taking place where I did my PhD.
6 months ago
0
1
0
Currently NeurIPS has 21390 submissions. The final number last year was 15671. Observation made by my student George Giapitzakis.
6 months ago
0
5
0
Got a pin this morning Einstein problem:
en.wikipedia.org/wiki/Einstei...
7 months ago
0
2
0
reposted by
Kimon Fountoulakis
Jason Lee
7 months ago
Our new work on scaling laws that includes compute, model size, and number of samples. The analysis involves an extremely fine-grained analysis of online sgd built up over the last 8 years of understanding sgd on simple toy models (tensors, single index models, multi index model)
add a skeleton here at some point
0
5
1
Hey, I definitely predicted this correctly.
7 months ago
0
0
0
ChatGPT gives me the ability to expand my search capabilities on topics that I can only roughly describe, or even illustrate with a figure, when I don’t know the exact keywords to use in a Google search.
7 months ago
0
0
0
Positional Attention is accepted at ICML 2025! Thanks to all co-authors for the hard work (64 pages). If you’d like to read the paper, check the quoted post.
add a skeleton here at some point
7 months ago
1
7
1
NeurIPS 2026 in the Cyclades. Just saying.
7 months ago
0
4
0
I enjoyed reading the paper "A Generalized Neural Tangent Kernel for Surrogate Gradient Learning" (Spotlight, NeurIPS 2024). They extend the NTK framework to activation functions that have finitely many jumps.
7 months ago
1
1
0
reposted by
Kimon Fountoulakis
Waterloo’s David R. Cheriton School of Computer Science
7 months ago
✍️ Code Shaping, an AI-powered software, allows users to edit their code through sketches like diagrams and graphs 📈 🏆 This game-changing platform won the Best Paper Award at
#CHI2025
. 🔗Read more:
uwaterloo.ca/computer-sci...
#UWaterloo
#AI
loading . . .
New AI model turns sketches into code | Cheriton School of Computer Science | University of Waterloo
Co-developed by alum Ryan Yen, Code Shaping can transform coding beyond the keyboard.
https://uwaterloo.ca/computer-science/news/new-ai-model-turns-sketches-code
0
5
5
reposted by
Kimon Fountoulakis
Aleksandros Sobczyk
7 months ago
With my first Bluesky post, I am very pleased to share that my last PhD paper "Deterministic complexity analysis of Hermitian eigenproblems" has been accepted in ICALP 2025. A preprint is available on Arxiv:
arxiv.org/abs/2410.21550
A bit more info on linkedin:
www.linkedin.com/posts/aleksa...
loading . . .
Deterministic complexity analysis of Hermitian eigenproblems
In this work we revisit the arithmetic and bit complexity of Hermitian eigenproblems. We first provide an analysis for the divide-and-conquer tridiagonal eigensolver of Gu and Eisenstat [GE95] in the ...
https://arxiv.org/abs/2410.21550
0
4
2
Update "Memory Augmented Large Language Models are Computationally Universal", Dale Schuurmans link:
arxiv.org/abs/2301.04589
add a skeleton here at some point
7 months ago
0
2
0
reposted by
Kimon Fountoulakis
Alex Dimakis
7 months ago
Excited to be part of
Greeksin.ai
add a skeleton here at some point
0
4
1
Shenghao's Ph.D Thesis "Perspectives of Graph Diffusion: Computation, Local Partitioning, Statistical Recovery, and Applications" is now available. Link:
dspacemainprd01.lib.uwaterloo.ca/server/api/c...
Relevant papers: 1) Local Graph Clustering with Noisy Labels (ICLR 2024)
add a skeleton here at some point
7 months ago
1
3
0
I am still surprised by how difficult it is to train a 2-layer MLP to simply learn to copy or permute the input exactly. If k is the input length, the result below provides a (seemingly tight) upper bound of O(k²) training trials.
add a skeleton here at some point
8 months ago
0
2
0
New additions 1. Graph neural networks extrapolate out-of-distribution for shortest paths.
arxiv.org/abs/2503.19173
2. Round and Round We Go! What makes Rotary Positional Encodings useful?. ICLR 2025.
openreview.net/forum?id=Gtv...
add a skeleton here at some point
8 months ago
1
5
1
Our second kid arrived!
8 months ago
0
4
0
reposted by
Kimon Fountoulakis
Max Thiessen
8 months ago
GLOW is returning on 𝗠𝗮𝗿𝗰𝗵 𝟮𝟲𝘁𝗵, 𝟱𝗽𝗺 𝗖𝗘𝗧 with a special guest:
@petar-v.bsky.social
🌟 He will lecture on LLMs as GNNs – a topic which received quite some attention at our last session. Specifically, we will learn how Graph ML tools can help understand LLM generalisation
1
12
8
1 out of 12 papers in my batch at ICML has a score above 3 (weak acceptance). Each paper has at least 3 reviews.
8 months ago
0
1
0
Computational Capability and Efficiency of Neural Networks: A Repository of Papers I compiled a list of theoretical papers related to the computational capabilities of Transformers, recurrent networks, feedforward networks, and graph neural networks. Link:
github.com/opallab/neur...
8 months ago
2
10
5
Every time I try to use chatGPT or Gemini to write some text for me, I always get vague results. This is not useful. It can't be creative. I don't know why people talk about it as if it actually produces knowledge. Even if I initially think it's helpful, I end up rewriting the entire text because,
8 months ago
1
0
0
Given the recent trend in RL and the Turing Award to RL, you might also be interested in reading "Intelligent Machinery" by A. M. Turing from 1948, where he planted the seeds for RL and discussed the ability of computers to learn from their environment. Link:
weightagnostic.github.io/papers/turin...
8 months ago
0
4
0
Can neural networks learn to copy or permute an input exactly with high probability? We study this basic and fundamental question in "Exact Learning of Permutations for Nonzero Binary Inputs with Logarithmic Training Size and Quadratic Ensemble Complexity" Link:
arxiv.org/abs/2502.16763
9 months ago
1
5
2
reposted by
Kimon Fountoulakis
Max Thiessen
9 months ago
GLOW is back this Wednesday, Feb 19th, 5pm CET 🌟 Instead of talks, we’re hosting a casual discussion on where graph learning is headed and where early-career researchers can make the most impact. Join our open conversation with junior and senior graph researchers!
sites.google.com/view/graph-l...
1
5
3
Cool paper: Theoretical limitations of multi-layer Transformer, spotted by Shenghao Yang. link:
arxiv.org/abs/2412.02975
9 months ago
0
5
0
reposted by
Kimon Fountoulakis
Adam Johansen
9 months ago
Registration is now open for the 2nd RSS/Turing Workshop on Gradient Flows for Sampling, Inference, and Learning at
rss.org.uk/training-eve...
. Date: Monday 24 March 2025, 10.00AM - 5.00PM Location: The Alan Turing Institute
loading . . .
2nd RSS/Turing Workshop on Gradient Flows for Sampling, Inference, and Learning
https://rss.org.uk/training-events/events/events-2025/section-groups/2nd-rss-turing-workshop-on-gradient-flows-for-samp/#eventoverview
3
12
8
Positional Attention: Expressivity and Learnability of Algorithmic Computation (v2) We study the effect of using only fixed positional encodings in the Transformer architecture for computational tasks. These positional encodings remain the same across layers.
10 months ago
2
3
2
I am wondering what percentage of reviewers, who are also authors at the same conference, received positive feedback for their paper and then changed their opinion about a (multiple) paper(s) they reviewed during the rebuttal.
10 months ago
1
1
0
reposted by
Kimon Fountoulakis
Constantine Caramanis
10 months ago
🚀 🇬🇷 A year in the making! I’ve just completed a set of 21 lectures in Machine Learning, in Greek, designed for high school students. The course introduces key ML concepts, coding in Python & PyTorch, and real-world AI applications. 👉 WebPage:
tinyurl.com/ye2awe8m
🎥 YouTube:
tinyurl.com/2wwjru6z
loading . . .
Μηχανική Μάθηση (Machine Learning) - YouTube
Διαλέξεις Τεχνητής Νοημοσύνης και Μηχανικής Μάθησης: https://caramanis.github.io/MachineLearningClass/ Καλωσορίσατε στο μάθημα τεχνητής νοημοσύνης και μηχανι...
https://tinyurl.com/2wwjru6z
2
8
3
I miss those summer European conferences! I used to attend them as a PhD student, it was always fun!
10 months ago
0
2
0
. Shenghao Yang passed his PhD defence today. Shenghao is the second PhD student to graduate from our group. I am very happy for Shenghao and the work that he has done!
10 months ago
1
8
2
reposted by
Kimon Fountoulakis
Melanie Mitchell
11 months ago
Some of my thoughts on OpenAI's o3 and the ARC-AGI benchmark
aiguide.substack.com/p/did-openai...
loading . . .
Did OpenAI Just Solve Abstract Reasoning?
OpenAI’s o3 model aces the "Abstraction and Reasoning Corpus" — but what does it mean?
https://aiguide.substack.com/p/did-openai-just-solve-abstract-reasoning
17
341
125
It seems that Finland's Publication Forum (known as JUFO) decided that the review process in journals like MDPI is too fast and unreliable. As a result, they downgraded these journals to the lowest classification: zero.
deevybee.blogspot.com/2024/12/finl...
.
loading . . .
Finland vs. Germany: the case of MDPI
It's been an odd week for the academic publisher MDPI. On 16th December, Finland's Publication Forum (known as JUFO) announced that from J...
http://deevybee.blogspot.com/2024/12/finland-vs-germany-case-of-mdpi.html
11 months ago
1
3
1
reposted by
Kimon Fountoulakis
Francis Bach
11 months ago
My book is (at last) out, just in time for Christmas! A blog post to celebrate and present it:
francisbach.com/my-book-is-o...
2
142
38
reposted by
Kimon Fountoulakis
Gautam Kamath
11 months ago
ICML 2025 has some exciting changes. Here are two of my favorites. 1. Only 1 round of back-and-forth between authors & reviewers. The review process should not be an endless back and forth. It shouldn't be possible to get your paper accepted by exhausting reviewers.
2
65
11
On this day, 6 years ago, we started a road trip from Berkeley to Waterloo. It lasted 8 days, and we passed through California, Nevada, Arizona, Utah, Colorado, Nebraska, Iowa, Illinois, Indiana, and Michigan.
11 months ago
0
4
0
The first major breakthrough in AI occurred in the field of images, driven by the availability of large amounts of labeled image data. Then, it extended to text, thanks to the abundance of "labeled" internet data. It's hard to imagine a larger generic dataset.
11 months ago
1
1
0
reposted by
Kimon Fountoulakis
Thatchaphol Saranurak
11 months ago
A nice lecture series on graph theory
www.youtube.com/@DiestelGrap...
loading . . .
Reinhard Diestel: Graph theory lectures
These videos are live recordings, minimally edited, of 56 lectures on graph theory that I gave at Hamburg University in 2023/24. They are based on the 6th edition of my Graph Theory book, which is ava...
https://www.youtube.com/@DiestelGraphTheory
0
13
1
Robert Wang is presenting his work at
#NeurIPS2024
"Analysis of Corrected Graph Convolutions". Date/time: Fri 13 Dec 11 a.m. PST — 2 p.m. PST. link:
openreview.net/pdf?id=MSsQD...
11 months ago
1
5
0
Aseem's thesis, "Statistical Foundations for Learning on Graphs", is available on UWSpace. link:
uwspace.uwaterloo.ca/items/291d10...
12 months ago
0
6
0
reposted by
Kimon Fountoulakis
Dan Roy
12 months ago
Link:
arxiv.org/abs/2412.024...
loading . . .
Artificial Expert Intelligence through PAC-reasoning
Artificial Expert Intelligence (AEI) seeks to transcend the limitations of both Artificial General Intelligence (AGI) and narrow AI by integrating domain-specific expertise with critical, precise reas...
https://arxiv.org/abs/2412.02441v1
1
7
3
reposted by
Kimon Fountoulakis
Ahmad Beirami
12 months ago
Dear
#ICLR
authors: As the discussion period comes to an end, please consider writing a 𝐜𝐨𝐧𝐜𝐢𝐬𝐞, accurate, and clear summary of the rebuttal and discussion period for the reviewers/AC/SAC to ground the next phase of the decision making.
2
16
1
LVLM-COUNT: Enhancing the Counting Ability of Large Vision-Language Models By splitting the image into sub-images using a novel object-aware division technique, we can enhance the performance of LVLMs such as GPT-4o and Gemini Pro 1.5. Link:
arxiv.org/abs/2412.00686
12 months ago
1
4
1
reposted by
Kimon Fountoulakis
Terence Tao
12 months ago
*AI for Mathematics and Theoretical Computer Science*, a workshop hosted jointly by the Simons Institute for the Theory of Computing and the Simons Laufer Mathematical Sciences Institute, will be held in Berkeley at April 7-11, 2025.
simons.berkeley.edu/workshops/si...
loading . . .
Simons Institute for the Theory of Computing and SLMath Joint Workshop: AI for Mathematics and Theoretical Computer Science
This is an exciting time for mathematics, as new technologies for mathematical reasoning provide novel opportunities for mathematical research, communication, and discovery. Mathlib, a library of form...
https://simons.berkeley.edu/workshops/simons-institute-theory-computing-slmath-joint-workshop-ai-mathematics-theoretical
1
132
29
Load more
feeds!
log in