Research Goal: Understanding the computational and statistical principles required to design AI/RL agents. Associate Professor at Polytechnique Montréal and Mila. 🇨🇦 academic.sologen.nethttps://bsky.app/profile/sologen.bsky.socialhttps://bsky.app/profile/sologen.bsky.social/post/3mvbpurdmrc2hShana Tova!11 Sep 2026 23:29 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mvbpurdmrc2hhttps://bsky.app/profile/sologen.bsky.social/post/3muzdzxigcc2dNice collection of historic AI-related papers and movies! - Minsky's PhD thesis, which he talks about RL (I'd heard of this; never seen!) - Turing's paper on AI - Fukushima's convolutional net - Kismet robot [contains quote post or other embedded content]08 Sep 2026 15:36 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3muzdzxigcc2dhttps://bsky.app/profile/sologen.bsky.social/post/3mux2pym4ec2yJames R. Munkres, whom I know because of his Topology textbook, has died. May he rest connected! August 18, 1930 – July 30, 2026 https://www.douglassfh.com/obituary/james-munkres07 Sep 2026 17:44 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mux2pym4ec2yhttps://bsky.app/profile/sologen.bsky.social/post/3mqag6vtv5c2bThis platform will not replace Twitter/X for us (scientists, researchers, profs, etc.). It might be (noticeably) better in several aspects, but (1) it is not a disruptive innovation, and (2) has the third mover disadvantage. P.S: I'll stay active here for now.09 Jul 2026 19:57 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mqag6vtv5c2bhttps://bsky.app/profile/sologen.bsky.social/post/3mqa2vsc5h22nIt is interesting that we still don't have a completely clear picture of why/when (Optimisitic) Policy Iteration + Monte Carlo estimate works, especially with every-visit update model (which can be biased though consistent, BTW).09 Jul 2026 16:35 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mqa2vsc5h22nhttps://bsky.app/profile/sologen.bsky.social/post/3mplyji3ij22n🇨🇦🍁Happy Canada Day!🍁🇨🇦01 Jul 2026 16:59 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mplyji3ij22nhttps://bsky.app/profile/sologen.bsky.social/post/3mpf72qpuk22r🇨🇦Canadian Heroes🇨🇦29 Jun 2026 00:08 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mpf72qpuk22rhttps://bsky.app/profile/sologen.bsky.social/post/3mp55qla3ms2nTemporal Difference Learning for Diffusion Models (ICML 2026) arxiv.org/abs/2606.15048 By Yangchen Pan (my former PhD student) and co-authors. It reformulates diffusion training as a Markov reward process and introduces a TD objective to encourage temporal consistency across denoising steps. https://arxiv.org/abs/2606.1504825 Jun 2026 19:23 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mp55qla3ms2nhttps://bsky.app/profile/sologen.bsky.social/post/3mnl2c4go522bSad to hear the passing of Dimitri Bertsekas (1942- 2026). His work has been very influential to me and shaped the way I think about RL. I am sure this is the case for many others in the RL, Control, and Optimization communities.05 Jun 2026 21:08 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mnl2c4go522bhttps://bsky.app/profile/sologen.bsky.social/post/3mmfkl3yb4c2zIf you have a Reinforcement Learning paper accepted at TMLR, JMLR, JAIR, AIJ, or MLJ, you can use this wonderful opportunity to present your work and meet your peers at RLC in Montreal, Canada. 🇨🇦 [contains quote post or other embedded content]21 May 2026 23:18 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mmfkl3yb4c2zhttps://bsky.app/profile/sologen.bsky.social/post/3mke2pcsfx225Do you use often use PPO, but wish you could use something just better? Try REPPO: Relative Entropy Pathwise Policy Optimization! Project Page: https://cvoelcker.de/projects/reppo/ [contains quote post or other embedded content]25 Apr 2026 22:11 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mke2pcsfx225https://bsky.app/profile/sologen.bsky.social/post/3mjschgtbhs2bHypothesis: People have been gradually shifting to write more like ChatGPT and alike. They use structures such as "This is not only X; but it is also Y". These struct. are natural part of lang, but either 1. they're becoming more prevalent, 2. I've become more sensitive to them.18 Apr 2026 20:42 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mjschgtbhs2bhttps://bsky.app/profile/sologen.bsky.social/post/3mifgyjaus22iWe have a new PhD Candidate in town: @tylerkastner.bsky.social Looking forward to all the new work you will be doing on Distributional Reinforcement Learning.01 Apr 2026 00:33 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mifgyjaus22ihttps://bsky.app/profile/sologen.bsky.social/post/3mhjoxunwl22yHappy Norooz, the Persian new year 1405/2585, the equinox, and the beginning of spring!20 Mar 2026 23:42 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mhjoxunwl22yhttps://bsky.app/profile/sologen.bsky.social/post/3mfxnrunolc2pAli Khamenei is in hell. The world is a better place now!01 Mar 2026 02:07 +0000at://did:plc:encka6qjdacjfptucihfrpth/app.bsky.feed.post/3mfxnrunolc2p