willemropke.bsky.social
PhD student | Interested in all things decision-making and learning
👤 Joined on 06 August 2023
Followers
Following
Total Posts
@willemropke.bsky.socialUnless they don't do it for citations. Which seems healthy 😅
Show PostPQN Blog 1/3: TD methods are the bread and butter of RL, yet can have convergence issues when used in practice. This has always annoyed me. Find out below why TD is so unstable and how can we understand this instability better using the TD Jacobian. @flair-ox.bsky.social @jfoerst.bsky.social
Show Postsuper happy about this preprint! we can *finally* perform efficient exploration and find near-optimal stationary policies in infinite-horizon linear MDPs, and even use it for imitation learning :) working with @neu-rips.bsky.social and @lviano.bsky.social on this was so much fun!!
Show PostAre folks still here? 😅
Show PostOur algo, IPRO, converges to the Pareto front and comes with strong guarantees with respect to the approximation error. Congrats Willem, and really glad to have been part of this work!
Show Post