cv
A summary of my current curriculum vitae.
Basics
Name | Michael Gimelfarb |
Label | AI Researcher |
Url | https://mike-gimelfarb.github.io/ |
Summary | I am a researcher in reinforcement learning and planning, a branch of artificial intelligence that studies how an intelligent agent should interact with a dynamic environment to maximize cumulative reward. |
Work
-
Oct. 2014 - May 2015 Research Analyst
Russell Investments
Collected and analyzed numerical and qualitative data on competing mutual funds to guide decision-making and strategy. Wrote macros to automate the preparation and analysis of client portfolio data, resulting in much faster turn-around time.
- Data Analysis
-
Mar. 2022 - Jul. 2022 Research Scientist Intern
Google Deepmind UK (Remote)
Derived novel algorithms for continual/lifelong reinforcement learning, where an agent must learn to achieve a long sequence of diverse goals in the most efficient way possible.
- Continual Reinforcement Learning
- Lifelong Reinforcement Learning
-
Jan. 2024 - Current Post-Doctoral Researcher
RVL Lab, Department of Computer Science, University of Toronto
Developed robust offline reinforcement learning algorithms in which an agent must evaluate a policy using only a pre-existing data set without any direct interactions with an environment. The advantages of learned world models and guided generative diffusion models explored as they relate to robustness and scalability of learning.
- Offline Reinforcement Learning
-
Jan. 2023 - Sep. 2023 Post-Doctoral Researcher
D3M Lab, University of Toronto
Developed novel algorithms for efficient and scalable planning in high-dimensional spaces, particularly using symbolic methods, nonlinear optimization, and gradient-based optimization. Developed and maintained the Python planning library pyRDDLGym.
- Planning
Education
-
Sep. 2017 - Dec. 2022 Toronto, Canada
-
Sep. 2015 - Sep. 2017 Toronto, Canada
-
Sep. 2010 - Jun. 2014 Toronto, Canada
Bachelor in Business Administration
Schulich School of Business, York University
Finance and Actuarial Science
Skills
Artificial Intelligence | |
Machine Learning | |
Deep Learning | |
Reinforcement Learning | |
Robotics | |
Planning |
Software Languages and Tools | |
Python | |
C++ | |
Java | |
Docker | |
Git |
Languages
English | |
Native speaker |
Russian | |
Native speaker |