cv

A summary of my current curriculum vitae.

Basics

Name Michael Gimelfarb
Label AI Researcher
Url https://mike-gimelfarb.github.io/
Summary I am a researcher in reinforcement learning and planning, a branch of artificial intelligence that studies how an intelligent agent should interact with a dynamic environment to maximize cumulative reward.

Work

  • Oct. 2014 - May 2015
    Research Analyst
    Russell Investments
    Collected and analyzed numerical and qualitative data on competing mutual funds to guide decision-making and strategy. Wrote macros to automate the preparation and analysis of client portfolio data, resulting in much faster turn-around time.
    • Data Analysis
  • Mar. 2022 - Jul. 2022
    Research Scientist Intern
    Google Deepmind UK (Remote)
    Derived novel algorithms for continual/lifelong reinforcement learning, where an agent must learn to achieve a long sequence of diverse goals in the most efficient way possible.
    • Continual Reinforcement Learning
    • Lifelong Reinforcement Learning
  • Jan. 2024 - Current
    Post-Doctoral Researcher
    RVL Lab, Department of Computer Science, University of Toronto
    Developed robust offline reinforcement learning algorithms in which an agent must evaluate a policy using only a pre-existing data set without any direct interactions with an environment. The advantages of learned world models and guided generative diffusion models explored as they relate to robustness and scalability of learning.
    • Offline Reinforcement Learning
  • Jan. 2023 - Sep. 2023
    Post-Doctoral Researcher
    D3M Lab, University of Toronto
    Developed novel algorithms for efficient and scalable planning in high-dimensional spaces, particularly using symbolic methods, nonlinear optimization, and gradient-based optimization. Developed and maintained the Python planning library pyRDDLGym.
    • Planning

Education

  • Sep. 2017 - Dec. 2022

    Toronto, Canada

    PhD
    Industrial Engineering, University of Toronto
    Artificial Intelligence
  • Sep. 2015 - Sep. 2017

    Toronto, Canada

    Master of Applied Science
    Industrial Engineering, University of Toronto
    Operations Research
  • Sep. 2010 - Jun. 2014

    Toronto, Canada

    Bachelor in Business Administration
    Schulich School of Business, York University
    Finance and Actuarial Science

Skills

Artificial Intelligence
Machine Learning
Deep Learning
Reinforcement Learning
Robotics
Planning
Software Languages and Tools
Python
C++
Java
Docker
Git

Languages

English
Native speaker
Russian
Native speaker