CV

Education

• B.S. in Aerospace Engineering, Tokyo Institute of Technology, 2015
• M.S. in Mechanical and Aerospace Engineering, Tokyo Institute of Technology, 2017
• PhD in School of Computing, Tokyo Institute of Technology, 2021~

Work experience

• 11/2013 ~ 6/2016: Internship
  • AXELSPACE
• 4/2017 ~ Now
  • Mitsubishi Electric Corporation, Information Technology R&D Center

Code

• tf2rl: a Deep Reinforcement Learning library written in TensorFlow2

Skills

Programming languages

• C/C++ 8years:
  • Embedded softwares for micro satellites, and robots [proj1], [proj2], [proj3]
  • Neural Networks (MLP and CNN) from scratch for onboard satellite imagery classification [proj]
• C# 5years:
  • An autonomous satellite operation system
  • Signal processing to encode/decode data for communications between satellites and ground stations
• python 5years:
  • A Deep Reinforcement Learning library written in TensorFlow2.0 [github]:
  • Prototype developments of machine learning / data analysis algorithms using scikit-learn, TensorFlow, Caffe
• MATLAB/Simulink 2years:
  • Guidance and control for artificial satellites [proj]
• Web development 3years:
  • HTML/CSS/JavaScript/JQuery/MySQL

Robotics / Embedded systems

• ROS 2years:
  • Prototype developments for research (industrial robots, mobile robots, research projects, etc.)
• Mechatronics 3years:
  • Mechanical design using 3D CAD (Inventor, SolidWorks, Fusion360), and 2D CAD (AutoCAD)
  • Mechanical machines (lathe, milling machine, laser processing machine, 3D printer, etc.)
  • Electrical circuit design (MBE, Eagle)
  • Micro computers (PIC, Arduino, mbed, RaspberryPI, Vertex-4)
• Verilog-HDL 1year:
  • Embeded software for micro satellite

Machine learning

• Reinforcement learning
  • Efficient RL using reference path [paper]
  • Model-based RL to solve complex navigation task

Publications

See all publications here.

Awards

• 2013 First place in ARLISS 2013
• 2013 First place in 1st AxelSpace Cup
• 2014 First place in 17th RobotGrandPrix
• 2014 First place in 22nd Satellite Design Contest, Idea Award
• 2015 First place in 4th Project Management Award
• 2015 First place in 23rd Satellite Design Contest, Design Award

Projects

Please check portfolio!

Academic Activities

Presentations

• Tutorial talk, “深層強化学習の基礎・応用”，MIRU2021.

Program Committees

• Reviewer for IEEE RA-L, ICRA, IROS, MRVC-2021@ACML, EcoRL2021@NeurIPS.

Teaching

• Instructor
  • Deep Reinforcement Learning Spring Seminar 2021, Autumun Seminar 2021, The University of Tokyo. I taught a course on deep reinforcement learning at The University of Tokyo in Spring 2021. The course takes a broad (deep) RL algorithms including policy gradient, REINFORCE, actor-critic, PPO, DDPG, TD3, SAC. I co-designed the whole course structure and the teaching material for my class (one of six).
• Teachnig Assistant
  • Deep Reinforcement Learning Summer School (RLSS2020), The University of Tokyo. Teaching Assistant for model-based RL class.