Reinforcement Learning

What I Learned From Tecton's apply() 2022 Conference

What I Learned From Tecton's apply() 2022 Conference

Back in May, I attended apply(), Tecton’s second annual virtual event for data and ML teams to discuss the practical data engineering challenges faced when building ML for the real world. There were talks on best practice development patterns, tools of choice, and emerging architectures to successfully build and manage production ML applications.

This long-form article dissects content from 14 sessions and lightning talks that I found most useful from attending apply(). These talks cover 3 major areas: industry trends, production use cases, and open-source libraries. Let’s dive in!

What I Learned From Arize:Observe 2022

What I Learned From Arize:Observe 2022

Last month, I had the opportunity to speak at Arize:Observe, the first conference dedicated solely to ML observability from both a business and technical perspective. More than a mere user conference, Arize:Observe features presentations and panels from industry thought leaders and ML teams across sectors. Designed to tackle both the basics and most challenging questions and use cases, the conference has sessions about performance monitoring and troubleshooting, data quality and drift monitoring and troubleshooting, ML observability in the world of unstructured data, explainability, business impact analysis, operationalizing ethical AI, and more.

In this blog recap, I will dissect content from the summit’s most insightful technical talks, covering a wide range of topics from scaling real-time ML and best practices of effective ML teams to challenges in monitoring production ML pipelines and redesigning ML platform.

Datacast Episode 61: Meta Reinforcement Learning with Louis Kirsch

Datacast Episode 61: Meta Reinforcement Learning with Louis Kirsch

Louis Kirsch is a third-year Ph.D. student at the Swiss AI Lab IDSIA, advised by Prof. Jürgen Schmidhuber. He received his B.Sc. in IT-Systems-Engineering from Hasso-Plattner-Institute (1st rank) and his Master of Research in Computational Statistics and Machine Learning from University College London (1st rank). His research focuses on meta-learning algorithms for reinforcement learning, specifically meta-learning algorithms that are general-purpose, introduced by his work on MetaGenRL. Louis has organized the BeTR-RL workshop at ICLR 2020, was an invited speaker at Meta Learn NeurIPS 2020, and won several GPU compute awards for the Swiss national supercomputer Piz Daint.

Datacast Episode 58: Deep Learning Meets Distributed Systems with Jim Dowling

Datacast Episode 58: Deep Learning Meets Distributed Systems with Jim Dowling

Jim Dowling is the CEO of Logical Clocks AB, an Associate Professor at KTH Royal Institute of Technology, and a Senior Researcher at SICS RISE in Stockholm. His research concentrates on building systems support for machine learning at scale. He is the lead architect of Hops Hadoop, the world's fastest and most scalable Hadoop distribution and only Hadoop platform with support for GPUs as a resource. He is also a regular speaker at Big Data and AI industry conferences.

What I Learned From Attending RE•WORK Deep Learning 2.0 Summit 2021

What I Learned From Attending RE•WORK Deep Learning 2.0 Summit 2021

At the end of January, I attended REWORK’s Deep Learning 2.0 Virtual Summit, which brings together the latest technological advancements and practical examples to apply deep learning to solve challenges in business and society. In this long-form blog recap, I will dissect content from the talks that I found most useful from attending the summit. The post consists of 17 talks that are divided into 5 sections: Enterprise AI, Ethics and Social Responsibility, Deep Learning Landscape, Generative Models, and Reinforcement Learning.

Datacast Episode 33: Domain Randomization in Robotics with Josh Tobin

Datacast Episode 33: Domain Randomization in Robotics with Josh Tobin

Josh Tobin is the founder and CEO of a stealth machine learning startup. Previously, Josh worked as a deep learning & robotics researcher at OpenAI and as a management consultant at McKinsey. He is also the creator of Full Stack Deep Learning, the first course focused on the emerging engineering discipline of production machine learning. Josh did his Ph.D. in Computer Science at UC Berkeley, advised by Pieter Abbeel.

Datacast Episode 26: From Cognitive Neuroscience to Reinforcement Learning with Arthur Juliani

Datacast Episode 26: From Cognitive Neuroscience to Reinforcement Learning with Arthur Juliani

Arthur Juliani is a Senior Machine Learning Engineer at Unity Technologies, where he has worked as a founding member of the ml-agents GitHub project as well as the leader of the Obstacle Tower project. He is also currently a Ph.D. candidate in Cognitive Neuroscience at the University of Oregon, where he studies computation models of spatial representation learning in humans.

Datacast Episode 23: Machine Learning for Finance with Jannes Klaas

Datacast Episode 23: Machine Learning for Finance with Jannes Klaas

Jannes is a data scientist at QuantumBlack and author of the book "Machine Learning For Finance". He previously studied financial economics at Oxford University where he wrote his thesis on the predictability of banking stress tests.