Posts by Tags

API

PyTorch with C++ 1

2 minute read

Published:

PyTorch is one of the well established libraries for modeling deep neural networks. The exposed Python API is the most commonly used one. However, the library also exposes bindings for C++. In this series of notebooks, I will try to demonstrate how to use the latter. I will be following to a large extent the documentation for the C++ frontend.

algorithms

apache-spark

Apache Spark: RDD operations with Scala

2 minute read

Published:

In this notebook, we go over Spark’s resilient distributed dataset or RDD. The official programming guide can be found here. RDDs form the backbone of Spark’s data structures. The DataSet and DataFrame are based on RDD.

autonomous agents

big-data

Apache Spark: RDD operations with Scala

2 minute read

Published:

In this notebook, we go over Spark’s resilient distributed dataset or RDD. The official programming guide can be found here. RDDs form the backbone of Spark’s data structures. The DataSet and DataFrame are based on RDD.

c++

C++ Programming: Using the auto keyword

1 minute read

Published:

The auto keyword changed its semantics starting from the C++11 standard. In this notebook, we will review its new semantics and examine its new flavors.

PyTorch with C++ 1

2 minute read

Published:

PyTorch is one of the well established libraries for modeling deep neural networks. The exposed Python API is the most commonly used one. However, the library also exposes bindings for C++. In this series of notebooks, I will try to demonstrate how to use the latter. I will be following to a large extent the documentation for the C++ frontend.

decision making

deep-neural-networks

PyTorch with C++ 1

2 minute read

Published:

PyTorch is one of the well established libraries for modeling deep neural networks. The exposed Python API is the most commonly used one. However, the library also exposes bindings for C++. In this series of notebooks, I will try to demonstrate how to use the latter. I will be following to a large extent the documentation for the C++ frontend.

deep-reinforcement-learning

Reinforcement Learning: Deep Q-networks

3 minute read

Published:

Online Q-learning can experience instabilities during training. This is because by using experience sampled sequentially from the environment leads to highly correlated gradient steps. Deep Q-networks (DQN) made deep reinforcement learning a viable approach to complex sequential control problems. In this section, we introduce the vanilla DQN algorithm. Next sections will discuss various improvements that have been proposed in the literature.

dqn

Reinforcement Learning: Deep Q-networks

3 minute read

Published:

Online Q-learning can experience instabilities during training. This is because by using experience sampled sequentially from the environment leads to highly correlated gradient steps. Deep Q-networks (DQN) made deep reinforcement learning a viable approach to complex sequential control problems. In this section, we introduce the vanilla DQN algorithm. Next sections will discuss various improvements that have been proposed in the literature.

gradient-boosting

hidden-markov-model

linear-algebra

linear-regression

machine-learning

matrix-approximation

numerics

PyTorch with C++ 1

2 minute read

Published:

PyTorch is one of the well established libraries for modeling deep neural networks. The exposed Python API is the most commonly used one. However, the library also exposes bindings for C++. In this series of notebooks, I will try to demonstrate how to use the latter. I will be following to a large extent the documentation for the C++ frontend.

programming

C++ Programming: Using the auto keyword

1 minute read

Published:

The auto keyword changed its semantics starting from the C++11 standard. In this notebook, we will review its new semantics and examine its new flavors.

pytorch

PyTorch with C++ 1

2 minute read

Published:

PyTorch is one of the well established libraries for modeling deep neural networks. The exposed Python API is the most commonly used one. However, the library also exposes bindings for C++. In this series of notebooks, I will try to demonstrate how to use the latter. I will be following to a large extent the documentation for the C++ frontend.

reinforcement learning

reinforcement-learning

Reinforcement Learning: Deep Q-networks

3 minute read

Published:

Online Q-learning can experience instabilities during training. This is because by using experience sampled sequentially from the environment leads to highly correlated gradient steps. Deep Q-networks (DQN) made deep reinforcement learning a viable approach to complex sequential control problems. In this section, we introduce the vanilla DQN algorithm. Next sections will discuss various improvements that have been proposed in the literature.

resilient-distributed-dataset

Apache Spark: RDD operations with Scala

2 minute read

Published:

In this notebook, we go over Spark’s resilient distributed dataset or RDD. The official programming guide can be found here. RDDs form the backbone of Spark’s data structures. The DataSet and DataFrame are based on RDD.

scala

Apache Spark: RDD operations with Scala

2 minute read

Published:

In this notebook, we go over Spark’s resilient distributed dataset or RDD. The official programming guide can be found here. RDDs form the backbone of Spark’s data structures. The DataSet and DataFrame are based on RDD.

singular-value-decomposition