Increasing the concurrency of a Kafka consumer 🧮
Out-of-the-box, a Kafka consumer is not thread safe. Multi-threaded access must be properly synchronised. Can we create a multi-threaded consumer? 🤔
👋 Thanks for visiting!
I’m James, an experienced q/kdb+,come DevOps, engineer with a passion for streamlining processes and optimising systems 🚀.
I decided to take the plunge and create a blog to share my personal work and any valuable insights I’ve amassed over the years 😅.
If you’d like to get in contact… please reach out and message me via LinkedIn 💻.
Want to see some open-source projects I’ve worked on, checkout my projects page.
Create a discovery service using kdb+ 🔍
Want to know where all your
kdb+ applications are running, without spending 💵, then let’s explore creating an in-house discovery service 🏠
Predicting early onset dementia
Can Machine learning models 🤖 help predict the early onset of dementia using social and biological data of patients? Let’s investigate using
kdb+ 🔬
2️⃣ Predicting early onset dementia - Data preparation 🧪
Transform raw data into a machine-friendly format with this comprehensive guide to
data preprocessing. 🧼 Learn the ins and outs of preprocessing data to achieve better results for your machine learning models.
3️⃣ Predicting early onset dementia - ML Modeling 🚀
The third blog in this series explores how we try to maximise the potential of our machine learning models through the concept of
feature engineering ⚙️ New techniques are explored in the hope of optimising the accuracy of our models. Which algo comes out on top? 👑
4️⃣ Predicting early onset dementia - Creating a web GUI 🖥️
The last blog in this series explores how we can create a web dashboard to use our trained ML models to predict whether an individual is exhibiting the early symptoms of Dementia 🧬
1️⃣ Terraform + Ansible + Docker Swarm = 🔥
Infrastructure as Code (
IaC) is a concept thrown about everywhere these days! Let’s create a full IaC environment, from provisioning ➡️ deployment using Terraform, Ansible and Docker Swarm 🚀
2️⃣ Terraform + Ansible + Docker Swarm = 🔥
We provisioned some shiny new toys using terraform in part 1️⃣. Now, let’s configure them using Ansible and setup a Swarm 🐝