Airflow and Spark Orchestration on KubernetesIt sounds really amazing scaling airflow when we want grow and run as many as possible in parallell. Here I just present Airflow setup for…Oct 8, 2021Oct 8, 2021
Doing ACID on SparkHere I am going to talk about doing CRUD using Delta Lake and Spark. I heard a lot of good stuff about Delta Lake and I just try to work…Sep 29, 20212Sep 29, 20212
Scalable Stream Processing using QueueIn this story for penetration test on kafka LOCUST is going to be applied. In each api call by locust a random data at current time will be…May 18, 2021May 18, 2021
Asynchronouse Distributed ML PlatformIn this story, a ML pipeline service for training machine learning model is going to be illustrated.Feb 19, 2021Feb 19, 2021
Real-Time Bitcoin Monitoring and Prediction with Bokeh and TwistedIn this article the implementation of real-time bitcoin prediction and monitoring is going to be explained.Sep 17, 2020Sep 17, 2020
Chatroom development with fastapi websocketIn this story, the process of developing a live chatroom with fastapi websocket and build it with docker and deploy it on heroku :))Sep 17, 2020Sep 17, 2020
ML microservice with Nameko to implement a predictive maintenance applicationIn this article the development and deployment of a microservice is going to be explained. This microservice consists of:Sep 10, 2020Sep 10, 2020
Real-time Fraud detection web applicationIn the first part the machine learning part is going to be described. This fraud detection project notebook could be found here.Sep 9, 2020Sep 9, 2020
Nameko Microservice with Flask and Fastapi (kubernetes)The deployment of the nameko microservice that explained HERE with kubernetes. As it mentioned in part 1, each of microservice component…Sep 8, 2020Sep 8, 2020
Nameko Microservice with Flask and Fastapi (docker)In this story the whole process of building the microservice app with nameko that has both flask and fastapi as web service, is going to…Sep 8, 2020Sep 8, 2020