Sign in Subscribe

Gautam Menon

Gautam Menon

I'm a Python developer focused on deep learning, currently solving Computer Vision problems. I enjoy working in DevOps, MLOps, Data Engineering and NLP to create robust, data-driven solutions.

BigBanyanTree: Parsing HTML source code with Apache Spark & Selectolax

BigBanyanTree: Parsing HTML source code with Apache Spark & Selectolax

Dive into the world of data extraction! Learn how to parse HTML source code from Common Crawl WARC files with Apache Spark and Selectolax for insightful analysis and unlock the potential of HTML source code.

Zero to Spark - BigBanyanTree Cluster Setup

Zero to Spark - BigBanyanTree Cluster Setup

This blog details the setup of an Apache Spark cluster in standalone mode for data engineering using Docker compose on a dedicated Hetzner server. It also covers the setup of other utilities such as Jupyterlab and Llama-3.1 8B LLM service.

llamafile : An Executable LLM

llamafile : An Executable LLM

LLM Deployment with llamafile: Discover how Mozilla’s llamafile simplifies LLM deployment into a single executable. Learn to optimize Docker images, explore alternatives like llama.cpp and ollama, and leverage quantized models for efficient resource use.