Data Engineering • Infra • DataOps

Hi, I'm
Aiman Haziq

A Data Engineer based in Malaysia, specializing in building scalable data solutions and robust data infrastructure. Currently evolving at the intersection of Data Engineering and System Architecture.

Technical Arsenal

IoT & Automation

Raspberry PINodeREDn8nRabbitMQOpenAI

Database

PostgreSQLMariaDBMongoDBBigQueryMySQL

Operating Systems

UbuntuDebianCentOSAlmaLinux

Monitoring & Observability

PrometheusGrafana

Programming Languages

PythonJavaScriptTypeScriptPHPBash

Cloud

Google Cloud PlatformAzure

Software Engineering

React.jsIonic FrameworkNode.jsExpress.js

DevOps

DockerK8s (RKE2)JenkinsAnsibleGithub ActionsSonarQubeWireguard

Professional Journey

Data Engineer (Contract)

Dec 2024 - Current
ERS Energy

1. Architected and managed a dual-stream data pipeline that synchronizes hardware telemetry with user behavior to provide a view of solar performance. - Utility-Scale Edge Computing: Engineered an IoT edge layer for utility solar farms using Raspberry Pi and Node-RED. Developed custom flows to stream real-time telemetry via MQTT to a centralized RabbitMQ broker, ensuring low-latency data ingestion from remote sites. - Residential API Orchestration: Designed a high-availability integration layer using n8n to aggregate data from Huawei, Goodwe, and Sungrow APIs. Optimized the deployment with a 4-worker node cluster and automated continuous backups, enabling the platform to scale across hundres to thousands of residential sites. - Data Warehousing: Managed PostgreSQL to handle high-velocity telemetry data (spikes, reactive power, and performance metrics) from both rooftop and utility scales. - Optimized Google BigQuery as the primary warehouse for internal mobile application data. 2. Operational Intelligence & Monitoring - Anomaly Detection & Alarming: Developed a Python-based processing engine to analyze RabbitMQ AMQP streams. Built automated alarm systems that detect critical irregularities, such as grid power import spikes and component failures, reducing response time for maintenance teams. - Advanced Visualization: Designed executive-level Grafana Dashboard. These provide real-time visibility into PV health, weather-adjusted performance ratios (PR), and reactive power trends, turning raw data into actionable O&M (Operations & Maintenance) insights. 3. Cloud Infrastructure & DevOps - High-Availability Hosting: Administered a hybrid environment of on-prem Windows Servers and Ubuntu Cloud Instances. Deployed and orchestrated a full stack of monitoring and networking tools, including Wireguard (VPN), Prometheus, and Traefik (Reverse Proxy). - CI/CD Automation: Streamlined development workflows by configuring GitHub Actions to automate the build, test, and deployment phases of containerized internal applications, ensuring 99.9% uptime during updates. - GCP Serverless Architecture: Leveraged Google Cloud Functions for event-driven automation, including scheduled BigQuery transformations and automated infrastructure backups. Managed secure access control via fine-grained IAM policies. 4. R&D and Innovation - Next-Gen Asset Inspection: Leading research into Drone-based PV monitoring. Developed a pipeline for automated hotspot detection and barcode scanning using Google Cloud Vertex AI to significantly reduce manual inspection costs on large-scale solar farms.

Infra Engineer (Part Time)

June 2023 - Present
Bitify Dynamics

1. Distributed Database Management - Optimized data persistence layers for reliability and speed at scale. - NoSQL Sharding: Deployed and managed sharded MongoDB instances to distribute data loads, ensuring low-latency reads/writes for large datasets. - Enterprise SQL Continuity: Implemented rigorous backup and point-in-time restoration protocols for large-scale MariaDB databases, safeguarding critical company data against hardware or software failures. - Multi-OS Administration: Maintained a heterogeneous server environment encompassing AlmaLinux, CentOS, Ubuntu, Debian, and Windows Server, ensuring 100% patch compliance and resource optimization. 2. Cluster Orchestration & Scalable Deployment - Architected a high-performance environment for data-intensive workloads by transitioning from manual setups to automated, containerized orchestration. - Kubernetes Orchestration: Deployed and managed RKE2 (Rancher Next Generation) to orchestrate multi-node clusters. Engineered replica strategies to ensure high availability and efficient resource distribution for heavy data processing tasks. - Infrastructure as Code (IaC): Developed a library of Ansible Playbooks to automate the end-to-end configuration and deployment of applications and databases across a diverse fleet of cloud distributions. - Code Quality Governance: Integrated SonarQube into the deployment lifecycle to enforce continuous code quality analysis, ensuring that only performant and secure code reached production. 3. Unified Observability & Performance Monitoring - Established a "single pane of glass" monitoring strategy to maintain 24/7 visibility into system health. - Full-Stack Monitoring: Designed comprehensive Grafana dashboards powered by Prometheus. Implemented Node Exporter, cAdvisor, and Windows Exporter to track real-time metrics across both Linux and Windows environments. - Proactive Alerting: Configured intelligent alerting systems to detect container bottlenecks and resource exhaustion, significantly reducing "Mean Time to Resolution" (MTTR) for infrastructure incidents. 4. DevOps & Traffic Management - Automated CI/CD: Built and maintained robust CI/CD pipelines using Jenkins, standardizing the build, test, and deployment phases to achieve consistent, "one-click" software delivery. - Edge Routing & Security: Managed high-traffic entry points using Traefik and Apache Tomcat. Automated SSL certificate management and reverse proxy configurations to ensure secure, encrypted communication for all internal and external services.

Full-Stack Developer (Contract)

Nov 2022 - Nov 2024
ARBA Travel & Tours

1. Full-Cycle Web Application Development - Modern Frontend/Backend Delivery: Developed high-performance internal web applications using Vue.js and React.js for dynamic interfaces, backed by PHP and MySQL for robust data persistence. - Performance Optimization: Managed and optimized high-traffic WordPress environments, ensuring peak performance through strategic plugin management and custom code refinement. 2. Automated Business Orchestration & AI - Transformed manual business processes into automated, AI-driven workflows, significantly increasing operational throughput. - AI-Powered Customer Engagement: Architected and deployed a 24/7 autonomous Chatbot Assistant by integrating the OpenAI API with n8n. Empowered non-technical teams to manage customer interactions through a simplified interface, reducing manual support tickets. - Low-Code Workflow Engineering: Bridged fragmented business tools by designing complex automation sequences using n8n and Zapier. Built custom PHP-based API integrations to synchronize data across disparate internal platforms, eliminating data silos. - Operational Data: Synchronized critical business data using Hightouch (Reverse ETL) to drive actionable insights. 3. Strategic Open-Source Advocacy & Infrastructure - Led a "Cloud-First, Open-Source" initiative that drastically reduced licensing costs while hardening system security. - Infrastructure Containerization: Migrated legacy application deployments to Docker-based environments on Ubuntu Cloud Servers, ensuring 99.9% uptime and consistent development-to-production parity. - Security & Perimeter Defense: Engineered a secure internal network by deploying and configuring WireGuard VPN, providing an encrypted tunnel for remote team access and shielding internal services from external threats. - Cost-Saving Implementations: Conducted technical audits to replace expensive proprietary software with scalable open-source alternatives, including Rocket.Chat for unified communications and n8n for self-hosted automation.

Featured Projects

e-deria (Mobile Application)

e-deria (Mobile Application)

Developed a mobile application for a client which is an IoT‑enabled soil data calibration app using React, Firestore, InfluxDB, Node‑RED and Google Cloud Functions. The app delivered geolocation visualisation mapping to display precise soil point locations. The app is designed for practical, user‑solutions integrating geolocation, Bluetooth, and camera functionalities. Additionally, continuously successfully upgraded the Android SDK to the latest version from the previous release.

ReactFirebaseNodeREDInfluxDBESP32

Certifications

OpenTelemetry for Unified Observability

Coursera

Issued: Feb 2026ID: VOIRZ4HMM43D
View Credential

Certified Azure Developer

Asia Pacific University of Technology and Innovation (APU / APIIT)

Issued: Nov 2021
View Credential

Azure IoT Developer

Microsoft

Issued: Nov 2021Expires: Nov 2022
View Credential

Academic & Research

Education

Master of Computer Science (Research)

Universiti Teknologi MARA
2023 - 2025CGPA: Research (Awaiting)

Key Modules: Data Engineering, Machine Learning, Python, Algorithm, Data Infrastructure, Big Data

Bachelor's degree in Artificial Intelligence Engineering

Universiti Teknologi MARA
Aug 2018 - Feb 2022CGPA: 3.62

Key Modules: Neural Network, Fuzzy Logic, Algorithms, Python, C++, Tensorflow, PyTorch, JavaScript, Machine Learning, Deep Learning, MongoDB, SQL

Publications

Ready to collaborate?

Whether you have a question about infrastructure, AI implementation, or just want to say hi, I'll try my best to get back to you!

aimanhaziqyazik@gmail.com