Hi, I'm
Aiman Haziq
A Data Engineer based in Malaysia, specializing in building scalable data solutions and robust data infrastructure. Currently evolving at the intersection of Data Engineering and System Architecture.
Technical Arsenal
IoT & Automation
Database
Operating Systems
Monitoring & Observability
Programming Languages
Cloud
Software Engineering
DevOps
Professional Journey
Data Engineer (Contract)
Dec 2024 - Current1. Architected and managed a dual-stream data pipeline that synchronizes hardware telemetry with user behavior to provide a view of solar performance. - Utility-Scale Edge Computing: Engineered an IoT edge layer for utility solar farms using Raspberry Pi and Node-RED. Developed custom flows to stream real-time telemetry via MQTT to a centralized RabbitMQ broker, ensuring low-latency data ingestion from remote sites. - Residential API Orchestration: Designed a high-availability integration layer using n8n to aggregate data from Huawei, Goodwe, and Sungrow APIs. Optimized the deployment with a 4-worker node cluster and automated continuous backups, enabling the platform to scale across hundres to thousands of residential sites. - Data Warehousing: Managed PostgreSQL to handle high-velocity telemetry data (spikes, reactive power, and performance metrics) from both rooftop and utility scales. - Optimized Google BigQuery as the primary warehouse for internal mobile application data. 2. Operational Intelligence & Monitoring - Anomaly Detection & Alarming: Developed a Python-based processing engine to analyze RabbitMQ AMQP streams. Built automated alarm systems that detect critical irregularities, such as grid power import spikes and component failures, reducing response time for maintenance teams. - Advanced Visualization: Designed executive-level Grafana Dashboard. These provide real-time visibility into PV health, weather-adjusted performance ratios (PR), and reactive power trends, turning raw data into actionable O&M (Operations & Maintenance) insights. 3. Cloud Infrastructure & DevOps - High-Availability Hosting: Administered a hybrid environment of on-prem Windows Servers and Ubuntu Cloud Instances. Deployed and orchestrated a full stack of monitoring and networking tools, including Wireguard (VPN), Prometheus, and Traefik (Reverse Proxy). - CI/CD Automation: Streamlined development workflows by configuring GitHub Actions to automate the build, test, and deployment phases of containerized internal applications, ensuring 99.9% uptime during updates. - GCP Serverless Architecture: Leveraged Google Cloud Functions for event-driven automation, including scheduled BigQuery transformations and automated infrastructure backups. Managed secure access control via fine-grained IAM policies. 4. R&D and Innovation - Next-Gen Asset Inspection: Leading research into Drone-based PV monitoring. Developed a pipeline for automated hotspot detection and barcode scanning using Google Cloud Vertex AI to significantly reduce manual inspection costs on large-scale solar farms.
Infra Engineer (Part Time)
June 2023 - Present1. Distributed Database Management - Optimized data persistence layers for reliability and speed at scale. - NoSQL Sharding: Deployed and managed sharded MongoDB instances to distribute data loads, ensuring low-latency reads/writes for large datasets. - Enterprise SQL Continuity: Implemented rigorous backup and point-in-time restoration protocols for large-scale MariaDB databases, safeguarding critical company data against hardware or software failures. - Multi-OS Administration: Maintained a heterogeneous server environment encompassing AlmaLinux, CentOS, Ubuntu, Debian, and Windows Server, ensuring 100% patch compliance and resource optimization. 2. Cluster Orchestration & Scalable Deployment - Architected a high-performance environment for data-intensive workloads by transitioning from manual setups to automated, containerized orchestration. - Kubernetes Orchestration: Deployed and managed RKE2 (Rancher Next Generation) to orchestrate multi-node clusters. Engineered replica strategies to ensure high availability and efficient resource distribution for heavy data processing tasks. - Infrastructure as Code (IaC): Developed a library of Ansible Playbooks to automate the end-to-end configuration and deployment of applications and databases across a diverse fleet of cloud distributions. - Code Quality Governance: Integrated SonarQube into the deployment lifecycle to enforce continuous code quality analysis, ensuring that only performant and secure code reached production. 3. Unified Observability & Performance Monitoring - Established a "single pane of glass" monitoring strategy to maintain 24/7 visibility into system health. - Full-Stack Monitoring: Designed comprehensive Grafana dashboards powered by Prometheus. Implemented Node Exporter, cAdvisor, and Windows Exporter to track real-time metrics across both Linux and Windows environments. - Proactive Alerting: Configured intelligent alerting systems to detect container bottlenecks and resource exhaustion, significantly reducing "Mean Time to Resolution" (MTTR) for infrastructure incidents. 4. DevOps & Traffic Management - Automated CI/CD: Built and maintained robust CI/CD pipelines using Jenkins, standardizing the build, test, and deployment phases to achieve consistent, "one-click" software delivery. - Edge Routing & Security: Managed high-traffic entry points using Traefik and Apache Tomcat. Automated SSL certificate management and reverse proxy configurations to ensure secure, encrypted communication for all internal and external services.
Full-Stack Developer (Contract)
Nov 2022 - Nov 20241. Full-Cycle Web Application Development - Modern Frontend/Backend Delivery: Developed high-performance internal web applications using Vue.js and React.js for dynamic interfaces, backed by PHP and MySQL for robust data persistence. - Performance Optimization: Managed and optimized high-traffic WordPress environments, ensuring peak performance through strategic plugin management and custom code refinement. 2. Automated Business Orchestration & AI - Transformed manual business processes into automated, AI-driven workflows, significantly increasing operational throughput. - AI-Powered Customer Engagement: Architected and deployed a 24/7 autonomous Chatbot Assistant by integrating the OpenAI API with n8n. Empowered non-technical teams to manage customer interactions through a simplified interface, reducing manual support tickets. - Low-Code Workflow Engineering: Bridged fragmented business tools by designing complex automation sequences using n8n and Zapier. Built custom PHP-based API integrations to synchronize data across disparate internal platforms, eliminating data silos. - Operational Data: Synchronized critical business data using Hightouch (Reverse ETL) to drive actionable insights. 3. Strategic Open-Source Advocacy & Infrastructure - Led a "Cloud-First, Open-Source" initiative that drastically reduced licensing costs while hardening system security. - Infrastructure Containerization: Migrated legacy application deployments to Docker-based environments on Ubuntu Cloud Servers, ensuring 99.9% uptime and consistent development-to-production parity. - Security & Perimeter Defense: Engineered a secure internal network by deploying and configuring WireGuard VPN, providing an encrypted tunnel for remote team access and shielding internal services from external threats. - Cost-Saving Implementations: Conducted technical audits to replace expensive proprietary software with scalable open-source alternatives, including Rocket.Chat for unified communications and n8n for self-hosted automation.
Featured Projects

e-deria (Mobile Application)
Developed a mobile application for a client which is an IoT‑enabled soil data calibration app using React, Firestore, InfluxDB, Node‑RED and Google Cloud Functions. The app delivered geolocation visualisation mapping to display precise soil point locations. The app is designed for practical, user‑solutions integrating geolocation, Bluetooth, and camera functionalities. Additionally, continuously successfully upgraded the Android SDK to the latest version from the previous release.
Certifications
OpenTelemetry for Unified Observability
Coursera
Certified Azure Developer
Asia Pacific University of Technology and Innovation (APU / APIIT)
Azure IoT Developer
Microsoft
Academic & Research
Education
Master of Computer Science (Research)
Key Modules: Data Engineering, Machine Learning, Python, Algorithm, Data Infrastructure, Big Data
Bachelor's degree in Artificial Intelligence Engineering
Key Modules: Neural Network, Fuzzy Logic, Algorithms, Python, C++, Tensorflow, PyTorch, JavaScript, Machine Learning, Deep Learning, MongoDB, SQL
Publications
Ready to collaborate?
Whether you have a question about infrastructure, AI implementation, or just want to say hi, I'll try my best to get back to you!
aimanhaziqyazik@gmail.com