Turan Abdullayeva
Baku
Overview
11
11
years of professional experience
Work History
Data Engineer
Azerbaijan Land Transport Agency
Baku
07.2025 - Current
- Designed and implemented real-time data pipelines for urban mobility systems, streaming over 100k of taxis, scooter, and parking events daily through Apache Kafka, Debezium, and Apache NiFi and PL/pgSQL (functions, procedures and triggers).
- Built distributed ingestion workflows that merged event-based and batch data from vehicle GPS devices, transaction APIs, and fare systems into a centralized MinIO-based data lake.
- Developed stream processing logic in NiFi and Spark Structured Streaming to continuously compute parking occupancy, trip durations, and turnover metrics in near real time.
- Implemented Change Data Capture (CDC) with Debezium to synchronize transactional PostgreSQL and Oracle systems, ensuring data freshness and low-latency updates across domains.
- Modeled and optimized geospatial data (vehicle positions, parking areas, city zones) using PostGIS, supporting fast proximity searches and live occupancy dashboards.
- Automated data validation and anomaly detection for mobility transactions - ensuring integrity of timestamps, vehicle IDs, fare amounts, and plate formats before analytics processing.
- Engineered NiFi-based streaming jobs to merge asynchronous topics (e.g., taxi-orders, payments, drivers, and parking sessions) into unified, schema-aligned JSON payloads.
- Created daily and intraday aggregation pipelines to compute parking utilization, zone revenue, and demand heatmaps, improving analytic timeliness from hours to minutes.
- Established naming conventions, data governance rules, and schema consistency across payload, raw, and curated layers, supporting smooth integration with analytical systems.
- Collaborated with product and GIS teams to deliver real-time dashboards showing live parking availability and mobility performance metrics for city operators.
- Tuned PostgreSQL queries and indexes for large-scale time-series and geospatial data, improving response times for reporting and API endpoints by over 70 %.
Chapter Lead - Data Engineer
KapitalBank OJSC
Baku
06.2023 - 06.2025
- Designed and implemented distributed data pipelines for both real-time (streaming) and batch processing, using Apache Spark, Apache NiFi, and Airflow, integrated with Kafka and REST APIs.
- Built a centralized data lake architecture on S3-compatible storage, supporting structured and unstructured sources in JSON, XML, and parquet formats.
- Led the transformation of raw operational data into clean, analytics-ready formats, focusing on performance, scalability, and data quality.
- Developed ELT jobs using PL/SQL, PostgreSQL, and Oracle, optimizing for parallelism and throughput across large data volumes (>5TB).
- Managed a cross-functional team of data engineers, overseeing the successful delivery of 3-4 concurrent data projects with clear timelines and KPIs.
- Designed and enforced data governance standards, schema evolution strategies, and naming conventions across layers (payload, raw, curated).
- Implemented advanced monitoring and alerting for pipeline reliability and data freshness using DAG-level validations in Airflow.
- Collaborated with analysts, product managers, and DevOps teams to deliver data services aligned with business priorities.
- Developed and deployed CI/CD pipelines using GitLab, enabling automated testing, deployment, and version control of data engineering workflows.
- Implemented Slowly Changing Dimensions (SCD Type 1 and Type 2) in dimensional models to track historical data changes in data marts and reporting systems.
Data Engineer
UniBank OJSC
Baku
01.2023 - 06.2023
- Developed scalable data pipelines and databases supporting ETL, ELT, and EL processes using Apache Spark, Python, PL/SQL, and S3.
- Built and managed robust data workflows using Apache NiFi, Kafka, and Airflow DAGs to automate ingestion and transformation pipelines.
- Designed and optimized SQL Server database systems to maximize performance and responsiveness for internal and external clients.
- Collaborated with senior Data Scientists on the design and development of complex ETL processes using SSIS packages.
- Created and maintained PostgreSQL and Oracle databases, enabling efficient integration and aggregation of data from diverse sources.
- Designed, deployed, and maintained reusable and scalable data services to support analytics and reporting.
- Transformed unstructured formats like XML and JSON into clean, structured relational data for analysis and storage.
- Partnered with business stakeholders to gather requirements and deliver actionable insights through well-designed data solutions.
- Prepared and presented detailed reports, dashboards, and analyses to business units and executive leadership.
- Contributed to the development of high-performance data algorithms for use in real-time and batch processing systems.
- Helped establish data management policies, standards, and best practices across the engineering team.
BI Engineer
UniBank OJSC
Baku
01.2021 - 01.2023
- In-depth understanding of fundamentals of object-oriented design, data structures, algorithm design, and problem solving.
- Experience in creating reports, dashboards using IBM Cognos, Power BI, Tableau, SQL Server Reporting Services (SSRS) and Excel (VBA).
- Advanced experience working with big and complex data sets within large organizations including languages SQL, PL/SQL.
- Applying best practices and modern techniques to improve existing schemas for performance and efficiency.
- Experience in regulative reports which is daily, monthly, and yearly.
- Exceeded goals on 3+ projects by modifying extensive data into actionable business insights via data visualization and analysis.
- Building and maintaining data warehouses, data marts and data lakes that support reporting, analytics, and other business intelligence needs.
- Working with the data governance teams to develop and implement data policies, standards and procedures to ensure data quality, security and privacy.
Financial Specialist
UniBank OJSC
Baku
09.2018 - 12.2020
- Developed and managed budgets, creating financial forecasts.
- Analyzed financial data, preparing financial reports, and presenting findings to management.
- Created Excel automatic reports and dashboards for payroll.
- Perform a comprehensive analysis of the effects of financial issues like company debt and other financial structures.
- Worked in SQL and Excel (VBA).
- Planned strategies of departments and calculated bonuses for employees annual, monthly and quarterly.
Accountant
Qasr Construction Company
01.2015 - 12.2022
- Created automatic reports on Excel (VBA) and calculated PNL of company.
Trainer
01.2015 - 12.2022
- Educated employees of any company and students.
Lecturer
Baku Engineering University
01.2015 - 12.2022
- Educated based on supervised and unsupervised models.
Education
Mathematics (Bachelor) -
Baku State University
05.2018
Computer Engineering (Master) -
Baku Engineering University
05.2020
Skills
- Python
- Spark
- SQL
- PL/SQL
- PL/pgSQL
- Excel (VBA)
- Oracle
- MongoDB
- PostgreSQL
- SQL Server
- Hadoop
- Apache Spark
- Impala
- Apache Kafka
- Toad Developer
- PL/SQL Developer
- Debezium
- Apache Iceberg
- Apache Nifi
- Airflow
- Trino
- Mage
- SAP
- IBM Cognos
- Power BI
- Tableau
- Grafana
- Jira
- Gitlab
- Weka
Timeline
Data Engineer
Azerbaijan Land Transport Agency
07.2025 - Current
Chapter Lead - Data Engineer
KapitalBank OJSC
06.2023 - 06.2025
Data Engineer
UniBank OJSC
01.2023 - 06.2023
BI Engineer
UniBank OJSC
01.2021 - 01.2023
Financial Specialist
UniBank OJSC
09.2018 - 12.2020
Accountant
Qasr Construction Company
01.2015 - 12.2022
Trainer
01.2015 - 12.2022
Lecturer
Baku Engineering University
01.2015 - 12.2022
Mathematics (Bachelor) -
Baku State University
Computer Engineering (Master) -
Baku Engineering University