Senior Data Engineer, Cogoport

Senior Data Engineer

Cogoport

Location:

India, Mumbai

Category:

IT - Software Development

Contract Type:

Employment contract

Salary:

Not provided

Save Job

Apply Position

Job Description:

We are looking for a Senior Data Engineer (SDE 3) to build scalable, high-performance data solutions that drive actionable insights for logistics, freight pricing, shipment tracking, and operational efficiencies.

Job Responsibility:

Design and develop real-time and batch ETL/ELT pipelines for structured and unstructured logistics data (freight rates, shipping schedules, tracking events, etc.)
Optimize data ingestion, transformation, and storage for high availability and cost efficiency
Ensure seamless integration of data from global trade platforms, carrier APIs, and operational databases
Architect scalable, cloud-native data platforms using AWS (S3, Glue, EMR, Redshift), GCP (BigQuery, Dataflow), or Azure
Build and manage data lakes, warehouses, and real-time processing frameworks to support analytics, machine learning, and reporting needs
Optimize distributed databases (Snowflake, Redshift, BigQuery, Apache Hive) for logistics analytics
Develop streaming data solutions using Apache Kafka, Pulsar, or Kinesis to power real-time shipment tracking, anomaly detection, and dynamic pricing
Enable AI-driven freight rate predictions, demand forecasting, and shipment delay analytics
Improve customer experience by providing real-time visibility into supply chain disruptions and delivery timeline
Ensure high availability, fault tolerance, and data security compliance (GDPR, CCPA) across the platform
Improve query performance for large-scale logistics datasets through indexing, partitioning, and caching techniques
Implement data quality checks, lineage tracking, and metadata management for transparency and governance
Work closely with product managers, data scientists, and logistics experts to translate business needs into scalable data solutions
Partner with business teams to deliver revenue-impacting insights on freight, shipments, and trade patterns

Requirements:

6+ years of experience in data engineering, working with large-scale distributed systems
Strong proficiency in Python, Java, or Scala for data processing
Expertise in SQL and NoSQL databases (PostgreSQL, Cassandra, Snowflake, Apache Hive, Redshift)
Experience with big data processing frameworks (Apache Spark, Flink, Hadoop)
Hands-on experience with real-time data streaming (Kafka, Kinesis, Pulsar) for logistics use cases
Deep knowledge of AWS/GCP/Azure cloud data services like S3, Glue, EMR, Databricks, or equivalent
Familiarity with Airflow, Prefect, or Dagster for workflow orchestration
Strong understanding of logistics and supply chain data structures, including freight pricing models, carrier APIs, and shipment tracking systems

Nice to have:

Experience in building predictive analytics solutions for freight rates, demand forecasting, and risk assessment
Experience in machine learning model deployment and MLOps practices
Exposure to real-time analytics and OLAP systems
Certifications in AWS/GCP Data Engineering

What we offer:

Work with some of the brightest minds in the industry
Entrepreneurial culture fostering innovation, impact, and career growth
Opportunity to work on real-world logistics challenges
Collaborate with cross-functional teams across data science, engineering, and product
Be part of a fast-growing company scaling next-gen logistics platforms using advanced data engineering and AI

Additional Information:

Job Posted:

March 26, 2025

Employment Type:

Fulltime

Work Type:

On-site work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.