This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are in search of a Data Engineer, ready to utilize their skills in a dynamic setting. The industry we operate in is highly data-driven, and your role will be pivotal in managing and interpreting this data.
Job Responsibility:
Develop and manage streaming applications using Apache Kafka for real-time data processing
Implement algorithms and data structures to solve complex data problems
Utilize Apache Pig and Apache Spark to process large datasets efficiently
Develop APIs to facilitate data access
Leverage cloud technologies to ensure scalable and secure data storage
Perform data visualization to present insights in an easily understandable manner
Use Python and SQL for data extraction and manipulation
Implement Kubernetes and Terraform for orchestration and infrastructure as code
Manage SQL Server and DB2 databases for structured data storage
Ensure continuous integration and continuous delivery (CICD) for efficient software development and deployment
Conduct analytics to derive valuable insights from collected data
Requirements:
Minimum of 3 years of experience in a Data Engineer role or similar
Proficiency in Apache Kafka, Apache Pig, and Apache Spark
Ability to implement algorithms and perform data visualization tasks
Solid background in analytics and API development
Strong skills in SQL and Python programming languages
Familiarity with Kubernetes and Terraform
Experience with SQL Server and DB2 database systems
Understanding of Continuous Integration / Continuous Delivery (CICD) workflows
Ability to work independently and as part of a team
Excellent problem-solving skills and attention to detail
Strong verbal and written communication skills
Bachelor's degree in Computer Science, Data Science, or a related field preferred
What we offer:
Medical, vision, dental, and life and disability insurance
Welcome to
CrawlJobs.com
– Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.