Big Data Engineer

2 days ago


Fatih, Istanbul, Turkey Orion Innovation Full time

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

We are seeking a big data engineer for one of our clients. The successful candidate will be responsible for overseeing the creation and maintenance of our database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and creating and training data models.

Responsibilities
  • Design the architecture of our big data platform
  • Build lakehouse PoC and make lakehouse technology decisions (based on our requirements)
  • Build a scalable and performant data model satisfying our existing use cases and future plans using object storage (S3-compatible)
  • Build code architecture and deployment infrastructure for data pipelines development using orchestrator (Airflow) and Spark
  • Prepare documentation, knowledge transfer sessions and run books for data lake and data platform
  • Mentor engineering team during work process
  • Maintain our data pipeline and data lake platform
  • Customize and oversee integration tools, warehouses, databases, and analytical systems
  • Configure and provide availability for data-access tools
Job Qualifications And Skill Set
  • 3 to 5 years of relevant data engineering experience
  • Experience designing data model which utilizes object (S3-like) storage and used for massive parallel processing using Spark
  • Experience running lake house technologies (DeltaLake, Iceberg) in production on big datasets (TB of data)
  • Experience with pipeline orchestrators (Airflow/Dagster)
  • Experience writing and operating Spark pipelines at scale (hundreds of cores, TBs or RAM)
  • Experience with JVM based languages (Kotlin would be a plus)
  • Experience with Python
  • Excellent command of English both verbal and written

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Engineering and Information Technology

Industries

IT Services and IT Consulting

#J-18808-Ljbffr

  • Fatih, Istanbul, Turkey Withcherry Full time

    Withcherry is seeking a Big Data Engineering Manager to lead our big data engineering efforts. You will be responsible for managing a team of engineers to design and implement large-scale data systems using big data technologies such as Hadoop and Spark.The ideal candidate will have a strong understanding of big data technologies, with experience in leading...


  • Fatih, Istanbul, Turkey 健慫 Full time

    As a member of our Big Data Engineering team you'll get the opportunity to work with data at incredible scale that helps us improve the quality of our products. Peak's Big Data Platform fuels the process of data-driven decisions by utilising the latest big data tech stack to collect and process terabytes of incoming data on a daily basis. Our team of...

  • Big Data Engineer

    7 days ago


    Fatih, Istanbul, Turkey TELPA A.Ş. Full time

    Company Overview:Huawei's Turkey R&D Center is a key investment outside China, providing a platform for ambitious individuals to contribute to world-class projects.We are eager to welcome engineers who are enthusiastic about contributing to open-source Big Data projects such as Apache Doris, Apache HBase, and Apache Spark. Our team is committed to innovation...


  • Fatih, Istanbul, Turkey Orion Innovation Full time

    As a Big Data Engineer at Orion Innovation, you will play a critical role in shaping our data infrastructure and driving business growth through data-driven insights.The successful candidate will have 3-5 years of relevant data engineering experience, including designing data models that utilize object storage and massive parallel processing using Spark....

  • Big Data Engineer

    7 hours ago


    Fatih, Istanbul, Turkey Coderspace Full time

    About Coderspace">We are a fintech company with a global perspective, providing comprehensive solutions in the field of payment systems. Our expertise includes digital wallet infrastructure, transactions, money orders, mobile operations, and alternative payment methods. We hold the PC-DSS certificate, which sets us apart as a secure and reliable partner.">We...

  • Big Data Engineer

    7 hours ago


    Fatih, Istanbul, Turkey Eminevim Full time

    Are you passionate about data analytics and eager to contribute to a dynamic team? Do you have a strong background in data management, analysis, and reporting?We are seeking a talented Business Intelligence Developer to join our team at Eminevim. As a member of our team, you will have the opportunity to work on challenging projects, collaborate with...


  • Fatih, Istanbul, Turkey 健慫 Full time

    Focusing on building and maintaining a robust big data platform, you'll work closely with our engineering team to develop and refine our data-driven approach. As a key contributor, you'll shape the future of our platform by designing and implementing scalable, secure, and efficient data solutions.This role requires expertise in multiple areas, including...


  • Fatih, Istanbul, Turkey 健慫 Full time

    We're seeking a seasoned software engineer to join our team and contribute to the development of our big data platform. In this role, you'll be responsible for designing, building, and maintaining scalable data processing systems, leveraging expertise in distributed systems, cloud computing, and data engineering.As a critical member of our team, you'll...


  • Fatih, Istanbul, Turkey Orion Innovation Full time

    Orion Innovation is a leading global business and technology services firm that drives transformation and innovation through digital strategy, experience design, and engineering.We are seeking a Big Data Engineer to oversee the creation and maintenance of our database infrastructure. The ideal candidate will be responsible for collecting and maintaining...


  • Fatih, Istanbul, Turkey Randstad Türkiye Full time

    We are currently looking for Fresh Graduate and Junior Data Engineers to join our team based in our Huawei Turkey R&D Center (For Istanbul – Ankara – Izmir offices).ResponsibilitiesEmploy big data solutions and build the ETL pipelines that power the lifecycle of AppGallery operation from serving, search, recommendation, discovery, and...


  • Fatih, Istanbul, Turkey BIG GmbH Full time

    About Our CompanyBIG GmbH, a leading consulting company based in Munich, focuses on Analytics and SAP Business Technology Platform (BTP). Our mission is to help customers become data-driven companies by leveraging our technical expertise in Data & Analytics, Integration, Application Development & Automation, AI and Cloud Platform Services.We pride ourselves...


  • Fatih, Istanbul, Turkey SmartInfo Data Solution Full time

    Direct message the job poster from SmartInfo Data SolutionSmartinfo serves corporate customers in the field of Data and Software Technologies by offering both turnkey solutions and outsourcing services with its experienced team, specialized in Data Warehousing, Advanced Data Analytics, Need-Based Software Development Solutions, Big Data, Mobile and Web...

  • Data Engineer

    1 week ago


    Fatih, Istanbul, Turkey Blackkite Full time

    We are looking for aData Engineer (Backend Developer) to join our growing team. In this role, you will be responsible for collecting and processing large-scale digital data related to companies, integrating with external systems, and building high-performance solutions to support our cybersecurity intelligence platform.This role offers the opportunity to...


  • Fatih, Istanbul, Turkey Getir Full time

    At Getir, we are looking for a skilled Sr. Machine Learning Engineer to join our team and drive impactful, data-driven insights across the delivery domain.This role combines hands-on model development with opportunities for strategic input, allowing you to tackle real-world challenges through advanced data science. You will work collaboratively to ensure...


  • Fatih, Istanbul, Turkey Procter & Gamble Full time

    Job DescriptionWe are currently seeking a skilled Data Engineer to join our industry leading Data & Analytics team.The ideal candidate will have experience in designing, building, and implementing data pipelines and analytics platforms using various cloud platform components and tools such as Microsoft Azure, Google Cloud, or Amazon Web Services.Data...


  • Fatih, Istanbul, Turkey Procter & Gamble Full time

    Job SummaryWe are looking for a skilled Data Engineer to join our Data & Analytics team.The ideal candidate will have experience in designing, building, and implementing data pipelines and analytics platforms using various cloud platform components and tools.Data Pipeline DevelopmentCloud Architecture and ImplementationAutomation and OptimizationInfluencing...

  • Data Scientist

    1 day ago


    Fatih, Istanbul, Turkey Temblor Full time

    Temblor, Inc. is a Silicon Valley tech company that builds global catastrophe models for the public and the insurance industry to quantify real-time seismic hazard and risk using the concepts of stress transfer and the tools of machine learning.Our commercial products include dynamic hazard and loss forecasts, the first globally consistent insurance loss...


  • Fatih, Istanbul, Turkey Gullivers Full time

    Our ideal candidate must be very ambitious about working in a team that always looks for having the best internal process & customer experience using great technology. You'll need to work hard to adapt yourself into a big project and start taking responsibility. You should also consider this opportunity as a long-term career path decision; and get ready to...


  • Fatih, Istanbul, Turkey Temblor Full time

    We are looking for a skilled Geospatial Model Developer to join our team at Temblor. As a Geospatial Model Developer, you will be responsible for designing, developing, testing, and deploying geospatial models for earthquake risk assessment using machine learning and big data tools.You will work closely with our team of experts in geospatial modeling,...


  • Fatih, Istanbul, Turkey Coderspace Full time

    Sipay, Electronic Money and Payment Services Inc. is a fintech company with a dynamic and innovative perspective in the field of payment systems, bringing together under one roof the digital wallet infrastructure, transactions with or without cards, money orders, mobile operations, and all other alternative payment methods. Providing extensive solutions with...