Big Data Developer

Brooksource

Description:

We are seeking an experienced and highly skilled Big Data – Data Processing Specialist to join our team. In this role, you will be responsible for the development, maintenance, and enhancement of code that processes high-volume encounter claims data and testing solutions, all while aligning with our client’s systems strategy, requirements, and design. If you have advanced knowledge of Scala, expertise in Hadoop troubleshooting, and a preference for Java-backed solutions, we want to hear from you.

Responsibilities:

  • Develop, maintain, and enhance code for processing high-volume encounter claims data.
  • Test solutions to ensure alignment with clients’ systems strategy, requirements, and design.
  • Utilize Hadoop framework via Scala Spark and BRE to process large volumes of data and perform data validation at runtime.
  • Update documentation related to code and processes.
  • Provide effort estimation for development tasks.
  • Collaborate with other development teams as needed.

    Qualifications:

    • Scala: Advanced proficiency is a must.
    • Hadoop: Extensive experience, specifically for troubleshooting.
    • Java: Preferred for backend development.
    • HIVE Query Language: Strong understanding.
    • SQL (Structured Query Language): Proficiency in SQL.
    • Spark Framework: Solid experience.
    • Object-Oriented Programming (OOP): Strong grasp of OOP principles.
    • Big Data: Knowledge of big data concepts and technologies.

    Preferred Skills:

    • HIVE: Proficiency in HIVE.
    • Java: Proficiency for backend development.
    • Object-Oriented Programming (OOP): Advanced OOP skills.
    • SQL (Structured Query Language): Advanced SQL skills.

    Additional Information:

    This position is a crucial part of our project to enhance our data warehouse ETL process for understanding pharmaceutical transactions from CMS. As a Big Data – Data Processing Specialist, you will play a vital role in ensuring the efficient and accurate processing of large volumes of data, contributing to the success of our organization and our mission to provide valuable insights to our clients.


    The humanity paradox: Thriving in the age of automation

    In the age of artificial intelligence (AI) and hiring automation, it’s easy to feel lost in a digital crowd. It’s easy to feel overshadowed by algorithms and data-driven decision-making. However, there’s a compelling paradox at play here: In a world increasingly dominated by technology, your greatest asset may very well be your humanity.

    Related Industries: AI, All Industries

    Into the (Un)known

    Robert Delfs explains how the framework of knowns and unknowns can help instructors along the path of discovery.

    Related Industries: Computer Science, Data
    An image shows a student wearing a suit and smiling at the camera.