Data Engineer
Job Title Data Engineer 5
Yrs Technical/Functional Skills Data Engineer Experience Required 10
to 15 years of experience in Development, design, Architect implementation, and analytics solutions 6
Years of Experience on Python 6
Years of Experience on AWS Hands on development Design and Develop applications using Python/Pyspark and AWS Terraform Knowledge/Version changes Hands on experience is required Snowflake and Datawarehouse experience are required Data Bricks experience is added advantage.
From an AWS perspective, candidates need to be very well versed with Terraform, Glue, Lambda, S3 and their usage and practical issues faced when dealing with them.
At least 5
Experience on AWS (Glue, S3, lambda at the minimum) Candidates need to be very skilled in Python core programming and Spark.
Ability to design and demonstrate system Architecture with different environments.
Hands on experience on Data Warehousing and SQL Experience on Pandas Strong expertise in SQL is required.
Solid experience with git software version control and good understanding of code branching strategies and organization for code reuse Very Strong Data Bricks Architecture/Development knowledge Experience with DevOps & CI/CD tools Jenkins, Cloudbees, Please Build, etc.
Proficiency working with large data stores and data sets Health care knowledge is preferred.
Agile methodology (Jira Preferable) Roles & Responsibilities Must have capability to understand the current Architecture Coding, testing and implementation of cloud-based Spark apps support existing code thru enhancing, trouble shooting and maintaining per requirements maintain consistent practices for source code management in github comply with established CICD practices, and participate in the creation of new CICD methods attend daily scrum calls, and actively participate in updating/creating user stories and tasks in Jira Work closely with business analysts.
Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data centric technologies for the platform.
Collaborating within a project team to solve complex problems.
Lead by example coaching and mentoring those of your peers and mentoring less experienced team members.
Operate as part of the extended management team.
Duration of assignment (in Months) 12
Months Work Location (State, City and Zip) Bloomfield, CT Key words to search in resume AWS PySpark/ Python, Snowflake, Terraform & Sql Diverse Lynx LLC is an Equal Employment Opportunity employer.
All qualified applicants will receive due consideration for employment without any discrimination.
All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role.
We promote and support a diverse workforce across all levels in the company.
Recommended Skills Agile Methodology Amazon Web Services Apache Spark Architecture Benchmarking Big Data Estimated Salary: $20 to $28 per hour based on qualifications.
Yrs Technical/Functional Skills Data Engineer Experience Required 10
to 15 years of experience in Development, design, Architect implementation, and analytics solutions 6
Years of Experience on Python 6
Years of Experience on AWS Hands on development Design and Develop applications using Python/Pyspark and AWS Terraform Knowledge/Version changes Hands on experience is required Snowflake and Datawarehouse experience are required Data Bricks experience is added advantage.
From an AWS perspective, candidates need to be very well versed with Terraform, Glue, Lambda, S3 and their usage and practical issues faced when dealing with them.
At least 5
Experience on AWS (Glue, S3, lambda at the minimum) Candidates need to be very skilled in Python core programming and Spark.
Ability to design and demonstrate system Architecture with different environments.
Hands on experience on Data Warehousing and SQL Experience on Pandas Strong expertise in SQL is required.
Solid experience with git software version control and good understanding of code branching strategies and organization for code reuse Very Strong Data Bricks Architecture/Development knowledge Experience with DevOps & CI/CD tools Jenkins, Cloudbees, Please Build, etc.
Proficiency working with large data stores and data sets Health care knowledge is preferred.
Agile methodology (Jira Preferable) Roles & Responsibilities Must have capability to understand the current Architecture Coding, testing and implementation of cloud-based Spark apps support existing code thru enhancing, trouble shooting and maintaining per requirements maintain consistent practices for source code management in github comply with established CICD practices, and participate in the creation of new CICD methods attend daily scrum calls, and actively participate in updating/creating user stories and tasks in Jira Work closely with business analysts.
Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data centric technologies for the platform.
Collaborating within a project team to solve complex problems.
Lead by example coaching and mentoring those of your peers and mentoring less experienced team members.
Operate as part of the extended management team.
Duration of assignment (in Months) 12
Months Work Location (State, City and Zip) Bloomfield, CT Key words to search in resume AWS PySpark/ Python, Snowflake, Terraform & Sql Diverse Lynx LLC is an Equal Employment Opportunity employer.
All qualified applicants will receive due consideration for employment without any discrimination.
All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role.
We promote and support a diverse workforce across all levels in the company.
Recommended Skills Agile Methodology Amazon Web Services Apache Spark Architecture Benchmarking Big Data Estimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
