PySpark Developer W2 Contracts Hybrid positions in Iselin, NJ Job at CDRP Technologies, Iselin, NJ

WDdzSzhkOG56UTFBVzVYK0dLcEI0c08xWWc9PQ==
  • CDRP Technologies
  • Iselin, NJ

Job Description

Responsibilities:

  • Develop, maintain, and optimize data processing pipelines using PySpark on Azure Cloud.
  • Collaborate with cross-functional teams to understand data requirements and translate business needs into technical specifications.
  • Design and implement scalable data models and data architecture to support analytical and reporting needs.
  • Perform data cleansing, transformation, and enrichment processes to enhance data quality and usability.
  • Monitor and troubleshoot data processing jobs, ensuring high availability and performance.
  • Implement best practices for data governance and security within Azure Cloud.
  • Stay up-to-date with emerging technologies in big data, cloud computing, and the financial services industry.

Requirements:

  • Minimum of 9 years of experience in PySpark development.
  • Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.).
  • Prior experience in the banking, investment banking, or financial services sector is mandatory.
  • Proficient in PySpark for data processing and ETL tasks.
  • Experience with SQL and NoSQL databases.
  • Familiarity with data warehousing concepts and tools.
  • Knowledge of Azure services related to big data and analytics.

Preferred, but not required:

  • Experience with containerization technologies (e.g., Docker, Kubernetes).
  • Familiarity with machine learning frameworks (e.g., MLlib, TensorFlow).

Job Tags

Similar Jobs

Forhyre

Project Manager Job at Forhyre

 ...facing and internal communication skills Excellent written and verbal communication skills Solid organizational skills including attention to detail and multi-tasking skills Strong working knowledge of Microsoft Office PMP / PRINCE II certification is a plus... 

Allied Universal

Armed Security Officer - Weekends Job at Allied Universal

 ...Allied Universal, North America's leading security and facility services company, offers...  ...where appropriate; escort visitors and contractors, secure ingress and egress points, secure...  ...years of law enforcement, military, or private armed security experience Minimum of... 

Reed & Reed, Inc.

HR Generalist / Recruiter Job at Reed & Reed, Inc.

 ...The recruiter will collaborate with General Superintendents on a regular basis to identify current and future hiring needs, be responsible for writing job postings and advertisements, reviewing resumes and applications, setting up interviews and screening on the phone... 

Suncrest Hospice

On-Call Registered Nurse (RN) Job at Suncrest Hospice

Why Suncrest: We are seeking an RN On-Call for the weekends to work Friday, Saturday and Sunday. This role will help with admissions and visits on Friday from 8a-8p and be backup for the on-call shift at night. This role will be the primary RN on Saturday and Sunday... 

Clay Furniture

Cabinet Maker / Carpenter (entry or mid-level) Job at Clay Furniture

 ...solid surface and many types of wood to customize exactly what the customer needs. This Position We are looking for a full-time, cabinet fabricator to operate our panel saw. In this position, you will load full sheets of plywood into a large saw and cut all the...