PySpark Developer W2 Contracts Hybrid positions in Iselin, NJ Job at CDRP Technologies, Iselin, NJ

WDdzSzhkOG56UTFBVzVYK0dLcEI0c08xWWc9PQ==
  • CDRP Technologies
  • Iselin, NJ

Job Description

Responsibilities:

  • Develop, maintain, and optimize data processing pipelines using PySpark on Azure Cloud.
  • Collaborate with cross-functional teams to understand data requirements and translate business needs into technical specifications.
  • Design and implement scalable data models and data architecture to support analytical and reporting needs.
  • Perform data cleansing, transformation, and enrichment processes to enhance data quality and usability.
  • Monitor and troubleshoot data processing jobs, ensuring high availability and performance.
  • Implement best practices for data governance and security within Azure Cloud.
  • Stay up-to-date with emerging technologies in big data, cloud computing, and the financial services industry.

Requirements:

  • Minimum of 9 years of experience in PySpark development.
  • Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.).
  • Prior experience in the banking, investment banking, or financial services sector is mandatory.
  • Proficient in PySpark for data processing and ETL tasks.
  • Experience with SQL and NoSQL databases.
  • Familiarity with data warehousing concepts and tools.
  • Knowledge of Azure services related to big data and analytics.

Preferred, but not required:

  • Experience with containerization technologies (e.g., Docker, Kubernetes).
  • Familiarity with machine learning frameworks (e.g., MLlib, TensorFlow).

Job Tags

Similar Jobs

LeverageTek Staffing Solutions

Sharepoint Developer Job at LeverageTek Staffing Solutions

 ...Job Description LeverageTek is actively seeking a SharePoint Developer for a 12-month contract with its Ottawa-based customer. Work Location Remote Security Requirement Must have a Government of Canada Secret Clearance Key Tasks Developer Tasks... 

Sysco

Local Class A CDL Truck Driver Job at Sysco

 ...Career? Come join the SYGMA Pennsylvania Team . Our Delivery Drivers run 2 to 4 routes per week, with routes out no more than 36...  ...CERTIFICATIONS AND/OR TECHNICAL REQUIREMENTS:~ Valid Class A Commercial Drivers License. Must be insurable to operate a vehicle... 

Prudent Engineering

Land Surveyor Job at Prudent Engineering

What we are looking for? Prudent Engineering has an opening for a Land Survey Party Chief with 5+ years of experience. Please note that you must have a valid New York State Drivers license and must live in the state of New York. This a daily field position, and ...

CiresiMorek

Environment, Health and Safety Manager Job at CiresiMorek

 ...health, and safety strategy. This position will be responsible for policy management, regulatory compliance, and incident response. The EHS Manager will work with the plant leadership to build a strong safety culture and create an environment conducive to maintaining the... 

Varsity Tutors, a Nerdy Company

New Haven Technical Writing Tutor Job at Varsity Tutors, a Nerdy Company

Join to apply for the New Haven Technical Writing Tutor role at Varsity Tutors, a Nerdy Company3 days ago Be among the first 25 applicantsJoin to apply for the New Haven Technical Writing Tutor role at Varsity Tutors, a Nerdy CompanyGet AI-powered advice on this job...