Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

bjJqdmVRR3ZPMXJseVNJbnRrNkZlNk9sZ3c9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

Introlligent Inc.

Project Coordinator Job at Introlligent Inc.

 ...Key responsibilities include: Providing project management support for key programs Assisting business program managers with analysis...  ...to lift 25 pounds The ability to work independently at a remote warehouse on occasion The ideal candidate will have global... 

KFC

KFC ASSISTANT RESTAURANT MANAGER - HOURLY Job at KFC

 ...Description: Join the Tasty Chick'n KFC family and find a great career, because this is a place where great people work together in a great company. At Tasty Chick'n we realize the importance of every employee to the successful operation of our business, and genuinely... 

Heron Wolf

Estimator/PM - Civil Job at Heron Wolf

 ...we want to bring on someone that feels that perhaps a role closer to home might suit them especially if they have bid or build SCA, MTA, DASNY type work (up to $80M). In this role, you will have access to the President , inputting on what projects we go at, and the... 

urban

Junior Interior Designer Job at urban

 ...Financial District of San Francisco, this national architecture and design firm are seeking an innovative and dedicated design...  ...group. The ideal candidate will possess a good understanding of interior design principles, architectural concepts, and workplace design... 

The Claremont Colleges Services

Interim Catholic Chaplain Job at The Claremont Colleges Services

Interim Catholic ChaplainThe Claremont Colleges Services (TCCS) is the central coordinating and support organization for a highly regarded cluster of seven independent colleges known as The Claremont Colleges. TCCS, with about 300 staff members, provides exceptional...